The worst problem with facing south is...

[SoonerBK]

It's so dang windy. Sometimes it blows dust in your eye.

[badger]

That scary horse statue on campus... wait, that faces north, doesn't it? Well, shoot

[stoopified]

The smell from Texas?

[hipsterdoofus]

You aren't facing Mecca

[Cornfed]

Mecca lives down the street to the north.