Really it is just good taste. I mean who would actually wear blue and orange on purpose unless they are color blind.
I remember back in the day before the arrival of Spurrier and the Dawgs beat UF regularly, this whole area was heavily into UGA because UF used to be like UCF is now. Before Spurrier, UF never won a single SEC title (mid 80's win that was voided does not count because of probation). Back then most people supported UGA. After SOS had some success the bad wagon started filling up.
I think it is just good commons sense for people to support UGA. Red and Black look great together and we have Munson! All you get from being a UF fan is a GED, a mullet and a single wide somewhere west of Green Cove.