This keeps coming up. I love having the game in Jacksonville, myself. It's an awesome tradition, and an excuse to take a road trip to somewhere I normally wouldn't otherwise visit. I would be sad to see it go.
It has been the bye weekend before the game that has made the most difference, not the game's location.
If you want to hold the game in a neutral site, Jacksonville makes sense because, although it is much closer to UF, there are simply no venues large enough and with the facilities and appropriate atmosphere to host a college football game of this calliber that are an equal distance from both Athens and Gainesville. Rural Georgia basically occupies the area north of Jacksonville and south of Athens. It would be nice if we had a stadium large enough located directly between the two schools, but we don't. I mean, where else could you put it? Savannah? (this is why I've always envied the Red River Shootout. Dallas is a perfect neutral site between Austin and Norman).
You might could do a deal where you hold it in Jacksonville for 5 years and Atlanta for 5 years, so it would always be in a neutral site but half the time that site would be closer to one school than the other. Aside from that, keeping it in Jacksonville is the best option if you don't want to go home and away.