Georgia has an abundance of OHV trails that are perfectly suited for ATVs. Check for ATV parks or trails in state parks, as well as ATV rental agencies. You will need to stay away from perennial streams and private property where the owner has not given you explicit permission.
Check out these Fort Gaines, GA ATV/OHV resources:
