I haven't tried it personally, but my understanding it that the Passport office downtown (10th floor, corner of International and Peachtree) is same-day service.
Just checked on this, and you can only use this service if you need your passport in less than 2 weeks.
