A record by the
Blues Magoos, a
psychedelic rock band from
Long Island. It was released in
1969.
jbrandon has let me know that this may alos be a reference to Dizzy Gillespie's song Manteca, in which he notes "Don't ever go back to Georgia."
He was treated poorly there (due to his skin color) twice by the same club owner, after being promised better treatment.
There is also a jam played by Carlos Santana in conjunction with Soul Sacrifice/Don't Try This at Home. For an example of this check out the version on Santana's live disk Sacred Fire from 1993.
The lyrics are as follow: (for the Santana jam)
Never go back to Georgia baby, don't ever go back - hey hey!
Never go back to Georgia baby, don't ever go back - hey hey!