A metaphor for staying neutral in any given dispute. If you don't want to come down one on side of an argument or another, that leaves you sitting on the proverbial fence. Often used derisively, to imply wishy-washyness.