Women get called lesbian pretty much for breaking any male-defined standard of femininity, not just being unattracted to the accuser. In the past, breeches of these standards have included smoking, riding a bicycle, working for pay, and being uninterested in cooking or rearing children.