This saying originated in the Jonathan Letham book “Motherless Brooklyn”. One of the characters would say it whenever someone would start babbling about conspiracy. Basically a sarcastic way of pointing out the fact that someone is thinking far too much about something that in all probability should just be taken at face value.