It can also be used in place of the word fuck, when in the presence of small children.
"Oh FUC- FUDGE! Oh fudge... I um, like fudge... shit... I mean, ships! Ships float on the water, and you can uh, eat fudge on the ships... Yes those ships sure have mighty fine fudge on them, mighty fine fudge..."