It's a germanic word - dating at least from the Old English days when one declension of the word was wlyspian. German is lispen.
It almost certainly was never said or needed to be said by the afflicted ones themselves (same as for stutterers/stammerers), who might rarely have said anything for fear of retribution. They were probably looked upon as being soft-minded and fit only for low jobs, or sacrifices to the gods.