More generally (and in
probability-speak), for
any probability measure, any
random variable X taking value in some
interval I and any
convex function f defined on
I,
Ef(X) ≤ f(EX)
The same also holds if we replace the interval
I with
any convex region in
Rn.
See a proof of the Jensen inequality, if you like.