I got some useful information from this Question: Jensen's inequality in measure theory
Theorem 3.1 Jensen's Inequality
Let $(X,\mathcal{M},\mu)$ be a probability space (a measure space with $\mu(X) = 1$ ), $f: X \to \mathbb R \in L^1(X, \mu)$, and $\psi:\mathbb R \to \mathbb R $ be a convex function, then $$\psi\int_X f d\mu \le \int_X (\psi \circ f)d\mu$$
And that question asked whether Jensen's inequality still hold in general finite measure space ? A nice man d.k.o. answered:
Yes. In this case for convex $\varphi$ :$$\varphi\left(\frac{1}{\mu(X)}\int fd\mu\right)\le \frac{1}{\mu(X)}\int \varphi\circ fd\mu$$
However, this result is basically rescale $\mu$ to a probability measure.
So whether the following proposition hold?
Let $(X,\mathcal{M},\mu)$ be a general measure space, and $\mu(X) < \infty $,
$f: X \to \mathbb R \in L^1(X, \mu)$, and $\psi:\mathbb R \to \mathbb R $ be a convex function, then
$$\psi\int_X f d\mu \le \int_X (\psi \circ f)d\mu$$