Let $(X_\lambda,B_\lambda,\mu_\lambda)$ be a disjoint collection of measure spaces indexed by $\lambda$. Define $X$ to be the union of all the $X_\lambda$. Define $B=\{S \subseteq X: S \cap X_\lambda \in B_ \lambda\ \forall \lambda\}$. Define $\mu(E)=\sum_\lambda \mu(E \cap X_\lambda)$.
Now, assume that $(X,B, \mu)$ is a $\sigma$-finite measure space. I want to show that all but countably many $\mu_\lambda(X_\lambda)$ have to be $0$.
I figured out that each $\mu_\lambda$ has to be $\sigma$-finite. This is because, writing $X=A_1 \cup A_2 \cup...$ as a union of finite measure sets, each $\mu_\lambda(A_i \cap X_ \lambda) \leq \mu(A_i)$ and hence must be finite. But I don't think same trick will work for proving the above.