I encountered the following change of summation $\sum_{i=1}^ \infty \sum_{j=1}^ \infty a_{i,j} = \sum_{j=1}^ \infty \sum_{i=1}^ \infty a_{i,j} $, in Ahtreya and Lahiri's "Measure theory and Probability theory", page 16, where it says that this is allowed since the summands $a_{i,j}$ are non-negative. I have encountered the same argument in other books of Measure theory, but never saw a proof in the appendix neither a reference of it.
From a web search I made, it seems that Fubini's theorem for double integrals in $R^n$, or, for a measurable function on a product measure space, is proved, and resembles very much my question. However, I cannot find a proof exactly for double sequences, as is my original question. This is quite strange, since this should be considerably easier to prove.
Can you kindly point me to one? Could you outline the proof, alternatively? Thanks a lot.