While waiting for responses to this question, I did some research and came across this function on $[0,1]^2$: $f(x,y) = 0$ if $x$ or $y$ is irrational and $f(x,y) = 1/q$ if $x$ and $y$ are rational and $x = p/q$ in lowest terms.
Its claimed that the double Riemann integral $\int_{[0,1]^2}f $ exists since $f$ is continuous almost everywhere, but if $x$ is rational then $\int_0^1 f(x,y)dy $ does not exist as a Riemann integral.
I understand the second part since $f(x,y)$ looks like the Dirichlet function (when $x =p/q$ fixed) alternating between $1/q$ and $0$ for rational and irrational $y$. Just because $f$ alternates between $0$ and a variable non-zero value off and on a rational grid does not make it completely obvious about the continuity.
So I would like to see how to prove the first part directly using Darboux sums.