$\newcommand{\Riem}[1]{\mathtt{#1}}\newcommand{\Left}{\Riem{Left}}\newcommand{\Right}{\Riem{Right}}$Too long for a comment, but possibly of interest. In general, letting $\Left(f, P)$ denote the left Riemann sum of $f$ with respect to a partition $P$ and $\Right(f, P)$ the right, we have
$$
\Right(f, P) - \Left(f, P) = \sum_{i=1}^{n} [f(x_{i}) - f(x_{i-1})]\, \Delta x_{i}.
$$
To construct a (non-integrable) function and a sequence of partitions whose mesh decreases to $0$ but the left and right Riemann sums approach different limits, we can define $f$ on $[0, 1]$ by $f(x) = 0$ for $x$ rational and $f(x) = 1$ for $x$ irrational, and choose a sequence of partitions whose points are alternately rational and irrational, but for which the "rational-to-irrational intervals" asymptotically have total length $1$ and whose "irrational-to-rational intervals" therefore asymptotically have total length $0$, so that $\Right(f, P) - \Left(f, P)$ does not converge to $0$.
For instance, if $n = 2k$ is an even positive integer we could pick our partition $P_{n} = (x_{i})_{i=0}^{n}$ by taking $x_{2j} = 2j/n$ for $0 \leq j \leq k$ and $x_{2j-1} = x_{2j} - 1/(\sqrt{2}\, n!)$ for $1 \leq j \leq k$. For each $j$ with $1 \leq j \leq k$, we have
\begin{align*}
[f(x_{2j-1}) - f(x_{2j-2})]\, \Delta x_{2j-1} = \Delta x_{2j-1} &= \frac{2}{n} - \frac{1}{\sqrt{2}\,n!}, \\
[f(x_{2j}) - f(x_{2j-1})]\, \Delta x_{2j} = -\Delta x_{2j} &= -\frac{1}{\sqrt{2}\,n!}.
\end{align*}
Consequently, $\Right(f, P_{n}) - \Left(f, P_{n}) = 1 - \frac{k\sqrt{2}}{n!} \to 1$ as $n \to \infty$.
Here, the left Riemann sums and right Riemann sums converge, but not to the same limit. Modifying this idea, it's not difficult to construct for this function and interval a sequence of partitions whose mesh decreases to $0$ but the left Riemann sums do not converge and the right Riemann sums do not converge.
On the other hand, in elementary calculus, one often uses equal-length partitions, for which $\Delta x_{i} = (b - a)/n$ is the same for each $i$. For such a partition, whether or not $f$ is integrable on $[a, b]$, the difference is a telescoping sum:
$$
\Right(f, P) - \Left(f, P) = \frac{b - a}{n} \sum_{i=1}^{n} [f(x_{i}) - f(x_{i-1})]
= \frac{b - a}{n} [f(b) - f(a)],
$$
and this converges to $0$ as $n \to \infty$, i.e., the left Riemann sum (for these partitions) converges if and only if the right Riemann sum converges, and if either exists the limits are equal. (Again, existence of such a limit does not guarantee $f$ is integrable!)