Here is another answer, which main idea is : if $f$ is right or left continuous, there is an "explicit" solution (see the integrals below).
Claim : Every increasing function $f$ can be written as a sum of an increasing right-continuous function and a left-continuous function.
Proof : the set of points at which $f$ is discontinuous is at most countable : it will be denoted $(a_n)_{n \in \mathbb{N}}$. Now we take $g : x \mapsto \sum \limits_{\substack{n \in \mathbb{N}\\ a_n \le x}} f(a_n)-f(a_n^-)$ and $h = f-g$. It is easy to show that $g$ is right-continuous. If $x \notin \{a_n\}$, $f$ and $g$ are continuous at $x$, so $h$ is continuous at $x$. If $x=a_n$, $g(t) \underset{t \to x^-}{\longrightarrow} g(x)-\big( f(a_n)-f(a_n^-) \big)$, so $h(t) \underset{t \to x^-}{\longrightarrow} f(a_n^-)-g(x)+\big( f(a_n)-f(a_n^-) \big)=h(x)$. Hence $f=g+h$ with $f$ increasing and right-continuous, and $h$ left-continuous.
$ $
If we write $f=g+h$ with $g$, $h$ as in the claim, both $f$ and $g$ are increasing, thus locally bounded and with at most countably many discontinuity points. Hence $f$ and $g$ are Riemann integrable, and so is $h$. For $n \ge 1$, we can thus consider : $$
g_n : x \mapsto n \displaystyle{\int_x^{x+\frac{1}{n}}} g(t)dt,\quad \
h_n : x \mapsto n \displaystyle{\int_{x-\frac{1}{n}}^x} h(t)dt, \quad \
f_n : x \mapsto g_n(x)+h_n(x).$$
As $g$ (resp. $h$) is right (resp. left)-continuous, it is easy to prove that for all $x$, $g_n(x) \underset{n \to +\infty}{\longrightarrow} g(x)$ and $h_n(x) \underset{n \to +\infty}{\longrightarrow} h(x)$, so $\big(f_n\big)_{n \ge 1}$ converges pointwise to $f$. As $g$ and $h$ are locally bounded, $g_n$ and $h_n$ are continuous for all $n$, and thus $\big( f_n \big)_{n \ge 1}$ is a sequence of continuous functions.