I managed to derive the following integral:
$$\zeta \left( s \right) ={\frac { \left( s-2 \right)}{\Gamma \left( s \right) } \int_{0}^{\infty }\!{u}^{s-3} \left( \zeta(2)-{\it Li_2} \left(1-{{\rm e}^{-u}} \right) \right) \,{\rm d}u}\qquad \Re(s) \gt 2 \tag{1}$$
where $Li_2(z)$ is the dilogarithm.
For $s=3$ this reduces to:
$$\zeta \left( 3 \right) =\frac12{\int_{0}^{\infty } \zeta(2)-{\it Li_2} \left(1-{{\rm e}^{-u}} \right) \,{\rm d}u} \tag{2}$$
or after the variable change $u=\ln(x)$:
$$\zeta \left( 3 \right) =\frac12{\int_{1}^{\infty } \frac{1}{x}\left(\zeta(2)-{\it Li_2} \left(1-\frac{1}{x} \right)\right) \,{\rm d}x} \tag{3}$$
or with $u=-\ln(x)$:
$$\zeta \left( 3 \right) =\frac12{\int_{0}^{1} \frac{1}{x}\big(\zeta(2)-{\it Li_2} \left(1-x\right)\big) \,{\rm d}x} \tag{4}$$
Searched the web for similar expressions, but haven't found anything related yet.
Could this be simplified any further into know expressions?
ADDED 1: A surprise outcome is that:
$$\zeta \left( 5 \right) =\frac12{\int_{0}^{1} \frac{1}{x}\big(\zeta(2)-{\it Li_2} \left(1-x\right)\big)^2 \,{\rm d}x} \tag{5}$$
ADDED 2: Found one more:
$$\zeta \left( 4 \right) =\frac{4}{5}{\int_{0}^{1} \frac{1}{x}\big(\zeta(3)-{\it Li_3} \left(1-x\right)\big) \,{\rm d}x} \tag{6}$$