Too lazy to whip up anything fancy, but
program z2
use ISO_FORTRAN_ENV,only:wp=>REAL128
real(wp) zeta,x
integer k, M
M = 100000000
zeta = sum([(1/sqrt(real(k,wp)),k=1,M)])- &
2*sqrt(M+0.5_wp)-1/(48*sqrt(M+0.5_wp)**3)
write(*,*) zeta
end program z2
Spits out $-1.46035450880958681288949915247298$, which has $29$ digits of $\zeta\left(\frac12\right)$ correct. What you are doing amounts to analytical continuation of the Riemann zeta function.
You want proof? OK, all I can remember about the midpoint rule is that
$$\int_0^1f(x)dx=f\left(\frac12\right)+Cf^{\prime\prime}(\xi)$$
For some $\xi\in(0,1)$. I can never remember the value of $C$, but if $f(x)=\frac12\left(x-\frac12\right)^2$, then
$$\int_0^1f(x)dx=\frac12\frac13\frac18(2)=\frac1{24}=f\left(\frac12\right)+Cf^{\prime\prime}(\xi)=0+C\cdot1=C$$
So then we can say that
$$\begin{align}\sum_{k=1}^Nf(k)&=\sum_{k=1}^Mf(k)+\sum_{k=M+1}^Nf(k)\\
&=\sum_{k=1}^Mf(k)+\int_{M+\frac12}^{N+\frac12}f(x)dx-\frac1{24}\sum_{k=M+1}^Nf^{\prime\prime}(\xi_k)\\
&=\sum_{k=1}^Mf(k)+2\sqrt{N+\frac12}-2\sqrt{M+\frac12}-\frac1{24}\sum_{k=M+1}^Nf^{\prime\prime}(\xi_k)\end{align}$$
There is a mean value theorem that allows you to bound
$$-\frac1{24}\sum_{k=M+1}^Nf^{\prime\prime}(\xi_k)$$
by
$$-\frac1{24}\int_{M+\frac12}^{N+\frac12}f^{\prime\prime}(x)dx=-\frac1{24}\left[f^{\prime}\left(N+\frac12\right)-f^{\prime}\left(M+\frac12\right)\right]$$
To within a little variation of the endpoints. For the Riemann zeta function, $\zeta(s)$ with $\Re s>1$, this accelerates convergence but more importantly taking the limit as $N\rightarrow\infty$ just mean throwing out all the upper bound terms. The term with $M$, however makes the whole thing converge for $\Re s>0$ and so provides analytical continuation of the Riemann zeta function. I retained the
$$\frac1{24}f^{\prime}\left(M+\frac12\right)=-\frac1{48}\left(M+\frac12\right)^{-3/2}$$
term in my program because it's the right next-order term and helps convergence along. Thus I was approximating
$$\zeta\left(\frac12\right)\approx\sum_{k=1}^M\frac1{\sqrt k}-2\sqrt{M+\frac12}-\frac1{48}\left(M+\frac12\right)^{-3/2}$$
So this not only provides analytical continuation but accelerates convergence. Whoops, I see that I had the wrong sign on that last term, here let me fix it... now it's good to $29$ digits, that's more like it!