The Digamma Function
Differentiating the logarithm of $\Gamma(x+1)=x\,\Gamma(x)$ gives
$$
\frac{\Gamma'(x+1)}{\Gamma(x+1)}=\frac1x+\frac{\Gamma'(x)}{\Gamma(x)}\tag1
$$
that is, the digamma function satisfies
$$
\psi(x+1)=\frac1x+\psi(x)\tag2
$$
Since $\log(\Gamma(x+1))-\log(\Gamma(x))=\log(x)$, the Mean Value Theorem says that there is a $\xi\in(x,x+1)$ so that
$$
\frac{\Gamma'(\xi)}{\Gamma(\xi)}=\log(x)\tag3
$$
Because $\Gamma$ is log-convex, we get that
$$
\log(x-1)\lt\psi(x)\lt\log(x)\tag4
$$
Therefore,
$$
\lim_{x\to\infty}(\psi(x)-\log(x))=0\tag5
$$
The Extended Harmonic Numbers
If we define
$$
H(x)=\sum_{k=1}^\infty\left(\frac1k-\frac1{k+x}\right)\tag6
$$
then we get by using Telescoping Series
$$
\begin{align}
H(x+1)-H(x)
&=\sum_{k=1}^\infty\left(\frac1{k+x}-\frac1{k+x+1}\right)\\
&=\frac1{x+1}\tag7
\end{align}
$$
and for $n\in\mathbb{N}$, $H(n)=H_n$, the $n^\text{th}$ Harmonic Number.
As is shown in this answer,
$$
\lim_{n\to\infty}(H_n-\log(n))=\gamma\doteq0.57721566490153286060651209\tag8
$$
If $|x-n|\lt1$, then $|H_n-H(x)|\le\frac1{n-1}$ and $|\log(n)-\log(x)|\le\frac1{n-1}$. Therefore, we get that
$$
\lim_{x\to\infty}(H(x)-\log(x))=\gamma\tag9
$$
Relation Between $\boldsymbol{H(x)}$ and $\boldsymbol{\psi(x+1)}$
Equations $(2)$ and $(7)$ say that for $f(x)=H(x)-\psi(x+1)$, we have
$$
f(x+1)=f(x)\tag{10}
$$
Equations $(5)$ and $(9)$ say that
$$
\lim_{x\to\infty}f(x)=\gamma\tag{11}
$$
Therefore, we get that $f(x)=\gamma$; that is,
$$
H(x)=\psi(x+1)+\gamma\tag{12}
$$
To The Question
In your question you seem to be equating $x$ and $m$. I will use only $m$ since it is more commonly used for an integer.
Your equation
$$
h(m)=H_m+\frac1{m+1}-2\tag{13}
$$
is correct. $(13)$ can also be written as
$$
h(m)=H_{m+1}-2\tag{14}
$$
As shown in $(12)$, $H_{m+1}=\psi(m+2)+\gamma$, so $(14)$ becomes
$$
h(m)=\psi(m+2)+\gamma-2\tag{15}
$$
It would seem that the formula that Mathematica gives would be for
$$
\gamma+\psi(m+2)-H_m-2=h(m)-H_m\tag{16}
$$