Suppose $a,b$ are positive numbers, $a\neq b$. Then, the relationship $$ \frac{1}{4}\left(\frac{1}{a}+\frac{1}{b}\right)>\frac{1}{a+b} $$ is true because we can rewrite it as $$ a+b>4\frac{ab}{a+b} $$ or $$ (a-b)^2>0 $$ My question: Is there a similar relationship for p.d. matrices (of suitable dimension so that addition and multiplication work), i.e., can one establish that $$ \frac{1}{4}\left(A^{-1}+B^{-1}\right)-(A+B)^{-1}>0? $$ With similar steps to the scalar case, I write the claim as $$ A+B-4B(A+B)^{-1}A>0, $$ from which the analogous steps to the scalar case do not directly go through anymore. Using, e.g., Inverse of the sum of matrices did not help me proceed, either.
For context, the assertion would help me establish the general case here (I believe/hope that specific application has no properties that I do not mention in my question here): https://stats.stackexchange.com/questions/588398/help-partitioned-samples-efficiency-in-ols-compared-to-one-sample-regression