In a follow up to this post Boundedness of an operator composed with a sequence of pseudo inverses, I've arrived at the following problem to fix the issue in the paper I'm reading:
Consider an infinite dimensional separable Hilbert space $\mathcal{H}$, and let $A$, $B_m$, and $L$ denote linear, compact operators. Suppose further that $\|B_m\|_{op} \le \rho^m$ for some $0<\rho < 1$, and $L$ is symmetric and positive definite, so that the spectral theorem gives
$$ L(\cdot) = \sum_{\ell=1}^\infty \lambda_\ell \langle \phi_\ell,\cdot\rangle \phi_\ell, \;\; \sum_{\ell=1}^\infty \lambda_\ell < \infty. $$ We define a pseudo-inverse of $L$ as
$$ L^{-1}\pi_n(\cdot) = \sum_{\ell=1}^n \frac{ \langle \phi_\ell,\cdot\rangle}{\lambda_\ell} \phi_\ell. $$ ($\pi_n$ is the projection onto $span(\phi_1,...,\phi_n)$). The assumption of the paper is that $$ D = \sum_{\ell=1}^\infty \frac{ \|A(\phi_{\ell})\|^2}{\lambda_\ell} < \infty. $$ What I want to then show is that
$$ \xi_m =\|L^{1/2}B_mL^{-1}\pi_n A^* \|_{HS}^2 = \sum_{j=1}^\infty \|L^{1/2}B_mL^{-1}\pi_n A^*(\phi_j)\|^2 \le Const. \rho^m, $$ or find a counter example to this inequality that fits within this framework. Some simple arithmetic with the various definitions gives
$$ \xi_m = \sum_{j=1}^\infty \left\| \sum_{\ell=1}^{n} \frac{ \langle \phi_j, A(\phi_\ell) \rangle }{\lambda_\ell} L^{1/2}B_m(\phi_\ell) \right\|^2. $$ Notice that if we trade $B_m$ for the identity, then using that $\phi_j$ are eigenfunctions of $L^{1/2}$ and Parseval's identity, we get that $\xi_m$ becomes $\sum_{\ell=1}^n \frac{ \|A(\phi_{\ell})\|^2}{\lambda_\ell}$, which is bounded by assumption. What I can't see though is how to "extract" $\|B_m\|_{op}$ from everything! If $L^{1/2}$ and $B_m$ commute, or are mutually diagonalizable by $\{\phi_j\}_{j\ge 1}$, then we are in business, since then
$$ \xi_m = \sum_{j=1}^\infty \left\| \sum_{\ell=1}^{n} \frac{ \langle \phi_j, A(\phi_\ell) \rangle }{\lambda_\ell} L^{1/2}B_m(\phi_\ell) \right\|^2=\sum_{j=1}^\infty \left\|B_m \left( \sum_{\ell=1}^{n} \frac{ \langle \phi_j, A(\phi_\ell) \rangle }{\lambda_\ell} L^{1/2}(\phi_\ell) \right) \right\|^2 \\ \le \|B_m\|_{op}^2 D . $$
Otherwise I cannot see how to get any kind of useful bound here, and assuming commutivity of those operators is not done in the paper (although perhaps it should!).
Can any of you smart folks think of a way to get this bound using some sort of fancy operator inequality that does not amount to assuming $L^{1/2}$ and $B_m$ commute?