Let $A, B \in M_n(\mathbb{R})$ , $\alpha\in\mathbb{R}$, such that $A^2-B^2=\alpha(AB-BA)$. Prove that
$a)$ If $\alpha=0$ and $n$ odd, then $\det(AB-BA)=0$
$b)$ If $\alpha\neq0$ then $(AB-BA)^n=0_n$
For $a)$ we use the fact that $$\det(A+B)(A-B)=\det(A-B)(A+B)$$ which means that $$\det(AB-BA)=\det(-(AB-BA))$$ and since $n$ is odd we obtain the conclusion. The second point is, however, a little bit trickier. I managed to show just that $\det(AB-BA)=0$. Using the same method as for $a)$, we observe that $$\det((\alpha+1)(AB-BA))=\det((\alpha-1)(AB-BA))$$ and since $\alpha\neq0$, we obtain that our determinant is $0$, but from here I don't have any idea what should I do next.