Since you only asked for a hint, here's a big one.
$\cot^{-1}\alpha + \cot^{-1}\frac1\alpha$ is actually a constant. There are a few ways to prove this:
- Use the trig identity $\cot(x + y) = \frac{\cot x \cot y - 1}{\cot x + \cot y}$ with $x = \cot^{-1}\alpha$ and $y = \cot^{-1}\frac1\alpha$.
- Use the inverse trig identity $\cot^{-1}x + \cot^{-1}y = \cot^{-1}\left(\frac{xy - 1}{x + y}\right)$ with $x = \alpha$ and $y = 1/\alpha$.
- Use calculus to show that the derivative of $\cot x + \cot\frac1x$ is zero.
The third method won't tell you what the constant value is but I include the method for thoroughness. I recommend using the second method. The first method is more or less the same as the second method, just with extra steps. Anyway, once you get the actual value of $\cot^{-1}\alpha + \cot^{-1}\frac1\alpha$, you'll immediately have the answer to your original question.
EDIT: Because of the rules of domains and ranges for inverse trig functions, the sign of $\alpha$ is important. Both roots of $x^2 + 3x - \tan 2$ are negative. Keep this in mind when evaluating $\cot^{-1}\alpha + \cot^{-1}\frac1\alpha$.
cannot be equal to
what? – Bernard Jul 30 '16 at 11:50