I was working on the Volume 2 book published by the Art of Problem Solving company when I came across a problem that I just didn't know how to start. The problem is as follows:
Q: Are there integers m and n such that $5m^2 - 6mn + 7n^2 = 1985?$ (IMO 1985)
Here is the solution (I made it a spoiler if anyone wants to solve the problem first):
A: Multiplying the equation by 5 and completing the square to get perfect squares, we obtain $(5m-3n)^2 + 26n^2 = 9925$. Taking the equation (mod 13) to eliminate the $26n^2$, we have $(5m-3n)^2 \equiv 6 \pmod {13}$. But the squares mod 13 are 0, 1, 4, 9, 3, 12, and 10; since 6 is not a square [I think it should say "quadratic residue" instead of "square"], there can be no such m and n.
I completely understand each step taken in the solution but I am still confused as to what I should have done before and during my attempt at solving the problem in order to be able to think of that method during a timed test. Is it just practice and having exposure to many types of problems, and what would you guys have done when solving/seeing the problem for the first time?