I suppose you could use proof by contrapositive if you really wanted to, but that seems needlessly complicated for something that could so easily be considered with congruences (modular arithmetic), e.g., $47 \equiv -1 \mod 12$ or $47 \equiv 11 \mod 12$.
The simplest modulus would of course be 4 and you're done in the blink of an eye, but to make things a tiny bit more interesting I'm going to use 12; in order for a number to be divisible by 4, it must be 4, 8 or 0 modulo 12. The squares modulo 12 are 1, 4, 9, 4, 1, 0, 1, 4, 9, 4, 1, 0. Then the squares minus 3, taken modulo 12, are 10, 1, 6, 1, 10, 9, 10, 1, 6, 1, 10, 9; none of these are 4, 8 or 0.