The base case is clear, since if $n\gt 4, 5!=120\gt 25=5^2$
So assume $n=k$ which shows that $k!\gt k^2$.
Then if $n=k+1$,
$$(k+1)!=(k+1)k!$$ $$\gt (k+1)k^2 $$ Induction argument $$=k^3+k^2$$ $$\gt k^2+2k+1$$ $k^3>2k+1, \forall k\ge4$ $$=(k+1)^2$$
Is this a good proof? I never attempted the factorial induction proofs, and I first tried proving the other direction, that $n^2<n!$, and starting with $(k+1)^2$.