Denote an artificial square E as a number:
$$E \in \Bbb{N}| \lnot (\exists y \in \Bbb{Z} | y^2 = E) \land (For \ each \ w \in \Bbb{Z} \ \exists a_w | a_w^2 \equiv E \ \pmod w) $$
In other words this numbers are able to pass every square test via modular arithmetic, but aren't squares themselves.
My guess is they don't exist. Simply because for a sufficiently large w. It will be clear that no number squares to E but I'm not sure if this is rigorous enough of an argument, or if I have somehow forgotten detail