$b$ square-free $\Longrightarrow b = \prod_{B\subset\mathbb{P}}b'$ for a finite set of prime numbers $B$.
When $a$ is a perfect square $\pmod{b'}$, for all $b' \in B$, $a$ is a perfect square $\pmod{b}$.
Because $b$ is square free, we know that the prime factors are unique and the exponents in the factorization are all unitary. If $B$ is the set of divisors of $b$ and $[n]_m = \{n \pmod{m}\} \in \mathbb{Z}/m\mathbb{Z}$, then Chinese Remainder Theorem implies the intersection $\bigcap [a^2]_{b' \in B} = [a^2]_b$, because the residues remain constant as the modulus ranges.
The Dover Edition of Number Theory by Andrews covers this in Chapter 5.