The following is a proof that uses Wilson's Theorem. There are "easier" (and group-theoretically more natural) proofs that do not use Wilson's Theorem. The idea is due to Dirichlet.
Let $p$ be a prime of the form $4k+3$. We will assume that the congruence $x^2\equiv -1\pmod{p}$ has a solution, and use Wilson's Theorem to derive a contradiction.
If $x^2\equiv -1\pmod{p}$ had a solution $c$, then it would have exactly $2$ solutions, namely $c$ and $p-c$.
If $1\le a\le p-1$ and $1\le b\le p-1$, with $a\ne b$, call $a$ and $b$ buddies if $ab\equiv -1\pmod{p}$. Apart from $c$ and $p-c$, all numbers $a$ in the interval $1\le a\le p-1$ has a unique buddy $b\ne a$ in the interval $1\le b\le p-1$. So the numbers in the interval are divided into $\frac{p-3}{2}$ pairs of buddies, plus the numbers $c$ and $p-c$.
It follows that
$$(p-1)!\equiv (-1)^{(p-3)/2}(c)(p-c)\equiv 1\pmod{p}.$$
This contradicts Wilson's Theorem. It follows that there cannot be a $c$ such that $c^2\equiv -1\pmod{p}$.
Remark: The OP alluded to a Wilson's Theorem proof of the fact that if $p$ is of the form $4k+1$, then the congruence $x^2\equiv -1\pmod{p}$ has a solution. We give a different Wilson's Theorem based proof, that uses the ideas in the answer above.
Suppose to the contrary that $p=4k+1$ and the congruence $x^2\equiv -1\pmod{p}$ has no solution. Then all the numbers from $1$ to $p-1$ are divided into buddy pairs. It follows that $(p-1)!\equiv (-1)^{2k}\equiv 1\pmod{p}$, contradicting Wilson's Theorem.
Also, how do we know that $x^2 \equiv -1$ mod($p$) $\leftrightarrow$ $x$ has order $4$ in $(\mathbb{Z}{p\mathbb{Z}})^{x}$?
– letsmakemuffinstogether Jun 11 '15 at 05:07(\mathbb{Z}/p\mathbb{Z})^\times
) is the group of units of the integers modulo $p$. In other words, it consists of $$(\mathbb{Z}/p\mathbb{Z})^\times={[1],[2],\ldots,[p-1]}$$ and the group operation is multiplication of residue classes mod $p$. Here's the relevant Wikipedia article. – Zev Chonoles Jun 11 '15 at 05:10