Lemma 5.3 - I omit proof here - Let p be prime. Then $x^2 \equiv 1 \, (mod p) \iff x \equiv \pm 1 \; (mod p)$
First we establish the result for the first two primes 2, 3. Then prove the result for the remaining primes. for $p=2$, $(2-1)!\equiv 1\equiv-1$ (mod2) $p=3$, $(3-1)! \equiv 2\equiv-1$ (mod3)
Now let the prime $p\geq 5$ and consider the least non-negative residues modulo $p$: $ 1,\ 2,\ 3,\ 4,\ \cdots\ ,\ p-1 $
(1) Why consider $p = 2,3$ separately? http://www.millersville.edu/~bikenaga/number-theory/wilson-fermat/wilson-fermat.html starts with all primes?
By the above Lemma (5.3) we know that the first and last numbers in this list, 1 and $p-1$, is its own inverse. The inverse of the remaining residues 2, 3, 4, $\cdots,\ p-2$ is another number (and not itself) in this list. $\color{magenta}{Why? \quad (♯)}$
(2) Can someone please amplify $\color{magenta}{Why?}$
Consider the linear congruence $ax\equiv 1 \; (mod\ p)$ where $a=2,3,4,\ \cdots,\ p-2$
(3) How can you preconceive to consider this linear congruence? Why?
Since $gcd(a,\ p)=1$, so by the Linear Congruence Theorem, $ax\equiv 1 \; (mod\ p)$ has a unique solution $x\equiv b \; (mod\ p)$, where $b\not\equiv a \; (mod\ p)$ because (♯) means each of the $a=2,3,4,\ \cdots,\ p-2$ is not its own inverse.
This means that residues $a$ and $b$ can be paired up amongst the list $2,\ 3,\ 4,\ \cdots,\ p-2$ such that $ab\equiv 1(mod\ p)$ . I exclude the rest of the proof.
Origin – this better than Jones, p71 Theorem 4.6