I decided to prove by induction (though am running into some issues).
(Base case) When $k = 1$, we have $$\binom{p}{1} = \frac{p!}{1! \cdot (p - 1)!} = p \equiv 0 \bmod p.$$ When $k = p - 1$, we have $$\binom{p}{p - 1} = \frac{p!}{(p - 1)! \cdot (p - p + 1)!} = \frac{p!}{(p - 1)! \cdot 1!} = p \equiv 0 \bmod p.$$ (Inductive step) For some $1 < k < p - 1$, assume $\binom{p}{k} \equiv 0 \bmod p$. We will show that $\binom{p}{k + 1} \equiv 0 \bmod p$. By substitution, we obtain $$\binom{p}{k + 1} = \frac{p!}{(k + 1)! \cdot (p - k - 1)!} = \frac{p!}{k!(p - k)!} \cdot \frac{p - k}{k + 1} = \binom{p}{k} \cdot \frac{p - k}{k + 1}$$ Since the inductive hypothesis assumes that $\binom{p}{k} \equiv 0 \bmod p \implies \binom{p}{k} \cdot a \equiv 0 \bmod p \ \forall \ a \in \mathbb{Z}$, I need to somehow show that $\frac{p - k}{k + 1}$ is an integer, but it doesn't seem like it always will be.
Ultimately, I think it may be easier to not use induction, but I think it can be done this way and I just want to see if anyone has a good idea on how to continue my logic.