There is a really nice way to phrase this, that should introduce you to some notation you should really know.
Let us define the function $v_p:\mathbb{Z}\to\mathbb{N}\cup\{\infty\}$ by defining $v_p(x)$ to be the highest $i$ such that $p^i$ divides $x$ (where we take $v_p(0)=\infty$). Let us then extend $v_p$ to a map $v_p:\mathbb{Q}\to\mathbb{Z}$ by setting $v_p\left(\frac{a}{b}\right)=v_p(a)-v_p(b)$. One can quickly check that $v_p$ enjoys the following nice property:
$$v_p(xy)=v_p(x)+v_p(y)\quad\mathbf{(1)}$$
Moreover, we see by mere definition, that $p\mid x$ for $x\in\mathbb{Z}$ if and only if $v_p(x)>0$. Now, note that by $\mathbf{(1)}$ we have that
$$\displaystyle \begin{aligned}v_p\left({p\choose k}\right) &= v_p\left(\frac{p!}{k!(p-k)!}\right)\\ &= v_p(p!)-v_p(k!)-v_p((p-k)!)\end{aligned}\quad\mathbf{(2)}$$
But, since $\ell!=1\cdots \ell$ we can use $\mathbf{(1)}$ again to deduce that for each $\ell\in\mathbb{N}$ one has that
$$v_p(\ell!)=\sum_{j=1}^{\ell}v_p(j)$$
Now, if $j<p$ then evidently $p\nmid j$ so that $v_p(j)=0$. Thus,
$$v_p(k!)=\sum_{j=1}^{k}v_p(j)=\sum_{j=1}^{k}0=0$$
and
$$v_p((p-k)!)=\sum_{j=1}^{p-k}v_p(j)=\sum_{j=1}^{p-k}0=0$$
But
$$v_p(p!)=\sum_{j=1}^{p}v_p(j)=\sum_{j=1}^{p-1}v_p(j)+v_p(p)=\sum_{j=1}^{p-1}0+1=1$$
Thus, using $\mathbf{(2)}$ we may conclude that
$$v_p\left({p\choose k}\right)=1-0-0=1$$
and thus $\displaystyle p\mid {p\choose k}$, and moreover $p$ is the highest power of $p$ dividing ${p\choose k}$.