Your argument shows that
$$\binom{p}{k} =p\left(\frac{(p-1)!}{k!(p-k)!}\right)$$
but it's not immediate that the factor ${\displaystyle{\frac{(p-1)!}{k!(n-k)!}}}$ is an integer.
To finish it, cross-multiply, and then use the primeness of $p$ . . .
\begin{align*}
\text{Thus,}\;\;&\binom{p}{k} =p\left(\frac{(p-1)!}{k!(n-k)!}\right)\\[4pt]
\implies\;&p(p-1)!=(k!)\bigl((p-k)!\bigr)\binom{p}{k}\\[4pt]
\end{align*}
Since $p$ is prime,
- $0 < k < p\implies p\not\mid k!$$\\[4pt]$
[since $p$ does not divide any of the factors $1,..,k$]$\\[4pt]$
- $0 < k < p\implies 0 < p - k < p \implies p\not\mid (p-k)!$$\\[4pt]$
[since $p$ does not divide any of the factors $1,..,p-k$]$\\[4pt]$
In the equation
$$p(p-1)!=(k!)((p-k)!)\binom{p}{k}$$
it's clear that $p$ divides the LHS, hence $p$ divides the RHS.
Thus, $p$ divides the product of the $3$ integers
$$k!,\;\;\;(p-k)!,\;\;\;\binom{p}{k}$$
hence, since $p$ is prime, $p$ must divide at least one of the $3$ factors.
Since $p\not\mid k!$, and $p\not\mid (p-k)!$, it follows that $p\,{\mid}\,{\large{\binom{p}{k}}}$, as was to be shown.