If $p$ is prime and $p \mid a^k$, then $p \mid a$, and hence $p^k \mid a^k$; is this still valid if $p$ is composite?
I hope this simple approach works -
As $p$ is prime, and $a$ is repeated $k$ times, and it is not possible that there be a root of $p$, so $p \mid a$. Hence, $p^k \mid a^k$.
Regarding $p$ being composite, it is possible that $p = a^i, i \gt 1$ by an example : $p=49$, $a=7$; $p=16$, $a=4$; $p=125$, $a=5$; $p=64$, $a=4$.
Addendum - In wake of comments But that does not mean that $p \mid a^i => p \mid a$, as when $p=49, a = 7, i=2$, it does not mean that $49 \mid 7$.
So, seemingly this is true for both prime and composite $p$.
I request any argument(logic) based approach, even if it uses abstract algebra.