We can easily show that $n$ is a factor of the sum of $p$-th powers of the first $n$ integers , by assuming that the sum is a general polynomial of order $p+1$, and setting $n=0$, giving a zero constant term (as the sum is the same whether counted from $0$ or from $1$).
However, it is interesting to note that for odd $(>1)$ values of $p$, $n^2$ is a factor as well, and in fact, $n^2(n+1)^2$ are factors.
Is there a simple way of showing that $n^2$ is a factor of the sum of odd powers $(>1)$ of the first $n$ integers, without evaluating the entire summation or equating coefficients for the entire polynomial (and, preferably, without using Faulhabner's formulas and Bernoulli numbers)?
For instance, in the case of the fifth power, $$\sum_{r=1}^n r^5=an^6+bn^5+cn^4+dn^3+en^2+fn+g$$ As described above, $g=0$. How can we show that $f=0$ without first evaluating the other non-zero coefficients?