If you consider a cross-section of the sphere at a height $h$ above the equatorial plane, you get a circle of radius $\sqrt{r^2-h^2}$, and circumference $2\pi\sqrt{r^2-h^2}$.
Then you can be tempted to conclude that the area of the sphere is the average perimeter from $-r$ to $r$, which would yield $\pi^2r^2$.
But you must take into account the fact that the surface is not vertical but oblique and there is a correction factor equal to the secant of the angle of the normal, or $\dfrac r{\sqrt{r^2-h^2}}$.
So after simplification you are just integrating $2\pi r$ from $-r$ to $r$, which explains the factor $4$.
A geometric interpretation is by saying that any slice of small height $\delta h$ in a sphere has the same area (!)