why a square deforms into an asymmetric quadrilateral, whereas the circle deforms into a symmetric ellipse
But the center of circle does not project to center of ellipse. If you color one half of circle (nearest to you) in red, you will see in perspective that more than half of the ellipse is in red. This agrees with the behavior of the square: the side near us appears larger.
Here is a picture which, according to Andrejs Treibergs, comes from Della pittura (1435) by Alberti. (It does not look that old to me, I guess it was re-drawn).

The center of the circle (below) is on the intersection of the diagonals of the square. Since collinearity is preserved in perspective, the center of the circle in perspective is on the intersection of the diagonals of the trapezoid above. When sketching this by hand, you would draw a horizontal line through this point to find where the ellipse is tangent to the sides of the trapezoid.
But this horizontal line is not the major axis of the ellipse (it's a typical novice mistake to think that it is). The major axis is below the line of tangency points; that is, the ellipse still gets wider after touching the trapezoid. On the diagram above, this effect is slightly exaggerated: the endpoints of the major axes should be marked a bit higher. But they definitely are below the tangency points.
I recommend this page (Mathematics of Perspective by Andrejs Treibergs) as a gentle introduction to the subject.