The practice of much of modern mathematics is based on certain assumptions, such as the axiom of infinity (the existence of an infinite set). The practice (of over 100 years) shows that this does not get us into contradictions - though we can have no proof of that, by the incompleteness theorem. Historically, such practice has been challenged by philosophers. Already in the 1630s, Cavalieri's indivisibles were attacked by contemporary theologians/mathematicians. Cavalieri's response was that his critics were doing philosophy, not geometry.
To a certain extent, the mathematicians developed axiom systems so as to be able to counter such objections by making the assumptions explicit: these are our assumptions, and these are our conclusions. Practically speaking, if one can do without certain assumptions, it is arguably preferable to avoid them. This is the case with axiomatizing the natural numbers by means of Peano Arithmetic PA. Tao does it in such a way that the existence of $\mathbb N$ is not assumed; it is only a convenient piece of notation, as is the non-existent "set of all sets" in the traditional set theory ZF.
PA is weaker than ZF, and in particular has no provisions for infinite sets. To go further and start developing, for example, real analysis, it is convenient to use ZF (or more) as the background system. At that stage, it becomes necessary to explain how a model for PA can be constructed within ZF, which is what Tao does later in his book.
You mentioned in one of your comments that "Tao is defining the 'properties of numbers' rather than explicitly constructing the 'numbers'. His construction doesn't explain numbers exist." But Tao is not giving a construction of the natural numbers in the early part of the book; rather, he is presenting an informal axiomatisation of the natural numbers, along the lines of Peano Arithmetic. As mentioned above, this requires fewer foundational commitments than a set-theoretic framework such as ZF. You can't "construct numbers" without assuming anything.
2.I slightly updated my post - I am still confused what I'm confused, hope you can bare with me!
– Bryan Shih Aug 20 '23 at 17:34