I've always had the question of whether formal logic, number theory, or set theory "comes first" in foundations, and I've seen questions asking this. However, I recently came to what I think is the main source of my worry in the form of a specific question.
My question is, is there a way to prove that method of induction on the construction of well-formed formulas works in a non-circular way?
I am okay with taking induction on natural numbers axiomatically on the basis that saying "the natural numbers satisfy induction" is part of what we mean when we talk about natural numbers. It is easy to imagine how we could prove induction on wffs from induction on natural numbers.
However, my main question is the following: How do we know we haven't presupposed induction on wffs in the process of proving that induction on wffs follows from induction on natural numbers? Can this be done in a non-circular manner?
In order to state the axioms of natural numbers or a set theory strong enough to emulate natural numbers, we need first-order logic. In first-order logic, there are a number of results such as the unique readability theorem and the theorem of recursive definitions on wffs that rely on induction on wffs. Do we need these results to define number theory and/or set theory?
My worry is that we need unique readability or recursive definitions to define number theory / set theory containing number theory, and since unique readability & recursive definitions rely on induction on wffs, it renders the proof that $$ \text{induction on natural numbers}\implies\text{induction on wffs} $$ circular.