I guess to answer my question, I would need to construct a model of set theory in which N contains 0, 1, 2, etc. plus some extra junk and show that this model indeed works. Maybe someone has done this already? Or maybe it can be proven directly?
You can use the compactness theorem for first-order logic to construct such a model for ZFC, under the assumption that ZFC is consistent (i.e. has any models at all). A fun example is constructing a model whose $\mathbb{N}$ contains an infinite descending chain.
Add constants $N, c_0, c_1, c_2, \dots$ to the language of ZFC. Extend ZFC to premise $\Gamma$ by adding the following family of sentences:
"$N$ is the set of natural numbers", i.e. something like $N = \bigcap\{ x\mid x\text{ is an inductive set}\}$
$c_0 \in N$
$c_1 \in N$
$c_2 \in N$
$\vdots$
$c_0 > c_1$
$c_1 > c_2$
$c_2 > c_3$
$\vdots$
Consistency of ZFC implies that there is some model $M$ which satisfies ZFC. If $\Gamma_0 \subseteq \Gamma$ is finite, then there is a maximum $n$ such that the sentence $c_{n-1} > c_n$ is in $\Gamma_0$, so we can extend $M$ by (denoting $M$'s naturals by $0_M$, $1_M$, etc.) assigning:
$0_M$ to $c_n$,
$1_M$ to $c_{n-1}$,
$\vdots$
$(n-1)_M$ to $c_1$
$n_M$ to $c_0$
By design this assignment to constants $c_0, \dots, c_n$ satisfies all the sentences of form $c_i > c_{i+1}$ in $\Gamma_0$. We can satisfy all sentences of form $c_i \in N$ by, say, setting $c_i$ to $0_M$ for all $i > n$. As we've made no other changes to $M$, the finite subset of $ZFC$ contained in $\Gamma_0$ continues to be satisfied by this model, so we have a model which satisfies $\Gamma_0$.
Since we can do this for any finite $\Gamma_0 \subseteq \Gamma$, it follows from the compactness theorem that $\Gamma$ itself must have a model $M'$, within which there is now an infinite descending chain of naturals $c_0 > c_1 > c_2 > \dots$
As $\Gamma$ is a superset of $ZFC$, it follows that $M'$ is a model of $ZFC$ itself.
Also of note, facts like $\forall x\forall y(x\in N \wedge y \in N \wedge x < y \rightarrow x \in y)$ continue to hold in $M'$, so $c_0 \ni c_1 \ni c_2 \ni \dots$ is actually an infinite descending chain of set memberships, in apparent violation of the axiom of regularity. The rub is that $M'$ doesn't "know" about this sequence -- you won't find a function $f$ within $M'$ itself that has $f(i) = c_i$ for all $i \in \mathbb{N}$, even though there is clearly such a function in the observer language.