I have to prove why each Peano axiom that doesn't hold for a set $\mathbb{N}$ with base case $1$, and $S(1) = 2, S(2) = 3, S(3) = 1$, and $S(n) = n + 1$ for all $n \geq 4$.
Assuming you have $S(4)=5, S(5)=6, S(6)=7, ...$
Some of the Peano Axioms do hold:
$1\in \mathbb{N}$ (edit)
$S: \mathbb{N} \to \mathbb{N}$
$S$ is injective
The two remaining axioms do not hold. (edit)
As you point out, $\forall x\in \mathbb{N}:S(x)\ne 1$ is falsified since you have $S(3)=1$. (edit)
The induction principle does not hold (intuitively) because the number 4 is not a successor of anything, even though it has to be a successor of something in order for the induction principle to work.
Peano's axioms do not require that every number but $1$ has a predecessor, although induction can be used to prove this.
Hint as to the actual reason why this function $S$ does not satisfy the induction axiom:
Let $P=\{1, 2, 3\}$.
$1\in P$.
$k\in P \implies S(k)\in P$
ADDED:
That was not very clear, I'm afraid. Induction will not hold on $\mathbb{N}$ with your successor function $S$ because we have a subset $X=\{4, 5, 6, ...\}$ the elements of which are not connected in any way to the subset $P=\{1, 2, 3\}.$
We have:
$1\notin X$
$\forall x\in X:\neg \exists y\in \mathbb{N}:[y\notin X\land S(y)=x]$
If we have $P=\{1,2,3\}$, then it can be shown that:
$$1\in P \land \forall x\in P: S(x)\in P\land \exists x\in N: x\notin P]$$
Generalizing...
$$\exists P\subset N : [1\in P \land \forall x\in P: S(x)\in P\land \exists x\in N: x\notin P]]$$
Or equivalently...
$$\neg\forall P\subset N:[1\in P \land \forall a\in P: S(a)\in P \implies P=N]$$
This the negation of the induction axiom.
Also see my answer at Are there natural numbers that are not the descendant of 0?