Presumably "strengthened finite Ramsey theorem" means the Paris-Harrington theorem; if not, what does it mean?
Peano arithmetic already proves "There is no largest natural number," so adding this statement to PA just yields PA again.
If you're interested in the axioms you need to add to (say) PA in order to prove certain arithmetic facts, you should look up reverse mathematics. But this is a fairly advanced subject, and you should be familiar with the basics of proof and model theory before you tackle it. Your question suggests you are not quite comfortable with the model theory of first-order logic, so I suggest you start there (Ebbinghaus-Flum-Thomas is a good source; Marker is better written and more advanced, but has typoes).
Meanwhile, (Rosser's strengthening of) Goedel's theorem constructively provides a sentence $\varphi$ which is undecidable in a theory $T$, whenever $T$ is computably axiomatizable, consistent, and contains (say) Robinson's $Q$. So I don't understand the last two sentences of your first paragraph.
EDIT: See also Why is the Axiom of Infinity necessary?.