$\newcommand{\ZZ}{\mathbb{Z}}
\newcommand{\Zx}{\ZZ\left[x\right]}
\newcommand{\Zxx}{\ZZ\left[\left[x\right]\right]}$A rather striking difference are the automorphisms.
For simplicity, I will compare the univariate polynomial ring $\Zx$ with the univariate FPS (= formal power series) ring $\Zxx$. A ring automorphism of $\Zx$ is a ring isomorphism $\alpha : \Zx \to \Zx$. By the universal property of polynomial rings, a ring morphism $\alpha : \Zx \to \Zx$ is uniquely determined by its value $\alpha\left(x\right)$. Moreover, it is easy to see that such a ring morphism $\alpha$ is an isomorphism if and only if $\alpha\left(x\right) = \pm x + c$ for some $\pm$ sign and some $c \in \ZZ$. Thus, there are countably many ring automorphisms of $\Zx$. In contrast, there are uncountably many continuous ring automorphisms of $\Zxx$: Indeed, if $f = f_1 x + f_2 x^2 + f_3 x^3 + \cdots$ is any FPS with zero constant term and with $x^1$-coefficient $f_1 \in \left\{1,-1\right\}$, then this FPS $f$ has a compositional inverse $g$, and the continuous ring morphism $\beta : \Zxx \to \Zxx$ that sends $x$ to $f$ thus has an inverse (namely, the continuous ring morphism $\gamma : \Zxx \to \Zxx$ that sends $x$ to $g$). Since there are uncountably many candidates for $f$, there are thus uncountably many continuous ring automorphisms of $\Zxx$. I'm not sure if there are additionally any discontinuous ones, but their existence cannot decrease the cardinality.
Another difference is that $\Zx$ is a free $\ZZ$-module, whereas $\Zxx$ is not (indeed, $\Zxx$ is isomorphic to $\ZZ^{\mathbb{N}}$ as a $\ZZ$-module, and it is well-known that the latter $\ZZ$-module is not free).
In practical terms, polynomials and FPS are indeed fairly similar in many aspects, except that FPS rings have to generally be considered as topological algebras (over their base rings) in order to be well-behaved, whereas polynomial rings are nice enough as (mere) algebras already. This is why I had to say "continuous ring morphism" above, for example -- as without the "continuous", a ring morphism from $\Zxx$ would not be uniquely determined by the image of $x$ (or so I think).