$e$ is not useful. It just happens to be the value at $x = 1$ of the exponential function
$$e^x = \sum_{n=0}^{\infty} \frac{x^n}{n!}$$
which is incredibly useful because it is its own derivative. This fundamental property helps us solve differential equations, which are a very powerful language for understanding the universe.
The boring example is modeling something like the growth of bacteria. (As Raymond Manzoni's comment says, a more interesting example involving exponential growth is carbon dating.) A much more interesting example (to me, anyway) occurs if you allow $x$ to be something more general than a real number: allow it to be complex and you get Euler's formula
$$e^{ix} = \cos x + i \sin x$$
which tells you that the exponential can represent rotations in the plane. It also tells you that $\cos x$ and $\sin x$ can be used to describe simple harmonic motion, a basic and fundamental example of a differential equation describing real-world phenomena (such as circuits) that we know how to solve exactly thanks to the exponential function.
To be more specific, the current $I(t)$ in an LC circuit satisfies the differential equation
$$\frac{d^2 I}{dt^2} + \frac{1}{LC} I = 0$$
where $L$ is the inductance and $C$ is the capacitance. The complex exponential can be used to deduce that the solutions to this differential equation look like
$$I(t) = A \cos \omega t + B \sin \omega t$$
where $\omega^2 = \frac{1}{LC}$. This is a very precise description: the current is periodic and we can explicitly compute its period. Add in a resistor and you get a similar differential equation whose solutions can now be damped, and again we can explicitly compute how quickly the current is damped.
Exponentials are also closely related to the theory of the Fourier transform (which also helps us solve differential equations and much more besides), the normal distribution (which we use to understand statistics), approximating factorials (which we often need to do in computer science)...