The integration problems one gets in Calculus 2 have integrands specially tailored to admit sufficiently simple closed-form antiderivatives. In the platonic world of mathematics, integrands are more likely to have horrendous-looking antiderivatives than clean-looking, and much more likely still to not have any elementary closed-form. We have to be picky about defining special functions: the zoo is too large to name all non-elementary functions, so we need to pick the ones that (a) turn up the most, (b) are the most interesting, and (c) have the broadest utility.
In my experience, most special functions turn up in the contexts of differential equations, number theory, and combinatorics (with complex analysis as a given). The most general kind of special function that I am aware of is actually a family of them, multivariable hypergeometric functions, which are defined through infinite series expansions with ratios of rising factorials as coefficients.
The hypergeometrics are widely applicable because seemingly almost any elementary function and many non-elementary functions and their moms and dogs can all be expressed as one. For an easier example of how a single special function can "cover extra territory" than one might initially guess, consider the Lambert W function. It is the inverse of $xe^x$. So $W(xe^x)=x$, ignoring technical things like branch cuts in the complex plane. Initially the only kind of equation would seem to be useful for is $xe^x=a~\Rightarrow~ x=W(a)$. Somewhat surprisingly, some pretty simple manipulations allow things like $e^x+x=a$ to be solved (subtract $x$ from both sides, multiply both sides by $e^{a-x}$, ????, profit). We want our special functions to have the widest applicability, all else equal.
Many elementary functions (expressions obtained through the elementary operations applied to compositions of exponentials, logarithms, trigonemtric and inverse trigonometric functions - if we work with complex variables, the latter two are special cases of the former two) that we find do not have an elementary antiderivative. And we've seen we want there to be some strategy in which of these we pick to define as special functions. It is not just that we haven't yet found antiderivatives and suspect there aren't any, we can prove there aren't any.
Some examples are $e^{e^x}$ and $e^{-x^2}$. I think $\sin\sin x$ is another example, but I can't locate a source and I am not personally familiar with the machinery to determine if it is. A heuristic or rule of thumb is that composing exponential or trigonometric functions is walking a tightrope when it comes to having elementary antiderivatives. Perhaps the reason $\int \sin\sin xdx$ doesn't have a name is that it's not something that really comes up in practice. However, it turns out there are some instances of trig functions composed with trig functions occurring "in nature." The special functions needed for this situation are the Bessel functions (which appear in another answer here).
There are historically some other impossibility issues that have turned up. The ancients could bisect an angle but could not trisect one. At the turn of the $18$th century, we could solve cubics and quartics but could not solve a general quintic. The Abel-Ruffini theorem proved the impossibility of solving generic fifth degree or higher polynomials using radicals. Galois developed his theory of symmetry of equations which explained why this was true. It turns out that the impossibility of trisecting angles is a corollary to Galois theory. Very fittingly the current subject which deals with the impossibility of integrating some elementary functions is an outgrowth called differential Galois theory. There are various theorems and algorithms of significance here; see this thread.
(With sufficiently general hypergeometric functions one can exactly solve arbitrary polynomials.)
The real question here, then, is why is it so easy to differentiate and so hard to integrate? There are various rules to differentiate things like products and compositions. The closest product rule for integrals is by-parts and the closest chain rule for integrals is substitution. Why the asymmetry?
This very question was posed here. My favorite answer is that local operations are easier than global operations (differentiation is local and integration is global).