In order to answer your question, one has to clarify it. You presumably mean
integrating explicitly elementary functions in terms of further elementary functions. Of course, a complete answer would required a precise definition of
this term but we can regard it informally as meaning one which is obtained from
the usual suspects (powers, trigonometric, exponential, logarithm, etc.) by simple operations (arithmetic, composition, etc.). The difference is then that while there are simple rules which describe what happens when differentiating,
there are no such ones for integration. For example, integration by parts merely
shifts the problem to a new integral---this might work in a particular case but not in general. You can see this effect when you use Mathematica which cannot integrate all elementary functions explicitly. By the way there is, rather surprisingly, a general theory which covers this topic and this is used in the algorithm employed by Mathematica.