Many classes of functions can be developed into a function series. There are different kinds of function series possible. Each analytic function e.g. can locally be given by a convergent power series. A simple form of such a power series is the Taylor series. A Taylor series has some nice properties.
As you've already noted, the denominator of the Taylor coefficient is already a factorial. This comes from the $n$-th derivative of the summand term $x^{n}$ and is simply a result of the properties of the Taylor series. And it is a result of the power rule of differentiation. Higher product rule and higher power rule contain partitions of derivatives of lower degree. This is the combinatorial nature of the factorial in Taylor series and in derivatives.
The numerator of the $n$-th Taylor coefficient, the $n$-th local derivative, can also be interpreted combinatorially. It can be described as Bell polynomial. That is a partition polynomial. It contains all partitions of all derivatives of lower degree, and its coefficients contain the number of integer partitions and the number of set partitions; they are called multinomial coefficients of the third kind. Therefore this coefficients contain factorials in the numerator and in the denominator. Speaking pictorially, partial derivatives and higher derivatives are integer partitions. And this partition structure is maintained in exponential generating functions and in ordinary generating functions.
Factorials are the building blocks of the frequency numbers of combinatorial objects, i.e. of combinatorial numbers. They form binomials, multinomials and other combinatorial numbers which express the frequency of combinatorial structures like combinations, permutations, integer partitions, set partitions and combinatorial objects which are assembled from this basic structures.
The combinatorial interpretation and the interpretation by functions are often two pictures of the same thing. Both are interrelated by generating functions.