Elaborating on Andrey's answer:
There are some similar questions (Q1 and Q2, e.g.) related to the convergence/divergence of the standard integral rep of $ \Gamma (s)$ on this site, so I thought it might be helpful for those familiar with basic complex analysis to look at an extended integral rep for $\Gamma (s)$ that is related to the function's singularities, i.e., the Cauchy–Saalschütz integral, which Andrey highlights.
In understanding the convergence of real Taylor series, you need to look at the complex domain and the singularities (hopefully, only simple poles at most) of the function it represents. The same can apply to integrals over the real line, so first do a partial fraction expansion of the Euler/Gauss rep (Eqn. 6.1.2 in Abramowitz and Stegun, pg. 255; also EOM article) of $\Gamma (s)$ in the complex plane and note the simple poles at $s=0, -1, -2, ...$ , consistent with the identity $\frac{1}{s!(-s)!}=\frac{\sin(\pi s)}{\pi s}$. Then if you are comfortable with the Mellin transform, you can easily write down a Hadamard finite part integral representation for sections between the poles:
For $-n<\Re(s)=\sigma<-(n+1)$, the inverse Mellin transform gives
$$\frac{1}{2\pi i}\int_{\sigma -i\infty }^{\sigma +i\infty } \Gamma(s) x^{-s}ds=\frac{1}{2\pi i}\int_{\sigma -i\infty }^{\sigma +i\infty }\frac{\pi }{\sin \left ( \pi s \right )}\frac{x^{-s}}{(-s)!}ds$$
$$=\exp(-x)-\left(1-x+\frac{x^2}{2!}+ ... + \frac{(-x)^n}{n!}\right),$$
and, therefore, the associated Mellin transform gives
$$\Gamma (s)=\mathrm{FP}\int_{0}^{\infty }x^{s-1}\exp(-x)dx = \int_{0}^{\infty }x^{s-1}\left[\exp(-x)-\left(1-x+\frac{x^2}{2!}+ ... + \frac{(-x)^n}{n!}\right)\right]dx.$$
Roughly speaking, the singularities at the lower limit $x=0$ of $\frac{x^{s+m}}{s+m}$ for $m=0, -1, ..., -n$ are being subtracted out.
For $\Re(s)=\sigma>0$, you obtain the standard integral rep.