Not really. Actually, what you want is uniform convergence and majorant series.
DEFINITION 1 Let $f_n(x)$ be a sequence of functions. In particular, suppose $f_n(x)=\sum_{k=0}^n g_k(x)$ for some sequence $\{g_k\}_{k\in \mathbb N}$ of functions. Let $D$ be the set of points $x$ such that $\lim f_n(x)$ exists. Call $D$ the domain of convergence of $f=\lim f_n$.
An important property is a series might have is being majorant.
DEFINITION 2 We say that a series of functions is majorant in a certain domain $D'$ if there exists a convergent positive series $A=\sum a_k$ such that, for each $x$ in that domain $D'$ we have $|g_k(x)|\leq a_k$. Given a series $f=\lim f_n=\lim\sum^n g_k$, we say that $f$ converges absolutely if $f^*=\lim\sum^n |g_k|$ converges. (Thus, a majorant series is absolutely convergent.)
Yet another important case scenario is uniform convergence:
DEFINITION 3 (Uniform convergence) We say a series of functions converges uniformly in $D$ if for all $\epsilon>0$ there is an $N$ (depending only on $\epsilon$), such that $n\geq N$ implies $$|f(x)-f_n(x)|<\epsilon $$
We usually say $N$ is independent of the choice of $x$, too. You can picture this behaviour as follows: Each partial sum is always contained in the strip inside $f(x)+\epsilon$ and $f(x)-\epsilon$ of width $2\epsilon$.
In particular, every majorant series converges uniformly. This is known as Weierstrass' $M$ criterion. For majorant series, the following is valid:
THEOREM 1 If the series $\sum u_k(x)$ composed of functions with continuous derivates on $[a,b]$ converges to a sum function $s(x)$ and the series $$\sum u'_k(x)$$ composed of this derivatives is majorant on $[a,b]$, then $$s'(x)=\sum u'_k(x)$$
This stems from
THEOREM 2 Let $s(x)=\sum u_k(x)$ be a series of continuous functions, majorant on some $D$. Then, if $x$ and $\alpha$ are in $D$
$$\int_\alpha^x s(t)dt=\sum\int_\alpha^xu_k(t)dt$$
You can read this in much more detail, and find proofs, in (IIRC) Apostol's Calculus (Vol.1)
