Since we want to talk about the sum of cardinals, we first need to make sure that we know what is an infinite sum of cardinals.
And before that we need to make it perfectly clear. These are not natural numbers anymore. These are finite cardinals.
Suppose that $I$ is an index set, and for each $i\in I$, we have a cardinal $a_i$, then $\sum\limits_{i\in I} a_i$ is the cardinality of $\bigcup\limits_{i\in I}A_i$, where $\{A_i\mid i\in I\}$ is a set of pairwise disjoint sets, and $|A_i|=a_i$.
But why is this well-defined? Meaning, given two cardinals, $a,b$ we know that $a+b$ is well defined. If $A,A'$ have cardinality $a$ and $B,B'$ have cardinality $b$, and $A\cap B=A'\cap B'=\varnothing$, then $|A\cup B|=|A'\cup B'|$. How do we prove that? We pick some bijection from $A$ to $A'$ and from $B$ to $B'$ and we show that the union of these bijections is a bijection between the union of the sets.
Well that's fine and dandy. But what happens when we have an infinite sum? Well, if we have an infinite sum then we need to make infinitely many choices. And here we have to appeal to the axiom of choice. But let us, for a moment, assume the axiom of choice holds. In this case the same idea can be applied to the infinite case, we choose bijections as before and show that every two unions of these cardinalities will have the same size.
So in order to calculate what is $\sum\limits_{n\in\Bbb N} n$ we need to find a set which can be partitioned into infinitely many parts, each part having the cardinality of a different finite set. We can do that explicitly with $\Bbb N$ (as another answer shows), or we can use theorems to show that indeed $\Bbb N$ itself is such set. In either case, we have that $\sum\limits_{n\in\Bbb N}n=\aleph_0$.
We can also use other theorems about cardinal arithmetic to bound this sum from above and below by $\aleph_0$. For example, $$\aleph_0=\sum_{n\in\Bbb N}1\leq\sum_{n\in\Bbb N}n\leq\sum_{n\in\Bbb N}\aleph_0=\aleph_0.$$
The first equality holds because $\Bbb N$ is the union of $\aleph_0$ singletons; the second and third are obvious; and the final equality is true because in the presence of the axiom of choice repeated sums can be turn into a multiplication, so this is just $(\aleph_0)^2=\aleph_0$.
But what would happen if we decide not to accept the axiom of choice? Well, then we can't necessarily guarantee that we can choose bijections when considering infinite sums of cardinals. Could that affect the result? Yes, yes it can.
Consider if you will the case where there exists a Russell set, namely an infinite set which can be written as a countable union of pairwise disjoint pairs, but there is no function which chooses one element from each pair. Let $S$ be such set, and $\{S_n\mid n\in\Bbb N\}$ be such partition. We immediately observe that $S$ is not countable, despite being a countable union of pairs. Why? If it were countable, then we could have enumerated its elements and choose from each $S_n$ the one whose index is smaller.
Now the sum $\sum\limits_{n\in\Bbb N}2$ may depend whether or not we choose the $n$-th pair as $S_n$ or as $\{2n,2n+1\}$. In the former case we have a countable union of sets of size $2$, whose size is not countable; in the latter case we have a countable union of sets of size $2$, whose size is countable. So the infinite sum is not well-defined.
Of course, from this we can easily create an example where there are sets of size $n$ whose union is not countable. Simply inflate the $S_n$'s by adding natural numbers. The union of these inflated sets will have $S$ as a subset, so it couldn't possibly be countable (since subsets of a countable set are countable themselves); and on the other hand, well... $\Bbb N$ is the union of $\aleph_0$ finite sets of increasing size as before.
(And all that is left is that you believe me that it is consistent that a Russell set exists, and that is consistent with the failure of the axiom of choice.)