First, there is no single group that contains all finite groups as subgroups. This is so since there are simply too many finite groups, namely a proper class, and thus the class of all finite groups can't be contained in the power-set of any given set.
What is possible, as you and @anon show, is that there are groups that contain an isomorphic copy of each finite group. It is also possible to construct a group containing for every finite group a normal subgroup isomorphic to it. Clearly any such group must be infinite, it can't be abelian, and it must contain an element of any possible finite order.
For any increasing sequence of natural numbers ${n_k}$, the group $\prod S_{n_k}$ contains an isomorphic copy of any finite group (though not necessarily as a normal subgroup). This group, just like the group $S_\mathbb N$, which has the same property, has cardinality $c$.
Call a group with the property we discuss a cool group. Now, it is tempting to consider the intersection of all cool groups, and hope to show that it is a cool group, and thus the smallest such. However, this is hopeless because the intersection will simply be the empty set. One can try to remedy this situation in various ways but I'm not sure if it leads to anything good.
One obvious way to make the intersection make sense is to consider all cool groups that are subgroups of some fixed universal group. But then again, the up-to-isomorphism issue will prevent the intersection of all of these cool groups (which at least now is a group) from being cool. I'm not sure what else (if at all) there is to say about cool groups.