To see an example of some pathology, while the direct sum of free modules is always free (with the obvious free basis), the direct product of free modules may fail to be free.
Take $R=\mathbb{Z}$; then $M = \mathop{\oplus}\limits_{n=1}^{\infty}\mathbb{Z}$ is free abelian, with basis given by the "obvious" elements $e_i$ (which have a $1$ in the $i$th coordinate and zeros elsewhere). However, $N = \prod\limits_{n=1}^{\infty} \mathbb{Z}$ is not free abelian. For example, Specker proved (Additive Gruppen von Folgen ganzer Zahlen, Portugaliae Math. 9 (1950) 131-140) that $N$ has only countably many homomorphisms onto $\mathbb{Z}$. But since $N$ is uncountable, if it were free it would be free in uncountably many generators, and hence would have uncountably many homomorphisms onto $\mathbb{Z}$ (at least the projections). In fact, if $X$ is any infinite set, then $\mathop{\oplus}_{x\in X}\mathbb{Z}$ is free abelian of rank $|X|$, but $\prod_{x\in X}\mathbb{Z}$ is never free abelian.
You have a related pathology with vector spaces (of course, every vector space is free, so that's not what the problem will be, but rather when you think about "free on what set?"). When working with finitely many vector spaces, you have that $\dim(V_1\times V_2) = \dim(V_1\oplus V_2) = \dim(V_1)+\dim(V_2)$ (in the sense of sum of cardinalities). However, once you have infinitely many vector spaces, the equality breaks down for the product, while it holds for the direct sum:
$$\dim\left(\bigoplus_{i=1}^{\infty} V_i\right) = \sum_{i=1}^{\infty}\dim(V_i)$$
but for products it need not hold: for a counterexample, take $V_i = \mathbb{Q}$ as a vector space over itself; the sum of dimensions is $\aleph_0$, but the direct product of denumerably many copies of $\mathbb{Q}$ is uncountable, so the dimension is $2^{\aleph_0}$ (so you have a "jump" in the dimension once you get to infinitely many elements).