Before I address your question on the binomial formula, here is an easier (and, IMHO, more entertaining) proof for the number of subsets of a finite set. Suppose that $S$ is a set with $n$ elements, where $n$ is a non-negative integer. To fix ideas, suppose that, say, $n=5$. Write down the elements next to each other:
$$\begin{array}{ccccc}x_1&x_2&x_3&x_4&x_5\end{array}$$
Consider the subset $\{x_2,x_4,x_5\}$. This subset can be represented as follows:
$$\begin{array}{ccccc}x_1&x_2&x_3&x_4&x_5\\\times&\checkmark&\times&\checkmark&\checkmark\end{array}$$
Here, $\checkmark$ denotes that you include a given element in the subset and $\times$ denotes that you leave it out. In an analogous fashion, every subset of $S$ can be uniquely represented as a collection of $\checkmark$'s and $\times$'s. Another example:
$$\begin{array}{ccccc}x_1&x_2&x_3&x_4&x_5\\\times&\times&\times&\times&\times\end{array}$$
represents the empty set. (Right?)
Given this representation of subsets by labeling the elements with $\checkmark$'s and $\times$'s, the number of subsets of $S$ is given by the number of ways in which $\checkmark$'s and $\times$'s can be assigned to the elements of $S$. To each of the $n$ elements, you can assign $2$ labels ($\checkmark$ or $\times$), so the total number of ways in which $\checkmark$'s and $\times$'s can be assigned, and hence the total number of subsets, is $2^n$.
As for the proof based on the binomial formula, consider first the zero-element subsets of $S$. Clearly, there is only $1=\binom{n}{0}$ such set (the empty set). The number of one-element subsets is $n=\binom{n}{1}$. The number of two-element subsets is $\binom{n}{2}$. In general, for any $k\in\{0,1,\ldots,n-1,n\}$, the number of $k$-element subsets is $\binom{n}{k}$, because this is the number of ways you can pick $k$ elements out of $n$ without repetition. It follows that the total number of subsets is the number of zero-element subsets plus the number of one-element subsets and so on. Hence,
$$\sum_{k=0}^{n}\binom{n}{k}=2^n$$
is the number of all subsets of $S$.