To add some informal comments to what was already mentioned here, the word "algebra" is somewhat unfortunate, as the algebraic structure (in the abstract algebra sense) comes from treating the symmetric difference of two member sets as addition, while intersection serves the role of multiplication; however, we are mostly concerned with unions instead of symmetric difference (not all the time-check Littlewood's First Principle!). In this sense, an algebra of sets is a formal Boolean algebra. This is because the intersection (or "multiplication") of any set with itself always returns the set you start with, i.e. $x*x=x$ for all $x$ in the collection.
The members of an algebra must include finite unions and complements of members you know are there, as well as the parent set itself. The word "sigma" means that countably infinite unions of members must also themselves be members. Set algebras not specified as "sigma" algebras can exclude countable unions while still remaining algebras. Think of finite subsets of the natural numbers and their respective complements - you can take finite unions all day and your results will be members of this collection, but you would never get the set of all odd natural numbers, so the set of odd natural numbers is not a member of this algebra; but, the set of all odd natural numbers IS a countable union of elements in this set.
Since complements are included in algebras, the intersection of any two members of an algebra must be in the algebra, since $A\cap B=\left(A^c \cup B^c\right)^c$. Likewise, countable intersections of members of sigma-algebras are always themselves members of the sigma algebra (in other words, a sigma-algebra is "closed" under countable intersection).
With the Borel sigma algebra, the definition "the smallest sigma algebra containing the open intervals" (or open sets; recall, every open set is a countable union of open intervals, though) is somewhat difficult to understand at first glance, and in my opinion is given because it is more formal than defining the Borel sets by activity - i.e. "generating" by any combination of intersection, union, and complements of open sets. It is important to keep in mind, by the way, that Borel sets are more than just countable unions and intersections of open and closed sets. There are countable unions, intersections, complements, etc. of the sets you've mentioned that are also Borel; since a sigma-algebra includes a countable union of members as itself a member of the collection, and likewise with countable intersections of members, then we can take e.g. a countable intersection of a countable union of members and return a Borel set. The "Borel hierarchy" article on Wikipedia is a good exposition of this.
Back to the "smallest sigma algebra" definition. Think of it this way: if a sigma algebra includes all open intervals, it must include all complements, countable unions, and countable intersections of open intervals applied in any combination you choose, i.e. EVERY sigma algebra including the open intervals must include such sets, because of the fact that we are considering a sigma algebra in general in the first place (no matter what other members not having to do with open sets happen to be lurking around).
On the other hand, if a certain set is included in every single sigma-algebra that includes the open sets, it must be some cut-and-paste operation of unions, intersections and complements on the open sets, because if it is not such a set, it fails to belong to every sigma algebra that includes the open sets; namely, by our very assumption, it fails at least to belong to the sigma-algebra arising only from operating with unions, intersections and compliments on open sets! Hopefully, this clears up the "smallest sigma algebra" characterization for you.
As another poster mentioned, the Lebesgue measurable sets include members that are not Borel sets, i.e. cannot be "made" by operating on open sets via complements, and countable unions and intersections. Additionally, there are sets that are not Lebesgue measurable at all (the Vitali set, for instance), in fact every Lebesgue measurable set of positive measure includes a non-measurable subset!
Non-Borel measurable sets can be reached in this way; the Cantor set, a set of zero Lebesgue measure, can be mapped via a measurable function to a set of positive measure. Such a set, as mentioned before, contains a nonmeasurable set. Consider the inverse of our measurable function operating on this nonmeasurable subset, and you will get a subset of the measure zero Cantor set, hence you will get a (hopefully) measurable subset (of measure zero). This means a measurable function can, counterintuitively, map a measurable set to a nonmeasurable set. But it cannot map a Borel set to a nonmeasurable set. So we are stuck with a Lebesgue measurable set (of measure zero!) that is not Borel.
This is, in fact, why Lebesgue measurable sets are needed rather than just strictly sticking to Borel sets only. If we did the latter, we should hope that all subsets of a set of zero measure are themselves measurable with zero measure, but if we only consider the "easy" Borel sets as the measurable ones, we are hit with the inevitable problem of dealing with the fact that there are zero-measure sets with subsets that aren't even measurable (in that they are not Borel) at all. Lucky for us, Caratheodory verified that a "complete" extension of the standard Borel measure (i.e. the measure that reports the length of intervals) exists that can return a zero measure for every subset of a zero measure set, while still preserving measurements we expect on Borel sets. This is, as you may guess, exactly the Lebesgue measure.
The Borel sets are special for the reasons I've already mentioned - they are, intuitively, "elementary" in construction, while non-Borel sets (measurable or no) are typically described in a roundabout way in the context of Lebesgue measure. One can, however, represent every Borel set, at base, as some conglomeration of unions, intersections, and compliments, of open intervals. They may not "look" elementary, e.g. this apparently nonsensical set: $$\bigcap_{k=1}^\infty \bigcup_{n=1}^\infty \bigcap_{i=n}^\infty \bigcap_{j=n}^\infty \{x:\left|f_i(x)-f_j(x)\right|<\frac{1}{k}\}$$
While daunting at first appearance, this is just symbology for the set of points where the sequence of functions converges in the Cauchy sense, with intersection and union standing in for "all" and "there exists (at least one)", respectively: for all $k$ there exists an $n$ such that for all $i,j\geq n$, the distance between $f_i$ and $f_j$ at this point is less than the given "epsilon" bound $1/k$. This set itself is Borel (hence measurable) as it is a porridge of intersections and unions of Borel sets.