This is my take on the question, namely that we loose an important bit of symmetry as we go from multiplication to exponentiation.
When adding two numbers, you might think of both numbers as translations, and addition as doing first one translation, then the other. When multiplying two numbers, you can think of both numbers as scalings, and the multiplication itself as doing first one scaling, then the other. In other words, the two numbers on either side of the operation symbol are entities of the same kind.
However, exponentiation is repeated multiplication. In the expression $2^3$, $2$ signifies the scaling in question, and the $3$ tells you how many times to do it. In other words, the $2$ and the $3$ signifies qualitatively different entities (and I have seen no interpretation of exponentiation where the two numbers signify the same kind of thing). Therefore you break the symmetry, and thus there is no reason to expect it to be commutative.