So... square matrices over a field are special: one can prove that if a square matrix has a left inverse, then it also has a right inverse. And once you know that, it is easy to show that the left and right inverse must be equal. This holds in general for groups/rings: if $x$ is an element, and there exist $a,b$ such that $ax=1$ and $xb=1$, then $a=b$:
$$a = a1 = a(xb) = (ax)b = 1b = b.$$
(Use capital letters and the identity for matrices).
Now, if $A$ is a square matrix over a field, and there exists a matrix $B$ such that $AB=I$, then interpret $A$ and $B$ as linear transformations. Then $AB$ is bijective, hence $A$ is surjective; but that means that $A$ is full rank, hence by the Dimension Theorem has trivial nullity, hence $A$ is also injective. Since $A$ is therefore a bijection, it has a left inverse $C$ (which is also linear, and thus corresponds to a matrix), and thus $A$ has a two-sided inverse.
Similarly, if $A$ has a left inverse $C$ with $CA=I$, then $A$ is one-to-one, hence full rank and so surjective, so it has a right inverse and the argument proceeds as before.
In arbitrary rings you can have elements that have a left inverse but no right inverse; in such cases, you will have multiple left inverses but no right inverse. For if $x$ is an element such that there exists $a$ with $ax=1$, but $xb\neq 1$ for all $b$, then $xa\neq 1$, so $xa-1\neq 0$. Then $(xa-1)x = xax-x = x-x = 0$, so then $(a+xa-1)x = ax+(xa-1)x = 1$, but $a+xa-1\neq a$. Thus, $x$ has at least two left inverses. A symmetric argument shows that if $x$ has a right inverse but no left inverse, then it has at least two right inverses.
And yes, it is possible to have rings in which some elements have left inverses but no right inverses. Consider the vector space $\mathbb{R}[x]$ of all polynomials with coefficients in $\mathbb{R}$, and the ring of all linear transformations from $\mathbb{R}$ to itself. The linear transformation $T(p(x)) = xp(x)$ is one-to-one but not onto, so it has left inverse but no right inverse. In fact, it has infinitely many left inverses. Similarly, the linear transformation $T(p(x)) = p'(x)$ (the derivative) is onto, but not one-to-one, so it has a right inverse (in fact, infinitely many), but no left inverse.