The concept of equation is not limited to numbers, it extends to all mathematical objects. In mathematical discourse, to say that one mathematical object is equal to another mathematical object means that they are the same object. Equality has its own laws, although these laws are sometimes regarded as laws of logic, as opposed to laws of mathematics. One important example is the transitive law of equality: $A=B$ and $B=C$ implies $A=C$.
As the notation for each new kind of mathematical object is introduced, it is common to state exactly what "equality" means in that new context.
For example, in the Cartesian coordinate plane, given two points $P=(a,b)$ and $Q=(c,d)$, one defines equality of points $P=Q$ to mean: $a=c$ and $b=d$.
For another example relevant to your post, given two matrices $A,B \in \mathbb F^{m \times n}$ one defines equality of matrices $A=B$ to mean that $A_{ij}=B_{ij}$ for all $i \in \{1,\ldots,m\}$ and $j \in \{1,\ldots,n\}$.
In your discussion of matrix multiplication, first one proves that the matrix multiplication formula defines a binary operation, meaning a function which inputs a pair of matrices $A \in \mathbb F^{k \times l}$, $B \in \mathbb F^{l \times m}$ and outputs their matrix product $AB \in \mathbb F^{k \times m}$. To be a function means that equal inputs implies equal outputs, and therefore
$$Ax=B \implies A^{-1}(Ax) = A^{-1} b
$$
Also, the associative law of matrix multiplication is a true theorem, that one must prove in a linear algebra course: for all $A \in F^{k \times l}$, $B \in \mathbb F^{l \times m}$, $C \in \mathbb F^{m \times n}$ we have $(AB)C=A(BC)$. It follows that
$$A^{-1}(Ax) = (A^{-1} A) x
$$
Putting the last two equations together, and using the transitive law of equality, it follows that
$$Ax=B \implies (A^{-1} A) = A^{-1} b
$$
which is the first two lines of your calculation.
Perhaps you know now how to continue with the remaining lines?
On the other hand, as for your final paragraph asking whether all rules for manipulating numerical equations apply to all other equations ... well, of course not. For example, I suspect you know that the commutative law of multiplication is true for pairs of numbers, namely $ab=ba$ for all real numbers, but that there exists $n \times n$ matrices $A,B$ such that $AB \ne BA$. But if you don't know that, well, play around with some simple matrices, perhaps you might discover a counterexample.