BACKGROUND: Given a matrix, is there always another matrix which commutes with it?
Start with any fixed square matrix $A,$ size $n$ by $n$ as you say. Cayley-Hamilton says that $A$ satisfies a polynomial of degree $n.$ Which means that any polynomial in $A$ can be re-written as
$$ a_0 I + a_1 A + a_2 A^2 + \cdots + a_{n-1} A^{n-1}. $$
All such matrices commute with each other.
Someone once pointed out to me that this also applies to any real analytic function of $A,$ such as $e^A.$ I think it was Marc van Leeuwen. Anyway, that is correct. So, you get a vector space of matrices of dimension $n,$ out of the full dimension of $n^2.$ That would be my question, is $n$ the maximum dimension of a vector subspace of matrices, all of which commute with each other?
Note, you want $A$ to have $n$ distinct eigenvalues to get full value out of this. For example, if $A=I,$ all polynomials are just $a_0 I,$ dimension 1.