Make the set $M(n,n)$ of all $n\times n$ matrices a metric space first, by taking $d(A,B)=\text{rank}(A-B)$.
This is a metric, since
$$\begin{align}
\text{rank}(A-B)&\geq 0, \text{rank}(A-B)=0 \Rightarrow\\ &A=B ;
\end{align}$$
$$
\begin{align}
\text{rank}(A-B) &= \text{rank}(B-A) \text{ and } \text{rank}(A-B) \\
&=\text{rank}((A-C)+(C-B)) \\
&\leq \text{rank}(A-C)+\text{rank}(C-B), \Rightarrow \\
&(M(n,n),\text{rank}) \text{ is a metric space.}
\end{align}
$$
Now, you'll have to show that the set of all non-singular i.e. full-rank matrices is open. Because, if $A$ is a full-rank matrix, taking $\epsilon=1/2$, we have: $\text{rank}(A-X)<1/2 \Rightarrow \text{rank}(A-X)=0 \Rightarrow A=X$ i.e. $X$ is of full-rank. Thus any point(matrix) of the set of all nonsingular matrices, is an interior point of it. So, unless the metric is specified, the problem is meaningless!