An $m\times n$ matrix (with real entries) is an array of $m\times n$ real numbers so we can associate this with $\mathbb{R}^{mn}$. The function $f$ (the determinant) is linear in each column of the matrix. So interpretting as $f:\mathbb{R}^{n^{2}}\to\mathbb{R}$ as a function on $\mathbb{R}^{n}\times\mathbb{R}^{n}\times...\times\mathbb{R}^{n}$ (where the product is taken $n$ times since the matrix is $n\times n$ and hence has $n$ columns and each column has $n$ entries) we get a multilinear function in each variable.
The invertible matrices are matrices with determinant in $\mathbb{R}-\{0\}$ (not $\mathbb{R}^{n{2}}-\{0\})$ and since $f$ is continuous the preimage of this open set is open. The set $\mathbb{R}^{n^{2}}-\{0\}$ would be equivalent to the set of $n\times n$ matrices excluding the $0$ matrix.
To show that the function that sends a matrix to its inverse is continuous note that $A^{-1}=\frac{1}{\det(A)}adj(A)$ which gives a matrix whose entries are rational functions on $\mathbb{R}$ (note that adj(A) denotes the adjugate matrix). If we restrict to $A$ such that $\det(A)\neq0$ then the denominator of the rational functions is not $0$.
To see that the determinant is linear in the first column I calculate the determinant by means of the cofactor expansion along column $1$ (a similar proof will work for other columns) suppose we have:
$\det\begin{pmatrix}
(a_{1,1}+cb_{1})&a_{1,2}&...&a_{1,n}\\
(a_{2,1}+cb_{2})&a_{2,2}&...&a_{2,n}\\
...&...&...&...\\
(a_{n-1,1}+cb_{n-1})&a_{n-1,2}&...&a_{n-1,n}\\
(a_{n,1}+cb)&a_{n,2}&...&a_{n,n}\\
\end{pmatrix}$
$=\sum_{i=1}^{n}(a_{i,1}+cb_{i})C_{i,1}=\sum_{i=1}^{n}a_{i,1}C_{i,1}+c\sum_{i=1}^{n}b_{i}C_{i,1}$
$=\det
\begin{pmatrix}
a_{1,1}&a_{1,2}&...&a_{1,n}\\
a_{2,1}&a_{2,2}&...&a_{2,n}\\
...&...&...&...&...\\
a_{n-1,1}&a_{n-1,2}&...&a_{n-1,n}\\
a_{n,1}&a_{n,2}&...&a_{n,n}\\
\end{pmatrix}+c\det
\begin{pmatrix}
b_{1}&a_{1,2}&...&a_{1,n}\\
b_{2}&a_{2,2}&...&a_{2,n}\\
...&...&...&...&...\\
b_{n-1}&a_{n-1,2}&...&a_{n,n-1}\\
n_{n}&a_{n,2}&...&a_{n,n}\\
\end{pmatrix}$
To see why the determinant maps $\mathbb{R}^{n^{2}}$ to $\mathbb{R}$ just remember that the determinant gives a number and its domain is the space of square matrices which we associate to $\mathbb{R}^{n^{2}}$.