Practical application of matrices and determinants

Question

I have learned recently about matrices and determinants and also about the geometrical interpretations, i.e, how the matrix is used for linear transformations and how determinants tell us about area/volume changes.

My school textbooks tell me that matrices and determinants can be used to solve a system of equations, but I feel that such a vast concept would have more practical applications. My question is: what are the various ways the concept of matrices and determinants is employed in science or everyday life?

With some exaggeration, all of applied mathematics boils down to solving systems of linear equations. — Rodrigo de Azevedo, Mar 17 '19 at 19:19
Solving systems of equations is extremely practical. Every time someone solves a differential equation using the finite element method, or runs a linear regression, or solves an optimization problem using Newton's method, a system of linear equations is solved. There is hardly any engineering or applied math project that doesn't require solving a system of linear equations. — Sasho Nikolov, Mar 17 '19 at 19:37
Matrices are important to computer graphics, but not determinants. — user253751, Mar 17 '19 at 22:47
Possible duplicate of What are the applications of matrices in real world? — YuiTo Cheng, Mar 18 '19 at 08:52

score 8 · Answer 1 · answered Mar 17 '19 at 15:55

My first brief understanding of matrices is that they offer an elegant way to deal with data (combinatorially, sort of). A classical and really concrete example would be a discrete Markov chain (don't be frightened by its name). Say you are given the following information: if today is rainy, then tomorrow has a 0.9 probability to be rainy; if today is sunny, then tomorrow has a 0.5 probability to be rainy. Then you may organize these data into a matrix:

$$A=\begin{pmatrix} 0.9 & 0.5 \\ 0.1 & 0.5 \end{pmatrix}$$

Now if you compute $A^2=\begin{pmatrix} 0.86 & 0.7 \\ 0.14 & 0.3 \end{pmatrix}$, what do you get? 0.86 is the probability that if today is rainy then the day after tomorrow is still rainy and 0.7 is the probability that if today is sunny then the day after tomorrow is rainy. And this pattern holds for $A^n$ an arbitrary $n$.

That's the simple point: matrices are a way to calculate elegantly. In my understanding, this aligns with the spirit of mathematics. Math occurs when people try to solve practical problems. People find that if they make good definitions and use good notations, things will be a lot easier. Here comes math. And the matrix is such a good notation to make things easier.

score 5 · Answer 2 · answered Mar 17 '19 at 19:02

Matrices are used widely in computer graphics. If you have the coordinates of an object in 3d space, then scaling, stretching and rotating the object can all be done by considering the coordinates to be vectors and multiplying them by the appropriate matrix. When you want to display that object on-screen, the projection down to a 2D object is also a matrix multiplication.

score 4 · Answer 3 · answered Mar 17 '19 at 19:19

Determinants are of great theoretical significance in mathematics, since in general "the determinant of something $= 0$" means something very special is going on, which may be either good news of bad news depending on the situation.

On the other hand determinants have very little practical use in numerical calculations, since evaluating a determinant of order $n$ "from first principles" involves $n!$ operations, which is prohibitively expensive unless $n$ is very small. Even Cramer's rule, which is often taught in an introductory course on determinants and matrices, is not the cheapest way to solve $n$ linear equations in $n$ variables numerically if $n>2$, which is a pretty serious limitation!

Also, if the typical magnitude of each term in a matrix of of order $n$ is $a$, the determinant is likely to be of magnitude $a^n$, and for large $n$ (say $n > 1000$) that number will usually be too large or too small to do efficient computer calculations, unless $|a|$ is very close to $1$.

On the other hand, almost every type of numerical calculation involves the same techniques that are used to solve equations, so the practical applications of matrices are more or less "the whole of applied mathematics, science, and engineering". Most applications involve systems of equations that are much too big to create and solve by hand, so it is hard to give realistic simple examples. In real-world numerical applications, a set of $n$ linear equations in $n$ variables would still be "small" from a practical point of view if $n = 100,000,$ and even $n = 1,000,000$ is not usually big enough to cause any real problems - the solution would only take a few seconds on a typical personal computer.

Why "even Cramer's rule"? That rule is so obviously inefficient that it's hardly worth mentioning, as every introductory course covers Gaussian elimination, which is clearly much more efficient. — Servaes, Mar 17 '19 at 20:19
Whilst it doesn't make it more efficient, the determinant calculations in Cramer's rule can be done using Gaussian elimination which means its at least in the same complexity class surely? — jacob1729, Mar 17 '19 at 23:10

score 3 · Answer 4 · answered Mar 17 '19 at 15:27

Here's an application in calculus. The multivariate generalisation of integration by substitution viz. $x=f(y)\implies dx=f^\prime(y)dy$ uses the determinant of a matrix called a Jacobian in place of the $f^\prime$ factor. In particular, the chain rule $dx_i=\sum_j J_{ij}dy_j,\,J_{ij}:=\frac{\partial x_i}{\partial y_j}$ for $n$-dimensional vectors $\vec{x},\,\vec{y}$ can be summarised as $d\vec{x}=Jd\vec{y}$. Then $d^n\vec{x}=|\det J|d^n\vec{y}$.

score 3 · Answer 5 · answered Mar 17 '19 at 15:36

There are plenty of applications of determinants, but I will just mention one that applies to optimization. A totally unimodular matrix is a matrix (doesn’t have to be square) that every square submatrix has a determinant of 0, 1 or -1. It turns out that (by Cramer’s rule) that if a constraint matrix $A$ of a linear program max $\{c’x:\: Ax \leq b, x \in \mathbb{R}^n_+\} $ is totally unimodular, it is guaranteed to have an integer solution if a solution exists. In other words, the polyhedron formed by $P = \{x:\: Ax \leq b\}$ has integer vertices in $\mathbb{R}^n$. This has major implications in integer programming, as we solve an integer program that has a totally unimodular matrix as a linear program. This is advantageous because a linear program can me solved in polynomial time, where there is no polynomial algorithm for integer programs.

G Cab · Answer 6 · 2019-03-18T16:07:31.560

Besides the applications already mentioned in the previous answers, just consider that matrices are the fundamental basis for Finite Elements design, today widely used in every sector of engineering.

Actually a truss is a physical representation of a matrix: if its stiffness matrix has null determinant, it means that there can be movements without external forces, i.e. the truss will collapse.

Also, in the continuous analysis of the deformation of bodies, stress and strain each are represented by matrices (tensors).

The inertia of a body to rotation is a matrix.

An electric network is described by a matrix voltages/ currents, and a null determinant denotes a short somewhere.

And so on ...

score 2 · Answer 7 · answered Mar 17 '19 at 15:20

If the determinant of a matrix is zero, then there are no solutions to a set of equations represented by an nXn matrix set equal to a 1Xn matrix. If it is non-zero, then there are solutions and they can all be found using Cramer's Rule. They are also used in Photoshop for various visual tricks; they are used to cast 3D shapes onto a 2D surface; they are used to analyze seismic waves... and a hundred other applications where data need to be crunched in a simple manner.

score 0 · Answer 8 · answered Mar 18 '19 at 10:33

In system-theory,

systems can be represented by matrices and each column represent the internal-state of the system.
If a determinant of one such matrix is zero, then we can say that one of the state associated with certain dynamics is being duplicated.
Based on some special matrix operations, we arrive at something called as relative-gain-array (RGA). This will give information on how much each states/output of a system interactes with each other, collectively speaking.

However, top are just a few examples. There are much more.

Practical application of matrices and determinants

8 Answers8