Math and science::Algebra

LU decomposition

Let $A$ be a 3x3 square invertible matrix. Elimination on $A$ by a sequence of elimination matrices $E_{21}, E_{31}$ and $E_{32}$ results in an upper triangular matrix $U$ :

E_{32} E_{31} E_{21} A = U

We can combine the elimination matrices together:

E = E_{32} E_{31} E_{21}

and invert to arrive at the LU decomposition:

A = E_{21}^{- 1} E_{31}^{- 1} E_{32}^{- 1} U = E^{- 1} U = L U

The elements of the matrix $L$ have a very direct interpretation, arguably more interpretable than those of $E$ . If $l_{21}, l_{31}$ and $l_{32}$ are the scalars by which the first and second rows are subtracted from the rows below, then we can express $L$ as:

L = [\begin{matrix} 1 & 0 & 0 \\ l_{21} & 1 & 0 \\ l_{31} & l_{32} & 1 \end{matrix}]

Intuition

Operating on the "finished" $U$ that is outputted by elimination, $L$ reverses the row operations that were used in the elimination process. As each forward row operation only used "finished" rows to modify subsequent rows, when going in reverse, the building blocks of the row operations are present as-is in $L$ , as the "finished" rows are prepopulated by $U$ . This allows $L$ to very simply record one number for each row operation.

A combined of rank 1 matrices. Perspective.

$A$ can be seen to explode into rank 1 matrices through the elimination process. Consider a modified elimination where we try to reduce $A$ to a matrix of all zeros. The first step is to remove the first row of $A$ times a unique factor from every row of $A$ to give zeros in the first column. The factors are

[\begin{matrix} 1 \\ l_{21} \\ l_{31} \end{matrix}]

and the matrix being removed is:

[\begin{matrix} 1 (- row 1 -) \\ l_{21} (- row 1 -) \\ l_{31} (- row 1 -) \end{matrix}]

So, we are removing a rank one matrix, column times row, from $A$ . Repeating this for each column will result in the zero vector. Consequently, these combined rank 1 matrices equal $A$ .

$A = L U$ decomp and the determinant of $A$

$\det (A) = \det (L) \det (U)$ , but as the diagonals of $L$ are all ones, we have $\det (A) = \det (U)$ , and the determinant can be read off as the product of diagonal entries of $U$ .

Example

The matrix $T$ is converted to upper triangular form as follows:

[\begin{matrix} 1 & - 1 & 0 \\ - 1 & 2 & - 1 \\ 0 & - 1 & 2 \end{matrix}] \to [\begin{matrix} 1 & - 1 & 0 \\ 0 & 1 & - 1 \\ 0 & - 1 & 2 \end{matrix}] \to [\begin{matrix} 1 & - 1 & 0 \\ 0 & 1 & - 1 \\ 0 & 0 & 1 \end{matrix}]

This corresponds to the two elimination matricies:

E_{21} = [\begin{matrix} 1 & 0 & 0 \\ 1 & 1 & 0 \\ 0 & 0 & 1 \end{matrix}], E_{32} = [\begin{matrix} 1 & 0 & 0 \\ 0 & 1 & 0 \\ 0 & 1 & 1 \end{matrix}]

Inverting these steps to get $E_{32}^{- 1} E_{21}^{- 1}$ gives:

\begin{aligned} E_{21}^{- 1} E_{32}^{- 1} & = [\begin{array}{c} 1 & 0 & 0 \\ - 1 & 1 & 0 \\ 0 & 0 & 1 \end{array}] [\begin{array}{c} 1 & 0 & 0 \\ 0 & 1 & 0 \\ 0 & - 1 & 1 \end{array}] \\ = [\begin{array}{c} 1 & 0 & 0 \\ - 1 & 1 & 0 \\ 0 & - 1 & 1 \end{array}] \end{aligned}

LU decomposition

Intuition

A combined of rank 1 matrices. Perspective.

A=LU decomp and the determinant of A

Example

Example

$A = L U$ decomp and the determinant of $A$