Linear Algebra Essentials

On this page

This reference collects identities for inverses, determinants, and traces, followed by common matrix decompositions. Before using an identity, check the matrix dimensions and any requirements for invertibility or symmetry. An identity may fail when these conditions do not hold.

Key Matrix Properties

1. Inverse Properties

These identities apply to invertible square matrices of compatible sizes; the scalar κ\kappa must be nonzero. In particular, notice the reversed order of the factors in the product formulas. The power identity holds for integer powers.

PropertyFormula
Inverse of an Inverse(A−1)−1=A(A^{-1})^{-1} = A
Inverse of a Transpose(A⊤)−1=(A−1)⊤(A^\top)^{-1} = (A^{-1})^\top
Inverse of a Scalar Multiple(κA)−1=κ−1A−1(\kappa A)^{-1} = \kappa^{-1}A^{-1}
Inverse of a Product (Two Matrices)(AB)−1=B−1A−1(AB)^{-1} = B^{-1}A^{-1}
Inverse of a Product (Three Matrices)(ABC)−1=C−1B−1A−1(ABC)^{-1} = C^{-1}B^{-1}A^{-1}
Inverse of a Sequence(A1A2⋯An)−1=An−1⋯A2−1A1−1(A_1A_2\cdots A_n)^{-1} = A_n^{-1}\cdots A_2^{-1}A_1^{-1}
Inverse of a Power(An)−1=(A−1)n(A^n)^{-1} = (A^{-1})^n

2. Determinant Properties

Determinants are defined for square matrices. In the product identity, the factors have the same size; in the inverse identity, the matrix must be invertible.

PropertyFormula
Determinant of a Transposedet⁡(A⊤)=det⁡(A)\det(A^\top) = \det(A)
Determinant of a Productdet⁡(AB)=det⁡(A)det⁡(B)\det(AB) = \det(A)\det(B)
Determinant of an Inversedet⁡(A−1)=1/det⁡(A)\det(A^{-1}) = 1/\det(A)
Determinant of a Scalar Multipledet⁡(κA)=κndet⁡(A)\det(\kappa A) = \kappa^n\det(A) for an n×nn\times n matrix
Determinant of a Block Diagonal Matrixdet⁡(diag⁡(A,B))=det⁡(A)det⁡(B)\det(\operatorname{diag}(A,B)) = \det(A)\det(B)
Determinant of an Identity Matrixdet⁡(I)=1\det(I) = 1

3. Trace Properties

The trace is the sum of a square matrix's diagonal entries. Factors in a product may be rectangular, provided each displayed product is defined and square. The cyclic rule lets us move the first factor to the end; it does not let us reorder factors freely.

PropertyFormula
Trace of a Transposetr⁡(A⊤)=tr⁡(A)\operatorname{tr}(A^\top) = \operatorname{tr}(A)
Trace of a Sumtr⁡(A+B)=tr⁡(A)+tr⁡(B)\operatorname{tr}(A+B) = \operatorname{tr}(A)+\operatorname{tr}(B)
Trace of a Producttr⁡(AB)=tr⁡(BA)\operatorname{tr}(AB) = \operatorname{tr}(BA)
Trace of a Scalar Multipletr⁡(κA)=κtr⁡(A)\operatorname{tr}(\kappa A) = \kappa\operatorname{tr}(A)
Cyclic Property of Tracetr⁡(ABC)=tr⁡(BCA)=tr⁡(CAB)\operatorname{tr}(ABC) = \operatorname{tr}(BCA) = \operatorname{tr}(CAB)
Trace of an Identity Matrixtr⁡(In)=n\operatorname{tr}(I_n) = n for the n×nn\times n identity

4. General Matrix Properties

The matrices below are real. Invertibility and eigenvalue decompositions refer to square matrices, while the singular value decomposition also applies to rectangular matrices.

Property

Description

Transpose of a Product

(AB)⊤=B⊤A⊤(AB)^\top = B^\top A^\top

Rank of a Matrix

Maximum number of linearly independent column vectors in the matrix.

Trace & Determinant for 2×2

For A=(abcd)A=\begin{pmatrix}a&b\\c&d\end{pmatrix}, tr⁡(A)=a+d\operatorname{tr}(A)=a+d and det⁡(A)=ad−bc\det(A)=ad-bc.

Matrix Invertibility

AA is invertible if and only if det⁡(A)≠0\det(A)\ne0.

Spectral (Eigen) Decomposition

A=PDP−1A=PDP^{-1} when AA is diagonalizable, with the eigenvectors in PP and eigenvalues in diagonal DD. For a real symmetric matrix, PP can be chosen orthogonal, so P−1=P⊤P^{-1}=P^\top.

Singular Value Decomposition (SVD)

A=UΣV⊤A=U\Sigma V^\top, where UU and VV are orthogonal and the diagonal entries of the rectangular matrix Σ\Sigma are nonnegative singular values.

Orthogonal Matrices

A real square matrix QQ is orthogonal if Q⊤Q=IQ^\top Q=I.

Conclusion

The tables separate three common tasks: manipulating inverses, evaluating determinants, and simplifying traces. When applying an identity, first check that the matrix dimensions and required conditions match the problem. The references below develop these properties alongside the decompositions listed in the final table.

Further Reading & Citations

  • Horn, R. A. & Johnson, C. R. (2013). Matrix Analysis. Cambridge University Press.

  • Gilbert Strang (2009). Introduction to Linear Algebra. Wellesley-Cambridge Press.

  • Lay, D. C. (2012). Linear Algebra and Its Applications. Pearson.

  • Meyer, C. D. (2000). Matrix Analysis and Applied Linear Algebra. SIAM.