Matrix Multiplication

1 min read

Matrix multiplication can be understood through three equivalent views:

  1. Dot product view — each entry (i,j)(i,j) of ABAB is the dot product of row ii of AA with column jj of BB
  2. Column combination view — each column of ABAB is a linear combination of columns of AA, with coefficients from the corresponding column of BB
  3. Transformation viewABAB represents the composition of two linear transformations: first BB, then AA

Dimensions: if AA is m×nm \times n and BB is n×pn \times p, then ABAB is m×pm \times p. The inner dimensions must match.

Matrix multiplication is associative (ABC=A(BC))(ABC = A(BC)) but not commutative (ABBA(AB \neq BA in general)).

The transformation view is the most geometrically powerful: multiplying by a matrix rotates, scales, shears, or projects space. Composing transformations = multiplying matrices.

See also: Gaussian Elimination, Eigendecomposition, Rank and Null Space

Linked from