Source

Adapted from my own handwritten and hand-typed notes from Year 1 to Year 3 of my EEE degree

An matrix has rows and columns, and is the entry in row , column . A vector is just an matrix. Defining addition and multiplication lets us do algebra with matrices, much like with numbers.

Addition and Scalar Multiplication

For two matrices and and a scalar :

These follow the usual rules:

  • and
  • and
  • and

Matrix Multiplication

If is and is , then is . Entry is the dot product of row of with column of :

The inner sizes must match. Example:

Key facts:

  • matrix multiplication is not commutative, in general
  • can be defined while is not (sizes do not match)
  • if the matrices are said to commute
  • it is associative and distributive: , ,

Transpose

The transpose swaps rows and columns: . An matrix becomes .

Properties:

  • (order reverses)
  • and
  • if , then is symmetric

With the transpose, the dot product of two column vectors is

and , are orthogonal when .

Square matrices that can be "divided by" are the subject of Matrix Inverse.