Source
Adapted from my own handwritten and hand-typed notes from Year 1 to Year 3 of my EEE degree
Every matrix comes with three subspaces.
Definitions
| Space | Definition | Lives in |
|---|---|---|
| Null space | ||
| Column space | span of the columns of | |
| Row space | span of the rows of |
Useful link: exactly when is consistent.
Method
Steps:
- Row reduce to RE (or RRE) form
- Null space: solve , set free variables as parameters, and write as a combination of fixed vectors. Those vectors are a basis of
- Column space: the original columns of in the pivot positions form a basis
- Row space: the nonzero rows of the RE form (or the matching original rows) form a basis
Row operations do not change the row space, but they do change the column space. That is why the column space basis uses the original columns.
Worked Example
Row 3 was row 2, so it became zero.
Null space, with and free:
Column space: pivots are in columns 1 and 2, so .
Row space: .
Both column and row space have 2 basis vectors, and the null space has 2. These counts are the rank and nullity, see Rank and Nullity.