Source
Adapted from my own handwritten and hand-typed notes from Year 1 to Year 3 of my EEE degree
A set of vectors is linearly independent (LI) when none of them can be built from the others. Otherwise it is linearly dependent (LD).
Definition
in is linearly independent if the only solution of
is the trivial solution . If some nontrivial solution exists, the set is dependent, and at least one vector is a combination of the others.
Method
Steps:
- Form the matrix and solve
- Row reduce to RE form
- A pivot in every column means only the trivial solution, so LI
- A free variable means many solutions, so LD
Quick checks:
- for vectors in (square matrix), they are LI exactly when
- more than vectors in are always dependent (more unknowns than equations)
- any set containing is dependent
Worked Example
Are , , independent?
Column 3 has no pivot, so is free and the set is dependent. Indeed .
If instead , the determinant is , so that set is independent.
Why It Matters
It matters because:
- a consistent system has a unique solution exactly when the columns of are LI
- a set that is LI and spans a space is a basis