Source
Adapted from my own handwritten and hand-typed notes from Year 1 to Year 3 of my EEE degree
A system of linear equations is a set of equations in unknowns (an linear system). Many engineering problems reduce to one: node voltages in a circuit, resource allocation, balancing chemical equations.
General Form
There are only three possible outcomes:
- a unique solution
- infinitely many solutions
- no solution (the system is inconsistent)
For two unknowns this is easy to picture: each equation is a line. The lines cross once (unique), are parallel (none) or lie on top of each other (many).
Matrix Notation
The system is stored as a coefficient matrix and an augmented matrix .
Three Equivalent Views
The same system can be written in three ways, and you can switch to whichever is easiest:
- System of equations, as above
- Matrix equation
- Vector equation , where are the columns of
The vector view gives a useful fact: is consistent if and only if is a linear combination of the columns of .
Elementary Row Operations
Three elementary row operations (EROs) never change the solution set:
- swap two rows,
- multiply a row by a nonzero constant, with
- add a multiple of one row to another,
Two systems with the same solution set are called equivalent. EROs are the tool behind Gaussian elimination.
Homogeneous Systems
A system is homogeneous. It always has the trivial solution , so it is never inconsistent. The interesting question is whether it also has nontrivial solutions.