Source

Adapted from my own handwritten and hand-typed notes from Year 1 to Year 3 of my EEE degree

A system of linear equations is a set of equations in unknowns (an linear system). Many engineering problems reduce to one: node voltages in a circuit, resource allocation, balancing chemical equations.

General Form

There are only three possible outcomes:

  • a unique solution
  • infinitely many solutions
  • no solution (the system is inconsistent)

For two unknowns this is easy to picture: each equation is a line. The lines cross once (unique), are parallel (none) or lie on top of each other (many).

Matrix Notation

The system is stored as a coefficient matrix and an augmented matrix .

Three Equivalent Views

The same system can be written in three ways, and you can switch to whichever is easiest:

  • System of equations, as above
  • Matrix equation
  • Vector equation , where are the columns of

The vector view gives a useful fact: is consistent if and only if is a linear combination of the columns of .

Elementary Row Operations

Three elementary row operations (EROs) never change the solution set:

  • swap two rows,
  • multiply a row by a nonzero constant, with
  • add a multiple of one row to another,

Two systems with the same solution set are called equivalent. EROs are the tool behind Gaussian elimination.

Homogeneous Systems

A system is homogeneous. It always has the trivial solution , so it is never inconsistent. The interesting question is whether it also has nontrivial solutions.