Source

Adapted from my own handwritten and hand-typed notes from Year 1 to Year 3 of my EEE degree

Two events are independent when one happening does not change the probability of the other. If it does change it, the events are dependent.

Test for independence

and are independent if and only if

To check, compute , and separately and see whether the product rule holds.

Typical cases:

  • two coin flips, or two dice, are independent
  • drawing balls with replacement gives independent draws
  • drawing balls without replacement gives dependent draws, since the bag changes after the first draw

Independent is not the same as mutually exclusive

Mutually exclusive events with nonzero probability are always dependent: if one happens, the other cannot, so

If and are independent, then knowing tells us nothing about :

This follows directly from the definition of Conditional Probability.

Worked example

A family has two children, , all equally likely. Let = children of both sexes and = at least one boy.

Solution:

  • , ,
  • , so and are dependent

A second quick example: Peter is promoted with probability 0.6 and John with 0.8, independently. Then .