Extending the Law of Total Probability

Generalize the Law of Total Probability from a two-event partition to a partition with any number of events. Compute marginal probabilities of the form P(A) = sum over i of P(A | B_i) P(B_i), where {B_1, ..., B_n} partitions the sample space.

Step 1 of 119%

Tutorial

From Two-Event to N-Event Partitions

You've encountered the Law of Total Probability for a two-event partition. We now extend it to any number of events.

A partition of the sample space SS is a collection of events B1,B2,,BnB_1, B_2, \ldots, B_n that are pairwise disjoint and whose union is SS. Every outcome of the experiment belongs to exactly one of the BiB_i.

The extended Law of Total Probability states that for any event AA and any partition B1,,BnB_1, \ldots, B_n of SS,

P(A)=i=1nP(ABi)P(Bi)=P(AB1)P(B1)+P(AB2)P(B2)++P(ABn)P(Bn).P(A) = \sum_{i=1}^{n} P(A \mid B_i)\, P(B_i) = P(A \mid B_1) P(B_1) + P(A \mid B_2) P(B_2) + \cdots + P(A \mid B_n) P(B_n).

For example, suppose B1,B2,B3B_1, B_2, B_3 partition SS with

P(B1)=0.5,P(B2)=0.3,P(B3)=0.2,P(B_1) = 0.5,\quad P(B_2) = 0.3,\quad P(B_3) = 0.2,

and the conditional probabilities of an event AA are

P(AB1)=0.4,P(AB2)=0.2,P(AB3)=0.1.P(A \mid B_1) = 0.4,\quad P(A \mid B_2) = 0.2,\quad P(A \mid B_3) = 0.1.

Then

P(A)=0.50.4+0.30.2+0.20.1=0.20+0.06+0.02=0.28.P(A) = 0.5 \cdot 0.4 + 0.3 \cdot 0.2 + 0.2 \cdot 0.1 = 0.20 + 0.06 + 0.02 = 0.28.

Notice that the weights P(Bi)P(B_i) must sum to 11, since the BiB_i partition SS.

navigate · Enter open · Esc close · ⌘K/Ctrl K toggle