7 Conditioning
- Conditioning concerns how probabilities of events or distributions of random variables are influenced by information about the occurrence of events or the values of random variables.
- A probability is a measure of the likelihood or degree of uncertainty of an event. A conditional probability revises this measure to reflect any “new” information about the outcome of the underlying random phenomenon.
Example 7.1 The probability that a randomly selected American adult believes in human-driven climate change1 is 0.54.
The probability2 that a randomly selected American adult is a Democrat is 0.28.
- Donny Don’t says that the probability that a randomly selected American adult both (1) is a Democrat, and (2) believes in human-driven climate change is equal to \(0.28\times 0.54\). Do you agree?
- Suppose that the probability that a randomly selected American adult both is a Democrat and believes in human-driven climate change is 0.19. Construct an appropriate two-way table of probabilities.
- Compute the probability that a randomly selected American adult who is a Democrat believes in human-driven climate change.
- Compute the probability that a randomly selected American adult who believes in human-driven climate change is a Democrat.
- How can the probability in the two previous parts be written in terms of the probabilities provided (0.54, 0.28, 0.19)?
- The conditional probability of event \(A\) given event \(B\), denoted \(\text{P}(A|B)\), is defined as (provided \(\text{P}(B)>0\)) \[ \text{P}(A|B) = \frac{\text{P}(A\cap B)}{\text{P}(B)} \]
- The conditional probability \(\text{P}(A|B)\) represents how the likelihood or degree of uncertainty of event \(A\) should be updated to reflect information that event \(B\) has occurred.
- In general, knowing whether or not event \(B\) occurs influences the probability of event \(A\). That is, \[ \text{In general, } \text{P}(A|B) \neq \text{P}(A) \]
- Be careful: order is essential in conditioning. That is, \[ \text{In general, } \text{P}(A|B) \neq \text{P}(B|A) \]
- Within the context of two events, we have joint, conditional, and marginal probabilities.
- Joint: unconditional probability involving both events, \(\text{P}(A \cap B)\).
- Conditional: conditional probability of one event given the other, \(\text{P}(A | B)\), \(\text{P}(B | A)\).
- Marginal: unconditional probability of a single event \(\text{P}(A)\), \(\text{P}(B)\).
- The relationship \(\text{P}(A|B) = \text{P}(A\cap B)/\text{P}(B)\) can be stated generically as \[ \text{conditional} = \frac{\text{joint}}{\text{marginal}} \]
- In many problems conditional probabilities are provided or can be determined directly.
Example 7.2 Suppose that
- 67% of Democrats believe in human-driven climate
- 46% of Independents believe in human-driven climate
- 34% of Republicans believe in human-driven climate
Also suppose that
- 28% of American adults are Democrats
- 42% of American adults are Independents
- 30% of American adults are Republicans
- Define the event \(A\) to represent “believes in human-driven climate change” and \(D, I, R\) to correspond to affiliation in each of the parties. If the probability measure \(\text{P}\) corresponds to selecting an American adult uniformly at random, write all the percentages above as probabilities using proper notation.
- Construct an appropriate two-way table of probabilities.
- Now suppose that the randomly selected American believes in human-driven climate change. How does this information change the probability that the selected American belongs to each political party? Answer by computing appropriate probabilities (and using proper notation).
- How many times more likely is it for an American adult to believe in human-driven climate change and be Independent than to:
- believe in human-driven climate change and be Democrat
- believe in human-driven climate change and be Republican
- believe in human-driven climate change and be Democrat
- How many times more likely is it for an American adult who believes in human-driven climate change to be Independent than to be:
- Democrat
- Republican
- Democrat
- What do you notice about the answers to the two previous parts?
- The process of conditioning can be thought of as “slicing and renormalizing”.
- Extract the “slice” corresponding to the event being conditioned on (and discard the rest). For example, a slice might correspond to a particular row or column of a two-way table.
- “Renormalize” the values in the slice so that corresponding probabilities add up to 1.
- Extract the “slice” corresponding to the event being conditioned on (and discard the rest). For example, a slice might correspond to a particular row or column of a two-way table.
- Slicing determines the shape; renormalizing determines the scale.
- Slicing determines relative probabilities; renormalizing just makes sure they add up to 1.
Example 7.3 Roll a fair four-sided die twice. Let \(X\) be the sum of the two dice, and let \(Y\) be the larger of the two rolls (or the common value if both rolls are the same). The table below represents the joint distribution of \(X\) and \(Y\).
| \(x\) \ \(y\) | 1 | 2 | 3 | 4 |
| 2 | 1/16 | 0 | 0 | 0 |
| 3 | 0 | 2/16 | 0 | 0 |
| 4 | 0 | 1/16 | 2/16 | 0 |
| 5 | 0 | 0 | 2/16 | 2/16 |
| 6 | 0 | 0 | 1/16 | 2/16 |
| 7 | 0 | 0 | 0 | 2/16 |
| 8 | 0 | 0 | 0 | 1/16 |
- Compute and interpret in context \(\text{P}(X=5|Y=4)\).
- Construct a table to represent the conditional distribution of \(X\) given \(Y=4\) by “slicing and renormalizing”.
- Interpret the the conditional distribution of \(X\) given \(Y=4\) as a long run relative frequency distribution.
- Compute \(\text{E}(X|Y = 4)\).
- Interpret the value from the previous part as a long run average value in context.
- Construct a table to represent the conditional distribution of \(X\) given \(Y=3\), and compute \(\text{E}(X|Y = 3)\)
- Construct a table to represent the conditional distribution of \(X\) given \(Y=2\), and compute \(\text{E}(X|Y = 2)\)
- Construct a table to represent the conditional distribution of \(X\) given \(Y=1\), and compute \(\text{E}(X|Y = 1)\)
Probabilities are estimated based on this 2024 survey.↩︎
Estimate based on Gallup poll↩︎