Home/Discussion Groups/Session 3: Priors, Base Rates, and Likelihoods

Session 3: Priors, Base Rates, and Likelihoods

This session teaches participants to use background rates and diagnostic evidence before jumping to conclusions.

Concept Focus

A prior is a starting confidence before new evidence is considered. A base rate is the background frequency of something in a relevant group. A likelihood asks how expected the evidence would be if a claim were true.

The session helps participants avoid being captured by vivid stories. A dramatic example may matter, but it should be judged against the background rate and the diagnostic strength of the detail.

Historical Example

In wartime, governments sometimes overestimated threats because vivid incidents were easier to remember than quieter background data. Good intelligence work requires asking how common an event is and how strongly a new signal changes the estimate.

This illustrates why base rates are not cold or irrelevant. They protect judgment from being ruled by the most dramatic case.

Contemporary Issue

Medical screening tests are a useful modern example. A positive test result can be serious without being certain. The meaning depends on the condition’s base rate and the test’s false-positive and false-negative rates.

Adjacent References

These are starting points rather than exhaustive citations. They connect this page to nearby work in probability, calibration, cognitive bias, and social epistemology.

  • |Thomas Bayes, "An Essay towards solving a Problem in the Doctrine of Chances" (1763).
  • |E. T. Jaynes, Probability Theory: The Logic of Science (2003).

Discussion Questions

Questions with expandable guidance

Open each question for facilitator notes, examples, scenarios, and feedback. The aim is careful discussion at a senior high school reading level.

Question 1Why should background rates matter even when a case feels vivid?+
GuidanceAsk participants to compare one memorable example with the larger pattern. A vivid story can be real and still not representative.
Historical ExampleInsurance, public health, and safety engineering all depend on base rates. They ask how often events happen, not only how dramatic one event feels.
FeedbackA strong answer says base rates do not erase details; they anchor details.
Question 2How can a medical test be positive while the condition is still not certain?+
GuidanceIntroduce false positives, false negatives, and base rates. Keep the math simple: if a condition is rare, even a good test can produce some false alarms.
Hypothetical ScenarioA disease affects 1 in 1,000 people. A test is very good but not perfect. What else do you need to know before assigning confidence after a positive result?
FeedbackGood answers ask for sensitivity, specificity, and the base rate.
Question 3What makes a piece of evidence diagnostic rather than merely interesting?+
GuidanceDiagnostic evidence should be more expected if the claim is true than if it is false.
Contemporary IssueA celebrity endorsement is evidence that someone is promoting a product, but it may be weak evidence that the product works.
FeedbackGood answers distinguish attention-grabbing evidence from likelihood-shifting evidence.