Home/Case Studies/Medical Testing

Medical Testing

Medical tests show why sensitivity, specificity, prevalence, and emotional salience must all be kept separate.

The Pattern

Medical testing is a classic case where evidence sounds stronger than it is. A positive test result may feel like direct evidence that a condition is present, but its meaning depends on prevalence, false positives, false negatives, test quality, and the population being tested.

A rare disease with a decent test can still produce many false alarms when applied broadly. The emotional force of a positive result can make the likelihood feel stronger than the posterior actually warrants.

Where the Gap Opens

The common error is Deep Rationality: EP overstates what the test result means because the agent does not combine base rate and test accuracy correctly. Core Rationality may enter when fear turns a moderate posterior into near certainty, or when avoidance turns a serious result into denial.

Repair

Ask four questions: how common is the condition in this group, how often does the test detect real cases, how often does it falsely flag non-cases, and what follow-up evidence would discriminate better?

Medical credencing requires emotional steadiness. The aim is not to feel calm by force, but to prevent fear from silently rewriting probability.

Adjacent References

These are starting points rather than exhaustive citations. They connect this page to nearby work in probability, calibration, cognitive bias, and social epistemology.

  • |Daniel Kahneman and Amos Tversky, "Judgment under Uncertainty: Heuristics and Biases" (1974).
  • |Sarah Lichtenstein, Baruch Fischhoff, and Lawrence D. Phillips, "Calibration of Probabilities" (1982).