Neglecting the Base Rate

Photo by Adam Nieścioruk on Unsplash

what is the probability of a random person being infected, given a positive test result? Assuming test sensitivity of 95% and 5% of the population are infected.

The correct answer is 20%. If your answer was much higher, then you have committed a base rate fallacy, and here is why. Under uncertainty, we tend to make a quick judgment based on a presupposition. In psychology, this is called the representativeness heuristic.

Base rate fallacy is reasoning without taking prior knowledge into account. The solution is the Bayes theorem. The beauty of this approach relies on conditional probability, the essence of probabilistic reasoning.

For example: we have a test for infection with a sensitivity of 0.95, which means the test returns a 95% positive result on the infected population. Suppose further the test specificity is 0.80, which means the test return 80% negative results on the healthy population.

A visual representation of the probabilities

With a 0.05 prevalence (base rate), what is the probability of a random person being infected, given a positive test result?

Using Bayes Theorem:

P(H|E) = P(H) P(E|H) / P(E)

P(Infected | Positive) = P(Positive | Infected) P(Infected) / P(Positive | Infected) + P(Positive | Healthy)

0.95 * 0.05 / (0.95 * 0.05 + 0.20 * 0.95 ) = 0.20 = 20%

So, what is the probability of a random person being healthy, given a positive test result?

P(Healthy | Positive) = 1 — P(Infected | Positive)

1–0.20 = 0.80 = 80%

The takeaway, there is an 80% probability of a random person being healthy, given a positive test result. Committing a base rate fallacy as a decision-maker will result in disasters! I’ll leave this to your imagination. Now, you know. It would be easier for you to identify this bias when it happens in real life.

--

--

--

https://github.com/booletic

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

5 Scientific Manifestation Facts

What Competitive Intelligence Professionals Can Take From Watching Killing Eve?

Time Discounting and Space Discounting

The Power Of Noticing In Language Learning And In Life

Nudging and it’s uses today

Mind Control. The Serpent’s Number One Goal

Mind control. It’s happening all around us, unbeknown. Here’s how, and a reminder to protect yourself.

Are First Impressions Actually Lasting Impressions?

26 to 29: The New Formative Years of a Child’s Development

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Mansoor Aldosari

Mansoor Aldosari

https://github.com/booletic

More from Medium

A bot that solves Wordles with the frequency of English words in mind

You are playing a coin toss game. How do you know whether or not the coins are unbiased?

What Makes a Long Fanfic? Predicting Word Count of Fanfiction from AO3