Critical Thinking · Lesson 3 of 4

Correlation, confirmation, and cherry-picking

An anecdote establishes possibility, never frequency. Almost every misleading claim lives in that gap.

7 min read · Free — no account needed to read

Two things moving together does not tell you one caused the other. Something else may cause both, the arrow may point the other way, or it may be coincidence across enough comparisons. Before accepting a causal story, ask what else changed at the same time.

Confirmation bias is the pull toward information that agrees with you. It rarely feels like bias; it feels like research. The tell is asymmetric effort — you examined the study that disagreed and accepted the one that agreed.

Cherry-picking is selecting the cases that fit. Its everyday form is the anecdote: one person who did this and succeeded. An anecdote tells you something is possible. It cannot tell you how often it works, and the difference between those two is usually the whole decision.

See it happen

A friend tells you their cousin took a bootcamp and tripled their salary in a year.

The read that arrives on its own

That is a real person with a real outcome. It clearly works.

The same situation, with this idea

One case establishes that it is possible. It says nothing about how often. What proportion of that cohort is still in the field, and what were they earning before?

What changed

The story is true and the conclusion still does not follow. An anecdote gives you possibility; almost every misleading claim lives in the gap between possible and common.

The takeaway

An anecdote establishes possibility, never frequency. Almost every misleading claim lives in that gap.

Easy to take the wrong way

Answering an anecdote with your own anecdote. Two stories pointing opposite ways still tell you nothing about frequency.

Try this

Find a success story you have been influenced by. Ask: how many people tried this, and where are they?