Category: Effects
Type: Cognitive Bias
Origin: Statistics and military research, WWII, Abraham Wald
Also known as: Survival Bias
Type: Cognitive Bias
Origin: Statistics and military research, WWII, Abraham Wald
Also known as: Survival Bias
Quick Answer — Survivorship Bias is a cognitive bias in which people focus on successful examples while overlooking the many failures that are no longer visible. First systematically studied during World War II by statistician Abraham Wald, this bias leads to incorrect conclusions by examining only the “survivors” of a process while ignoring those that didn’t survive. Understanding survivorship bias helps you avoid drawing false lessons from incomplete data and makes you question what you’re NOT seeing.
What is the Survivorship Bias?
The Survivorship Bias is a powerful cognitive bias that distorts how people learn from examples and data. When evaluating a group of survivors, people naturally focus on the visible successes while the invisible failures—the vast majority that didn’t make it—go unexamined. This creates systematically distorted conclusions about what leads to success. The key insight is that success leaves visible traces, but failure often leaves no trace at all. When you study only successful businesses, failed businesses are invisible. When you study only successful entrepreneurs, failed entrepreneurs have disappeared. When you study only winning investments, the losing investments that went to zero are gone from view. This creates a profound distortion in what we believe we can learn from observing success.We mistake visibility for representativeness—assuming that what we can see represents all the possibilities, when actually we’re only seeing the successful ones.This bias operates through several mechanisms. First, failed cases are literally harder to find—they may have gone bankrupt, shut down, or otherwise become invisible. Second, people are naturally attracted to success stories, making them more likely to study and share successful examples. Third, even when failed cases are available, they receive less attention and analysis than successful ones.
The Survivorship Bias in 3 Depths
- Beginner: Notice how business magazines feature successful companies but rarely analyze the thousands that failed doing the same things. When you hear about someone’s success, ask yourself: how many people tried the same thing and failed?
- Practitioner: When analyzing success factors, always include failed cases in your analysis. Actively seek out “failed experiments” and discontinued products to understand the full picture.
- Advanced: Apply “inverse thinking”—ask not what made the survivors successful, but what made the non-survivors fail. This reveals information invisible when studying only successes.
Origin
The survivorship bias was first systematically identified during World War II by statistician Abraham Wald and his Statistical Research Group. The military came to Wald with data on aircraft damage—they wanted to reinforce the areas with the most bullet holes. Wald’s revolutionary insight was to recommend reinforcing the areas with NO damage instead. Wald understood that the aircraft returning from missions had survived damage to the areas with bullet holes—the holes they DIDN’T have were the lethal hits that brought planes down. The returning planes were survivors; the planes that didn’t return had been killed by hits to the areas that now appeared “undamaged.” This insight saved countless lives and established the principle of studying what isn’t present. The term has since expanded to describe similar phenomena in business, investing, medicine, history, and numerous other fields where examining only visible successes leads to systematically wrong conclusions.Key Points
Invisible failures distort conclusions
Failed cases are often literally invisible—they may have gone out of business, been deleted, or otherwise become unobservable. Studying only visible successes gives a systematically distorted picture.
Success stories are more visible and attractive
Human attention naturally gravitates toward success stories. Media, case studies, and business books disproportionately feature successes, making them overrepresented in what we learn from.
Selection bias amplifies distortion
The very fact that something succeeded often makes it more visible and available for study. This creates a feedback loop where we study what success made visible, not what would help us understand success.
Applications
Business and Entrepreneurship
Business books feature successful companies but ignore the thousands using similar strategies that failed. Studying only winners gives false confidence about what actually causes success.
Investing and Finance
Investors often study successful investors or companies while ignoring the far more numerous failures. This leads to unrealistic expectations and poor risk assessment.
Career and Success Advice
Famous success stories are visible, but for every success there are many failures never heard from. Following advice from visible successes without understanding failure rates leads to poor decisions.
History and Historical Analysis
History is written by survivors—documents and records from failed civilizations, companies, or movements are less likely to have been preserved, distorting our understanding of the past.
Case Study
The Mutual Fund Industry
The mutual fund industry provides a powerful example of survivorship bias in finance. Published performance statistics typically include only funds that currently exist—the “survivors.” When a fund merges, closes, or is absorbed, its historical performance data often disappears from published rankings and averages. This creates a dramatically distorted picture. Academic research has found that survivorship bias inflates reported average returns by 0.5% to 1.5% annually—a massive amount over time. More importantly, the characteristics of “successful” funds in historical data are biased by excluding the funds that failed using similar strategies. Investors who base decisions on published performance data are unknowingly using distorted information. The fund that “beat the market” for 10 years and then closed may never appear in long-term performance studies, while funds that survived with mediocre performance are included.Boundaries and Failure Modes
The survivorship bias is robust but has important boundaries:- Sometimes survivors ARE different: In some cases, survival does indicate genuine selection advantages. The key is not to assume this automatically—it requires checking whether failed cases had the same opportunities and characteristics.
- Quality of failure data varies: In some domains, failed cases are relatively well-documented (e.g., bankruptcies), while in others they are nearly invisible (e.g., failed startup ideas that were never publicly discussed).
- Time horizon matters: What looks like survival may simply be delayed failure. Long-term studies reveal that many “survivors” eventually fail, changing the apparent success rate.
- Base rates are crucial: Understanding the overall success rate in a domain helps correct for survivorship bias—but these base rates are often unknown precisely because of survivorship bias itself.
Common Misconceptions
Success stories contain the secret to success
Success stories contain the secret to success
Actually, studying only successes often leads to false conclusions. Many successful companies share characteristics with failed ones—the difference may be factors not visible in either group.
You can just study the failures too
You can just study the failures too
In practice, failed cases are often much harder to find and analyze. They may have no websites, no press coverage, and no willing participants to discuss what went wrong.
Survivorship bias only matters for business
Survivorship bias only matters for business
This bias operates in every domain where some cases succeed and others fail—including medicine (only studying recovered patients), history (only reading surviving documents), and relationships (only asking couples who stayed together).
Related Concepts
The Survivorship Bias connects closely to other cognitive biases and statistical concepts:Selection Bias
The broader category of biases that occur when data is selected in a non-random way. Survivorship bias is a specific form of selection bias.
Confirmation Bias
Seeking information that confirms existing beliefs. Both biases lead to one-sided analysis—in one case selecting successes, in the other selecting confirming evidence.
Availability Heuristic
Judging probability by ease of recall. Successful cases are more “available”—easier to recall and imagine—creating a distorted probability estimate.
Publication Bias
The tendency for positive results to be published more often than negative results. This is essentially survivorship bias in academic research.
Base Rate Neglect
Ignoring base rate information when evaluating probabilities. Failing to consider how many attempts typically fail leads to overestimating success probability.
Hindsight Bias
Believing past events were more predictable than they actually were. Both biases involve distorted views of past outcomes—one about what worked, one about what was predictable.