Expert Political Judgment: How Good Is It? How Can We Know?
Philip E. Tetlock, 2005 — risk.
The dataset under Superforecasting: beginning in the mid-1980s, Tetlock collected dated, scoreable probability judgments from hundreds of professional experts — tens of thousands of forecasts over roughly two decades — and graded them against outcomes. The average expert barely outperformed simple statistical extrapolation. But the variance had structure: borrowing Isaiah Berlin's fox and hedgehog, he found that experts devoted to one big organizing idea were reliably worse than those who stitched many partial models together, and that the correlation between media prominence and accuracy ran negative. The first controlled demonstration that forecasting skill exists, is measurable, and is distributed almost inversely to confidence and fame.
Marked passages
The core result, summarized: across two decades of scored predictions, hedgehogs — experts who deploy one grand theory everywhere — were beaten by foxes, who aggregate many small, contradictory sources of evidence and update without drama; and both were embarrassed by how close simple extrapolation came to matching them.
The hiring rule for the codex: many frameworks held simultaneously, none promoted to the one big idea. Every projection cites multiple lenses because the single-lens forecaster is the documented failure mode.
The fame inversion, summarized: the experts most quoted in the media were, on average, less accurate than their obscure colleagues — the commentary market rewards the confident single narrative that scoring punishes.
Why this platform publishes Brier scores instead of credentials, and why the Observer Protocol weights track record over volume. Reputation and calibration are different currencies, and only one of them is scarce.
More on this shelf
- The Black Swan: The Impact of the Highly Improbable — Nassim Nicholas Taleb, 2007
- The Collapse of Complex Societies — Joseph Tainter, 1988
- Collapse: How Societies Choose to Fail or Succeed — Jared Diamond, 2005
- Antifragile: Things That Gain from Disorder — Nassim Nicholas Taleb, 2012
- Superforecasting: The Art and Science of Prediction — Philip E. Tetlock & Dan Gardner, 2015
- The Crowd: A Study of the Popular Mind — Gustave Le Bon, 1895
- The Limits to Growth — Donella Meadows, Dennis Meadows, Jørgen Randers, William Behrens III, 1972
- Is War Now Impossible? — Jan Gotlib Bloch (Ivan S. Bloch), 1899
This text points at
The shelf exists because the engine reads it. See the Core, the projections, the sealed ledger, or all 81 texts.