Kevin Dorst
University of Pittsburgh
Do people tend to be overconfident in their opinions? Many think so. They’ve run studies to test whether people are calibrated: whether their confidence in their opinions matches the proportion of those opinions that are true. Under certain conditions, people are systematically “over-calibrated”—for example, of the opinions they’re 80% confident in, only 60% are true. From this observed over-calibration, it’s inferred that people are irrationally overconfident. My question: When—and why—is this inference warranted? Answering this question requires articulating a general connection between being rational and being right—something extant studies have not done. I show how to do so using the notion of deference. This provides a theoretical foundation to calibration research, but also reveals a flaw: the connection between being rational and being right is much weaker than is commonly assumed; as a result, rational people can often be expected to be miscalibrated. Thus we can’t test whether people are overconfident by simply testing whether they are over-calibrated; instead, we must first predict the expected rational deviations from calibration, and then compare those predictions to people’s performance. I show how in principle this can be done—and that doing so has the potential to overturn the standard interpretation of robust empirical effects. In short: rational people can be expected to be wrong more often than you might think.
Keywords calibration  overconfidence  deference principles  human rationality  Bayesianism  hard-easy effect  base-rate effect  Dunning-Kruger effect
Categories (categorize this paper)
Edit this record
Mark as duplicate
Export citation
Find it on Scholar
Request removal from index
Revision history

Download options

PhilArchive copy

 PhilArchive page | Other versions
External links

Setup an account with your affiliations in order to access resources via your University's proxy server
Configure custom proxy (use this if your affiliation does not provide a proxy)
Through your library

References found in this work BETA

Add more references

Citations of this work BETA

No citations found.

Add more citations

Similar books and articles

Beliefs About Overconfidence.Sandra Ludwig & Julia Nafziger - 2011 - Theory and Decision 70 (4):475-500.
Economists as Experts: Overconfidence in Theory and Practice.Erik Angner - 2006 - Journal of Economic Methodology 13 (1):1-24.
How to Insure Against Utilitarian Overconfidence.Nicholas Agar - 2014 - Monash Bioethics Review 32 (3-4):162-171.


Added to PP index

Total views
554 ( #10,648 of 2,404,066 )

Recent downloads (6 months)
161 ( #3,180 of 2,404,066 )

How can I increase my downloads?


My notes