The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Knowing with certainty: The appropriateness of extreme confidence.
Abstract
How often are people wrong when they are certain that they know the answer to a question ? The studies reported here suggest that the answer is too often. For a variety of general-knowledge questions (e.g., absinthe is [a] a liqueur or [b] a precious stone), subjects first chose the most likely answer and then indicated their degree of certainty that the answer they had selected was, in fact, correct. Across several different question and response formats, subjects were consistently overconfident. They had sufficient faith in their confidence judgments to be willing to stake money on their validity. The psychological bases for unwarranted certainty are discussed in terms of the inferential processes whereby knowledge is constructed from perceptions and memories.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Judgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1975) · Utility, Probability, and Human Decision Making · doi:10.1007/978-94-010-1834-0_8 · Cited by 22,650
Availability: A heuristic for judging frequency and probability
Tversky, A., & Kahneman, D. (1973) · Cognitive Psychology · doi:10.1016/0010-0285(73)90033-9 · Cited by 9,984
Psychology of Reasoning: Structure and Content
Wason, P. C., & Johnson-Laird, P. N. (1972) · Medical Entomology and Zoology · Cited by 1,784
Do those who know more also know more about how much they know?
Lichtenstein, S., & Fischhoff, B. (1977) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(77)90001-0 · Cited by 1,081
Self-citationCalibration of Probabilities: The State of the Art
Lichtenstein, S., Fischhoff, B., & Phillips, L. D. (1977) · Decision Making and Change in Human Affairs · doi:10.1007/978-94-010-1276-8_19 · Cited by 483
Self-citationPsychology of pragmatic implication: Information processing between the lines.
Harris, R. J., & Monaco, G. E. (1978) · Journal of Experimental Psychology: General · doi:10.1037//0096-3445.107.1.1 · Cited by 289
G., E. H., & Münsterberg, H. (1908) · Harvard Law Review · doi:10.2307/1325494 · Cited by 186
REASONING FROM INCOMPLETE KNOWLEDGE
Collins, A., Warnock, E. H., Aiello, N., & Miller, M. L. (1975) · Representation and Understanding · doi:10.1016/b978-0-12-108550-6.50018-5 · Cited by 163
Processes in Acquiring Knowledge
Collins, A. (2017) · Routledge eBooks · doi:10.4324/9781315271644-26 · Cited by 77
Cited by
Investor Psychology and Security Market Under‐ and Overreactions
Daniel, K., Hirshleifer, D., & Subrahmanyam, A. (1998) · The Journal of Finance · doi:10.1111/0022-1082.00077 · Cited by 5,682
Boys will be Boys: Gender, Overconfidence, and Common Stock Investment
Barber, B. M., & Odean, T. (2001) · The Quarterly Journal of Economics · doi:10.1162/003355301556400 · Cited by 5,276
Dimensions of Consumer Expertise
Alba, J. W., & Hutchinson, J. W. (1987) · Journal of Consumer Research · doi:10.1086/209080 · Cited by 4,375
Extensional versus intuitive reasoning: The conjunction fallacy in probability judgment.
Tversky, A., & Kahneman, D. (1983) · Psychological Review · doi:10.1037/0033-295x.90.4.293 · Cited by 3,991
Heuristics and Biases: The Psychology of Intuitive Judgment
Bottom, W. P., Gilovich, T., Griffin, D., & Kahneman, D. (2004) · The Academy of Management Review · doi:10.2307/20159081 · Cited by 3,536
Representativeness revisited: Attribute substitution in intuitive judgment.
Kahneman, D., & Frederick, S. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.004 · Cited by 3,476
Norm theory: Comparing reality to its alternatives.
Kahneman, D., & Miller, D. T. (1986) · Psychological Review · doi:10.1037/0033-295x.93.2.136 · Cited by 3,024
Busenitz, L. W., & Barney, J. B. (1997) · Journal of Business Venturing · doi:10.1016/s0883-9026(96)00003-1 · Cited by 2,618
The trouble with overconfidence.
Moore, D. A., & Healy, P. J. (2008) · Psychological Review · doi:10.1037/0033-295x.115.2.502 · Cited by 2,358
Investor Psychology and Asset Pricing
(2001) · The Journal of Finance · doi:10.1111/0022-1082.00379 · Cited by 2,357
Slovic, P., Finucane, M., Peters, E., & MacGregor, D. G. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.025 · Cited by 2,349
Self-citation“Clinical versus Actuarial Judgment.”
Dawes, R. M., Faust, D., & Meehl, P. E. (1989) · Science · doi:10.1126/science.2648573 · Cited by 2,298
Heuristics and Biases: The Psychology of Intuitive Judgment
(2002) · Cambridge University Press eBooks · doi:10.1017/cbo9780511808098 · Cited by 2,192
Volume, Volatility, Price, and Profit When All Traders Are Above Average
Odean, T. (1998) · The Journal of Finance · doi:10.1111/0022-1082.00078 · Cited by 1,979
Are we all less risky and more skillful than our fellow drivers?
Svenson, O. (1981) · Acta Psychologica · doi:10.1016/0001-6918(81)90005-6 · Cited by 1,969
The totalitarian ego: Fabrication and revision of personal history.
Greenwald, A. G. (1980) · American Psychologist · doi:10.1037/0003-066x.35.7.603 · Cited by 1,942
“Fischhoff, Slovic, and Lichtenstein ( 1977 ) asked people to give answers to difficult general information questions and then asked them to estimate the probability of correctness of their answers.”
BackgroundFlawed Self-Assessment: Implications for Health, Education, and the Workplace
Dunning, D., Heath, C., & Suls, J. M. (2004) · Psychological Science in the Public Interest · doi:10.1111/j.1529-1006.2004.00018.x · Cited by 1,865
The weighing of evidence and the determinants of confidence
Griffin, D., & Tversky, A. (1992) · Cognitive Psychology · doi:10.1016/0010-0285(92)90013-r · Cited by 1,841
The Hot Hand in Basketball: On the Misperception of Random Sequences
Gilovich, T., Vallone, R., & Tversky, A. (1985) · Cognitive Psychology · doi:10.1016/0010-0285(85)90010-6 · Cited by 1,649
Probabilistic mental models: a Brunswikian theory of confidence
Gigerenzer, G., Hoffrage, U., & Kleinbölting, H. (1991) · Psychological Review · doi:10.1037/0033-295x.98.4.506 · Cited by 1,506
Koriat, A., Lichtenstein, S., & Fischhoff, B. (1980) · Journal of Experimental Psychology: Human Learning and Memory · doi:10.1037/0278-7393.6.2.107 · Cited by 1,477
Self-citationChapter 18 A survey of behavioral finance
Barberis, N., & Thaler, R. (2003) · Handbook of the Economics of Finance · doi:10.1016/s1574-0102(03)01027-6 · Cited by 1,441
Monitoring one’s own knowledge during study: A cue-utilization approach to judgments of learning
Koriat, A. (1997) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.126.4.349 · Cited by 1,363
Confidence in judgment: persistence of the illusion of validity
Einhorn, H. J., & Hogarth, R. M. (1978) · Psychological Review · doi:10.1037/0033-295x.85.5.395 · Cited by 1,209
Misinformation and the Currency of Democratic Citizenship
Kuklinski, J. H., Quirk, P. J., Jerit, J., Schwieder, D., & Rich, R. F. (2000) · The Journal of Politics · doi:10.1111/0022-3816.00033 · Cited by 1,167
Facts and Fears: Understanding Perceived Risk
Slovic, P., Fischhoff, B., & Lichtenstein, S. (1980) · Societal Risk Assessment · doi:10.1007/978-1-4899-0445-4_9 · Cited by 1,188
Self-citationSupport theory: a nonextensional representation of subjective probability
Tversky, A., & Koehler, D. J. (1994) · Psychological Review · doi:10.1037/0033-295x.101.4.547 · Cited by 1,167
Cognitive biases, risk perception, and venture formation
Simon, M., Houghton, S. M., & Aquino, K. (2000) · Journal of Business Venturing · doi:10.1016/s0883-9026(98)00003-2 · Cited by 1,151
Do those who know more also know more about how much they know?
Lichtenstein, S., & Fischhoff, B. (1977) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(77)90001-0 · Cited by 1,081
Self-citationMonitoring and control processes in the strategic regulation of memory accuracy.
Koriat, A., & Goldsmith, M. (1996) · Psychological Review · doi:10.1037//0033-295x.103.3.490 · Cited by 1,065
(1990) · Max Planck Institute for Plasma Physics · Cited by 1,059
First Impressions Matter: A Model of Confirmatory Bias
Rabin, M., & Schrag, J. L. (1999) · The Quarterly Journal of Economics · doi:10.1162/003355399555945 · Cited by 1,001
Trust, self-confidence, and operators' adaptation to automation
Lee, J. D., & Moray, N. (1994) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1994.1007 · Cited by 932
How do we know that we know? The accessibility model of the feeling of knowing
Koriat, A. (1993) · Psychological Review · doi:10.1037/0033-295x.100.4.609 · Cited by 895
Narcissism, confidence, and risk attitude
Campbell, W. K., Goodie, A. S., & Foster, J. D. (2004) · Journal of Behavioral Decision Making · doi:10.1002/bdm.475 · Cited by 854
Slovic, P., Fischhoff, B., & Lichtenstein, S. (1982) · Risk Analysis · doi:10.1111/j.1539-6924.1982.tb01369.x · Cited by 850
Self-citationKnowledge Calibration: What Consumers Know and What They Think They Know
Alba, J. W., & Hutchinson, J. W. (2000) · Journal of Consumer Research · doi:10.1086/314317 · Cited by 828
The use of statistical heuristics in everyday inductive reasoning.
Nisbett, R. E., Krantz, D. H., Jepson, C., & Kunda, Z. (1983) · Psychological Review · doi:10.1037/0033-295x.90.4.339 · Cited by 811
Park, C. W., Mothersbaugh, D. L., & Feick, L. (1994) · Journal of Consumer Research · doi:10.1086/209383 · Cited by 798
Overconfidence: It Depends on How, What, and Whom You Ask
Klayman, J., Soll, J. B., González-Vallejo, C., & Barlas, S. (1999) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1999.2847 · Cited by 785
Online Investors: Do the Slow Die First?
Barber, B. M., & Odean, T. (2002) · Review of Financial Studies · doi:10.1093/rfs/15.2.455 · Cited by 784
Advances in Behavioral Finance.
Jegadeesh, N., & Thaler, R. H. (1995) · The Journal of Finance · doi:10.2307/2329257 · Cited by 775
Costs and benefits of judgment errors: Implications for debiasing.
Arkes, H. R. (1991) · Psychological Bulletin · doi:10.1037/0033-2909.110.3.486 · Cited by 764
Dunning, D., Meyerowitz, J. A., & Holzberg, A. D. (1989) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.57.6.1082 · Cited by 758
Slovic, P., Fischhoff, B., & Lichtenstein, S. (1981) · Risk/Benefit Analysis in Water Resources Planning and Management · doi:10.1007/978-1-4899-2168-0_17 · Cited by 712
Self-citationDunning, D., Meyerowitz, J. A., & Holzberg, A. D. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.020 · Cited by 678
All the News That's Fit to Reprint: Do Investors React to Stale Information?
Tetlock, P. C. (2011) · Review of Financial Studies · doi:10.1093/rfs/hhq141 · Cited by 677
Chatterjee, A., & Hambrick, D. C. (2011) · Administrative Science Quarterly · doi:10.1177/0001839211427534 · Cited by 636
Risk Perception and Communication
Fischhoff, B., Bostrom, A., & Quadrel, M. J. (1993) · Annual Review of Public Health · doi:10.1146/annurev.pu.14.050193.001151 · Cited by 634
Self-citationThe Dirt on Coming Clean: Perverse Effects of Disclosing Conflicts of Interest
Cain, D. M., Loewenstein, G., & Moore, D. A. (2005) · The Journal of Legal Studies · doi:10.1086/426699 · Cited by 614
Forecasting and Planning: An Evaluation
Hogarth, R. M., & Makridakis, S. (1981) · Management Science · doi:10.1287/mnsc.27.2.115 · Cited by 608
Jehn, K. A., & Shah, P. P. (1997) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.72.4.775 · Cited by 561
Metacognition and consciousness
Koriat, A. (2007) · The Cambridge Handbook of Consciousness · doi:10.1017/cbo9780511816789.012 · Cited by 554
Calibration and probability judgements: Conceptual and methodological issues
Keren, G. (1991) · Acta Psychologica · doi:10.1016/0001-6918(91)90036-y · Cited by 549
Aspiration Level Adaptation: An Empirical Exploration
Lant, T. K. (1992) · Management Science · doi:10.1287/mnsc.38.5.623 · Cited by 521
Beyond hubris: How highly confident entrepreneurs rebound to venture again
Hayward, M. L. A., Forster, W. R., Sarasvathy, S. D., & Fredrickson, B. L. (2010) · Journal of Business Venturing · doi:10.1016/j.jbusvent.2009.03.002 · Cited by 513
Biais, B., Hilton, D., Mazurier, K., & Pouget, S. (2005) · Review of Economic Studies · doi:10.1111/j.1467-937x.2005.00333.x · Cited by 505
Toward a Theory of Behavioral Operations
Gino, F., & Pisano, G. (2008) · Manufacturing & Service Operations Management · doi:10.1287/msom.1070.0205 · Cited by 497
Does Overconfidence Affect Corporate Investment? CEO Overconfidence Measures Revisited
Malmendier, U., & Tate, G. (2005) · European Financial Management · doi:10.1111/j.1354-7798.2005.00302.x · Cited by 468
Gender Differences in Seff-Perceptions: Convergent Evidence from Three Measures of Accuracy and Bias
Beyer, S., & Bowden, E. M. (1997) · Personality and Social Psychology Bulletin · doi:10.1177/0146167297232005 · Cited by 463
Cognitive biases and their impact on strategic planning
Barnes, J. H. (1984) · Strategic Management Journal · doi:10.1002/smj.4250050204 · Cited by 451
Reconsidering the Rational Public: Cognition, Heuristics, and Mass Opinion
Kuklinski, J. H., & Quirk, P. J. (2000) · Elements of Reason · doi:10.1017/cbo9780511805813.008 · Cited by 446
The Feeling of Knowing: Some Metatheoretical Implications for Consciousness and Control
Koriat, A. (2000) · Consciousness and Cognition · doi:10.1006/ccog.2000.0433 · Cited by 442
Why we still use our heads instead of formulas: Toward an integrative approach.
Kleinmuntz, B. (1990) · Psychological Bulletin · doi:10.1037//0033-2909.107.3.296 · Cited by 437
Why are some entrepreneurs more innovative than others?
Koellinger, P. (2008) · Small Business Economics · doi:10.1007/s11187-008-9107-0 · Cited by 436
Differences between traits: Properties associated with interjudge agreement.
Funder, D. C., & Dobroth, K. M. (1987) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.52.2.409 · Cited by 434
Unpacking, repacking, and anchoring: Advances in support theory.
Rottenstreich, Y., & Tversky, A. (1997) · Psychological Review · doi:10.1037/0033-295x.104.2.406 · Cited by 425
Entrepreneurial Risk and Strategic Decision Making: It’s a Matter of Perspective
Busenitz, L. W. (1999) · The Journal of Applied Behavioral Science · doi:10.1177/0021886399353005 · Cited by 421
BIASES IN THE INTERPRETATION AND USE OF RESEARCH RESULTS
MacCoun, R. J. (1998) · Annual Review of Psychology · doi:10.1146/annurev.psych.49.1.259 · Cited by 417
Simon, M., & Houghton, S. M. (2003) · Academy of Management Journal · doi:10.2307/30040610 · Cited by 416
Incorporating the Irrelevant: Anchors in Judgments of Belief and Value
Chapman, G. B., & Johnson, E. J. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.008 · Cited by 410
Sloman, S. A. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.024 · Cited by 395
Testing bayes rule and the representativeness heuristic: Some experimental evidence
Grether, D. M. (1992) · Journal of Economic Behavior & Organization · doi:10.1016/0167-2681(92)90078-p · Cited by 395
Hilbert, M. (2012) · Psychological Bulletin · doi:10.1037/a0025940 · Cited by 391
Cognitive Biases and Strategic Decision Processes: An Integrative Perspective
Das, T. K., & Teng, B. (1999) · Journal of Management Studies · doi:10.1111/1467-6486.00157 · Cited by 387
The Courage of Misguided Convictions
Barber, B. M., & Odean, T. (1999) · Financial Analysts Journal · doi:10.2469/faj.v55.n6.2313 · Cited by 387
Sherman, S. J., Cialdini, R. B., Schwartzman, D. F., & Reynolds, K. D. (1985) · Personality and Social Psychology Bulletin · doi:10.1177/0146167285111011 · Cited by 382
Lichtenstein, S., & Fischhoff, B. (1980) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(80)90052-5 · Cited by 375
Self-citationPsychological Barriers to Dispute Resolution
Ross, L., & Ward, A. (1995) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(08)60407-4 · Cited by 380
Cunningham, A. E., Perry, K. E., Stanovich, K. E., & Stanovich, P. J. (2004) · Annals of Dyslexia · doi:10.1007/s11881-004-0007-y · Cited by 374
Brewer, N., & Wells, G. L. (2006) · Journal of Experimental Psychology: Applied · doi:10.1037/1076-898x.12.1.11 · Cited by 361
Power and overconfident decision-making
Fast, N. J., Sivanathan, N., Mayer, N. D., & Galinsky, A. D. (2012) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2011.11.009 · Cited by 351
Lopes, L. L. (1991) · Theory & Psychology · doi:10.1177/0959354391011005 · Cited by 346
Perceived Risk, Real Risk: Social Science and the Art of Probabilistic Risk Assessment
Freudenburg, W. R. (1988) · Science · doi:10.1126/science.3175635 · Cited by 330
Scientific Explanation and the Sense of Understanding
Trout, J. D. (2002) · Philosophy of Science · doi:10.1086/341050 · Cited by 330
Ethical leadership and the psychology of decision making
Messick, D. M., & Bazerman, M. H. (2004) · Research in Ethical Issues in Organizations · doi:10.1016/s1529-2096(01)03014-0 · Cited by 325
The self-consistency model of subjective confidence.
Koriat, A. (2012) · Psychological Review · doi:10.1037/a0025648 · Cited by 320
Koriat, A., & Levy-Sadot, R. (2001) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037//0278-7393.27.1.34 · Cited by 318
Assessing uncertainty in physical constants
Henrion, M., & Fischhoff, B. (1986) · American Journal of Physics · doi:10.1119/1.14447 · Cited by 316
Self-citationThe calibration and resolution of confidence in perceptual judgments
Baranski, J. V., & Petrusic, W. M. (1994) · Perception & Psychophysics · doi:10.3758/bf03205299 · Cited by 312
Dissociating knowing and the feeling of knowing: Further evidence for the accessibility model.
Koriat, A. (1995) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.124.3.311 · Cited by 307
Introduction – Heuristics and Biases: Then and Now
Gilovich, T., & Griffin, D. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.002 · Cited by 305
Information, Cognitive Biases, and Commitment to a Course of Action
Schwenk, C. R. (1986) · The Academy of Management Review · doi:10.2307/258461 · Cited by 303
Facing uncertainty in the game of bridge: A calibration study
Keren, G. (1987) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(87)90047-1 · Cited by 302
Confidence-Enhanced Performance
Compte, O., & Postlewaite, A. (2004) · American Economic Review · doi:10.1257/0002828043052204 · Cited by 300
Chen, G., Crossland, C., & Luo, S. (2015) · Strategic Management Journal · doi:10.1002/smj.2291 · Cited by 294
Situation Awareness-Based Agent Transparency
Chen, J. Y., Procci, K., Boyce, M., Wright, J., Garcia, A., & Barnes, M. (2014) · doi:10.21236/ada600351 · Cited by 293
Reading Across Mediums: Effects of Reading Digital and Print Texts on Comprehension and Calibration
Singer, L. M., & Alexander, P. A. (2017) · The Journal of Experimental Education · doi:10.1080/00220973.2016.1143794 · Cited by 292
Norm Theory: Comparing Reality to Its Alternatives
Kahneman, D., & Miller, D. T. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.022 · Cited by 289
The Accuracy-Confidence Correlation in the Detection of Deception
DePaulo, B. M., Charlton, K., Cooper, H., Lindsay, J. J., & Muhlenbruck, L. (1997) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr0104_5 · Cited by 288
Metadata
- Authors
- Fischhoff, B., Slovic, P., & Lichtenstein, S.
- Venue
- Journal of Experimental Psychology: Human Perception and Performance
- Published
- 1977-11
- Volume
- 3
- Issue
- 4
- Pages
- 552-564
- ISSN
- 0096-1523 (ISSN-L)
- 1939-1277
- OpenAlex
- W2019939391
- Cited by
- 1,417
- References
- 9
- FWCI
- 2.69
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.