The DOI matches its Crossref record.
Debiasing
Abstract
Once a behavioral phenomenon has been identified in some experimental context, it is appropriate to start questioning its robustness. A popular and often productive questioning strategy might be called destructive testing, after a kindred technique in engineering. A proposed design is subjected to conditions intended to push it to and beyond its limits of viability. Such controlled destruction can clarify where it is to be trusted and why it works when it does. Applied to a behavioral phenomenon, this philosophy would promote research attempting to circumscribe the conditions for its observation and the psychological processes that must be evoked or controlled in order to eliminate it. Where the phenomenon is a judgmental bias, destructive testing takes the form of debiasing efforts. Destructive testing shows where a design fails; when a bias fails, the result is improved judgment. The study of heuristics and biases might itself be seen as the application of destructive testing to the earlier hypothesis that people are competent intuitive statisticians. Casual observation suggests that people's judgment is generally “good enough” to let them make it through life without getting into too much trouble. Early studies (Peterson & Beach, 1967) supported this belief, indicating that, to a first approximation, people might be described as veridical observers and normative judges. Subsequent studies, represented in this volume, tested the accuracy of this approximation by looking at the limits of people's apparent successes. Could better judgment have made them richer or healthier?
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Confirmation Bias: A Ubiquitous Phenomenon in Many Guises
Nickerson, R. S. (1998) · Review of General Psychology · doi:10.1037/1089-2680.2.2.175 · Cited by 7,267
Extensional versus intuitive reasoning: The conjunction fallacy in probability judgment.
Tversky, A., & Kahneman, D. (1983) · Psychological Review · doi:10.1037/0033-295x.90.4.293 · Cited by 3,991
Heuristics and Biases: The Psychology of Intuitive Judgment
Bottom, W. P., Gilovich, T., Griffin, D., & Kahneman, D. (2004) · The Academy of Management Review · doi:10.2307/20159081 · Cited by 3,536
Representativeness revisited: Attribute substitution in intuitive judgment.
Kahneman, D., & Frederick, S. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.004 · Cited by 3,476
Norm theory: Comparing reality to its alternatives.
Kahneman, D., & Miller, D. T. (1986) · Psychological Review · doi:10.1037/0033-295x.93.2.136 · Cited by 3,024
Arkes, H. R., & Blumer, C. (1985) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(85)90049-4 · Cited by 2,573
Slovic, P., Finucane, M., Peters, E., & MacGregor, D. G. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.025 · Cited by 2,349
“Clinical versus Actuarial Judgment.”
Dawes, R. M., Faust, D., & Meehl, P. E. (1989) · Science · doi:10.1126/science.2648573 · Cited by 2,298
Heuristics and Biases: The Psychology of Intuitive Judgment
(2002) · Cambridge University Press eBooks · doi:10.1017/cbo9780511808098 · Cited by 2,192
The weighing of evidence and the determinants of confidence
Griffin, D., & Tversky, A. (1992) · Cognitive Psychology · doi:10.1016/0010-0285(92)90013-r · Cited by 1,841
The Hot Hand in Basketball: On the Misperception of Random Sequences
Gilovich, T., Vallone, R., & Tversky, A. (1985) · Cognitive Psychology · doi:10.1016/0010-0285(85)90010-6 · Cited by 1,649
Metacognitive Experiences in Consumer Judgment and Decision Making
Schwarz, N. (2004) · Journal of Consumer Psychology · doi:10.1207/s15327663jcp1404_2 · Cited by 1,549
Support theory: a nonextensional representation of subjective probability
Tversky, A., & Koehler, D. J. (1994) · Psychological Review · doi:10.1037/0033-295x.101.4.547 · Cited by 1,167
How to Make Cognitive Illusions Disappear: Beyond “Heuristics and Biases”
Gigerenzer, G. (1991) · European Review of Social Psychology · doi:10.1080/14792779143000033 · Cited by 1,159
The misunderstood limits of folk science: An illusion of explanatory depth
Rozenblit, L., & Keil, F. (2002) · Cognitive Science · doi:10.1207/s15516709cog2605_1 · Cited by 1,032
First offers as anchors: The role of perspective-taking and negotiator focus.
Galinsky, A. D., & Mussweiler, T. (2001) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.81.4.657 · Cited by 834
The use of statistical heuristics in everyday inductive reasoning.
Nisbett, R. E., Krantz, D. H., Jepson, C., & Kunda, Z. (1983) · Psychological Review · doi:10.1037/0033-295x.90.4.339 · Cited by 811
Psychological foundations of dynamic capabilities: reflexion and reflection in strategic management
Hodgkinson, G. P., & Healey, M. P. (2011) · Strategic Management Journal · doi:10.1002/smj.964 · Cited by 767
Taking stock of naturalistic decision making
Lipshitz, R., Klein, G., Orasanu, J., & Salas, E. (2001) · Journal of Behavioral Decision Making · doi:10.1002/bdm.381 · Cited by 761
Dunning, D., Meyerowitz, J. A., & Holzberg, A. D. (1989) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.57.6.1082 · Cited by 758
Dunning, D., Meyerowitz, J. A., & Holzberg, A. D. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.020 · Cited by 678
Cognitive and Motivational Biases in Decision and Risk Analysis
Montibeller, G., & von Winterfeldt, D. (2015) · Risk Analysis · doi:10.1111/risa.12360 · Cited by 578
Mussweiler, T., Strack, F., & Pfeiffer, T. (2000) · Personality and Social Psychology Bulletin · doi:10.1177/01461672002611010 · Cited by 556
Overconfidence, Compensation Contracts, and Capital Budgeting
GERVAIS, S., HEATON, J. B., & ODEAN, T. (2011) · The Journal of Finance · doi:10.1111/j.1540-6261.2011.01686.x · Cited by 538
An Opportunity for Me? The Role of Resources in Opportunity Evaluation Decisions
Haynie, J. M., Shepherd, D. A., & McMullen, J. S. (2009) · Journal of Management Studies · doi:10.1111/j.1467-6486.2009.00824.x · Cited by 516
THE EFFECTS OF FRAMING AND NEGOTIATOR OVERCONFIDENCE ON BARGAINING BEHAVIORS AND OUTCOMES.
Neale, M. A., & Bazerman, M. H. (1985) · Academy of Management Journal · doi:10.2307/256060 · Cited by 502
Zajac, E. J., & Bazerman, M. H. (1991) · Academy of Management Review · doi:10.5465/amr.1991.4278990 · Cited by 491
Roese, N. J., & Vohs, K. D. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612454303 · Cited by 457
Cognitive interventions to reduce diagnostic error: a narrative review
Graber, M. L., Kissam, S., Payne, V. L., Meyer, A. N. D., Sorensen, A., Lenfestey, N., Tant, E., Henriksen, K., LaBresh, K., & Singh, H. (2012) · BMJ Quality & Safety · doi:10.1136/bmjqs-2011-000149 · Cited by 449
Unpacking, repacking, and anchoring: Advances in support theory.
Rottenstreich, Y., & Tversky, A. (1997) · Psychological Review · doi:10.1037/0033-295x.104.2.406 · Cited by 425
How Can Decision Making Be Improved?
Milkman, K. L., Chugh, D., & Bazerman, M. H. (2009) · Perspectives on Psychological Science · doi:10.1111/j.1745-6924.2009.01142.x · Cited by 425
Cognitive debiasing 2: impediments to and strategies for change
Croskerry, P., Singhal, G., & Mamede, S. (2013) · BMJ Quality & Safety · doi:10.1136/bmjqs-2012-001713 · Cited by 419
Incorporating the Irrelevant: Anchors in Judgments of Belief and Value
Chapman, G. B., & Johnson, E. J. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.008 · Cited by 410
The Role of Representative Design in an Ecological Approach to Cognition.
Dhami, M. K., Hertwig, R., & Hoffrage, U. (2004) · Psychological Bulletin · doi:10.1037/0033-2909.130.6.959 · Cited by 408
Sloman, S. A. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.024 · Cited by 395
Architecture of Entrepreneurial Learning: Exploring the Link among Heuristics, Knowledge, and Action
Holcomb, T. R., Ireland, R. D., Holmes, R. M., & Hitt, M. A. (2009) · Entrepreneurship Theory and Practice · doi:10.1111/j.1540-6520.2008.00285.x · Cited by 395
Debiasing Decisions: Improved Decision Making With a Single Training Intervention
Morewedge, C. K., Yoon, H., Scopelliti, I., Symborski, C. W., Korris, J. H., & Kassam, K. S. (2015) · Policy Insights from the Behavioral and Brain Sciences · doi:10.1177/2372732215600886 · Cited by 384
Sherman, S. J., Cialdini, R. B., Schwartzman, D. F., & Reynolds, K. D. (1985) · Personality and Social Psychology Bulletin · doi:10.1177/0146167285111011 · Cited by 382
Bornstein, B. H., & Emler, A. C. (2001) · Journal of Evaluation in Clinical Practice · doi:10.1046/j.1365-2753.2001.00284.x · Cited by 353
Cognitive biases and decision support systems development: a design science approach
Arnott, D. (2006) · Information Systems Journal · doi:10.1111/j.1365-2575.2006.00208.x · Cited by 354
Frederickson, J. R., & Miller, J. S. (2004) · The Accounting Review · doi:10.2308/accr.2004.79.3.667 · Cited by 344
Larrick, R. P. (2004) · Blackwell Handbook of Judgment and Decision Making · doi:10.1002/9780470752937.ch16 · Cited by 328
Assessing uncertainty in physical constants
Henrion, M., & Fischhoff, B. (1986) · American Journal of Physics · doi:10.1119/1.14447 · Cited by 316
Self-citationThe cognitive basis of model-based reasoning in science
Nersessian, N. J. (2002) · The Cognitive Basis of Science · doi:10.1017/cbo9780511613517.008 · Cited by 313
The calibration and resolution of confidence in perceptual judgments
Baranski, J. V., & Petrusic, W. M. (1994) · Perception & Psychophysics · doi:10.3758/bf03205299 · Cited by 312
Introduction – Heuristics and Biases: Then and Now
Gilovich, T., & Griffin, D. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.002 · Cited by 305
Self-Regulation of Cognitive Inference and Decision Processes
Baumeister, R. F., & Newman, L. S. (1994) · Personality and Social Psychology Bulletin · doi:10.1177/0146167294201001 · Cited by 292
Norm Theory: Comparing Reality to Its Alternatives
Kahneman, D., & Miller, D. T. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.022 · Cited by 289
Intuitive evaluation of likelihood judgment producers: evidence for a confidence heuristic
Price, P. C., & Stone, E. R. (2004) · Journal of Behavioral Decision Making · doi:10.1002/bdm.460 · Cited by 272
Imagery, Affect, and Financial Judgment
MacGregor, D. G., Slovic, P., Dreman, D., & Berry, M. (2000) · Journal of Psychology and Financial Markets · doi:10.1207/s15327760jpfm0102_2 · Cited by 279
The Cognitive Basis of Science
(2002) · Cambridge University Press eBooks · doi:10.1017/cbo9780511613517 · Cited by 276
Overconfidence in Newsvendor Orders: An Experimental Study
Ren, Y., & Croson, R. (2013) · Management Science · doi:10.1287/mnsc.2013.1715 · Cited by 267
Caplan, B. (2002) · The Economic Journal · doi:10.1111/1468-0297.00041 · Cited by 258
When debiasing backfires: Accessible content and accessibility experiences in debiasing hindsight.
Sanna, L. J., Schwarz, N., & Stocker, S. L. (2002) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.28.3.497 · Cited by 195
Bias Blind Spot: Structure, Measurement, and Consequences
Scopelliti, I., Morewedge, C. K., McCormick, E., Min, H. L., Lebrecht, S., & Kassam, K. S. (2015) · Management Science · doi:10.1287/mnsc.2014.2096 · Cited by 183
Mental Contamination and the Debiasing Problem
Wilson, T. D., Centerbar, D. B., & Brekke, N. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.012 · Cited by 160
The calibration of expert judgment: heuristics and biases beyond the laboratory
Koehler, D. J., Brenner, L., & Griffin, D. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.041 · Cited by 146
Finn, B., & Tauber, S. K. (2015) · Educational Psychology Review · doi:10.1007/s10648-015-9313-7 · Cited by 102
Chang, W., Chen, E., Mellers, B., & Tetlock, P. (2016) · Judgment and Decision Making · doi:10.1017/s1930297500004599 · Cited by 89
Confidence Calibration in a Multiyear Geopolitical Forecasting Competition
Moore, D. A., Swift, S. A., Minster, A., Mellers, B., Ungar, L., Tetlock, P., Yang, H. H. J., & Tenney, E. R. (2017) · Management Science · doi:10.1287/mnsc.2016.2525 · Cited by 74
“Overconfidence may be the most consequential of the many biases to which human judgment is vulnerable, both because of its ubiquity and because of its role in facilitating other biases and errors (Bazerman and Moore 2013, Fischhoff 1982, Kahneman 2011).”
BackgroundAircrews and automation bias: the advantages of teamwork?
Mosier, K. L., Skitka, L. J., Dunbar, M., & McDonnell, L. (2001) · The International Journal of Aviation Psychology · doi:10.1207/s15327108ijap1101_1 · Cited by 62
Does “putting on your thinking cap” reduce myside bias in evaluation of scientific evidence?
Drummond, C., & Fischhoff, B. (2019) · Thinking & Reasoning · doi:10.1080/13546783.2018.1548379 · Cited by 35
Self-citationThe influence of prior belief on scientific thinking
Evans, J. S. B. T. (2002) · The Cognitive Basis of Science · doi:10.1017/cbo9780511613517.011 · Cited by 22
Metadata
- Authors
- Fischhoff, B.
- Venue
- Judgment under Uncertainty
- Publisher
- Cambridge University Press
- Published
- 1982-04-30
- Pages
- 422-444
- OpenAlex
- W1853441518
- Cited by
- 506
- References
- 0
- FWCI
- 2.04
- Type
- book chapter
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.