The DOI matches its Crossref record; 110 of the 110 references it cites were found in a registry or an index.
Confirmation, disconfirmation, and information in hypothesis testing
Abstract
Strategies for hypothesis testing in scientific investigation and everyday reasoning have interested both psychologists and philosophers. A number of these scholars stress the importance of disconnrmation in reasoning and suggest that people are instead prone to a general deleterious "confirmation bias." In particular, it is suggested that people tend to test those cases that have the best chance of verifying current beliefs rather than those that have the best chance of falsifying them. We show, however; that many phenomena labeled "confirmation bias" are better understood in terms of a general positive test strategy. With this strategy, there is a tendency to test cases that are expected (or known) to have the property of interest rather than those expected (or known) to lack that property. This strategy is not equivalent to confirmation bias in the first sense; we show that the positive test strategy can be a very good heuristic for determining the truth or falsity of a hypothesis under realistic conditions. It can, however, lead to systematic errors or inefficiencies. The appropriateness of human hypothesis-testing strategies and prescriptions about optimal strategies must be understood in terms of the interaction between the strategy and the task at hand.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A hypothesis can create bias as it often entails confirmation and other biases that generate evidence, confirming that hypothesis while ignoring (or dismissing) conflicting evidence (Baldwin, 1993; Klayman & Ha, 1987; Wagenaar et al., 1993).”
From Biased and biasing: the hidden bias cascade and bias snowball effects (2025) · cites this paper as Klayman & Ha, 1987
In the citing paper
“In this sense,selection of evidence based on relevance is related to the confirmation bias in cognitive science, where learners have been observed to (arguably maladaptively) select data which they believe to be true (i.e. they fail to attempt to falsify their hypotheses) [133].”
From Evolution and impact of bias in human and machine learning algorithm interaction (2020) · cites this paper as [133]
Citations
Cites
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2022) · doi:10.1176/appi.books.9780890425787 · Cited by 23,476
Judgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1975) · Utility, Probability, and Human Decision Making · doi:10.1007/978-94-010-1834-0_8 · Cited by 22,650
(1966) · Medical Entomology and Zoology · Cited by 10,293
Signal detection theory and psychophysics
Ingleby, D. (1967) · Journal of Sound and Vibration · doi:10.1016/0022-460x(67)90197-6 · Cited by 8,616
The Logic of Scientific Discovery
Bhaskar, R. (2013) · Routledge eBooks · doi:10.4324/9780203090732-9 · Cited by 7,765
Diagnostic and Statistical Manual of Mental Disorders, 3rd ed
Cooper, A. M., & Michels, R. (1981) · American Journal of Psychiatry · doi:10.1176/ajp.138.1.128 · Cited by 7,419
Falsification and the Methodology of Scientific Research Programmes
Lakatos, I. (1970) · Criticism and the Growth of Knowledge · doi:10.1017/cbo9781139171434.009 · Cited by 4,649
Lord, C. G., Ross, L., & Lepper, M. R. (1979) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.37.11.2098 · Cited by 4,583
Human Inference: Strategies and Shortcomings of Social Judgment.
Cherniak, C., Nisbett, R. E., & Ross, L. D. (1983) · The Philosophical Review · doi:10.2307/2184495 · Cited by 4,196
Cited by
Sorted by citations
Items 901–998 of 998
Kraus, S. F. (2023) · Science & Education · doi:10.1007/s11191-023-00422-x · Cited by 20
The Role of Evidence Diversity and Explanation in 4- and 5-Year-Olds’ Resolution of Counterevidence
Macris, D. M., & Sobel, D. M. (2017) · Journal of Cognition and Development · doi:10.1080/15248372.2017.1323755 · Cited by 21
Harris, C., Fiedler, K., Marien, H., & Custers, R. (2020) · Journal of Experimental Psychology General · doi:10.1037/xge0000754 · Cited by 18
Updating politicized beliefs: How motivated reasoning contributes to polarization
Su, S. (2021) · Journal of Behavioral and Experimental Economics · doi:10.1016/j.socec.2021.101799 · Cited by 23
Understanding the #longCOVID and #longhaulers Conversation on Twitter: Multimethod Study
Santarossa, S., Rapp, A., Sardinas, S., Hussein, J., Ramirez, A., Cassidy‐Bushrow, A. E., Cheng, P., & Yu, E. (2021) · JMIR Infodemiology · doi:10.2196/31259 · Cited by 21
Over, D. E., & Evans, J. S. B. T. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009495349 · Cited by 19
What theories are needed for strategic management?
Bao, G. (2015) · Nankai Business Review International · doi:10.1108/nbri-05-2015-0012 · Cited by 20
Petrocelli, J. V., Seta, C. E., & Seta, J. J. (2013) · Thinking & Reasoning · doi:10.1080/13546783.2013.775073 · Cited by 20
Seeking health information on the web: Positive hypothesis testing
Kayhan, V. O. (2013) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2012.12.004 · Cited by 23
Pilditch, T. D., & Custers, R. (2017) · Acta Psychologica · doi:10.1016/j.actpsy.2017.04.006 · Cited by 22
A Context-Driven Framework for Proactive Decision Support With Applications
Mishra, M., Sidoti, D., Avvari, G. V., Mannaru, P., Ayala, D. F. M., Pattipati, K. R., & Kleinman, D. L. (2017) · IEEE Access · doi:10.1109/access.2017.2707091 · Cited by 22
The Role of Affect in the Development of Entrepreneurial Intentions
Pérez-Fernández, H., García, J. B. D., Martín‐Cruz, N., & Escudero, A. I. R. (2020) · Entrepreneurship Research Journal · doi:10.1515/erj-2019-0124 · Cited by 20
Strategically overconfident (to a fault): How self-promotion motivates advisor confidence.
Zant, A. B. V. (2021) · Journal of Applied Psychology · doi:10.1037/apl0000879 · Cited by 20
Variations on anchoring: Sequential anchoring revisited
Bahník, Š., Houdek, P., Vrbová, L., & Hájek, J. (2019) · Judgment and Decision Making · doi:10.1017/s1930297500005428 · Cited by 25
Refusing to budge: a confirmatory bias in decision making?
Kosnik, L.-R. D. (2007) · Mind & Society · doi:10.1007/s11299-007-0043-5 · Cited by 20
Davidai, S., & Deri, S. (2019) · Journal of Experimental Psychology General · doi:10.1037/xge0000580 · Cited by 20
Dealing with Uncertainties in Policing Serious Crime
Bammer, G. (2010) · ANU Press eBooks · doi:10.22459/dupsc.05.2010 · Cited by 21
The Weighing of Evidence and the Determinants of Confidence
Griffin, D., & Tversky, A. (2002) · Cambridge University Press eBooks · doi:10.1017/cbo9780511808098.015 · Cited by 20
Gigerenzer, G. (2002) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195153729.003.0010 · Cited by 20
Lewicka, M. (1998) · Springer eBooks · doi:10.1007/978-1-4757-2901-6_9 · Cited by 20
The influence of information presentation order on professional tax judgment
Pei, B. K. W., Reckers, P. M. J., & Wyndelts, R. W. (1990) · Journal of Economic Psychology · doi:10.1016/0167-4870(90)90050-j · Cited by 20
Issues in the development and use of expert systems for marketing decisions
Mitchell, A. A., Russo, J. E., & Wittink, D. R. (1991) · International Journal of Research in Marketing · doi:10.1016/0167-8116(91)90006-s · Cited by 20
La théorie argumentative du raisonnement
Mercier, H. (2009) · HAL · Cited by 20
Loukopoulos, P. (2005) · Cited by 20
O’Neill, O. (2009) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780195145397.003.0006 · Cited by 20
Stall, L. M., & Petrocelli, J. V. (2022) · Applied Cognitive Psychology · doi:10.1002/acp.3998 · Cited by 22
Inter-temporal choice and self-control: saving and borrowing
Webley, P., & Nyhus, E. K. (2008) · Cambridge University Press eBooks · doi:10.1017/cbo9780511490118.005 · Cited by 20
Rolison, J. J., Evans, J. S. B. T., Dennis, I., & Walsh, C. R. (2012) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2012.03.003 · Cited by 22
Mandel, D. R., & Vartanian, O. A. (2009) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470210902794148 · Cited by 19
Stereotypes as Pseudocontingencies
Kutzner, F., & Fiedler, K. (2016) · European Review of Social Psychology · doi:10.1080/10463283.2016.1260238 · Cited by 25
Are we at a Turning Point for Distance Research in International Business Studies?
Dow, D. (2017) · Emerald Group Publishing Limited eBooks · doi:10.1108/s1745-886220170000012001 · Cited by 18
Online prejudice and barriers to digital innovation: Empirical investigations of Chinese consumers
Che, T., Peng, Z. C., Lai, F., & Luo, X. R. (2021) · Information Systems Journal · doi:10.1111/isj.12323 · Cited by 19
Nascent entrepreneur(ship) research : a review
Davidsson, P., & Gordon, S. R. (2009) · Cited by 19
Contraries as an effective strategy in geometrical problem solving
Branchini, E., Burro, R., Bianchi, I., & Savardi, U. (2015) · Thinking & Reasoning · doi:10.1080/13546783.2014.994035 · Cited by 19
Is Popper's Falsificationist Heuristic a Helpful Resource for Developing Critical Thinking?
Lam, C. (2007) · Educational Philosophy and Theory · doi:10.1111/j.1469-5812.2007.00349.x · Cited by 19
Bicchieri, C. (2009) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780195145397.003.0010 · Cited by 25
Confirmation Bias, Problem-Solving and Cognitive Models
Green, D. W. (1990) · Advances in psychology · doi:10.1016/s0166-4115(08)61342-4 · Cited by 19
Penner, D. E., & Klahr, D. (1996) · Child Development · doi:10.1111/j.1467-8624.1996.tb01884.x · Cited by 19
Simulating buying center decision processes: propositions and methodology
McNally, R. C. (2002) · Journal of Business and Industrial Marketing · doi:10.1108/08858620210419790 · Cited by 19
Probability judgment in three-category classification learning.
Koehler, D. J. (2000) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037//0278-7393.26.1.28 · Cited by 19
Connolly, T., & Ordóñez, L. D. (2003) · Wiley eBooks · doi:10.1002/0471264385.wei1219 · Cited by 19
On the Evolutionary Emergence of OptimismPreprint
Heifetz, A., & Yossi Spiegel, C. (2000) · SSRN Electronic Journal · doi:10.2139/ssrn.247355 · Cited by 19
Fratricide in Air Operations. Opening the Black-Box: Revealing the 'Social'
Masys, A. J. (2010) · Figshare · Cited by 18
Scientific Investigations of Elementary School Children
Valanides, N., Papageorgiou, M., & Angeli, C. (2013) · Journal of Science Education and Technology · doi:10.1007/s10956-013-9448-6 · Cited by 19
Strategies for selecting and evaluating information
Liefgreen, A., Pilditch, T. D., & Lagnado, D. A. (2020) · Cognitive Psychology · doi:10.1016/j.cogpsych.2020.101332 · Cited by 18
Explaining the Evidence: How the Mind Investigates the World
Lagnado, D. A. (2021) · Cited by 18
A unified framework for incorporating decision making into explanations of business failure
Amankwah‐Amoah, J. (2015) · Industrial Management & Data Systems · doi:10.1108/imds-03-2015-0085 · Cited by 18
Probability estimation in poker: A qualified success for unaided judgment
Liley, J., & Rakow, T. (2009) · Journal of Behavioral Decision Making · doi:10.1002/bdm.670 · Cited by 18
The Impact of Sequential Data on Consumer Confidence in Relative Judgments
Biswas, D., Zhao, G., & Lehmann, D. R. (2010) · Journal of Consumer Research · doi:10.1086/656061 · Cited by 18
Whitesmith, M. (2018) · Intelligence & National Security · doi:10.1080/02684527.2018.1534640 · Cited by 18
Understanding and Managing Bias
Kebbell, M. R., Muller, D., & MARTIN, K. (2010) · ANU Press eBooks · doi:10.22459/dupsc.05.2010.06 · Cited by 18
Conflicts of Interest in Public Policy Research
MacCoun, R. J. (2005) · Cambridge University Press eBooks · doi:10.1017/cbo9780511610332.018 · Cited by 18
Gale, M. B., & Ball, L. J. (2011) · Memory & Cognition · doi:10.3758/s13421-011-0159-z · Cited by 18
The information gained from witnesses' responses to an initial “blank” lineup.
Palmer, M. A., Brewer, N., & Weber, N. (2012) · Law and Human Behavior · doi:10.1037/h0093939 · Cited by 18
Crott, H. W., Giesel, M., & Hoffmann, C. (1998) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.75.4.938 · Cited by 18
The impact of external representation in a rule discovery task
Vallée‐Tourangeau, F., & Penney, A. K. (2005) · The European Journal of Cognitive Psychology · doi:10.1080/09541440440000249 · Cited by 18
Leader-focused search: The impact of an emerging preference on information search
Carlson, K. A., & Guha, A. (2011) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2010.12.002 · Cited by 18
Human performance in fault diagnosis: can expert systems help?
Lindgaard, G. (1995) · Interacting with Computers · doi:10.1016/0953-5438(95)93604-4 · Cited by 18
Reflections on the peer review process
Marsh, H. W., & Ball, S. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065912 · Cited by 18
Theory-Driven Reasoning about Plausible Pasts and Probable Futures in World Politics
Tetlock, P. E. (2002) · Cambridge University Press eBooks · doi:10.1017/cbo9780511808098.044 · Cited by 18
Hypothesis testing in a rule discovery problem: When a focused procedure is effective
Rossi, S., Caverni, J. P., & Girotto, V. (2001) · The Quarterly Journal of Experimental Psychology Section A · doi:10.1080/02724980042000101 · Cited by 18
Hypothesis Testing: Strategy Selection for Generalising versus Limiting Hypotheses
Spellman, B. A. (1999) · Thinking & Reasoning · doi:10.1080/135467899394084 · Cited by 18
Predicting fault diagnosis performance: why are some bugs hard to find?
Sanderson, P. M., & Murtagh, J. M. (1990) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/21.47830 · Cited by 18
The dilution effect: judgmental bias, conversational convention, or a bit of both?
Tetlock, P. E., Lerner, J. S., & Boettger, R. (1996) · European Journal of Social Psychology · doi:10.1002/(sici)1099-0992(199611)26:6 · Cited by 97
Baker, S., Patel, N. P., Gunten, C. D. V., Valentine, K. D., & Scherer, L. D. (2020) · Judgment and Decision Making · doi:10.1017/s193029750000735x · Cited by 17
Fernbach, P. M., & Bogard, J. E. (2023) · Topics in Cognitive Science · doi:10.1111/tops.12662 · Cited by 17
Cherubini, P., Rusconi, P., Russo, S., & Crippa, F. (2012) · Psychological Research · doi:10.1007/s00426-012-0430-3 · Cited by 17
The use of incentives in organizations
Jeffrey, S. A., Dickinson, A. M., & Einarsson, Y. F. (2013) · International Journal of Productivity and Performance Management · doi:10.1108/ijppm-12-2012-0139 · Cited by 17
Taking the High (or Low) Road: A Quantifier Priming Perspective on Basic Anchoring Effects
Sleeth‐Keppler, D. (2013) · The Journal of Social Psychology · doi:10.1080/00224545.2012.757543 · Cited by 17
Walsh, C. R., & Sloman, S. A. (2004) · eScholarship (California Digital Library) · Cited by 17
Harris, A. J. L., de Molière, L., Soh, M., & Hahn, U. (2017) · PLoS ONE · doi:10.1371/journal.pone.0173136 · Cited by 17
Cohen, A. S., Mitchell, K. R., Beck, M. R., & Hicks, J. L. (2017) · Journal of Experimental Psychopathology · doi:10.5127/jep.056316 · Cited by 17
Biases in construction project dispute resolution
Cheung, S. O., & Li, K. (2019) · Engineering Construction & Architectural Management · doi:10.1108/ecam-03-2018-0109 · Cited by 19
Acting as Expected: Global Leadership Preferences and the Pursuit of an Integrated Supply Chain
Kull, T. J., Wiengarten, F., Power, D., & Shah, P. (2019) · Journal of Supply Chain Management · doi:10.1111/jscm.12208 · Cited by 17
Understanding Antigay Bias From a Cognitive-Affective-Behavioral Perspective
Callender, K. A. (2014) · Journal of Homosexuality · doi:10.1080/00918369.2014.998965 · Cited by 18
Entrepreneurial Decision-Making: Thinking Under Uncertainty
Gustafsson, V. (2009) · International studies in entrepreneurship · doi:10.1007/978-1-4419-0443-0_13 · Cited by 17
The price of information: Increased inspection costs reduce the confirmation bias in visual search
Rajsic, J., Wilson, D. E., & Pratt, J. (2017) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2016.1278249 · Cited by 21
You and I have nothing in common: The role of dissimilarity in interpersonal influence
Tuk, M. A., Verlegh, P. W. J., Smidts, A., & Wigboldus, D. H. J. (2019) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2018.12.010 · Cited by 17
Preference Consistency and Preference Strength: Processing and Judgmental issues1
Jain, S. P. (2003) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.2003.tb01940.x · Cited by 17
Modeling collective choice: decision‐making on complex intellective tasks
Bonner, B. L., Baumann, M. R., Lehn, A., Pierce, D., & Wheeler, E. C. (2006) · European Journal of Social Psychology · doi:10.1002/ejsp.305 · Cited by 17
O’Donnell, M. A. (2013) · American Journal of Health Promotion · doi:10.4278/ajhp.28.1.iv · Cited by 17
The Cognitive Psychology of Reasoning: An Introduction
Evans, J. S. B. T. (1993) · The Quarterly Journal of Experimental Psychology Section A · doi:10.1080/14640749308401027 · Cited by 17
Information Sampling and Reasoning Biases
Fiedler, K., & Kutzner, F. (2015) · Wiley eBooks · doi:10.1002/9781118468333.ch13 · Cited by 17
Critical Thinking, Critical Reasoning, and Methodological Reflection (1996)
Finocchiaro, M. A. (2005) · Cambridge University Press eBooks · doi:10.1017/cbo9780511527517.007 · Cited by 17
X. Emotion and Desire in Self-Deception
Mele, A. R. (2003) · Royal Institute of Philosophy Supplement · doi:10.1017/s1358246100007955 · Cited by 16
Power Asymmetry, Negotiations and Conflict Management in Organizations
Fousiani, K. (2022) · Organizational Conflict - New Insights · doi:10.5772/intechopen.95492 · Cited by 16
Bos, L., Egelhofer, J. L., & Lecheler, S. K. (2023) · Communication Research · doi:10.1177/00936502231178432 · Cited by 24
RETRACTED ARTICLE: The skeptical import of motivated reasoning: A closer look at the evidence
van Doorn, M. (2023) · Thinking & Reasoning · doi:10.1080/13546783.2023.2276975 · Cited by 20
RetractedMindsets and politically motivated reasoning about fake news
Ludwig, J., & Sommer, J. (2024) · Motivation and Emotion · doi:10.1007/s11031-024-10067-0 · Cited by 23
Practical Reasoning and Emotion
Greenspan, P. S. (2009) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780195145397.003.0011 · Cited by 17
Cyber-Empathic Design: A Data Driven Framework for Product Design
Ghosh, D. D., Kim, J.-H., Olewnik, A. T., Lakshmanan, A., & Lewis, K. E. (2016) · doi:10.1115/detc2016-59642 · Cited by 16
Ghosh, D., Olewnik, A. T., & Lewis, K. E. (2017) · Journal of Computing and Information Science in Engineering · doi:10.1115/1.4037435 · Cited by 19
Tell Me What I Wanted to Hear: Confirmation Effect in Lay Evaluations of Financial Expert Authority
Zaleśkiewicz, T., & Gąsiorowska, A. (2018) · Applied Psychology · doi:10.1111/apps.12145 · Cited by 17
It depends: Partisan evaluation of conditional probability importance
Leaf Van Boven, A., Ramos, J., Montal‐Rosenberg, R., Kogut, T., Sherman, D. K., & Slovic, P. (2019) · Cognition · doi:10.1016/j.cognition.2019.01.020 · Cited by 19
Financial decisions in the household
Burgoyne, C. B., & Kirchler, E. M. (2008) · Cambridge University Press eBooks · doi:10.1017/cbo9780511490118.006 · Cited by 17
Confirmation and Disconfirmation: Their Social Advantages
Leyens, J.-P., Dardenne, B., Yzerbyt, V., Scaillet, N., & Snyder, M. (1999) · European Review of Social Psychology · doi:10.1080/14792779943000062 · Cited by 44
Value priorities and subjective well-being: Direct relations and congruity effects
Sagiv, L., & Schwartz, S. H. (2000) · European Journal of Social Psychology · doi:10.1002/(sici)1099-0992(200003/04)30:2
Metadata
- Authors
- Klayman, J., & Ha, Y.-W.
- Affiliations
- University of Chicago (US)
- ORCID
- Klayman, Joshua
- Venue
- Psychological Review
- Published
- 1987-04
- Volume
- 94
- Issue
- 2
- Pages
- 211-228
- ISSN
- 0033-295X (ISSN-L)
- 1939-1471
- OpenAlex
- W2124371667
- Cited by
- 2,094
- References
- 107
- Citations by year
- 2026: 28 · 2025: 35 · 2024: 53 · 2023: 51 · 2022: 44 · 2021: 71 · 2020: 60 · 2019: 60 · 2018: 70 · 2017: 72 · 2016: 47 · 2015: 57 · 2014: 53 · 2013: 61 · 2012: 71
- FWCI
- 22.99
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Review (publishedVersion)
- Funders
- National Science Foundation (8309586)
- Topics
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Social Sciences › Psychology › General Psychology › Academic and Historical Perspectives in Psychology
- Social Sciences › Arts and Humanities › Philosophy › Epistemology, Ethics, and Metaphysics
- Keywords
- hypothesis testing, confirmation bias, disconfirmation, falsification, heuristics, scientific reasoning, everyday reasoning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review