Confirmation, disconfirmation, and information in hypothesis testing
Abstract
Strategies for hypothesis testing in scientific investigation and everyday reasoning have interested both psychologists and philosophers. A number of these scholars stress the importance of disconnrmation in reasoning and suggest that people are instead prone to a general deleterious "confirmation bias." In particular, it is suggested that people tend to test those cases that have the best chance of verifying current beliefs rather than those that have the best chance of falsifying them. We show, however; that many phenomena labeled "confirmation bias" are better understood in terms of a general positive test strategy. With this strategy, there is a tendency to test cases that are expected (or known) to have the property of interest rather than those expected (or known) to lack that property. This strategy is not equivalent to confirmation bias in the first sense; we show that the positive test strategy can be a very good heuristic for determining the truth or falsity of a hypothesis under realistic conditions. It can, however, lead to systematic errors or inefficiencies. The appropriateness of human hypothesis-testing strategies and prescriptions about optimal strategies must be understood in terms of the interaction between the strategy and the task at hand.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
A hypothesis can create bias as it often entails confirmation and other biases that generate evidence confirming that hypothesis while ignoring or dismissing conflicting evidence.
“A hypothesis can create bias as it often entails confirmation and other biases that generate evidence, confirming that hypothesis while ignoring (or dismissing) conflicting evidence (Baldwin, 1993; Klayman & Ha, 1987; Wagenaar et al., 1993).”
From Biased and biasing: the hidden bias cascade and bias snowball effects (2025) · cites this paper as Klayman & Ha, 1987
Selection of evidence based on relevance is related to confirmation bias in cognitive science, where learners have been observed to select data which they believe to be true (i.e. they fail to attempt to falsify their hypotheses).
“In this sense,selection of evidence based on relevance is related to the confirmation bias in cognitive science, where learners have been observed to (arguably maladaptively) select data which they believe to be true (i.e. they fail to attempt to falsify their hypotheses) [133].”
From Evolution and impact of bias in human and machine learning algorithm interaction (2020) · cites this paper as [133]
Cites
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810 · see citing works
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2022) · doi:10.1176/appi.books.9780890425787 · Cited by 23,476 · see citing works
Judgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1975) · Utility, Probability, and Human Decision Making · doi:10.1007/978-94-010-1834-0_8 · Cited by 22,650 · see citing works
(1966) · Medical Entomology and Zoology · Cited by 10,293 · see citing works
Signal detection theory and psychophysics
Ingleby, D. (1967) · Journal of Sound and Vibration · doi:10.1016/0022-460x(67)90197-6 · Cited by 8,616 · see citing works
The Logic of Scientific Discovery
Bhaskar, R. (2013) · Routledge eBooks · doi:10.4324/9780203090732-9 · Cited by 7,765 · see citing works
Diagnostic and Statistical Manual of Mental Disorders, 3rd ed
Cooper, A. M., & Michels, R. (1981) · American Journal of Psychiatry · doi:10.1176/ajp.138.1.128 · Cited by 7,417 · see citing works
Falsification and the Methodology of Scientific Research Programmes
Lakatos, I. (1970) · Criticism and the Growth of Knowledge · doi:10.1017/cbo9781139171434.009 · Cited by 4,649 · see citing works
Lord, C. G., Ross, L., & Lepper, M. R. (1979) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.37.11.2098 · Cited by 4,583 · see citing works
Human Inference: Strategies and Shortcomings of Social Judgment.
Cherniak, C., Nisbett, R. E., & Ross, L. D. (1983) · The Philosophical Review · doi:10.2307/2184495 · Cited by 4,196 · see citing works
Falsification and the Methodology of Scientific Research Programmes
Lakatos, I. (1976) · Can Theories be Refuted? · doi:10.1007/978-94-010-1863-0_14 · Cited by 3,915 · see citing works
The Logic of Scientific Discovery.
Kendall, M. G., & Popper, K. R. (1959) · Biometrika · doi:10.2307/2332835 · Cited by 2,896 · see citing works
Miller, G. A., & Cantor, N. E. (1982) · Social Cognition · doi:10.1521/soco.1982.1.1.83 · Cited by 2,862 · see citing works
Human Inference: Strategies and Shortcomings of Social Judgment.
Connolly, T., Nisbett, R. E., & Ross, L. D. (1981) · Administrative Science Quarterly · doi:10.2307/2392481 · Cited by 2,682 · see citing works
On the Failure to Eliminate Hypotheses in a Conceptual Task
Wason, P. C. (1960) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470216008416717 · Cited by 2,090 · see citing works
Kintsch, W. (1977) · Medical Entomology and Zoology · Cited by 2,051 · see citing works
Psychology of Reasoning: Structure and Content
Wason, P. C., & Johnson-Laird, P. N. (1972) · Medical Entomology and Zoology · Cited by 1,425 · see citing works
Confidence in judgment: persistence of the illusion of validity
Einhorn, H. J., & Hogarth, R. M. (1978) · Psychological Review · doi:10.1037/0033-295x.85.5.395 · Cited by 1,209 · see citing works
A hypothesis-confirming bias in labeling effects
Darley, J. M., & Gross, P. H. (1983) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.44.1.20 · Cited by 1,173 · see citing works
Foss, B. (1966) · Medical Entomology and Zoology · Cited by 1,157 · see citing works
Conservatism in human information processing
Edwards, W. (1982) · Cambridge University Press eBooks · doi:10.1017/cbo9780511809477.026 · Cited by 1,041 · see citing works
Hypothesis-testing processes in social interaction.
Snyder, M., & Swann, W. B. (1978) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.36.11.1202 · Cited by 937 · see citing works
Einhorn, H. J., & Hogarth, R. M. (1986) · Psychological Bulletin · doi:10.1037/0033-2909.99.1.3 · Cited by 912 · see citing works
Consumer Learning: Advertising and the Ambiguity of Product Experience
Hoch, S. J., & Ha, Y.-W. (1986) · Journal of Consumer Research · doi:10.1086/209062 · Cited by 908 · see citing works
Conservatism in a simple probability inference task.
Phillips, L. D., & Edwards, W. (1966) · Journal of Experimental Psychology · doi:10.1037/h0023653 · Cited by 878 · see citing works
The elusive thematic‐materials effect in Wason's selection task
Griggs, R. A., & Cox, J. R. (1982) · British Journal of Psychology · doi:10.1111/j.2044-8295.1982.tb01823.x · Cited by 859 · see citing works
Fishbein, M. (1980) · Lawrence Erlbaum Associates eBooks · Cited by 760 · see citing works
Theories in Cognitive Psychology: The Loyola Symposium
Wallace, W. P., Laughlin, P. R., & Solso, R. L. (1975) · The American Journal of Psychology · doi:10.2307/1421683 · Cited by 726 · see citing works
Cognitive Processes in Choice and Decision Behavior
Wallsten, T. S., Einhorn, H. J., Ebbesen, E. Β., Konečni, V. J., & Corbin, R. M. (1979) · doi:10.21236/ada078481 · Cited by 667 · see citing works
Beyond discrete biases: Functional and dysfunctional aspects of judgmental heuristics.
Hogarth, R. M. (1981) · Psychological Bulletin · doi:10.1037/0033-2909.90.2.197 · Cited by 611 · see citing works
Alloy, L. B., & Kayne, N. T. (1984) · Psychological Review · doi:10.1037/0033-295x.91.1.112 · Cited by 609 · see citing works
Causal schemas in judgments under uncertainty
Tversky, A., & Kahneman, D. J. (1982) · Cambridge University Press eBooks · doi:10.1017/cbo9780511809477.009 · Cited by 605 · see citing works
Judgment of contingency between responses and outcomes.
Jenkins, H. M., & Ward, W. C. (1965) · The Psychological Monographs · doi:10.1037/h0093874 · Cited by 593 · see citing works
Hypothesis evaluation from a Bayesian perspective.
Fischhoff, B., & Marom, T. (1983) · Psychological Review · doi:10.1037/0033-295x.90.3.239 · Cited by 539 · see citing works
d’Arcais, G. B. F., & Levelt, W. J. M. (1970) · Cited by 525 · see citing works
Confirmation Bias in a Simulated Research Environment: An Experimental Study of Scientific Inference
Mynatt, C. R., Doherty, M. E., & Tweney, R. D. (1977) · Quarterly Journal of Experimental Psychology · doi:10.1080/00335557743000053 · Cited by 524 · see citing works
Quest for accuracy in person perception: A matter of pragmatics.
Swann, W. B. (1984) · Psychological Review · doi:10.1037/0033-295x.91.4.457 · Cited by 458 · see citing works
Judgment of covariation by social perceivers.
Crocker, J. (1981) · Psychological Bulletin · doi:10.1037/0033-2909.90.2.272 · Cited by 441 · see citing works
Scientist as Subject: The Psychological Imperative.
Lewis, L. S., & Mahoney, M. J. (1978) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2064480 · Cited by 415 · see citing works
Duda, R. O., & Shortliffe, E. H. (1983) · Science · doi:10.1126/science.6340198 · Cited by 399 · see citing works
Hypothesis behavior by humans during discrimination learning.
Levine, M. (1966) · Journal of Experimental Psychology · doi:10.1037/h0023006 · Cited by 396 · see citing works
THE CONCEPT OF CORRELATION IN ADULTS
Smedslund, J. (1963) · Scandinavian Journal of Psychology · doi:10.1111/j.1467-9450.1963.tb01324.x · Cited by 365 · see citing works
Edwards, W. (1965) · Journal of Mathematical Psychology · doi:10.1016/0022-2496(65)90007-6 · Cited by 335 · see citing works
Thinking and Reasoning: Psychological Approaches
Dominowski, R. L., & Evans, J. S. B. T. (1985) · The American Journal of Psychology · doi:10.2307/1422779 · Cited by 324 · see citing works
Falsification and the Methodology of Scientific Research Programmes
LAKATOS, I. (2014) · Philosophy, Science, and History · doi:10.4324/9780203802458-7 · Cited by 318 · see citing works
The display of information and the judgment of contingency.
Ward, W. C., & Jenkins, H. M. (1965) · Canadian Journal of Psychology/Revue Canadienne de Psychologie · doi:10.1037/h0082908 · Cited by 318 · see citing works
Sensible Reasoning: A Hypothesis about Hypotheses
Tschirgi, J. E. (1980) · Child Development · doi:10.2307/1129583 · Cited by 314 · see citing works
MATCHING BIAS IN THE SELECTION TASK
Evans, J. S. B. T., & Lynch, J. (1973) · British Journal of Psychology · doi:10.1111/j.2044-8295.1973.tb01365.x · Cited by 311 · see citing works
Skov, R. B., & Sherman, S. J. (1986) · Journal of Experimental Social Psychology · doi:10.1016/0022-1031(86)90031-4 · Cited by 310 · see citing works
Evaluation of evidence in causal inference.
Schustack, M. W., & Sternberg, R. J. (1981) · Journal of Experimental Psychology General · doi:10.1037/0096-3445.110.1.101 · Cited by 300 · see citing works
The subjective side of science
Martino, J. P., & Editor, O. (1976) · Technological Forecasting and Social Change · doi:10.1016/0040-1625(76)90016-0 · Cited by 294 · see citing works
Perception: An approach to personality.
(1951) · doi:10.1037/11505-000 · Cited by 283 · see citing works
Confirmatory and diagnosing strategies in social information gathering.
Yaacov Trope, B., & Bassok, M. (1982) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.43.1.22 · Cited by 282 · see citing works
The subjective side of science
(1975) · Futures · doi:10.1016/0016-3287(75)90055-5 · Cited by 275 · see citing works
Personality dynamics and the process of perceiving.
Bruner, J. S. (1951) · doi:10.1037/11505-005 · Cited by 250 · see citing works
Consequences of Confirmation and Disconfirmation in a Simulated Research Environment
Mynatt, C. R., Doherty, M. E., & Tweney, R. D. (1978) · Quarterly Journal of Experimental Psychology · doi:10.1080/00335557843000007 · Cited by 233 · see citing works
Learning from experience and suboptimal rules in decision making
Einhorn, H. J. (1982) · Cambridge University Press eBooks · doi:10.1017/cbo9780511809477.020 · Cited by 227 · see citing works
Rumain, B., Connell, J. W., & Braine, M. D. S. (1983) · Developmental Psychology · doi:10.1037//0012-1649.19.4.471 · Cited by 213 · see citing works
Reinforcement-induced behavioral stereotypy: How not to teach people to discover rules.
Schwartz, B. N. (1982) · Journal of Experimental Psychology General · doi:10.1037/0096-3445.111.1.23 · Cited by 192 · see citing works
Estimates of contingency between two dichotomous variables.
Arkes, H. R., & Harkness, A. R. (1983) · Journal of Experimental Psychology General · doi:10.1037/0096-3445.112.1.117 · Cited by 191 · see citing works
Strategies of Rule Discovery in an Inference Task
Tweney, R. D., Doherty, M. E., Worner, W. J., Pliske, D. B., Mynatt, C. R., Gross, K. A., & Arkkelin, D. L. (1980) · Quarterly Journal of Experimental Psychology · doi:10.1080/00335558008248237 · Cited by 183 · see citing works
Does Scientific Discovery Have a Logic?
Simon, H. A. (1973) · Philosophy of Science · doi:10.1086/288559 · Cited by 175 · see citing works
Biased Questions in Judgment of Covariation Studies
Crocker, J. (1982) · Personality and Social Psychology Bulletin · doi:10.1177/0146167282082005 · Cited by 166 · see citing works
Amano, S. (1923) · The Japanese journal of psychology · doi:10.4992/jjpsy1919.t1.356 · Cited by 162 · see citing works
The effects of experience on performance in Wason’s selection task
Cox, J. R., & Griggs, R. A. (1982) · Memory & Cognition · doi:10.3758/bf03197653 · Cited by 150 · see citing works
Hypothesis plausibility and hypothesis generation
Gettys, C. F., & Fisher, S. D. (1979) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(79)90018-7 · Cited by 148 · see citing works
Does Scientific Discovery Have a Logic?
Simon, H. A. (1977) · Boston studies in the philosophy of science · doi:10.1007/978-94-010-9521-1_18 · Cited by 145 · see citing works
The Effects of Problem Content and Negation on Wason's Selection Task
Griggs, R. A., & Cox, J. R. (1983) · The Quarterly Journal of Experimental Psychology Section A · doi:10.1080/14640748308402486 · Cited by 141 · see citing works
Information-gathering strategies in hypothesis-testing
Trope, Y., & Bassok, M. (1983) · Journal of Experimental Social Psychology · doi:10.1016/0022-1031(83)90016-1 · Cited by 139 · see citing works
Sources of error in judging event covariations: Effects of memory demands.
Shaklee, H., & Mims, M. (1982) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.8.3.208 · Cited by 113 · see citing works
A rule analysis of judgments of covariation between events
Shaklee, H., & Tucker, D. C. (1980) · Memory & Cognition · doi:10.3758/bf03211142 · Cited by 107 · see citing works
A Comparison of Disconfirmatory, Confirmatory and Control Strategies on Wason's 2–4–6 Task
Gorman, M. E., & Gorman, M. E. (1984) · The Quarterly Journal of Experimental Psychology Section A · doi:10.1080/14640748408402183 · Cited by 105 · see citing works
How the possibility of error affects falsification on a task that models scientific problem solving
Gorman, M. E. (1986) · British Journal of Psychology · doi:10.1111/j.2044-8295.1986.tb01984.x · Cited by 104 · see citing works
>On the Failure to Eliminate Hypotheses...< – A Second Look
Wason, P. C. (1968) · Cited by 104 · see citing works
Faraday’s Discovery of Induction: A Cognitive Approach
Tweney, R. D. (1985) · doi:10.1007/978-1-349-11139-8_11 · Cited by 103 · see citing works
Laws of language use and formal logic
Politzer, G. (1986) · Journal of Psycholinguistic Research · doi:10.1007/bf01067391 · Cited by 99 · see citing works
Testing Hypotheses about Other People
Snyder, M., & Campbell, B. (1980) · Personality and Social Psychology Bulletin · doi:10.1177/014616728063015 · Cited by 93 · see citing works
Eliminative and Enumerative Behaviour in a Conceptual Task
Wetherick, N. E. (1962) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470216208416542 · Cited by 93 · see citing works
Making decisions under the influence of memory.
Fox, J. (1980) · Psychological Review · doi:10.1037/0033-295x.87.2.190 · Cited by 76 · see citing works
Development of Rule Use in Judgments of Covariation between Events
Shaklee, H., & Mims, M. (1981) · Child Development · doi:10.1111/j.1467-8624.1981.tb03047.x · Cited by 68 · see citing works
The effect of thematic content on cognitive strategies in the four-card selection task
Yachanin, S. A., & Tweney, R. D. (1982) · Bulletin of the Psychonomic Society · doi:10.3758/bf03330048 · Cited by 67 · see citing works
Where leading questions can lead: The power of conjecture in social interaction.
Swann, W. B., Giuliano, T., & Wegner, D. M. (1982) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.42.6.1025 · Cited by 67 · see citing works
Learning conceptual rules: II. The role of positive and negative instances.
Bourne, L. E., & Guy, D. E. (1968) · Journal of Experimental Psychology · doi:10.1037/h0025952 · Cited by 63 · see citing works
Development of Rule Use in Judgments of Covariation between Events
Shaklee, H., & Mims, M. (1981) · Child Development · doi:10.2307/1129245 · Cited by 63 · see citing works
AN OPERANT DISCRIMINATION TASK ALLOWING VARIABILITY OF REINFORCED RESPONSE PATTERNING1
Vogel, R., & Annau, Z. (1973) · Journal of the Experimental Analysis of Behavior · doi:10.1901/jeab.1973.20-1 · Cited by 55 · see citing works
The questions lay interviewers ask
Trope, Y., Bassok, M., & Alon, E. (1984) · Journal of Personality · doi:10.1111/j.1467-6494.1984.tb00552.x · Cited by 53 · see citing works
Confirmatory Search Strategies in Social Interaction: How, When, Why, and With What Consequences
Swann, W. B., & Giuliano, T. (1987) · Journal of Social and Clinical Psychology · doi:10.1521/jscp.1987.5.4.511 · Cited by 52 · see citing works
Counselor hypothesis-testing strategies.
Strohmer, D. C., & Newman, L. J. (1983) · Journal of Counseling Psychology · doi:10.1037/0022-0167.30.4.557 · Cited by 49 · see citing works
Human discrimination learning: The subset-sampling assumption.
Levine, M. (1970) · Psychological Bulletin · doi:10.1037/h0032951 · Cited by 49 · see citing works
A Hypothesis-Confirming Bias in Labeling Effects
Darley, J. M., & Gross, P. H. (2004) · Social Cognition · doi:10.4324/9780203496398-27 · Cited by 35 · see citing works
Evaluation of evidence in causal inference.
Schustack, M. W., & Sternberg, R. J. (1981) · Journal of Experimental Psychology General · doi:10.1037//0096-3445.110.1.101 · Cited by 32 · see citing works
Logical knowledge and cue redundancy in deductive reasoning
Hoch, S. J., & Tschirgi, J. E. (1985) · Memory & Cognition · doi:10.3758/bf03198458 · Cited by 31 · see citing works
Rationality and the psychology of inference
Tweney, R. D., & Doherty, M. E. (1983) · Synthese · doi:10.1007/bf01063999 · Cited by 30 · see citing works
An Inference Model for Conceptual Rule Learning 1
Bourne, L. E. (2024) · Routledge eBooks · doi:10.4324/9781032722375-11 · Cited by 29 · see citing works
The direct measurement of hypothesis-sampling strategies
Millward, R. B., & Spoehr, K. T. (1973) · Cognitive Psychology · doi:10.1016/0010-0285(73)90002-9 · Cited by 29 · see citing works
Rationality and Disconfirmation: Further Evidence
Tweney, R. D., Doherty, M. E., & Mynatt, C. R. (1982) · Social Studies of Science · doi:10.1177/030631282012003004 · Cited by 29 · see citing works
Control of complex, sequential operants by systematic visual information in pigeons.
Schwartz, B. N. (1981) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037/0097-7403.7.1.31 · Cited by 27 · see citing works
Sensible Reasoning: A Hypothesis about Hypotheses
Tschirgi, J. E. (1980) · Child Development · doi:10.1111/j.1467-8624.1980.tb02502.x · Cited by 24 · see citing works
Cue redundancy and extra logical inferences in a deductive reasoning task
Hoch, S. J., & Tschirgi, J. E. (1983) · Memory & Cognition · doi:10.3758/bf03213475 · Cited by 23 · see citing works
Wason, P. C. (1962) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470216208416543 · Cited by 23 · see citing works
Kern, L. H. (1982) · OhioLink ETD Center (Ohio Library and Information Network) · Cited by 16 · see citing works
Studies in the History of Psychology and the Social Sciences 3
Bem, S., Rappard, H. V., & van Horn, W. (1985) · Cited by 15 · see citing works
Evaluation of hypotheses in concept identification
Taplin, J. E. (1975) · Memory & Cognition · doi:10.3758/bf03198215 · Cited by 15 · see citing works
Hypothesis Generation and Plausibility Assessment.
Gettys, C. F., Fisher, S. D., & Mehle, T. (1978) · Defense Technical Information Center (DTIC) · Cited by 10 · see citing works
Sources of error in judging event covariations: Effects of memory demands.
Shaklee, H., & Mims, M. (1982) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037//0278-7393.8.3.208 · Cited by 10 · see citing works
Making decisions under the influence of memory.
Fox, J. (1980) · Psychological Review · doi:10.1037//0033-295x.87.2.190 · Cited by 7 · see citing works
Rationality and Disconfirmation
Hardin, C. L. (1980) · Social Studies of Science · doi:10.1177/030631278001000407 · Cited by 6 · see citing works
Control of complex, sequential operants by systematic visual information in pigeons.
Schwartz, B. N. (1981) · Journal of Experimental Psychology Animal Behavior Processes · doi:10.1037//0097-7403.7.1.31 · Cited by 4 · see citing works
A Cross-Study Analysis of Covariation Judgments.
Lipe, M. G. (1982) · Defense Technical Information Center (DTIC) · Cited by 3 · see citing works
Rationality and Authority: On the Confusion of Justification and Permission
Mahoney, M. J. (1980) · Social Studies of Science · doi:10.1177/030631278001000408 · Cited by 3 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Strategic assets and organizational rent
Amit, R., & Schoemaker, P. J. H. (1993) · Strategic Management Journal · doi:10.1002/smj.4250140105 · Cited by 8,425 · see citing works
The case for motivated reasoning.
Kunda, Z. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.108.3.480 · Cited by 9,022 · see citing works
Confirmation Bias: A Ubiquitous Phenomenon in Many Guises
Nickerson, R. S. (1998) · Review of General Psychology · doi:10.1037/1089-2680.2.2.175 · Cited by 7,267 · see citing works
Individual differences in reasoning: Implications for the rationality debate?
Stanovich, K. E., & West, R. F. (2000) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00003435 · Cited by 4,255 · see citing works
Heuristics and Biases: The Psychology of Intuitive Judgment
Bottom, W. P., Gilovich, T. D., Griffin, D., & Kahneman, D. J. (2004) · Academy of Management Review · doi:10.2307/20159081 · Cited by 3,579 · see citing works
Reasoning the fast and frugal way: Models of bounded rationality.
Gigerenzer, G., & Goldstein, D. G. (1996) · Psychological Review · doi:10.1037/0033-295x.103.4.650 · Cited by 3,504 · see citing works
Norm theory: Comparing reality to its alternatives
Kahneman, D., & Miller, D. T. (1986) · Psychological Review · doi:10.1037/0033-295x.93.2.136 · Cited by 3,158 · see citing works
The antecedents and consequences of customer satisfaction for firms
Anderson, E. W., & Sullivan, M. W. (1993) · Marketing Science · doi:10.1287/mksc.12.2.125 · Cited by 4,610 · see citing works
All Frames Are Not Created Equal: A Typology and Critical Analysis of Framing Effects
Levin, I. P., Schneider, S. L., & Gaeth, G. J. (1998) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1998.2804 · Cited by 2,592 · see citing works
Response strategies for coping with the cognitive demands of attitude measures in surveys
Krosnick, J. A. (1991) · Applied Cognitive Psychology · doi:10.1002/acp.2350050305 · Cited by 2,487 · see citing works
Investor Psychology and Asset Pricing
Hirshleifer, D. A. (2001) · The Journal of Finance · doi:10.1111/0022-1082.00379 · Cited by 2,358 · see citing works
Motivated closing of the mind: “Seizing” and “freezing”
Kruglanski, A. W., & Webster, D. M. (1996) · Psychological Review · doi:10.1037/0033-295x.103.2.263 · Cited by 2,379 · see citing works
Slovic, P., Finucane, M., Peters, E., & MacGregor, D. G. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.025 · Cited by 2,349 · see citing works
“Clinical versus Actuarial Judgment.”
Dawes, R. M., Faust, D., & Meehl, P. E. (1989) · Science · doi:10.1126/science.2648573 · Cited by 2,298 · see citing works
(2002) · Cambridge University Press eBooks · doi:10.1017/cbo9780511808098 · Cited by 2,214 · see citing works
Policy Implementation and Cognition: Reframing and Refocusing Implementation Research
Spillane, J. P., Reiser, B. J., & Reimer, T. (2002) · Review of Educational Research · doi:10.3102/00346543072003387 · Cited by 1,923 · see citing works
Krosnick, J. A. (1999) · Annual Review of Psychology · doi:10.1146/annurev.psych.50.1.537 · Cited by 1,852 · see citing works
The weighing of evidence and the determinants of confidence
Griffin, D., & Tversky, A. (1992) · Cognitive Psychology · doi:10.1016/0010-0285(92)90013-r · Cited by 1,796 · see citing works
Representativeness revisited: Attribute substitution in intuitive judgment.
Kahneman, D., & Frederick, S. (2002) · Heuristics and Biases · doi:10.1017/cbo9780511808098.004 · Cited by 3,476 · see citing works
Scientific discovery learning with computer simulations of conceptual domains
De Jong, T., & Van Joolingen, W. R. (1998) · Review of Educational Research · doi:10.3102/00346543068002179 · Cited by 1,593 · see citing works
Gilbert, D. T. (1991) · American Psychologist · doi:10.1037/0003-066x.46.2.107 · Cited by 1,526 · see citing works
Necessary Condition Analysis (NCA)
Dul, J. (2015) · Organizational Research Methods · doi:10.1177/1094428115584005 · Cited by 1,402 · see citing works
Models of ecological rationality: The recognition heuristic.
Goldstein, D. G., & Gigerenzer, G. (2002) · Psychological Review · doi:10.1037/0033-295x.109.1.75 · Cited by 1,352 · see citing works
Comparison processes in social judgment: Mechanisms and consequences.
Mussweiler, T. (2003) · Psychological Review · doi:10.1037/0033-295x.110.3.472 · Cited by 1,345 · see citing works
Why do humans reason? Arguments for an argumentative theory
Mercier, H., & Sperber, D. (2011) · Behavioral and Brain Sciences · doi:10.1017/s0140525x10000968 · Cited by 2,254 · see citing works
Feeling validated versus being correct: A meta-analysis of selective exposure to information
Hart, W., Albarracín, D., Eagly, A. H., Brechan, I., Lindberg, M. J., & Merrill, L. (2009) · Psychological Bulletin · doi:10.1037/a0015701 · Cited by 1,292 · see citing works
Learning in and about complex systems
Sterman, J. D. (1994) · System Dynamics Review · doi:10.1002/sdr.4260100214 · Cited by 1,279 · see citing works
Identity negotiation: Where two roads meet.
Swann, W. B. (1987) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.53.6.1038 · Cited by 1,237 · see citing works
Support theory: a nonextensional representation of subjective probability
Tversky, A., & Koehler, D. J. (1994) · Psychological Review · doi:10.1037/0033-295x.101.4.547 · Cited by 1,167 · see citing works
Managing What Consumers Learn from Experience
Hoch, S. J., & Deighton, J. (1989) · Journal of Marketing · doi:10.1177/002224298905300201 · Cited by 1,114 · see citing works
Thagard, P. R. (1989) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00057046 · Cited by 1,075 · see citing works
Dual space search during scientific reasoning
Klahr, D., & Dunbar, K. (1988) · Cognitive Science · doi:10.1207/s15516709cog1201_1 · Cited by 1,058 · see citing works
A rational analysis of the selection task as optimal data selection.
Oaksford, M., & Nick Chater, A. (1994) · Psychological Review · doi:10.1037/0033-295x.101.4.608 · Cited by 1,047 · see citing works
A Theory of Unconscious Thought
Dijksterhuis, A., & Nordgren, L. F. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00007.x · Cited by 1,041 · see citing works
What We Know and Don't Know about Online Word-of-Mouth: A Review and Synthesis of the Literature
King, R. A., Racherla, P., & Bush, V. D. (2014) · Journal of Interactive Marketing · doi:10.1016/j.intmar.2014.02.001 · Cited by 1,049 · see citing works
Credibility and trust of information in online environments: The use of cognitive heuristics
Metzger, M. J., & Flanagin, A. J. (2013) · Journal of Pragmatics · doi:10.1016/j.pragma.2013.07.012 · Cited by 1,000 · see citing works
Entrepreneurs' Optimism And New Venture Performance: A Social Cognitive Perspective
Hmieleski, K. M., & Baron, R. A. (2009) · Academy of Management Journal · doi:10.5465/amj.2009.41330755 · Cited by 1,001 · see citing works
Impact of Product-Harm Crises on Brand Equity: The Moderating Role of Consumer Expectations
Dawar, N., & Pillutla, M. M. (2000) · Journal of Marketing Research · doi:10.1509/jmkr.37.2.215.18729 · Cited by 981 · see citing works
Explaining the enigmatic anchoring effect: Mechanisms of selective accessibility.
Strack, F., & Mussweiler, T. (1997) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.73.3.437 · Cited by 981 · see citing works
Blackwell Handbook of Judgment and Decision Making
(2004) · Wiley eBooks · doi:10.1002/9780470752937 · Cited by 981 · see citing works
The Anchoring-and-Adjustment Heuristic: Why the Adjustments Are Insufficient
Epley, N., & Gilovich, T. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01704.x · Cited by 920 · see citing works
Influence of fake news in Twitter during the 2016 US presidential election
Bovet, A., & Makse, H. A. (2019) · CUNY Academic Works (City University of New York) · Cited by 882 · see citing works
Type 2 diabetes and cancer: umbrella review of meta-analyses of observational studies
Tsilidis, K. K., Kasimis, J. C., López, D. S., Ntzani, E., & Ioannidis, J. P. A. (2015) · BMJ · doi:10.1136/bmj.g7607 · Cited by 861 · see citing works
A social comparison theory meta-analysis 60+ years on.
Gerber, J. P., Wheeler, L., & Suls, J. (2018) · Psychological Bulletin · doi:10.1037/bul0000127 · Cited by 808 · see citing works
An Evaluation of a Cognitive Theory of Response-Order Effects in Survey Measurement
Krosnick, J. A., & Alwin, D. F. (1987) · Public Opinion Quarterly · doi:10.1086/269029 · Cited by 825 · see citing works
Eyewitness Identification Procedures: Recommendations for Lineups and Photospreads
Wells, G. L., Small, M., Penrod, S. D., Malpass, R., Fulero, S. M., & Brimacombe, C. (1998) · Law and Human Behavior · doi:10.1023/a:1025750605807 · Cited by 804 · see citing works
How Scientists Really Reason: Scientific Reasoning in Real-World Laboratories
Dunbar, K. N. (1994) · The MIT Press eBooks · doi:10.7551/mitpress/4879.003.0017 · Cited by 760 · see citing works
Dunning, D., Meyerowitz, J. A., & Holzberg, A. D. (1989) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.57.6.1082 · Cited by 758 · see citing works
Varieties of Confirmation Bias
Klayman, J. (1995) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60315-1 · Cited by 755 · see citing works
Self-citationInfluence of fake news in Twitter during the 2016 US presidential election
Bovet, A., & Makse, H. A. (2019) · Nature Communications · doi:10.1038/s41467-018-07761-2 · Cited by 701 · see citing works
Jonas, E., Schulz-Hardt, S., Frey, D., & Thelen, N. (2001) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.80.4.557 · Cited by 725 · see citing works
Précis of Simple heuristics that make us smart
Todd, P. M., & Gigerenzer, G. (2000) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00003447 · Cited by 718 · see citing works
Relevance theory explains the selection task
Sperber, D. (1995) · Cognition · doi:10.1016/0010-0277(95)00666-m · Cited by 711 · see citing works
First Impressions Matter: A Model of Confirmatory Bias
Rabin, M., & Schrag, J. L. (1999) · The Quarterly Journal of Economics · doi:10.1162/003355399555945 · Cited by 1,001 · see citing works
Unbelieving the unbelievable: Some problems in the rejection of false information.
Gilbert, D. T., Krull, D. S., & Malone, P. S. (1990) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.59.4.601 · Cited by 681 · see citing works
Dunning, D. A., Meyerowitz, J. A., & Holzberg, A. D. (2002) · Cambridge University Press eBooks · doi:10.1017/cbo9780511808098.020 · Cited by 688 · see citing works
The development of scientific thinking skills in elementary and middle school
Zimmerman, C. (2007) · Developmental Review · doi:10.1016/j.dr.2006.12.001 · Cited by 700 · see citing works
Chernev, A. (2003) · Journal of Consumer Research · doi:10.1086/376808 · Cited by 672 · see citing works
The heuristic-analytic theory of reasoning: Extension and evaluation
Evans, J. S. B. T. (2006) · Psychonomic Bulletin & Review · doi:10.3758/bf03193858 · Cited by 644 · see citing works
Shastri, L., & Ajjanagadde, V. (1993) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00030910 · Cited by 629 · see citing works
Drummond, C., & Fischhoff, B. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1704882114 · Cited by 607 · see citing works
Anchoring, Activation, and the Construction of Values
Chapman, G. B., & Johnson, E. J. (1999) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1999.2841 · Cited by 592 · see citing works
Mussweiler, T., & Strack, F. (1999) · Journal of Experimental Social Psychology · doi:10.1006/jesp.1998.1364 · Cited by 585 · see citing works
A Multidisciplinary Analysis of the Nature, Meaning, and Measurement of Trust
Tschannen-Moran, M., & Hoy, W. K. (2000) · Review of Educational Research · doi:10.3102/00346543070004547 · Cited by 995 · see citing works
Why Do Partisan Media Polarize Viewers?
Levendusky, M. S. (2013) · American Journal of Political Science · doi:10.1111/ajps.12008 · Cited by 587 · see citing works
Mele, A. R. (2003) · doi:10.1093/019515617x.001.0001 · Cited by 553 · see citing works
Under what conditions does theory obstruct research progress?
Greenwald, A. G., Pratkanis, A. R., Leippe, M. R., & Baumgardner, M. H. (1986) · Psychological Review · doi:10.1037/0033-295x.93.2.216 · Cited by 574 · see citing works
Wouldn’t it be nice? Predicting future feelings
Loewenstein, G. F., & Schkade, D. A. (1999) · Cited by 529 · see citing works
Brambilla, M., Rusconi, P., Sacchi, S., & Cherubini, P. (2010) · European Journal of Social Psychology · doi:10.1002/ejsp.744 · Cited by 517 · see citing works
The forensic confirmation bias: Problems, perspectives, and proposed solutions.
Kassin, S. M., Dror, I. E., & Kukucka, J. (2013) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2013.01.001 · Cited by 634 · see citing works
The Development of Scientific Reasoning Skills
Zimmerman, C. (2000) · Developmental Review · doi:10.1006/drev.1999.0497 · Cited by 509 · see citing works
The Influence of Vaccine-critical Websites on Perceiving Vaccination Risks
Betsch, C., Renkewitz, F., Betsch, T., & Ulshöfer, C. (2010) · Journal of Health Psychology · doi:10.1177/1359105309353647 · Cited by 493 · see citing works
How scientists think: On-line creativity and conceptual change in science.
Dunbar, K. N. (2004) · American Psychological Association eBooks · doi:10.1037/10227-017 · Cited by 482 · see citing works
Beware of samples! A cognitive-ecological sampling approach to judgment biases.
Fiedler, K. (2000) · Psychological Review · doi:10.1037/0033-295x.107.4.659 · Cited by 460 · see citing works
Decisions and the evolution of memory: Multiple systems, multiple functions.
Klein, S. B., Cosmides, L., Tooby, J., & Chance, S. (2002) · Psychological Review · doi:10.1037/0033-295x.109.2.306 · Cited by 464 · see citing works
An evaluation of dual-process theories of reasoning
Osman, M. (2004) · Psychonomic Bulletin & Review · doi:10.3758/bf03196730 · Cited by 444 · see citing works
Social perception and social reality: A reflection-construction model.
Jussim, L. (1991) · Psychological Review · doi:10.1037/0033-295x.98.1.54 · Cited by 446 · see citing works
Why we still use our heads instead of formulas: Toward an integrative approach.
Kleinmuntz, B. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.107.3.296 · Cited by 432 · see citing works
Heuristics and biases: Expertise and task realism in auditing.
Smith, J. F., & Kida, T. (1991) · Psychological Bulletin · doi:10.1037/0033-2909.109.3.472 · Cited by 437 · see citing works
Women are credited less in science than men
Ross, M. B., Glennon, B. M., Murciano-Goroff, R., Berkes, E. G., Weinberg, B. A., & Lane, J. I. (2022) · Nature · doi:10.1038/s41586-022-04966-w · Cited by 437 · see citing works
Belief revision in children: The role of prior knowledge and strategies for generating evidence
Schauble, L. (1990) · Journal of Experimental Child Psychology · doi:10.1016/0022-0965(90)90048-d · Cited by 420 · see citing works
Unpacking, repacking, and anchoring: Advances in support theory.
Rottenstreich, Y., & Tversky, A. (1997) · Psychological Review · doi:10.1037/0033-295x.104.2.406 · Cited by 437 · see citing works
BIASES IN THE INTERPRETATION AND USE OF RESEARCH RESULTS
MacCoun, R. J. (1998) · Annual Review of Psychology · doi:10.1146/annurev.psych.49.1.259 · Cited by 419 · see citing works
Incorporating the Irrelevant: Anchors in Judgments of Belief and Value
Chapman, G. B., & Johnson, E. J. (2002) · Cambridge University Press eBooks · doi:10.1017/cbo9780511808098.008 · Cited by 410 · see citing works
Sloman, S. A. (2002) · Cambridge University Press eBooks · doi:10.1017/cbo9780511808098.024 · Cited by 407 · see citing works
A theory of implicit and explicit knowledge
Dienes, Z., & Perner, J. (1999) · Behavioral and Brain Sciences · doi:10.1017/s0140525x99002186 · Cited by 672 · see citing works
Motivated recruitment of autobiographical memories.
Sanitioso, R. B., Kunda, Z., & Fong, G. T. (1990) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.59.2.229 · Cited by 401 · see citing works
Laughlin, P. R., Hatch, E. C., Silver, J. S., & Boh, L. (2006) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.90.4.644 · Cited by 390 · see citing works
How people decide what they want to know
Sharot, T., & Sunstein, C. R. (2020) · Nature Human Behaviour · doi:10.1038/s41562-019-0793-1 · Cited by 386 · see citing works
Product Experience Is Seductive
Hoch, S. J. (2002) · Journal of Consumer Research · doi:10.1086/344422 · Cited by 382 · see citing works
The Ups and Downs of Social Comparison: Mechanisms of Assimilation and Contrast.
Mussweiler, T., Rüter, K., & Epstude, K. (2004) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.87.6.832 · Cited by 379 · see citing works
Krueger, J. I., & Funder, D. C. (2004) · Behavioral and Brain Sciences · doi:10.1017/s0140525x04000081 · Cited by 370 · see citing works
Students' transition from an engineering model to a science model of experimentation
Schauble, L., Klopfer, L. E., & Raghavan, K. (1991) · Journal of Research in Science Teaching · doi:10.1002/tea.3660280910 · Cited by 370 · see citing works
When less is more: Counterfactual thinking and satisfaction among Olympic medalists.
Medvec, V. H., Madey, S. F., & Gilovich, T. D. (1995) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.69.4.603 · Cited by 507 · see citing works
Maintaining stereotypes in the face of disconfirmation: Constructing grounds for subtyping deviants.
Kunda, Z., & Oleson, K. C. (1995) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.68.4.565 · Cited by 368 · see citing works
Explanation, imagination, and confidence in judgment.
Koehler, D. J. (1991) · Psychological Bulletin · doi:10.1037//0033-2909.110.3.499 · Cited by 561 · see citing works
Yin, D., Mitra, S., & Zhang, H. (2016) · Information Systems Research · doi:10.1287/isre.2015.0617 · Cited by 365 · see citing works
Fisher, C. D. (2003) · Journal of Organizational Behavior · doi:10.1002/job.219 · Cited by 367 · see citing works
On the natural selection of reasoning theories
Cheng, P. W., & Holyoak, K. J. (1989) · Cognition · doi:10.1016/0010-0277(89)90031-0 · Cited by 362 · see citing works
The Impact of Candidate Name Order on Election Outcomes
Miller, J. M., & Krosnick, J. A. (1998) · Public Opinion Quarterly · doi:10.1086/297848 · Cited by 357 · see citing works
- Authors
- Klayman, J., & Ha, Y.-W.
- Affiliations
- University of Chicago (US)
- ORCID
- Klayman, Joshua
- Venue
- Psychological Review
- Published
- 1987-04
- Volume
- 94
- Issue
- 2
- Pages
- 211-228
- ISSN
- 0033-295X (ISSN-L)
- 1939-1471
- OpenAlex
- W2124371667
- Cited by
- 2,094
- References
- 107
- Citations by year
- 2026: 28 · 2025: 35 · 2024: 53 · 2023: 51 · 2022: 44 · 2021: 71 · 2020: 60 · 2019: 60 · 2018: 70 · 2017: 72 · 2016: 47 · 2015: 57 · 2014: 53 · 2013: 61 · 2012: 71
- FWCI
- 22.99
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Review (publishedVersion)
- Funders
- National Science Foundation (8309586)
- Topics
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Social Sciences › Psychology › General Psychology › Academic and Historical Perspectives in Psychology
- Social Sciences › Arts and Humanities › Philosophy › Epistemology, Ethics, and Metaphysics
- Keywords
- hypothesis testing, confirmation bias, disconfirmation, falsification, heuristics, scientific reasoning, everyday reasoning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review