The DOI matches its Crossref record; 80 of the 80 references it cites were found in a registry or an index.
Why don’t well-educated adults understand accumulation? A challenge to researchers, educators, and citizens
Open accessAbstract
Accumulation is a fundamental process in dynamic systems: inventory accumulates production less shipments; the national debt accumulates the federal deficit. Effective decision making in such systems requires an understanding of the relationship between stocks and the flows that alter them. However, highly educated people are often unable to infer the behavior of simple stock-flow systems. In a series of experiments we demonstrate that poor understanding of accumulation, termed stock-flow failure, is a fundamental reasoning error. Persistent poor performance is not attributable to an inability to interpret graphs, lack of contextual knowledge, motivation, or cognitive capacity. Rather, stock-flow failure is a robust phenomenon that appears to be rooted in failure to appreciate the most basic principles of accumulation, leading to the use of inappropriate heuristics. We show that many people, including highly educated individuals with strong technical training, use what we term the "correlation heuristic", erroneously assuming that the behavior of a stock matches the pattern of its flows. We discuss the origins of stock-flow failure and implications for management and education.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Prospect theory: An analysis of decision under risk
Kahneman, D., & Tversky, A. (1988) · Decision, Probability and Utility · doi:10.1017/cbo9780511609220.014 · Cited by 32,474
Climate change 2007: the physical science basis
Solomon, S., Qin, D., Manning, M., Marquis, M. C., Averyt, K. B., Tignor, M., Miller, H. L., & Chen, Z. (2007) · Cited by 24,158
Climate Change 2007: The Physical Science Basis.
Schiavon, S., & Zecchin, R. (2007) · eScholarship (California Digital Library) · Cited by 16,994
Climate Change 2001: The Scientific Basis
Cooper, R. N., Houghton, J. T., McCarthy, J. J., & Metz, B. (2002) · Foreign Affairs · doi:10.2307/20033020 · Cited by 12,889
The Handbook of Social Psychology
Gravatt, A. E., Lindzey, G., & Aronson, F. (1969) · The Family Coordinator · doi:10.2307/582242 · Cited by 12,517
The Elaboration Likelihood Model of Persuasion
Petty, R. E., & Cacioppo, J. T. (1986) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(08)60214-2 · Cited by 8,822
Asset Stock Accumulation and Sustainability of Competitive Advantage
Dierickx, I., & Cool, K. (1989) · Management Science · doi:10.1287/mnsc.35.12.1504 · Cited by 8,353
(2013) · Handbooks of Sociology and Social Research · doi:10.1007/978-94-007-6772-0 · Cited by 7,486
Griggs, D. J., & Noguer, M. (2002) · Weather · doi:10.1256/004316502320517344 · Cited by 5,754
Categorization and Representation of Physics Problems by Experts and Novices*
Chi, M. T. H., Feltovich, P. J., & Glaser, R. (1981) · Cognitive Science · doi:10.1207/s15516709cog0502_2 · Cited by 5,248
The visual display of quantitative information
(1985) · General Pharmacology: The Vascular System · doi:10.1016/0306-3623(85)90230-7 · Cited by 5,070
Subjective probability: A judgment of representativeness
Kahneman, D., & Tversky, A. (1972) · Cognitive Psychology · doi:10.1016/0010-0285(72)90016-3 · Cited by 4,851
(2004) · Choice Reviews Online · doi:10.5860/choice.41-3182 · Cited by 4,690
RATIONAL CHOICE AND THE FRAMING OF DECISIONS
Tversky, A., & Kahneman, D. (1988) · Decision Making · doi:10.1017/cbo9780511598951.011 · Cited by 3,712
Kemp, C. D., & Tufte, E. R. (1992) · Biometrics · doi:10.2307/2532323 · Cited by 2,713
Modeling Managerial Behavior: Misperceptions of Feedback in a Dynamic Decision Making Experiment
Sterman, J. D. (1989) · Management Science · doi:10.1287/mnsc.35.3.321 · Cited by 2,500
Self-citationPetty, R. E., Wegener, D. T., & Fabrigar, L. R. (1997) · Annual Review of Psychology · doi:10.1146/annurev.psych.48.1.609 · Cited by 2,290
On the Failure to Eliminate Hypotheses in a Conceptual Task
Wason, P. C. (1960) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470216008416717 · Cited by 2,098
Confirmation, disconfirmation, and information in hypothesis testing
Klayman, J., & Ha, Y.-W. (1987) · Psychological Review · doi:10.1037/0033-295x.94.2.211 · Cited by 2,094 · cited 1×
“People often assume that their initial intuition about a problem is correct unless they receive feedback ( Klayman & Ha, 1987; Raman, 2002).”
BackgroundThe Visual Display of Quantitative Information.
Zelterman, D., & Tufte, E. R. (1984) · Journal of the American Statistical Association · doi:10.2307/2288294 · Cited by 2,059
Bounded Rationality and Organizational Learning
Simon, H. A. (1999) · Reflections: The SoL Journal · doi:10.1162/152417399570142 · Cited by 2,021
Implicit Learning and Tacit Knowledge
Reber, A. S. (2003) · Essential Sources in the Scientific Study of Consciousness · doi:10.7551/mitpress/2834.003.0047 · Cited by 2,001
Müller, G., Pannhorst, W., & Schiffner, U. (1995) · Schott Series on Glass and Glass Ceramics · doi:10.1007/978-3-662-03083-7_2 · Cited by 1,982
The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework
Camerer, C. F., Hogarth, R. M., Budescu, D. V., & Eckel, C. (1999) · Elicitation of Preferences · doi:10.1007/978-94-017-1406-8_2 · Cited by 1,545
The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework
Camerer, C. F., & Hogarth, R. M. (1999) · Journal of Risk and Uncertainty · doi:10.1023/a:1007850605129 · Cited by 1,428
Rational choice in an uncertain world
Dawes, R. M., & Kagan, J. (1988) · Medical Entomology and Zoology · Cited by 1,291
Attitude change: Multiple roles for persuasion variables.
Petty, R. E., & Wegener, D. T. (1998) · Cited by 1,271
Ecological interface design: theoretical foundations
Vicente, K. J., & Rasmussen, J. (1992) · IEEE Transactions on Systems, Man and Cybernetics · doi:10.1109/21.156574 · Cited by 1,084
All models are wrong: reflections on becoming a systems scientist
Sterman, J. D. (2002) · System Dynamics Review · doi:10.1002/sdr.261 · Cited by 953
Self-citationD., C. P., & Simon, H. A. (1980) · The American Journal of Psychology · doi:10.2307/1422381 · Cited by 770
Domain-specific reasoning: Social contracts, cheating, and perspective change
Gigerenzer, G., & Hug, K. (1992) · Cognition · doi:10.1016/0010-0277(92)90060-u · Cited by 770
Bathtub dynamics: initial results of a systems thinking inventory
Sweeney, L. B., & Sterman, J. D. (2000) · System Dynamics Review · doi:10.1002/sdr.198 · Cited by 763 · cited 13×
“Although the results of prior work suggest that poor performance arises from the use of the correlation heuristic (Cronin & Gonzalez, in press; Sterman & Booth Sweeney, 2002; Booth Sweeney & Sterman, 2000), there are many other explanations.”
BackgroundMethodResultInfluentialSelf-citationWhy are some problems hard? Evidence from Tower of Hanoi
Kotovsky, K., Hayes, J. R., & Simon, H. A. (1985) · Cognitive Psychology · doi:10.1016/0010-0285(85)90009-x · Cited by 722 · cited 1×
“Kotovsky, Hayes, and Simon (1985) showed that problem solving is more difficult when people cannot reconcile the formulation of a problem with their beliefs about the real world.”
BackgroundFault trees: sensitivity of estimated failure probabilities to problem representation
Fischhoff, B., Slovic, P., & Lichtenstein, S. (1978) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.4.2.330 · Cited by 708
The Proximity Compatibility Principle: Its Psychological Foundation and Relevance to Display Design
Wickens, C. D., & Carswell, C. M. (1995) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872095779049408 · Cited by 655
Elshout, J. (1996) · Acta Psychologica · doi:10.1016/0001-6918(96)00041-8 · Cited by 641
Applying Covariational Reasoning While Modeling Dynamic Events: A Framework and a Study
Carlson, M., Jacobs, S., Coe, E., Larsen, S., & Hsu, E. (2002) · Journal for Research in Mathematics Education · doi:10.2307/4149958 · Cited by 599 · cited 1×
“Poor ability to interpret and construct graphs among both students and adults is well documented in the mathematics education literature and related fields (e.g., Berry & Nyman, 2003; Carlson, Jacobs, Coe, Larsen, & Hsu, 2002; Gattis, 2002, 2004; Gattis & Holyoak, 1996; Paulos, 1988; Tufte 1983, 1990).”
BackgroundMisperceptions of feedback in dynamic decision making
Sterman, J. D. (1989) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(89)90041-1 · Cited by 595
Self-citationInstance‐based learning in dynamic decision making
Gonzalez, C., Lerch, J. F., & Lebiere, C. (2003) · Cognitive Science · doi:10.1207/s15516709cog2704_2 · Cited by 535
Self-citationKaplan, C. A., & Simon, H. A. (1990) · Cognitive Psychology · doi:10.1016/0010-0285(90)90008-r · Cited by 530
Implicit learning of synthetic languages: The role of instructional set.
Reber, A. S. (1976) · Journal of Experimental Psychology: Human Learning and Memory · doi:10.1037/0278-7393.2.1.88 · Cited by 523 · cited 1×
“Learning in many domains, including dynamic decision making, often occurs implicitly (Gonzalez, 2005; Gonzalez, Lerch, & Lebiere, 2003; Reber, 1976, 1989): Individuals who do well on a task are not always aware of the task structure, may not be able to describe the key elements of the task, and may…”
BackgroundEffects of Feedback Complexity on Dynamic Decision Making
Diehl, E., & Sterman, J. D. (1995) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.1995.1043 · Cited by 452
Self-citationSterman, J. D., & Sweeney, L. B. (2007) · Climatic Change · doi:10.1007/s10584-006-9107-5 · Cited by 431
Self-citationInnumeracy: Mathematical Illiteracy and its Consequences.
Evered, L. J., & Allen, J. (1990) · The American Mathematical Monthly · doi:10.2307/2324023 · Cited by 412
Complex Problem Solving: The European Perspective
Frensch, P., & Funke, J. (1995) · heiDOK (Heidelberg University) · doi:10.11588/heidok.00008262 · Cited by 388
Matching Versus Mismatching Attitude Functions: Implications for Scrutiny of Persuasive Messages
Petty, R. E., & Wegener, D. T. (1998) · Personality and Social Psychology Bulletin · doi:10.1177/0146167298243001 · Cited by 349
Boom, Bust, and Failures to Learn in Experimental Markets
Paich, M., & Sterman, J. D. (1993) · Management Science · doi:10.1287/mnsc.39.12.1439 · Cited by 341
Self-citationInsights in Decision MakingPreprint
Hogarth, R. M. (1990) · RePEc: Research Papers in Economics · Cited by 340
Innumeracy: Mathematical Illiteracy and its Consequences.
Hand, D., & Paulos, J. A. (1992) · Applied Statistics · doi:10.2307/2347643 · Cited by 335
Orenstein, S. (1991) · Journal of Pediatric Gastroenterology and Nutrition · doi:10.1002/j.1536-4801.1991.tb10331.x · Cited by 325
(2014) · Psychology Press eBooks · doi:10.4324/9781315806723 · Cited by 314
Focussing in reasoning and decision making
Legrenzi, P. (1993) · Cognition · doi:10.1016/0010-0277(93)90035-t · Cited by 313
Information Displays and Decision Processes
Kleinmuntz, D. N., & Schkade, D. A. (1993) · Psychological Science · doi:10.1111/j.1467-9280.1993.tb00265.x · Cited by 309
Cloudy skies: assessing public understanding of global warming
Sterman, J. D., & Sweeney, L. B. (2002) · System Dynamics Review · doi:10.1002/sdr.242 · Cited by 262
Self-citationRoch, S. G., Lane, J. A. S., Samuelson, C. D., Allison, S. T., & Dent, J. L. (2000) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.2000.2915 · Cited by 214
Decision support for real-time, dynamic decision-making tasks
González, C. (2005) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2004.11.002 · Cited by 166
Cognitive Heuristics and Feedback in a Dynamic Decision Environment
Kleinmuntz, D. N. (1985) · Management Science · doi:10.1287/mnsc.31.6.680 · Cited by 164
Promoting students’ graphical understanding of the calculus
Berry, J., & Nyman, M. A. (2003) · The Journal of Mathematical Behavior · doi:10.1016/j.jmathb.2003.09.006 · Cited by 151
The Search for Insight: Grappling with Gestalt Psychology's Unanswered Questions
Mayer, R. E. (1994) · The MIT Press eBooks · doi:10.7551/mitpress/4879.003.0004 · Cited by 143
Mapping conceptual to spatial relations in visual reasoning.
Gattis, M., & Holyoak, K. J. (1996) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/0278-7393.22.1.231 · Cited by 140
Behavioral decision making and judgment.
Dawes, R. M. (1998) · Cited by 132
González, C. (2004) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/hfes.46.3.449.50395 · Cited by 131
Content Effects on Decision Making
Rettinger, D. A., & Hastie, R. (2001) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.2000.2948 · Cited by 129
Task Workload and Cognitive Abilities in Dynamic Decision Making
González, C. (2005) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1518/0018720053653767 · Cited by 121
Making Inferences About Missing Information: The Effects of Existing Information
Ross, W. T., & Creyer, E. H. (1992) · Journal of Consumer Research · doi:10.1086/209282 · Cited by 117
Understanding the building blocks of dynamic systems
Cronin, M. A., & González, C. (2007) · System Dynamics Review · doi:10.1002/sdr.356 · Cited by 108
Self-citationThe effects of feedback format on dynamic decision making
Atkins, P. W. B., Wood, R. E., & Rutgers, P. J. (2002) · Organizational Behavior and Human Decision Processes · doi:10.1016/s0749-5978(02)00002-x · Cited by 101
Effect of system dynamics education on systems thinking inventory task performance
Pala, Ö., & Vennix, J. A. M. (2005) · System Dynamics Review · doi:10.1002/sdr.310 · Cited by 81
Understanding and control of a simple dynamic system
Jensen, E., & Brehmer, B. (2003) · System Dynamics Review · doi:10.1002/sdr.267 · Cited by 59
Vicente, K. J. (1996) · System Dynamics Review · doi:10.1002/(sici)1099-1727(199624)12:4 · Cited by 57
Coordinating informal and formal aspects of mathematics: student behavior and textbook messages
Raman, M. (2002) · The Journal of Mathematical Behavior · doi:10.1016/s0732-3123(02)00119-0 · Cited by 46
Structure mapping in spatial reasoning
Gattis, M. (2002) · Cognitive Development · doi:10.1016/s0885-2014(02)00095-3 · Cited by 44
Spurious Correlations in Mathematical Thinking
Ben‐Zeev, T., & Star, J. R. (2001) · Cognition and Instruction · doi:10.1207/s1532690xci1903_1 · Cited by 41
Almor, A., & Sloman, S. A. (2000) · Memory & Cognition · doi:10.3758/bf03209354 · Cited by 39
Feedback Delays in Complex Dynamic Decision Tasks
Funke, J. (2014) · doi:10.4324/9781315806723-13 · Cited by 34
Mapping relational structure in spatial reasoning
Gattis, M. (2004) · Cognitive Science · doi:10.1016/j.cogsci.2004.02.001 · Cited by 33
Harel, G., Behr, M. J., Post, T. R., & Lesh, R. (1992) · Cognition and Instruction · doi:10.1207/s1532690xci0901_2 · Cited by 27
Fischhoff, B., & Downs, J. S. (1997) · Psychological Science · doi:10.1111/j.1467-9280.1997.tb00401.x · Cited by 26
A model of knowledge activation and insight in problem solving
Cronin, M. A. (2004) · Complexity · doi:10.1002/cplx.20031 · Cited by 19
Self-citationKlein, W. M. P. (1999) · Basic and Applied Social Psychology · doi:10.1207/s15324834basp2103_2 · Cited by 9
Cited by
A framework to diagnose barriers to climate change adaptation
Moser, S. C., & Ekstrom, J. A. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1007887107 · Cited by 1,708
Climate Change: New Dimensions in Disaster Risk, Exposure, Vulnerability, and Resilience
Lavell, A., Oppenheimer, M., Diop, C., Hess, J., Lempert, R., Li, J., Muir-Wood, R., Myeong, S., Moser, S., Takeuchi, K., et al. (2012) · Managing the Risks of Extreme Events and Disasters to Advance Climate Change Adaptation · doi:10.1017/cbo9781139177245.004 · Cited by 407
Integrated Risk and Uncertainty Assessment of Climate Change Response Policies
(2015) · Climate Change 2014: Mitigation of Climate Change · doi:10.1017/cbo9781107415416.008 · Cited by 391
Bodies of Knowledge for Research in Behavioral Operations
Bendoly, E., Croson, R., Goncalves, P., & Schultz, K. (2010) · Production and Operations Management · doi:10.1111/j.1937-5956.2009.01108.x · Cited by 337
Instance-based learning: Integrating sampling and repeated decisions from experience.
Gonzalez, C., & Dutt, V. (2011) · Psychological Review · doi:10.1037/a0024558 · Cited by 255
Self-citation
Metadata
- Authors
- Cronin, M. A., Gonzalez, C., & Sterman, J. D.
- Venue
- Organizational Behavior and Human Decision Processes
- Publisher
- Elsevier BV
- Published
- 2009-01
- Volume
- 108
- Issue
- 1
- Pages
- 116-130
- ISSN
- 0749-5978 (ISSN-L)
- OpenAlex
- W2061967586
- Cited by
- 347
- References
- 80
- FWCI
- 27.68
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.