The DOI matches its Crossref record; 188 of the 188 references it cites were found in a registry or an index; none of the 151 sources its claims cite is checked for support yet.
The role of anomalous data in knowledge acquisition: A theoretical framework and implications for science instruction.
Open accessAbstract
Understanding how science students respond to anomalous data is essential to understanding knowledge acquisition in science classrooms. This article presents a detailed analysis of the ways in which scientists and science students respond to such data. We postulate that there are seven distinct forms of response to anomalous data, only one of which is to accept the data and change theories. The other six responses involve discounting the data in various ways in order to protect the preinstructional theory. We analyze the factors that influence which of these seven forms of response a scientist or student will choose, giving special attention to the factors that make theory change more likely. Finally, we discuss the implications of our framework for science instruction.
Overview
CoChat Summary
TL;DR
The paper proposes that people respond to anomalous data in seven distinct ways, only one of which is accepting the data and changing theory; the other six preserve the prior theory. It analyzes factors that influence which response occurs and derives instructional strategies intended to foster reflective theory change.
Key findings
- Seven responses to anomalous data are postulated: ignoring, rejecting, excluding, holding in abeyance, reinterpreting, making peripheral theory changes, and changing theory; only the last involves changing core beliefs.
- Responses are influenced by prior knowledge (entrenchment, ontological beliefs, epistemological commitments, background knowledge), the alternative theory (availability, quality, intelligibility), the anomalous data (credibility, ambiguity, multiple lines of data), and processing strategies (especially deep processing).
- Empirical examples include Pickering and Monts’s finding that 45% of undergraduates asserted correct contradictory laboratory data were in error, with 53% of those offering a specific methodological explanation and 47% a vague one; Rowell and Dawson found 3 of 12 subjects changed from a weight to a volume theory after anomalous data; Burbules and Linn convinced more than 70% of adolescents to shift from a weight to a volume theory of displacement within a single session.
- Other cited results: Mynatt, Doherty, and Tweney found 91% of subjects who obtained unambiguous disconfirming data changed to a correct or partly correct hypothesis; Lawson and Worsnop reported agreement that “Fossils were intentionally put on the Earth to confuse humans” rose from 1% before instruction to 7% after instruction.
Methods
- Theoretical/review paper: it develops a framework classifying responses to anomalous data, analyzes conditions leading to different responses, and draws implications for science instruction; no new empirical study is reported.
- Evidence base: selected examples and findings from the history and philosophy of science, psychology, and science education; no primary sample, systematic sampling, or meta-analytic procedure is described.
- Main analysis: conceptual and logical analysis of coordinating theory and data across three decisions—whether the data are accepted as valid, whether the individual can explain the data, and whether the prior theory is changed—used to derive seven psychologically plausible responses and influencing factors.
Limitations
- Paper-stated: the authors state that no one had yet developed a detailed framework for responses to anomalous information; they also note no studies investigating effects of epistemological beliefs on responses to anomalous information and no studies examining whether deep processing affects science students’ responses to anomalous data.
- Paper-stated: some proposed instructional approaches, such as explicit instruction to help students construct appropriate ontological categories, “has not yet been tested empirically.”
- Evident: as a theoretical synthesis, the paper does not report a systematic review protocol, effect sizes, or primary data; the authors state they do not attempt an exhaustive enumeration of factors, and much evidence is illustrative rather than directly testing the full framework in classrooms.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 0 Not valid · 101 Not checked · 131 Own results and interpretations
In the paper
“For example, Rowell and Dawson (1983) found that 3 of 12 subjects who held a weight theory of water displacement changed to a volume theory after observing anomalous data that supported the volume theory.”
§ 992-93 Editorial Advisory Board > Changing Theories
What the sources say
- Not checked yetcites Rowell and Dawson (1983)
plainstates a causen = 12- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Using the same domain, Burbules and Linn (1988) devised an educational intervention using anomalous data that convinced more than 70% of adolescents to shift from a weight theory of displacement to a volume theory of displacement within a single session.”
§ 992-93 Editorial Advisory Board > Changing Theories
What the sources say
- Not checked yetcites Burbules and Linn (1988)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“As predicted, subjects in the entrenched condition were less likely to abandon the meteor impact theory than were subjects in the nonentrenched condition.”
§ 992-93 Editorial Advisory Board > Characteristic 1. Entrenchment of the Prior Theory
What the sources say
- Not checked yetcites Chinn and Brewer (1992a)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“But the use of anomalous data is no panacea.”
§ 992-93 Editorial Advisory Board > The Role of Anomalous Data
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We postulate that there are seven distinct forms of response to anomalous data, only one of which is to accept the data and change theories.The other six responses involve discounting the data in various ways in order to protect the preinstructional theory.”
- Also stated in: § Forms of Psychological Response to Anomalous Data · plain
“We postulate that there are seven basic responses: (a) ignore the anomalous data, (b) reject the data, (c) exclude the data from the domain of theory A, (d) hold the data in abeyance, (e) reinterpret the data while retaining theory A, (f) reinterpret the data and make peripheral changes to theory A, and (g) accept the data and change theory A, possibly in favor of theory B.”
§ 992-93 Editorial Advisory Board > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Also stated in: § Forms of Psychological Response to Anomalous Data · plain
118 more claims
Create a free account to see all 232 claims and to verify the 151 references still open.
- It may state two separate claims as one. 52
- Probably not a substantial claim. 74
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Six maladaptive responses have been conceptualized as occurring as a result of this conflict, including ignoring external feedback, rejecting external feedback, viewing feedback as irrelevant, refusing to see a connection between internal and external feedback, reinterpreting the external feedback to align it with internal judgement, or acting on feedback in a superficial manner. 17”
From Medical student perceptions of feedback and feedback behaviors within the context of the “educational alliance.” (2017) · cites this paper as [17]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ 992-93 Editorial Advisory Board > Abstract
“The other six responses involve discounting the data in various ways in order to protect the preinstructional theory.”
§ 992-93 Editorial Advisory Board > Making Peripheral Theory Changes
“An individual who responds in this way clearly accepts the data but is unwilling to give up theory A and accept theory B.”
Citations
Cites
The Structure of Scientific Revolutions
Kuhn, T. S., & Schlegel, R. (1963) · Physics Today · doi:10.1063/1.3050879 · Cited by 35,538
The Structure of Scientific Revolutions: 50th Anniversary Edition
Kuhn, T. S., & Hacking, I. (2012) · doi:10.7208/chicago/9780226458144.001.0001 · Cited by 21,170
A social-cognitive approach to motivation and personality.
Dweck, C. S., & Leggett, E. L. (1988) · Psychological Review · doi:10.1037/0033-295x.95.2.256 · Cited by 9,745
Levels of processing: A framework for memory research
Craik, F. I. M., & Lockhart, R. S. (1972) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(72)80001-x · Cited by 9,566
The case for motivated reasoning.
Kunda, Z. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.108.3.480 · Cited by 9,022
Chaiken, S. (1980) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.39.5.752 · Cited by 5,516
Accommodation of a scientific conception: Toward a theory of conceptual change
Posner, G. J., Strike, K. A., Hewson, P. W., & Gertzog, W. A. (1982) · Science Education · doi:10.1002/sce.3730660207 · Cited by 5,187 · cited 1×
“An entrenched belief is a belief that is deeply embedded in a network of other beliefs (see Brewer & Chinn, 1991; P. Hewson, 1981; Posner et al., 1982; Vosniadou & Brewer, 1992).”
BackgroundFalsification and the Methodology of Scientific Research Programmes
Lakatos, I. (1970) · Criticism and the Growth of Knowledge · doi:10.1017/cbo9781139171434.009 · Cited by 4,649
Lord, C. G., Ross, L., & Lepper, M. R. (1979) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.37.11.2098 · Cited by 4,583
Falsification and the Methodology of Scientific Research Programmes
Lakatos, I. (1976) · Can Theories be Refuted? · doi:10.1007/978-94-010-1863-0_14 · Cited by 3,915
Research works printed but not linked: 34
- Alvermann DE, 1990, Paper presented at the annual meeting of the National Reading Conference
- Bassok M, 1989, Journal of Experimental Psychology: Learning, Memory, and Cognition, 15, 153
- Brewer WF, 1992, Learning scientific theories that contradict entrenched beliefs
- Brewer WF, 1992, Paper presented at the XXV International Congress of Psychology
- Brown DE, 1992, Research in physics learning: Theoretical issues and empirical studies, 380
- Catrambone R, 1989, Journal of Experimental Psychology: Learning, Memory, and Cognition, 15, 1147
- Chi MTH, 1992, Minnesota studies in the philosophy of science: Vol. XV. Cognitive models of science, 129
- Chi MTH, 1989, Knowing, learning, and instruction: Essays in honor of Robert Glaser, 251
- Chinn CA, 1992, Responding to anomalous scientific data: Effects of entrenchment, background knowledge, and an alternative theory
- Close F, 1991, New Scientist, 46
- Collins A, 1977, Schooling and the acquisition of knowledge, 339
- Collins A, 1989, Knowing, learning, and instruction: Essays in honor of Robert Glaser, 453
- diSessa AA, 1982, Cognitive Science, 6, 37
- Drake S, 1980, Galileo
- Dunbar K, 1989, Proceedings of the Eleventh Annual Conference of the Cognitive Science Society, 426
- Dunbar K, 1989, Complex information processing: The impact of Herbert A. Simon, 109
- Dunbar K, 1990, Proceedings of the Twelfth Annual Conference of the Cognitive Science Society, 93
- Hesse JJ, 1987, Proceedings of the Second International Seminar on Misconceptions and Educational Strategies in Science and Mathematics, 2, 194
- Inagaki K, 1981, Quarterly Newsletter of the Laboratory of Comparative Human Cognition, 3, 26
- Kuhn D, 1988, The development of scientific thinking skills
- McCloskey M, 1983, Mental models, 299
- Minstrell JA, 1989, Toward the thinking curriculum: Current cognitive research, 129
- Muller R, 1988, Nemesis
- Ranney M, 1988, Proceedings of the Tenth Annual Conference of the Cognitive Science Society, 426
- Reiner M, 1987, Proceedings of the Second International Seminar on Misconceptions and Educational Strategies in Science and Mathematics, 2, 368
- Ross BH, 1987, Journal of Experimental Psychology: Learning, Memory, and Cognition, 13, 629
- Schoenfeld AH, 1989, Toward the thinking curriculum: Current cognitive research, 83
- Shrager J, 1990, Computational models of scientific discovery and theory formation, 1
- Stavy R, 1987, Proceedings of the Second International Seminar on Misconceptions and Educational Strategies in Science and Mathematics, 1, 456
- Strike KA, 1985, Cognitive structure and conceptual change, 211
- Thagard P, 1990, Computational models of scientific discovery and theory formation, 27
- Toulmin S, 1972, Human understanding: The collective use and evolution of concepts
- 10.5962/bhl.title.2472 · doi:10.5962/bhl.title.2472
- Watson B, 1990, Phi Delta Kappan, 71, 680
Cited by
Feedback and Self-Regulated Learning: A Theoretical Synthesis
Butler, D. L., & Winne, P. H. (1995) · Review of Educational Research · doi:10.3102/00346543065003245 · Cited by 3,334
Constructing Scientific Knowledge in the Classroom
Driver, R., Asoko, H., Leach, J., Scott, P., & Mortimer, E. (1994) · Educational Researcher · doi:10.3102/0013189x023007005 · Cited by 2,016
Policy Implementation and Cognition: Reframing and Refocusing Implementation Research
Spillane, J. P., Reiser, B. J., & Reimer, T. (2002) · Review of Educational Research · doi:10.3102/00346543072003387 · Cited by 1,908
Conceptualizing Teacher Professional Learning
Opfer, V. D., & Pedder, D. (2011) · Review of Educational Research · doi:10.3102/0034654311413609 · Cited by 1,814
Scientific discovery learning with computer simulations of conceptual domains
De Jong, T., & Van Joolingen, W. R. (1998) · Review of Educational Research · doi:10.3102/00346543068002179 · Cited by 1,593
Metadata
- Authors
- Chinn, C. A., & Brewer, W. F.
- Affiliations
- University of Illinois Urbana-Champaign (US)
- ORCID
- Chinn, Clark A.
- Venue
- Review of Educational Research
- Published
- 1993-03
- Volume
- 63
- Issue
- 1
- Pages
- 1-49
- ISSN
- 0034-6543 (ISSN-L)
- 1935-1046
- OpenAlex
- W2166792455
- Semantic Scholar
- e0634f2945b43d4c13a0aa2ff31f2c1c5fe597b9
- Cited by
- 1,393
- References
- 188
- Citations by year
- 2026: 23 · 2025: 20 · 2024: 23 · 2023: 21 · 2022: 35 · 2021: 51 · 2020: 61 · 2019: 40 · 2018: 48 · 2017: 44 · 2016: 52 · 2015: 69 · 2014: 55 · 2013: 74 · 2012: 59
- FWCI
- 131.95
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Review of Educational Research (publishedVersion)
- Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) (submittedVersion)
- Rutgers University Community Repository (Rutgers University) (submittedVersion)
- Topics
- Social Sciences › Education › Science Education and Pedagogy
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Evolution and Science Education
- Social Sciences › Psychology › Developmental and Educational Psychology › Educational Strategies and Epistemologies
- Keywords
- anomalous data, knowledge acquisition, science learning, theory change, scientific reasoning, science instruction, theoretical framework
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The role of anomalous data in knowledge acquisition: A theoretical framework and implications for science instruction. https://app.cochat.ai/papers/10.3102/00346543063001001
- The paper
- Chinn, C. A., & Brewer, W. F. (1993). The role of anomalous data in knowledge acquisition: A theoretical framework and implications for science instruction. Review of Educational Research. https://doi.org/10.3102/00346543063001001
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.