Cited by 1,393Science Education and PedagogyEvolution and Science EducationEducational Strategies and Epistemologies

The role of anomalous data in knowledge acquisition: A theoretical framework and implications for science instruction.

Open access
Chinn, Clark A., Brewer, William F.·1993·Review of Educational Research

Abstract

Understanding how science students respond to anomalous data is essential to understanding knowledge acquisition in science classrooms. This article presents a detailed analysis of the ways in which scientists and science students respond to such data. We postulate that there are seven distinct forms of response to anomalous data, only one of which is to accept the data and change theories. The other six responses involve discounting the data in various ways in order to protect the preinstructional theory. We analyze the factors that influence which of these seven forms of response a scientist or student will choose, giving special attention to the factors that make theory change more likely. Finally, we discuss the implications of our framework for science instruction.

AI snapshot

Written from the paper’s full text.

TL;DR

The paper proposes that people respond to anomalous data in seven distinct ways, only one of which is accepting the data and changing theory; the other six preserve the prior theory. It analyzes factors that influence which response occurs and derives instructional strategies intended to foster reflective theory change.

Key findings

  • Seven responses to anomalous data are postulated: ignoring, rejecting, excluding, holding in abeyance, reinterpreting, making peripheral theory changes, and changing theory; only the last involves changing core beliefs.
  • Responses are influenced by prior knowledge (entrenchment, ontological beliefs, epistemological commitments, background knowledge), the alternative theory (availability, quality, intelligibility), the anomalous data (credibility, ambiguity, multiple lines of data), and processing strategies (especially deep processing).
  • Empirical examples include Pickering and Monts’s finding that 45% of undergraduates asserted correct contradictory laboratory data were in error, with 53% of those offering a specific methodological explanation and 47% a vague one; Rowell and Dawson found 3 of 12 subjects changed from a weight to a volume theory after anomalous data; Burbules and Linn convinced more than 70% of adolescents to shift from a weight to a volume theory of displacement within a single session.
  • Other cited results: Mynatt, Doherty, and Tweney found 91% of subjects who obtained unambiguous disconfirming data changed to a correct or partly correct hypothesis; Lawson and Worsnop reported agreement that “Fossils were intentionally put on the Earth to confuse humans” rose from 1% before instruction to 7% after instruction.

Methods

  • Theoretical/review paper: it develops a framework classifying responses to anomalous data, analyzes conditions leading to different responses, and draws implications for science instruction; no new empirical study is reported.
  • Evidence base: selected examples and findings from the history and philosophy of science, psychology, and science education; no primary sample, systematic sampling, or meta-analytic procedure is described.
  • Main analysis: conceptual and logical analysis of coordinating theory and data across three decisions—whether the data are accepted as valid, whether the individual can explain the data, and whether the prior theory is changed—used to derive seven psychologically plausible responses and influencing factors.

Limitations

  • Paper-stated: the authors state that no one had yet developed a detailed framework for responses to anomalous information; they also note no studies investigating effects of epistemological beliefs on responses to anomalous information and no studies examining whether deep processing affects science students’ responses to anomalous data.
  • Paper-stated: some proposed instructional approaches, such as explicit instruction to help students construct appropriate ontological categories, “has not yet been tested empirically.”
  • Evident: as a theoretical synthesis, the paper does not report a systematic review protocol, effect sizes, or primary data; the authors state they do not attempt an exhaustive enumeration of factors, and much evidence is illustrative rather than directly testing the full framework in classrooms.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.3102/00346543063001001

Cites

190 of 190 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 151 cited sources checked · 0 supported · 0 flagged

  • Findingcitation

    Rowell and Dawson (1983) found that 3 of 12 subjects who held a weight theory of water displacement changed to a volume theory after observing anomalous data that supported the volume theory.

    “For example, Rowell and Dawson (1983) found that 3 of 12 subjects who held a weight theory of water displacement changed to a volume theory after observing anomalous data that supported the volume theory.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Rowell and Dawson (1983)

      Not checked in the free run.

  • Findingcitation

    Burbules and Linn (1988) devised an educational intervention using anomalous data that convinced more than 70% of adolescents to shift from a weight theory of displacement to a volume theory of displacement within a single session.

    “Using the same domain, Burbules and Linn (1988) devised an educational intervention using anomalous data that convinced more than 70% of adolescents to shift from a weight theory of displacement to a volume theory of displacement within a single session.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Burbules and Linn (1988)

      Not checked in the free run.

  • Findingcitation

    Chinn and Brewer (1992a) found that subjects in the entrenched condition were less likely to abandon the meteor impact theory than were subjects in the nonentrenched condition.

    “As predicted, subjects in the entrenched condition were less likely to abandon the meteor impact theory than were subjects in the nonentrenched condition.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Chinn and Brewer (1992a)

      Not checked in the free run.

  • Interpretationcitation

    The use of anomalous data in science instruction is no panacea.

    “But the use of anomalous data is no panacea.”
    Quote in the paperSubstantial claim
  • Interpretationnone given

    There are seven basic forms of response to anomalous data: ignore the data, reject the data, exclude the data from the domain of the theory, hold the data in abeyance, reinterpret the data while retaining the theory, reinterpret the data and make peripheral changes to the theory, and accept the data and change the theory.

    “We postulate that there are seven distinct forms of response to anomalous data, only one of which is to accept the data and change theories.The other six responses involve discounting the data in various ways in order to protect the preinstructional theory.”
    • Also stated in: § Forms of Psychological Response to Anomalous Data · plain
      “We postulate that there are seven basic responses: (a) ignore the anomalous data, (b) reject the data, (c) exclude the data from the domain of theory A, (d) hold the data in abeyance, (e) reinterpret the data while retaining theory A, (f) reinterpret the data and make peripheral changes to theory A, and (g) accept the data and change theory A, possibly in favor of theory B.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: No one has yet developed a detailed framework for understanding responses to anomalous information.
  • May combine two claims. 52
  • Classified as probably not a substantial claim. 74
  • The quote only partly states this claim. 1
  • May combine two claims.

    Findingcitation

    Carey et al. (1989) found that a majority of seventh graders believed that scientific knowledge is a faithful copy of nature and that scientific inquiry is a Baconian process of observing facts rather than a process of constructing theories to account for empirical observations.

    “Carey et al. (1989) found that a majority of seventh graders believed that scientific knowledge is a faithful copy of nature and that scientific inquiry is a Baconian process of observing facts rather than a process of constructing theories to account for empirical observations.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Carey et al. (1989) source

      Not checked in the free run.

  • May combine two claims.

    Findingcitation

    Sherman and Kunda found that high-caffeine consumers were less persuaded by a study linking caffeine to disease and rated its methodology as less sound than low-caffeine consumers.

    “Subjects who were high-caffeine consumers were less likely to be persuaded by the study, and they correspondingly rated various methodological aspects of the study as less sound than did low-caffeine consumers.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Sherman and Kunda (reported in Kunda, 1990)

      Not checked in the free run.

  • May combine two claims.

    Findingcitation

    Samarapungavan (1992) found that first graders prefer theories that are internally consistent, consistent with empirical evidence, and cover a broad range of evidence, and that a substantial majority of fifth graders additionally preferred non-ad hoc explanations.

    “Samarapungavan (1992) found that first graders prefer theories that are internally consistent, that are consistent with empirical evidence, and that cover a broad range of evidence instead of a narrow range.She also found that a substantial majority of fifth graders additionally preferred explanations that are not ad hoc to those that are ad hoc.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Samarapungavan (1992) source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation

    In peripheral theory change, the changes leave the theory's central hypotheses intact.

    “In all of these cases, however, the changes leave the theory's central hypotheses intact.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Compared to scientists, science students may be remarkably open to new data.

    “By this standard, it appears that compared to scientists, science students may be remarkably open to new data!”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationnone given

    Individuals who reject data use a wide variety of reasons; three very common forms of rejection are arguing that there was a fundamental methodological error in the way the data were obtained, arguing that the data were merely due to random variation, and declaring the data to be fraudulent.

    “Individuals who reject data use a wide variety of reasons for the rejection; however, three very common forms of rejection are (a) arguing that there was a fundamental methodological error in the way the data were obtained, (b) arguing that the data were merely due to random variation, and (c) declaring the data to be fraudulent.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationcitation

    Wallace differentiated between the human body and the human intellect and developed separate theories to account for their origins.

    “Thus, Wallace differentiated between the human body and the human intellect and developed separate theories to account for the origins of the two subtypes.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Wallace, 1889

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Brown and Clement (1992) found that children subtyped the principles of physics into three different subdomains.

    “In science education, Brown and Clement (1992) found that children subtyped the principles of physics into three different subdomains.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Brown and Clement (1992)

      Not checked in the free run.

  • May combine two claims.

    Interpretationcitation

    Anomalous data do not always lead to belief change; students often find ways to discredit anomalous data and protect their preinstructional beliefs against the data.

    “Thus, anomalous data do not always lead to belief change.Students often find ways to discredit anomalous data and protect their preinstructional beliefs against the data.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Champagne et al., 1985

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    Lakatos distinguished between hard core propositions and protective belt propositions within a theory; hard core propositions cannot be altered without scrapping the entire theory, but protective belt propositions can be altered while preserving the key, central hypotheses.

    “Lakatos (1970) has distinguished between two types of propositions within a theory: hard core propositions and protective belt propositions.Hard core propositions cannot be altered without scrapping the entire theory, but protective belt propositions can be altered while preserving the key, central hypotheses.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Lakatos, 1970 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given

    Perhaps the most common grounds for rejecting data is methodological error.

    “Perhaps the most common grounds for rejecting data is methodological error.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    A very common form of peripheral change is subtyping.

    “A very common form of peripheral change is subtyping.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    The anomalous data in these instructional approaches are intended to cause students to become dissatisfied with their current theories, which cannot account for the anomalous data, and to adopt instead the target scientific theory, which successfully explains the data.

    “The anomalous data are intended to cause students to become dissatisfied with their current theories, which cannot account for the anomalous data, and to adopt instead the target scientific theory, which successfully explains the data (e.g., Posner, Strike, Hewson, & Gertzog, 1982).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Posner, Strike, Hewson, & Gertzog, 1982

      Not checked in the free run.

    • The authors state this as an assumption: Persuasive data are needed to convince students to abandon well-entrenched preinstructional theories.
  • May combine two claims.

    Interpretationcitation

    The commonly observed phenomenon of compartmentalization among science learners can be viewed as a form of exclusion; it amounts to excluding classroom science data from everyday theories about how the physical world works.

    “The commonly observed phenomenon of compartmentalization among science learners can also be viewed as a form of exclusion.”
    • Also stated in: § Excluding Anomalous Data · plain
      “Compartmentalization amounts to excluding classroom science data from everyday theories about how the physical world works.”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Osborne & Wittrock, 1983

      Not checked in the free run.

    • cites Pines & West, 1986

      Not checked in the free run.

    • cites Roth & Anderson, 1988

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Other children adopt a two-earth theory in which there is a flat earth on which people live and a round earth up in space.

    “Other children adopt a two-earth theory in which there is a flat earth on which people live and a round earth up in space.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Vosniadou & Brewer, 1992

      Not checked in the free run.

  • May combine two claims.

    Interpretationnone given

    Only one of the seven responses to anomalous data is to accept the data and change theories; the other six responses involve discounting the data in various ways in order to protect the preinstructional theory.

    “We postulate that there are seven distinct forms of response to anomalous data, only one of which is to accept the data and change theories.The other six responses involve discounting the data in various ways in order to protect the preinstructional theory.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisenone given

    The current literature on science education includes many new instructional approaches that take students' preinstructional theories into account and are designed to convince students to change their theories.

    “The current literature on science education includes many new instructional approaches that take students' preinstructional theories into account and are designed to convince students to change their theories.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    Students typically resist giving up their preinstructional beliefs; instead of abandoning or modifying them in the face of new, conflicting data and ideas, they often staunchly maintain old ideas and reject or distort new ideas.

    “The second reason why understanding how students respond to contradictory information is crucial for science education is that students typically resist giving up their preinstructional beliefs.Instead of abandoning or modifying their preinstructional beliefs in the face of new, conflicting data and ideas, students often staunchly maintain old ideas and reject or distort new ideas.”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Vosniadou & Brewer, 1992

      Not checked in the free run.

    • cites Anderson & Smith, 1984

      Not checked in the free run.

    • cites Champagne, Klopfer, & Anderson, 1980

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationcitation

    This peripheral modification of the theory accounted for the anomalous data but allowed the philosopher to retain the core belief that the moon was a perfect sphere.

    “This peripheral modification of the theory accounted for the anomalous data but allowed the philosopher to retain the core belief that the moon was a perfect sphere.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    After looking through Galileo's telescope, one of Galileo's opponents conceded that he saw mountains on the moon but argued that the mountains were embedded in a perfectly transparent crystal sphere.

    “After looking through Galileo's telescope, one of Galileo's opponents conceded that he saw mountains on the moon through the telescope.However, he argued that the mountains were embedded in a perfectly transparent crystal sphere”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Drake, 1980, p. 48

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Interpretationnone given

    Placing anomalous data in abeyance leaves the individual's initial theory unchanged.

    “In common with all of the earlier forms of response, placing the data in abeyance leaves the individual's initial theory unchanged.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Peripheral theory change is the first response to anomalous data discussed that involves any change in an individual's initial theory.

    “This is the first response to anomalous data that we have discussed that involves any change in an individual's initial theory.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    In some studies, major belief change takes more time and shows up only over years as students acquire additional knowledge; in other studies, some theory change in response to anomalous data occurs within one or a few experimental sessions or within several classroom lessons.

    “In some studies, major belief change takes more time and shows up only over years as students acquire additional knowledge (e.g., Karmiloff-Smith, 1988;Vosniadou & Brewer, 1992).In other studies, some theory change in response to anomalous data occurs within one or a few experimental sessions or within several classroom lessons”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Karmiloff-Smith, 1988 source

      Not checked in the free run.

    • cites Vosniadou & Brewer, 1992

      Not checked in the free run.

    • cites Alvermann & Hynd, 1989

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    It seems probable that helping students achieve explicit metaconceptual knowledge of how theories relate to evidence would promote a more rational theory evaluation process.

    “It certainly seems probable that helping students achieve explicit metaconceptual knowledge of how theories relate to evidence would promote a more rational theory evaluation process.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationcitation

    Faulty ontological assumptions lead students to reject and fail to comprehend accepted scientific ideas, and thus to make theory-preserving responses to anomalous data.

    “These faulty ontological assumptions not only lead students to reject accepted scientific ideas but also make it difficult for the students even to comprehend the accepted scientific ideas.Thus, they lead students to make theory-preserving responses to anomalous data.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    Several mistaken ontological beliefs have been found to resist change, including beliefs that electrons and photons move along a single discrete path, that time flows at a constant rate regardless of relative motion, that heat is a substance, and that force is something internal to a moving object.

    “Examples of mistaken ontological beliefs that have been found to resist change are beliefs that objects like electrons and photons move along a single discrete path (Brewer & Chinn, 1991), that time flows at a constant rate regardless of relative motion (Brewer & Chinn, 1991;P. Hewson, 1982), that heat is a substance (Wiser, 1988), and that force is something internal to a moving object (McCloskey”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Brewer & Chinn, 1991

      Not checked in the free run.

    • cites P. Hewson, 1982 source

      Not checked in the free run.

    • cites Wiser, 1988

      Not checked in the free run.

  • May combine two claims.

    Interpretationcitation

    Sometimes a belief is entrenched for reasons of personal self-image or for social expediency.

    “Sometimes a belief is entrenched for reasons of personal self-image or for social expediency.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationnone given

    Depending on its contents, background knowledge can lead an individual to reject or reinterpret anomalous data, or to accept the anomalous data and make either peripheral or core changes to the current theory.

    “Depending on its contents, an individual's background knowledge can have very different effects on how the individual responds to anomalous data.On one hand, background knowledge can lead an individual to reject or reinterpret anomalous data.On the other hand, background knowledge can lead the individual to accept the anomalous data and to make either peripheral or core changes to the current”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    The more entrenched a belief, the harder it should be to persuade an individual to change the belief.

    “The more entrenched a belief, the harder it should be to persuade an individual to change the belief.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Chi (1992) argued that many misconceptions in the physical sciences are caused by faulty ontological underpinnings, namely, that concepts like heat, light, force, and current are believed by children to be a material substance.

    “Chi (1992) has argued that many misconceptions in the physical sciences are caused by faulty ontological underpinnings, namely, that concepts like heat, light, force, and current are believed by children to be a material substance.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Chi (1992)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    An individual's background knowledge is an extremely potent factor in determining how the individual responds to anomalous data.

    “An individual's background knowledge is an extremely potent factor in determining how the individual responds to anomalous data.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationcitation

    Many school-aged children possess epistemological beliefs about the scientific enterprise that are likely to impede rational theory change, such as believing that learning science amounts to memorizing facts and that science does not apply to the everyday world.

    “Moreover, many school-aged children possess epistemological beliefs about the scientific enterprise that are likely to impede rational theory change.For example, many students appear to believe that learning science amounts to memorizing facts and that science does not apply to the everyday world (Songer & Linn, 1991).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Songer & Linn, 1991

      Not checked in the free run.

  • May combine two claims.

    Interpretationcitation

    Although children possess an adequate commonsense epistemology, they lack more sophisticated epistemological commitments based on the scientific cultural tradition, including commitments to testing hypotheses experimentally and using rigorous controls.

    “However, although children possess an adequate commonsense epistemology, they undoubtedly lack more sophisticated epistemological commitments based on the scientific cultural tradition that began to develop during the Renaissance (Brewer & Samarapungavan, 1991); these include commitments to such ideas as testing hypotheses experimentally and using rigorous controls.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Brewer & Samarapungavan, 1991

      Not checked in the free run.

  • May combine two claims.

    Interpretationnone given

    Attempts to coordinate theory and data involve three fundamental dimensions: whether the individual accepts the data as valid, whether the individual can provide an explanation for why the data are accepted or not accepted, and whether the individual changes his or her prior theory.

    “Thus, attempts to coordinate theory and data involve three fundamental dimensions: (a) whether the individual accepts the data as valid, (b) whether the individual can provide an explanation for why the data are accepted or not accepted, and (c) whether the individual changes his or her prior theory.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    The seven categories can be derived from a logical analysis of the data evaluation and theory-change process.

    “However, we also think that the seven categories can be derived from a logical analysis of the data evaluation and theory-change process.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    There are four characteristics of prior beliefs that are especially important in influencing how an individual responds to anomalous information: entrenchment of the current theory, ontological beliefs, epistemological commitments, and background knowledge.

    “We postulate that there are four characteristics of prior beliefs that are especially important in influencing how an individual responds to anomalous information: (1) the entrenchment of the individual's current theory, (2) the individual's ontological beliefs, (3) the individual's epistemological commitments, and (4) the individual's background knowledge.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Rational, informed theory change requires that the student understand the new theory.

    “And it is equally obvious that rational, informed theory change requires that the student understand the new theory.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationnone given

    To avoid rejection, anomalous data must pass the test of credibility; credible data may produce exclusion, abeyance, reinterpretation, peripheral theory change, or theory change, but not rejection.

    “To avoid rejection, anomalous data must pass the test of credibility.Data that are not credible will be rejected.Data that are credible may produce the responses of exclusion, abeyance, reinterpretation, peripheral theory change, or theory change, but not rejection.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Scientists will not give up a theory unless a plausible alternative theory is available, and the same holds for science learners.

    “T. Kuhn (1962) has argued that scientists will not give up a theory unless there is a plausible alternative theory available, and Posner et al. (1982) have made essentially the same argument about science learners.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites T. Kuhn (1962)

      Not checked in the free run.

    • cites Posner et al. (1982) source

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    A good scientific theory has at least five characteristics: accuracy, broad scope, consistency, simplicity, and fruitfulness.

    “T. Kuhn (1977) has argued that a good scientific theory has at least five characteristics.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites T. Kuhn (1977) source

      Not checked in the free run.

  • May combine two claims.

    Interpretationnone given

    There are three characteristics of anomalous data that influence response: credibility, ambiguity, and existence of multiple data to rule out prior theory-preserving responses.

    “We propose that there are three characteristics of anomalous data that influence the response to such data: (1) the credibility of the data, ( 2) the ambiguity of the data, and ( 3) the existence of multiple data to rule out prior theory-preserving responses.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Thagard (1992) concludes that for most scientific revolutions, explanatory breadth of the new theory is the largest contributor to explanatory coherence.

    “He (Thagard, 1992) concludes that “for most revolutions, the explanatory breadth of the new theory--how much it explains--is the largest contributor to explanatory coherence” (p.248).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Thagard, 1992 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Schank and Ranney (1991) found that subjects prefer theories that cover a broader scope of empirical data.

    “Schank and Ranney (1991) have similarly found that subjects prefer theories that cover a broader scope of empirical data.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Schank and Ranney (1991)

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    As a result, when children are presented with covariation information that contradicts a favored theory, they are not constrained to accept the information, and they find it easy to retain their favored theory.

    “As a result, when children are presented with covariation information that contradicts a favored theory, they are not constrained to accept the information, and they find it easy to retain their favored theory.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationcitation

    Instructional use of anomalous data in the classroom relies primarily on the idea that learners reject their own theory because it cannot accurately account for the anomalous data and accept the alternative because it does.

    “Indeed, the instructional use of anomalous data in the classroom relies primarily on the idea of accuracy: learners will come to reject their own theory because it cannot accurately account for the anomalous data, and they will accept the alternative theory because it does account for the anomalous data.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    More credible communicators produce more belief change, and credibility is enhanced when the communicator is unbiased and an expert.

    “Social psychologists have found that more credible communicators produce more belief change, and credibility is enhanced when the communicator is unbiased and when the communicator is an expert (Hovland, Janis, & Kelley, 1953;Maddux & Rogers, 1980;Reinard, 1988).”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Hovland, Janis, & Kelley, 1953

      Not checked in the free run.

    • cites Maddux & Rogers, 1980

      Not checked in the free run.

    • cites Reinard, 1988 source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    In the Petty and Cacioppo (1979) experiment, high-involvement subjects regarded stricter visitation policies more favorably, while low-involvement subjects were not affected.

    “The persuasive message had no effect on low-involvement subjects, but it led high-involvement subjects to regard stricter visitation policies more favorably.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Petty and Cacioppo (1979)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    Ontological beliefs tend to be deeply entrenched, so anomalous data that contradict these beliefs tend to produce theory-preserving responses.

    “Ontological beliefs tend to be deeply entrenched, so that anomalous data that contradict these beliefs tend to produce theory-preserving responses.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    It seems probable that deep processing goals can be aroused in science classrooms through personal involvement and through students knowing they will have to justify their judgments.

    “And it seems probable that deep processing goals can be aroused in science classrooms through personal involvement and through students knowing that they will have to justify their judgments.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Ambiguous data encourage reinterpretations; unambiguous data preclude such reinterpretations.

    “Ambiguous data thus encourage reinterpretations; unambiguous data preclude such reinterpretations.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Brown and Clement (1992) reported that increased use of hands-on experiences appeared to facilitate conceptual change in mechanics.

    “Brown and Clement (1992) reported that increased use of hands-on experiences appeared to facilitate conceptual change in mechanics.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Brown and Clement (1992)

      Not checked in the free run.

  • May combine two claims. The quote only partly states this claim.

    Interpretationreasoning

    In science education, there are two ways to rebut students' theory-preserving responses: anticipate objections in advance and prepare data, or find out post hoc and conduct further studies.

    “In science education, like science itself, there are two ways to rebut students' theory-preserving responses.The first way is, again, to anticipate in advance what the grounds for rejection and reinterpretation will be and to prepare lines of data in advance to undermine those objections.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    Brown and Clement (1992) reported that their second-year intervention was much more successful than the first, partly because they had a more detailed understanding of students' alternative conceptions.

    “They report that the second year's intervention was much more successful than the first, and they believed that part of the reason was that in the second year, they had a much more detailed understanding of students' alternative conceptions.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Brown and Clement (1992)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Interpretationnone given

    More entrenched beliefs lead to theory-preserving responses and make theory change more difficult.

    “More entrenched beliefs lead to theory-preserving responses and make theory change more difficult.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationcitation

    Allowing people to observe experimental results directly may enhance credibility and produce theory change more than reading about results.

    “A fourth possible way to enhance credibility is to allow people to observe the experimental results directly.Thus, classroom demonstrations and laboratories might be more likely to produce theory change than simply having students read about an experimental result.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Stavy (1987, 1991) suggests that unambiguous data are more effective than ambiguous data in promoting theory change among science students.

    “Research by Stavy (1987Stavy ( , 1991) ) suggests that unambiguous data are more effective than ambiguous data in promoting theory change among science students.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Stavy (1987

      Not checked in the free run.

    • cites [1991]

      Not checked in the free run.

  • May combine two claims.

    Interpretationcitation

    If people are personally involved with the issue, or expect to justify their reasoning, they process anomalous information deeply and are more likely to change their theories; otherwise they process superficially and theory change is less likely.

    “If they are personally involved with the issue, or if they expect to have to justify their reasoning, people process anomalous information deeply and are more likely to change their theories.Otherwise, they are content to process the information superficially, and theory change is less likely.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    Background knowledge can facilitate rejection or reinterpretation and facilitate theory change, depending on its content.

    “Background knowledge can, on one hand, facilitate rejection or reinterpretation and, on the otherhand, facilitate theory change, depending on the particular content of the background knowledge.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    In the history of science, unambiguous data against a theory sometimes nudge scientists toward eventual theory change, but often produce abeyance or peripheral change instead.

    “In the history of science, unambiguous data against a theory sometimes nudge scientists toward eventual theory change (cf.Badash, 1966;Musgrave, 1976), but unambiguous data often produce abeyance or peripheral change instead.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Badash, 1966 source

      Not checked in the free run.

    • cites Musgrave, 1976 source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    In practice people frequently fail to process contradictory information deeply; they attend more to evidence that supports their beliefs than evidence that contradicts them.

    “However, in practice people frequently fail to process contradictory information deeply; in particular, they attend much more to evidence that supports their beliefs than evidence that contradicts them (e.g., Galotti, 1989).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Galotti, 1989 source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    In Chaiken's (1980) study, subjects who expected to justify their opinions in a discussion with peers processed the arguments more deeply and were more convinced.

    “The results showed that the subjects who expected to have to justify their opinions in a discussion with their peers processed the arguments more deeply and were more convinced by the arguments.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Chaiken's (1980) source

      Not checked in the free run.

  • May combine two claims.

    Interpretationnone given

    Some data are more easily reinterpretable than others; unambiguous data should increase the likelihood of theory change, while ambiguous data make reinterpretation easy.

    “Although it is undoubtedly true that any data can be reinterpreted, it also seems clear that some data are more easily reinterpretable than others.In other words, some data are relatively unambiguous with respect to two competing theories; other data are relatively ambiguous.Unambiguous data should increase the likelihood of theory change; ambiguous data should make reinterpretation very easy.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Interpretationreasoning

    Students who are not motivated to process scientific evidence deeply are not likely to change their theories, or if they do, the change will be superficial.

    “Students who are not motivated to process scientific evidence deeply are not likely to change their theories, or if they do change their theories, the change will be superficial, not involving a deep understanding of the new theory and why it is supported by the evidence.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Interpretationnone given

    Some epistemological commitments, such as a commitment to consistency, foster theory change; others, such as a belief that science is a matter of memorizing facts, probably impede theory change.

    “Some epistemological commitments, such as a commitment to consistency, foster theory change; others, such as a belief that science is a matter of memorizing facts, probably impede theory change.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation

    Data that the individual already believes are perfectly credible.

    “Finally, there is one form of data that is perfectly credible, data that the individual already believes.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Less ambiguous data are less likely to be reinterpreted.

    “Less ambiguous data are less likely to be reinterpreted.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationnone given

    Before students can even begin to evaluate a theory, they need a wealth of domain-specific background knowledge.

    “Before students can even begin to evaluate a theory, they need a wealth of domain-specific background knowledge.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    To learn epistemological commitments appropriate to evaluating evidence and theories, students may need to participate in a community that regularly debates alternative theories, discusses responses to anomalous data, and evaluates evidence and theories.

    “In other words, to learn epistemological commitments appropriate to evaluating evidence and theories, students may need to participate in a community that regularly debates alternative theories, discusses responses to anomalous data, and evaluates evidence and theories.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given

    Table 3 presents 11 general instructional strategies that the authors hypothesize will foster reflective theory change.

    “Table 3 presents 11 general instructional strategies that we hypothesize will foster reflective theory change.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    If the goal of instruction is theory change, students need some kind of access to a plausible alternative theory.

    “But if the goal of instruction is theory change, students need some kind of access to a plausible alternative theory.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    It is desirable for the alternative theory to be intelligible as well as plausible, but this may not be strictly necessary to permit theory change.

    “It is desirable for the alternative theory to be intelligible as well as plausible, but this may not be strictly necessary to permit theory change.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Vosniadou and Brewer (1992) argue that the hollow-earth model is an attempt to reconcile the notion that the earth is round with the student's entrenched belief that things fall downward.

    “Vosniadou and Brewer (1992) argue that the hollow-earth model is an attempt to reconcile the notion that the earth is round with the student's entrenched belief that things fall downward.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Vosniadou and Brewer (1992)

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Carey et al. (1989) developed a 3-week instructional unit blending an enculturation approach with some explicit instruction on the scientific method; as a result, students showed a marked increase in their understanding of the nature and purposes of scientific inquiry.

    “In the domain of science, Carey et al. (1989) developed a 3-week instructional unit blending an enculturation approach with some explicit instruction on the scientific method.As a result of this short intervention, students showed a marked increase in their understanding of the nature and purposes of scientific inquiry.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Carey et al. (1989) source

      Not checked in the free run.

  • May combine two claims.

    Interpretationnone given

    Deep processing makes theory change more likely and can be enhanced by fostering personal involvement and ensuring students know they will have to justify their reasoning.

    “Deep processing makes theory change more likely and can be enhanced in at least two ways: by fostering personal involvement in the issue and by ensuring that students know that they will have to justify their reasoning.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    In addition to domain-specific background knowledge, domain-general background knowledge can help promote reflective theory change.

    “In addition to domain-specific background knowledge, domain-general background knowledge can help promote reflective theory change.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationreasoning

    Without addressing the most entrenched components of a theory, fundamental theory change may be very difficult.

    “Without addressing these components, fundamental theory change may be very difficult.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    To change an entrenched theory, it may be necessary to identify the crucial components of the theory that are most deeply entrenched.

    “Thus, to change an entrenched theory, it may be necessary to figure out precisely why the theory is entrenched, that is, to identify those crucial components of the theory that are most deeply entrenched.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    More credible data are less likely to be rejected.

    “More credible data are less likely to be rejected.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    To foster reflective theory change, the teacher must orchestrate four clusters of factors: students' prior knowledge, the alternative theory, the anomalous data, and students' processing strategies.

    “To do so, the teacher must orchestrate the same four clusters of factors that we discussed in the previous section: the students' prior knowledge, the alternative theory, the anomalous data, and the students' processing strategies.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Vosniadou (1992) argues that to lead the student to change the hollow-earth model, it is essential to address the entrenched belief that things fall downward.

    “Vosniadou (1992) argues that in order to lead the student to change the hollow-earth model, it is essential to address the entrenched belief that things fall downward.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Vosniadou (1992)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    Theory change is more likely when students are presented with an alternative theory that includes a plausible mechanism.

    “We argued earlier that theory change is more likely when students are presented with an alternative theory that includes a plausible mechanism.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    A key to plausibility is an explanatory physical mechanism.

    “A key to plausibility is an explanatory physical mechanism.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Multiple experiments can make both rejection and reinterpretation less likely.

    “And multiple experiments can make both rejection and reinterpretation less likely.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Chi (1992) proposes that the way to lead students through ontological shifts is by explicit instruction: students should be told that physics entities belong to a different ontological category.

    “Chi (1992) proposes that the way to lead students through these ontological shifts is by explicit instruction: students should “be told that physics entities belong to a different ontological category” (p.142).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Chi (1992)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Because a crucial part of coming to understand a theory is understanding little by little how the theory explains an array of data, the reiterations of the sequence of learning events are crucial to developing an accurate understanding of the alternative theory.

    “Because a crucial part of coming to understand a theory is understanding little by little how the theory explains an array of data, the reiterations of the sequence of learning events are crucial to developing an accurate understanding of the alternative theory.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    Issue involvement might be promoted by having students explain everyday experiences and solve everyday problems.

    “Issue involvement might be promoted by having students explain everyday experiences and solve everyday problems.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationnone given

    One way of making sure that data are unambiguous is to choose data that are perceptually obvious.

    “One way of making sure that data are unambiguous is to choose data that are perceptually obvious.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    The series of anomalous data does not only lead students toward theory change; it also helps them refine their understanding of the new theory.

    “The series of anomalous data does not only lead students toward theory change; it also helps them refine their understanding of the new theory.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    The alternative theory should not be a superior theory only from the perspective of scientists; it should provide a better account of the data that students have available to them.

    “But it should not be a superior theory only from the perspective of scientists; it should provide a better account of the data that students have available to them.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    Students may view data as more credible if they understand that the data have been gathered according to accepted principles.

    “Students may view data as more credible if they understand that the data have been gathered according to accepted principles.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    Having students justify their reasoning should come naturally in an environment in which students are discussing competing theories for phenomena.

    “Having students justify their reasoning should come naturally in an environment in which students are discussing competing theories for phenomena.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationnone given

    For belief change to occur in any of these domains, it is important to understand how people respond to anomalous information, and it is crucial to understand the conditions that make reflective theory change more likely.

    “For belief change to occur in any of these domains, it is important to understand how people respond to anomalous information, and it is crucial to understand the conditions that make reflective theory change more likely.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    If computerized simulations of data are presented, students may need to be convinced that the simulation faithfully mimics reality.

    “If computerized simulations of data are presented, students may need to be convinced that the simulation faithfully mimics reality.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

    Interpretationreasoning

    Teachers may want to appeal to real-world data that students already know about; this can help reduce compartmentalization, in addition to promoting theory change.

    “Finally, teachers may want to appeal to real-world data that students already know about.This can help reduce compartmentalization, in addition to promoting theory change.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    Factors influence which of these responses an individual will choose when faced with anomalous data.

    “In the second section, we discussed factors that influence which of these responses an individual will choose when faced with anomalous data.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    Because a single experiment will often fail to convince doubters, introducing multiple lines of data may be helpful.

    “Because a single experiment will often fail to convince doubters, introducing multiple lines of data may be helpful.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    Students should sometimes be exposed to less credible data, ambiguous data, and single lines of data.

    “However, we also believe that students should sometimes be exposed to less credible data, ambiguous data, and single lines of data.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    Anomalous data are more likely to promote theory change when they are credible and unambiguous and when multiple lines of data are presented.

    “Anomalous data are more likely to promote theory change when they are credible and unambiguous and when multiple lines of data are presented.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    An intelligible alternative theory may not be strictly necessary for theory change, but it certainly is critical for reflective theory change.

    “As we discussed earlier, an intelligible alternative theory may not be strictly necessary for theory change, but it certainly is critical for reflective theory change.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    There are seven forms of response to anomalous data: ignoring the anomalous data, rejecting the data, excluding the data from the current theory, holding the data in abeyance, reinterpreting the data, making peripheral changes to the current theory, and changing the theory.

    “In the first section, we proposed that there are seven forms of response to anomalous data: (a) ignoring the anomalous data, (b) rejecting the data, (c) excluding the data from the current theory, (d) holding the data in abeyance, (e) reinterpreting the data, (f) making peripheral changes to the current theory, and (g) changing the theory.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    It appears desirable for the teacher to know what particular competing theories the children hold, so that appropriate, unambiguous anomalous data can be chosen.

    “Therefore, it appears desirable for the teacher to know what particular competing theories the children hold, so that appropriate, unambiguous anomalous data can be chosen.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationown data

    The analyses presented in this report provide insights into how to organize science instruction that uses anomalous data.

    “The analyses presented in this report provide insights into how to organize science instruction that uses anomalous data.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Awareness of some general criteria for evaluating anomalous data may help protect students against blind theory change.

    “This awareness of some general criteria for evaluating anomalous data may help protect them against blind theory change.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    Understanding how people respond to anomalous data is crucial to understanding the process of theory change.

    “In this report, we have argued that understanding how people respond to anomalous data is crucial to understanding the process of theory change.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    There is good evidence that theory change is facilitated by making the alternative theory available to students.

    “There is good evidence, then, that theory change is facilitated by making the alternative theory available to students.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    It seems likely that the teacher can promote deep processing strategies by promoting issue involvement and requiring students to justify their reasoning.

    “It seems likely that the teacher can promote deep processing strategies by promoting issue involvement and requiring students to justify their reasoning.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    Live demonstrations and hands-on experiences may enhance credibility.

    “Live demonstrations and hands-on experiences may enhance credibility.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    By selecting multiple lines of credible, unambiguous data, the teacher may be able to make theory change more likely.

    “By selecting multiple lines of credible, unambiguous data, the teacher may be able to make theory change more likely.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    Regardless of how students finally learn about the scientifically accepted alternative theory, it is desirable that the alternative theory be of high quality, in terms of the criteria of accuracy, scope, and consistency.

    “Regardless of how students finally learn about the scientifically accepted alternative theory, it is desirable that the alternative theory be of high quality, in terms of the criteria of accuracy, scope, and consistency.”
    Quote in the paperNot a substantial claim
109 of 109
  • The authors state this as an assumption.

    Persuasive data are needed to convince students to abandon well-entrenched preinstructional theories.

    “and it is plausible to assume that persuasive data are needed to convince students to abandon well-entrenched preinstructional theories.”
  • The authors state this as an assumption.

    No one has yet developed a detailed framework for understanding responses to anomalous information.

    “Although the issue of how scientists and science students respond to anomalous information is critical for science education, no one, to our knowledge, has yet developed a detailed framework for understanding responses to anomalous information.”
  • The authors state this as an assumption.

    Children who have internalized some accepted canons for evaluating scientific experiments will be willing to accept anomalous data when the data conform to those canons.

    “In science education, it seems reasonable to assume that children who have internalized some of the accepted canons for evaluating scientific experiments will be willing to accept anomalous data when the data conform to those canons.”
  • The paper relies on this without support.

    No studies have investigated the effects of epistemological beliefs on how individuals respond to anomalous information.

    “Although it is plausible to assume that epistemological beliefs such as those presented above might make theory change more likely, we know of no studies that have investigated the effects of epistemological beliefs on how individuals respond to anomalous information.”
  • The authors state this as an assumption.

    If an alternative theory ranks highly on accuracy, scope, consistency, simplicity, and fruitfulness, individuals will be more likely to change theories and less likely to make theory-preserving responses to anomalous data.

    “It seems reasonable to assume that if an alternative theory ranks highly on these five characteristics, individuals will be more likely to change theories and less likely to make theorypreserving responses to anomalous data.”
  • The authors state this as an assumption.

    It is frequently more rational to discredit anomalous data than to change theories.

    “Obviously, it is frequently more rational to discredit anomalous data than to change theories: the teacher does not want to foster blind theory change but instead theory change that is rational and reflective.”
  • The authors state this as an assumption.

    Teachers want to foster reflective theory change rather than blind theory change.

    “the teacher does not want to foster blind theory change but instead theory change that is rational and reflective.”
  • The paper relies on this without support.

    The scientifically accepted alternative theory is of high quality in terms of accuracy, scope, and consistency.

    “In one sense, this is not difficult for science instructors, because the alternative theory is an accepted scientific theory.”
8 of 8

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Six maladaptive responses have been conceptualized as occurring as a result of the conflict between external and internal feedback: ignoring external feedback, rejecting external feedback, viewing feedback as irrelevant, refusing to see a connection between internal and external feedback, reinterpreting the external feedback to align it with internal judgement, or acting on feedback in a superfici

    “Six maladaptive responses have been conceptualized as occurring as a result of this conflict, including ignoring external feedback, rejecting external feedback, viewing feedback as irrelevant, refusing to see a connection between internal and external feedback, reinterpreting the external feedback to align it with internal judgement, or acting on feedback in a superficial manner. 17”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Abstract says all six protective responses discount the data

    Minor

    The abstract says every response other than theory change discounts the anomalous data. The discussion of peripheral theory change, one of those six responses, explicitly says the individual accepts the data.

1 of 1

Cites

Flagged first, then by citations

Research works printed but not linked: 34

  1. Alvermann DE, 1990, Paper presented at the annual meeting of the National Reading Conference
  2. Bassok M, 1989, Journal of Experimental Psychology: Learning, Memory, and Cognition, 15, 153
  3. Brewer WF, 1992, Learning scientific theories that contradict entrenched beliefs
  4. Brewer WF, 1992, Paper presented at the XXV International Congress of Psychology
  5. Brown DE, 1992, Research in physics learning: Theoretical issues and empirical studies, 380
  6. Catrambone R, 1989, Journal of Experimental Psychology: Learning, Memory, and Cognition, 15, 1147
  7. Chi MTH, 1992, Minnesota studies in the philosophy of science: Vol. XV. Cognitive models of science, 129
  8. Chi MTH, 1989, Knowing, learning, and instruction: Essays in honor of Robert Glaser, 251
  9. Chinn CA, 1992, Responding to anomalous scientific data: Effects of entrenchment, background knowledge, and an alternative theory
  10. Close F, 1991, New Scientist, 46
  11. Collins A, 1977, Schooling and the acquisition of knowledge, 339
  12. Collins A, 1989, Knowing, learning, and instruction: Essays in honor of Robert Glaser, 453
  13. diSessa AA, 1982, Cognitive Science, 6, 37
  14. Drake S, 1980, Galileo
  15. Dunbar K, 1989, Proceedings of the Eleventh Annual Conference of the Cognitive Science Society, 426
  16. Dunbar K, 1989, Complex information processing: The impact of Herbert A. Simon, 109
  17. Dunbar K, 1990, Proceedings of the Twelfth Annual Conference of the Cognitive Science Society, 93
  18. Hesse JJ, 1987, Proceedings of the Second International Seminar on Misconceptions and Educational Strategies in Science and Mathematics, 2, 194
  19. Inagaki K, 1981, Quarterly Newsletter of the Laboratory of Comparative Human Cognition, 3, 26
  20. Kuhn D, 1988, The development of scientific thinking skills
  21. McCloskey M, 1983, Mental models, 299
  22. Minstrell JA, 1989, Toward the thinking curriculum: Current cognitive research, 129
  23. Muller R, 1988, Nemesis
  24. Ranney M, 1988, Proceedings of the Tenth Annual Conference of the Cognitive Science Society, 426
  25. Reiner M, 1987, Proceedings of the Second International Seminar on Misconceptions and Educational Strategies in Science and Mathematics, 2, 368
  26. Ross BH, 1987, Journal of Experimental Psychology: Learning, Memory, and Cognition, 13, 629
  27. Schoenfeld AH, 1989, Toward the thinking curriculum: Current cognitive research, 83
  28. Shrager J, 1990, Computational models of scientific discovery and theory formation, 1
  29. Stavy R, 1987, Proceedings of the Second International Seminar on Misconceptions and Educational Strategies in Science and Mathematics, 1, 456
  30. Strike KA, 1985, Cognitive structure and conceptual change, 211
  31. Thagard P, 1990, Computational models of scientific discovery and theory formation, 27
  32. Toulmin S, 1972, Human understanding: The collective use and evolution of concepts
  33. 10.5962/bhl.title.2472 · DOI
  34. Watson B, 1990, Phi Delta Kappan, 71, 680

Cited by

Sorted by citations

Authors
Chinn, C. A., & Brewer, W. F.
Affiliations
University of Illinois Urbana-Champaign (US)
Venue
Review of Educational Research
Published
1993-03
Volume
63
Issue
1
Pages
1-49
ISSN
  • 0034-6543 (ISSN-L)
  • 1935-1046
OpenAlex
W2166792455
Cited by
1,393
References
190
Citations by year
2026: 23 · 2025: 20 · 2024: 23 · 2023: 21 · 2022: 35 · 2021: 51 · 2020: 61 · 2019: 40 · 2018: 48 · 2017: 44 · 2016: 52 · 2015: 69 · 2014: 55 · 2013: 74 · 2012: 59
FWCI
131.95
Type
journal article
Language
en
Open access
Locations
  • Review of Educational Research (publishedVersion)
  • Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) (submittedVersion)
  • Rutgers University Community Repository (Rutgers University) (submittedVersion)
Topics
  • Social Sciences › Education › Science Education and Pedagogy
  • Social Sciences › Arts and Humanities › History and Philosophy of Science › Evolution and Science Education
  • Social Sciences › Psychology › Developmental and Educational Psychology › Educational Strategies and Epistemologies
Keywords
anomalous data, knowledge acquisition, science learning, theory change, scientific reasoning, science instruction, theoretical framework

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-10.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-10.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review