The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
The development and validation of a learning progression for argumentation in science
Abstract
Given the centrality of argumentation in the Next Generation Science Standards, there is an urgent need for an empirically validated learning progression of this core practice and the development of high‐quality assessment items. Here, we introduce a hypothesized three‐tiered learning progression for scientific argumentation. The learning progression accounts for the intrinsic cognitive load associated with orchestrating arguments of increasingly complex structure. Our proposed learning progression for argumentation in science also makes an important distinction between construction and critique. We present validity evidence for this learning progression based on item response theory, and discuss the development of items used to test this learning progression. By analyzing data from cognitive think‐aloud interviews of students, written responses on pilot test administrations, and large‐scale test administrations using a Rasch analysis, we discuss the refinement both of our items and our learning progression to improve construct validity and scoring reliability. Limitations to this research as well as implications for future work on assessment of scientific argumentation are discussed. © 2016 Wiley Periodicals, Inc. J Res Sci Teach 53: 821–846, 2016
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2001) · Cited by 13,930
Confirmation Bias: A Ubiquitous Phenomenon in Many Guises
Nickerson, R. S. (1998) · Review of General Psychology · doi:10.1037/1089-2680.2.2.175 · Cited by 7,267
Culture and systems of thought: Holistic versus analytic cognition.
Nisbett, R. E., Peng, K., Choi, I., & Norenzayan, A. (2001) · Psychological Review · doi:10.1037/0033-295x.108.2.291 · Cited by 4,263
Talking science: language, learning, and values
(1991) · Choice Reviews Online · doi:10.5860/choice.28-5211 · Cited by 3,996
Cognitive load theory, learning difficulty, and instructional design
Sweller, J. (1994) · Learning and Instruction · doi:10.1016/0959-4752(94)90003-5 · Cited by 3,801
A Rasch model for partial credit scoring
Masters, G. N. (1982) · Psychometrika · doi:10.1007/bf02296272 · Cited by 3,782
Protocol Analysis: Verbal Reports as Data
Ericsson, K. A., & Simon, H. A. (1993) · doi:10.7551/mitpress/5657.001.0001 · Cited by 3,537
Science as Social Knowledge: Values and Objectivity in Scientific Inquiry
Longino, H. E. (1990) · doi:10.1515/9780691209753 · Cited by 3,092
Cognitive Load Theory and Instructional Design: Recent Developments
Paas, F., Renkl, A., & Sweller, J. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_1 · Cited by 3,041
Cognitive Load Theory and the Format of Instruction
Chandler, P., & Sweller, J. (1991) · Cognition and Instruction · doi:10.1207/s1532690xci0804_2 · Cited by 2,894
Establishing the norms of scientific argumentation in classrooms
Driver, R., Newton, P., & Osborne, J. (2000) · Science Education · doi:10.1002/(sici)1098-237x(200005)84:3<287::aid-sce1>3.0.co;2-a · Cited by 2,323
Self-citationWhy do humans reason? Arguments for an argumentative theory
Mercier, H., & Sperber, D. (2011) · Behavioral and Brain Sciences · doi:10.1017/s0140525x10000968 · Cited by 2,254
Enhancing the quality of argumentation in school science
Osborne, J., Erduran, S., & Simon, S. (2004) · Journal of Research in Science Teaching · doi:10.1002/tea.20035 · Cited by 1,596
Self-citationPsychology of Reasoning: Structure and Content
Wason, P. C., & Johnson-Laird, P. N. (1972) · Medical Entomology and Zoology · Cited by 1,421
Erduran, S., Simon, S., & Osborne, J. (2004) · Science Education · doi:10.1002/sce.20012 · Cited by 1,408
Self-citationFostering students' knowledge and argumentation skills through dilemmas in human genetics
Zohar, A., & Nemet, F. (2002) · Journal of Research in Science Teaching · doi:10.1002/tea.10008 · Cited by 1,346
(2004) · Cited by 1,236
A Systematic Theory of Argumentation. The Pragma-Dialectical Approach
Andone, C. (2005) · Journal of Pragmatics · doi:10.1016/j.pragma.2004.07.003 · Cited by 1,197
A Developmental Model of Critical Thinking
Kuhn, D. (1999) · Educational Researcher · doi:10.2307/1177186 · Cited by 1,188
Schwarz, C. V., Reiser, B. J., Davis, E. A., Kenyon, L., Achér, A., Fortus, D., Shwartz, Y., Hug, B., & Krajcik, J. (2009) · Journal of Research in Science Teaching · doi:10.1002/tea.20311 · Cited by 1,155
Arguing to Learn in Science: The Role of Collaborative, Critical Discourse
Osborne, J. (2010) · Science · doi:10.1126/science.1183944 · Cited by 948
Self-citationThe Multidimensional Random Coefficients Multinomial Logit Model
Adams, R. J., Wilson, M., & Wang, W.-C. (1997) · Applied Psychological Measurement · doi:10.1177/0146621697211001 · Cited by 943
Arguing and Thinking: a rhetorical approach to social psychology
Marraffa, M. (1995) · Iris (Roma Tre University) · Cited by 719
Grosslight, L., Unger, C., Jay, E., & Smith, C. L. (1991) · Journal of Research in Science Teaching · doi:10.1002/tea.3660280907 · Cited by 695
Assimilating complex information
Pollock, E., Chandler, P., & Sweller, J. (2002) · Learning and Instruction · doi:10.1016/s0959-4752(01)00016-0 · Cited by 692
The development of scientific thinking skills in elementary and middle school
Zimmerman, C. (2007) · Developmental Review · doi:10.1016/j.dr.2006.12.001 · Cited by 671
The place of argumentation in the pedagogy of school science
Newton, P., Driver, R., & Osborne, J. (1999) · International Journal of Science Education · doi:10.1080/095006999290570 · Cited by 619
Self-citationvon Aufschnaiter, C., Erduran, S., Osborne, J., & Simon, S. (2008) · Journal of Research in Science Teaching · doi:10.1002/tea.20213 · Cited by 544
Self-citationImplications of Evidence‐Centered Design for Educational Testing
Mislevy, R. J., & Haertel, G. D. (2006) · Educational Measurement: Issues and Practice · doi:10.1111/j.1745-3992.2006.00075.x · Cited by 543
THE PLACE OF ARGUMENTATION IN THE PEDAGOGY OF SCHOOL SCIENCE
(2003) · The RoutledgeFalmer Reader in Science Education · doi:10.4324/9780203464090-11 · Cited by 522
Report of the 2012 National Survey of Science and Mathematics Education.
Banilower, E. R., Smith, P. S., Weiss, I. R., Malzahn, K. A., Campbell, K. M., & Weis, A. M. (2013) · Cited by 506
Berland, L. K., & McNeill, K. L. (2010) · Science Education · doi:10.1002/sce.20402 · Cited by 481
Harrison, A. G., & Treagust, D. F. (2000) · Science Education · doi:10.1002/(sici)1098-237x(200005)84:3<352::aid-sce3>3.0.co;2-j · Cited by 406
Scientific Reasoning: The Bayesian Approach.
Parmigiani, G., Howson, C., & Urbach, P. (1991) · Journal of the American Statistical Association · doi:10.2307/2290425 · Cited by 406
Argument to Foster Scientific Literacy: A Review of Argument Interventions in K–12 Science Contexts
Cavagnetto, A. R. (2010) · Review of Educational Research · doi:10.3102/0034654310376953 · Cited by 394
Disciplinary authority and accountability in scientific practice and learning
Ford, M. (2008) · Science Education · doi:10.1002/sce.20263 · Cited by 385
Lee, M., Wu, Y., & Tsai, C. (2009) · International Journal of Science Education · doi:10.1080/09500690802314876 · Cited by 378
Scientific argument and explanation: A necessary distinction?
Osborne, J. F., & Patterson, A. (2011) · Science Education · doi:10.1002/sce.20438 · Cited by 366
Self-citationLearning Progressions in Science: An Evidence-based Approach to Reform
Corcoran, T., Mosher, F., & Rogat, A. (2009) · doi:10.12698/cpre.2009.rr63 · Cited by 362
Developing a multi‐year learning progression for carbon cycling in socio‐ecological systems
Mohan, L., Chen, J., & Anderson, C. W. (2009) · Journal of Research in Science Teaching · doi:10.1002/tea.20314 · Cited by 349
From principles to practice: An embedded assessment system
Wilson, M., & Sloane, K. (2000) · Applied Measurement in Education · doi:10.1207/s15324818ame1302_4 · Cited by 333
What is Reasoning? What Is an Argument?
Walton, D. N. (1990) · The Journal of Philosophy · doi:10.2307/2026735 · Cited by 331
Learning progressions: Aligning curriculum, instruction, and assessment
Duncan, R. G., & Hmelo‐Silver, C. E. (2009) · Journal of Research in Science Teaching · doi:10.1002/tea.20316 · Cited by 316
Current Issues in Competence Modeling and Assessment
Koeppen, K., Hartig, J., Klieme, E., & Leutner, D. (2008) · Zeitschrift für Psychologie / Journal of Psychology · doi:10.1027/0044-3409.216.2.61 · Cited by 296
Domain-Specific Knowledge and Why Teaching Generic Skills Does Not Work
Tricot, A., & Sweller, J. (2014) · Educational Psychology Review · doi:10.1007/s10648-013-9243-1 · Cited by 273
(1994) · Choice Reviews Online · doi:10.5860/choice.32-0903 · Cited by 254
Duncan, R. G., Rogat, A. D., & Yarden, A. (2009) · Journal of Research in Science Teaching · doi:10.1002/tea.20312 · Cited by 251
Myside bias in thinking about abortion
Baron, J. (1995) · Thinking & Reasoning · doi:10.1080/13546789508256909 · Cited by 238
Songer, N. B., Kelcey, B., & Gotwals, A. W. (2009) · Journal of Research in Science Teaching · doi:10.1002/tea.20313 · Cited by 221
Trends of Science Education Research: An Automatic Content Analysis
Chang, Y.-H., Chang, C.-Y., & Tseng, Y.-H. (2010) · Journal of Science Education and Technology · doi:10.1007/s10956-009-9202-2 · Cited by 220
(2002) · Evaluation in Education and Human Services · doi:10.1007/0-306-47535-9 · Cited by 213
Gotwals, A. W., & Songer, N. B. (2009) · Science Education · doi:10.1002/sce.20368 · Cited by 150
Teaching the nature of science through scientific errors
Allchin, D. (2012) · Science Education · doi:10.1002/sce.21019 · Cited by 138
Reasons for the lack of argumentation and debate in the Far East
Becker, C. (1986) · International Journal of Intercultural Relations · doi:10.1016/0147-1767(86)90035-0 · Cited by 123
What Is High-Quality Instruction?.
Weiss, I. R., & Pasley, J. D. (2004) · Educational leadership · Cited by 117
Beyond Construction: Five arguments for the role and value of critique in learning science
Henderson, J. B., MacPherson, A. C., Osborne, J. F., & Wild, A. (2015) · International Journal of Science Education · doi:10.1080/09500693.2015.1043598 · Cited by 107
Self-citationImproving inquiry in social science : a volume in honor of Lee J. Cronbach
Cronbach, L. J., Snow, R. E., & Wiley, D. E. (1991) · Lawrence Erlbaum Associates eBooks · Cited by 104
Rosenbaum, P. R. (1988) · Psychometrika · doi:10.1007/bf02294217 · Cited by 104
Why Argue? Developing Understanding of the Purposes and Values of Argumentive Discourse
Kuhn, D., Wang, Y., & Li, H. (2010) · Discourse Processes · doi:10.1080/01638531003653344 · Cited by 96
Wiliam, D. (2010) · Review of Research in Education · doi:10.3102/0091732x09351544 · Cited by 94
Assessment of uncertainty‐infused scientific argumentation
Lee, H., Liu, O. L., Pallant, A., Roohr, K. C., Pryputniewicz, S., & Bracey, Z. B. (2014) · Journal of Research in Science Teaching · doi:10.1002/tea.21147 · Cited by 85
Gotwals, A. W., & Songer, N. B. (2013) · Journal of Research in Science Teaching · doi:10.1002/tea.21083 · Cited by 82
The Role of Refutation Text in Overcoming Difficulty with Science Concepts.
Hynd, C. R., & Alvermann, D. E. (1986) · The Journal of Reading · Cited by 80
Reflections on Learning Progressions
Shavelson, R. J., & Kurpius, A. (2012) · SensePublishers eBooks · doi:10.1007/978-94-6091-824-7_2 · Cited by 74
Penney, K., Norris, S. P., Phillips, L. M., & Clark, G. (2003) · Canadian Journal of Science Mathematics and Technology Education · doi:10.1080/14926150309556580 · Cited by 73
Information becomes evidence when an explanation can incorporate it into a causal framework
Koslowski, B., Marasia, J., Chelenza, M., & Dublin, R. (2008) · Cognitive Development · doi:10.1016/j.cogdev.2008.09.007 · Cited by 63
Performance-based accountability policies: Implications for school and classroom practices
Hannaway, J., & Hamilton, L. S. (2008) · PsycEXTRA Dataset · doi:10.1037/e722482011-001 · Cited by 46
ASSESSMENT IN THE SCHOOLS: PURPOSES AND CONSEQUENCES
Messick, S. (1987) · ETS Research Report Series · doi:10.1002/j.2330-8516.1987.tb00255.x · Cited by 28
Assessing Students’ Progressing Abilities To Construct Scientific Explanations
Gotwals, A. W., Songer, N. B., & Bullard, L. (2012) · SensePublishers eBooks · doi:10.1007/978-94-6091-824-7_9 · Cited by 27
Cited by
ArgueTutor: An Adaptive Dialog-Based Learning System for Argumentation Skills
Wambsganss, T., Kueng, T., Soellner, M., & Leimeister, J. M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445781 · Cited by 138
Can ChatGPT support prospective teachers in physics task development?
Küchemann, S., Steinert, S., Revenga, N., Schweinberger, M., Dinc, Y., Avila, K. E., & Kuhn, J. (2023) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.19.020128 · Cited by 132
AL: An Adaptive Learning Support System for Argumentation Skills
Wambsganss, T., Niklaus, C., Cetto, M., Söllner, M., Handschuh, S., & Leimeister, J. M. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376732 · Cited by 101
Zummo, L., Donovan, B., & Busch, K. C. (2021) · Journal of Research in Science Teaching · doi:10.1002/tea.21648 · Cited by 52
Tseng, A. S., Bonilla, S., & MacPherson, A. (2021) · Journal of Research in Science Teaching · doi:10.1002/tea.21696 · Cited by 36
Self-citation
Metadata
- Authors
- Osborne, J. F., Henderson, J. B., MacPherson, A., Szu, E., Wild, A., & Yao, S.
- Venue
- Journal of Research in Science Teaching
- Publisher
- Wiley
- Published
- 2016-04-03
- Volume
- 53
- Issue
- 6
- Pages
- 821-846
- ISSN
- 0022-4308 (ISSN-L)
- 1098-2736
- OpenAlex
- W2344674375
- Cited by
- 277
- References
- 69
- FWCI
- 78.15
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.