How to improve argumentation comprehension in university students: experimental test of a training approach
Open accessAbstract
The ability to comprehend informal arguments is essential for scientific literacy but students often lack structural knowledge about these arguments, especially when the arguments are more complex. This study used a pre-post-test design with a follow-up 4 weeks later to investigate whether a computerised training in identifying structural components of informal arguments can improve university students’ competences to understand complex arguments. The training was embedded in a constructivist learning environment and contents were based on the Toulmin model of argument structure, according to which arguments can be deconstructed into several functional components: Claim, datum, warrant, backing evidence, and rebuttal. Being able to identify the warrant is central for scientific literacy, as the warrant determines whether a conclusion is justified given the data. Results indicate that training in argument structure did not generally improve performance for all students and argument types, but that it was particularly helpful for identifying more complex arguments with a less typical structure and relational aspects between key components (i.e. warrants). High achieving students profited the most from this intervention, and the intervention was also helpful for students with high pretest accuracy scores. Our results suggest that interventions to foster argumentation skills should be included into the curriculum and these interventions should be designed to match learners’ ability level.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
von der Mühlen et al. (2018) found that training in argumentation comprehension was not equally useful for recognizing different argument components; it particularly helped identify more complex arguments with less typical structure and relational aspects such as warrants.
“The authors found that the intervention was not equally useful in recognizing the different components of the arguments.Specifically, the training was particularly helpful in identifying more complex arguments with a less typical structure and the relational aspects between key components, i.e. warrants.”
From Teaching argumentative synthesis writing through deliberative dialogues: instructional practices in secondary education (2021) · cites this paper as von der Mühlen et al. (2018)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences
Cohen, P., Cohen, P., West, S. G., & Aiken, L. S. (2014) · Psychology Press eBooks · doi:10.4324/9781410606266 · Cited by 20,819 · see citing works
The role of deliberate practice in the acquisition of expert performance
Ericsson, K. A., Krampe, R. T., & Tesch-Römer, C. (1993) · Psychological Review · doi:10.1037/0033-295x.100.3.363 · Cited by 9,564 · see citing works
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences.
Henry, N. W., Cohen, J., & Cohen, P. R. (1977) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2064799 · Cited by 7,231 · see citing works
Toulmin, S. E. (2003) · doi:10.1017/cbo9780511840005 · Cited by 7,101 · see citing works
Effects of externally mediated rewards on intrinsic motivation.
Deci, E. L. (1971) · Journal of Personality and Social Psychology · doi:10.1037/h0030644 · Cited by 4,170 · see citing works
Adding It Up: Helping Children Learn Mathematics
Kilpatrick, J., Swafford, J. O., & Findell, B. R. (2013) · DSpace Biblioteca Universidad de Talca (Universidad de Talca) · Cited by 4,084 · see citing works
Self-explanations: How students study and use examples in learning to solve problems
Chi, M. (1989) · Cognitive Science · doi:10.1016/0364-0213(89)90002-5 · Cited by 2,287 · see citing works
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences
Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003) · Cited by 2,213 · see citing works
Instructional Design Theories and Models
(1983) · doi:10.4324/9780203824283 · Cited by 2,192 · see citing works
Self‐Explanations: How Students Study and Use Examples in Learning to Solve Problems
Chi, M. T. H., Bassok, M., Lewis, M. W., Reimann, P., & Glaser, R. (1989) · Cognitive Science · doi:10.1207/s15516709cog1302_1 · Cited by 1,714 · see citing works
Informal reasoning regarding socioscientific issues: A critical review of research
Sadler, T. D. (2004) · Journal of Research in Science Teaching · doi:10.1002/tea.20009 · Cited by 1,440 · see citing works
Reducing cognitive load by mixing auditory and visual presentation modes.
Mousavi, S. Y., Low, R., & Sweller, J. (1995) · Journal of Educational Psychology · doi:10.1037/0022-0663.87.2.319 · Cited by 995 · see citing works
Knowles, E. S., & Linn, J. A. (2004) · Psychology Press eBooks · doi:10.4324/9781410609816 · Cited by 992 · see citing works
Informal Reasoning and Education
(2012) · Routledge eBooks · doi:10.4324/9780203052228 · Cited by 708 · see citing works
The Oxford Handbook of Thinking and Reasoning
Holyoak, K. J., & Morrison, R. (2012) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199734689.001.0001 · Cited by 702 · see citing works
Mayer, R. E. (1989) · Review of Educational Research · doi:10.3102/00346543059001043 · Cited by 687 · see citing works
Improving Students' Ability to Identify and Use Source Information
Britt, M. A., & Aglinskas, C. (2002) · Cognition and Instruction · doi:10.1207/s1532690xci2004_2 · Cited by 509 · see citing works
Learning and Individual Differences
Chen, J., & Usher, E. L. (2013) · Cited by 469 · see citing works
PISA 2012 Results: What Students Know and Can Do (Volume I, Revised edition, February 2014)
OECD (2014) · Programme for international student assessment/Internationale Schulleistungsstudie · doi:10.1787/9789264208780-en · Cited by 397 · see citing works
Approaches to studying formal and everyday reasoning.
Galotti, K. M. (1989) · Psychological Bulletin · doi:10.1037/0033-2909.105.3.331 · Cited by 322 · see citing works
PISA 2009 Results: Students On Line
OECD (2011) · Programme for international student assessment/Internationale Schulleistungsstudie · doi:10.1787/9789264112995-en · Cited by 304 · see citing works
Aptitude-treatment interaction as a framework for research on individual differences in learning.
Snow, R. E. (1989) · Cited by 267 · see citing works
Studying and Using Multiple Documents in History: Effects of Discipline Expertise
Rouet, J., Favart, M., Britt, M. A., & Perfetti, C. A. (1997) · Cognition and Instruction · doi:10.1207/s1532690xci1501_3 · Cited by 248 · see citing works
Everyday Reasoning and the Roots of Intelligence
Perkins, D. N., Farady, M., & Bushey, B. (2012) · Routledge eBooks · doi:10.4324/9780203052228-9 · Cited by 247 · see citing works
Postprimary education has little impact on informal reasoning.
Perkins, D. N. (1985) · Journal of Educational Psychology · doi:10.1037/0022-0663.77.5.562 · Cited by 247 · see citing works
Rittle‐Johnson, B., Star, J. R., & Durkin, K. L. (2009) · Journal of Educational Psychology · doi:10.1037/a0016026 · Cited by 245 · see citing works
Blair, J. A., & Johnson, R. H. (1987) · Argumentation · doi:10.1007/bf00127118 · Cited by 217 · see citing works
Learning to reason via instruction in argumentation
Voss, J. F., & Means, M. L. (1991) · Learning and Instruction · doi:10.1016/0959-4752(91)90013-x · Cited by 183 · see citing works
Britt, M. A., Richter, T., & Rouet, J. (2014) · Educational Psychologist · doi:10.1080/00461520.2014.916217 · Cited by 179 · see citing works
Self-citationArgumentation Schema and the Myside Bias in Written Argumentation
Wolfe, C. R., Britt, M. A., & Butler, J. A. (2009) · Written Communication · doi:10.1177/0741088309333019 · Cited by 173 · see citing works
Stanovich, K. E. (2012) · The Oxford Handbook of Thinking and Reasoning · doi:10.1093/oxfordhb/9780199734689.013.0022 · Cited by 169 · see citing works
Trending Cardiovascular Nutrition Controversies
Freeman, A. M., Morris, P. B., Barnard, N. D., Esselstyn, C. B., Ros, E., Agatston, A. S., Devries, S. R., O’Keefe, J. H., Miller, M. J., Ornish, D. M., et al. (2017) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2016.10.086 · Cited by 166 · see citing works
The Structure of a Scientific Paper
Suppe, F. (1998) · Philosophy of Science · doi:10.1086/392651 · Cited by 149 · see citing works
Processing strategies and the generation effect: Implications for making a better reader
deWinstanley, P. A., & Bjork, E. L. (2004) · Memory & Cognition · doi:10.3758/bf03196872 · Cited by 117 · see citing works
Improving Students' Evaluation of Informal Arguments
Larson, A. A., Britt, M. A., & Kurby, C. A. (2009) · The Journal of Experimental Education · doi:10.3200/jexe.77.4.339-366 · Cited by 112 · see citing works
Text Cues and Strategies Successful Readers Use to Construct the Gist of Lengthy Written Arguments
Chambliss, M. J. (1995) · Reading Research Quarterly · doi:10.2307/748198 · Cited by 99 · see citing works
The Cognitive Processes in Informal Reasoning
Shaw, V. (1996) · Thinking & Reasoning · doi:10.1080/135467896394564 · Cited by 96 · see citing works
DISFLUENCIES IN COMPREHENDING ARGUMENTATIVE TEXTS
Larson, M., Britt, M. A., & Larson, A. A. (2004) · Reading Psychology · doi:10.1080/02702710490489908 · Cited by 94 · see citing works
Getting a picture that is both accurate and stable: Situation models and epistemic validation
Schroeder, S., Richter, T., & Hoever, I. J. (2008) · Journal of Memory and Language · doi:10.1016/j.jml.2008.05.001 · Cited by 90 · see citing works
Self-citationFourth and Fifth Graders Representing the Argument Structure in Written Texts
Chambliss, M. J., & Murphy, P. K. (2002) · Discourse Processes · doi:10.1207/s15326950dp3401_4 · Cited by 73 · see citing works
I Agreed with What? Memory for Simple Argument Claims
Britt, M. A., Kurby, C. A., Dandotkar, S., & Wolfe, C. R. (2007) · Discourse Processes · doi:10.1080/01638530701739207 · Cited by 70 · see citing works
Demonstrations of a generation effect in context memory
Marsh, E. J., Edelman, G., & Bower, G. H. (2001) · Memory & Cognition · doi:10.3758/bf03196409 · Cited by 67 · see citing works
Hefter, M. H., Berthold, K., Renkl, A., Riess, W., Schmid, S., & Fries, S. (2014) · Instructional Science · doi:10.1007/s11251-014-9320-y · Cited by 63 · see citing works
Self-citationHow to Foster Active Processing of Explanations in Instructional Communication
Berthold, K., & Renkl, A. (2010) · Educational Psychology Review · doi:10.1007/s10648-010-9124-9 · Cited by 59 · see citing works
Self-citationJudging the plausibility of arguments in scientific texts: a student–scientist comparison
von der Mühlen, S., Richter, T., Schmid, S., Schmidt, E. M., & Berthold, K. (2015) · Thinking & Reasoning · doi:10.1080/13546783.2015.1127289 · Cited by 56 · see citing works
Self-citationHefter, M. H., Renkl, A., Rieß, W., Schmid, S., Fries, S., & Berthold, K. (2015) · Learning and Instruction · doi:10.1016/j.learninstruc.2015.05.002 · Cited by 48 · see citing works
Self-citationPaxton, R. J. (1997) · Journal of Educational Psychology · doi:10.1037/0022-0663.89.2.235 · Cited by 48 · see citing works
Cognitive Flexibility and Epistemic Validation in Learning from Multiple Texts
Richter, T. (2011) · Springer eBooks · doi:10.1007/978-94-007-1793-0_7 · Cited by 44 · see citing works
Self-citationCognitive flexibility theory and its implications for designing CBI
Jonassen, D. H. (1992) · NATO ASI series. Series F : Computer and system sciences · doi:10.1007/978-3-662-02840-7_23 · Cited by 26 · see citing works
Melnick, A., & Merritt, J. E. (1972) · Cited by 24 · see citing works
Instructional Models in Computer-Based Learning Environments
Dijkstra, S., Krammer, H. P. M., & van Merriënboer, J. J. G. (1992) · NATO ASI series. Series F : Computer and system sciences · doi:10.1007/978-3-662-02840-7 · Cited by 20 · see citing works
Links between beliefs and cognitive flexibility : lessons learned
Elen, J. (2011) · Springer eBooks · doi:10.1007/978-94-007-1793-0 · Cited by 18 · see citing works
Renkl, A. (2009) · Springer-Lehrbuch · doi:10.1007/978-3-540-88573-3_1 · Cited by 17 · see citing works
NAEP 1994 U.S. History Report Card. Findings from the National Assessment of Educational Progress.
Beatty, A. (1996) · Cited by 16 · see citing works
Beyond decoding: Pictures of expository prose
Calfee, R. C., & Chambliss, M. J. (1988) · Annals of Dyslexia · doi:10.1007/bf02648259 · Cited by 14 · see citing works
Construction of Argument Representations During On-line Reading
Britt, M. A., & Larson, A. A. (2002) · PsycEXTRA Dataset · doi:10.1037/e413812005-097 · Cited by 5 · see citing works
Meemook, K., Nakajima, Y., Nakamura, M., Hussaini, A., & Kar, S. (2017) · Journal of the American College of Cardiology · doi:10.1016/s0735-1097(17)34516-3 · Cited by 1 · see citing works
von der Mühlen, S., Schmidt, E. M., Richter, T., Berthold, K., Schmid, S., & Bruns, K. (2014) · PUB – Publications at Bielefeld University (Bielefeld University) · Cited by 1 · see citing works
Self-citation
Flagged first, then by citations
3 of the 62 references couldn’t be matched to a known paper.
Research works printed but not linked: 3
- Amstad, T. (1978). Wie verständlich sind unsere Zeitungen? [How understandable are our newspapers?] (Unpublished doctoral dissertation). Zürich: University of Zürich.
- Freeman, A. M., Morris, P. B., Barnard, N., Esselstyn, C. B., Ros, E., Agatston, A., et al. (2017). Trend- ing cardiovascular nutrition controversies. Journal of the American College of Cardiology, 69, 1127-1187.
- Johnson-Laird, P. N. (1983). Mental models: Towards a cognitive science of language, inference and consciousness. Cambridge, MA: Harvard University Press.
Cited by
Sorted by citations
Managing uncertainty in scientific argumentation
Chen, Y., Benus, M. J., & Hernandez, J. (2019) · Science Education · doi:10.1002/sce.21527 · Cited by 146 · see citing works
Suwono, H., Marthaliakirana, A. D., Saefi, M., & Gofur, A. (2022) · Eurasia Journal of Mathematics Science and Technology Education · doi:10.29333/ejmste/12304 · Cited by 40 · see citing works
Wu, C., & Liu, C. (2021) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.17.010125 · Cited by 30 · see citing works
Casado-Ledesma, L., Cuevas, I., Van den Bergh, H., Rijlaarsdam, G., Mateos, M., Granado-Peinado, M., & Martín, E. (2021) · Instructional Science · doi:10.1007/s11251-021-09548-3 · Cited by 29 · see citing works
Chen, Y., Aguirre-Mendez, C., & Terada, T. (2020) · International Journal of Science Education · doi:10.1080/09500693.2020.1837990 · Cited by 20 · see citing works
Münchow, H., Tiffin‐Richards, S. P., Fleischmann, L., Pieschl, S., & Richter, T. (2023) · Zeitschrift für Erziehungswissenschaft · doi:10.1007/s11618-023-01147-x · Cited by 18 · see citing works
Self-citationLeung, J. S. C. (2020) · Instructional Science · doi:10.1007/s11251-020-09522-5 · Cited by 16 · see citing works
Klopp, E., & Stark, R. (2020) · Frontiers in Education · doi:10.3389/feduc.2020.00126 · Cited by 14 · see citing works
Learning about informal fallacies and the detection of fake news: An experimental intervention
Hruschka, T. M. J., & Appel, M. (2023) · PLoS ONE · doi:10.1371/journal.pone.0283238 · Cited by 16 · see citing works
Refined use of the eye-mind hypothesis for scientific argumentation using multiple representations
Wu, C., & Liu, C. (2022) · Instructional Science · doi:10.1007/s11251-022-09581-w · Cited by 16 · see citing works
Learning as an epistemic activity / El aprendizaje como actividad epistémica
Richter, T., & Tiffin‐Richards, S. P. (2024) · Journal for the Study of Education and Development Infancia y Aprendizaje · doi:10.1177/02103702231224633 · Cited by 10 · see citing works
Self-citationPalma-Jiménez, M., Robles, D. C., & López, Á. B. (2023) · Science & Education · doi:10.1007/s11191-023-00468-x · Cited by 10 · see citing works
Generating Causal Relations in Scientific Texts: The Long-Term Advantages of Successful Generation
Abel, R., & Hänze, M. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00199 · Cited by 10 · see citing works
Accessibility Evaluation of Video Games for Users with Cognitive Disabilities
Salvador-Ullauri, L., Acosta-Vargas, P., & Luján‐Mora, S. (2020) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-39512-4_130 · Cited by 10 · see citing works
What Does It Take to Deal with Academic Literature?
Münchow, H., Richter, T., & Schmid, S. (2020) · Springer eBooks · doi:10.1007/978-3-658-27886-1_12 · Cited by 8 · see citing works
Self-citationLeveraging generative AI to facilitate peer feedback in collaborative argumentation learning
Chang, Y., Liu, Q., Lu, Y., & Miao, E. (2026) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-026-00586-w · Cited by 4 · see citing works
Measuring university students’ ability to recognize argument structures and fallacies
Berkle, Y., Schmitt, L., Tolzin, A., Janson, A., Wambsganß, T., Leimeister, J. M., & Leuchter, M. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1270931 · Cited by 4 · see citing works
Lasting benefits of a web-based training in understanding informal arguments
Wertgen, A. G., Münchow, H., Richter, T., & Tiffin‐Richards, S. P. (2025) · European Journal of Psychology of Education · doi:10.1007/s10212-024-00930-6 · Cited by 4 · see citing works
Self-citationKlopp, E., & Stark, R. (2020) · Publications of the UdS (Saarland University) · doi:10.22028/d291-31793 · Cited by 3 · see citing works
Comprensión y producción de argumentación escrita en estudiantes de educación primaria
Freire, P., Larrain, A. S., Verdugo, S., Gómez, M., & Grau, V. (2020) · Cogency · doi:10.32995/cogency.v12i1.323 · Cited by 3 · see citing works
Çitçi, U. S., & PETEKÇİ, S. (2022) · Kafkas Üniversitesi İktisadi ve İdari Bilimler Fakültesi Dergisi · doi:10.36543/kauiibfd.2022.ozelsayi12 · Cited by 3 · see citing works
Plausible or problematic? Evaluating logical fallacies in a scientific text
Tiffin‐Richards, S. P., Münchow, H., & Richter, T. (2025) · Thinking & Reasoning · doi:10.1080/13546783.2025.2473353 · Cited by 2 · see citing works
Self-citationActivating argumentation schema to write argumentatively and tactfully
Liu, D., Gan, Q., & Ma, H. (2024) · Acta Psychologica · doi:10.1016/j.actpsy.2024.104256 · Cited by 2 · see citing works
Du, Y., & Gao, X. (2024) · Journal of English for Academic Purposes · doi:10.1016/j.jeap.2024.101433 · Cited by 2 · see citing works
Exploring Methodologies for Collecting High-Quality Implicit Reasoning in Arguments
Singh, K., Mim, F. S., Inoue, N., Naito, S., & Inui, K. (2021) · Workshop on Argument Mining (ArgMining) · doi:10.18653/v1/2021.argmining-1.6 · Cited by 2 · see citing works
Informelles Lernen im Internet
Abendroth, J., & Richter, T. (2023) · Springer eBooks · doi:10.1007/978-3-662-66608-1_10 · Cited by 1 · see citing works
Self-citationVivas, R. V. J., Meza, J. A. D., Castro-Castro, M. L., & Rueda, A. C. C. (2020) · Iberian Conference on Information Systems and Technologies (CISTI) · doi:10.23919/cisti49556.2020.9140963 · Cited by 1 · see citing works
A Comparative Study on Collecting High-Quality Implicit Reasonings at a Large-scalePreprint
Singh, K., Reisert, P., Inoue, N., & Inui, K. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.07924 · Cited by 1 · see citing works
Naovalia, R., Amin, M., & Suwono, H. (2021) · AIP conference proceedings · doi:10.1063/5.0043447
Klopp, E., & Stark, R. (2020) · doi:10.31234/osf.io/j6q9z
Kapshuk, Y., & Alt, D. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.882370 · Cited by 1 · see citing works
Salsabilah, S. T. (2021) · International Journal of English Linguistics Literature and Education (IJELLE) · doi:10.32585/ijelle.v3i2.1976
Vegas, R. A. M., & Gómez, M. S. (2023) · Texto Livre Linguagem e Tecnologia · doi:10.1590/1983-3652.2023.46444
Friberg‐Fernros, H., Lundmark, S., Theorin, N., Ahlbom, J., & Oscarsson, H. E. (2025) · Argumentation · doi:10.1007/s10503-025-09683-y
- Authors
- von der Mühlen, S., Richter, T., Schmid, S., & Berthold, K.
- Affiliations
- University of Würzburg (DE)
- University of Regensburg (DE)
- Bielefeld University (DE)
- Corresponding author
- Richter, Tobias
- Venue
- Instructional Science
- Published
- 2018-10-17
- Volume
- 47
- Issue
- 2
- Pages
- 215-237
- ISSN
- 0020-4277 (ISSN-L)
- 1573-1952
- OpenAlex
- W2888462774
- Cited by
- 34
- References
- 62
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 3 · 2023: 6 · 2022: 4 · 2021: 6 · 2020: 9 · 2019: 2
- FWCI
- 13.78
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Instructional Science (publishedVersion, cc-by)
- University of Regensburg Publication Server (University of Regensburg) (submittedVersion)
- PUB – Publications at Bielefeld University (Bielefeld University) (submittedVersion)
- Funders
- Bundesministerium für Bildung und Forschung (01PK15009B, 01PK11017B)
- Topics
- Social Sciences › Education › Science Education and Pedagogy
- Social Sciences › Psychology › Developmental and Educational Psychology › Educational Strategies and Epistemologies
- Social Sciences › Education › Education and Critical Thinking Development
- Keywords
- Toulmin model, argument structure, constructivist learning, scientific literacy, university students, individual differences in learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review