Improving analytical reasoning and argument understanding: a quasi-experimental field study of argument visualization
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
The ability to analyze arguments is critical for higher-level reasoning, yet previous research suggests that standard university education provides only modest improvements in students’ analytical-reasoning abilities. What pedagogical approaches are most effective for cultivating these skills? We investigated the effectiveness of a 12-week undergraduate seminar in which students practiced a software-based technique for visualizing the logical structures implicit in argumentative texts. Seminar students met weekly to analyze excerpts from contemporary analytic philosophy papers, completed argument visualization problem sets, and received individualized feedback on a weekly basis. We found that seminar students improved substantially more on LSAT Logical Reasoning test forms than did control students (d = 0.71, 95% CI: [0.37, 1.04], p < 0.001), suggesting that learning how to visualize arguments in the seminar led to large generalized improvements in students’ analytical-reasoning skills. Moreover, blind scoring of final essays from seminar students and control students, drawn from a parallel lecture course, revealed large differences in favor of seminar students (d = 0.87, 95% CI: [0.26, 1.48], p = 0.005). Seminar students understood the arguments better, and their essays were more accurate and effectively structured. Taken together, these findings deepen our understanding of how visualizations support logical reasoning and provide a model for improving analytical-reasoning pedagogy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
What attributes guide the deployment of visual attention and how do they do it?
Wolfe, J. M., & Horowitz, T. S. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1411 · Cited by 1,766
Does discovery-based instruction enhance learning?
Alfieri, L., Brooks, P. J., Aldrich, N. J., & Tenenbaum, H. R. (2011) · Journal of Educational Psychology · doi:10.1037/a0021017 · Cited by 1,338
Question Asking During Tutoring
Graesser, A. C., & Person, N. K. (1994) · American Educational Research Journal · doi:10.3102/00028312031001104 · Cited by 900
Aleven, V. A. W. M. M., & Koedinger, K. R. (2002) · Cognitive Science · doi:10.1207/s15516709cog2602_1 · Cited by 895
Schwartz, D. L., & Martin, T. (2004) · Cognition and Instruction · doi:10.1207/s1532690xci2202_1 · Cited by 763
Eliciting Self‐Explanations Improves Understanding
Chi, M. T. H., De Leeuw, N., Chiu, M., & Lavancher, C. (1994) · Cognitive Science · doi:10.1207/s15516709cog1803_3 · Cited by 757
The Emergence of Abstract Representations in Dyad Problem Solving
Schwartz, D. L. (1995) · Journal of the Learning Sciences · doi:10.1207/s15327809jls0403_3 · Cited by 410
Liu, O. L., Frankel, L., & Roohr, K. C. (2014) · ETS Research Report Series · doi:10.1002/ets2.12009 · Cited by 340
Creating visual explanations improves learning
Bobek, E., & Tversky, B. (2016) · Cognitive Research: Principles and Implications · doi:10.1186/s41235-016-0031-6 · Cited by 298
Cited by
A call to action for librarians: Countering conspiracy theories in the age of QAnon
Beene, S., & Greer, K. (2021) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2020.102292 · Cited by 28
“One reason for this may be that education provides only modest training in analytical reasoning (Cullen et al., 2018).”
Representational transformations: Using maps to write essays
Binks, A., Toniolo, A., & Nacenta, M. A. (2022) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2022.102851 · Cited by 12
“This existing work on essay-writing has largely focused on how diagram use affects essay outcomes (Cullen et al., 2018; Easterday et al., 2009; van den Braak et al., 2008).”
BackgroundChapter 1: Problem-based learning: A 21st-century teaching and learning strategy
Research Unit Self-Directed Learning, F. O. E., Golightly, A., Sebatana, M. J., & School of Mathematics, S. A. T. E. (2023) · NWU Self-Directed Learning Series · doi:10.4102/aosis.2023.bk409.01 · Cited by 1
Metadata
- Authors
- Cullen, S., Fan, J., van der Brugge, E., & Elga, A.
- Venue
- npj Science of Learning
- Published
- 2018-12-04
- Volume
- 3
- Issue
- 1
- Pages
- 21-21
- ISSN
- 2056-7936 (ISSN-L)
- OpenAlex
- W2901463152
- Cited by
- 55
- References
- 9
- FWCI
- 12.17
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Improving analytical reasoning and argument understanding: a quasi-experimental field study of argument visualization. https://app.cochat.ai/papers/10.1038/s41539-018-0038-5
- The paper
- Cullen, S., Fan, J., van der Brugge, E., & Elga, A. (2018). Improving analytical reasoning and argument understanding: a quasi-experimental field study of argument visualization. npj Science of Learning. https://doi.org/10.1038/s41539-018-0038-5
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.