The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
An Exploratory Study of Argumentative Writing by Young Students: A transformer-based Approach
Open accessAbstract
We present a computational exploration of argument critique writing by young students.Middle school students were asked to criticize an argument presented in the prompt, focusing on identifying and explaining the reasoning flaws.This task resembles an established college-level argument critique task.Lexical and discourse features that utilize detailed domain knowledge to identify critiques exist for the college task but do not perform well on the young students data.Instead, transformerbased architecture (e.g., BERT) fine-tuned on a large corpus of critique essays from the college task performs much better (over 20% improvement in F1 score).Analysis of the performance of various configurations of the system suggests that while children's writing does not exhibit the standard discourse structure of an argumentative essay, it does share basic local sequential structures with the more mature writers.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Similar performances were observed in classifying students' argumentative essays (best F1 = 0.66).
“Similar performances were also observed in classifying students' argumentative essays (best F1 = 0.66) (Ghosh et al., 2020).”
From Practical and ethical challenges of large language models in education: A systematic scoping review (2024) · cites this paper as Ghosh et al., 2020
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Argumentation Schemes for Presumptive Reasoning
Walton, D. (2013) · Routledge eBooks · doi:10.4324/9780203811160 · Cited by 998
AUTOMATED ESSAY SCORING WITH E‐RATER® V.2.0
Attali, Y., & Burstein, J. C. (2004) · ETS Research Report Series · doi:10.1002/j.2333-8504.2004.tb01972.x · Cited by 641
Parsing Argumentation Structures in Persuasive Essays
Stab, C., & Gurevych, I. (2017) · Computational Linguistics · doi:10.1162/coli_a_00295 · Cited by 471
Habernal, I., & Gurevych, I. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1150 · Cited by 205
TOEFL11: A CORPUS OF NON‐NATIVE ENGLISH
Blanchard, D., Tetreault, J., Higgins, D., Cahill, A., & Chodorow, M. S. (2013) · ETS Research Report Series · doi:10.1002/j.2333-8504.2013.tb02331.x · Cited by 205
Finding the WRITE stuff: automatic identification of discourse structure in student essays
Burstein, J. C., Marcu, D., & Knight, K. D. (2003) · IEEE Intelligent Systems · doi:10.1109/mis.2003.1179191 · Cited by 190
Classification and Clustering of Arguments with Contextualized Word Embeddings
Reimers, N., Schiller, B., Beck, T., Daxenberger, J., Stab, C., & Gurevych, I. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1054 · Cited by 157
Modeling Argument Strength in Student Essays
Persing, I., & Ng, V. (2015) · doi:10.3115/v1/p15-1053 · Cited by 150
End-to-End Argumentation Mining in Student Essays
Persing, I., & Ng, V. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1164 · Cited by 118
AMPERSAND: Argument Mining for PERSuAsive oNline Discussions
Chakrabarty, T., Hidey, C., Muresan, S., McKeown, K., & Hwang, A. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1291 · Cited by 103
Argument Mining for Improving the Automated Scoring of Persuasive Essays
Nguyen, H. V., & Litman, D. J. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12046 · Cited by 84
Modeling Prompt Adherence in Student Essays
Persing, I., & Ng, V. (2014) · Annual Meeting of the Association for Computational Linguistics (ACL) · doi:10.3115/v1/p14-1144 · Cited by 81
Coarse-grained Argumentation Features for Scoring Persuasive Essays
Ghosh, D., Khanam, A., Han, Y., & Muresan, S. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-2089 · Cited by 71
Self-citationContext-aware Argumentative Relation Mining
Nguyen, H. V., & Litman, D. J. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1107 · Cited by 69
Recognizing Insufficiently Supported Arguments in Argumentative Essays
Stab, C., & Gurevych, I. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-1092 · Cited by 63
Scoring Persuasive Essays Using Opinions and their Targets
Farra, N., Somasundaran, S., & Burstein, J. C. (2015) · Workshop on Innovative Use of NLP for Building Educational Applications · doi:10.3115/v1/w15-0608 · Cited by 58
Parsing Argumentation Structures in Persuasive EssaysPreprint
Stab, C., & Gurevych, I. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.07370 · Cited by 57
Attali, Y., & Powers, D. (2008) · ETS Research Report Series · doi:10.1002/j.2333-8504.2008.tb02105.x · Cited by 41
Deane, P. (2014) · ETS Research Report Series · doi:10.1002/ets2.12002 · Cited by 40
The Developmental Writing Scale
Sturm, J. M., Cali, K. S., Nelson, N. W., & Staskowski, M. (2012) · Topics in Language Disorders · doi:10.1097/tld.0b013e318272159e · Cited by 21
Yi, S., Deane, P., & Fowles, M. E. (2017) · ETS Research Report Series · doi:10.1002/ets2.12166 · Cited by 12
Detecting Good Arguments in a Non-Topic-Specific Way: An Oxymoron?
Klebanov, B. B., Gyawali, B., & Yi, S. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-2038 · Cited by 6
Flagged first, then by citations
Cited by
Sorted by citations
Practical and ethical challenges of large language models in education: A systematic scoping review
Yan, L., Sha, L., Zhao, L., Li, Y., Martinez‐Maldonado, R., Chen, G., Li, X., Jin, Y., & Gašević, D. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13370 · Cited by 1,435
“Similar performances were also observed in classifying students’ argumentative essays (best F1 = 0.66) (Ghosh et al., 2020).”
ResultInfluentialLottridge, S. M., Woolf, S., Young, M., Jafari, A., & Ormerod, C. (2023) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12784 · Cited by 11
Automated evaluation of the quality of ideas in compositions based on concept maps
Yang, L., Xin, T., Luo, F., Zhang, S., & Tian, X. (2021) · Natural Language Engineering · doi:10.1017/s1351324921000103 · Cited by 8
"Sharks are not the threat humans are": Argument Component Segmentation in School Student EssaysPreprint
Alhindi, T., & Ghosh, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.04518 · Cited by 9
Self-citationTHE STATE OF THE ART IN PROVIDING AUTOMATED FEEDBACK TO OPEN-ENDED STUDENT WORK
Larrondo, P., Frank, B. M., & Ortíz, J. M. (2021) · Proceedings of the Canadian Engineering Education Association (CEEA) · doi:10.24908/pceea.vi0.14854 · Cited by 3
Learning from Auxiliary Sources in Argumentative Revision Classification
Afrin, T., & Litman, D. J. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-36336-8_42
Metadata
- Authors
- Ghosh, D., Beigman Klebanov, B., & Song, Y.
- Affiliations
- Educational Testing Service (US)
- ORCID
- Ghosh, Debanjan
- Venue
- Proceedings of the Fifteenth Workshop on Innovative Use of NLP for Building Educational Applications
- Published
- 2020
- Pages
- 145-150
- OpenAlex
- W3037122148
- Cited by
- 6
- References
- 25
- Citations by year
- 2023: 3 · 2021: 3
- FWCI
- 0.57
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Workshop on Innovative Use of NLP for Building Educational Applications (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Keywords
- argumentative writing, younger schoolchildren, junior high school students, transformer models, BERT fine-tuning, children's writing, discourse structure, argumentative essay structure, automated writing evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
