Writing pal: Feasibility of an intelligent writing strategy tutor in the high school classroom.
The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
The Writing Pal (W-Pal) is a novel intelligent tutoring system (ITS) that offers writing strategy instruction, game-based practice, essay writing practice, and formative feedback to developing writers. Compared to more tractable and constrained learning domains for ITS, writing is an ill-defined domain because the features of effective writing are difficult to quantify and individual writers can employ diverse strategies to achieve similar goals. The development of an ITS in an ill-defined domain presents particular challenges regarding comprehensive instruction, modularized content, extended practice, and formative feedback. In this article, we describe how the development of W-Pal has uniquely addressed these concerns and present the results of a study assessing the feasibility of this system in high school English classrooms. This study included 2 teachers and their 141 10th grade English class students who utilized W-Pal over a 6-month period during the academic year. Log-file analyses showed that students used all aspects of W-Pal, but activity and engagement was uneven throughout the year and decreased over time. Essay scores improved over time and surveys indicated that students perceived the lessons, games, and feedback as beneficial. However, specific aspects of the learning environment were critiqued as annoying, challenging, or lacking specificity. Overall, the results suggest that the system was generally well-received by the students but also offer insights for the development of ITSs in ill-defined domains.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Shute, V. J. (2008) · Review of Educational Research · doi:10.3102/0034654307313795 · Cited by 4,631 · cited 1×
“Research has emphasized the importance individualized, formative feedback that describes clear methods for improvement (McGarrell & Verbeem, 2007; Shute, 2008), such as strategies for developing arguments and evidence.”
The structure of ill structured problems
Simon, H. A. (1973) · Artificial Intelligence · doi:10.1016/0004-3702(73)90011-8 · Cited by 2,600 · cited 1×
“Ill-structured problems possess ambiguous goals, solution paths, or assessment criteria (Simon, 1973).”
BackgroundA meta-analysis of writing instruction for adolescent students
Graham, S., & Perin, D. (2007) · Journal of Educational Psychology · doi:10.1037/0022-0663.99.3.445 · Cited by 1,609
Aleven, V. A. W. M. M., & Koedinger, K. R. (2002) · Cognitive Science · doi:10.1207/s15516709cog2602_1 · Cited by 895
Affect and learning: An exploratory look into the role of affect in learning with AutoTutor
Craig, S., Graesser, A., Sullins, J., & Gholson, B. (2004) · Journal of Educational Media · doi:10.1080/1358165042000283101 · Cited by 630
Linguistic Features of Writing Quality
McNamara, D. S., Crossley, S. A., & McCarthy, P. M. (2010) · Written Communication · doi:10.1177/0741088309351547 · Cited by 570
Self-citationAutomated Writing Assessment in the Classroom
Warschauer, M., & Grimes, D. (2008) · Pedagogies: An International Journal · doi:10.1080/15544800701771580 · Cited by 243
Crossley, S. A., & McNamara, D. S. (2011) · International Journal of Continuing Engineering Education and Life-Long Learning · doi:10.1504/ijceell.2011.040197 · Cited by 103
Self-citation
Cited by
Explainable Artificial Intelligence in education
Khosravi, H., Shum, S. B., Chen, G., Conati, C., Tsai, Y.-S., Kay, J., Knight, S., Martinez-Maldonado, R., Sadiq, S., & Gašević, D. (2022) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100074 · Cited by 863
AutoTutor and Family: A Review of 17 Years of Natural Language Tutoring
Nye, B. D., Graesser, A. C., & Hu, X. (2014) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-014-0029-5 · Cited by 286
Automated Writing Evaluation and Feedback: Multiple Metrics of Efficacy
Wilson, J., & Roscoe, R. D. (2020) · Journal of Educational Computing Research · doi:10.1177/0735633119830764 · Cited by 176
Self-citationAcaWriter: A learning analytics tool for formative feedback on academic writing
Knight, S., Shibani, A., Abel, S., Gibson, A., & Ryan, P. (2020) · Journal of Writing Research · doi:10.17239/jowr-2020.12.01.06 · Cited by 151
Wilson, J., Ahrendt, C., Fudge, E. A., Raiche, A., Beard, G., & MacArthur, C. (2021) · Computers & Education · doi:10.1016/j.compedu.2021.104208 · Cited by 118
Metadata
- Authors
- Roscoe, R. D., & McNamara, D. S.
- Venue
- Journal of Educational Psychology
- Published
- 2013-11
- Volume
- 105
- Issue
- 4
- Pages
- 1010-1025
- ISSN
- 0022-0663 (ISSN-L)
- 1939-2176
- OpenAlex
- W2320732612
- Cited by
- 144
- References
- 8
- FWCI
- 10.31
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.