Strategy Uptake in Writing Pal: Adaptive Feedback and Instruction
The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
The present study examined the extent to which adaptive feedback and just-in-time writing strategy instruction improved the quality of high school students’ persuasive essays in the context of the Writing Pal (W-Pal). W-Pal is a technology-based writing tool that integrates automated writing evaluation into an intelligent tutoring system. Students wrote a pretest essay, engaged with W-Pal’s adaptive instruction over the course of four training sessions, and then completed a posttest essay. For each training session, W-Pal differentiated strategy instruction for each student based on specific weaknesses in the initial training essays prior to providing the opportunity to revise. The results indicated that essay quality improved overall from pretest to posttest with respect to holistic quality, as well as several specific dimensions of essay quality, particularly for students with lower literacy skills. Moreover, students’ scores on some of the training essays improved from the initial to revised version on the dimensions of essay quality that were targeted by instruction, whereas scores did not improve on the dimensions that were not targeted by instruction. Overall, the results suggest that W-Pal’s adaptive strategy instruction can improve the quality of students’ essays overall, as well as more specific dimensions of essay quality.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Formative feedback positively impacts students' writing (Anderson & Ayaawan, 2023;Butterfuss et al., 2022Huisman et al., 2019).”
From Impact of ChatGPT on ESL students’ academic writing skills: a mixed methods intervention study (2024) · cites this paper as Butterfuss et al., 2022
In the citing paper
“Natural language processing techniques analyze written responses to provide personalized cognitive support for improving skills, such as argumentation (Butterfuss et al., 2022;Zhu et al., 2020).”
From Looking Beyond the Hype: Understanding the Effects of AI on Learning (2025) · cites this paper as Butterfuss et al., 2022
Citations
Cites
The role of deliberate practice in the acquisition of expert performance
Ericsson, K. A., Krampe, R. T., & Tesch-Römer, C. (1993) · Psychological Review · doi:10.1037/0033-295x.100.3.363 · Cited by 9,564
Shute, V. J. (2008) · Review of Educational Research · doi:10.3102/0034654307313795 · Cited by 4,631 · cited 2×
“Existing evidence suggests that AWEs are effective when they provide opportunities for practice along with formative feedback that aligns with classroom instruction, which allows each student to receive support without additional strain on teachers’ time and resources (Roscoe et al., 2011, 2013; Shute, 2008).”
BackgroundThe development of student feedback literacy: Enabling uptake of feedback
Carless, D., & Boud, D. (2018) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2018.1463354 · Cited by 2,428 · cited 1×
“…limitations of this study, it is critical to emphasize the importance of these results given the frequent lack of uptake of feedback on students’ essays (e.g., Carless & Boud, 2018), and the vital importance of providing students with just-in-time instruction that focuses on their individual needs.”
BackgroundMacArthur, C. A., Graham, S. W., & Fitzgerald, J. (2005) · Cited by 2,327
VanLEHN, K. (2011) · Educational Psychologist · doi:10.1080/00461520.2011.611369 · Cited by 2,323 · cited 1×
“ITSs that include adaptive instruction demonstrate notable learning effects (d¼�0.75; VanLehn, 2011) over those that do not.”
BackgroundInfluentialA meta-analysis of writing instruction for adolescent students
Graham, S., & Perin, D. (2007) · Journal of Educational Psychology · doi:10.1037/0022-0663.99.3.445 · Cited by 1,609 · cited 1×
“…with high-quality individualized feedback, instruction, and opportunities for extended practice, all of which are necessary for skill building in general (Ericsson et al., 1993), as well as for development of writing skills (Graham & Perin, 2007; Johnstone et al., 2002; Kellogg & Raulerson, 2007).”
BackgroundA cognitive process theory of writing
Flower, L., & Hayes, J. R. (1981) · College Composition & Communication · doi:10.58680/ccc198115885 · Cited by 1,025 · cited 1×
“…nature of writing, which requires students to coordinate several cognitive skills and knowledge sources through multiple demanding processes including setting goals, solving problems, and strategically managing cognitive resources (Allen et al., 2016; Flower & Hayes, 1981; Hayes, 1996).”
BackgroundTeaching writing to high school students: A national survey.
Kiuhara, S. A., Graham, S., & Hawken, L. S. (2009) · Journal of Educational Psychology · doi:10.1037/a0013097 · Cited by 396 · cited 2×
“…students do not receive sufficient writing instruction (Graham et al., 2014), in part because many instructors feel underprepared to teach writing (Kiuhara et al., 2009) and are often limited in their capacity to provide opportunities for writing practice along with targeted, individualized…”
BackgroundLinguistic features in writing quality and development: An overview
Crossley, S. (2020) · Journal of Writing Research · doi:10.17239/jowr-2020.11.03.01 · Cited by 310 · cited 1×
“Students’ needs may also vary across essays, as students may show patterns of strengths and weaknesses that differ across various essay prompts (Allen et al., 2016, 2019; Crossley, 2020).”
BackgroundThe Effects of Writing on Learning in Science, Social Studies, and Mathematics: A Meta-Analysis
Graham, S., Kiuhara, S. A., & MacKay, M. (2020) · Review of Educational Research · doi:10.3102/0034654320914744 · Cited by 292
Improving the writing skills of college students
Kellogg, R. T., & Raulerson, B. A. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194058 · Cited by 270 · cited 1×
“…with high-quality individualized feedback, instruction, and opportunities for extended practice, all of which are necessary for skill building in general (Ericsson et al., 1993), as well as for development of writing skills (Graham & Perin, 2007; Johnstone et al., 2002; Kellogg & Raulerson, 2007).”
BackgroundTraining Advanced Writing Skills: The Case for Deliberate Practice
KELLOGG, R. T., & WHITEFORD, A. P. (2009) · Educational Psychologist · doi:10.1080/00461520903213600 · Cited by 257 · cited 1×
“When students can successfully leverage these skills over the course of prewriting, drafting, and revising, then the end product is more likely to be a relatively high-quality essay (Flower & Hayes, 1980; Kellogg & Whiteford, 2009).”
BackgroundCrossley, S. A., Kyle, K., & McNamara, D. S. (2016) · Journal of Second Language Writing · doi:10.1016/j.jslw.2016.01.003 · Cited by 235 · cited 6×
“, W-Pal’s integration of AWE and intelligent tutoring) have been described in existing work (Crossley et al., 2016; Dai et al., 2010; Roscoe et al., 2014).”
BackgroundMethodSelf-citationTeaching writing to middle school students: a national survey
Graham, S., Capizzi, A., Harris, K. R., Hebert, M., & Morphy, P. (2014) · Reading and Writing · doi:10.1007/s11145-013-9495-7 · Cited by 211 · cited 1×
“In general, students do not receive sufficient writing instruction (Graham et al., 2014), in part because many instructors feel underprepared to teach writing (Kiuhara et al.”
BackgroundTaub, M., Sawyer, R., Smith, A., Rowe, J., Azevedo, R., & Lester, J. (2020) · Computers & Education · doi:10.1016/j.compedu.2019.103781 · Cited by 207 · cited 1×
“Specifically, each lesson is connected to gamebased practice activities that help students to practice the strategy while also fostering engagement (Shank & Neeman, 2001; Taub et al., 2020) while students apply the writing strategies and reinforce the strategy knowledge acquired from W-Pal.”
BackgroundNatural language processing in an intelligent writing strategy tutoring system
McNamara, D. S., Crossley, S. A., & Roscoe, R. (2013) · Behavior Research Methods · doi:10.3758/s13428-012-0258-1 · Cited by 202 · cited 1×
“, 2016 ) to assess the student’s essay for content, rhetorical style, text cohesion, and language sophistication (McNamara et al., 2013) and assign an overall quality rating from poor to great on a six-point scale.”
BackgroundSelf-citationIndividual differences in undergraduate essay-writing strategies: A longitudinal study
Torrance, M., Thomas, G. V., & Robinson, E. J. (2000) · Higher Education · doi:10.1023/a:1003990432398 · Cited by 159 · cited 1×
“These strengths and weaknesses can also change over the course of writing practice, feedback, and instruction (Kieft et al., 2007; Torrance et al., 2000).”
BackgroundCrossley, S. A., Roscoe, R. D., & McNamara, D. S. (2014) · Written Communication · doi:10.1177/0741088314526354 · Cited by 155 · cited 2×
“Successful essays and successful writers do not necessarily share the same linguistic attributes or characteristics as there are many ways to write a good essay and multiple profiles of successful writers (Crossley et al., 2014).”
BackgroundSelf-citationRelative reading achievement: A longitudinal study of 187 children from first through sixth grades.
Phillips, L. M., Norris, S. P., Osmond, W. C., & Maynard, A. M. (2002) · Journal of Educational Psychology · doi:10.1037//0022-0663.94.1.3 · Cited by 155
The Writing Pal Intelligent Tutoring System: Usability Testing and Development
Roscoe, R. D., Allen, L. K., Weston, J. L., Crossley, S. A., & McNamara, D. S. (2014) · Computers & composition/Computers and composition · doi:10.1016/j.compcom.2014.09.002 · Cited by 153 · cited 3×
“W-Pal has demonstrated effectiveness for improving high school and college students’ strategy knowledge and writing performance (e.g., Crossley et al., 2016; Roscoe et al., 2013, 2014, 2015; Roscoe & McNamara, 2013).”
BackgroundSelf-citationLin, T. Y. (2002) · Educational Technology & Society · Cited by 149
Writing pal: Feasibility of an intelligent writing strategy tutor in the high school classroom.
Roscoe, R. D., & McNamara, D. S. (2013) · Journal of Educational Psychology · doi:10.1037/a0032340 · Cited by 144 · cited 6×
“One such tool is the Writing Pal (W-Pal; Roscoe & McNamara, 2013), which provides writing strategy instruction, extended practice, and immediate formative feedback.”
BackgroundMethodSelf-citationThe impact of formative feedback on the development of academic writing
Wingate, U. (2010) · Assessment & Evaluation in Higher Education · doi:10.1080/02602930903512909 · Cited by 143 · cited 1×
“Some students simply ignore feedback messages and fail to adapt their writing (Wingate, 2010).”
BackgroundRanalli, J., Link, S., & Chukharev-Hudilainen, E. (2017) · Educational Psychology · doi:10.1080/01443410.2015.1136407 · Cited by 129 · cited 1×
“AWE systems leverage natural language processing tools to evaluate student writing across several dimensions and provide feedback to students (Crossley et al., 2013; Grimes & Warschauer, 2010; Ranalli et al., 2017).”
BackgroundEffects of repeated practice and contextual-writing experiences on college students' writing skills.
Johnstone, K. M., Ashbaugh, H., & Warfield, T. D. (2002) · Journal of Educational Psychology · doi:10.1037/0022-0663.94.2.305 · Cited by 125 · cited 1×
“…with high-quality individualized feedback, instruction, and opportunities for extended practice, all of which are necessary for skill building in general (Ericsson et al., 1993), as well as for development of writing skills (Graham & Perin, 2007; Johnstone et al., 2002; Kellogg & Raulerson, 2007).”
BackgroundDempsey, M. S., PytlikZillig, L. M., & Bruning, R. H. (2009) · Assessing Writing · doi:10.1016/j.asw.2008.12.003 · Cited by 107 · cited 1×
“Thus, students may benefit from instruction and feedback that target their specific needs (Dempsey et al., 2009; Ericsson et al., 1993).”
BackgroundWriting in the Secondary-Level Disciplines: a Systematic Review of Context, Cognition, and Content
Miller, D. M., Scott, C. E., & McTigue, E. M. (2016) · Educational Psychology Review · doi:10.1007/s10648-016-9393-z · Cited by 101
Applied Natural Language Processing: Identification, Investigation and Resolution
Hassel, M., & Dalianis, H. (2011) · IGI Global eBooks · doi:10.4018/978-1-60960-741-8 · Cited by 77
The effects of adapting a writing course to students' writing strategies
Kieft, M., Rijlaarsdam, G., Galbraith, D., & van den Bergh, H. (2007) · British Journal of Educational Psychology · doi:10.1348/096317906x120231 · Cited by 72 · cited 1×
“These strengths and weaknesses can also change over the course of writing practice, feedback, and instruction (Kieft et al., 2007; Torrance et al., 2000).”
BackgroundWriting flexibility in argumentative essays: a multidimensional analysis
Allen, L. K., Likens, A. D., & McNamara, D. S. (2018) · Reading and Writing · doi:10.1007/s11145-018-9921-y · Cited by 57
Self-citationCrossley, S. A., Varner, L. K., Roscoe, R. D., & McNamara, D. S. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39112-5_28 · Cited by 43 · cited 2×
“W-Pal incorporates elements of an ITS along with AWE to improve high school and college students’ writing performance in the context of persuasive essays (e.g., Crossley et al., 2013; Roscoe & McNamara, 2013).”
BackgroundMethodSelf-citationDeveloping pedagogically-guided algorithms for intelligent writing feedback
Roscoe, R. D., Varner, L. K., Crossley, S. A., & McNamara, D. S. (2013) · International Journal of Learning Technology · doi:10.1504/ijlt.2013.059131 · Cited by 40 · cited 2×
“W-Pal has demonstrated effectiveness for improving high school and college students’ strategy knowledge and writing performance (e.g., Crossley et al., 2016; Roscoe et al., 2013, 2014, 2015; Roscoe & McNamara, 2013).”
BackgroundSelf-citationAutomated analysis of essays and open-ended verbal responses.
Graesser, A. C., & McNamara, D. S. (2012) · American Psychological Association eBooks · doi:10.1037/13619-017 · Cited by 39 · cited 3×
“When students submit training essays during their practice sessions, W-Pal’s AWE system uses several text analysis tools (e.g., Coh-Metrix; Graesser & McNamara, 2012; Tool for the Automatic Analysis of Cohesion [TAACO], Crossley et al., 2016 ) to assess the student’s essay for content, rhetorical…”
MethodSelf-citationWriting and Writing Difficulties From Primary Grades to College: Introduction to the Special Issue
Graham, S., & Hall, T. E. (2015) · Learning Disability Quarterly · doi:10.1177/0731948715592154 · Cited by 27
Contrasting Writing Practice Formats in a Writing Strategy Tutoring System
Roscoe, R. D., Allen, L. K., & McNamara, D. S. (2018) · Journal of Educational Computing Research · doi:10.1177/0735633118763429 · Cited by 23 · cited 1×
“, 2014), with less skilled students showing greater gains than skilled students (Roscoe et al., 2019).”
BackgroundSelf-citationJournal of Engineering and Computer Innovations
(2023) · Journal of Engineering and Computer Innovations · doi:10.5897/jeci · Cited by 9
Research works printed but not linked: 10
- Allen L. K., 2014, Topics in Cognitive Psychology, 114, 663
- Flower L. S., 1980, College Composition and Communication, 23, 2
- Grimes D., 2010, Journal of Technology, Learning, and Assessment, 8, 4
- Hayes J. R., 1996, The science of writing: Theories, methods, individual differences, and applications, 1
- MacGinitie W. H., 1989, Gates–MacGinitie reading tests
- National Commission on Writing, 2004, Writing: A ticket to work. Or a ticket out
- 10.1037/0022-0663.94.1.3 · doi:10.1037/0022-0663.94.1.3 · Paper page
- Roscoe R. D., 2015, Technology, Instruction, Cognition, and Learning, 10, 59
- Roscoe R. D., 2011, Proceedings of the 24th international Florida artificial intelligence research society (FLAIRS) conference, 543
- VanLehn K., 2006, International Journal of Artificial Intelligence and Education, 16, 227
Cited by
Impact of ChatGPT on ESL students’ academic writing skills: a mixed methods intervention study
Mahapatra, S. (2024) · Smart Learning Environments · doi:10.1186/s40561-024-00295-9 · Cited by 398
Looking Beyond the Hype: Understanding the Effects of AI on Learning
Bauer, E., Greiff, S., Graesser, A. C., Scheiter, K., & Sailer, M. (2025) · Educational Psychology Review · doi:10.1007/s10648-025-10020-8 · Cited by 153
“Natural language processing techniques analyze written responses to provide personalized cognitive support for improving skills, such as argumentation (Butterfuss et al., 2022; Zhu et al., 2020).”
Evaluating AI's impact on self-regulated language learning: A systematic review
Chang, W.-L., & Sun, J. C. (2024) · System · doi:10.1016/j.system.2024.103484 · Cited by 165
Bauer, E., Sailer, M., Niklas, F., Greiff, S., Sarbu‐Rothsching, S., Zottmann, J., Kiesewetter, J., Stadler, M. J., Fischer, M. R., Seidel, T., et al. (2025) · Journal of Computer Assisted Learning · doi:10.1111/jcal.13123 · Cited by 72
Woo, D. J., Wang, Y., Susanto, H., & Guo, K. (2023) · Journal of Educational Computing Research · doi:10.1177/07356331231175999 · Cited by 44
“Besides, students may not receive suf fi cient writing instruction and feedback from teachers in a classroom context (Butterfuss et al., 2022).”
Background
Metadata
- Authors
- Butterfuss, R., Roscoe, R. D., Allen, L. K., McCarthy, K. S., & McNamara, D. S.
- Affiliations
- Arizona State University (US)
- University of New Hampshire (US)
- Georgia State University (US)
- Corresponding author
- Butterfuss, Reese
- Venue
- Journal of Educational Computing Research
- Publisher
- SAGE Publications
- Published
- 2022-05-08
- Volume
- 60
- Issue
- 3
- Pages
- 696-721
- ISSN
- 0735-6331 (ISSN-L)
- 1541-4140
- OpenAlex
- W4229373826
- Semantic Scholar
- 6c76809318bfb1aa6d2a4be6a639826dcdcada65
- Cited by
- 34
- References
- 36
- Citations by year
- 2026: 3 · 2025: 8 · 2024: 15 · 2023: 7 · 2022: 1
- FWCI
- 2.55
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Educational Computing Research (publishedVersion)
- Funders
- Office of Naval Research (N00014-17-1-2300, N00014-19-1-2424)
- Institute of Education Sciences (R305A180144, R305A180261, R305A190063)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Social Sciences › Education › Writing and Handwriting Education
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Keywords
- adaptive instruction, adaptive feedback, persuasive essay writing, intelligent tutoring systems, automated writing evaluation, essay quality, high school students, literacy skills, personalized learning, essay revision
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.