The automated writing assistance landscape in 2021
Open accessAbstract
Abstract Automated writing assistance – a category that encompasses a variety of computer-based tools that help with writing – has been around in one form or another for 60 years, although it’s always been a relatively minor part of the NLP landscape. But the category has been given a substantial boost from recent advances in deep learning. We review some history, look at where things stand today, and consider where things might be going.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
It is highly likely that LLMs will be integrated more deeply into suites of products that are often provided to students by HEIs in the future.
“it is highly likely that LLMs will be integrated more deeply into suites of products that are often provided to students by HEIs in the future”
From Academic Integrity considerations of AI Large Language Models in the post-pandemic era: ChatGPT and beyond (2023) · cites this paper as Dale & Viethen, 2021
In the concluding “Copy Shark” passage (page unavailable), the paper predicts that GPT-3-based writing capabilities may soon appear in Microsoft Word. That supports future LLM integration into a widely used product, but the paper does not say that such integration is highly likely across product suites provided to students by higher education institutions. (LLM, conf=0.86)
Experimental — accuracy not yet measuredLLMs will generally always provide an answer or output, even if that is factually incorrect or misinterpreted.
“Although one concern levied against LLMs is that they will generally always provide an answer or output, even if that is factually incorrect or misinterpreted (Dale, 2021; Hutson, 2022)”
From Academic Integrity considerations of AI Large Language Models in the post-pandemic era: ChatGPT and beyond (2023) · cites this paper as Dale, 2021
Section 3.3, “From editor to author” (page unavailable), says GPT-3 can generate convincing text that is sometimes nonsense, supporting the concern that an output can be unreliable. It does not say LLMs generally always provide an answer, or specifically discuss factual errors or misinterpretation. (LLM, conf=0.82)
Experimental — accuracy not yet measuredLLMs have the potential to produce text that lacks semantic coherence.
“there is the potential for LLMs to produce text that lacks semantic coherence (Dale, 2021)”
From Academic Integrity considerations of AI Large Language Models in the post-pandemic era: ChatGPT and beyond (2023) · cites this paper as Dale, 2021
AI writing tools offered various language support functions, such as sentence or text generation, which could improve students' writing performance.
“Similarly, Dale and Viethen (2021) reported that AI writing tools offered various language support functions, such as sentence or text generation, which could improve students' writing performance.”
From The Role of AI-Assisted Learning in Academic Writing: A Mixed-Methods Study on Chinese as a Second Language Students (2025) · cites this paper as Dale & Viethen, 2021
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Context based spelling correction
Mays, E., Damerau, F. J., & Mercer, R. L. (1991) · Information Processing & Management · doi:10.1016/0306-4573(91)90066-u · Cited by 267 · see citing works
The EPISTLE text-critiquing system
Heidorn, G. E., Jensen, K., Miller, L. A., Byrd, R. J., & Chodorow, M. S. (1982) · IBM Systems Journal · doi:10.1147/sj.213.0305 · Cited by 141 · see citing works
Using the web for language independent spellchecking and autocorrection
Whitelaw, C., Hutchinson, B., Chung, G., & Ellis, G. R. (2009) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/1699571.1699629 · Cited by 133 · see citing works
Natural language generation: The commercial state of the art in 2020
Dale, R. (2020) · Natural Language Engineering · doi:10.1017/s135132492000025x · Cited by 55 · see citing works
Self-citationHuman Factors and Behavioral Science: TheUNIX™ Writer's Workbench Software: Rationale And Design
Macdonald, N. H. (1983) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1983.tb03520.x · Cited by 36 · see citing works
The Design of a Proofreading Software Service
Mudge, R. (2010) · Cited by 17 · see citing works
Dobrin, D. N. (1990) · Computers and the Humanities · doi:10.1007/bf00115029 · Cited by 13 · see citing works
Checking in on grammar checking
Dale, R. (2016) · Natural Language Engineering · doi:10.1017/s1351324916000061 · Cited by 10 · see citing works
Self-citationDale, R. (2004) · Natural Language Engineering · doi:10.1017/s1351324903003309 · Cited by 9 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 3
- Heidorn, G. (2000). Intelligent writing assistance. In Dale, R., Moisl H. and Somers H. (eds), A Handbook of Natural Language Processing: Techniques and Applications for the Processing of Language as Text, pp. 181-207. New York: Marcel Dekker.
- Macdonald, N.H. (1983). The UNIX writers workbench software: rationale and design. Bell System Technical Journal 62, 1891-1908.
- Naber, D. (2003). A Rule-Based Style and Grammar Checker, Diploma Thesis, University of Bielefeld.
Cited by
Sorted by citations
Perkins, M. (2023) · Journal of University Teaching and Learning Practice · doi:10.53761/1.20.02.07 · Cited by 839 · see citing works
Collaborating with ChatGPT in argumentative writing classrooms
Su, Y., Lin, Y., & Lai, C. (2023) · Assessing Writing · doi:10.1016/j.asw.2023.100752 · Cited by 679 · see citing works
Marzuki, Widiati, U., Rusdin, D., Darwin, & Indrawati, I. (2023) · Cogent Education · doi:10.1080/2331186x.2023.2236469 · Cited by 524 · see citing works
“Works by Nazari et al. (2021), Dale and Viethen (2021), M. Lee et al. (2022), and Zhao (2022) served as valuable references.”
BackgroundExploring students' perspectives on generative AI-assisted academic writing
Kim, J., Yu, S., Detrick, R., & Li, N. (2025) · Education and Information Technologies · doi:10.1007/s10639-024-12878-7 · Cited by 438 · see citing works
Exploring Artificial Intelligence in Academic Essay: Higher Education Student's Perspective
Malik, A. R., Pratiwi, Y., Andajani, K., Numertayasa, I. W., Suharti, S., Darwis, A., & Marzuki (2023) · International Journal of Educational Research Open · doi:10.1016/j.ijedro.2023.100296 · Cited by 418 · see citing works
AI in the Foreign Language Classroom: A Pedagogical Overview of Automated Writing Assistance Tools
Alharbi, W. (2023) · Education Research International · doi:10.1155/2023/4253331 · Cited by 286 · see citing works
Peláez‐Sánchez, I. C., Velarde-Camaqui, D., & Glasserman‐Morales, L. D. (2024) · Frontiers in Education · doi:10.3389/feduc.2024.1392091 · Cited by 182 · see citing works
Chen, C., & Gong, Y. (. (2025) · Education Sciences · doi:10.3390/educsci15020141 · Cited by 90 · see citing works
Cummings, R. E., Monroe, S. M., & Watkins, M. (2024) · Computers and Composition · doi:10.1016/j.compcom.2024.102827 · Cited by 83 · see citing works
Kim, T., Shin, D., Kim, Y.-H., & Hong, H. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642693 · Cited by 75 · see citing works
The impact of integrating ChatGPT with teachers’ feedback on EFL writing skills
Asadi, M., Ebadi, S., & Mohammadi, L. (2025) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2025.101766 · Cited by 101 · see citing works
ChatGPT usage in everyday life: A motivation-theoretic mixed-methods study
Wolf, V., & Maier, C. (2024) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2024.102821 · Cited by 73 · see citing works
Kim, J., Yu, S., Lee, S.-S., & Detrick, R. (2025) · Journal of Research on Technology in Education · doi:10.1080/15391523.2025.2456043 · Cited by 93 · see citing works
Speculative Propositions for Digital Writing Under the New Autonomous Model of Literacy
Robinson, B. (2022) · Postdigital Science and Education · doi:10.1007/s42438-022-00358-5 · Cited by 51 · see citing works
Chan, C. K. Y., & Lee, K. K. W. (2025) · Computers & Education · doi:10.1016/j.compedu.2025.105399 · Cited by 38 · see citing works
Beyond the Chat: Executable and Verifiable Text-Editing with LLMs
Laban, P., Vig, J., Hearst, M., Xiong, C., & Wu, C.-S. (2024) · Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3654777.3676419 · Cited by 31 · see citing works
Ito, T., Yamashita, N., Kuribayashi, T., Hidaka, M., Suzuki, J., Gao, G., Jamieson, J., & Inui, K. (2023) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3586183.3606810 · Cited by 20 · see citing works
Intelligent Support Engages Writers Through Relevant Cognitive Processes
Göldi, A., Wambsganß, T., Neshaei, S. P., & Rietsche, R. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642549 · Cited by 21 · see citing works
Shofiah, N., & Putera, Z. F. (2024) · Research Square · doi:10.21203/rs.3.rs-3871916/v1 · Cited by 26 · see citing works
Garcia, M. B. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2499158 · Cited by 24 · see citing works
TALAYHAN, Ö. G. (2023) · JOURNAL OF CURRENT DEBATES IN SOCIAL SCIENCES · doi:10.29228/cudes.71701 · Cited by 30 · see citing works
Gallagher, J. R., & Wagner, K. (2024) · Journal of Business and Technical Communication · doi:10.1177/10506519241239937 · Cited by 17 · see citing works
Clorion, F. D. D., Alieto, E. O., Fuentes, J. O., Suicano, D. J. B., Natividad, E.-R. R., Miñoza, M. V., Pil, A. I. O., Aidil-Karanain, F., & Vallejo, R. G. (2024) · Springer eBooks · doi:10.1007/978-3-031-65691-0_16 · Cited by 18 · see citing works
Deskilling of Teaching and the Case for Intelligent Tutoring Systems
Hughes, J. (2021) · Journal of Ethics and Emerging Technologies · doi:10.55613/jeet.v31i2.90 · Cited by 21 · see citing works
Algorithmic-authors in academia: blurring the boundaries of human and machine knowledge production
Gretzky, M., & Dishon, G. (2025) · Learning Media and Technology · doi:10.1080/17439884.2025.2452196 · Cited by 15 · see citing works
Neyem, A., Sandoval Alcocer, J. P., Mendoza, M., Centellas-Claros, L., Gonzalez, L. A., & Paredes-Robles, C. (2024) · Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 1 · doi:10.1145/3626252.3630854 · Cited by 14 · see citing works
Heintz, K., Roh, Y., & Lee, J. (2022) · Science Editing · doi:10.6087/kcse.261 · Cited by 12 · see citing works
Zhao, X., Sbaffi, L., & Cox, A. M. (2025) · Electronics · doi:10.3390/electronics14061194 · Cited by 18 · see citing works
Wu, Q., & Xu, A. (2025) · British Educational Research Journal · doi:10.1002/berj.4119 · Cited by 17 · see citing works
RetractedAI WRITING CORRECTION TOOLS: TEACHERS AND STUDENTS’ PERCEPTION
Putra, M. (2023) · JURNAL TATSQIF · doi:10.20414/jtq.v21i1.7963 · Cited by 17 · see citing works
College Students' Use and Perceptions of Artificial Intelligence (AI): A Survey Study
Strayhorn, T. L. (2025) · Journal of college student development · doi:10.1353/csd.2025.a962923 · Cited by 8 · see citing works
Högström, J., Paakkari, A., Nilsberth, M., & Slotte, A. (2024) · Learning Media and Technology · doi:10.1080/17439884.2024.2436566 · Cited by 7 · see citing works
Yıldız, M., Topuz, A. C., Polat, H., Taşlıbeyaz, E., Kurşun, E., & Yeşilyurt, S. (2025) · Educational Psychology · doi:10.1080/01443410.2025.2539797 · Cited by 8 · see citing works
Stylometric analysis of AI-generated texts: a comparative study of ChatGPT and DeepSeek
Jaashan, H. M. S., & Bin-Hady, W. R. A. (2025) · Cogent Arts and Humanities · doi:10.1080/23311983.2025.2553162 · Cited by 6 · see citing works
From errors to excellence: AI-driven scaffolding for advancing L2 writing skills
Ren, B., Dong, Y., & Zhang, B. (2025) · Cogent Education · doi:10.1080/2331186x.2025.2588512 · Cited by 11 · see citing works
Corrective Feedback of AI Tools in Writing and Translation
Jomaa, N. J. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-9511-0.ch010 · Cited by 6 · see citing works
Cicero: An AI-Based Writing Assistant for Legal Users
Luzi, F. D., Macrì, M., Mecella, M., & Mencattini, T. (2023) · Lecture notes in business information processing · doi:10.1007/978-3-031-34674-3_13 · Cited by 6 · see citing works
Zhang, L., Li, J., & Tsung, L. (2026) · System · doi:10.1016/j.system.2026.104002 · Cited by 10 · see citing works
Al-shaboul, I. A., Rousan, R. M. A., Kalsoom, T., & Al-Awawdeh, N. (2024) · Research Journal in Advanced Humanities · doi:10.58256/pjf6en83 · Cited by 8 · see citing works
Stadnik, M., Coskovic, A. L., Banko, T., & Ružak, D. (2025) · Interdisciplinary Description of Complex Systems · doi:10.7906/indecs.23.1.3 · Cited by 4 · see citing works
$NLP: How to spend a billion dollars
Dale, R. (2022) · Natural Language Engineering · doi:10.1017/s1351324921000450 · Cited by 4 · see citing works
Self-citationWhen Transformer models are more compositional than humans: The case of the depth charge illusion
Paape, D. (2023) · Experiments in Linguistic Meaning · doi:10.3765/elm.2.5370 · Cited by 4 · see citing works
AI-Powered Writing Tools: A Phenomenological Inquiry of Tertiary Students’ Usage
Candilas, K. S., Japson, M. C. N., Bartolata, V. D., Amores, D. J. R., Abas, S. R., & Getuaban, P. A. M. (2024) · AsiaCALL Online Journal · doi:10.54855/acoj.241523 · Cited by 6 · see citing works
Nurseha, I. (2023) · JEET Journal of English Education and Technology · doi:10.59689/jeet.v4i03.127 · Cited by 3 · see citing works
Garcia, M. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5242823 · Cited by 3 · see citing works
A Review on Conversational AI as a Tool in Academic Writing
Demiröz, H., & Tıkız‐Ertürk, G. (2025) · Eskiyeni (Online)/Eskiyeni · doi:10.37697/eskiyeni.1565854 · Cited by 4 · see citing works
Angewandte Linguistik für Sprachberufe
Perrin, D. (2022) · De Gruyter eBooks · doi:10.1515/9783110786675 · Cited by 2 · see citing works
The Unexpected Effects of Google Smart Compose on Open-Ended Writing Tasks
Cummings, R. E., Le, T., Shrestha, S., & Smith, C. V. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-64302-6_33 · Cited by 2 · see citing works
Oladele, B. K., Ndlovu, M., & Adeleke, J. O. (2025) · Educational Technology Quarterly · doi:10.55056/etq.964 · Cited by 2 · see citing works
Research on Text Generation Techniques Combining Machine Learning and Deep Learning
HUANG, Y., & Yu, H. (2022) · Asia-Pacific Conference on Image Processing, Electronics and Computers (IPEC) · doi:10.1145/3544109.3544168 · Cited by 2 · see citing works
Text Polishing with Chinese Idiom: Task, Datasets and Pre-trained Baselines
Liao, J., Cheng, S., & Tan, M. (2023) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3593806 · Cited by 2 · see citing works
Perrin, D., & Linguistics, Z. S. O. A. (2022) · De Gruyter eBooks · doi:10.1515/9783110786675-012 · Cited by 2 · see citing works
The Integration of Artificial Intelligence Into Saudi Educational Settings
Albadry, H. (2025) · International Journal of Computer-Assisted Language Learning and Teaching · doi:10.4018/ijcallt.394883 · Cited by 1 · see citing works
Angewandte Linguistik für Sprachberufe
Perrin, D. (2024) · De Gruyter eBooks · doi:10.1515/9783110786767 · Cited by 1 · see citing works
Sanz-Valdivieso, L. (2024) · IEEE Transactions on Professional Communication · doi:10.1109/tpc.2024.3419288 · Cited by 1 · see citing works
Using a Scenario-Based Method to Explore University Students’ Views About Writing Assistance
Möller, A., Comer, K., Rawlins, P., & Emerson, L. (2025) · New Zealand Journal of Educational Studies · doi:10.1007/s40841-025-00384-4 · Cited by 1 · see citing works
USING NEURAL MACHINE TRANSLATION FOR DETECTING AND CORRECTING GRAMMATICAL ERRORS
Yang, D., & Wang, P. (2021) · doi:10.33965/icwi_ac2021_202109l002 · Cited by 1 · see citing works
When Transformer models are more compositional than humans: The case of the depth charge illusionPreprint
Paape, D. (2022) · doi:10.31234/osf.io/gx4q5 · Cited by 1 · see citing works
Mahlow, C. (2023) · doi:10.35542/osf.io/da2rm · Cited by 1 · see citing works
Angewandte Linguistik für Sprachberufe
Perrin, D. (2021) · De Gruyter eBooks · doi:10.1515/9783110748796
Steinmetz, I., & Harbusch, K. (2022) · Workshop on Intelligent and Interactive Writing Assistants (In2Writing) · doi:10.18653/v1/2022.in2writing-1.4
LAIR - Language As Intermediate Representation
von Csefalvay, C. (2024) · doi:10.59350/jmdk2-xtx05
Needle in a Haystack: Finding Suitable Idioms Based on Text Descriptions
Zhernokleev, D., & Braslavski, P. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-54534-4_13
Свиридюк, В. П., Bodyk, O. P., Kalinina, L. V., PROKOPCHUK, N., & Khrystych, N. (2024) · Information Technologies and Learning Tools · doi:10.33407/itlt.v101i3.5547
Enhancing Student Theses with Advanced Text Analysis Using NLP and Pre-trained Models
Marquez, M. P., González‐López, S., Rentería, J. R. C., Borrego, G., Meranza-Castillón, M. O., & Zamora, G. M. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-83882-8_2
The Key Obstacles to using Emerging Artificial Intelligence Tools in Foreign Language Learning
Ndjama, J. D. N. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-9606-3.ch004
Ayoub, N. N., Joudi, N. S., Saba, M. S. B., & Saba, A. S. B. (2025) · European Scientific Journal ESJ · doi:10.19044/esj.2025.v21n14p37 · Cited by 3 · see citing works
A semi supervised framework for human and machine collaboration in computer assisted text refinement
Sun, Y., Wang, Y., Yang, H., & Suen, R. (2025) · Scientific Reports · doi:10.1038/s41598-025-10085-z
L2 learners’ behavioral and cognitive engagement in AI-supported English writingPreprint
Alqurashi, F. (2025) · Research Square · doi:10.21203/rs.3.rs-6804457/v1
Panahi, P., & Chen, J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5493308
Penpeña, R. A. P. (2025) · EthAIca · doi:10.56294/ai2025426 · Cited by 2 · see citing works
Harnessing Artificial Intelligence for Language Learning
Javed, F. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-0275-1.ch001
FutureLetter: Augmenting Personal Writing for Future-Self Dialogue using LLMs
Tsuyuguchi, K., Chishima, Y., Watanabe, K., & Suzuki, K. (2026) · Augmented Humans International Conference (AHs) · doi:10.1145/3795011.3795042
Topic Modeling of Student Perspectives on Generative AI for Academic Research Writing
Aspiras, L. S. (2026) · International Conference on Artificial Intelligence, Systems, and Emerging Technologies (ICAISET) · doi:10.1109/icaiset66439.2026.11541475
Amon, K., Mpoeleng, D., Zlotnikova, I., & Letsholo, K. J. (2026) · Southern African Linguistics and Applied Language Studies · doi:10.2989/16073614.2026.2674593
Hinchcliffe, D., Fergani, C., & Zajitschek, S. R. K. (2026) · AJP Advances in Physiology Education · doi:10.1152/advan.00273.2025 · Cited by 1 · see citing works
The effect of artificial intelligence on students’ writing performance: a meta-analysis
Wu, J., Chen, Q., Jiang, H., & Bai, X. (2026) · Reading and Writing · doi:10.1007/s11145-026-10884-4
Generative AI for Second Language Writing Feedback, Assessment, and Instruction
Li, M., Han, J., & Taha, G. (2026) · Cambridge University Press eBooks · doi:10.1017/9781009657334 · Cited by 1 · see citing works
AI and MOOCs in Reverse Engineering- a Toy RC Car Case Study
Vodă, M., Şoşdean, C., & Coornaert, B. (2026) · IEEE Digital Education and MOOCS Conference (DEMOcon) · doi:10.1109/democon70840.2026.11708479
- Authors
- Dale, R., & Viethen, J.
- Affiliations
- Macquarie University (AU)
- Corresponding author
- Dale, Robert
- ORCID
- Dale, Robert
- Venue
- Natural Language Engineering
- Publisher
- Cambridge University Press (CUP)
- Published
- 2021-07
- Volume
- 27
- Issue
- 4
- Pages
- 511-518
- ISSN
- 1351-3249 (ISSN-L)
- 1469-8110
- OpenAlex
- W3180439001
- Cited by
- 81
- References
- 9
- Citations by year
- 2026: 8 · 2025: 27 · 2024: 21 · 2023: 13 · 2022: 9 · 2021: 3
- FWCI
- 4.07
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Natural Language Engineering (publishedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
- Keywords
- computer-assisted writing, writing support tools, natural language processing applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review