The DOI matches its Crossref record; 65 of the 65 references it cites were found in a registry or an index.
Investigating students’ cognitive processes in generative AI-assisted digital multimodal composing and traditional writing
Open accessAbstract
Recently, generative artificial intelligence (AI)-powered chatbots such as ChatGPT and Bing Chat have garnered increasing attention on a global scale. Previous studies have focused mostly on the influence of generative AI on writing while few researchers have investigated how generative AI can facilitate students' multimodal writing process. To fill in this gap, we explored the generative AI-assisted composing processes of two groups of English as a foreign language (EFL) writers over two weeks in this qualitative study. One group completed a multimodal PowerPoint (PPT) project, and the other group completed a traditional argumentative essay project. Our data consist of students’ screen recordings with think-aloud protocols, final multimodal texts, and post-project interviews. Our analysis showed different patterns in text production across the two groups. Students in the PPT group tended to construct more bridge texts and examples to corroborate their sub-claims in the hierarchical order. They also inclined to borrow the summarized search results from the Bing Chat to expand texts for their PPT slides. With regard to image generation for PPT slides, descriptions of AI images from ChatGPT were used as effective prompts to generate AI images from Bing Image Creator. Moreover, students were interested in producing and refining AI images following the recommended prompts by Bing Chat. They also evaluated these AI images from different perspectives. We conclude the study with a discussion on the pedagogical implications and suggestions for further study.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Unlike static writing tools, GAI systems function as interactive partners capable of simulating rhetorical genres and providing immediate adaptive feedback (Dergaa et al., 2023;Liu et al., 2024;Zhang et al., 2025c).”
From Generative AI, visual scaffolds, and metacognition in EFL writing (2026) · cites this paper as Liu et al., 2024
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reading images: the grammar of visual design
(1996) · Choice Reviews Online · doi:10.5860/choice.34-1950 · Cited by 8,742
Chatting and cheating: Ensuring academic integrity in the era of ChatGPT
Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2190148 · Cited by 3,087
Chatting and Cheating. Ensuring academic integrity in the era of ChatGPT
Cotton, D., Cotton, P., & Shipway, J. R. (2023) · doi:10.35542/osf.io/mrz8h · Cited by 3,079
An introduction to functional grammar
Morley, G. D. (1986) · Lingua · doi:10.1016/0024-3841(86)90084-7 · Cited by 2,785
What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education
Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., & Agyemang, B. (2023) · Smart Learning Environments · doi:10.1186/s40561-023-00237-x · Cited by 2,003
ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.1.9 · Cited by 1,806
A cognitive process theory of writing
Flower, L., & Hayes, J. R. (1981) · College Composition & Communication · doi:10.58680/ccc198115885 · Cited by 1,025
Lund, B. D., Wang, T., Mannuru, N. R., Nie, B., Shimray, S., & Wang, Z. (2023) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24750 · Cited by 919
Modeling and remodeling writing
Hayes, J. R. (2012) · Written Communication · doi:10.1177/0741088312451260 · Cited by 893
Strzelecki, A. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2023.2209881 · Cited by 807
Stimulated recall: a report on its use in naturalistic research
Lyle, J. (2003) · British Educational Research Journal · doi:10.1080/0141192032000137349 · Cited by 774
Using ChatGPT for second language writing: pitfalls and potentials
Barrot, J. S. (2023) · Assessing Writing · doi:10.1016/j.asw.2023.100745 · Cited by 770
Yilmaz, R., & Karaoglan Yilmaz, F. G. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100147 · Cited by 745
Impact of ChatGPT on learners in a L2 writing practicum: an exploratory investigation
Yan, D. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-11742-4 · Cited by 713
Design Guidelines for Prompt Engineering Text-to-Image Generative Models
Liu, V., & Chilton, L. B. (2021) · arXiv · doi:10.48550/arxiv.2109.06977 · Cited by 635
The Routledge Handbook of Research Methods in Applied Linguistics
(2019) · Routledge eBooks · doi:10.4324/9780367824471 · Cited by 572
Collaborating with ChatGPT in argumentative writing classrooms
Su, Y., Lin, Y., & Lai, C. (2023) · Assessing Writing · doi:10.1016/j.asw.2023.100752 · Cited by 563
Technology in Language Use, Language Teaching, and Language Learning
Chun, D., Kern, R., & Smith, B. (2016) · The Modern Language Journal · doi:10.1111/modl.12302 · Cited by 525
Fabrication and errors in the bibliographic citations generated by ChatGPT
Walters, W. H., & Wilder, E. I. (2023) · Scientific Reports · doi:10.1038/s41598-023-41032-5 · Cited by 499
Yilmaz, R., & Karaoglan Yilmaz, F. G. (2023) · Computers in Human Behavior: Artificial Humans · doi:10.1016/j.chbah.2023.100005 · Cited by 344
Toward an Empirical Model of EFL Writing Processes: An Exploratory Study
Sasaki, M. (2000) · Journal of Second Language Writing · doi:10.1016/s1060-3743(00)00028-x · Cited by 320
Using digital story writing as a pedagogy to develop AI literacy among primary students
Ng, D. T. K., Luo, W., Chan, H. M. Y., & Chu, S. K. W. (2022) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2022.100054 · Cited by 266
Assessing digital multimodal composing in second language writing: Towards a process-based model
Hafner, C. A., & Ho, W. Y. J. (2020) · Journal of Second Language Writing · doi:10.1016/j.jslw.2020.100710 · Cited by 244
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems
Brewster, S. A., Fitzpatrick, G., Cox, A. J., & Kostakos, V. (2019) · Cited by 238
Hafner, C. A. (2015) · TESOL Quarterly · doi:10.1002/tesq.238 · Cited by 224
Zhao, X. (2023) · RELC Journal · doi:10.1177/00336882221094089 · Cited by 192
The affordances of digital multimodal composing for EFL learning
Jiang, L. (2017) · ELT Journal · doi:10.1093/elt/ccw098 · Cited by 168
What’s in a text-to-image prompt? The potential of stable diffusion in visual arts education
Dehouche, N., & Dehouche, K. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e16757 · Cited by 168
A Preliminary Investigation of Fake Peer-Reviewed Citations and References Generated by ChatGPT
Day, T. (2023) · The Professional Geographer · doi:10.1080/00330124.2023.2190373 · Cited by 160
Writing in the workplace: Constructing documents using multiple digital sources
Leijten, M., Waes, L. V., Schriver, K. A., & Hayes, J. R. (2014) · Journal of Writing Research · doi:10.17239/jowr-2014.05.03.3 · Cited by 159
Digital multimodal composing in post-secondary L2 settings: a review of the empirical landscape
Zhang, M., Akoto, M., & Li, M. (2021) · Computer Assisted Language Learning · doi:10.1080/09588221.2021.1942068 · Cited by 135
Kohn, K. W., & Hoffstaedter, P. (2017) · Computer Assisted Language Learning · doi:10.1080/09588221.2017.1304966 · Cited by 130
Jiang, L. G., Yu, S., & Lee, I. (2022) · Journal of Second Language Writing · doi:10.1016/j.jslw.2022.100869 · Cited by 112
The role of working memory in young second language learners’ written performances
Michel, M. C., Kormos, J., Brunfaut, T., & Ratajczak, M. (2019) · Journal of Second Language Writing · doi:10.1016/j.jslw.2019.03.002 · Cited by 100
Multimodal Composing and Traditional Essays: Linguistic Performance and Learner Perceptions
Kim, Y., & Belcher, D. (2020) · RELC Journal · doi:10.1177/0033688220906943 · Cited by 98
Smart MOOC integrated with intelligent tutoring: A system architecture and framework model proposal
Yılmaz, R., Yurdugül, H., Yılmaz, F. G. K., Şahin, M., Sulak, S., Aydın, F., Tepgeç, M., Müftüoğlu, C. T., & Oral, Ö. (2022) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2022.100092 · Cited by 89
For L2 writers, it is always the problem of the language
Qu, W. (2017) · Journal of Second Language Writing · doi:10.1016/j.jslw.2017.10.007 · Cited by 79
Jian-hua, Z., & Zhang, L. J. (2023) · Learning and Instruction · doi:10.1016/j.learninstruc.2023.101808 · Cited by 78
Self-citationXu, Y. (2021) · Computer Assisted Language Learning · doi:10.1080/09588221.2021.1945635 · Cited by 72
Can Cognitive Writing Models Inform the Design of the Common Core State Standards?
Hayes, J. R., & Olinghouse, N. G. (2015) · The Elementary School Journal · doi:10.1086/681909 · Cited by 71
Koltovskaia, S. (2022) · ReCALL · doi:10.1017/s0958344022000179 · Cited by 66
Dale, R. (2017) · Natural Language Engineering · doi:10.1017/s1351324917000018 · Cited by 59
Kim, Y., & Kang, S. (2020) · Computers & composition/Computers and composition · doi:10.1016/j.compcom.2020.102609 · Cited by 59
Handbook of Practical Second Language Teaching and Learning
Hinkel, E. (2022) · Routledge eBooks · doi:10.4324/9781003106609 · Cited by 57
Thi, N. K., Nikolov, M., & Simon, K. (2022) · Innovation in Language Learning and Teaching · doi:10.1080/17501229.2022.2122476 · Cited by 53
A Ghostwriter for the Masses: ChatGPT and the Future of Writing
Zimmerman, A. M. (2023) · Annals of Surgical Oncology · doi:10.1245/s10434-023-13436-0 · Cited by 53
Kim, Y., Kang, S., Nam, Y., & Skalicky, S. (2022) · System · doi:10.1016/j.system.2022.102722 · Cited by 51
Bhat, A., Agashe, S., Oberoi, P., Mohile, N., Jangir, R., & Joshi, A. (2023) · Proceedings of the 28th International Conference on Intelligent User Interfaces · doi:10.1145/3581641.3584060 · Cited by 47
Initial Images: Using Image Prompts to Improve Subject Representation in Multimodal AI Generated Art
Qiao, H., Liu, V., & Chilton, L. (2022) · Creativity and Cognition · doi:10.1145/3527927.3532792 · Cited by 46
Multimodal composing and second language acquisition
Lim, J., & Kessler, M. (2023) · Language Teaching · doi:10.1017/s0261444823000125 · Cited by 45
Implementing Classroom-Based Assessment for Young EFL Learners in the Chinese Context: A Case Study
Yan, Q., Zhang, L. J., & Cheng, X. (2021) · The Asia-Pacific Education Researcher · doi:10.1007/s40299-021-00602-9 · Cited by 42
Self-citationTan, X. (2022) · Journal of Second Language Writing · doi:10.1016/j.jslw.2022.100958 · Cited by 42
Conceptualizing digital multimodal composing competence in L2 classroom: a qualitative inquiry
Zhang, E. D., & Yu, S. (2023) · Computer Assisted Language Learning · doi:10.1080/09588221.2023.2177310 · Cited by 40
Digital Storytelling: Changing Learners’ Attitudes and Self-efficacy Beliefs
Tecedor, M. (2023) · Applied Linguistics · doi:10.1093/applin/amad002 · Cited by 39
Reactivity of concurrent verbal reporting in second language writing
Yang, C., Hu, G., & Zhang, L. J. (2014) · Journal of Second Language Writing · doi:10.1016/j.jslw.2014.03.002 · Cited by 38
Self-citationL1 versus L2 writing processes: What insight can we obtain from a keystroke logging program?
Mohsen, M. A. (2021) · Language Teaching Research · doi:10.1177/13621688211041292 · Cited by 35
Zhang, E. D., & Yu, S. (2022) · Innovation in Language Learning and Teaching · doi:10.1080/17501229.2022.2135712 · Cited by 32
Proceedings of the Third Workshop on Narrative Understanding
(2021) · doi:10.18653/v1/2021.nuse-1 · Cited by 31
Deng, Y., Liu, D., & Feng, D. W. (2023) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2023.2227358 · Cited by 31
Chen, Y., Wang, L., Liu, X., & Wang, H. (2023) · Sustainability · doi:10.3390/su15086692 · Cited by 27
A Design Space for Writing Support Tools Using a Cognitive Process Model of Writing
Gero, K., Calderwood, A., Li, C., & Chilton, L. (2022) · Proceedings of the First Workshop on Intelligent and Interactive Writing Assistants (In2Writing 2022) · doi:10.18653/v1/2022.in2writing-1.2 · Cited by 25
Could artificial intelligence win the next Weather Photographer of the Year competition?
Hunt, K. M. R. (2022) · Weather · doi:10.1002/wea.4348 · Cited by 15
Diversified text-to-image generation via deep mutual information estimation
Li, A., Zhao, L., Zuo, Z., Wang, Z., Chen, H., Lu, D., & Xing, W. (2021) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2021.103259 · Cited by 12
Research works printed but not linked: 9
- Kang, 2023, EFL adolescent learners' perceptions of digital multimodal composing tasks and task outcomes: A longitudinal study, International Journal of Applied Linguistics, 33, 340, 10.1111/ijal.12473 · doi:10.1111/ijal.12473
- Kim, 2023, Comparing monomodal traditional writing and digital multimodal composing in EAP classrooms: Linguistic performance and writing development, Journal of English for Academic Purposes, 10.1016/j.jeap.2023.101247 · doi:10.1016/j.jeap.2023.101247
- Macken-Horarik, 2004, Interacting with the multimodal text: Reflections on image and verbiage in art express, Visual Communication, 3, 5, 10.1177/1470357204039596 · doi:10.1177/1470357204039596
- Mehdi, 2023, Confirmed: The new Bing runs on OpenAI's GPT-4, The Official Microsoft Blog
- Mehdi, 2023, Create images with your words-Bing Image Creator comes to the new Bing, The Official Microsoft Blog
- Mehdi, 2023, Reinventing search with a new AI-powered Microsoft Bing and Edge, your copilot for the web, The Official Microsoft Blog
- Tai, 2023, Exploring the potential and limitations of ChatGPT for academic peer-reviewed writing: Addressing linguistic injustice and ethical concerns, Journal of Academic Language and Learning, 17, T16
- Unsworth, 2006, Towards a metalanguage for multiliteracies education: Describing the meaning-making resources of language-image interaction, English Teaching: Practice and Critique, 5, 55
- Zhan, 2023, Multimodal image synthesis and editing: A survey and taxonomy, IEEE Transactions on Pattern Analysis and Machine Intelligence, 1
Cited by
Does ChatGPT enhance student learning? A systematic review and meta-analysis of experimental studies
Deng, R., Jiang, M., Yu, X., Lu, Y., & Liu, S. (2025) · Computers & Education · doi:10.1016/j.compedu.2024.105224 · Cited by 531
Exploring students' perspectives on generative AI-assisted academic writing
Kim, J., Yu, S., Detrick, R., & Li, N. (2025) · Education and Information Technologies · doi:10.1007/s10639-024-12878-7 · Cited by 438
“…evaluation and correction, AI writing systems facilitate students’ metacognition by allowing them to identify and correct language errors (Fitria, 2021), notice dissonance in their writing (Gayed et al., 2022), and improve their manuscript’s overall clarity and coherence (Liu et al., 2023).”
Wang, H., Dang, A., Wu, Z., & Mac, S. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100326 · Cited by 272
Guo, K., Pan, M., Li, Y., & Lai, C. (2024) · The Internet and Higher Education · doi:10.1016/j.iheduc.2024.100962 · Cited by 173
Generative AI (GenAI) in the language classroom: A systematic review
Lee, S., Choe, H., Zou, D., & Jeon, J. (2026) · Interactive Learning Environments · doi:10.1080/10494820.2025.2498537 · Cited by 158
Metadata
- Authors
- Liu, M., Zhang, L. J., & Biebricher, C.
- Venue
- Computers & Education
- Publisher
- Elsevier BV
- Published
- 2024-04
- Volume
- 211
- Pages
- 104977
- ISSN
- 0360-1315 (ISSN-L)
- OpenAlex
- W4389804697
- Cited by
- 282
- References
- 65
- FWCI
- 66.27
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- creativecommons.org/licenses/by/4.0/ (vor)
- Funders
- University of Auckland
- Ministry of Education of the People's Republic of China
- China Scholarship Council (202206090014)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.