Cited by 232EFL/ESL Teaching and LearningEnglish Language Learning and TeachingArtificial Intelligence in Education

The DOI matches its Crossref record, with a small difference in title or year; 77 of the 79 references it cites were found in a registry or an index.

Incorporating a reflective thinking promoting mechanism into artificial intelligence-supported English writing environments

Liu, Chenchen, Hou, Jierui, Tu, Yun-Fang, Wang, Youmei, Hwang, Gwo-Jen·2023·Interactive Learning Environments

DOI 10.1080/10494820.2021.2012812

Open this paper in CoChat — free account

Abstract

Automated writing feedback supported by artificial intelligence (AI) techniques has attracted the attention of English as Foreign Language (EFL) researchers. However, there is insufficient evidence and inconsistent conclusions on the actual impacts of AI on students’ writing skills. In addition, in the field of EFL writing, there are few studies which have integrated appropriate teaching strategies to promote the effectiveness of EFL writing teaching and learning. Furthermore, it remains unclear how learners can effectively benefit from AI technology-based English writing. To solve this problem, this study proposed a reflective thinking promotion mechanism-based AI-supported English writing (RTP-AIEW) approach to deepen learners’ thinking and improve their EFL writing quality. To investigate the effectiveness of this learning approach, a quasi-experiment was conducted in two EFL writing classes in a university. One class (50 students) was the experimental group learning with the proposed RTP-AIEW approach, while the other class (53 students) was the control group learning with conventional AI-supported EFL writing. The results indicated that the proposed approach not only significantly improved the experimental group students’ English writing performance, but also improved their self-efficacy and self-regulated learning, and significantly reduced their cognitive load. In addition, students’ learning experience and perceptions are also discussed.

Integrity signals

Registry

Crossref · 10.1080/10494820.2021.2012812

Cites

77 of 77 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

1 retracted

RETRACTED: English teaching practice based on artificial intelligence technology
Bin, Y., & Mandal, D. (2019) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-179141 · Cited by 153
Retracted
How we think.
Dewey, J. (1910) · D C Heath eBooks · doi:10.1037/10903-000 · Cited by 9,538
Augmented Reality in education – cases, places and potentials
Bower, M., Howe, C., McCredie, N., Robinson, A., & Grover, D. (2014) · Educational Media International · doi:10.1080/09523987.2014.889400 · Cited by 777
A concept map-embedded educational computer game for improving students' learning performance in natural science courses
Hwang, G., Yang, L., & Wang, S. (2013) · Computers & Education · doi:10.1016/j.compedu.2013.07.008 · Cited by 659
Self-citation
Investigating the effect of pre-training when learning through immersive virtual reality and video: A media and methods experiment
Meyer, O. A., Omdahl, M. K., & Makransky, G. (2019) · Computers & Education · doi:10.1016/j.compedu.2019.103603 · Cited by 515 · cited 1×
“The use of VR may also result in vertigo which may prevent them from learning properly (Meyer et al., 2019; Moss & Muth, 2011).”
Background
Influences of artificial intelligence (AI) awareness on career competency and job burnout
Kong, H., Yuan, Y., Baruch, Y., Bu, N. T., Jiang, X., & Wang, K. (2021) · International Journal of Contemporary Hospitality Management · doi:10.1108/ijchm-07-2020-0789 · Cited by 500
Patterns of Discourse in Two Kinds of Literature Discussion
Chinn, C. A., Anderson, R. C., & Waggoner, M. A. (2001) · Reading Research Quarterly · doi:10.1598/rrq.36.4.3 · Cited by 355
A personalized recommendation-based mobile learning approach to improving the reading performance of EFL students
Hsu, C.-K., Hwang, G., & Chang, C. (2012) · Computers & Education · doi:10.1016/j.compedu.2012.12.004 · Cited by 338
Self-citation
Feedback loops and the longer-term: towards feedback spirals
Carless, D. (2019) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2018.1531108 · Cited by 328 · cited 3×
“…go through the process of acquiring knowledge, receiving learning tasks, and receiving feed-back, and then they can reconsider their learning behavior and adapt their learning strategies based on the feedback in the repeated learning process (Carless, 2019; Hwang & Wang, 2016; Kiili, 2007).”
Background
The role of value on teachers' internalization of external barriers and externalization of personal beliefs for classroom technology integration
Vongkulluksn, V. W., Xie, K., & Bowman, M. A. (2017) · Computers & Education · doi:10.1016/j.compedu.2017.11.009 · Cited by 304
Deep learning goes to school: toward a relational understanding of AI in education
Perrotta, C., & Selwyn, N. (2020) · Learning, Media and Technology · doi:10.1080/17439884.2020.1686017 · Cited by 299
Digital support for academic writing: A review of technologies and pedagogies
Strobl, C., Ailhaud, E., Benetos, K., Devitt, A., Kruse, O., Proske, A., & Rapp, C. (2019) · Computers & Education · doi:10.1016/j.compedu.2018.12.005 · Cited by 298
Foundation for problem‐based gaming
Kiili, K. J. M. (2007) · British Journal of Educational Technology · doi:10.1111/j.1467-8535.2007.00704.x · Cited by 295
Impact of automated writing evaluation on teacher feedback, student revision, and writing improvement
Link, S., Mehrzad, M., & Rahimi, M. (2022) · Computer Assisted Language Learning · doi:10.1080/09588221.2020.1743323 · Cited by 275
A conceptual map model for developing intelligent tutoring systems
Hwang, G. (2003) · Computers & Education · doi:10.1016/s0360-1315(02)00121-5 · Cited by 250
Self-citation
Using automated written corrective feedback in the writing classrooms: effects on L2 writing accuracy
Barrot, J. S. (2023) · Computer Assisted Language Learning · doi:10.1080/09588221.2021.1936071 · Cited by 248 · cited 2×
“These ﬁ ndings are valuable since previous studies mainly focused on the e ﬀ ects of automated rating tools on learning performance rather than on learning perceptions (Barrot, 2021; Guo et al., 2021).”
MethodResult
Characteristics of Head-Mounted Displays and Their Effects on Simulator Sickness
Moss, J. D., & Muth, E. R. (2011) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720811405196 · Cited by 242
Integrating video-capture virtual reality technology into a physically interactive learning environment for English learning
Yang, J. C., Chen, C., & Jeng, M. C. (2010) · Computers & Education · doi:10.1016/j.compedu.2010.06.005 · Cited by 220
Using virtual reality to facilitate learners’ creative self-efficacy and intrinsic motivation in an EFL classroom
Lin, Y.-J., & Wang, H. (2021) · Education and Information Technologies · doi:10.1007/s10639-021-10472-9 · Cited by 208
Automated writing evaluation for formative assessment of second language writing: investigating the accuracy and usefulness of feedback as part of argument-based validation
Ranalli, J., Link, S., & Chukharev‐Hudilainen, E. (2016) · Educational Psychology · doi:10.1080/01443410.2015.1136407 · Cited by 207
Impacts of a mind mapping-based contextual gaming approach on EFL students’ writing performance, learning perceptions and generative uses in an English course
Fu, Q.-K., Lin, C.-J., Hwang, G., & Zhang, L. (2019) · Computers & Education · doi:10.1016/j.compedu.2019.04.005 · Cited by 198
Self-citation
Using augmented‐reality‐based mobile learning material in EFL English composition: An exploratory case study
Liu, P. E., & Tsai, M.-K. (2012) · British Journal of Educational Technology · doi:10.1111/j.1467-8535.2012.01302.x · Cited by 195
Students’ perceptions of collaboration, self-regulated learning, and information seeking in the context of Internet-based learning and traditional learning
Lee, S. W., & Tsai, C. (2010) · Computers in Human Behavior · doi:10.1016/j.chb.2010.11.016 · Cited by 194
Exploring the impact of using automated writing evaluation in English as a foreign language university students' writing
Wang, Y.-J., Shang, H.-F., & Briody, P. (2013) · Computer Assisted Language Learning · doi:10.1080/09588221.2012.655300 · Cited by 185
Self-citation
A fuzzy expert system-based adaptive learning approach to improving students’ learning performances by considering affective and cognitive factors
Hwang, G.-J., Sung, H.-Y., Chang, S.-C., & Huang, X.-C. (2020) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2020.100003 · Cited by 183
Self-citation
Critical social theory and transformative learning: evidencein pre‐service teachers’ service‐learning reflection logs
Carrington, S. B., & Selva, G. (2010) · Higher Education Research & Development · doi:10.1080/07294360903421384 · Cited by 173
Augmented reality and language learning: From annotated vocabulary to place-based mobile games
Godwin‐Jones, R. (2016) · Language learning & technology · doi:10.64152/10125/44475 · Cited by 172
Improving the effectiveness of English vocabulary review by integrating ARCS with mobile game‐based learning
Wu, T. (2018) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12244 · Cited by 151
Prediction of student course selection in online higher education institutes using neural network
Kardan, A. A., Sadeghi, H., Ghidary, S. S., & Sani, M. R. F. (2013) · Computers & Education · doi:10.1016/j.compedu.2013.01.015 · Cited by 145
Computer-assisted EFL writing and evaluations based on artificial intelligence: a case from a college reading and writing course
Wang, Z. (2020) · Library Hi Tech · doi:10.1108/lht-05-2020-0113 · Cited by 142
Beyond positive and negative emotions: Looking into the role of achievement emotions in discussion forums of MOOCs
Xing, W., Tang, H., & Pei, B. (2019) · The Internet and Higher Education · doi:10.1016/j.iheduc.2019.100690 · Cited by 123
AR videos as scaffolding to foster students’ learning achievements and motivation in EFL learning
Chen, C. (2020) · British Journal of Educational Technology · doi:10.1111/bjet.12902 · Cited by 116
Single loop or double loop learning: English vocabulary learning performance and behavior of students in situated computer games with different guiding strategies
Hwang, G., & Wang, S.-Y. (2016) · Computers & Education · doi:10.1016/j.compedu.2016.07.005 · Cited by 113
Self-citation
How effectively can EFL students use automated written corrective feedback (AWCF) in research writing?
Guo, Q., Feng, R., & Hua, Y. (2021) · Computer Assisted Language Learning · doi:10.1080/09588221.2021.1879161 · Cited by 112
Google Earth Virtual Reality and expository writing for young English Learners from a Funds of Knowledge perspective
Chen, Y., Smith, T. J., York, C. S., & Mayall, H. J. (2019) · Computer Assisted Language Learning · doi:10.1080/09588221.2018.1544151 · Cited by 110
Teaching Smart People How to Learn
(2009) · Routledge eBooks · doi:10.4324/9780080517889-22 · Cited by 109
The role of collective efficacy, cognitive quality, and task cohesion in computer-supported collaborative learning (CSCL)
Wang, S.-L., & Hwang, G.-J. (2012) · Computers & Education · doi:10.1016/j.compedu.2011.09.003 · Cited by 103
Self-citation
Reflective Thinking, Self-Efficacy, Self-Esteem and Academic Achievement of Iranian EFL Students in Higher Education: Is there a Relationship?
Asakereh, A., & Yousofi, N. (2018) · International Journal of Educational Psychology · doi:10.17583/ijep.2018.2896 · Cited by 95
Implementing Automated Writing Evaluation in Different Instructional Contexts: A Mixed-Methods Study
Palermo, C., & Wilson, J. (2020) · Journal of Writing Research · doi:10.17239/jowr-2020.12.01.04 · Cited by 94
An automatic collocation writing assistant for Taiwanese EFL learners: A case of corpus-based NLP technology
Chang, Y., Chang, J. S., Chen, H.-J., & Liou, H. (2008) · Computer Assisted Language Learning · doi:10.1080/09588220802090337 · Cited by 92
Evaluation of AR embedded physical puzzle game on students’ learning achievement and motivation on elementary natural science
Lu, S.-J., Liu, Y., Chen, P., & Hsieh, M.-R. (2018) · Interactive Learning Environments · doi:10.1080/10494820.2018.1541908 · Cited by 88
English writing instruction in Iran: Implications for second language writing curriculum and pedagogy
Naghdipour, B. (2016) · Journal of Second Language Writing · doi:10.1016/j.jslw.2016.05.001 · Cited by 86
Collaborating with ‘familiar’ strangers in mobile-assisted environments: The effect of socializing activities on learning EFL writing
Jiang, D., & Zhang, L. J. (2020) · Computers & Education · doi:10.1016/j.compedu.2020.103841 · Cited by 85
Automatic summary assessment for intelligent tutoring systems
He, Y., Hui, S. C., & Quan, T. (2009) · Computers & Education · doi:10.1016/j.compedu.2009.05.008 · Cited by 82
To make a long story short: A rubric for assessing graduate students’ academic and popular science writing skills
Rakedzon, T., & Baram‐Tsabari, A. (2017) · Assessing Writing · doi:10.1016/j.asw.2016.12.004 · Cited by 81
An online peer assessment approach to supporting mind-mapping flipped learning activities for college English writing courses
Lin, C.-J. (2019) · Journal of Computers in Education · doi:10.1007/s40692-019-00144-6 · Cited by 78
The use of models as a written feedback technique with young EFL learners
Guirao, J. C., de Larios, J. R., & Coyle, Y. (2015) · System · doi:10.1016/j.system.2015.04.002 · Cited by 75
Artificial intelligence translation under the influence of multimedia teaching to study English learning mode
Li, P., Ning, Y., & Fang, H. (2021) · International Journal of Electrical Engineering Education · doi:10.1177/0020720920983528 · Cited by 73
An Empirical Study on the Artificial Intelligence Writing Evaluation System in China CET
Lu, X.-X. (2019) · Big Data · doi:10.1089/big.2018.0151 · Cited by 71
Supporting self-efficacy beliefs and interest as educational inputs and outcomes: Framing AI and Human partnered task experiences
Fryer, L. K., Thompson, A., Nakao, K., Howarth, M., & Gallacher, A. (2020) · Learning and Individual Differences · doi:10.1016/j.lindif.2020.101850 · Cited by 71
The effects of ideal and ought-to L2 selves on Korean EFL learners’ writing strategy use and writing quality
Jang, Y., & Lee, J. (2018) · Reading and Writing · doi:10.1007/s11145-018-9903-0 · Cited by 65
High school teachers' perspectives on applying different mobile learning strategies to science courses: the national mobile learning program in Taiwan
Lai, C. L., & Hwang, G. J. (2015) · International Journal of Mobile Learning and Organisation · doi:10.1504/ijmlo.2015.070704 · Cited by 64
Self-citation
A WSQ-based flipped learning approach to improving students’ dance performance through reflection and effort promotion
Hsia, L., Hwang, G., & Lin, C.-J. (2019) · Interactive Learning Environments · doi:10.1080/10494820.2019.1651744 · Cited by 64
Self-citation
Investigating student attention, meditation, cognitive load, and satisfaction during lectures in a foreign language supported by speech-enabled language translation
Shadiev, R., & Huang, Y. (2019) · Computer Assisted Language Learning · doi:10.1080/09588221.2018.1559863 · Cited by 63
A study of adolescent English learners’ cognitive engagement in writing while using an automated content feedback system
Lee, C. (2019) · Computer Assisted Language Learning · doi:10.1080/09588221.2018.1544152 · Cited by 59
Teaching and researching writing
Cobb, T. (2003) · System · doi:10.1016/s0346-251x(02)00079-9 · Cited by 57
Development of reflection through learning activity
Zuckerman, G. A. (2004) · European Journal of Psychology of Education · doi:10.1007/bf03173234 · Cited by 53
Informal digital learning of English and English as an international language: The path less traveled
Lee, J. S., & Lee, K. (2018) · British Journal of Educational Technology · doi:10.1111/bjet.12652 · Cited by 51
Finding a Place for Critical Thinking and Self-voice in College English as a Foreign Language Writing Classrooms
Barnawi, O. Z. (2011) · English Language Teaching · doi:10.5539/elt.v4n2p190 · Cited by 45
To CALL or not to CALL: empirical evidence from neuroscience
Hsu, L. (2020) · Computer Assisted Language Learning · doi:10.1080/09588221.2020.1750429 · Cited by 40
Training College Students to Use Learning Strategies: A Framework and Pilot Course
McDaniel, M. A., Einstein, G. O., & Een, E. (2021) · Psychology Learning & Teaching · doi:10.1177/1475725721989489 · Cited by 39
Untitled work
(2014) · Journal of Pan-Pacific Association of Applied Linguistics · Cited by 33
Using an interactive ubiquitous learning system to enhance authentic learning experiences in a cultural heritage course
Chin, K.-Y., Lee, K.-F., & Chen, Y. (2017) · Interactive Learning Environments · doi:10.1080/10494820.2017.1341939 · Cited by 32
Creating rainbows from words and transforming understandings: enhancing student learning through reflective writing in an Aboriginal music course
Barney, K. S., & Mackinlay, E. (2010) · Teaching in Higher Education · doi:10.1080/13562511003619995 · Cited by 30
Ubiquitous knowledge and experiences to foster EFL learning affordances
García‐Sánchez, S., & Luján-García, C. (2016) · Computer Assisted Language Learning · doi:10.1080/09588221.2016.1176047 · Cited by 29
An investigation into EFL learners’ reflection in writing and the inhibitors to their reflection
Avarzamani, F., & Farahian, M. (2019) · Cogent Psychology · doi:10.1080/23311908.2019.1690817 · Cited by 28
Exploration on Cultivation of Critical Thinking in College Intensive Reading Course
Tang, L. (2016) · English Language Teaching · doi:10.5539/elt.v9n3p18 · Cited by 28
Encouraging Active Learning in Higher Education A Self-Determination Theory Perspective
Jeno, L. M. (2015) · International Journal of Technology and Inclusive Education · doi:10.20533/ijtie.2047.0533.2015.0091 · Cited by 22
An investigation into effectiveness of different reflective learning strategies for learning operational software
Koong, C., Yang, T.-I., Wu, C., Li, H.-T., & Tseng, C. (2013) · Computers & Education · doi:10.1016/j.compedu.2013.11.003 · Cited by 20
Impact of Explicit Vocabulary Instruction on Writing Achievement of Upper-Intermediate EFL Learners
Solati-Dehkordi, S. A., & Salehi, H. (2016) · International Education Studies · doi:10.5539/ies.v9n4p141 · Cited by 17
Research on Reliability and Validity of Mobile Networks-Based Automated Writing Evaluation
Lang, F., Li, S., & Zhang, S. (2018) · International Journal of Mobile Computing and Multimedia Communications · doi:10.4018/ijmcmc.2019010102 · Cited by 16
EFL learners' peer negotiations and attitudes in mobile-assisted collaborative writing
Yeh, S.-W., & Chen, C.-T. (2019) · Language Education & Assessment · doi:10.29140/lea.v2n1.100 · Cited by 15
Are Learners Becoming More Autonomous? The Role of Self-Access Center in EFL College Students’ English Learning in Taiwan
Chung, I.-F. (2013) · The Asia-Pacific Education Researcher · doi:10.1007/s40299-013-0076-y · Cited by 13
Legitimizing social work: The practice of reflective professionals
Potting, M., Sniekers, M., Lamers, C., & Reverda, N. (2010) · Journal of Social Intervention Theory and Practice · doi:10.18352/jsi.220 · Cited by 12
Promoting Self-regulated Learning in an Intelligent Tutoring System for Writing
Allen, L. K., & McNamara, D. S. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-19773-9_125 · Cited by 9
Expression and connection : the integration of the reflective learning process and the writing process into social network sites
Park, J. Y., & Son, J. (2011) · Faculty of Education · Cited by 7
College English teaching mode based on intelligent robot
Jun, W. (2019) · International Journal of Continuing Engineering Education and Life-Long Learning · doi:10.1504/ijceell.2019.099246 · Cited by 5

Research works printed but not linked: 1

10.1080/09588221.2020.1743323 · DOI · Paper page

Sorted by citations

The effects of over-reliance on AI dialogue systems on students’ cognitive abilities: A systematic review
Zhai, C., Wibowo, S., & Li, L. D. (2024) · Smart Learning Environments · doi:10.1186/s40561-024-00316-7 · Cited by 1,567
Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students
Song, C., & Song, Y. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1260843 · Cited by 717
The impact of AI writing tools on the content and organization of students’ writing: EFL teachers’ perspective
Marzuki, Widiati, U., Rusdin, D., Darwin, & Indrawati, I. (2023) · Cogent Education · doi:10.1080/2331186x.2023.2236469 · Cited by 524
Exploring Artificial Intelligence in Academic Essay: Higher Education Student's Perspective
Malik, A. R., Pratiwi, Y., Andajani, K., Numertayasa, I. W., Suharti, S., Darwis, A., & Marzuki (2023) · International Journal of Educational Research Open · doi:10.1016/j.ijedro.2023.100296 · Cited by 418
Critical thinking in the AI era: An exploration of EFL students’ perceptions, benefits, and limitations
Darwin, D., Rusdin, D., Mukminatien, N., Suryati, N., Laksmi, E. D., & Marzuki, M. (2023) · Cogent Education · doi:10.1080/2331186x.2023.2290342 · Cited by 494

See all 232

Authors: Liu, C., Hou, J., Tu, Y.-F., Wang, Y., & Hwang, G.-J.
Affiliations: Wenzhou University (CN)
Fu Jen Catholic University (TW)
Kaohsiung Medical University (TW)
Corresponding author: Hwang, Gwo-Jen
ORCID: Liu, Chenchen
Tu, Yun-Fang
Wang, Youmei
Hwang, Gwo-Jen
Venue: Interactive Learning Environments
Publisher: Informa UK Limited
Published: 2021-12-10
Volume: 31
Issue: 9
Pages: 5614-5632
ISSN: 1049-4820 (ISSN-L)
1744-5191
DOI: 10.1080/10494820.2021.2012812
OpenAlex: W4200268598
Cited by: 231
References: 79
Citations by year: 2026: 53 · 2025: 88 · 2024: 61 · 2023: 20 · 2022: 9
FWCI: 88.88
Type: journal article
Language: en
Open access: closed
Locations: Interactive Learning Environments (publishedVersion)
Topics: Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
Social Sciences › Education › English Language Learning and Teaching
Social Sciences › Education › Artificial Intelligence in Education
Keywords: EFL writing, reflective thinking, automated writing feedback, writing self-efficacy, student self-regulation, cognitive load, writing quality, learner perceptions, writing instruction strategies

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Incorporating a reflective thinking promoting mechanism into artificial intelligence-supported English writing environments

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks