Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Sign Up
Cited by 80

The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.

Effect of chatbot-assisted language learning: A meta-analysis

Zhang, Shunan, Shan, Cheng, Lee, John Sie Yuen, Che, ShaoPeng, Kim, Jang Hyun·2023·Education and Information Technologies
DOI 10.1007/s10639-023-11805-6
Open this paper in CoChat — free account

Overview

Integrity signals

Registry

Crossref · 10.1007/s10639-023-11805-6

Cites

14 of 14 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 14 references

Research works printed but not linked: 54

  1. Adamopoulou, E., & Moussiades, L. (2020). An overview of chatbot technology. In Artificial Intelligence Applications and Innovations: 16th IFIP WG 12.5 International Conference, AIAI 2020, Neos Marmaras, Greece, June 5–7, 2020, Proceedings, Part II 16 (pp. 373–383). Springer International Publishing. · DOI
  2. * Ahn, S. (2022). The Effects of Chatbot on Grammar Competence for Korean EFL College Students. Journal of Digital Convergence, 20(3), 53-61.
  3. Atwell, E. (1999). The language machine (pp.1–72). The British Council.
  4. Baby, C. J., Khan, F. A., & Swathi, J. (2017). Home automation using IoT and a chatbot using natural language processing. In 2017 Innovations in Power and Advanced Computing Technologies (i-PACT) (pp. 1–6). IEEE. · DOI
  5. Bii, P. (2013). Chatbot technology: A possible means of unlocking student potential to learn how to learn. Educational Research, 4(2), 218–221.
  6. Borenstein, M., Hedges, L. V., Higgins, J. P., & Rothstein, H. R. (2021). Introduction to meta-analysis. John Wiley & Sons. · DOI · Paper page
  7. Cameron, G., Cameron, D., Megaw, G., Bond, R., Mulvenna, M., O’Neill, S., Armour, C., & McTear, M. (2017). Towards a chatbot for digital counselling. In Proceedings of the 31st International BCS Human Computer Interaction Conference (HCI 2017) 31 (pp. 1–7). · DOI
  8. Chen, H.-L., Vicki Widarso, G., & Sutrisno, H. (2020). A chatbot for learning Chinese: Learning achievement and technology acceptance. Journal of Educational Computing Research, 58(6), 1161–1189. · DOI · Paper page
  9. Chen, X., Zou, D., Xie, H., & Cheng, G. (2021). Twenty years of personalized language learning. Educational Technology & Society, 24(1), 205–222.
  10. Chopra, S., Gianforte, R., & Sholar, J. J. A. T. o. G. (2016). Meet percy: The CS 221 teaching assistant chatbot. ACM Transactions on Graphics, 1(1), 1–8.
  11. Durlak, J. A. (2009). How to select, calculate, and interpret effect sizes. Journal of Pediatric Psychology, 34(9), 917–928. · DOI
  12. Duval, S., & Tweedie, R. (2000). Trim and fill: A simple funnel-plot–based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56(2), 455–463. · DOI · Paper page
  13. Flynn, S., Foley, C., & Vinnitskaya, I. J. I. J. o. M. (2004). The cumulative-enhancement model for language acquisition: Comparing adults' and children's patterns of development in first, second and third language acquisition of relative clauses. International Journal of Multilingualism, 1(1), 3–16. · DOI
  14. Freed, B. F., Segalowitz, N., & Dewey, D. P. (2004). Context of learning and second language fluency in French: Comparing regular classroom, study abroad, and intensive domestic immersion programs. Studies in Second Language Acquisition, 26(2), 275–301. · DOI
  15. Fryer, L. K., Ainley, M., Thompson, A., Gibson, A., & Sherlock, Z. (2017). Stimulating and sustaining interest in a language course: An experimental comparison of Chatbot and Human task partners. Computers in Human Behavior, 75, 461–468. · DOI · Paper page
  16. * Fryer, L. K., Thompson, A., Nakao, K., Howarth, M., Gallacher, A. J. L., & Differences, I. (2020). Supporting self-efficacy beliefs and interest as educational inputs and outcomes: Framing AI and Human partnered task experiences. Learning and Individual Differences, 80, 101850. · DOI · Paper page
  17. * Goda, Y., Yamada, M., Matsukawa, H., Hata, K., Yasunami, S. J. T. J. o. I., & Education, S. i. (2014). Conversation with a chatbot before an online EFL group discussion and the effects on critical thinking. The Journal of Information and Systems in Education, 13(1), 1–7. · DOI
  18. Hallahan, D. P., Keller, C. E., McKinney, J. D., Lloyd, J. W., & Bryan, T. (1988). Examining the research base of the regular education initiative: Efficacy studies and the adaptive learning environments model. Journal of Learning Disabilities, 21(1), 29–35. · DOI
  19. Han, D.-E. (2020). The Effects of Voice-based AI Chatbots on Korean EFL Middle School Students’ Speaking Competence and Affective Domains. Asia-Pacific Journal of Convergent Research Interchange, 6(7), 71–80. · DOI · Paper page
  20. Han, J.-H., Jo, M.-H., Jones, V., & Jo, J.-H. J. J. o. I. P. S. (2008). Comparative study on the educational use of home robots for children. Journal of Information Processing Systems, 4(4), 159–168. · DOI
  21. Hedges, L. V., & Olkin, I. (2014). Statistical methods for meta-analysis. Academic press.
  22. Huang, W., Hew, K. F., & Fryer, L. K. (2022). Chatbots for language learning—Are they really useful? A systematic review of chatbot-supported language learning. Journal of Computer Assisted Learning, 38(1), 237–257. · DOI · Paper page
  23. * Hwang, W.-Y., Guo, B.-C., Hoang, A., Chang, C.-C., & Wu, N.-T. (2022). Facilitating authentic contextual EFL speaking and conversation with smart mechanisms and investigating its influence on learning achievements. Computer Assisted Language Learning, 1–27. · DOI
  24. Jakonen, T., & Jauni, H. (2021). Mediated learning materials: Visibility checks in telepresence robot mediated classroom interaction [Article]. Classroom Discourse, 12(1–2), 121–145. · DOI
  25. * Jeon, J. (2021a). Chatbot-assisted dynamic assessment (CA-DA) for L2 vocabulary learning and diagnosis. Computer Assisted Language Learning, 1–27. · DOI · Paper page
  26. Jeong, H., Hmelo-Silver, C. E., & Jo, K. (2019). Ten years of computer-supported collaborative learning: A meta-analysis of CSCL in STEM education during 2005–2014. Educational Research Review, 28, 100284. · DOI · Paper page
  27. * Kim, H.-S., Cha, Y., & Kim, N.-Y. (2020). Impact of mobile interactions with AI on writing performance. Modern English Education, 21(2), 1-13. · DOI
  28. * Kim, N.-Y. (2016). Effects of voice chat on EFL learners’ speaking ability according to proficiency levels. Multimedia-Assisted Language Learning, 19(4), 63-88.
  29. * Kim, N.-Y. (2018a). Chatbots and Korean EFL students' English vocabulary learning. Journal of Digital Convergence, 16(2), 1-7.
  30. * Kim, N.-Y. (2018b). A study on chatbots for developing Korean college students' English listening and reading skills. Journal of Digital Convergence, 16(8), 19-26.
  31. * Kim, N.-Y. (2019). A study on the use of artificial intelligence chatbots for improving English grammar skills. Journal of Digital Convergence, 17(8), 37-46.
  32. Krashen, S. (1981). Second language acquisition. Second Language Learning, 3(7), 19–39.
  33. Lantolf, J. P. (2000). Introducing sociocultural theory. Sociocultural Theory and Second Language Learning, 1, 1–26.
  34. Lantolf, J. P., & Pavlenko, A. (1995). Sociocultural theory and second language acquisition. Annual Review of Applied Linguistics, 15, 108–124. · DOI
  35. Lee, H., & Lee, J. H. (2022). The effects of robot-assisted language learning: A meta-analysis. Educational Research Review, 35, 100425. · DOI
  36. Lee, J.-Y., & Hwang, Y. (2022). A meta-analysis of the effects of using AI chatbot in Korean EFL education. Studies in English Language & Literature, 48(1), 213–243. · DOI
  37. Lin, C.-J., & Mubarok, H. (2021). Learning analytics for investigating the mind map-guided AI Chatbot approach in an EFL flipped speaking classroom. Educational Technology & Society, 24(4), 16–35.
  38. * Lin, M. P. C., & Chang, D. (2020). Enhancing post-secondary writers' writing skills with a chatbot: A mixed-method classroom study. Educational Technology & Society, 23(1), 78–92.
  39. * Mageira, K., Pittou, D., Papasalouros, A., Kotis, K., Zangogianni, P., & Daradoumis, A. (2022). Educational AI chatbots for content and language integrated learning. Applied Sciences-Basel, 12(7), 3239. · DOI
  40. Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., Group* P. (2009). Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Annals of internal medicine, 151(4), 264–269. · DOI · Paper page
  41. Moore, M. G. (2013). The theory of transactional distance. In Handbook of distance education (pp. 84–103). Routledge. · DOI
  42. * Nagata, R., Hashiguchi, T., & Sadoun, D. (2019). Is the simplest chatbot effective in English writing learning assistance? In Computational Linguistics: 16th International Conference of the Pacific Association for Computational Linguistics, PACLING 2019, Hanoi, Vietnam, October 11–13, 2019, Revised Selected Papers 16 (pp. 245–256). Springer Singapore. · DOI
  43. * Nghi, T. T., Phuc, T. H., & Thang, N. T. (2019). Applying ai chatbot for teaching a foreign language: An empirical research. International Journal of Scientific Research, 8.
  44. Peng, J. E., & Woodrow, L. (2010). Willingness to communicate in English: A model in the Chinese EFL classroom context. Language Learning, 60(4), 834–876. · DOI
  45. Pham, X. L., Pham, T., Nguyen, Q. M., Nguyen, T. H., & Cao, T. T. H. (2018). Chatbot as an intelligent personal assistant for mobile language learning. In Proceedings of the 2018 2nd International Conference on Education and E-Learning (pp. 16–21). · DOI
  46. Polatidis, N. (2014). Chatbot for admissions. arXiv preprint arXiv:1408.6762. · arXiv
  47. Saxton, M. (2017). Child language: Acquisition and development. Child Language, 1–408. · DOI
  48. Shakhovska, N., Basystiuk, O., & Shakhovska, K. (2019). Development of the Speech-to-Text Chatbot Interface Based on Google API. In MoMLeT (pp. 212–221).
  49. * Vázquez-Cano, E., Mengual-Andrés, S., & López-Meneses, E. (2021). Chatbot to improve learning punctuation in Spanish and to enhance open and flexible learning environments. International Journal of Educational Technology in Higher Education, 18(1), 1–20. · DOI
  50. Von Worde, R. (2003). Students’ Perspectives on Foreign Language Anxiety. Inquiry, 8(1), n1.
  51. Wang, Y. F., Petrina, S., & Feng, F. (2017). VILLAGE—Virtual Immersive Language Learning and Gaming Environment: Immersion and presence. British Journal of Educational Technology, 48(2), 431–450. · DOI
  52. Wei, X., Saab, N., & Admiraal, W. (2021). Assessment of cognitive, behavioral, and affective learning outcomes in massive open online courses: A systematic literature review. Computers & Education, 163, 104097. · DOI
  53. * Ye, Y., Deng, J., & Liu, X. (2021). The Effect of Oral Practice via Chatbot on Students’ Oral English Accuracy. In Emerging Technologies for Education: 6th International Symposium, SETE 2021, Zhuhai, China, November 11–12, 2021, Revised Selected Papers (pp. 344–354). Cham: Springer International Publishing. · DOI
  54. Zhang, S., Che, S., Nan, D., & Kim, J. H. (2023). How does online social interaction promote students’ continuous learning intentions? Frontiers in Psychology, 14. · DOI

Cited by

See all 80

Metadata

Authors
Zhang, S., Shan, C., Lee, J. S. Y., Che, S., & Kim, J. H.
Venue
Education and Information Technologies
Publisher
Springer Science and Business Media LLC
Published
2023-04-26
Volume
28
Issue
11
Pages
15223-15243
ISSN
  • 1360-2357
  • 1573-7608
DOI
10.1007/s10639-023-11805-6
Cited by
80
References
14
Language
en
Update notices
correction (2026-04-24)
Licence
Funders
National Research Foundation of Korea (NRF-2020R1A2C1014957)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Effect of chatbot-assisted language learning: A meta-analysis. https://app.cochat.ai/papers/10.1007/s10639-023-11805-6
The paper
Zhang, S., Shan, C., Lee, J. S. Y., Che, S., & Kim, J. H. (2023). Effect of chatbot-assisted language learning: A meta-analysis. Education and Information Technologies. https://doi.org/10.1007/s10639-023-11805-6

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.