Exploring ChatGPT literacy in language education: A global perspective and comprehensive approach
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
With the widespread use of Generative AI in education, effectively utilizing and integrating it into teaching have become key focal points and challenges in education. Different subjects and target audiences require varied norms and strategies for implementing Generative AI, such as ChatGPT. These differences directly impact the educational integration of Generative AI in various educational contexts. To address these disparities and establish common ground, we propose the concept of ChatGPT literacy to bridge research gaps. In this study, we tailor the concept of ChatGPT literacy specifically for language teachers, aiming to delineate the essential competencies needed to proficiently and ethically use ChatGPT as a language learning and teaching tool. We propose a theoretical framework encompassing six fundamental constructs: benefits, limitations, prompts, evaluation (of ChatGPT responses), assessment (assisted by ChatGPT), and ethics, to comprehensively conceptualise and evaluate ChatGPT literacy. Drawing on both quantitative and qualitative survey data from 492 language teachers across 41 countries, we validate the proposed ChatGPT literacy framework by examining teachers' practices and challenges associated with ChatGPT usage. Our analysis of Likert-scale data, utilizing item and confirmatory techniques, confirms the effectiveness of the six-construct framework in defining ChatGPT literacy. In addition, we collected qualitative data through open questions and conducted thematic analysis, demonstrating that ChatGPT has been integrated throughout the instructional cycle, from material preparation to formative and summative assessment phases. These quantitative and qualitative findings have significant implications for a range of stakeholders, including language educators, learners, AI technology developers, and policymakers, providing valuable insights to inform decisions regarding ChatGPT integration in language education. Ultimately, our study equips relevant stakeholders with the necessary competencies to responsibly exploiting ChatGPT's potential in language and other subject areas.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · doi:10.35542/osf.io/5er8f · Cited by 7,552
ChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326
A Brief Tutorial on the Development of Measures for Use in Survey Questionnaires
Hinkin, T. R. (1998) · Organizational Research Methods · doi:10.1177/109442819800100106 · Cited by 4,095
BAİDOO-ANU, D., & OWUSU ANSAH, L. (2023) · Journal of AI · doi:10.61969/jai.1337500 · Cited by 3,939
What is AI Literacy? Competencies and Design Considerations
Long, D., & Magerko, B. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376727 · Cited by 3,241
Baidoo-Anu, D., & Owusu Ansah, L. (2023) · doi:10.2139/ssrn.4337484 · Cited by 3,004
Ray, P. P. (2023) · Internet of Things and Cyber-Physical Systems · doi:10.1016/j.iotcps.2023.04.003 · Cited by 2,463
What Is the Impact of ChatGPT on Education? A Rapid Review of the Literature
Lo, C. K. (2023) · Education Sciences · doi:10.3390/educsci13040410 · Cited by 2,024
ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.1.9 · Cited by 1,806
Artificial hallucinations in ChatGPT: implications in scientific writing
Alkaissi, H., & McFarlane, S. I. (2023) · Cureus · doi:10.7759/cureus.35179 · Cited by 1,540
ChatGPT for Language Teaching and Learning
Kohnke, L., Moorhouse, B. L., & Zou, D. (2023) · RELC Journal · doi:10.1177/00336882231162868 · Cited by 1,371
Self-citationWang, B., Rau, P.-L. P., & Yuan, T. (2023) · Behaviour & Information Technology · doi:10.1080/0144929x.2022.2072768 · Cited by 1,036
Huang, W., Hew, K. F., & Fryer, L. K. (2022) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12610 · Cited by 830
ChatGPT: Jack of all trades, master of none
Kocoń, J., Cichecki, I., Kaszyca, O., Kochanek, M., Szydło, D., Baran, J., Bielaniewicz, J., Gruza, M., Janz, A., Kanclerz, K., et al. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101861 · Cited by 758
Exploring the potential of using an AI language model for automated essay scoring
Mizumoto, A., & Eguchi, M. (2023) · Research Methods in Applied Linguistics · doi:10.1016/j.rmal.2023.100050 · Cited by 647
The opportunities and challenges of ChatGPT in education
Adeshola, I., & Adepoju, A. P. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2023.2253858 · Cited by 517
Liang, J.-C., Hwang, G.-J., Chen, M.-R. A., & Darmawansah, D. (2023) · Interactive Learning Environments · doi:10.1080/10494820.2021.1958348 · Cited by 378
Hadi Mogavi, R., Deng, C., Juho Kim, J., Zhou, P., D. Kwon, Y., Hosny Saleh Metwally, A., Tlili, A., Bassanelli, S., Bucchiarone, A., Gujar, S., et al. (2024) · Computers in Human Behavior: Artificial Humans · doi:10.1016/j.chbah.2023.100027 · Cited by 369
Impact of ChatGPT on Learning Motivation: Teachers and Students' Voices
Ali, J. K. M., Shamsan, M. A. A., Hezam, T. A., & Mohammed, A. A. Q. (2023) · Journal of English Studies in Arabia Felix · doi:10.56540/jesaf.v2i1.51 · Cited by 335
Trends, Research Issues and Applications of Artificial Intelligence in Language Education
(2023) · DOAJ (DOAJ: Directory of Open Access Journals) · doi:10.30191/ets.202301_26(1).0009 · Cited by 290
Self-citationAI and English language teaching: Affordances and challenges
Crompton, H., Edmett, A., Ichaporia, N., & Burke, D. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13460 · Cited by 282
Korzynski, P., Mazurek, G., Krzypkowska, P., & Kurasinski, A. (2023) · Entrepreneurial Business and Economics Review · doi:10.15678/eber.2023.110302 · Cited by 235
Assessing the Usability of ChatGPT for Formal English Language Learning
Shaikh, S., Yayilgan, S. Y., Klimova, B., & Pikhart, M. (2023) · European Journal of Investigation in Health, Psychology and Education · doi:10.3390/ejihpe13090140 · Cited by 183
Liesenfeld, A., Lopez, A., & Dingemanse, M. (2023) · Proceedings of the 5th International Conference on Conversational User Interfaces · doi:10.1145/3571884.3604316 · Cited by 111
Can large language models write reflectively
Li, Y., Sha, L., Yan, L., Lin, J., Raković, M., Galbraith, K., Lyons, K., Gašević, D., & Chen, G. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2023.100140 · Cited by 99
Cited by
Does ChatGPT enhance student learning? A systematic review and meta-analysis of experimental studies
Deng, R., Jiang, M., Yu, X., Lu, Y., & Liu, S. (2025) · Computers & Education · doi:10.1016/j.compedu.2024.105224 · Cited by 531
The grass is not always greener: Teacher vs. GPT-assisted written corrective feedback
Lin, S., & Crosthwaite, P. (2024) · System · doi:10.1016/j.system.2024.103529 · Cited by 86
Self-citationAbdallah, N., Katmah, R., Khalaf, K., & Jelinek, H. F. (2025) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2025.101866 · Cited by 55
Integrating AI technology into corpus-based language learning through ChatAI
Anthony, L. (2025) · Computer Assisted Language Learning · doi:10.1080/09588221.2025.2589747 · Cited by 7
Metadata
- Authors
- Ma, Q., Crosthwaite, P., Sun, D., & Zou, D.
- Venue
- Computers and Education: Artificial Intelligence
- Publisher
- Elsevier BV
- Published
- 2024-12
- Volume
- 7
- Pages
- 100278
- ISSN
- 2666-920X (ISSN-L)
- OpenAlex
- W4401465392
- Cited by
- 93
- References
- 27
- FWCI
- 35.59
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.