CoChat

Climate-control ChatGPT for EFL writing and AI literacy

Aldamen, Hesham, Alawneh, Salwa Mohammad, Almashour, Mohamad, Al-Deaibes, Mutasim, Alsharefeen, Rami · 2026 · Frontiers in Artificial Intelligence
Cited by 1

The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.

Abstract

ChatGPT is increasingly used in EFL writing, yet applied linguistics lacks robust methods for measuring whether human-AI dialogue improves learners’ AI literacy, harm-sensitive reasoning, and independent argumentative writing. This mixed-methods quasi-experimental study examines whether climate-control ChatGPT, a prompted interactional design that requires learners to justify, qualify, counterexample, and re-author their own claims, produces stronger gains than standard ChatGPT use and no-ChatGPT instruction. The study involved 120 undergraduate EFL learners in six intact second-year academic writing sections at a public university in Jordan. Participants were assigned to no-ChatGPT control, standard ChatGPT, or climate-control ChatGPT conditions. Data included no-AI diagnostic, pretest, posttest, and delayed transfer essays; ChatGPT dialogue logs; first and final drafts; learner reflections; uptake traces; stimulated-recall interviews; and 9,113 HARM-CAL annotated language units. HARM-CAL, Harm-sensitive Reasoning and Anthropomorphism Calibration in Language, classified learner language for naïve relativism, moral imposition, harm-sensitive reasoning, AI anthropomorphism, calibrated AI literacy, and reflective uncertainty. Results showed that the climate-control condition produced the largest gains in harm-sensitive AI literacy and argumentative writing quality, with advantages maintained on delayed no-AI transfer. It also reduced direct uptake, increased self-repair and authorial control, and strengthened calibrated distinctions between AI output competence and consciousness. The study contributes a classroom-tested intervention and a transparent computational framework that combines reproducible annotation procedures, a fully specified TF-IDF baseline, and archived transformer-family classifier outputs for analyzing responsible AI literacy in second-language argumentation.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3389/frai.2026.1869343

Cites

20 of 20 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 29

  1. Alnemrat, 2025, AI vs. teacher feedback on EFL argumentative writing: a quantitative study, Front. Educ., 10, 1614673, 10.3389/feduc.2025.1614673 · DOI
  2. Blended learning with AI role-play in English for tourism and hospitality 103067 Aldamen H. Almashour M. Al-Deaibes M. Jarrah M. Alsharefeen R. Social Sciences & Humanities Open 14 · DOI
  3. Artstein, 2008, Survey article: inter-coder agreement for computational linguistics, Comput. Linguist., 34, 555, 10.1162/coli.07-034-R2 · DOI · Paper page
  4. Aull, 2014, Linguistic markers of stance in early and advanced academic writing: a corpus-based comparison, Written Commun., 31, 151, 10.1177/0741088314527055 · DOI · Paper page
  5. Bates, 2015, Fitting linear mixed-effects models using lme4, J. Stat. Softw., 67, 1, 10.18637/jss.v067.i01 · DOI · Paper page
  6. Braun, 2021, To saturate or not to saturate? Questioning data saturation as a useful concept for thematic analysis and sample-size rationales, Qual. Res. Sport, Exerc. Health, 13, 201, 10.1080/2159676X.2019.1704846 · DOI · Paper page
  7. Cohen, 1960, A coefficient of agreement for nominal scales, Educ. Psychol. Meas., 20, 37, 10.1177/001316446002000104 · DOI · Paper page
  8. D'Mello, 2014, Confusion can be beneficial for learning, Learn. Instr., 29, 153, 10.1016/j.learninstruc.2012.05.003 · DOI · Paper page
  9. Gebru, 2021, Datasheets for datasets, Commun. ACM, 64, 86, 10.1145/3458723 · DOI · Paper page
  10. Greene, 2001, An fMRI investigation of emotional engagement in moral judgment, Science, 293, 2105, 10.1126/science.1062872 · DOI · Paper page
  11. Guetterman, 2015, Integrating quantitative and qualitative results in health science mixed methods research through joint displays, Ann. Fam. Med., 13, 554, 10.1370/afm.1865 · DOI · Paper page
  12. Kohnke, 2023, ChatGPT for language teaching and learning, RELC J., 54, 537, 10.1177/00336882231162868 · DOI · Paper page
  13. Kyle, 2015, Automatically assessing lexical sophistication: indices, tools, findings, and application, TESOL Q., 49, 757, 10.1002/tesq.194 · DOI · Paper page
  14. Ladson-Billings, 1995, Toward a theory of culturally relevant pedagogy, Am. Educ. Res. J., 32, 465, 10.3102/00028312032003465 · DOI · Paper page
  15. Li, 2024, Evaluating the role of ChatGPT in enhancing EFL writing assessments in classroom settings: a preliminary investigation, Humanit. Soc. Sci. Commun., 11, 1268, 10.1057/s41599-024-03755-2 · DOI
  16. Lu, 2024, Can ChatGPT effectively complement teacher assessment of undergraduate students’ academic writing?, Assess. Eval. High. Educ., 49, 616, 10.1080/02602938.2024.2301722 · DOI · Paper page
  17. Mercer, 2012, Explaining the dialogic processes of teaching and learning: the value and potential of sociocultural theory, Learn. Cult. Soc. Interact., 1, 12, 10.1016/j.lcsi.2012.03.001 · DOI · Paper page
  18. Nakagawa, 2013, A general and simple method for obtaining R2 from generalized linear mixed-effects models, Methods Ecol. Evol., 4, 133, 10.1111/j.2041-210x.2012.00261.x · DOI · Paper page
  19. Papi, 2024, When good and reproducible results are a giant with feet of clay: the importance of software quality in NLP, Proc. 62nd Annu. Meet. Assoc. Comput. Linguist, 1, 3657, 10.18653/v1/2024.acl-long.200 · DOI
  20. Paris, 2012, Culturally sustaining pedagogy: a needed change in stance, terminology, and practice, Educ. Res., 41, 93, 10.3102/0013189X12441244 · DOI · Paper page
  21. Plonsky, 2014, How big is big? Interpreting effect sizes in L2 research, Lang. Learn., 64, 878, 10.1111/lang.12079 · DOI · Paper page
  22. Polio, 2017, Second language writing development: a research agenda, Lang. Teach., 50, 261, 10.1017/S0261444817000015 · DOI · Paper page
  23. Praphan, 2023, AI technologies in the ESL/EFL writing classroom: the villain or the champion?, J. Second. Lang. Writ., 62, 101072, 10.1016/j.jslw.2023.101072 · DOI
  24. Reimers, 2019, Sentence-BERT: sentence embeddings using Siamese BERT-networks, Proc. EMNLP-IJCNLP, 22, 3982, 10.18653/v1/D19-1410 · DOI · Paper page
  25. Samuel, 2023, Cultivation of human centered artificial intelligence: culturally adaptive thinking in education (CATE) for AI, Front. Artif. Intell., 6, 1198180, 10.3389/frai.2023.1198180 · DOI
  26. Storks, 2023, NLP reproducibility for all: understanding experiences of beginners, Proc. 61st Annu. Meet. Assoc. Comput. Linguist, 1, 10199, 10.18653/v1/2023.acl-long.568 · DOI
  27. Su, 2023, Collaborating with ChatGPT in argumentative writing classrooms, Assess. Writ., 57, 100752, 10.1016/j.asw.2023.100752 · DOI · Paper page
  28. Yang, 2024, ChatGPT for L2 learning: current status and implications, System, 124, 103351, 10.1016/j.system.2024.103351 · DOI
  29. Zhang, 2024, Artificial intelligence in EFL speaking: impact on enjoyment, anxiety, and willingness to communicate, System, 121, 103259, 10.1016/j.system.2024.103259 · DOI · Paper page

Metadata

Authors
Aldamen, H., Alawneh, S. M., Almashour, M., Al-Deaibes, M., & Alsharefeen, R.
Venue
Frontiers in Artificial Intelligence
Published
2026-07-22
Volume
9
ISSN
2624-8212
Cited by
1
References
20

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.