The effectiveness of ChatGPT on pre-service teachers' STEM teaching literacy, learning performance, and cognitive load in a teacher training course
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Within the realm of teacher education, effective tools as support can enhance pre-service teachers' comprehension of STEM concepts and their ability to tackle with complex problems. This research aims to empirically investigate the impact of ChatGPT-supported collaborative learning on pre-service teachers' STEM teaching literacy, learning performance, and cognitive load. A total of 36 sophomore undergraduate pre-service teachers participated in an 8-week quasi-experimental study (with classes lasting 3 hours each week). These pre-service teachers were tasked with creating teaching aids and simulating instructional sessions. The experimental group engaged in small-group collaborative learning assisted by ChatGPT (N=21), while the control group (N=15) conducted conventional collaborative learning. The results indicate that pre-service teachers using ChatGPT demonstrated superior performance in terms of learning performance and cognitive load, though the improvement in STEM teaching literacy was not evident. However, ChatGPT contributed to students' acquisition and comprehension of STEM teaching knowledge. In essence, within a collaborative learning context, ChatGPT exhibits significant potential in addressing complex issues and offering personalized support but also we should mitigate potential risks. Collaborative learning with human-machine co-creation is poised to be a trend in the future of education, offering innovative avenues for the cultivation of STEM pre-service teachers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Social psychology of creativity: A consensual assessment technique.
Amabile, T. M. (1982) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.43.5.997 · Cited by 2,278
A SWOT analysis of ChatGPT: Implications for educational practice and research
Farrokhnia, M., Banihashem, S. K., Noroozi, O., & Wals, A. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2195846 · Cited by 1,384
Teachers’ Perception of STEM Integration and Education: A Systematic Literature Review
Margot, K. C., & Kettler, T. (2019) · International Journal of STEM Education · doi:10.1186/s40594-018-0151-2 · Cited by 992 · cited 1×
“…difficulties arise in integrating STEM content, coping with the complexity of various technological applications, and dealing with the delayed scaffolding provided, leading to lack of effective learning strategies and meth-ods for pre-service teachers’ STEM teaching literacy development [2].”
BackgroundEngineering Education in the Era of ChatGPT: Promise and Pitfalls of Generative AI for Education
Qadir, J. (2023) · 2023 IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon54358.2023.10125121 · Cited by 707 · cited 1×
“This facilitates the generation of creative solutions, the provision of personalized learning resources, and the stimulation of both divergent and convergent individual thinking [8].”
BackgroundAcceptance of artificial intelligence among pre-service teachers: A multigroup analysis
Zhang, C., Schießl, J., Plößl, L., Hofmann, F., & Gläser-Zikuda, M. (2023) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00420-7 · Cited by 413
Kim, C., Kim, D., Yuan, J., Hill, R. B., Doshi, P., & Thai, C. N. (2015) · Computers & Education · doi:10.1016/j.compedu.2015.08.005 · Cited by 344 · cited 1×
“While intelligent agents like ChatGPT can enhance teacher engagement [17], the improvement in teaching literacy remains slow.”
BackgroundKim, N. J., Belland, B. R., & Walker, A. E. (2018) · Educational Psychology Review · doi:10.1007/s10648-017-9419-1 · Cited by 220 · cited 1×
“In a STEM teacher training course learning, several challenges often arise, including the lack of personalized guidance, limited group interactions, rigid problem-solving paths, and difficulties in integrating disciplinary knowledge [10].”
Background
Cited by
Does ChatGPT enhance student learning? A systematic review and meta-analysis of experimental studies
Deng, R., Jiang, M., Yu, X., Lu, Y., & Liu, S. (2025) · Computers & Education · doi:10.1016/j.compedu.2024.105224 · Cited by 531
Wang, J., & Fan, W. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-04787-y · Cited by 322
RetractedSun, L., & Zhou, L. (2024) · Journal of Educational Computing Research · doi:10.1177/07356331241277937 · Cited by 129
“For example, Ji et al. (2023) showed that college students using ChatGPT excelled in academic performance and cognitive load, but did not show signi fi cant improvements in STEM pedagogical literacy.”
Li, T., Ji, Y., & Zhan, Z. (2024) · Asia Pacific Journal of Education · doi:10.1080/02188791.2024.2305163 · Cited by 133
Self-citationLiu, X., Guo, B., He, W., & Hu, X. (2025) · Journal of Educational Computing Research · doi:10.1177/07356331251329185 · Cited by 89
Metadata
- Authors
- Ji, Y., Zou, X., Li, T., & Zhan, Z.
- Venue
- Proceedings of the 2023 6th International Conference on Educational Technology Management
- Publisher
- ACM
- Published
- 2023-11-03
- Pages
- 16-22
- OpenAlex
- W4391409756
- Cited by
- 29
- References
- 7
- FWCI
- 7.73
- Type
- conference paper
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The effectiveness of ChatGPT on pre-service teachers' STEM teaching literacy, learning performance, and cognitive load in a teacher training course. https://app.cochat.ai/papers/10.1145/3637907.3637948
- The paper
- Ji, Y., Zou, X., Li, T., & Zhan, Z. (2023). The effectiveness of ChatGPT on pre-service teachers' STEM teaching literacy, learning performance, and cognitive load in a teacher training course. Proceedings of the 2023 6th International Conference on Educational Technology Management. https://doi.org/10.1145/3637907.3637948
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.