The DOI matches its Crossref record; 103 of the 104 references it cites were found in a registry or an index.
The effectiveness of ChatGPT in assisting high school students in programming learning: evidence from a quasi-experimental research
Open accessAbstract
Programming education gains importance in high schools as the digital age progresses. However, the openness and adaptability of programming languages present unique challenges for instructional practices compared to other subjects. While traditional instructional tools offer limited support, ChatGPT, a groundbreaking Generative Artificial Intelligence, has shown impressive capabilities in natural language processing and knowledge generation. This study explored whether ChatGPT can transcend existing limitations and improve programming education through a quasi-experimental approach with post-hoc interviews in high school classrooms. A total of 153 students participated, and the results from MANCOVA and ANCOVA analyses revealed that students using ChatGPT reported lower levels of flow experience, self-efficacy, and learning achievement compared to those utilizing conventional methods. Post-hoc interviews further revealed that students felt ChatGPT's effectiveness in facilitating their programming learning fell short of their initial expectations. These findings highlight the need to carefully consider the complexity of programming learning tasks and students' cognitive, affective, and interactive dimensions when integrating AI technologies into education. We discuss the implications and provide thorough pedagogical strategies, specifically the guidance–practice–transformation (G–P–T) mode, to maximize the potential of AI tools and support high school programming education, emphasizing the balance of technological innovation with learning best practices.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Some studies document confusion, frustration, and other negative emotions driven by mistrust, technical limits, or unmet expectations [78,87,93,98], and even declines in self-efficacy [140].”
From A Systematic Review of Generative AI in K–12: Mapping Goals, Activities, Roles, and Outcomes via the 3P Model (2025) · cites this paper as [140]
Citations
Cites
Self-efficacy: The exercise of control
Bandura, A., Freeman, W. H., & Lightsey, R. (1999) · Journal of Cognitive Psychotherapy · doi:10.1891/0889-8391.13.2.158 · Cited by 46,835
Kallio, H., Pietilä, A., Johnson, M., & Kangasniemi, M. (2016) · Journal of Advanced Nursing · doi:10.1111/jan.13031 · Cited by 4,295
Lye, S. Y., & Koh, J. H. L. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.09.012 · Cited by 1,421
Examining Science Education in ChatGPT: An Exploratory Study of Generative Artificial Intelligence
Cooper, G. (2023) · Journal of Science Education and Technology · doi:10.1007/s10956-023-10039-y · Cited by 1,263
Lund, B. D., Wang, T., Mannuru, N. R., Nie, B., Shimray, S., & Wang, Z. (2023) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24750 · Cited by 919
Chatbots applications in education: A systematic review
Okonkwo, C. W., & Ade-Ibijola, A. (2021) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2021.100033 · Cited by 879
ChatGPT for (Finance) research: The Bananarama Conjecture
Dowling, M., & Lucey, B. M. (2023) · Finance research letters · doi:10.1016/j.frl.2023.103662 · Cited by 648
Assessing computational thinking: A systematic review of empirical studies
Tang, X., Yin, Y., Lin, Q., Hadad, R., & Zhai, X. (2020) · Computers & Education · doi:10.1016/j.compedu.2019.103798 · Cited by 647
Abstracts written by ChatGPT fool scientists
Else, H. (2023) · Nature · doi:10.1038/d41586-023-00056-7 · Cited by 611
Mousavinasab, E., Zarifsanaiey, N., R. Niakan Kalhori, S., Rakhshan, M., Keikha, L., & Ghazi Saeedi, M. (2021) · Interactive Learning Environments · doi:10.1080/10494820.2018.1558257 · Cited by 605
Research works printed but not linked: 2
- 10.1016/S0747-5632(04)00036-6 · DOI
- Yang, T. C., Hwang, G. J., Yang, S. J., & Hwang, G. H. (2015). A two-tier test-based approach to improving students’ computer-programming skills in a web-based learning environment. Journal of Educational Technology & Society, 18(1), 198–210.
Cited by
Sorted by citations
Wang, J., & Fan, W. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-04787-y · Cited by 322
RetractedGenerative AI use in K-12 education: a systematic review
Alfarwan, A. M. (2025) · Frontiers in Education · doi:10.3389/feduc.2025.1647573 · Cited by 162
Vallejo, U. C., ROMANI, G., Inca, K. S. M., Zegel, I. D. E. S., Loza, G. E. S., Gonzaga, U. N. S. L., FRANCO, A. M., Gonzaga, U. N. S. L., Choque, M. K. O., & Gonzaga, U. N. S. L. (2025) · ESPACIOS · doi:10.48082/espacios-a25v46n03p02 · Cited by 32
ChatGPT as a cognitive crutch: Evidence from a randomized controlled trial on knowledge retention
Barcaui, A. (2025) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2025.102287 · Cited by 51
Tao, S., Lan, M., Wang, M., & Li, H. (2026) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2026.100561 · Cited by 34
Metadata
- Authors
- Yang, T.-C., Hsu, Y.-C., & Wu, J.-Y.
- Affiliations
- National Yang Ming Chiao Tung University (TW)
- Tainan First Senior High School (TW)
- Southern Methodist University (US)
- Corresponding author
- Yang, Tzu-Chi
- Venue
- Interactive Learning Environments
- Publisher
- Informa UK Limited
- Published
- 2025-01-16
- Volume
- 33
- Issue
- 6
- Pages
- 3726-3743
- ISSN
- 1049-4820 (ISSN-L)
- 1744-5191
- OpenAlex
- W4406474705
- Cited by
- 80
- References
- 104
- Citations by year
- 2026: 63 · 2025: 17
- FWCI
- 71.05
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Interactive Learning Environments (publishedVersion, cc-by)
- Funders
- National Science and Technology Council (111-2410-H-A49-066-MY3)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Social Sciences › Education › Artificial Intelligence in Education
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Keywords
- ChatGPT, generative AI, programming education, high school students, flow experience, self-efficacy, academic performance, artificial intelligence in education, student perceptions of AI tools
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review