Artificial Intelligence Supporting Independent Student Learning: An Evaluative Case Study of ChatGPT and Learning to Code
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
Artificial intelligence (AI) tools like ChatGPT demonstrate the potential to support personalized and adaptive learning experiences. This study explores how ChatGPT can facilitate self-regulated learning processes and learning computer programming. An evaluative case study design guided the investigation of ChatGPT’s capabilities to aid independent learning. Prompts mapped to self-regulated learning processes elicited ChatGPT’s support across learning tools: instructional materials, content tools, assessments, and planning. Overall, ChatGPT provided comprehensive, tailored guidance on programming concepts and practices. It consolidated multimodal information sources into integrated explanations with examples. ChatGPT also effectively assisted planning by generating detailed schedules. However, its interactivity and assessment functionality demonstrated shortcomings. ChatGPT’s effectiveness relies on learners’ metacognitive skills to seek help and assess its limitations. The implications include ChatGPT’s potential to provide Bloom’s two-sigma tutoring benefit at scale.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 1×
“We should expect this consistency given that the contributions to online communities appear to significantly contribute to the major LLMs (per the inclusion of the Common Crawl Data Set reported by AI researchers) [45].”
BackgroundHattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905 · cited 1×
“Effective and immediate feedback is a vital component of learning [34].”
BackgroundBecoming a Self-Regulated Learner: An Overview
Zimmerman, B. J. (2002) · Theory Into Practice · doi:10.1207/s15430421tip4102_2 · Cited by 10,197 · cited 4×
“This necessitates a more active role for students in the learning process consistent with SRL [21].”
BackgroundMethodInfluentialZawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-019-0171-0 · Cited by 7,242 · cited 2×
“Generative AI applications offer new pedagogical opportunities for learning and teaching purposes, for example, in the ability to help teachers evaluate and upgrade the teaching and learning processes in the classroom and facilitate the planning and implementation of lessons [3].”
BackgroundThe 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring
BLOOM, B. S. (1984) · Educational Researcher · doi:10.3102/0013189x013006004 · Cited by 2,734 · cited 2×
“While controlled studies will need to verify this, achievement gains produced by AI tutors can rival Bloom’s human tutor findings from 40 years ago [16].”
BackgroundVanLEHN, K. (2011) · Educational Psychologist · doi:10.1080/00461520.2011.611369 · Cited by 2,323
Cognitive Load Theory and Complex Learning: Recent Developments and Future Directions
van Merriënboer, J. J. G., & Sweller, J. (2005) · Educational Psychology Review · doi:10.1007/s10648-005-3951-0 · Cited by 2,206
Artificial intelligence in higher education: the state of the field
Crompton, H., & Burke, D. (2023) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-023-00392-8 · Cited by 2,010 · cited 2×
“This quick, open introduction of a powerful AI application has greatly expanded recognition of the importance of AIEd, as evidenced by the large number of educational researcher publications in recent years [6].”
BackgroundSchraw, G., Crippen, K. J., & Hartley, K. (2006) · Research in Science Education · doi:10.1007/s11165-005-3917-8 · Cited by 1,529
Self-citationVision, challenges, roles and research issues of Artificial Intelligence in Education
Hwang, G.-J., Xie, H., Wah, B. W., & Gašević, D. (2020) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2020.100001 · Cited by 1,435
Interpreting effect sizes of education interventions
Kraft, M. A. (2020) · Educational Researcher · doi:10.3102/0013189x20912798 · Cited by 1,281
Celik, I. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107468 · Cited by 1,012
Application and theory gaps during the rise of artificial intelligence in education
Chen, X., Xie, H., Zou, D., & Hwang, G.-J. (2020) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2020.100002 · Cited by 1,003
Ouyang, F., Zheng, L., & Jiao, P. (2022) · Education and Information Technologies · doi:10.1007/s10639-022-10925-9 · Cited by 831
Using cognitive psychology to understand GPT-3
Binz, M., & Schulz, E. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2218523120 · Cited by 559 · cited 3×
“As such, researchers are now advocating that AI systems be studied as experimental participants [15].”
BackgroundUse chat gpt to solve programming bugs
Surameery, N. M. S., & Shakor, M. Y. (2023) · International Journal of Information technology and Computer Engineering · doi:10.55529/ijitc.31.17.22 · Cited by 382
Chang, D. H., Lin, M. P.-C., Hajian, S., & Wang, Q. Q. (2023) · Sustainability · doi:10.3390/su151712921 · Cited by 370 · cited 1×
“With the dramatic uptick in generative AI tools, researchers have recently begun to consider design principles to support self-regulated learning broadly [26].”
BackgroundThe Role of Self-Regulation in Programming Problem Solving Process and Success
Loksa, D., & Ko, A. J. (2016) · Proceedings of the 2016 ACM Conference on International Computing Education Research · doi:10.1145/2960310.2960334 · Cited by 143 · cited 1×
“Computer education researchers have found that these processes are fundamental in supporting programming problem solving [22].”
BackgroundProbing the psychology of AI models
Shiffrin, R., & Mitchell, M. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2300963120 · Cited by 70 · cited 2×
“Standardization could assist in developing benchmarks to enable reasonable comparisons across tools [14].”
Background
Cited by
Wang, J., & Fan, W. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-04787-y · Cited by 322
“…work (Chan et al. 2024; Su et al. 2023) and providing targeted, personalized feedback (Escalante et al. 2023; Qi et al. 2024 (Albdrani and Al-Shargabi, 2023; Looi and Jia, 2025) and recommending diverse learning resources based on students ’ needs (Hartley et al. 2024; Jauhiainen and Guerra, 2024).”
RetractedShata, A., & Hartley, K. (2025) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-025-00511-7 · Cited by 127
Self-citationSardi, J., Darmansyah, Candra, O., Yuliana, D. F., Habibullah, Yanto, D. T. P., & Eliza, F. (2025) · International Journal of Engineering Pedagogy (iJEP) · doi:10.3991/ijep.v15i1.53379 · Cited by 105
Banihashem, S. K., Bond, M., Bergdahl, N., Khosravi, H., & Noroozi, O. (2025) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-025-00548-8 · Cited by 82
Does ChatGPT Help Novice Programmers Write Better Code? Results From Static Code Analysis
Haindl, P., & Weinberger, G. (2024) · IEEE Access · doi:10.1109/access.2024.3445432 · Cited by 45
“Hartley et al. [29] assessed ChatGPT’s role in supporting independent coding learning, examining its effectiveness in delivering instructional materials, feedback, and planning.”
BackgroundResult
Metadata
- Authors
- Hartley, K., Hayak, M., & Ko, U. H.
- Venue
- Education Sciences
- Publisher
- MDPI AG
- Published
- 2024-01-24
- Volume
- 14
- Issue
- 2
- Pages
- 120
- ISSN
- 2227-7102 (ISSN-L)
- OpenAlex
- W4391211285
- Cited by
- 84
- References
- 19
- FWCI
- 31.76
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.