Experiences from Using Code Explanations Generated by Large Language Models in a Web Software Development E-Book
Open accessThe DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
Advances in natural language processing have resulted in large language models (LLMs) that can generate code and code explanations. In this paper, we report on our experiences generating multiple code explanation types using LLMs and integrating them into an interactive e-book on web software development. Three different types of explanations -- a line-by-line explanation, a list of important concepts, and a high-level summary of the code -- were created. Students could view explanations by clicking a button next to code snippets, which showed the explanation and asked about its utility. Our results show that all explanation types were viewed by students and that the majority of students perceived the code explanations as helpful to them. However, student engagement varied by code snippet complexity, explanation type, and code snippet length. Drawing on our experiences, we discuss future directions for integrating explanations generated by LLMs into CS classrooms.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This has been inspired by many other instances where LLMs have already demonstrated remarkable effectiveness in generating novel language artifacts. These include course readings [22], code explanations [23, 28, 29, 41], model solutions [9, 35, 42], feedback [34], or responses to help requests [18, 26, 46, 47].”
From A Comparative Study of AI-Generated (GPT-4) and Human-crafted MCQs in Programming Education (2024) · cites this paper as [28]
In the citing paper
“On the other hand, recent work has shown that AI tools can be used to produce high-quality learning resources, including programming exercises [32], explanations of code [24,28], and even on-demand feedback to students [27].”
From Instructor Perceptions of AI Code Generation Tools - A Multi-Institutional Interview Study (2024) · cites this paper as [28]
In the citing paper
“MacNeil et al. found that students generally found code explanations generated by LLMs useful for learning, but the perceived utility of the explanations and students' engagement with them varied by explanation type [137].”
From The Robots Are Here: Navigating the Generative AI Revolution in Computing Education (2023) · cites this paper as [137]
In the citing paper
“However, non-code models such as GPT-3 have been found to be more apt at creating higher level code explanations [137].”
From The Robots Are Here: Navigating the Generative AI Revolution in Computing Education (2023) · cites this paper as [137]
In the citing paper
“Students rated these explanations on a 5-point Likert scale, confirming that explanations matched the code and were useful for learning in general, whereas line-by-line explanations were rated as least helpful.”
From The Robots Are Here: Navigating the Generative AI Revolution in Computing Education (2023) · cites this paper as [137]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Vaithilingam, P., Zhang, T., & Glassman, E. L. (2022) · CHI Conference on Human Factors in Computing Systems Extended Abstracts · doi:10.1145/3491101.3519665 · Cited by 660
Review of recent systems for automatic assessment of programming assignments
Ihantola, P., Ahoniemi, T., Karavirta, V., & Seppälä, O. (2010) · Proceedings of the 10th Koli Calling International Conference on Computing Education Research · doi:10.1145/1930464.1930480 · Cited by 554 · cited 1×
“through the use of automated grading systems [1, 18, 30].”
MethodAutomatic Generation of Programming Exercises and Code Explanations Using Large Language Models
Sarsa, S., Denny, P., Hellas, A., & Leinonen, J. (2022) · Proceedings of the 2022 ACM Conference on International Computing Education Research - Volume 1 · doi:10.1145/3501385.3543957 · Cited by 497 · cited 8×
“Explanations of code can also be generated by LLMs [24, 37].”
BackgroundMethodInfluentialSelf-citationOnline python tutor: embeddable web-based program visualization for cs education
Guo, P. J. (2013) · Proceeding of the 44th ACM technical symposium on Computer science education · doi:10.1145/2445196.2445368 · Cited by 396
Designing the whyline: a debugging interface for asking questions about program behavior
Ko, A. J., & Myers, B. A. (2004) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985712 · Cited by 361
PeerWise: students sharing their multiple choice questions
Denny, P., Hamer, J., Luxton-Reilly, A., & Purchase, H. (2008) · Proceedings of the Fourth international Workshop on Computing Education Research · doi:10.1145/1404520.1404526 · Cited by 211
Self-citationPair programming in education: a literature review
Hanks, B., Fitzgerald, S., McCauley, R., Murphy, L., & Zander, C. (2011) · Computer Science Education · doi:10.1080/08993408.2011.579808 · Cited by 205 · cited 1×
“For example in pair programming, students work together which requires them to often explain their code and their thinking process to their partner [16].”
BackgroundGenerating Diverse Code Explanations using the GPT-3 Large Language Model
MacNeil, S., Tran, A., Mogil, D., Bernstein, S., Ross, E., & Huang, Z. (2022) · Proceedings of the 2022 ACM Conference on International Computing Education Research - Volume 2 · doi:10.1145/3501709.3544280 · Cited by 200 · cited 6×
“In computer science classrooms, LLMs are beginning to be used to generate assignments [36], help students to write their code [3, 40], and to generate explanations of code snippets to facilitate learning [23].”
BackgroundMethodInfluentialSelf-citationWheel-Spinning: Students Who Fail to Master a Skill
Beck, J. E., & Gong, Y. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-39112-5_44 · Cited by 161 · cited 1×
“However, these grading systems have become increasingly focused on providing formative feedback such as hints [31, 34] error-specific feedback [24, 34] to help students avoid getting stuck in counterproductive behaviors when their answers are incorrect [4].”
BackgroundiSnap: Towards Intelligent Tutoring in Novice Programming Environments
Price, T. W., Dong, Y., & Lipovac, D. (2017) · Proceedings of the 2017 ACM SIGCSE Technical Symposium on Computer Science Education · doi:10.1145/3017680.3017762 · Cited by 140
Research works printed but not linked: 12
- Kirsti M Ala-Mutka. 2005. A survey of automated assessment approaches for programming assignments. Computer science education, Vol. 15, 2 (2005), 83--102.
- Jacob Austin Augustus Odena Maxwell Nye Maarten Bosma Henryk Michalewski David Dohan Ellen Jiang Carrie Cai Michael Terry Quoc Le and Charles Sutton. 2021. Program Synthesis with Large Language Models. arxiv: 2108.07732 [cs.PL] · arXiv
- Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell Sandhini Agarwal Ariel Herbert-Voss Gretchen Krueger Tom Henighan Rewon Child Aditya Ramesh Daniel M. Ziegler Jeffrey Wu Clemens Winter Christopher Hesse Mark Chen Eric Sigler Mateusz Litwin Scott Gray Benjamin Chess Jack Clark Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever and Dario Amodei. 2020. Language Models are Few-Shot Learners. In Advances in neural information processing systems. 1877--1901.
- Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, et al. 2021. Evaluating large language models trained on code. arXiv preprint arXiv:2107.03374 (2021). · arXiv
- James Finnie-Ansley, Paul Denny, Brett A Becker, Andrew Luxton-Reilly, and James Prather. 2022. The Robots Are Coming: Exploring the Implications of OpenAI Codex on Introductory Programming. In Australasian Computing Education Conf. 10--19.
- Katy Ilonka Gero, Vivian Liu, and Lydia Chilton. 2022. Sparks: Inspiration for Science Writing Using Language Models. In Designing Interactive Systems Conf. (Virtual Event, Australia) (DIS '22). ACM, New York, NY, USA, 1002--1019.
- Pengfei Liu, Weizhe Yuan, Jinlan Fu, Zhengbao Jiang, Hiroaki Hayashi, and Graham Neubig. 2021. Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing. arXiv preprint arXiv:2107.13586 (2021). · arXiv
- José Carlos Paiva, José Paulo Leal, and Álvaro Figueira. 2022. Automated Assessment in Computer Science Education: A State-of-the-Art Review. ACM Transactions on Computing Education (TOCE) (2022).
- Jaanus Pöial. 2020. Challenges of Teaching Programming in StackOverflow Era. In International Conf. on Interactive Collaborative Learning. Springer, 703--710.
- Wengran Wang, Yudong Rao, Rui Zhi, Samiha Marwan, Ge Gao, and Thomas W. Price. 2020. Step Tutor: Supporting Students through Step-by-Step Example-Based Feedback. In Proceedings of the 2020 ACM Conf. on Innovation and Technology in Computer Science Education. ACM, New York, NY, USA, 391--397.
- Jacqueline L. Whalley, Raymond Lister, Errol Thompson, Tony Clear, Phil Robbins, P. K. Ajith Kumar, and Christine Prasad. 2006. An Australasian Study of Reading and Comprehension Skills in Novice Programmers, Using the Bloom and SOLO Taxonomies. In Proc. of the 8th Australasian Conf. on Computing Education - Volume 52. Australian Computer Society, Inc., AUS, 243--252.
- Ann Yuan, Andy Coenen, Emily Reif, and Daphne Ippolito. 2022. Wordcraft: Story Writing With Large Language Models. In 27th International Conf. on Intelligent User Interfaces. 841--852.
Cited by
Items 201–271 of 271
Code Ranking with Structure Awareness Contrastive Learning
Huang, H., Cao, L., Wang, J., Yu, T., & Cai, Y. (2025) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc66645.2025.00053 · Cited by 1
“Comparison with Baseline Performance: Table I reports the Pass@k (with k ∈ [1 , 5 , 10] ) for both Code Llama and DeepSeek-coder.”
Sørensen, M. P., Horbach, S. P. J. M., Dorofeeva, O., & Bak, M. S. (2024) · CFA Scientific Reports · doi:10.7146/cfasr.v15i3.157222 · Cited by 2
Generating Code Tours Using Locally-Runnable LLMs
Balfroid, M. (2025) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3696630.3731462 · Cited by 2
Integration of AI Code-Writing Assistants in IT Higher Education
Käver, A., Leoste, J., Marmor, K., & Rodríguez-Piñero, P. T. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-032-07989-3_4 · Cited by 3
AI Chatbots vs. Traditional Search: A Comparative Study on Student Information Retrieval
Pasquarelli, L., Koutcheme, C., & Hellas, A. (2025) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie63693.2025.11328491 · Cited by 2
“…especially in programming and programming education, where LLMs can be used to create and solve programming problems [5], [10], [26], [29], improve programming error messages [17], provide code explanations [21], [26], and to provide support for students in need of help [13], [14], [19], [20].”
Self-citationAssessing the Role of Diversity in LLM Explanations for Enhancing Student Understanding
Patel, K., Bernstein, S., Nasimova, R., Denny, P. C., Leinonen, J., & MacNeil, S. (2026) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3770761.3777320 · Cited by 2
Self-citationRobrecht, A., Kowalski, C. R., & Kopp, S. (2026) · Frontiers Comput. Sci. · doi:10.3389/fcomp.2026.1558674 · Cited by 2
Fayed, M. S., & Fayed, A. S. (2026) · Electronics · doi:10.3390/electronics15040903 · Cited by 2
“There is limited empirical evidence on how LLMs behave when asked to construct full-scale frameworks that require architectural consistency, state management, event handling, and long-range reasoning across thousands of lines of code [6,7].”
Effective Use of Large Language Models for Social Constructivism in Computer Science Education
Falkner, N., Leppänen, L., & Leinonen, J. (2026) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3803400.3809392 · Cited by 1
Self-citationPădurean, V.-A., Riegel, K., Barbre, G., Blake, M., Denny, P. C., Gotovos, A., Leinonen, J., MacNeil, S., Prather, J. E., & Singla, A. K. (2026) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3765964.3811639 · Cited by 1
Self-citationKohn, T., Antensteiner, T., Hahnel, C., Kern, B., Keuning, H., Kia, E., Kiesler, N., Komm, D., Marinus, E., Šavelka, J., et al. (2026) · Koli Calling International Conference on Computing Education Research · doi:10.1145/3856208.3856233 · Cited by 2
GuardRails: Automated Suggestions for Clarifying Ambiguous Purpose Statements
Pawagi, M., & Kumar, V. (2023) · Bangalore Annual Compute Conference · doi:10.1145/3627217.3627234 · Cited by 2
“LLMs have been used to support CS education in a variety of ways, including explaining code [16], creating code-writing tasks [16, 22], providing students with hints on such tasks [18], including how to fix syntactic and logical errors [3, 12] .”
MethodCould ChatGPT Be Used for Reviewing Learnersourced Exercises?
Pirttinen, N., & Leinonen, J. (2023) · Koli Calling International Conference on Computing Education Research · doi:10.1145/3631802.3631845 · Cited by 1
Self-citationAli, M., & Xie, B. (2025) · ACM Inroads · doi:10.1145/3734876 · Cited by 2
Dialogagent: An Auto-Engagement Agent for Code Question Answering Data Production
Liang, X., Ren, J., Qi, J., Peng, C., & Jiang, B. (2025) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1109/icse-seip66354.2025.00012 · Cited by 1
“With the rise of Large Language Models (LLMs), a new generation of LLM-based programming assistant tools has emerged, providing developers with powerful capabilities such as code completion [1]–[4], debugging [5]–[7], and natural language-based code understanding [8].”
BoilerSketch: A TA-Supervised, Diagram-First GenAI Practice for Structured Diagrams in CS1/Early CS2Preprint
Dickey, E., Tiwari, V., Sinha, A., & Bejarano, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.00844 · Cited by 1
“Student-facing work has used large language models to make programming error messages more interpretable and actionable for novices [10], and to provide multiple styles of code explanations embedded directly in course materials [11].”
A Comprehensive Evaluation of Large Language Models for Method Name PredictionPreprint
Qian, H., Xu, T., Ding, Z., Liu, W., Zhu, S., Yin, J., Feng, X., Fang, C., Zhao, J., & Sun, W. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4886577
Inžinerinė ir kompiuterinė grafika 2024. Konferencijos straipsnių rinkinys
(2024) · Inžinerinė ir kompiuterinė grafika/Inžinerinė ir kompiuterinė grafika · doi:10.3846/2669-0527.2024
Scaling CS1 Support with Compiler-Integrated Conversational AIPreprint
Renzella, J., Vassar, A., Solano, L. L., & Taylor, A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2408.02378
Miller, S. T., & Busby-Earle, C. (2024) · Lecture notes in networks and systems · doi:10.1007/978-3-031-73128-0_18 · Cited by 1
Cornelison, K. (2025) · EdArXiv (OSF Preprints) · doi:10.35542/osf.io/uqhe2_v1
Generating Distractors for Code Completion Problems: Can LLM Assist Instructors?
Hassany, M., Akhüseyinoğlu, K., Narayanan, A. B. L., Agarwal, A., Šavelka, J., & Brusilovsky, P. L. (2025) · Proceedings of the ... International Florida Artificial Intelligence Research Society Conference · doi:10.32473/flairs.38.1.138995
An Emergent Bottom-Up Categorization of Students’ LLMs Usage in an Undergraduate Research Course
Vasquez, I. O., Mahinpei, R., Elouazizi, N., & Conati, C. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-98462-4_17 · Cited by 2
Maisaroh, M. E., Aisa, A., & Rahmawati, R. D. (2025) · YASIN · doi:10.58578/yasin.v5i5.7191
Leveraging AI to Support High School Students' Mathematical Reasoning Through Writing
Bundock, K., Li, C., Kiuhara, S. A., & Zheng, R. Z. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-2927-7.ch005
Backström, O., & Kihlert, A. (2023) · KTH Publication Database DiVA (KTH Royal Institute of Technology) · Cited by 7
Using Large Language Models to Generate Worked Examples of CS2-Level Programming Questions
Lindvall, V., & Marcus, S. (2024) · KTH Publication Database DiVA (KTH Royal Institute of Technology) · Cited by 2
Aihetamu, R. (2025) · Hogskolan Ihalmstad (Halmstad University) · Cited by 1
Cognitive-Aware Plugin for Vulnerability Feedback
Sanders, A. L., Walia, G., & Cordova, L. P. (2025) · Conference on Information Technology Education · doi:10.1145/3769694.3771158
CodeAid: A Unified AI Solution for Code Language Identification and Insights
Prathik, K., N, S. G. B., Kalasareddy, B., & Tahoor, S. (2025) · IEEE International Conference for Women in Innovation, Technology & Entrepreneurship (ICWITE) · doi:10.1109/icwite64848.2025.11307060
“Sarsa et al. [13] proposed a framework for automating the generation of programming exercises and solutions using LLMs.”
Multimodal Quiz Generation via RAG with LLM-as-Judge Evaluation
Kunuku, M. T., & Dehbozorgi, N. (2025) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie63693.2025.11328244
“Studies such as [9], [11] have shown that while LLMs can help generate educational content, their effectiveness in accurately representing visual context remains limited.”
Decoding AI Impact: Longitudinal Analysis of Code Submissions in Programming MOOCs
Leppänen, L., Leinonen, J., Hellas, A., Kaila, E., & Mannila, L. (2025) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie63693.2025.11328633
Self-citationAji, I. F. S., & Ningsih, R. D. H. U. (2026) · JATI (Jurnal Mahasiswa Teknik Informatika) · doi:10.36040/jati.v10i1.16945
Systematizing AI-Assisted Web Development with the C.O.M.P.A.S.S. Framework and D.I.A.L. Cycle
Pamudji, A. K., Dewi, S. I. S., & Anggitasari, A. A. (2025) · IEEE Student Conference on Research and Development (SCOReD) · doi:10.1109/scored68498.2025.11398971
“These tools are capable of not only generating code but also providing code explanations in a variety of formats, from high-level summaries to line-by-line explanations, proving helpful in both learning and development scenarios [8], [9].”
Evaluating LLMs in the Context of a Functional Programming Course: A Comprehensive Study
Zhang, Y., Pientka, B., & Si, X. (2026) · The Art Science and Engineering of Programming · doi:10.22152/programming-journal.org/2026/11/5 · Cited by 1
Ovalle, M. T. O. (2026) · LATAM Revista Latinoamericana de Ciencias Sociales y Humanidades · doi:10.56712/latam.v7i2.5536
Jarvie-Eggart, M. E., Teahen, J. R., Masker, D. T., Padilla, J., Ureel, L. C., Brown, L. E., Pomerville, S., & Sticken, J. (2026) · Journal of Teaching and Learning with Technology · doi:10.14434/jotlt.v14i1.41701
Descriptive and Univariate Vibe Analysis of Forestry Data with AI and R Statistics
Namuene, K. S., & Mbella, N. N. (2026) · International Journal of Innovative Science and Research Technology (IJISRT) · doi:10.38124/ijisrt/26apr077
Fumanal-Andrés, I. (2026) · IEEE Access · doi:10.1109/access.2026.3699382
Yazılım Mühendisliği Eğitiminde Üretken Yapay Zekânın Bibliyometrik Analiz Yöntemi ile İncelenmesi
Baz, F. Ç., & Keleş, Ş. (2026) · Osmaniye Korkut Ata Üniversitesi Fen Bilimleri Enstitüsü Dergisi · doi:10.47495/okufbed.1766554
AI or Ally? Understanding Student Reliance on GitHub Copilot and Human Peers Through Eye Tracking
Salib, G., & Sharafi, Z. (2026) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2026.3705249
“Previous research has assessed the quality of code and explanations produced by LLMs while examining their impact on programming and computing education [25], [26], [27], and explored their potential integration into development tools [28], [29].”
Chapagain, J., & Rus, V. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29744-0_3
Writing Instructors’ Pedagogical Decisions About Generative AI
Miller, S., & Bosch, N. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29770-9_58
Exploring the Value of Diverse LLM Explanations in Introductory Programming
Bernstein, S., Denny, P. C., Leinonen, J., Patel, K. S. V., Nasimova, R., Littlefield, M., & MacNeil, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.28882
Self-citationC onjuror : A GenAI-Powered Tool to Support Teachers Customizing a Scratch Curriculum
Tran, M. T., Gonzalez-Maldonado, D., & Franklin, D. M. (2026) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3803400.3809362
Beyond Maintenance: A Benchmark and Multi-Agent Framework for Repository-Usage Code Generation
Lin, K., Gong, S., Jatowt, A., Wang, J., & Cai, Y. (2026) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3805712.3808589 · Cited by 1
Balfroid, M., Julien, A., Dzenatan, A., Devroey, X., & Vanderose, B. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.26987
Alzaghoul, E. F., Assaf, A. J., Al-Khatib, T., & Yousef, R. (2026) · International Journal of Modern Education and Computer Science · doi:10.5815/ijmecs.2026.04.06
Uso de LLMs no Agrupamento e Classificação de Estratégias de Programação em Juízes On-line
Aguiar, D., Melo, R., Pires, F., Pessoa, M., & Fernandes, D. (2026) · Anais do Workshop sobre Educação em Computação (WEI) · doi:10.5753/wei.2026.22274
Evaluating LLM-Generated Contextualized Algorithm Design Problems
Goodwin, E., Braught, K., Liu, J., Newar, D. K. P., Gertner, Y., Poulsen, S., & Franklin, D. M. (2026) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3765964.3811658
A Validated Scale Measuring Student Self-Efficacy for Programming with Generative AI
Prather, J. E., Margulieux, L. E., Kharitonova, Y., Yang, Y., Reeves, B. N., Denny, P. C., Benario, J. G., Holmes, E., Spaulding, E., Barbre, G., et al. (2026) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3765964.3811645 · Cited by 2
Self-citationTowards Human-Centered Large Language Models for Personalized Programming Education
Fan, J. (2026) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3765965.3816672
“LLMs have demonstrated strong capabilities in programming support, including solving tasks and generating explanations [6, 9].”
Prompt Writing and Program Quality: An Investigation from a Programming Education Perspective
Nakamura, Y., Ito, W., Nishigata, Y., & Kuramitsu, K. (2026) · Journal of Information Processing · doi:10.2197/ipsjjip.34.648
Bernstein, S., & Sibia, N. (2026) · Koli Calling International Conference on Computing Education Research · doi:10.1145/3856208.3856217
Self-citationDenny, P. C., Leinonen, J., Hellas, A., Sarsa, S., Liut, M., & Khosravi, H. (2026) · Western Canadian Conference on Computing Education · doi:10.1145/3828792.3828801
Self-citationInstructional Governance by Design: A Framework for AI in Computing EducationPreprint
Dickey, E. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.26098
Nathaniel, J. (2026) · UEF eRepo (University of Eastern Finland)
Jang, Y., & Choi, J.-I. (2026) · Applied Sciences · doi:10.3390/app162010056
An Empirical Analysis of LLM Usage in Software Engineering Course Projects
Jeong, H., & Kim, J. (2026) · ACM Transactions on Computing Education · doi:10.1145/3859283
“Existing studies have explored the use of LLM-supported automation to reduce instructors’ workload in course material preparation and assessment [Jury et al. 2024; MacNeil et al. 2023; Sarsa et al. 2022; Zhang et al. 2024], as well as several student-and instructor-facing aspects of LLM adoption.”
Self-citationDiaz-Garcia, J. A., Morcillo-Jiménez, R., Ortiz-Viso, B., & Ruiz, M. D. (2026) · Multidisciplinary Journal for Education Social and Technological Sciences · doi:10.4995/muse.2026.26470
“Versions of Generative AI are now capable of performing these tasks in mathematics (Calonge et al., 2023) and analyze code from programming exercises (MacNeil et al., 2023, Becker et al., 2023a).”
Multi-sourced AI Tutor for Non-Native English Speaker StudentsPreprint
Shen, Y., Ai, X., Wang, W., John, R. J. L., & Syamkumar, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.22163
“Beyond aiding student learning by providing thorough code explanations [12], step-wise worked examples [5], and prompt problems [1], as well as facilitating various instructional activities, LLMs have proven effective as the basis for educational question-answering (QA) systems, or in other words,…”
Code Comprehensor: Hierarchical Documentation and Cross-Modal Retrieval for Large Repositories
Roychowdhury, S., Isaac, J. H. R., Gao, J., Klitte, M., & Corcoran, D. (2026) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme67971.2026.00071
Pindo, J. M. O., Castillo, F. J., Azan, J. P. C., & Rivas, M. A. T. (2026) · Estudios y Perspectivas Revista Científica y Académica · doi:10.61384/r.c.a..v6i4.2133
Yalwa, A. S., Othman, M. S., Yusuf, L. M., & Almarshadi, M. S. (2026) · Cogent Education · doi:10.1080/2331186x.2026.2745324
Πέλλας, Ν. (2026) · Journal of Educational Computing Research · doi:10.1177/07356331261504318
"It's Weird That it Knows What I Want": Usability and Interactions with Copilot for Novice Programmers
Prather, J., Reeves, B. N., Denny, P., Becker, B. A., Leinonen, J., Luxton-Reilly, A., Powell, G., Finnie-Ansley, J., & Santos, E. A. (2023) · arXiv
“Large language models have also been found to be capable of producing pedagogical code explanations [58, 67, 94].”
BackgroundSelf-citation
Metadata
- Authors
- MacNeil, S., Tran, A., Hellas, A., Kim, J., Sarsa, S., Denny, P., Bernstein, S., & Leinonen, J.
- Affiliations
- Temple University (US)
- Aalto University (FI)
- University of Auckland (NZ)
- ORCID
- Venue
- Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 1
- Publisher
- ACM
- Published
- 2023-03-02
- Pages
- 931-937
- OpenAlex
- W4323033814
- Cited by
- 195
- References
- 30
- Citations by year
- 2026: 27 · 2025: 59 · 2024: 79 · 2023: 29
- FWCI
- 58.66
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- ACM Technical Symposium on Computer Science Education (SIGCSE) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Aaltodoc (Aalto University) (submittedVersion, other-oa)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Keywords
- code explanation, large language models, interactive e-books, computer science education, student engagement, explanation types, code generation, code complexity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.