Conversing with Copilot: Exploring Prompt Engineering for Solving CS1 Problems Using Natural Language
Open accessThe DOI matches its Crossref record; 24 of the 25 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
GitHub Copilot is an artificial intelligence tool for automatically generating source code from natural language problem descriptions. Since June 2022, Copilot has officially been available for free to all students as a plug-in to development environments like Visual Studio Code. Prior work exploring OpenAI Codex, the underlying model that powers Copilot, has shown it performs well on typical CS1 problems thus raising concerns about its potential impact on how introductory programming courses are taught. However, little is known about the types of problems for which Copilot does not perform well, or about the natural language interactions that a student might have with Copilot when resolving errors. We explore these questions by evaluating the performance of Copilot on a publicly available dataset of 166 programming problems. We find that it successfully solves around half of these problems on its very first attempt, and that it solves 60% of the remaining problems using only natural language changes to the problem description. We argue that this type of prompt engineering, which we believe will become a standard interaction between human and Copilot when it initially fails, is a potentially useful learning activity that promotes computational thinking skills, and is likely to change the nature of code writing skill development.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This has been inspired by many other instances where LLMs have already demonstrated remarkable effectiveness in generating novel language artifacts. These include course readings [22], code explanations [23, 28, 29, 41], model solutions [9, 35, 42], feedback [34], or responses to help requests [18, 26, 46, 47].”
From A Comparative Study of AI-Generated (GPT-4) and Human-crafted MCQs in Programming Education (2024) · cites this paper as [9]
In the citing paper
“The phrasing of the prompt and problem statement can significantly impact whether the LLM will solve it correctly [Denny et al. 2023].”
From How Do Programming Students Use Generative AI? (2025) · cites this paper as Denny et al. 2023
In the citing paper
“Our examination of the prompts indicated that this discrepancy may arise because students face challenges in constructing effective queries or revising them to obtain useful information, aligning with findings in the literature on code generation using LLMs [13].”
From Using an LLM to Help With Code Understanding (2024) · cites this paper as [13]
In the citing paper
“Hence, the findings reported in [46] appear to be challenged by the more capable GPT-4 model as well as the findings reported in [7, 10, 11, 38].”
From Thrilled by Your Progress! Large Language Models (GPT-4) No Longer Struggle to Pass Assessments in Higher Education Programming Courses (2023) · cites this paper as [7]
In the citing paper
“Hence, the strengths and limitations reported in prior work [7, 10, 11, 38, 46] still hold to a certain degree.”
From Thrilled by Your Progress! Large Language Models (GPT-4) No Longer Struggle to Pass Assessments in Higher Education Programming Courses (2023) · cites this paper as [7]
7 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988 · cited 1×
“While their ability to generate novel human-like outputs is on the one hand fascinating, their rapidly increasing deployment has caused alarm among some researchers and led to calls for better understanding of their implications and risks [3, 24].”
BackgroundOn the Opportunities and Risks of Foundation Models
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021) · arXiv · doi:10.48550/arxiv.2108.07258 · Cited by 2,676
Hierarchical Text-Conditional Image Generation with CLIP Latents
Ramesh, A., Dhariwal, P., Nichol, A., Chu, C., & Chen, M. (2022) · arXiv · doi:10.48550/arxiv.2204.06125 · Cited by 2,511
Evaluating Large Language Models Trained on Code
Chen, M., Tworek, J., Jun, H., Yuan, Q., Pinto, H. P. D. O., Kaplan, J., Edwards, H., Burda, Y., Joseph, N., Brockman, G., et al. (2021) · arXiv · doi:10.48550/arxiv.2107.03374 · Cited by 1,436
Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm
Reynolds, L., & McDonell, K. (2021) · Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411763.3451760 · Cited by 952 · cited 1×
“Indeed, it is well known that language model outputs are very sensitive to their inputs [19].”
BackgroundVaithilingam, P., Zhang, T., & Glassman, E. L. (2022) · CHI Conference on Human Factors in Computing Systems Extended Abstracts · doi:10.1145/3491101.3519665 · Cited by 660
Automatic Generation of Programming Exercises and Code Explanations Using Large Language Models
Sarsa, S., Denny, P., Hellas, A., & Leinonen, J. (2022) · Proceedings of the 2022 ACM Conference on International Computing Education Research - Volume 1 · doi:10.1145/3501385.3543957 · Cited by 497 · cited 1×
“applied Codex to the task of generating novel programming exercises given a single example as input [20].”
MethodSelf-citationThe Robots Are Coming: Exploring the Implications of OpenAI Codex on Introductory Programming
Finnie-Ansley, J., Denny, P., Becker, B. A., Luxton-Reilly, A., & Prather, J. (2022) · Proceedings of the 24th Australasian Computing Education Conference · doi:10.1145/3511861.3511863 · Cited by 463 · cited 3×
“Nevertheless, across the 166 problems we evaluated, overall we observe similar rates of initial success reported in earlier studies [11].”
BackgroundResultSelf-citationGrounded Copilot: How Programmers Interact with Code-Generating Models
Barke, S., James, M. B., & Polikarpova, N. (2023) · Proceedings of the ACM on Programming Languages · doi:10.1145/3586030 · Cited by 436
GitHub Copilot AI pair programmer: Asset or Liability?
Dakhel, A. M., Majdinasab, V., Nikanjam, A., Khomh, F., Desmarais, M. C., Ming, Z., & Jiang (2022) · arXiv · doi:10.48550/arxiv.2206.15331 · Cited by 417
Research works printed but not linked: 4
- Jacob Austin Augustus Odena Maxwell Nye Maarten Bosma Henryk Michalewski David Dohan Ellen Jiang Carrie Cai Michael Terry Quoc Le et al. 2021. Program synthesis with large language models. arXiv preprint arXiv:2108.07732 (2021). · arXiv
- 10.5555/3495724.3495883 · doi:10.5555/3495724.3495883
- Pengfei Liu, Weizhe Yuan, Jinlan Fu, Zhengbao Jiang, Hiroaki Hayashi, and Graham Neubig. 2021. Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing. arXiv preprint arXiv:2107.13586 (2021). · arXiv
- Leonard Tang, Elizabeth Ke, Nikhil Singh, Bo Feng, Derek Austin, Nakul Verma, and Iddo Drori. 2022. Solving Probability and Statistics Problems by Probabilistic Program Synthesis at Human Level and Predicting Solvability. In Artificial Intelligence in Education. Posters and Late Breaking Results, Workshops and Tutorials, Industry and Innovation Tracks, Practitioners' and Doctoral Consortium,, Maria Mercedes Rodrigo, Noburu Matsuda, Alexandra I. Cristea, and Vania Dimitrova (Eds.). Springer International Publishing, Cham, 612--615.
Cited by
Items 301–398 of 398
EmbeddedKittens: An Evaluation of Code Embeddings for ScratchPreprint
Fein, B., & Fraser, G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.19291 · Cited by 1
The Robots Are Here: Implications of Generative AI for Computing Education
Denny, P. C. (2023) · doi:10.52843/cassyni.3j2hbh
Self-citation(2023) · Computing in Science & Engineering · doi:10.1109/mcse.2023.3324237
Scaling CS1 Support with Compiler-Integrated Conversational AIPreprint
Renzella, J., Vassar, A., Solano, L. L., & Taylor, A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2408.02378
Miranda, P. C., & de Andrade, M. H. S. (2024) · doi:10.5753/cbsoft_estendido.2024.4100
Kinder, L., & Käfer, T. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-78955-7_21
Goel, N., Shah, B., Kumar, M., Murali, R., & Gupta, R. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-84391-4_3
RECE: A Family of Explainable Rubrics for Autograding Refute Problems
Kumar, V. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-84391-4_7
Self-citationGenerating Distractors for Code Completion Problems: Can LLM Assist Instructors?
Hassany, M., Akhüseyinoğlu, K., Narayanan, A. B. L., Agarwal, A., Šavelka, J., & Brusilovsky, P. L. (2025) · Proceedings of the ... International Florida Artificial Intelligence Research Society Conference · doi:10.32473/flairs.38.1.138995
VisArena: A testbed for visualization with synthetic data tables
Fu, S., Jin, J., Ma, Q., Luo, Z., Xiong, K., & Wu, Y. (2025) · Journal of Visualization · doi:10.1007/s12650-025-01069-2
Alrobai, A., & Cristea, A. I. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-99261-2_31 · Cited by 1
Pan, D. P., Luo, L., Zhu, J., Gao, Z., Tong, X., & Hui, P. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791410 · Cited by 1
How Effectively Can Off-the-Shelf Generative AI Tools Solve Circuit Design Problems?
Azhaan, M., Afeef, M., & Kumar, V. (2025) · Lecture notes in educational technology · doi:10.1007/978-981-95-1734-3_21
Self-citationPrompts Engineering Challenges in Software Code Generation
Gutierrez, Y., Camacho, E., Pardo, C., & Villarreal, V. (2025) · IEEE Congreso Internacional en Inteligencia Ambiental, Ingeniería de Software y Salud Electrónica y Móvil (AmITIC) · doi:10.1109/amitic68284.2025.11214606
Assessing the Prevalence of AI-assisted Cheating in Programming Courses: A Pilot StudyPreprint
Delphino, K. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2507.06438
109PwnPilot: could an adversary be pair programming with our most trusted software engineers?
Horne, D. (2025) · De Gruyter eBooks · doi:10.1515/9783111436548-006
Jhonnerie, R., Oktorini, Y., Darlis, V. V., Pebriandi, P., Prianto, E., Fatmawati, R., Nofrizal, N., Ramses, R., Miswadi, M., & Rahmatdillah, R. (2024) · Springer Link (Chiba Institute of Technology) · doi:10.1051/bioconf/202413603002/pdf
Suomalainen, E. (2024) · LUTPub (LUT University) · Cited by 1
Informatikstudenters användning av ChatGPT inom programmering
Carlsson, J., & Hultkrantz, J. (2024) · Lund University Publications Student Papers (Lund University)
Craft Ethics : Aiming for Virtue in Programming with Generative AI
Jönsson, M., & Tholander, J. (2024) · DiVA (Södertörn University) · Cited by 2
Evaluating the Capabilities of GPT-4 in Full-Stack Web Development : A Practical Approach
Sandberg, J., & Zhang, Y. (2024) · Dalarna University College Electronic Archive
LEAP: A Method for Programming Education
Hashmi, N., Li, Z., Parise, S., & Shankaranarayanan, G. (2025) · Journal of the Association for Information Systems
The impact of task specification on code generated via ChatGPT
Lundblad, J., Thörn, E., & Thörn, L. (2023) · Diva portal (Dalarna University Library)
Paiva, J. C. C. (2025) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) · doi:10.34626/jwhx-jn48 · Cited by 1
Large Language Models in Secondary Informatics Education: Teachers' Perspectives
Busuttil, L. (2025) · OAR@UM (University of Malta) · doi:10.5281/zenodo.16948571 · Cited by 2
Auxiliary Generation Technology for Engine Model Code on the Basis of Prompt Engineering
Xu, Q., Yang, J., Cao, W., Hu, Z., Hu, A., & Liu, K. (2025) · Springer eBooks · doi:10.1007/978-981-95-0942-3_7
Cognitive-Aware Plugin for Vulnerability Feedback
Sanders, A. L., Walia, G., & Cordova, L. P. (2025) · Conference on Information Technology Education · doi:10.1145/3769694.3771158
Moreno-Alameda, D., Iglesias, J. B., Romero, A. D.-G., & Gimeno, A. S. (2026) · Springer eBooks · doi:10.1007/978-3-032-08213-8_9
Comparative Analysis of Generative AI Performance in University Programming Courses
Suomalainen, E., Vanhala, E., & Ikonen, J. (2026) · Lecture notes in business information processing · doi:10.1007/978-3-032-14518-5_16
Culligan, N., & Korady, B. (2026) · Conference on Human Centred Artificial Intelligence - Education and Practice (HCAIep) · doi:10.1145/3777490.3777500
Balancing Cost and Quality in LLM-based Test Case Generation by Prompt Engineering
Onishi, S., Kitamura, K., Kohiga, A., & Koita, T. (2025) · International Conference on Foundation and Large Language Models (FLLM) · doi:10.1109/fllm67465.2025.11391174
Tompkins, M., Agarwal, N., Soneji, A., Wasinger, R., Nelson, C., Leach, K., Hasan, R., Doupé, A., Votipka, D., Shoshitaishvili, Y., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.17448
Toward a new paradigm of AI-powered programming education through metacognition
Paludo, G., & Montresor, A. (2026) · Italian Journal of Educational Technology · doi:10.17471/2499-4324/1457
Tekoälyavusteinen ohjelmistokehitys: GitHub Copilotin arviointi ohjelmistokehittäjän työkaluna
Kuusisto, H. (2024) · Tampere University Institutional Repository (Tampere University)
Evaluating LLMs in the Context of a Functional Programming Course: A Comprehensive Study
Zhang, Y., Pientka, B., & Si, X. (2026) · The Art Science and Engineering of Programming · doi:10.22152/programming-journal.org/2026/11/5 · Cited by 1
Kozan, K., Keleṣ, Ö., Jian, S., Ayvaz, S., Sierszecki, K., & Joo, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.13269
Leveraging Generative AI for Cognitive Skill Enhancement in Low-Performing Programming Learners
Kumaran, R., & Mohan, A. (2026) · International Conference on Intelligent Data Communication Technologies and Internet of Things (IDCIoT) · doi:10.1109/idciot67589.2026.11455731
Akkiraju, N. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-8450-4.ch012
Development of an iconographic classroom in Moodle with Claude for usability Improvement
Lizárraga, M. G. B., Zataraín, V. B. N., & Campaña, J. I. O. (2026) · Apertura · doi:10.32870/ap.v18n1.2723
Rethinking Programming Skills in the Age of Generative AI
Bolici, F., Crowston, K., Varone, A., & Fudge, M. (2026) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2026.863 · Cited by 1
Investigating Conversational Agents to Support Secondary School Students Learning CSPPreprint
Frazier, M., Damevski, K., & Pollock, L. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.16213
Ouh, E. L., Tan, K. W., Lo, S. L., & Zhang, Y. (2026) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3785022.3785037 · Cited by 1
Using large language models to test voice user interfaces
Guglielmi, E., Spina, A., Bavota, G., Oliveto, R., & Scalabrino, S. (2026) · Empirical Software Engineering · doi:10.1007/s10664-026-10859-7
A systematic review of human-LLM interactions in computational thinking empirical studies
Zhang, Y., Song, Y., Precup, D., Rabbany, R., & Cutumisu, M. (2026) · Computer Science Education · doi:10.1080/08993408.2026.2665177
Nadeem, D., Asif, N., Tanveer, M., & Javed, K. (2026) · Kashf Journal of Multidisciplinary Research · doi:10.71146/kjmr877
García, R. N. G., Arias, S. C. D. L., Llontop, R. F. G., Hashimoto, E. M. C., Gallegos, J. P. C., Zaquinaula, I. R. A., Vara, F. E. O., Severino, E. C. P., Ruiz, L. C. V., García, J. E. G., et al. (2026) · South Florida Journal of Development · doi:10.46932/sfjdv7n6-017
Learning Programming with Generative AI: A Pre-University Pilot Study
Yong, S.-T., Chin, L.-Y., Matthews, R., & Ramayah, B. (2026) · International Conference on Information and Education Technology (ICIET) · doi:10.1109/iciet69664.2026.11561564
Dinh, T. (2026) · Aaltodoc (Aalto University)
Fudge, M. (2026) · Syracuse University Libraries (Syracuse University)
An LLM-Based Guided Programming Assistance System for Code Quality Feedback and Formative Assessment
Liu, G. (2026) · Applied Sciences · doi:10.3390/app16136455
Zhang, B., ea, I. R., & Migut, G. (2026) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3803401.3811981
Zuo, F., Xu, S., Ma, X., Qu, X., & Li, X. (2026) · IFIP advances in information and communication technology · doi:10.1007/978-3-032-30809-2_14
Yin, Y., Zuo, H., Han, J., Chen, L., Wang, P., Jiang, P., Hazeri, K., & Childs, P. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2697347
When LLM Tutoring Responses Work: Evidence from Student Programming ConversationsPreprint
Abrar, M. F., Sharmin, S., & Barmaki, R. L. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.09919
Giacaman, N., Terragni, V., Denny, P. C., & Kumar, V. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.10674
Self-citationCodeOwl: Automatic Generation of Tiered Parsons Problems for Introductory ProgrammingPreprint
Cisternino, L., Obermüller, F., & Fraser, G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.12460
From Repositories to Practice: LLM-Based Personalization in Programming Education
Horváth, M., Ďurkovičová, M., Bubeňková, L., & Pietriková, E. (2026) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/oasics.icpec.2026.9
Teaching Programming in the Age of AI: Pedagogical Strategies for Computational Sociology
Ramos, M. C., & Liang, F. (2026) · Teaching Sociology · doi:10.1177/0092055x261469125
Pérez, R. J. P., Castillo, N. A. V., & Martínez, R. S. V. (2026) · Research Club Scientia · doi:10.65415/xfce7x48
Billionniere, E. V., Lunn, S. J., Thapaliya, A., & Rahman, F. (2026) · LACCEI International Multi-Conference for Engineering, Education and Technology (LACCEI) · doi:10.18687/laccei2026.1.1.638
Evaluating LLM-Generated Contextualized Algorithm Design Problems
Goodwin, E., Braught, K., Liu, J., Newar, D. K. P., Gertner, Y., Poulsen, S., & Franklin, D. M. (2026) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3765964.3811658
WIP: LLM Odyssey: A Game-Based Platform for Teaching LLM Engineering ConceptsPreprint
Tripathi, P. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.16924
Zhong, Q., Zhong, Y., Yu, J., & Ma, M. (2026) · International Conference on Computer Science and Technologies in Education (CSTE) · doi:10.1109/cste69562.2026.11649712
Identifying the Factors of AI Acceptance in Education: A Systematic Review
Rani, N., & Singh, S. (2026) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--59869
Dallal, A. H. (2026) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--60630
Niu, Y., Lin, X., Feng, R., Lowry, M., & Reed, M. (2026) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--59652
Putratama, A. A., Choiriyah, S., Yanto, M. R., Minatullah, M. A. B., & Kusuma, W. P. (2026) · Journal of Contemporary Education and Inovation · doi:10.67008/ct66fs61
Lofandri, W., & Rama, A. (2025) · Lentera Negeri · doi:10.29210/991960
Hey, ChatGPT, Look at My Work: Using Conversational AI in Requirements Engineering Education
Badihi, S., Tegegn, M., Riddell, E., Czarnecki, K., & Rubin, J. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3744916.3773112 · Cited by 1
Beyond Coding: How Students Use Generative AI Across the Full Software Development Lifecycle
Matti, S., Szendrei, R., & Pintér, B. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-32732-1_14
Instructional Governance by Design: A Framework for AI in Computing EducationPreprint
Dickey, E. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.26098
Rocha, A., Ferreira, J. P., de Oliveira, P. C., Alves, M., & Sousa, A. J. (2026) · Computers · doi:10.3390/computers15100647
Hadjichristofi, C., Gerokonstantis, D., Papadeas, P. V., & Vescoukis, V. (2026) · Annals of Computer Science and Information Systems · doi:10.15439/2026f9512
Enhancing Introduction to Computer and Data Science Based on Python Course Using Gen AI
Grabarnik, G. Y., & Yaskolko, S. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-28463-1_37
Explanation First Prompting for Reviewing AI Programming Answers in Undergraduate Courses
Raiter, O. К. (2026) · International Conference on Advanced Computer Information Technologies (ACIT) · doi:10.1109/acit69831.2026.11700007
Masi, A. D., Wang, C., & Moccozet, L. (2026) · Nordic Conference on Human-Computer Interaction · doi:10.1145/3829807.3829904
Unpacking AI Agent Participation in Issue-Centered Collaboration in Open-Source Software Development
Zhi, K., Fan, G., & Chen, W. (2026) · Proceedings of the ACM on software engineering. · doi:10.1145/3832206
Uzo, B. C., Okpara, M., Chukwuemeka, E. N., Bande, P. S., & Okpara, F. N. (2026) · International Journal of Innovative Science and Research Technology (IJISRT) · doi:10.38124/ijisrt/26sep959
Understanding Student Use of Large Language Models Across Computer Science SubfieldsPreprint
Nizamani, S. B., Lee, Y., Chandrashekar, N. D., Ellis, M., & Ramakrishnan, N. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.01158
Ye, R., Fan, J., Bernuy, A. Z., Karnalim, O., Denny, P. C., Leinonen, J., & Liut, M. (2026) · Koli Calling International Conference on Computing Education Research · doi:10.1145/3856208.3856226
Self-citationBibliometric Review on Artificial Intelligence-Based Tools for Language Learning
Murillo, H. J. G. (2024) · Review of Contemporary Philosophy · Cited by 1
Keller, K. (2025) · European International Journal of Multidisciplinary Research and Management Studies
(2026) · Issues in Information Systems · doi:10.48009/2_iis_2026_128
Schoeman, M., Scholtz, C., Smuts, H., Louw, P., & Smit, D. (2026) · Lecture notes in business information processing · doi:10.1007/978-3-032-38498-0_29
Generative AI in vocational ICT education: Implications for teaching, learning, and assessment
Gunathilake, W., & Liyanage, S. (2026) · STEM Education · doi:10.3934/steme.2026041
إعادة هندسة مناهج علوم الحاسب في المرحلة الثانوية في عصر الذكاء الاصطناعي التوليدي
الشمري, أ. (2026) · Academic Journal of Research and Scientific Publishing · doi:10.52132/ajrsp/v8.90.8
Ouh, E. L., Tan, K. W., Lo, S. L., Gan, B. K. S., & Zhang, Y. (2026) · ACM Transactions on Computing Education · doi:10.1145/3858331
Ananda, M. R., Wahyuni, T. S., Rizal, F., & Darni, R. (2026) · JRTI (Jurnal Riset Tindakan Indonesia) · doi:10.29210/30037008000
Who benefits from LLMs? Prompt engineering competence and equity in higher education
Li, Z., Liu, Y., Jiang, J., Zhang, Z., Li, Z., & Chen, W. (2026) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-026-00633-6
Su, T., Sun, L., Wang, H., & Li, Y. (2026) · International Conference on Intelligent Education and Computer Technology (IECT) · doi:10.1145/3845354.3845445
Lin, Z., Pan, Y., & Zhang, X. (2026) · International Conference on Intelligent Education and Computer Technology (IECT) · doi:10.1145/3845354.3845539
Haurane, N., Tøssebro, E., & Jimarkon, P. (2026) · rEFLections · doi:10.61508/refl.v33i3.293243
Yalwa, A. S., Othman, M. S., Yusuf, L. M., & Almarshadi, M. S. (2026) · Cogent Education · doi:10.1080/2331186x.2026.2745324
Fernandes, M. G. S., de Sousa, R. R., & Gonçalves, S. M. N. (2026) · RECIMA21 - Revista Científica Multidisciplinar · doi:10.47820/recima21.v7i11.9483
Case Study—AdWords to AdWards: AI as a Coding Partner in Teaching Online Optimization Algorithms
Pachamanova, D. A., Tilson, V., & Dwyer‐Matzky, K. (2026) · INFORMS Transactions on Education · doi:10.1287/ited.2025.0147ca
Beyond access: guided versus free ChatGPT use and learning outcomes in higher education
Nazır, T. (2026) · Interactive Learning Environments · doi:10.1080/10494820.2026.2759148
Metadata
- Authors
- Denny, P., Kumar, V., & Giacaman, N.
- Affiliations
- University of Auckland (NZ)
- Indian Institute of Science Bangalore (IN)
- Venue
- Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 1
- Publisher
- ACM
- Published
- 2023-03-02
- Pages
- 1136-1142
- OpenAlex
- W4323037544
- Cited by
- 287
- References
- 22
- Citations by year
- 2026: 57 · 2025: 84 · 2024: 99 · 2023: 47
- FWCI
- 86.69
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- ACM Technical Symposium on Computer Science Education (SIGCSE) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Social Sciences › Education › Artificial Intelligence in Education
- Keywords
- GitHub Copilot, prompt engineering, natural language programming, OpenAI Codex, code generation, introductory programming education, computational thinking, error resolution
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.