Developing Critical Thinking Practices Interwoven with Generative AI Usage in an Introductory Programming Course
Abstract
Software development has evolved significantly. In the past, developers were required to have comprehensive understanding of programming languages, algorithms, and computer architecture. However, with the emergence of the Internet, software libraries, frameworks, and forums became widely available, which utilize reusable software components that can reduce development time and costs. The advent of Generative Artificial Intelligence (AI) tools, such as ChatGPT, GitHub Copilot, and Amazon CodeWhisperer, has further enhanced the developer's toolkit, as these tools can be used for a wide variety of tasks such as code generation, documentation, commenting and reviewing. As programming is often slow and requires trial and error, novice programmers can be tempted to apply the first solution found on the Internet or proposed by an AI tool without much critical reflection or notion of responsibility. Hence, the advances of AI have raised both excitement and concerns among Information Technology (IT)/Computer Science (CS) students and educators. Yet, AI tools are here to stay, and students must learn to use them responsibly. The aim of this paper is to investigate how to design learning activities that introduce Generative AI tools (GitHub Copilot and ChatGPT) for programming while promoting critical thinking practices among students in an introductory programming course in the first semester. Students' opinions and customs were surveyed before and after the AI-based programming assignment. The results indicate that students' awareness of the possibilities and limitations of AI, as well as practices of critical thinking in programming increased. This is encouraging as critical thinking is an integral part of best programming practices.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Recent studies have identified the potential of GenAI tools to activate CT through cognitive scaffolding and metacognitive prompting.
“Recent studies have identified the potential of GenAI tools to activate CT through cognitive scaffolding and metacognitive prompting [11,13,14].”
From A Systematic Literature Review on the Pedagogical Implications and Impact of GenAI on Students' Critical Thinking (2026) · cites this paper as [13]
When students are not explicitly encouraged to reflect on their own reasoning or compare their answers with AI-generated suggestions, they are less likely to revise their thinking or explore alternate solutions.
“Studies have shown that when students are not explicitly encouraged to reflect on their own reasoning or compare their answers with AI-generated suggestions, they are less likely to revise their thinking or explore alternate solutions [13].”
From A Systematic Literature Review on the Pedagogical Implications and Impact of GenAI on Students' Critical Thinking (2026) · cites this paper as [13]
AI tools supplied exemplar feedback, evaluation criteria, alternative solutions, brainstorming prompts, or code suggestions that students were required to analyze, critique, or revise.
“In these interventions, AI tools supplied exemplar feedback, evaluation criteria, alternative solutions, brainstorming prompts, or code suggestions that students were required to analyze, critique, or revise [13,50,71,93].”
From A Systematic Literature Review on the Pedagogical Implications and Impact of GenAI on Students' Critical Thinking (2026) · cites this paper as [13]
Performance tasks, such as AI-augmented debates, problem-based projects, and peer review of AI-generated work, proved particularly effective for promoting evaluation and explanation skills.
“Performance tasks, such as AI-augmented debates, problem-based projects, and peer review of AI-generated work, proved particularly effective for promoting evaluation and explanation skills [13,75].”
From A Systematic Literature Review on the Pedagogical Implications and Impact of GenAI on Students' Critical Thinking (2026) · cites this paper as [13]
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414 · see citing works
Designing and Conducting Mixed Methods Research
Robinson, P. M. (2007) · Australian and New Zealand Journal of Public Health · doi:10.1111/j.1753-6405.2007.00096.x · Cited by 23,297 · see citing works
Mixed Methods Research: A Research Paradigm Whose Time Has Come
Johnson, R. B., & Onwuegbuzie, A. J. (2004) · Educational Researcher · doi:10.3102/0013189x033007014 · Cited by 11,170 · cited 1× · see citing works
“MMR “ combines quantitative and qualitative research techniques, methods, approaches, concepts or language into a single study ” [40].”
MethodMixing Qualitative and Quantitative Methods: Triangulation in Action.
Jick, T. D. (1979) · Administrative Science Quarterly · doi:10.2307/2392366 · Cited by 7,103 · cited 1× · see citing works
“The thematic analysis was conducted by one researcher and reviewed by the other researchers to provide triangulation of analysers in the qualitative analysis [49].”
MethodCohen, L., Manion, L., & Morrison, K. (2017) · doi:10.4324/9781315456539 · Cited by 6,018 · see citing works
Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A. M., Koohang, A., Raghavan, V., Ahuja, M., et al. (2023) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2023.102642 · Cited by 4,584 · see citing works
A SWOT analysis of ChatGPT: Implications for educational practice and research
Farrokhnia, M., Banihashem, S. K., Noroozi, O., & Wals, A. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2195846 · Cited by 1,384 · see citing works
Why Johnny Can’t Prompt: How Non-AI Experts Try (and Fail) to Design LLM Prompts
Zamfirescu-Pereira, J. D., Wong, R. Y., Hartmann, B., & Yang, Q. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581388 · Cited by 893 · see citing works
A Concept of Critical Thinking.
Ennis, R. H. (1962) · Harvard Educational Review · Cited by 629 · see citing works
Unlocking the opportunities through ChatGPT Tool towards ameliorating the education system
Javaid, M., Haleem, A., Singh, R. P., Khan, S., & Khan, I. H. (2023) · BenchCouncil Transactions on Benchmarks, Standards and Evaluations · doi:10.1016/j.tbench.2023.100115 · Cited by 535 · see citing works
Can Students Evaluate Online Sources? Learning From Assessments of Civic Online Reasoning
McGrew, S., Breakstone, J., Ortega, T., Smith, M., & Wineburg, S. (2018) · Theory & Research in Social Education · doi:10.1080/00933104.2017.1416320 · Cited by 533 · see citing works
Clean Code: A Handbook of Agile Software Craftsmanship
(2009) · Kybernetes · doi:10.1108/03684920910973252 · Cited by 496 · see citing works
Asleep at the Keyboard? Assessing the Security of GitHub Copilot’s Code Contributions
Pearce, H., Ahmad, B., Tan, B., Dolan-Gavitt, B., & Karri, R. (2022) · 2022 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp46214.2022.9833571 · Cited by 476 · see citing works
Transformative Effects of ChatGPT on Modern Education: Emerging Era of AI Chatbots
Gill, S. S., Xu, M.-X., Patros, P., Wu, H.-M., Kaur, R., Kaur, K., Fuller, S., Singh, M., Arora, P., Parlikad, A., et al. (2023) · Internet Things Cyber Phys. Syst. · doi:10.1016/j.iotcps.2023.06.002 · Cited by 466 · see citing works
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.1.23 · Cited by 421 · see citing works
Use of ChatGPT in academia: Academic integrity hangs in the balance
Bin-Nashwan, S. A., Sadallah, M., & Bouteraa, M. (2023) · Technology in Society · doi:10.1016/j.techsoc.2023.102370 · Cited by 394 · see citing works
Quotations in Qualitative Studies: Reflections on Constituents, Custom, and Purpose
Eldh, A. C., Årestedt, L., & Berterö, C. (2020) · International Journal of Qualitative Methods · doi:10.1177/1609406920969268 · Cited by 362 · see citing works
Tiruneh, D. T., Cock, M. D., Weldeslassie, A. I., Elen, J., & Janssen, R. (2016) · International Journal of Science and Mathematics Education · doi:10.1007/s10763-016-9723-0 · Cited by 291 · see citing works
ChatGPT in education: Methods, potentials, and limitations
Memarian, B., & Doleck, T. (2023) · Computers in Human Behavior: Artificial Humans · doi:10.1016/j.chbah.2023.100022 · Cited by 266 · cited 1× · see citing works
“The use of Generative AI tools in education has sparked a debate and is seen as double-edged [2], as some believe it provides new opportunities for enhancing learning [16], while others are concerned about the negative impact it can have on the integrity of assessments (e.g. plagiarism) [17].”
MethodLau, S., & Guo, P. (2023) · Proceedings of the 2023 ACM Conference on International Computing Education Research V.1 · doi:10.1145/3568813.3600138 · Cited by 241 · see citing works
Deficient Critical Thinking Skills among College Graduates: Implications for leadership
Flores, K., Matkin, G. S., Burbach, M. E., QUINN, C. E., & Harding, H. E. (2010) · Educational Philosophy and Theory · doi:10.1111/j.1469-5812.2010.00672.x · Cited by 211 · see citing works
Stupple, E. J. N., Maratos, F. A., Elander, J., Hunt, T. E., Cheung, K. Y. F., & Aubeeluck, A. (2016) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2016.11.007 · Cited by 156 · see citing works
Role of ChatGPT in Computer Programming.
Biswas, S. S. (2023) · Mesopotamian Journal of Computer Science · doi:10.58496/mjcsc/2023/002 · Cited by 154 · see citing works
Halpern, D. F. (2013) · Psychology Press eBooks · doi:10.4324/9781315885278 · Cited by 145 · see citing works
A Literature Review of Critical Thinking in Engineering Education
Ahern, A., Dominguez, C., McNally, C., O’Sullivan, J. J., & Pedrosa, D. (2019) · Studies in Higher Education · doi:10.1080/03075079.2019.1586325 · Cited by 127 · see citing works
Agile Software Development: Principles, Patterns, and Practices
Winter, R. J. (2014) · Performance Improvement Journal · doi:10.1002/pfi.21408 · Cited by 118 · see citing works
ChatGPT: The Brightest Student in the Class
Vázquez-Cano, E., Ramírez-Hurtado, J. M., Sáez-López, J., & López-Meneses, E. (2023) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2023.101380 · Cited by 79 · see citing works
Vermeulen, A., Ambler, S. W., Bumgardner, G., Metz, E., Misfeldt, T., & Shur, J. (2000) · Cambridge University Press eBooks · doi:10.1017/cbo9780511585852 · Cited by 72 · see citing works
"I know it when I see it" Perceptions of Code Quality
Börstler, J., Störrle, H., Toll, D., van Assema, J., Duran, R., Hooshangi, S., Jeuring, J. T., Keuning, H., Kleiner, C., & MacKellar, B. (2018) · doi:10.1145/3174781.3174785 · Cited by 55 · see citing works
An overview of a programme of research to support the assessment of Critical Thinking
Black, B. (2012) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2012.04.003 · Cited by 46 · see citing works
On Assuring Learning About Code Quality
Kirk, D., Crow, T. V. H., Luxton-Reilly, A., & Tempero, E. D. (2020) · Australasian Computing Education Conference · doi:10.1145/3373165.3373175 · Cited by 36 · see citing works
You Can Lead Students to Sources, but Can You Make Them Think?
Hayes-Bohanan, P., & Spievak, E. R. (2008) · College & Undergraduate Libraries · doi:10.1080/10691310802177200 · Cited by 21 · see citing works
DevOps in Practice for Education Management Information System at ECNU
Yang, D., Wang, D., Yang, D., Dong, Q., Wang, Y., Zhou, H., & Hong, D. (2020) · Procedia Computer Science · doi:10.1016/j.procs.2020.09.148 · Cited by 21 · see citing works
Evaluation of Critical Thinking in Online Software Engineering Teaching: A Systematic Mapping Study
Ancán, Ó., Díaz, J., & Olivares-Rodríguez, C. (2021) · IEEE Access · doi:10.1109/access.2021.3135245 · Cited by 14 · see citing works
Java Coding Guidelines: 75 Recommendations for Reliable and Secure Programs
Long, F., Mohindra, D., Seacord, R. C., Sutherland, D. F., & Svoboda, D. (2013) · CERN Document Server (European Organization for Nuclear Research) · Cited by 12 · see citing works
It's Never too Early to Learn About Code Quality
Östlund, L., Wicklund, N., & Glassey, R. J. (2023) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3545945.3569829 · Cited by 11 · see citing works
Measuring Critical Thinking Skills and Dispositions in Undergraduate Students
O’Hare, L. (2004) · Research Portal (Queen's University Belfast) · doi:10.13140/rg.2.1.5113.3527 · Cited by 6 · see citing works
Preliminary psychometric characteristics of the critical thinking self-assessment scale
Nair, G. G. (2011) · HARVEST (University of Saskatchewan) · Cited by 2 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Nathaniel, J., Oyelere, S. S., Suhonen, J. T., & Tedre, M. (2025) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2025.100460 · Cited by 37 · see citing works
Xu, X. (., Konnova, A., Gao, B., Peng, C., Vo, D., & Dow, S. P. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713649 · Cited by 20 · see citing works
Adejumo, A. A., Oyelere, S. S., Sanusi, I. T., & Suhonen, J. T. (2026) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2026.100570 · Cited by 22 · see citing works
Balart, T., Díaz, B., & Shryock, K. (2026) · Algorithms · doi:10.3390/a19030179 · Cited by 15 · see citing works
“Highlighting the importance of structured integration of AI tools with CT to promote responsible use, deeper reflection, increased awareness of code quality and robustness [13,50,71,93].”
InfluentialAruleba, K., Sanusi, I. T., Obaido, G., Ogbuokiri, B., & Mienye, I. D. (2025) · Technology Knowledge and Learning · doi:10.1007/s10758-025-09899-7 · Cited by 13 · see citing works
Becerra, Á., & Cobos, R. (2025) · IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon62633.2025.11016499 · Cited by 8 · see citing works
Employing generative AI applications in learning
Nadif, B., Zemrani, M. Z., Hammou, B. A., Mansour, S.-E., Fakhrou, A., & Bouih, A. (2025) · American Journal of STEM Education · doi:10.32674/vt55r634 · Cited by 6 · see citing works
The Impact of AI Use in Programming Courses on Critical Thinking Skills
Clarke, C. J. S. F., & Konak, A. (2025) · Journal of Cybersecurity Education Research and Practice · doi:10.62915/2472-2707.1220 · Cited by 5 · see citing works
Behmanush, H., Akhtari, F., Nooripour, R., Weber, I. G., & Cannanure, V. K. (2025) · ACM SIGCAS/SIGCHI Conference on Computing and Sustainable Societies (COMPASS) · doi:10.1145/3715335.3735479 · Cited by 4 · see citing works
Athena: A GenAI-Powered Programming Tutor Based on Open-Source LLM
Lin, Y., Khan, M. F. F., & Sakamura, K. (2025) · IEEE International Conference on Consumer Technology (ICCT-Pacific) · doi:10.1109/icct-pacific63901.2025.11012850 · Cited by 4 · see citing works
Stimulating Critical Thinking in a Web Programming Module with Generative AI Tools
Naeem, U., Styve, A. G., & Virkki, O. T. (2025) · IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon62633.2025.11016298 · Cited by 5 · see citing works
Self-citationAruleba, K., Oyelere, S. S., Obaido, G., & Sanusi, I. T. (2025) · Conference on United Kingdom & Ireland Computing Education Research (UKICER) · doi:10.1145/3754508.3754517 · Cited by 4 · see citing works
Zarandi, F. M., Martin, M., Wei, S., & Reeping, D. P. (2025) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie63693.2025.11328196 · Cited by 3 · see citing works
Opportunities and considerations for using artificial intelligence in bioinformatics education
Piccolo, S. R., Nathan, A., Brazas, M. D., Kandpal, M., Miró-Herrans, A. T., Kleinschmit, A. J., McClatchy, S., Mutheiwana, P., Nikolic, D., Gallo, L. I., et al. (2024) · Bioinformatics Advances · doi:10.1093/bioadv/vbaf169 · Cited by 2 · see citing works
Proust-Androwkha, S., Psyché, V., Kyriakoglou, R., Boubaker, A., Lallé, S., Chartofylaka, L., Machado, G. M., & Mawas, N. E. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-98462-4_48 · Cited by 2 · see citing works
Case Study: Using Artificial Intelligence as a Tutor for a Programming Course
Timčenko, O. (2024) · International Conference on Information Technology Based Higher Education and Training (ITHET) · doi:10.1109/ithet61869.2024.10837624 · Cited by 2 · see citing works
Concepts for Teaching Software Development in the Age of AI-Tools
Böttcher, A., Thurner, V., & Zönnchen, B. (2025) · IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon62633.2025.11016505 · Cited by 2 · see citing works
Assessing Software Engineering Students' Analytical Skills in the Era of Generative AI
Petrovska, O., Pearsall, R., & Clift, L. (2024) · Conference on Computing Education Practice (CEP) · doi:10.1145/3702212.3702223 · Cited by 1 · see citing works
From Topic to Thesis: Critical Engagement with Generative AI in Thesis Preparation
Virkki, O. T., Naeem, U., & Styve, A. (2026) · 2026 IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon67543.2026.11574181
Self-citationOsti, G., & Roke, E. R. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825858
Dolinsky, M. S. (2025) · WSEAS TRANSACTIONS ON ADVANCES in ENGINEERING EDUCATION · doi:10.37394/232010.2025.22.5
I Am vs. Ai - the Future Belongs to Agile MindsetsPreprint
Kucharska, W., & Kucharski, M. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5378517
Applied Learning of Data Structures and Algorithms using AI Chatbots
Low, M. Y. H., Quah, C. K., Lee, K. K., & Lee, C. C. (2025) · IEEE International Conference on Teaching, Assessment, and Learning for Engineering · doi:10.1109/tale66047.2025.11346597
AI-Powered Virtual Teachers and Their Role in Developing Critical Thinking Skills
Aksin, A. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-2637-5.ch008
Jecha, J., Liang, Y., Han, J., & Nassor, H. (2026) · Research Square · doi:10.21203/rs.3.rs-9461812/v1 · Cited by 1 · see citing works
Ding, S., Smith, J. B., Gautier, K., Garrett, S., Magerko, B. S., Freeman, J., Pardo, B., Ludi, S. A., Brown, T. L., & McKlin, T. (2026) · ACM International Conference on Interaction Design and Children (IDC) · doi:10.1145/3773077.3812141
Understanding Critical Thinking Skills with Generative AI in a Transnational Education Setting
Islam, R. (2026) · IEEE Global Engineering Education Conference (EDUCON) · doi:10.1109/educon67543.2026.11574197 · Cited by 1 · see citing works
Evaluating the Effect of Generative AI-Assisted Debugging on Students’ Critical Thinking
Albadarin, Y., Saqr, M., Pope, N., & Tukiainen, M. (2026) · Technology Knowledge and Learning · doi:10.1007/s10758-026-09998-z
Graßl, I. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3786580.3786983
Multani, M. K., & Castro, L. C. (2026) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--59733
Yalçın, Y., Bakır-Yalçın, E., İslamoğlu, H., & Ursavaş, Ö. F. (2026) · Journal of Computer Assisted Learning · doi:10.1002/jcal.70341
Guerrero, M. I. S., Santistevan, B. C. C., Lapo, Y. R. O., Benavides, N. D. C. L., & Suárez, J. A. B. (2026) · Revista Multidisciplinar Epistemología de las Ciencias · doi:10.71112/jcqx1318
- Authors
- Styve, A., Virkki, O. T., & Naeem, U.
- Affiliations
- Norwegian University of Science and Technology (NO)
- Haaga-Helia University of Applied Sciences (FI)
- Queen Mary University of London (GB)
- Venue
- 2024 IEEE Global Engineering Education Conference (EDUCON)
- Publisher
- IEEE
- Published
- 2024-05-08
- Pages
- 01-08
- OpenAlex
- W4400411008
- Cited by
- 32
- References
- 38
- Citations by year
- 2026: 12 · 2025: 16 · 2024: 4
- FWCI
- 14.04
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE Global Engineering Education Conference (EDUCON) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
- Social Sciences › Education › Problem and Project Based Learning
- Keywords
- critical thinking, introductory programming, GitHub Copilot, ChatGPT, AI-assisted programming, student attitudes toward AI, responsible AI use, programming exercises, novice programmers
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review