Unreflected Acceptance – Investigating the Negative Consequences of ChatGPT-Assisted Problem Solving in Physics Education
Open accessPublished version of a preprint
The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
The general availability of large language models and thus unrestricted usage in sensitive areas of everyday life, such as education, remains a major debate. We argue that employing generative artificial intelligence (AI) tools warrants informed usage and examined their impact on problem solving strategies in higher education. In a study, students with a background in physics were assigned to solve physics exercises, with one group having access to an internet search engine (N=12) and the other group being allowed unrestricted use of ChatGPT (N=27). We evaluated their performance, strategies, and interaction with the provided tools. Our results showed that nearly half of the solutions provided with the support of ChatGPT were mistakenly assumed to be correct by students, indicating that they overly trusted ChatGPT even in their field of expertise. Likewise, in 42% of cases, students used copy & paste to query ChatGPT — an approach only used in 4% of search engine queries — highlighting the stark differences in interaction behavior between the groups and indicating limited task reflection when using ChatGPT. In our work, we demonstrated a need to (1) guide students on how to interact with LLMs and (2) create awareness of potential shortcomings for users.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Verification of sources: Another challenge arises from the difficulty of verifying the sources from which information is retrieved69.”
From On opportunities and challenges of large multimodal foundation models in education (2025) · cites this paper as [69]
Experimental — accuracy not yet measuredIn the citing paper
“LLMs amalgamate vast amounts of data, making it hard to trace back the origin of specific pieces of information, which is crucial for reliability.”
From On opportunities and challenges of large multimodal foundation models in education (2025) · cites this paper as [69]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · cited 1×
“Recent advances in natural language processing, initiated by the introduction of the transformer architecture (Vaswani et al. 2017), have led to significant progress in the field of language models.”
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173 · cited 1×
“The different approaches taken by GPT (Radford et al. 2018) and BERT (Devlin et al. 2018) models proved to be exceptionally successful.”
Scaling Laws for Neural Language Models
Kaplan, J., McCandlish, S., Henighan, T., Brown, T. B., Chess, B., Child, R., Gray, S., Radford, A., Wu, J., & Amodei, D. (2020) · arXiv · doi:10.48550/arxiv.2001.08361 · Cited by 9,550
SUS: A 'Quick and Dirty' Usability Scale
(1996) · Usability Evaluation In Industry · doi:10.1201/9781498710411-35 · Cited by 8,989
ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · doi:10.35542/osf.io/5er8f · Cited by 7,552
Self-citationChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326 · cited 4×
“LLMs offer great potential for advancing standard practices and research in education (Kasneci et al. 2023).”
InfluentialSelf-citationLLaMA: Open and Efficient Foundation Language Models
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.-A., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., Azhar, F., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.13971 · Cited by 4,602 · cited 2×
“ChatGPT (OpenAI 2022a) brought the technology into the public eye, further accelerating the pace of publications and leading to the development of models such as LLaMA (Touvron et al. 2023), GPT-4 (OpenAI 2023), and PaLM-E (Driess et al. 2023).”
The aligned rank transform for nonparametric factorial analyses using only anova procedures
Wobbrock, J. O., Findlater, L., Gergle, D., & Higgins, J. J. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1978963 · Cited by 2,854 · cited 1×
“Further, we conducted a one-way ANOVA after rank-aligning the data (Wobbrock et al. 2011) to investigate whether there are significant differences between our two conditions (S EARCH E NGINE , C HAT GPT) with regard to the students’ performances in the main test.”
Research works printed but not linked: 5
- Blandford, A.; Furniss, D.; and Makri, S. 2016. Qualitative HCI Research: Going behind the Scenes. Synthesis lectures on human-centered informatics , 9(1): 1-115.
- K¨ uchemann, S.; Steinert, S.; Revenga, N.; Schweinberger, M.; Dinc, Y.; Avila, K. E.; and Kuhn, J. 2023. Physics task development of prospective physics teachers using ChatGPT. arXiv preprint arXiv:2304.10014 . · arXiv
- Lewis, J. R.; Utesch, B. S.; and Maher, D. E. 2013. UMUXLITE: when there's no time for the SUS. In Proceedings of the SIGCHI conference on human factors in computing systems , 2099-2102.
- OpenAI. 2023. GPT-4 technical report. arXiv preprint arXiv:2303.08774 . · arXiv
- West, C. G. 2023a. Advances in apparent conceptual physics reasoning in ChatGPT-4. arXiv preprint arXiv:2303.17012 . · arXiv
Cited by
AI Tutoring Outperforms Active Learning
Kestin*, G., Miller*, K., Klales, A., Milbourne, T., & Ponti, G. (2024) · doi:10.21203/rs.3.rs-4243877/v1 · Cited by 214
Student Interaction with ChatGPT Can Promote Complex Critical Thinking Skills
Suriano, R., Plebe, A., Acciai, A., & Fabio, R. A. (2025) · Learning and Instruction · doi:10.1016/j.learninstruc.2024.102011 · Cited by 208
Kestin, G., Miller, K., Klales, A., Milbourne, T., & Ponti, G. (2025) · Scientific Reports · doi:10.1038/s41598-025-97652-6 · Cited by 214
“Krupp et al. (2023) observed limited reflection among students using ChatGPT without guidance 25 , while Forero (2023) reported a decline in student performance when AI interactions lacked structure and did not encourage critical thinking 2 .”
Prompt engineering as a new 21st century skill
Federiakin, D. A., Molerov, D., Zlatkin‐Troitschanskaia, O., & Maur, A. (2024) · Frontiers in Education · doi:10.3389/feduc.2024.1366434 · Cited by 261
Tassoti, S. (2024) · Journal of Chemical Education · doi:10.1021/acs.jchemed.4c00212 · Cited by 129
How understanding large language models can inform the use of ChatGPT in physics education
Polverini, G., & Gregorcic, B. (2023) · European Journal of Physics · doi:10.1088/1361-6404/ad1420 · Cited by 200
“Even more recently, Krupp et al. [90] have demonstrated that students who used ChatGPT as a tool in solving physics tasks often used its output uncritically, even in topics that they had significant experience with.”
BackgroundSteinert, S., Avila, K. E., Ruzika, S., Kuhn, J., & Küchemann, S. (2024) · Smart Learning Environments · doi:10.1186/s40561-024-00354-1 · Cited by 73
“…give an example of a simpler situation in which the incorrect or missing concept plays a central role and ask the student how he would explain the situation. strongly reduces the number of erroneous output and hallucinations because the teacher provides the correct solution to the task, and…”
Self-citationLademann, J., Henze, J., & Becker, S. (2025) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.21.010147 · Cited by 85
Between tech and text: the use of generative AI in Palestinian universities - a ChatGPT case study
Hamamra, B. T., Mayaleh, A., & Khlaif, Z. N. (2024) · Cogent Education · doi:10.1080/2331186x.2024.2380622 · Cited by 60
“However, the emergence of ChatGPT caused a departure from this trajectory, since it inadvertently prompted students to engage in extensive copying and pasting texts without taking into consideration the validity and originality of the generated content (Krupp et al., 2023).”
On opportunities and challenges of large multimodal foundation models in education
Küchemann, S., Avila, K. E., Dinc, Y., Hortmann, C., Revenga, N., Ruf, V., Stausberg, N., Steinert, S., Fischer, F., Fischer, M., et al. (2025) · npj Science of Learning · doi:10.1038/s41539-025-00301-w · Cited by 47
Self-citationTeaming Up with an AI: Exploring Human–AI Collaboration in a Writing Scenario with ChatGPT
Luther, T., Kimmerle, J., & Cress, U. (2024) · AI · doi:10.3390/ai5030065 · Cited by 45
“…findings regarding the originality of the texts and the rating of the participants’ contribution to the texts, it can be concluded that the participants had a relatively good insight into the proportion of text they had contributed to the texts and the proportion of text that ChatGPT had generated.”
BackgroundDilling, F., & Herrmann, M. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1460337 · Cited by 63
Sun, D., Boudouaia, A., Yang, J., & Xu, J. (2024) · Humanities and Social Sciences Communications · doi:10.1057/s41599-024-03991-6 · Cited by 61
Sun, D., Xu, P., Zhang, J., Liu, R., & Zhang, J. (2025) · Electronics · doi:10.3390/electronics14010194 · Cited by 36
“These studies typically observe and examine how learners use LLMs in the learning process to explore the potential impact of LLMs [45,46].”
Using ChatGPT for teaching physics
Avila, K. E., Steinert, S., Ruzika, S., Kühn, J., & Küchemann, S. (2024) · The Physics Teacher · doi:10.1119/5.0227132 · Cited by 25
Self-citationStephenson, Z., Johnson-Glauch, N., & Cruchley, S. (2025) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2025.2504621 · Cited by 25
Challenges and Opportunities of Moderating Usage of Large Language Models in Education
Krupp, L., Steinert, S., Kiefer-Emmanouilidis, M., Avila, K. E., Lukowicz, P., Kühn, J., Küchemann, S., & Karolus, J. (2024) · International Conference on Mobile and Ubiquitous Multimedia (MUM) · doi:10.1145/3701571.3701590 · Cited by 48
“Furthermore, as shown by Krupp et al. [12], unmoderated access to LMs, such as ChatGPT, leads to low amounts of reflection in students.”
InfluentialSelf-citationAn Investigation of Change in Prompting Strategies in a Semester-Long Course on the Use of GenAI
Sigot, M., & Tassoti, S. (2025) · Journal of Chemical Education · doi:10.1021/acs.jchemed.4c01287 · Cited by 22
Neumann, K., Kühn, J., & Drachsler, H. (2024) · Unterrichtswissenschaft · doi:10.1007/s42010-024-00212-6 · Cited by 38
Aldazharova, S., Issayeva, G., Maxutov, S., & Balta, N. (2024) · Contemporary Educational Technology · doi:10.30935/cedtech/15592 · Cited by 30
Küchemann, S., Avila, K. E., Dinc, Y., Hortmann, C., Revenga, N., Ruf, V., Stausberg, N., Steinert, S., Fischer, F., Fischer, M. R., et al. (2024) · doi:10.35542/osf.io/n7dvf · Cited by 19
Self-citationPrabhudesai, S., Kasi, A. P., Mansingh, A., Antar, A. D., Shen, H., & Banović, N. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713714 · Cited by 35
Teacher training in the age of AI: impact on AI literacy and teachers’ attitudes
Lademann, J., Henze, J., Honke, N., Wollny, C., & Becker, S. (2026) · Frontiers in Education · doi:10.3389/feduc.2025.1671306 · Cited by 62
Fadillah, M. A., Usmeldi, U., Lufri, L., Mawardi, M., & Festiyed, F. (2024) · Advances in Mobile Learning Educational Research · doi:10.25082/amler.2024.02.013 · Cited by 26
“…its use, ChatGPT is effective as a tool to exercise students’ critical and creative thinking skills, provide in-depth feedback on problem-solving-based tasks, and serve as an additional learning resource to reinforce understanding fundamental physics concepts (Krupp et al., 2024; Su et al., 2023).”
THE ROLE OF CHATGPT AND HIGHER-ORDER THINKING SKILLS AS PREDICTORS OF PHYSICS INQUIRY
Fadillah, M. A., Usmeldi, U., & Asrizal, A. (2024) · Journal of Baltic Science Education · doi:10.33225/jbse/24.23.1178 · Cited by 31
Lesson planning with ChatGPT for inquiry-based biology instruction – A(I) roll of the dice?
Großmann, L., Koberstein‐Schwarz, M., Krüger, D., & Krell, M. (2025) · International Journal of Science Education · doi:10.1080/09500693.2025.2567509 · Cited by 18
“The uncritical acceptance of LLM-generated texts poses significant risks, as users may overlook crucial insufficiencies in the output (Krupp et al., 2024).”
A typology of physician input approaches to using AI chatbots for clinical decision-making
Siden, R., Kerman, H. M., Gallo, R. J., Cool, J. A., Hom, J., Goh, E., Ahuja, N. K., Heidenreich, P. A., Shieh, L. Y., Yang, D. X., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-02184-y · Cited by 15
A Missed Opportunity for No-Code Chatbots? Current Challenges in Publicly Available Chemistry GPTs
Sigot, M., & Tassoti, S. (2025) · Journal of Chemical Education · doi:10.1021/acs.jchemed.4c01552 · Cited by 9
Understanding AI-Related Needs of Adolescent Refugee EFL Learners in Türkiye: A Qualitative Study
Derakhshan, A., & Solhi, M. (2025) · Journal of Education for Students Placed at Risk (JESPAR) · doi:10.1080/10824669.2025.2602796 · Cited by 12
“Specifically, by employing AI tools and bots, students’ critical reflection on their learning is likely to be hampered (Krupp et al., 2024).”
Kieser, F., Tschisgale, P., Rauh, S., Bai, X., Maus, H., Petersen, S., Stede, M., Neumann, K., & Wulff, P. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1408817 · Cited by 11
ChatGPT's quality: Reliability and validity of concept inventory items
Küchemann, S., Rau, M. A., Schmidt, A., & Kühn, J. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1426209 · Cited by 11
Self-citationAI-supported data analysis boosts student motivation and reduces stress in physics education
Henze, J., Lademann, J., Becker, S., & Bresges, A. (2026) · Frontiers in Education · doi:10.3389/feduc.2026.1719670 · Cited by 19
“In one study, ChatGPT-4 outperformed engineering students on the Force Concept Inventory (FCI), suggesting its potential for physics instruction (Kieser et al., 2023).”
Boolzen, C., Kühn, J., Flegr, S., Rott, E.-M., Stausberg, N., & Küchemann, S. (2026) · Artificial Intelligence Review · doi:10.1007/s10462-026-11665-9 · Cited by 16
Self-citationLi, L. L., Mao, G., Zhang, L., & Ying, J. (2025) · Education and Information Technologies · doi:10.1007/s10639-025-13849-2 · Cited by 14
Leveraging generative AI to facilitate peer feedback in collaborative argumentation learning
Chang, Y., Liu, Q., Lu, Y., & Miao, E. (2026) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-026-00586-w · Cited by 4
Guedes, T. S. D. V., Rupprecht, P., & Rodenas, I. (2026) · Journal of Organizational Change Management · doi:10.1108/jocm-01-2026-0095 · Cited by 4
Using large language models for solving textbook-style thermodynamic problems
Loubet, R., Zittlau, P., Vollmer, L., Hoffmann, M., Fellenz, S., Jirasek, F., Leitte, H., & Hasse, H. (2025) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2025.109333 · Cited by 12
Wang, R., Liu, C., & Yi, F. (2025) · Medical Education · doi:10.1111/medu.70100 · Cited by 8
“23,53,68,69 Prior studies have demonstrated this validation bias arises primarily from ChatGPT's dual role: acting both as a “ cognitive anchor, ” which provides a seemingly authoritative reference point that limits exploratory thinking, and as a “ social comparator, ” rendering peer critiques as…”
Portuguese secondary school students’ perceptions regarding the use of ChatGPT
Callado, A., Saúde, I., & Araújo, J. L. (2025) · Contemporary Educational Technology · doi:10.30935/cedtech/17516 · Cited by 10
Roziqin, R., Samsudin, A., Saepuzaman, D., Sari, H. N., & Iryanti, M. (2026) · STEM Education · doi:10.3934/steme.2026023 · Cited by 7
Research on confusing responses based on ChatGPT
Xiong, H. (2024) · Applied and Computational Engineering · doi:10.54254/2755-2721/57/20241315 · Cited by 3
Reeping, D. P., & Shah, A. (2024) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--47047 · Cited by 3
Nehring, A., Buschhüter, D., Kubsch, M., Ludwig, T., Wulff, P., & Neumann, K. (2025) · Zeitschrift für Didaktik der Naturwissenschaften · doi:10.1007/s40573-025-00177-8 · Cited by 4
Tran, T. T. P., Dang, T. N., & Nguyen, V. L. P. (2025) · International journal of AI in language education. · doi:10.54855/ijaile.25222 · Cited by 12
Sadidi, F., & Prestel, T. (2025) · Discover Education · doi:10.1007/s44217-025-01071-8 · Cited by 4
“Considering the potential and limitations of ChatGPT on the one hand and the challenges students face when using this tool on the other hand shows how important it is to promote critical thinking when integrating ChatGPT into education [8].”
Exploring physics students’ attitudes toward ChatGPT using the ABC model
Veith, J. M., Bauer, A., Becker, E., & Bitzenbauer, P. (2026) · Eurasia Journal of Mathematics Science and Technology Education · doi:10.29333/ejmste/17822 · Cited by 4
“This risk is compounded by students ’ high trust in AI ’ s output, leading to an uncritical acceptance of incorrect information (Ding et al., 2023; Krupp et al., 2023).”
Li, H., & Derakhshan, A. (2026) · BMC Psychology · doi:10.1186/s40359-026-04884-w · Cited by 3
“For instance, Krupp et al. [25] posited that learners using AI tutors such as ChatGPT will show limited reflection on their learning processes.”
Shamshin, A. (2024) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-3-031-71804-5_27 · Cited by 4
Work-in-Progress: Students' Prompting Strategies When Solving an Engineering Design Task
Reeping, D. P., & Shah, A. (2024) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie61694.2024.10893099 · Cited by 4
“These pitfalls align to some extent with Krupp [10] in the context of collaborative problem-solving for Physics with ChatGPT; specifically, they similarly noted undergraduate students using a copy-and-paste approach to prompting for most of the interactions (42% of the time).”
Natural Language Processing and Large Language Models
Wulff, P., Kubsch, M., & Krist, C. (2025) · Springer texts in education · doi:10.1007/978-3-031-74227-9_7 · Cited by 10
Muhanna, W. A. A. (2025) · International Journal of Technology Enhanced Learning · doi:10.1504/ijtel.2025.146302 · Cited by 1
Do AI-generated videos obey physics laws?
Gregorcic, B. (2025) · Physics Education · doi:10.1088/1361-6552/adfc1c · Cited by 1
“One of the main challenges in preparing students for a life with AI is cultivating a sufficiently critical stance towards AI-generated content [7–9].”
Generative AI in Training and Coaching: Redefining the Design Process of Learning Materials
Komar, A., Heidelmann, M., & Schaaff, K. (2026) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-981-95-4423-3_3 · Cited by 2
“This issue highlights that, despite efficiency gains, human experts continue to play a crucial role in fine-tuning and ensuring the quality of learning materials [30].”
Student chatbot use and perceptions in a course assignment: Comparing two geomatics courses
Hochmair, H. H. (2025) · Geomatica · doi:10.1016/j.geomat.2025.100079 · Cited by 2
The Influence of Chat GPT Use on University Students’ Critical Thinking Skills
Seo, J.-S., & Lim, S.-Y. (2025) · 한국가정관리학회지 · doi:10.7466/jfbl.2025.43.3.109 · Cited by 2
AI-generated language in introductory physics lab reports in the first year of ChatGPT
Arvidsson, K. (2025) · Discover Artificial Intelligence · doi:10.1007/s44163-025-00742-7 · Cited by 4
“Krupp et al. [30] found that students who used ChatGPT as a tool to solve physics problems tended to use its output uncritically.”
Reflections on AI in mechanical engineering education
Impelluso, T. J. (2026) · International Journal of Mechanical Engineering Education · doi:10.1177/03064190261418523 · Cited by 1
Psychological and pedagogical problems of using chatGPT in solving physical problems
Shamshin, A. (2023) · ScienceRise Pedagogical Education · doi:10.15587/2519-4984.2023.292760 · Cited by 1
Influence of Assistive Technology for Special Education
Manullank, C. (2023) · Journal Educational Verkenning · doi:10.48173/jev.v4i4.250 · Cited by 1
“A take a look at via Krupp et al. (2023) found that using assistive generation definitely correlates with progressed educational performance, especially in areas along with reading comprehension and mathematical trouble-solving.”
BackgroundWeb Agents and Benchmarks - A Survey Focusing on Algorithmic Strategies and Performance RatingsPreprint
Krupp, L., Geißler, D., Lukowicz, P., & Karolus, J. (2025) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/vhn2c_v1 · Cited by 3
Self-citationCan Image Generative Models Be Considered Experts?
Quang, D. B. H., Dorleon, G., & Colarik, A. M. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-4291-5_33
Adaptive Scaffolding with Generative AI Chatbot for Solving Ill-Structured Problems
Jang, H., & So, H. (2025) · Proceedings. · doi:10.22318/icls2025.194070
Hu, Y., Curdt‐Christiansen, X. L., & Wang, J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5353491
Siden, R., Kerman, H. M., Gallo, R. J., Cool, J. A., Hom, J., Goh, E., Ahuja, N. K., Heidenreich, P. A., Shieh, L. Y., Yang, D. X., et al. (2025) · medRxiv · doi:10.1101/2025.07.23.25332002
“17,18 Some physicians who used searching also frequently described aiming for more narrow outputs, whereas some physicians who used copy-pasting described aiming for more robust outputs.”
AI to the Rescue: Supporting Manual Annotation for Dataset Creation
Liebers, C., Ertas, M., Pfützenreuter, N., Auda, J., Gruenefeld, U., & Schneegaß, S. (2025) · Mensch und Computer (MuC) · doi:10.1145/3743049.3743086
AI-Aided Decision-Making in Education: Uncertainty, Explainability, and Human Responsibility
Kieser, F., Tschisgale, P., & Wulff, P. (2025) · Signals and communication technology · doi:10.1007/978-3-031-96855-6_2
Mitigating Risks in Large Language Model Usage Through Critical Thinking
Ziegfeld, L., Kox, E. S., Blok, J., van der Mijn, R., Venrooij, W., & van der Waa, J. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-13184-3_28
WIP: Structured AI Tutoring in Engineering Education
Cruz, A., Yatawara, A., Misha, M., & Wang, J. (2025) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie63693.2025.11328293
“However, concerns remain about their unstructured use [7, 8, 9] and the need for instructors to provide adequate scaffolding for AI-assisted lessons [10].”
Sofita, M., Damarsha, A. B., Prasetya, J. E., Yuliatin, E. D., Rahma, N. F., Jauhariyah, M. N. R., & Saphıra, H. V. (2025) · Studies in Philosophy of Science and Education · doi:10.46627/sipose.v5i3.676
The effects of goal-setting on learning during information seeking with generative AI
Urgo, K., Li, Y., Arguello, J., & Capra, R. (2026) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3786304.3788847
Yoo, T.-A., Yang, H.-S., Kim, M., & Chung, J. (2026) · Interactive Learning Environments · doi:10.1080/10494820.2026.2646275 · Cited by 1
“…generally relied on single-point surveys or interviews, or focused on correlations between AI usage and assignment scores (Bašić et al., 2023; Guo & Lee, 2023; Hmoud et al., 2024; Kosar et al., 2024; Krupp et al., 2024; Suriano et al., 2025; Tossell et al., 2024; Yilmaz & Karaoglan Yilmaz, 2023).”
Brockmann, P., Schuhbauer, H., Marutschke, D. M., & Kryssanov, V. V. (2025) · International Conference on Artificial Intelligence and Teacher Education (ICAITE) · doi:10.1109/icaite68636.2025.11442549 · Cited by 2
“In the aforementioned study by Krupp et al. [4] 42% of their students simply copied and pasted answers from ChatGPT, so-called ”zero-shot prompting”.”
Zuhayr, R. A. A., Akbar, H. F., Hazin, R., & Halim, E. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-14750-9_7
Optimization of a Teacher’s Time Management Using Artificial Intelligence
Pšenák, P., & Pšenáková, I. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-18888-5_4
Becker, E., Bauer, A. A., Schrader, J., Bitzenbauer, P., & Veith, J. M. (2026) · Physical Review Physics Education Research · doi:10.1103/gd1w-1637 · Cited by 1
Personalized smart courses for university physics based on knowledge graph and large language models
Yin, W., Yan, Z., Qi, Z., & Zhang, R. (2026) · Interactive Technology and Smart Education · doi:10.1108/itse-10-2025-0313 · Cited by 1
The Janus-Faced Nature of AI in STEM Education
Wulff, P. (2026) · Maarif global education series · doi:10.1007/978-981-95-9023-0_4
Teaching What the Machine Told Us: Critical Agency and Epistemic Trust in the Algorithmic Classroom
Genç, L. G., & Uygun, E. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-2600-1232-1.ch014
Stückler, M., & Tassoti, S. (2026) · Journal of Chemical Education · doi:10.1021/acs.jchemed.6c00955
Kotsis, K. T. (2026) · EIKI Journal of Effective Teaching Methods · doi:10.59652/p5j07k92
Fadillah, M. A., Usmeldi, U., Festiyed, F., & Asrizal, A. (2026) · doi:10.3390/proceedings2026148012
Fenici, M. (2026) · Human Affairs · doi:10.1515/humaff-2026-0011
Role of AI in physics problem-solving skills
Ramaswamy, A., & Chhabra, M. (2026) · Physics Education · doi:10.1088/1361-6552/aeaabb
Metadata
- Authors
- Krupp, L., Steinert, S., Kiefer-Emmanouilidis, M., Avila, K. E., Lukowicz, P., Kuhn, J., Küchemann, S., & Karolus, J.
- Affiliations
- German Research Centre for Artificial Intelligence (DE)
- Ludwig-Maximilians-Universität München (DE)
- Rheinland-Pfälzische Technische Universität Kaiserslautern-Landau (DE)
- LMU Munich
- Corresponding author
- Krupp, Lars
- ORCID
- Venue
- Frontiers in Artificial Intelligence and Applications
- Publisher
- IOS Press
- Published
- 2024-06-05
- ISSN
- 0922-6389 (ISSN-L)
- 1879-8314
- OpenAlex
- W4399390300
- Cited by
- 82
- References
- 34
- Citations by year
- 2026: 24 · 2025: 34 · 2024: 21
- FWCI
- 57.61
- Type
- book chapter
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Frontiers in artificial intelligence and applications (publishedVersion, cc-by-nc)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Social Sciences › Education › Artificial Intelligence in Education
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Keywords
- ChatGPT, generative AI in education, physics problem solving, student trust in AI, AI-assisted problem solving, search engine use, student performance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.