The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
ChatGPT and the frustrated Socrates
Open accessAbstract
Abstract We present a case study of a conversation between ourselves and an artificial intelligence-based chatbot ChatGPT. We asked the chatbot to respond to a basic physics question that will be familiar to most physics teachers: ‘A teddy bear is thrown into the air. What is its acceleration in the highest point?’ The chatbot’s responses, while linguistically quite advanced, were unreliable in their correctness and often full of contradictions. We then attempted to engage in Socratic dialogue with the chatbot to resolve the errors and contradictions, but with little success. We found that ChatGPT is not yet good enough to be used as a cheating tool for physics students or as a physics tutor. However, we found it quite reliable in generating incorrect responses on which physics teachers could train assessment of student responses.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Failures of LLMs include lack of knowledge about object attributes (e.g., size, weight, softness) (Wang et al., 2023c; Liu et al., 2022b; Shu et al., 2023; Kondo et al., 2023), spatial relationships (e.g., above, inside, next to) (Liu et al., 2022b; Shu et al., 2023; Kondo et al., 2023), simple physical laws (e.g., gravity, motion, and force) (Gregorcic & Pendrill, 2023), and object affordance”
From Large Language Model Reasoning Failures (2026) · cites this paper as Gregorcic & Pendrill, 2023
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hestenes, D., Wells, M., & Swackhamer, G. (1992) · The Physics Teacher · doi:10.1119/1.2343497 · Cited by 3,235
Toward an Epistemology of Physics
diSessa, A. A. (1993) · Cognition and Instruction · doi:10.1080/07370008.1985.9649008 · Cited by 1,443
Common sense concepts about motion
Halloun, I. A., & Hestenes, D. (1985) · American Journal of Physics · doi:10.1119/1.14031 · Cited by 852
Science, Language, and Literacy : Case Studies of Learning in Swedish University Physics
Airey, J. (2009) · Uppsala University Publications (Uppsala University) · Cited by 113
“Force,” ontology, and language
Brookes, D. T., & Etkina, E. (2009) · Physical Review Special Topics - Physics Education Research · doi:10.1103/physrevstper.5.010110 · Cited by 93
Playing games with AIs: the limits of GPT-3 and similar large language models
Sobieszek, A., & Price, T. (2022) · Minds and Machines · doi:10.1007/s11023-022-09602-0 · Cited by 86
Critical thinking in national tests across four subjects in Swedish compulsory school
Nygren, T., Haglund, J., Samuelsson, C. R., af Geijerstam, Å., & Prytz, J. (2018) · Education Inquiry · doi:10.1080/20004508.2018.1475200 · Cited by 48
Students making sense of motion in a vertical roller coaster loop
Pendrill, A.-M., Eriksson, M., Eriksson, U., Svensson, K., & Ouattara, L. (2019) · Physics Education · doi:10.1088/1361-6552/ab3f18 · Cited by 17
Self-citationForce, acceleration and velocity during trampoline jumps—a challenging assignment
Pendrill, A.-M., & Ouattara, L. (2017) · Physics Education · doi:10.1088/1361-6552/aa89cb · Cited by 11
Self-citation
Cited by
Sorted by citations
Leveraging ChatGPT for Enhancing Critical Thinking Skills
Guo, Y., & Lee, D. (2023) · Journal of Chemical Education · doi:10.1021/acs.jchemed.3c00505 · Cited by 250
ChatGPT in physics education: A pilot study on easy-to-implement activities
Bitzenbauer, P. (2023) · Contemporary Educational Technology · doi:10.30935/cedtech/13176 · Cited by 181
Enhancing STEM learning with ChatGPT and Bing Chat as objects to think with: A case study
Vasconcelos, M. A. R., & dos Santos, R. P. (2023) · Eurasia Journal of Mathematics Science and Technology Education · doi:10.29333/ejmste/13313 · Cited by 208
How understanding large language models can inform the use of ChatGPT in physics education
Polverini, G., & Gregorcic, B. (2023) · European Journal of Physics · doi:10.1088/1361-6404/ad1420 · Cited by 160
Self-citationEducational data augmentation in physics education research using ChatGPT
Kieser, F., Wulff, P., Kuhn, J., & Küchemann, S. (2023) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.19.020150 · Cited by 108
Digital transformation in engineering education: Exploring the potential of AI-assisted learning
Pham, T. T., Nguyen, T. B., Ha, S., & Ngoc, N. T. N. (2023) · Australasian Journal of Educational Technology · doi:10.14742/ajet.8825 · Cited by 155
Dahlkemper, M. N., Lahme, S. Z., & Klein, P. (2023) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.19.010142 · Cited by 149
A Systematic Review of the Limitations and Associated Opportunities of ChatGPT
Cong‐Lem, N., Soyoof, A., & Tsering, D. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2344142 · Cited by 140
Lund, B. D., & Naheem, K. T. (2023) · Learned Publishing · doi:10.1002/leap.1582 · Cited by 136
Fathi, T. E., Saad, A., Larhzil, H., Lamri, D., & Ibrahmi, E. M. A. (2025) · Disciplinary and Interdisciplinary Science Education Research · doi:10.1186/s43031-025-00125-z · Cited by 143
ChatGPT: The brightest student in the class
Cano, E. V., Ramírez‐Hurtado, J. M., López, J. M. S., & Menéses, E. L. (2023) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2023.101380 · Cited by 105
Krupp, L., Steinert, S., Kiefer-Emmanouilidis, M., Avila, K. E., Lukowicz, P., Kuhn, J., Küchemann, S., & Karolus, J. (2024) · Frontiers in Artificial Intelligence and Applications · doi:10.3233/faia240195 · Cited by 82
The impact of AI in physics education: a comprehensive review from GCSE to university levels
Yeadon, W., & Hardy, T. (2024) · Physics Education · doi:10.1088/1361-6552/ad1fa2 · Cited by 116
Performance of ChatGPT on the test of understanding graphs in kinematics
Polverini, G., & Gregorcic, B. (2024) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.20.010109 · Cited by 70
Self-citationExploring the impact of language models, such as ChatGPT , on student learning and assessment
Zirar, A. (2023) · Review of Education · doi:10.1002/rev3.3433 · Cited by 99
Annamalai, N., Bervell, B., Mireku, D. O., & Andoh, R. P. K. (2024) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2024.100346 · Cited by 111
Perceptions of Higher Education Students towards ChatGPT Usage
Das, S. R., & Madhusudan, J. V. (2024) · International Journal of Technology in Education · doi:10.46328/ijte.583 · Cited by 103
Watters, C., & Lemański, M. K. (2023) · Frontiers in Big Data · doi:10.3389/fdata.2023.1224976 · Cited by 64
ChatGPT as a tool for honing teachers’ Socratic dialogue skills
Gregorcic, B., Polverini, G., & Sarlah, A. (2024) · Physics Education · doi:10.1088/1361-6552/ad3d21 · Cited by 36
Self-citationExploring the potential of AI-Chatbots in organic chemistry: An assessment of ChatGPT and Bard
Hallal, K., Hamdan, R., & Tlais, S. (2023) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2023.100170 · Cited by 62
Data Privacy and Security Safeguarding Customer Information in ChatGPT Systems
Shafik, W. (2024) · Advances in hospitality, tourism and the services industry (AHTSI) book series · doi:10.4018/979-8-3693-1239-1.ch003 · Cited by 38
Exploring the use of ChatGPT in learning and instructing statistics and data analytics
Xing, Y. (2024) · Teaching Statistics · doi:10.1111/test.12367 · Cited by 40
Exploring the role of human-AI collaboration in solving scientific problems
Tong, D., Jin, B., Tao, Y., Ren, H., Islam, A. Y. M. A., & Bao, L. (2025) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.21.010149 · Cited by 29
Making a revolution in physics learning in high schools with ChatGPT: A case study in UAE
Alarbi, K., Halaweh, M., Tairab, H., Alsalhi, N. R., Annamalai, N., & Aldarmaki, F. (2024) · Eurasia Journal of Mathematics, Science and Technology Education · doi:10.29333/ejmste/14983 · Cited by 28
Polverini, G., Melin, J., Önerud, E., & Gregorcic, B. (2025) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.21.010154 · Cited by 35
Self-citationFlipped dialogic learning method with ChatGPT: A case study
Pavlova, N. (2023) · International Electronic Journal of Mathematics Education · doi:10.29333/iejme/14025 · Cited by 27
Evaluating AI and human authorship quality in academic writing through physics essays
Yeadon, W., Agra, E., Inyang, O.-O., Mackay, P., & Mizouri, A. (2024) · European Journal of Physics · doi:10.1088/1361-6404/ad669d · Cited by 26
Kortemeyer, G., Babayeva, M., Polverini, G., Widenhorn, R., & Gregorcic, B. (2025) · Physical Review Physics Education Research · doi:10.1103/98hg-rkrf · Cited by 35
Self-citationWulff, P. (2023) · European Journal of Physics · doi:10.1088/1361-6404/ad0f9c · Cited by 24
Challenges and Opportunities of Moderating Usage of Large Language Models in Education
Krupp, L., Steinert, S., Kiefer-Emmanouilidis, M., Avila, K. E., Lukowicz, P., Kühn, J., Küchemann, S., & Karolus, J. (2024) · International Conference on Mobile and Ubiquitous Multimedia (MUM) · doi:10.1145/3701571.3701590 · Cited by 40
ChatGPT as an innovative tool for increasing sales in online stores
Orzoł, M., & Szopik‐Depczyńska, K. (2023) · Procedia Computer Science · doi:10.1016/j.procs.2023.10.340 · Cited by 29
Buldur, M., & Sezer, B. (2024) · BMC Oral Health · doi:10.1186/s12903-024-04358-8 · Cited by 28
Fock, A., & Siller, H.-S. (2025) · International Journal of STEM Education · doi:10.1186/s40594-025-00589-5 · Cited by 24
ChatGPT in Language Education: Perceptions of Teachers - A Beneficial Tool or Potential Threat?
Widianingtyas, N., Mukti, T. W. P., & Silalahi, R. M. P. (2023) · Voices of English Language Education Society · doi:10.29408/veles.v7i2.20326 · Cited by 38
Arpaci, A., Ozturk, A. U., Okur, I., & Sadry, S. (2025) · BMC Oral Health · doi:10.1186/s12903-025-06624-9 · Cited by 23
English, R., Nash, R., & Mackenzie, H. (2026) · Innovations in Education and Teaching International · doi:10.1080/14703297.2024.2446236 · Cited by 17
Generative AI as a lab partner: A case study
Kilde-Westberg, S., Johansson, A., & Enger, J. (2025) · Physical Review Physics Education Research · doi:10.1103/ggy1-3kjk · Cited by 26
Chatbots in Education: A Dual Perspective on Innovation and Ethics
Pappagallo, S. (2024) · Journal of Digital Pedagogy · doi:10.61071/jdp.2420 · Cited by 16
Tschisgale, P., Maus, H., Kieser, F., Kroehs, B., Petersen, S., & Wulff, P. (2025) · Physical Review Physics Education Research · doi:10.1103/6fmx-bsnl · Cited by 28
Lawan, A. A., Muhammad, B. R., Tahir, A. M., Yarima, K. I., Zakari, A., Abdullahi, A. H., Hussaini, A., Kademi, H. I., Danlami, A. A., Sani, M. A., et al. (2023) · doi:10.11648/j.edu.20231204.14 · Cited by 16
Learning against the machine: the double edged sword of (Gen)AI in STEM education
Wulff, P., & Kubsch, M. (2025) · International Journal of STEM Education · doi:10.1186/s40594-025-00588-6 · Cited by 20
Contracts rethought and redesigned: A new era with AI
Autto, H., Haapio, H., & Nuottila, J. (2024) · International Journal of Commerce and Contracting · doi:10.1177/20555636241261278 · Cited by 16
Pimbblet, K. A., & Morrell, L. J. (2024) · European Journal of Physics · doi:10.1088/1361-6404/ad9874 · Cited by 20
The Subject of AI: A Psychoanalytic Intervention
Black, J., & Johanssen, J. (2025) · Theory Culture & Society · doi:10.1177/02632764251381144 · Cited by 12
Chiasson, R. M., Goodboy, A. K., Vendemia, M. A., Beer, N., Meisz, G. C., Cooper, L., Arnold, A., Lincoski, A., George, W., Zuckerman, C., et al. (2024) · Communication Education · doi:10.1080/03634523.2024.2398105 · Cited by 13
Educational Games and the Potential of AI to Transform Writing Across the Curriculum
Evmenova, A. S., Regan, K. S., Mergen, R. L., & Nawash, R. H. (2025) · Education Sciences · doi:10.3390/educsci15050567 · Cited by 28
LLM-generated tips rival expert-created tips in helping students answer quantum-computing questions
Krupp, L., Bley, J., Gobbi, I., Geng, A., Müller, S., Suh, S., Moghiseh, A., Medina, A. C., Bartsch, V., Widera, A., et al. (2025) · EPJ Quantum Technology · doi:10.1140/epjqt/s40507-025-00334-5 · Cited by 15
Ramkorun, B. (2024) · Physics Education · doi:10.1088/1361-6552/ad2191 · Cited by 10
dos Santos, R. P. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4629567 · Cited by 13
Demirkol, M., & Malkoç, N. (2023) · Educational Process International Journal · doi:10.22521/edupij.2023.124.3 · Cited by 10
Orynbassarova, D., & Porta, S. D. L. (2024) · International Conference on Emerging eLearning Technologies and Applications (ICETA) · doi:10.1109/iceta63795.2024.10850795 · Cited by 11
Use of Generative Artificial Intelligence tools in higher education environments
Seco, D., Groesser, S. N., & Pedrosa, A. M. (2025) · Multidisciplinary Journal for Education Social and Technological Sciences · doi:10.4995/muse.2025.23623 · Cited by 10
Can ChatGPT Pass a Physics Test?
Rēvalde, G., Zholdakhmet, M., Abola, A., & Murzagaliyeva, A. (2025) · Technology Knowledge and Learning · doi:10.1007/s10758-025-09814-0 · Cited by 9
Descending an inclined plane with a large language model
Dunlap, J. C., Sissons, R., & Widenhorn, R. (2025) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.21.010153 · Cited by 8
Improving biology learning in high school with ChatGPT: A case study in Morocco
Baroud, S., Alaoui, M. E., Janati‐Idrissi, R., Boucetta, N., Ghariz, G., & Seghir, H. (2025) · Eurasia Journal of Mathematics Science and Technology Education · doi:10.29333/ejmste/16606 · Cited by 10
Taani, O., Alarabi, K., Tairab, H. H., Khurma, O. A., & AlSadrani, B. (2025) · Contemporary Educational Technology · doi:10.30935/cedtech/17315 · Cited by 9
Using ChatGPT errors to encourage student exploration and self-learning in mathematics
Slobodsky, P., & Durcheva, M. (2025) · International Journal of Mathematical Education in Science and Technology · doi:10.1080/0020739x.2025.2505200 · Cited by 7
El uso de ChatGPT 4.0 para la elaboración de exámenes: crear el prompt adecuado
Mendoza, K. K. R. (2023) · LATAM Revista Latinoamericana de Ciencias Sociales y Humanidades · doi:10.56712/latam.v4i2.1040 · Cited by 13
Kieser, F., Tschisgale, P., Rauh, S., Bai, X., Maus, H., Petersen, S., Stede, M., Neumann, K., & Wulff, P. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1408817 · Cited by 11
Exploring the Role of ChatGPT in Science Education for Asia-Pacific and Beyond: a Systematic Review
Park, H. K., & Martin, S. N. (2024) · Asia-Pacific Science Education · doi:10.1163/23641177-bja10079 · Cited by 9
AI-supported data analysis boosts student motivation and reduces stress in physics education
Henze, J., Lademann, J., Becker, S., & Bresges, A. (2026) · Frontiers in Education · doi:10.3389/feduc.2026.1719670 · Cited by 18
Matheis, P., & Jacob-John, J. (2024) · Advances in educational marketing, administration, and leadership book series · doi:10.4018/979-8-3693-0240-8.ch008 · Cited by 7
Science in the era of ChatGPT, large language models and generative AI
Pournaras, E. (2023) · AI critique · doi:10.1515/9783839467664-015 · Cited by 12
ChatGPT’s problem-solving abilities in context-rich and traditional physics problems
Horchani, R. (2025) · Physics Education · doi:10.1088/1361-6552/adb473 · Cited by 9
Implementing AI in Physics Lessons in the High School
Bessas, N., Tzanaki, E., Vavougios, D., & Plagianakos, V. P. (2023) · International Conference on Computational Science and Computational Intelligence (CSCI) · doi:10.1109/csci62032.2023.00293 · Cited by 5
Cho, N., Li, H., Zhang, X., & Li, Y. (2025) · Journal of Science Education and Technology · doi:10.1007/s10956-025-10280-7 · Cited by 5
Kimya Sorularının Cevaplanmasında Yapay Zekâ Tabanlı Sohbet Robotlarının Performansının İncelenmesi
ÇELİK, A. Y., & K.ÇOBAN, Ö. (2023) · Türk Eğitim Bilimleri Dergisi · doi:10.37217/tebd.1361401 · Cited by 8
Students’ Embodied Interactions During Collaborative Learning Activities in Physics
Gregorcic, B. (2024) · Challenges in physics education · doi:10.1007/978-3-031-72541-8_3 · Cited by 4
Self-citationJakobsen, D. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-031-84457-7_10 · Cited by 4
A Comparison of AI Performance with Student Performance in Astrophysics and Astrobiology
Radenković, L., & Milošević, M. (2024) · The Physics Teacher · doi:10.1119/5.0168896 · Cited by 4
Transformative Effects of Smarter Chatbots
Reddy, C. K. K., Reddy, P. S., Pilly, A., & Doss, S. (2024) · Wiley eBooks · doi:10.1002/9781394234028.ch18 · Cited by 5
Large Language Model Reasoning Failures
Song, P., Han, P., & Goodman, N. (2026) · arXiv · doi:10.48550/arxiv.2602.06176 · Cited by 3
Soyoof, A., Reynolds, B. L., Rassaei, E., Kao, C.-W., & Ha, X. V. (2025) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2025.100530 · Cited by 7
Nehring, A., Buschhüter, D., Kubsch, M., Ludwig, T., Wulff, P., & Neumann, K. (2025) · Zeitschrift für Didaktik der Naturwissenschaften · doi:10.1007/s40573-025-00177-8 · Cited by 3
Cho, N. (2024) · Discover Artificial Intelligence · doi:10.1007/s44163-024-00215-3 · Cited by 3
Nishiwaki, Y. (2025) · European Journal of Physics · doi:10.1088/1361-6404/adfc16 · Cited by 4
Felipe, A. L., Khwakhali, U. S., & Nguyen, T. N. (2025) · International STEM Education Conference (iSTEM-Ed) · doi:10.1109/istem-ed65612.2025.11129352 · Cited by 2
Chatbots in Science Education: A Scoping Review of Early Empirical Evidence
Utrilla, M. C., Paños, E., & Ruíz-Gallardo, J.-R. (2025) · Journal of Science Education and Technology · doi:10.1007/s10956-025-10260-x · Cited by 7
Unlocking the Future: A Comprehensive Review of ChatGPT in Education
Kim, D., Wang, C. K., Borowiec, K., Rein, N., Cho, J.-H. A., & Liu, J. J. (2025) · Technology Knowledge and Learning · doi:10.1007/s10758-025-09923-w · Cited by 2
Exploring physics students’ attitudes toward ChatGPT using the ABC model
Veith, J. M., Bauer, A., Becker, E., & Bitzenbauer, P. (2026) · Eurasia Journal of Mathematics Science and Technology Education · doi:10.29333/ejmste/17822 · Cited by 3
Are You Creative? What College-Level English Language Learners Think of AI Writing Assistants
Syabilla, Z. F., Romadhon, M. G. E., & Mustofa, M. (2023) · Voices of English Language Education Society · doi:10.29408/veles.v7i3.21209 · Cited by 4
Exploring the Role of AI in Learning and Teaching Thermodynamics: A Case Study with ChatGPT
Oss, S. (2024) · The Physics Educator · doi:10.1142/s2661339524500136 · Cited by 2
Pham, T., Tran, M., Kavalchuk, I., & Nguyen, T. N. (2024) · Lecture notes in mechanical engineering · doi:10.1007/978-3-031-59042-9_18 · Cited by 2
Shamshin, A. (2024) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-3-031-71804-5_27 · Cited by 3
Reinventing instructional laboratory with ChatGPT: Radiation measurement by smartphone
Sirisathitkul, C., & Sirisathitkul, Y. (2025) · Innovations in Education and Teaching International · doi:10.1080/14703297.2025.2467319 · Cited by 2
Natural Language Processing and Large Language Models
Wulff, P., Kubsch, M., & Krist, C. (2025) · Springer texts in education · doi:10.1007/978-3-031-74227-9_7 · Cited by 7
Bessas, N., Tzanaki, E., Vavougios, D., & Plagianakos, V. P. (2025) · Social Sciences & Humanities Open · doi:10.1016/j.ssaho.2025.101610 · Cited by 4
Comparing ChatGPT and Gemini on a Two-Tier Static Fluid Test: Capability and Scientific Consistency
Kaharu, S. N., Werdhiana, I. K., & Mansyur, J. (2025) · European Journal of Educational Research · doi:10.12973/eu-jer.15.1.223 · Cited by 2
Artificial intelligence at school: please handle with care
Oss, S. (2023) · Physics Education · doi:10.1088/1361-6552/acd7c0 · Cited by 2
AUTOMATIC SOLVING OF PHYSICS WORD PROBLEMS
Popov, R., & Karpenko, N. V. (2024) · Automation technological and business processes · doi:10.15673/atbp.v16i2.2853 · Cited by 1
Creating a Postcard Puzzle for Educational Purposes in Junior High School Science
Bessas, N., Tzanaki, E., Vavougios, D., & Plagianakos, V. P. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-031-85652-5_1 · Cited by 1
Do AI-generated videos obey physics laws?
Gregorcic, B. (2025) · Physics Education · doi:10.1088/1361-6552/adfc1c · Cited by 1
Self-citationAI-generated language in introductory physics lab reports in the first year of ChatGPT
Arvidsson, K. (2025) · Discover Artificial Intelligence · doi:10.1007/s44163-025-00742-7 · Cited by 1
Moonsamy, W., & Lotriet, H. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-12457-9_2 · Cited by 1
Kampylis, P. (2025) · Cognition and exploratory learning in the digital age · doi:10.1007/978-3-032-05817-1_1 · Cited by 1
Aydemir, M., & Başman, M. (2026) · Springer eBooks · doi:10.1007/978-981-95-4871-2_10 · Cited by 2
Kaharu, S. N., Mansyur, J., Werdhiana, I. K., & Tule, R. (2026) · European Journal of Educational Research · doi:10.12973/eu-jer.15.3.941 · Cited by 1
Sudmann, A., Echterhölter, A., Ramsauer, M., Retkowski, F., Schröter, J., & Waibel, A. (2023) · AI critique · doi:10.1515/9783839467664 · Cited by 5
Psychological and pedagogical problems of using chatGPT in solving physical problems
Shamshin, A. (2023) · ScienceRise Pedagogical Education · doi:10.15587/2519-4984.2023.292760 · Cited by 1
Leveraging on artificial intelligence in enhancing STEM education: A case study of ChatGPT
Ukala, G., Ukala, C. U., & Chukwuemeka, P. C. (2025) · European Journal of Health and Biology Education · doi:10.29333/ejhbe/16583 · Cited by 1
Metadata
- Authors
- Gregorcic, B., & Pendrill, A.-M.
- Affiliations
- Uppsala University (SE)
- Lund University (SE)
- Corresponding author
- Gregorcic, Bor
- Venue
- Physics Education
- Publisher
- IOP Publishing
- Published
- 2023-03-22
- Volume
- 58
- Issue
- 3
- Pages
- 035021
- ISSN
- 0031-9120 (ISSN-L)
- 1361-6552
- OpenAlex
- W4360846784
- Cited by
- 125
- References
- 9
- Citations by year
- 2026: 18 · 2025: 42 · 2024: 37 · 2023: 28
- FWCI
- 29.34
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Physics Education (publishedVersion, cc-by)
- Uppsala University Publications (Uppsala University) (submittedVersion, other-oa)
- Lund University Publications (Lund University) (submittedVersion)
- Topics
- Social Sciences › Education › Artificial Intelligence in Education
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- ChatGPT, large language models, Socratic dialogue, physics tutoring, academic dishonesty, incorrect responses, physics misconceptions, chatbot reliability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review