Cited by 1,080Artificial Intelligence in EducationTeaching and Learning ProgrammingArtificial Intelligence in Healthcare and Education

The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index; none of the 9 sources its claims cite is checked for support yet.

ChatGPT for Education and Research: Opportunities, Threats, and Strategies

Open access

Rahman, Md. Mostafizer, Watanobe, Yutaka·2023·Applied Sciences

DOI 10.3390/app13095783

Published version of a preprint

Open this paper in CoChat — free account Open PDF

Abstract

In recent years, the rise of advanced artificial intelligence technologies has had a profound impact on many fields, including education and research. One such technology is ChatGPT, a powerful large language model developed by OpenAI. This technology offers exciting opportunities for students and educators, including personalized feedback, increased accessibility, interactive conversations, lesson preparation, evaluation, and new ways to teach complex concepts. However, ChatGPT poses different threats to the traditional education and research system, including the possibility of cheating on online exams, human-like text generation, diminished critical thinking skills, and difficulties in evaluating information generated by ChatGPT. This study explores the potential opportunities and threats that ChatGPT poses to overall education from the perspective of students and educators. Furthermore, for programming learning, we explore how ChatGPT helps students improve their programming skills. To demonstrate this, we conducted different coding-related experiments with ChatGPT, including code generation from problem descriptions, pseudocode generation of algorithms from texts, and code correction. The generated codes are validated with an online judge system to evaluate their accuracy. In addition, we conducted several surveys with students and teachers to find out how ChatGPT supports programming learning and teaching. Finally, we present the survey results and analysis.

AI snapshot

Written from the paper’s full text.

TL;DR

This paper examines ChatGPT’s opportunities and threats for education and research, with a focus on programming learning and teaching. It combines coding experiments on an online judge system with surveys of students and teachers, finding generally useful support but also accuracy, integrity, and over-reliance concerns.

Key findings

In code-generation experiments, ChatGPT’s generated code was correct about 95.83% of the time on a basic compiler and about 75% on the Aizu Online Judge (AOJ), with an average accuracy of 85.42%.
Among surveyed students, 78.8% had used ChatGPT for programming problems, 86.7% said its suggestions helped solve programming problems, and 92.9% found it useful for learning programming; most student satisfaction ratings were 4/5 (36.6%) or 5/5 (20%).
About 60% of surveyed teachers had used ChatGPT for teaching programming, but about 50% rated satisfaction as 3/5, suggesting limited trust; one teacher said ChatGPT “is still not perfect to answer some exams of my Java class.”
The paper identifies threats including cheating on online exams and assignments, diminished critical thinking, difficulty evaluating AI-generated text/code, ethical implications and bias, and blind reliance on generative AI; proposed strategies include clear assignment instructions, plagiarism detection, proctoring, comparing responses, and follow-up questions.

Methods

The authors conducted coding-related experiments with ChatGPT: code generation from problem descriptions, pseudocode generation, code correction/debugging, and code optimization.
For code generation, they used eight random “Algorithms and Data Structures” problems from AOJ, generated code three times per problem, and validated results on both a basic compiler and the AOJ platform.
They also conducted surveys with undergraduate, Master’s, and doctoral students and with teachers about ChatGPT’s support for programming learning and teaching; the paper reports percentages but not the total number of respondents.

Limitations

The paper states that experiments were conducted on ChatGPT during active development, so results may vary with new ChatGPT versions, different questions, different problem descriptions, and different solution codes for optimization.
The paper notes that although ChatGPT generated about 85.42% correct code on average, adjustments may still be necessary for error-free compilation and acceptance, and it failed an elementary counting task involving the digit “8.”
Evident from the text: the survey sample size is not reported, and the coding experiments are limited to eight AOJ problems with three generations each, which restricts generalizability.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.3390/app13095783

Cites

71 of 71 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 9 cited sources checked · 0 supported · 0 flagged

Show all 33 claims

It may state two separate claims as one. 18
Probably not a substantial claim. 31

A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The suggestions proved to be interesting to the programmers and helpful in resolving the code errors.”
§ ChatGPT for Education and Research: Opportunities, Threats, and Strategies > 4.3. Error Checking and Debugging in Code
Load-bearingStrength:plain· not yet calibratedCausal:direct· not yet calibrated
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes
It may state two separate claims as one.
- Rests on an assumption: The authors' assessment that ChatGPT's debugging suggestions were helpful reflects actual programmer benefit.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“it can be difficult to hold anyone accountable for the responses generated”
§ ChatGPT for Education and Research: Opportunities, Threats, and Strategies > Ethical implications and potential biases:
Strength:plain· not yet calibrated
Tests✓ Asserted: passes✗ Checkable: fails✗ Load-bearing: fails✓ Based: passes
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
- Rests on an assumption: ChatGPT generates responses without human intervention.
In the paper
“Cotton et al. [57] presented several strategies for recognizing texts from LLMs such as ChatGPT, including language inconsistencies, a lack of proper citations, factual errors, ambiguity, and poor context awareness.”
§ ChatGPT for Education and Research: Opportunities, Threats, and Strategies > -Sam Altman, CEO of OpenAI
What the sources say
- Not checked yetcites [57] Cotton, D.R., Cotton, P.A., and Shipway, J.R. (2023). Chatting and Cheating. Ensuring academic integrity in the era of ChatGPT. Innov. Educ. Teach. Int., 1–12. source
Strength:plain· not yet calibrated
Tests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passes
Probably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“The answers and texts generated by ChatGPT are becoming indistinguishable from human-generated answers and texts.”
§ ChatGPT for Education and Research: Opportunities, Threats, and Strategies > -Sam Altman, CEO of OpenAI
What the sources say
- Not checked yetcites [57] Cotton, D.R., Cotton, P.A., and Shipway, J.R. (2023). Chatting and Cheating. Ensuring academic integrity in the era of ChatGPT. Innov. Educ. Teach. Int., 1–12. source
- Not checked yetcites [60] Elkins, 2020, Can GPT-3 pass a Writer’s turing test?, J. Cult. Anal.
- Not checked yetcites [61] Gao, C.A., Howard, F.M., Markov, N.S., Dyer, E.C., Ramesh, S., Luo, Y., and Pearson, A.T. (2022). Comparing scientific abstracts generated by ChatGPT to original abstracts using an artificial intelligence output detector, plagiarism detector, and blinded human reviewers. bioRxiv. source
Load-bearingStrength:plain· not yet calibrated
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In short, ChatGPT threatens the fairness and validity of online exams and assignments.”
§ ChatGPT for Education and Research: Opportunities, Threats, and Strategies > 6. Threats and Strategies
Load-bearingStrength:plain· not yet calibratedCausal:direct· not yet calibrated
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes
Probably not a substantial claim.
- Rests on an assumption: ChatGPT can generate human-like text for academic topics.

40 of 40

The paper relies on this without support.
The eight randomly selected AOJ problems and three code generations per problem are representative of ChatGPT's general code-generation performance for programming learning.
“We leveraged the problem descriptions of eight random problems and generated codes three times for each problem on the basis of the same description.”
The paper relies on this without support.
The survey respondents are representative of students and teachers who use ChatGPT for programming learning and teaching.
“We conducted a comprehensive survey on how ChatGPT supports programming learning and teaching among undergraduate, Master's, and doctoral students and teachers.”
The paper relies on this without support.
Students' self-reported helpfulness of ChatGPT suggestions reflects actual improvement in solving programming problems.
“By asking the question “Do ChatGPT's suggestions help you in solving programming problems?”,we tried to assess how ChatGPT suggestions help students.We found that about 86.7% of the students answered “Yes”.”
The paper relies on this without support.
The authors' judgment that ChatGPT-generated explanations and pseudocode are easy to understand and useful reflects learners' actual understanding.
“The results demonstrate that ChatGPT can generate easy-to-understand explanations and pseudocode that are useful for learners to understand algorithmic concepts.”
The paper relies on this without support.
The authors' assessment that ChatGPT's debugging suggestions were helpful reflects actual programmer benefit.
“The suggestions proved to be interesting to the programmers and helpful in resolving the code errors.”
The paper relies on this without support.
ChatGPT can generate human-like text for academic topics.
“As ChatGPT can generate human-like text for academic topics”
The paper relies on this without support.
LLMs rely heavily on training data, and when the data contain biases or anomalies, it could lead to unfair results.
“Typically, LLMs rely heavily on training data, and when the data contain biases or anomalies, it could lead to unfair results.”
The paper relies on this without support.
The internal mechanisms and processes of ChatGPT are not sufficiently open and transparent to users about how they work.
“Furthermore, the internal mechanisms and processes are not sufficiently open and transparent to users about how they work.”
The paper relies on this without support.
ChatGPT generates responses without human intervention.
“Because ChatGPT generates responses without human intervention”

9 of 9

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

Table 1 names a different lead author for reference 25
Minor
Table 1 attributes reference 25 to Simon et al., while the reference list identifies Frieder as its lead author.

1 of 1

1 retracted

Retracted: Chat With ChatGPT on Intelligent Vehicles: An IEEE TIV Perspective
Du, H., Teng, S., Chen, H., Ma, J., Wang, X., Gou, C., Li, B., Ma, S., Miao, Q., Na, X., et al. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3253281 · Cited by 164 · cited 1×
“Moreover, ChatGPT has recently been applied to tasks in different domains such as software engineering [36], medical education [37], data augmentation [38], ﬁfth industrial revolution [39], code generation [40], intelligent vehicles [41], and solving AI tasks [42].”
Method
Retracted
Attention Is All You Need
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · cited 1×
“Therefore, the Transformer architecture was introduced [4] to alleviate this problem.”
Method
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 1×
“Generative pretrained transformer (GPT)-3 is a large language model (LLM) based on the Transformer architecture [5,6] that has achieved signiﬁcant success in NLP tasks.”
Background
ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · doi:10.35542/osf.io/5er8f · Cited by 7,552
ChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326 · cited 3×
“Furthermore, several studies [9–12 Frieder et al. [25] tested the mathematical capabilities of ChatGPT on GHOSTS and handcrafted datasets.”
BackgroundMethod
Training language models to follow instructions with human feedback
Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C. L., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., et al. (2022) · arXiv · doi:10.48550/arxiv.2203.02155 · Cited by 4,208 · cited 2×
“Finally, the resulting model is called InstructGPT [8].”
BackgroundMethod
Performance of ChatGPT on USMLE: Potential for AI-Assisted Medical Education Using Large Language Models
Kung, T. H., Cheatham, M., ChatGPT, Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., et al. (2022) · doi:10.1101/2022.12.19.22283643 · Cited by 4,115
Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models
Kung, T. H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000198 · Cited by 4,115 · cited 1×
“Kung et al. [26] evaluated the performance of ChatGPT on the US Medical Licensing Exam, which includes three exams: Step 1, Step 2CK, and Step 3.”
Background
Chatting and cheating: Ensuring academic integrity in the era of ChatGPT
Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2190148 · Cited by 3,087 · cited 3×
“Students can be given clear instructions on assignments and online exams on how to structure their assignments and answer their questions online [57].”
Background
Chatting and Cheating. Ensuring academic integrity in the era of ChatGPT
Cotton, D., Cotton, P., & Shipway, J. R. (2023) · doi:10.35542/osf.io/mrz8h · Cited by 3,079

Flagged first, then by citations

Show all 58 references

Research works printed but not linked: 3

Rahman, M.M. (2022). Data Analysis and Code Assessment Using Machine Learning Techniques for Programming Activities. [Ph.D. Thesis, The University of Aizu].
Avila-Chauvet, L., Mejía, D., and Acosta Quiroz, C.O. (2023). Chatgpt as a Support Tool for Online Behavioral Task Programming. SSRN, Available online: https://ssrn.com/abstract=4329020.
Jiao, W., Wang, W., Huang, J.t., Wang, X., and Tu, Z. (2023). Is ChatGPT a good translator? A preliminary study. arXiv.

Sorted by citations

Items 801–900 of 1,004

An Integrated LDA-QFD Approach for Improving Online Course Quality Based on Learners' Reviews
Wang, R., Ling, H., Chen, J., & Fu, H. (2025) · International Journal of Distance Education Technologies · doi:10.4018/ijdet.371203 · Cited by 5
“…pre-trained transformer alternatives, which provide vast amounts of information and resources, some students may opt for self-learning, using these tools rather than enrolling in MOOCs and potentially leading to a decrease in course enrollment (Rahman & Watanobe, 2023; Tayan et al., 2024).”
Enhancing STEM Education with ChatGPT: A Case Study on Developing Practice Assessments for C Programming
Ismail, S. S., Lynch, J., & Alghazo, R. (2024) · IEEE International Conference on Engineering Education (ICEED) · doi:10.1109/iceed62316.2024.10923780 · Cited by 1
“In [1], the authors surveyed the potential opportunities and threats of ChatGPT in the education field, and they conducted a study on the benefit of ChatGPT in enhancing students’ programming skills.”
Influential
Embedding process knowledge in cyber-social systems on the example of cognitive tutor to teach scope
Александрович, С. О., Sidor, A., & Karpenko, P. (2023) · Journal of Integrated Design and Process Science · doi:10.1177/10920617241289701 · Cited by 1
“…and instructors with lesson planning (Hartley et al., 2024; Rahman & Watanobe, 2023); they are also used to test design (Hartley et al., 2024; Rahman & Watanobe, 2023), consoli-date learning material (Hartley et al., 2024), explain and write program code (Hartley et al., 2024; Kazemitabaar…”
Influential
Interacción social en el blended learning: una reflexión sobre la integración de la tecnología
Martínez, V. A. G., & Naranjo, M. L. G. (2024) · trilogía Ciencia Tecnología Sociedad · doi:10.22430/21457778.3117 · Cited by 2
Large Language Models in Corporate Investment: An Analysis of ChatGPT’s Transformative Applications, Strategic Impacts, and Future Opportunities
Zhuang, X., & Wu, Y. (2025) · IT Professional · doi:10.1109/mitp.2025.3543555 · Cited by 1
Perceptions of ChatGPT's Reliability and Efficacy for Academic Tasks Among Saudi University Students
Amal, A. (2025) · Modern English Education · doi:10.18095/meeso.2025.26.1.242 · Cited by 1
“It offers an accommodating group discussion environment since it can help learners with disabilities gauge other learners by offering text-to-speech and speech-to-text services (Rahman & Watanobe, 2023).”
Influential
Subjective and Objective Quality Assessments of AI-Generated Images for Language E-Learning
Onuoha, C., Dang, V. H., Nam, N. D., Hương, T. T., Nam, P. N., & Thang, T. C. (2025) · IEEE Access · doi:10.1109/access.2025.3578047 · Cited by 1
“For example, GPT [4] can be employed in unimodal tasks to provide answers to quizzes [7], grade questions [8], [9], [10], and solve mathematical problems [11].”
The authors have requested that this preprint be removed from Research Square.Preprint
Marbun, T. O. (2023) · Research Square · doi:10.21203/rs.3.rs-3044396/v1 · Cited by 1
Software Engineering Education in Chatgpt Era: Experiences on Adjustments in Programming Course for Novice ProgrammersPreprint
Kosar, T., Ostojić, D., Liu, Y. D., & Mernik, M. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4640063 · Cited by 1
The Relationship Between AI Tools and Their Aspects in Higher EducationPreprint
Abhishek, N., & Neethu, S. (2024) · Qeios · doi:10.32388/ac6on1 · Cited by 1
From Early Adoption to Ethical Adoption: A Diffusion of Innovation Perspective on ChatGPT and Large Language Models in the ClassroomPreprint
Imran, M., Shahid, A. R., Hou, M., & Imteaj, A. (2024) · doi:10.36227/techrxiv.170630660.06963201/v1 · Cited by 4
RETRACTED: IBEDO-DE: A Novel ChatGPT-Enhanced Model for ImprovingEducational Outcomes through Data-Driven Insights and Student PerceptionsPreprint
Sorour, S. E., Ahmed, H. M. M., Amin, A. E. A., & Abdelkader, H. E. (2024) · Research Square · doi:10.21203/rs.3.rs-4180848/v1 · Cited by 1
Retracted
Factors and Impacts of ChatGPT Adoption for Academic Purposes in Higher Learning Institutions: Students’ PerspectivesPreprint
Victor, D. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4791569 · Cited by 2
Factors and Impacts of ChatGPT Adoptionfor Academic Purposes in Higher Learning Institutions: Students’ PerspectivesPreprint
Victor, D. (2024) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/qkhs4 · Cited by 2
Evolutionary Trends in Decision Sciences Education Research From Simulation and Games to Data Analytics and Generative Artificial IntelligencePreprint
Akpan, I. J., & Akpan, A. A. (2024) · Preprints.org · doi:10.20944/preprints202407.1294.v1 · Cited by 1
Pre-service Physical Sciences Teachers’ Views on Integrating ChatGPT into Teaching: A Case StudyPreprint
Jere, S., Bessong, R. O., Mpeta, M., & Litshani, N. F. (2024) · Research Square · doi:10.21203/rs.3.rs-4783356/v1 · Cited by 1
The Psychology of Generative AI in Higher Education: Mapping Benefits and RisksPreprint
Kościelniak, M., & Bielecki, M. (2024) · Qeios · doi:10.32388/x1itss · Cited by 4
Bridging Today and the Future of Humanity: AI Safety in 2024 and BeyondPreprint
Han, S. (2025) · Qeios · doi:10.32388/zhm9uq · Cited by 4
Translating the Force Concept Inventory in the age of AIPreprint
Babayeva, M., Dunlap, J. C., Snětinová, M., & Widenhorn, R. (2025) · Research Square · doi:10.21203/rs.3.rs-7410179/v1 · Cited by 2
Discipline-Sensitive Generative AI in Higher Education
López-López, E. M., Bru-Cordero, O., & Correa-Álvarez, C. D. (2026) · Encyclopedia · doi:10.3390/encyclopedia6060119 · Cited by 4
USO DO CHATGPT EM ATIVIDADES AVALIATIVAS DE DISCIPLINAS BÁSICA DE FÍSICA PARA ALUNOS DO CURSO DE ENGENHARIA
Pojar, M., Masunaga, S. H., Chinaglia, E. F., & Curado, J. F. (2023) · Brazilian Congress of Engineering Education (COBENGE) · doi:10.37702/2175-957x.cobenge.2023.4455
Programme basé sur l’étude collective d’une leçon (Lesson Study) et les applications d'intelligence artificielle pour développer les pratiques enseignantes et les compétences de la pensée réflexive auprès des enseignants de français
محمد, م. م. (2023) · مجلة جامعة الفيوم للعلوم التربوية والنفسية · doi:10.21608/jfust.2023.320270
ChatGPT in ultrasound medicine: potential applications and challenges (Preprint)Preprint
Zhang, Y., Luo, Y., Ling, W., Zhu, Y., & Lu, X. (2023) · doi:10.2196/preprints.54225
ChatGPT's Academic Odyssey: Navigating Higher Education's AI RevolutionPreprint
Sen, S. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4628243
AS PERSPECTIVAS E OS DESAFIOS DA CURADORIA EDUCACIONAL PARA ESTUDANTES HIPERCONECTAD@S
Eichler, M. L., & Eichler, T. Z. N. (2023) · Revista de ciências humanas · doi:10.31512/19819250.2023.24.02.49-67
Izazovi i moguća rješenja u korištenju umjetne inteligencije (AI) prilikom provođenja ispita u visokom školstvu
Vukelić, B., Šehanović, Z., & Alić, N. (2023) · Politehnika · doi:10.36978/cte.7.2.5
Proses Berpikir Tingkat Tinggi Mahasiswa Menggunakan Kerangka Kerja Teori Mason Berbantuan ChatGPT Pada Analisis Real II
Ratnawati, O. A., Artuti, E., & Pancarita, P. (2023) · Equals Jurnal Ilmiah Pendidikan Matematika · doi:10.46918/equals.v6i2.1814
About the methods of the students competences analysis in distance and blended learning
Savin, M. A. (2023) · Informatics and Education · doi:10.32517/0234-0453-2023-38-6-59-67
Analysis of ChatGPT's capabilities for solving problems of reverse-engineering of software
Sokolov, V. (2023) · Collection Information technology and security · doi:10.20535/2411-1031.2023.11.2.293778
Students’ Perspectives on ChatGPT in China
Luo, C., & Yunus, M. M. (2023) · International Journal of Academic Research in Business and Social Sciences · doi:10.6007/ijarbss/v13-i12/20257
Research Ethics Among Undergraduates of the Social Sciences
Shaikh, S. S., & Chhachhar, D. A. R. (2024) · Advances in information quality and management · doi:10.4018/979-8-3693-1726-6.ch010
مستقبل التعليم: إمكانات وعواقب وتحديات الذكاء الاصطناعي
الهادي, م. (2024) · Compunet ( The Egyptian Information Journal ) · doi:10.21608/jstc.2024.338391
Chatbot-generative pretrained transformer: Potential role in medical education and clinical settings
Meo, S. A. (2024) · Advances in Biomedical and Health Sciences · doi:10.4103/abhs.abhs_89_23
Integración de Chat GPT: Proceso de Actualización de Perfil de Egreso
Sepúlveda, I., Rodríguez, Y. B., & Galindo, T. M. (2023) · CODES · doi:10.15443/codes2052
Integración de ChatGPT en la Planificación Didáctica: Percepciones y Valoraciones de Estudiantes de Educación Diferencial
Sepúlveda-Irribarra, C. (2023) · CODES · doi:10.15443/codes2028
Integrated Coding Environment for Programming Exercise
Murai, K., & Watanobe, Y. (2023) · Asia Service Sciences and Software Engineering Conference (ASSE) · doi:10.1145/3634814.3634822
“In these papers [5, 17, 18], the excessive use of generative AI such as ChatGPT can lead to a lack of specialized knowledge of learners, the impact on problem-solving ability, and the possibility of dependence due to excessive use.”
BackgroundSelf-citation
LSA: A Novel State-Of-The-Art Sorting Algorithm for Efficient Arrangement of Large Data
Shiplu, A. I., Rahman, M. M., & Watanobe, Y. (2023) · Asia Service Sciences and Software Engineering Conference (ASSE) · doi:10.1145/3634814.3634829
Self-citation
PENINGKATKAN KESADARAN PERSILANGAN BUDAYA DAN DIGITALISASI PEMBELAJARAN PADA SISWA SMA MELALUI PENYULUHAN
Syahputri, R., Nurfiana, N., Trisnawati, S., Rafles, Z., & Alex, Z. P. (2024) · JMM (Jurnal Masyarakat Mandiri) · doi:10.31764/jmm.v8i2.21381
“…yang dapat berdampak pada kesehatan jiwa dan keinginan untuk mengakhiri hidup Kim et al. (2020), dan tidak jujur dalam mengerjakan ujian daring Rahman & Watanobe (2023), Untuk memastikan keunggulan ini dapat dimanfaatkan secara optimal oleh para pelaku pendidikan dan menekan aspek negatif,…”
Background
ChatGPT és más nagy nyelvi modellek (LLM-ek) biztonsági kérdései, szervezeti és társadalmi hatásai
Nagy, P. (2024) · Rendvédelem · doi:10.53793/rv.2024.2.1 · Cited by 1
An In-depth Analysis of Current Trends in ChatGPT Academia, Scholars' Sentiments, and Network Characteristics in Co-authorship of Published Papers
Hu, L., Xu, Q., Yao, Y., & Zhang, T. (2024) · Lecture Notes in Education Psychology and Public Media · doi:10.54254/2753-7048/45/20230469
The applications, risks and countermeasures of ChatGPT integration into school education
Zhang, H. (2024) · Advances in Social Development and Education Research · doi:10.61935/asder.2.1.2024.p130
Experiential Learning in Engineering Education: A Book Review
Techanamurthy, U., Rosli, R. M. K. R., & Zakaria, A. F. (2023) · Asean Journal of Engineering Education · doi:10.11113/ajee2023.7n2.136
O uso do ChatGPT no ensino de programação
Melo, L. B., & Moura, T. J. M. (2023) · Computação Brasil. · doi:10.5753/compbr.2023.51.3994
Perceptions of the Impact of Chatgpt on University Training of Future Public Relations Practitioners in SpainPreprint
Xifra, J., mohamed, R., & Amar, H. M. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4836497
تطوير مهارات أعضاء هيئة التدريس والباحثين لاستخدام التشات جي بي تي ChatGPT في التعليم الجامعي: دراسة تجريبية Developing of Faculty Members and Researchers’ Skills in Using ChatGPT in University Education: Experimental Study
حسين, و. ب. ع. أ., & العمري, ن. ح. (2024) · Mağallaẗ Al-Buḥūṯ Al-Tarbawiyyaẗ wa Al-Nawʿiyyaẗ · doi:10.21608/jeor.2024.353873
A Case Study of ‘AI and Ethics’ on the Use of ChatGPT
Kim, Y. (2024) · Asia-pacific Journal of Convergent Research Interchange · doi:10.47116/apjcri.2024.05.43
AlgoTutor: An Integrated Learning Platform for Data Structures and Algorithms with Real-Time Guidance and Interactive Visualizations
Sashank, G. C., Tan, Z. W., & Fernando, O. N. N. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-61953-3_4
MEMÓRIA METÁLICA E CHATGPT: BENEFÍCIOS E LIMITAÇÕES DO USO DE FERRAMENTAS DE INTELIGÊNCIA ARTIFICIAL NA APRENDIZAGEM DE LÍNGUAS ESTRANGEIRAS
Pinto, M. A. R. (2024) · Revista Ibero-Americana de Humanidades, Ciências e Educação · doi:10.51891/rease.v10i6.14537 · Cited by 1
Positive digital learning: Challenges and path forward for educators
Carmo, M. (2024) · doi:10.36315/2024eadix17
The Use of ChatGPT in Acquiring Technical Term for Report Writing among Aircraft Maintenance Students
Thambirajah, J. I. (2024) · International Journal For Multidisciplinary Research · doi:10.36948/ijfmr.2024.v06i03.23153
Leveraging on Chatgpt, an Artificial Intelligence (AI) Tool to Transform Examination Writing in Higher EducationPreprint
Atieku-Boateng, H., Osei, R. D., Aryee, V., Essien, L., & Atieku-Boateng, B. (2024) · Research Square · doi:10.21203/rs.3.rs-4550887/v1 · Cited by 1
ChatGPT como herramienta estratégica de aprendizaje de un curso de pregrado de desarrollo de aplicaciones multiplataforma orientado a la Web
de Porres, U. D. S. M., Yamao, E., Lescano, N. L., de Porres, U. D. S. M., Macedo, Y. A. H., de Porres, U. D. S. M., Jácome, F. P. P., & de Porres, U. D. S. M. (2024) · Campus · doi:10.24265/campus.2024.v29n37.02
“Todo esto disponible en cualquier momento y en cualquier lugar (Geng et al., 2023; Rahman y Watanobe, 2023).”
A Comparative Study of Large Language Models in Explaining Intrinsically Disordered ProteinsPreprint
Gonzalez, D. T., Djulbegovic, M. B., Kim, C. K., Antonietti, M., Gameiro, G. R., & Uversky, V. N. (2024) · Qeios · doi:10.32388/5d952o
CHATGPT IN LEARNING AND RESEARCH: PERSPECTIVES FROM LECTURERS AND STUDENTS OF UNIVERSITIES IN DA NANG CITY
Phuong, L. T. (2024) · Tạp chí Khoa học Trường Đại học Vinh. Series C Khoa học và công nghệ giáo dục · doi:10.56824/vujs.2024.htkhgd36
Disruptive Innovations in Human Resource Management
Brown, B. A., & Heitner, K. L. (2024) · Advances in human resources management and organizational development book series · doi:10.4018/979-8-3693-4412-5.ch012
AI and ChatGPT Benefits, Implications, and Expectations in Engineering
Choudhary, S., Jyotiyana, M., & Sharma, K. K. (2024) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-2284-0.ch001
A Comparative Study of Large Language Models in Explaining Intrinsically Disordered ProteinsPreprint
Gonzalez, D. T., Djulbegovic, M. B., Kim, C. K., Antonietti, M., Gameiro, G. R., & Uversky, V. N. (2024) · Qeios · doi:10.32388/5d952o.2
“Further exploration of GPT-4's capabilities has shown its aptitude to tackle a broad range of intricate prompts across disciplines such as mathematics, coding, vision, law, and psychology while maintaining a human-like output [9][12] .”
Background
Correlation of Colposcopic Findings with Histologic Diagnosis in Cervical Lesions at Federal Medical Centre, Abuja
Offor, J. O., Izuka, M. O., Munirah, A., Benedict, E., Olukemi, M. O., Achusi, I. B., & Iyelobu, C. E. (2024) · Universal library of medical and health sciences. · doi:10.70315/uloap.ulmhs.2024.0203005
WRITING A CRITICAL ACADEMIC ESSAY: WITH OR WITHOUT CHATGPT?
Вовк, О., & Kryvoshyia, D. (2024) · ГРААЛЬ НАУКИ · doi:10.36074/grail-of-science.06.09.2024.058
“Notwithstanding that currently researchers recognize multiple benefits of ChatGPT in education [8; 10; 11], the question to what extent it can be applied in AW instruction still remains to be an issue that has yet to be thoroughly addressed.”
Background
Fransız Kültür Edincinin Kazandırılmasında Yapay Zekâ Rehber Olabilir Mi? Bing Chat AI Örneği
Yalçin, P., & Yağcı, Ş. Ç. (2024) · Journal of Higher Education and Science · doi:10.5961/higheredusci.1402198 · Cited by 1
After One Year, Where are Large Language Models Headed: A Thematic Analysis using Bibliometric Methodology (Preprint)Preprint
Bernstein, E., Ramsamooj, A., Miller, K. L., & Lum, Z. C. (2024) · doi:10.2196/preprints.68603
Exploring the Impact of ChatGPT in Engineering Education: A Mixed Methods Study at the Military Technological College in Muscat.
Badi, A. A., handhali, K. A., Alsalmi, S., Al-Zadjali, O., AlYarobi, S., & Alshibli, A. (2024) · International Conference on Digital Technology in Education (ICDTE) · doi:10.1145/3696230.3696252 · Cited by 1
“It is important to thoroughly examine the ethical considerations and potential biases associated with the utilization of ChatGPT in both education [18].”
REFLECTIONS ON USING CHATGPT TO GENERATE ESP MATERIALS. A CASE STUDY
Chirobocea, O. (2024) · Studia Universitatis Babeș-Bolyai Philologia · doi:10.24193/subbphilo.2024.4.02 · Cited by 4
“There is also the potential disruption of the student-teacher relationship, which has traditionally been to the teaching process (Koh et al. 2023; Rahman and Watanobe 2023).”
ChatGPT'nin Programlama Kodu Hata Ayıklama Performansının PyCharm Geleneksel Hata Ayıklama Aracı Performansı ile Karşılaştırılması
Kapar, F., Çelik, H. E., & Ziyanak, S. (2024) · Yüzüncü Yıl Üniversitesi Fen Bilimleri Enstitüsü Dergisi · doi:10.53433/yyufbed.1514642
Analytical Insight into Cutting-Edge Image Captioning for Advanced ChatGPT Functionality
Manisha, Kumar, A., & Yadav, D. K. (2024) · Communications in computer and information science · doi:10.1007/978-3-031-80778-7_16 · Cited by 2
Numerical Solution Analysis of Planetary Motion Models Using the Runge-Kutta Method
Sulthon, M. B., Tu’sadiyah, H., Bulayi, M., Ibtisam, T., & Jeewantha, T. (2024) · Interval Indonesian Journal of Mathematical Education · doi:10.37251/ijome.v2i1.1359
“In this process, the fourth-order Runge-Kutta equation is sought for its numerical solution using the fourth-order Rungekutta method and defining the variables 𝑘 1 , 𝑘 2 , 𝑘 3 and 𝑘 4 according to the general scheme [33]-[35].”
Leveraging ChatGPT for open educational resources in higher education: Potential benefits and multidimensional challenges
Aggoune, A., & Abada, C. (2024) · Science and Knowledge Horizons Journal · doi:10.34118/jskp.v4i02.4021
“…specific concepts, aiding students in their educational journey and experience with OERs and enhancing the effectiveness and quality of the latter (Rahman & Watanobe, 2023) • Fourth: following the above, the role of this technology can form as a design assistant, where ChatGPT aids in the process…”
Influential
ปัญญาประดิษฐ์เชิงสร้างสรรค์ในการศึกษาและการวิจัย : กรณีศึกษาการใช้ ChatGPT ของผู้รับทุนสนับสนุนที่จุฬาลงกรณ์มหาวิทยาลัย
ฉกามานนท์, ส., บุณยพุกกณะ, โ., สิทธิพันธุ์, ป., วงศ์วิเศษ, ข., สาเมาะ, อ., & Khabuan, S. (2025) · Interdisciplinary Academic and Research Journal · doi:10.60027/iarj.2025.280525 · Cited by 2
ВЛИЯНИЕ НЕЙРОСЕТЕЙ CHATGPT, MIDJOURNEY НА КАЧЕСТВО ПРОФЕССИОНАЛЬНОЙ ПОДГОТОВКИ БУДУЩЕГО ПЕДАГОГА В УСЛОВИЯХ ИССЛЕДОВАТЕЛЬСКОГО УНИВЕРСИТЕТА
Жумашева, С. С., & Bitleuov, A. A. (2024) · Habaršy. Pedagogika ġylymdary seriâsy · doi:10.51889/2959-5762.2024.84.4.013
Research on Ethical Issues of Classroom Dialogue in the Era of Large Language Model
Ling, J., Zhu, J., Shi, J., & Meo, P. D. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-0055-7_19
Assessing the Influence of ChatGPT on Student Outcomes in a Models of Computing Course
Blasco, I., & Mochetti, K. (2025) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3641555.3705132
Analyzing Undergraduate Students' Perceptions of Using ChatGPT in Daily Life
Agrawal, S., Huynh-Cam, T.-T., & Nalluri, V. (2024) · International Workshop on Artificial Intelligence and Education (WAIE) · doi:10.1109/waie63876.2024.00021
“For instance, [7] studied the perspective of students and educators of using ChatGPT in programming education.”
Influential
Preparing Future Engineers: Strategies for Integrating AI Platforms in Higher Education
Kok, C. L., Ho, C. K., Koh, Y. Y., Thanh, N. T. C., & Teo, T. H. (2024) · IEEE Region 10 Conference (TENCON) · doi:10.1109/tencon61640.2024.10902925
“Most research on AI's influence in software engineering education focuses on ChatGPT's ability to tackle university-level software engineering assignments and individual programming tasks [12].”
Need a Guide by My Side Not a Sage on Stage: ChatGPT in Learning
Chitrao, P. V., Bhoyar, P. K., & Divekar, R. (2025) · Lecture notes in networks and systems · doi:10.1007/978-981-97-8602-2_13
Generative AI- and ChatGPT for Foreign Language Learning: An Action Research
Dorasamy, M., Jun, L. Y., Kaliannan, M., & Jambulingam, M. (2025) · South Asian Journal of Management · doi:10.62206/sajm.31.6.2024.94-119
Use of Generative Artificial Intelligence among Selected Pre-University Business Students at a Private University in Malaysia
Lee, A. (2025) · Asia-Pacific Journal of Futures in Education and Society · doi:10.58946/apjfes-4.1.p1 · Cited by 1
Exploring Student Teachers’ Acceptance Intention of ChatGPT-Assisted Language Teaching: An Integration of the AOI Theory and the TAM Model
Xiong, Y., & Luo, Z. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-4090-4_6
Investigating The Effect of Artificial Intelligence Based Tools on Pre-Service Mathematics Teachers’ Concept Images
Karaca, H. (2025) · e-Kafkas Eğitim Araştırmaları Dergisi · doi:10.30900/kafkasegt.1534014
ChatGPT in Education and Healthcare: Applications, Challenges, and Ethical Implications
Liu, S. (2025) · Applied and Computational Engineering · doi:10.54254/2755-2721/2025.kl22304
Exploring the Role of Large Language Models in Evaluating Argumentative Writing in Military School Education
da Silva, D. C. A., Mello, C. E., & García, A. C. B. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-87330-0_15 · Cited by 2
Trends and Challenges of Educational Application of Generative Artificial Intelligence
Zhou, P., Xu, H., Tan, Y., Liu, M., Zhou, X., Xiong, W., & Li, J. (2024) · doi:10.1145/3722237.3722379
“It is crucial that people’s critical thinking and digital literacy should be further developed and promoted in educational informatization and digital literacy education [17].”
OPINION MINING USING BERT REGARDING PERCEPTIONS OF CHATGPT USAGE FROM UNDERGRADUATE STUDENTSPreprint
Supriyadi, E., Mahmud, M. R., Maylawati, D. S., Ramdhani, M. A., & Pahmi, S. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5213187
The Evolving Impacts of GenAI Tools on Writing Centers
Lindberg, N., & Domingues, A. A. (2025) · IGI Global eBooks · doi:10.4018/979-8-3693-8059-8.ch004
Enhancing Technological Sustainability in Academia: Leveraging ChatGPT for Teaching, Learning and EvaluationPreprint
Sadiq, M. A., Kefas, H. I., Ukaegbu, F. C., & Isiaku, L. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5251679
Using Generative Artificial Intelligence to Enhance the Performance of Disadvantaged Students in Secondary EducationPreprint
Brunton, R., Rhazzafe, S., Moodley, R., Kühn, S., Caraffini, F., Wilford, S., Higginbottom, R., Colreavy‐Donnelly, S., & Góngora, M. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5243811
Prompt writing and linguistic-syntax collaboration in power-writing AI utilization to assist introduction writing
Ganie, R., Sinar, T. S., Syahputra, F. P., & Veronica, A. (2025) · Multidisciplinary Science Journal · doi:10.31893/multiscience.2025341
Optimizing Research Performance: The Impact of ChatGPT and Digital Competence on Research Skills and Autonomy
Hidayat-ur-Rehman, I. (2025) · International Conference on Computing and Information Technology (ICCIT) · doi:10.1109/iccit63348.2025.10989377
Student Experience with AI-Assisted Situational Analysis in Construction Management
Daggubati, S. C. (2025) · Springer eBooks · doi:10.1007/978-981-96-6001-8_5
The Use of Chatgpt in Improving the Critical Thinking Skills of Islamic Education Graduates in Islamic Universities
Sofa, N. A., Kunaepi, A., & Nasikhin, N. (2024) · Edukasi Jurnal Pendidikan dan Pengajaran · doi:10.19109/6cdck053
Automated Robot Agent for Evaluating the Scientific Inquiry Capabilities via GPT-4: A Study on the Transparency and Visualization in Large Language Model
Yoon, G., Lee, H., Lee, S., Park, S.-Y., Dong, S.-Y., & Sim, J. Y. (2025) · The Journal of Korea Robotics Society · doi:10.7746/jkros.2025.20.2.200
Does ChatGPT-Integrated Learning Affect Indonesian EFL Learners’ Grammar Achievement?
Azwar, T. A., & Sujarwati, I. (2025) · ELE Reviews English Language Education Reviews · doi:10.22515/elereviews.v5i1.10425 · Cited by 6
“Despite the potential drawbacks, ChatGPT may occasionally produce inaccurate and illogical responses (Rahman & Watanobe, 2023).”
The Impact of AI-Assisted Mind Map-Based Learning Assessment on Motivation
Boukhari, S., Radid, M., Naciri, A., Chemsi, G., & Sadiq, M. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-0740-4.ch002
Learning a First Programming Language with LLM Tutor
Vukojičić, M., & Korica, I. (2025) · SINTEZA · doi:10.15308/sinteza-2025-331-336 · Cited by 1
“The research suggests that educational institutions must promote the use of LLM models [6] in addition to encouraging the best practices.”
Desarrollo y Evaluación de un Tutor Inteligente para el aprendizaje de programación basado en los Modelos de Lenguaje Extenso
Levchuk, O. (2025) · Congresso Ibero-Americano em Engenharia de Software (CIbSE) · doi:10.5753/cibse.2025.35313
Integrating Large Language Models into EFL classrooms in China: Pedagogical innovations and critical reflections
Xu, Y. (2025) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2025.8.2.2
Ethics-Driven Incentives: Supporting Government Policies for Responsible Artificial Intelligence Innovation
Baldassarre, M. T., Caivano, D., Nieto, B. F., & Ragone, A. (2025) · IEEE Intelligent Systems · doi:10.1109/mis.2025.3583222 · Cited by 3
“…to advancements in health care, enhancing education techniques, automating repetitive tasks, and improving customer service, among others, 29,30,31 there are inherent risks, including privacy concerns, the risk of job losses, the potential to re-produce biases, and spreading misinformation,…”
Areas of Application, Challenges, and Consequences of Generative AI: A Consideration Model
Smith, C. E., Hattingh, M. J., & Matthee, M. C. (2025) · Lecture notes in electrical engineering · doi:10.1007/978-981-96-3936-6_31
Exploring ChatGPT Integration in ELT Pre Service Teacher Education Curriculum Perception and Pedagogical Implications
Uralova, N. (2024) · International Conference on Future Networks and Distributed Systems (ICFNDS) · doi:10.1145/3726122.3726265 · Cited by 3
“Initially, it was developed as a natural language processing model and made its debut as a conversational AI-powered interface offering a free preview of its capabilities (Rahman & Watanobe, 2023; Rudolph et al, 2023).”
Retrieval-Augmented LLMs for Culturally Sensitive Learning Content in Refugee Education
Joseph, T., Hellen, N., & Marvin, G. (2025) · Lecture notes in networks and systems · doi:10.1007/978-981-96-2700-4_31
Development and Validation of Chatgpt as Productivity Assistant Scale (Cpa Scale): Psychometric Properties and Factor Structures Among Undergraduate StudentsPreprint
amin, H., Malik, M. A., Hussain, T., & Sulaiman, N. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5349395

Authors: Rahman, M. M., & Watanobe, Y.
Affiliations: University of Aizu (JP)
Corresponding author: Rahman, Md. Mostafizer
ORCID: Rahman, Md. Mostafizer
Watanobe, Yutaka
Venue: Applied Sciences
Publisher: MDPI AG
Published: 2023-05-08
Volume: 13
Issue: 9
Pages: 5783
ISSN: 2076-3417 (ISSN-L)
DOI: 10.3390/app13095783
OpenAlex: W4381982883
Semantic Scholar: 3b69ec0fc17c5134c9b002bebe283e0189bfdae5
Cited by: 1,080
References: 58
Citations by year: 2026: 193 · 2025: 338 · 2024: 425 · 2023: 124
FWCI: 253.56
Type: journal article
Language: en
Open access: gold
doi.org
Licence: cc-by
creativecommons.org/licenses/by/4.0/ (vor)
Locations: Applied Sciences (publishedVersion, cc-by)
Preprints.org (acceptedVersion, cc-by)
DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders: Japan Society for the Promotion of Science (JSPS) KAKENHI (23H03508)
Topics: Social Sciences › Education › Artificial Intelligence in Education
Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
Keywords: ChatGPT, large language models, artificial intelligence in education, academic dishonesty, critical thinking, programming education, code generation, code correction, student and teacher perceptions

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-09, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-09 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

ChatGPT for Education and Research: Opportunities, Threats, and Strategies

Abstract

Overview

AI snapshot

TL;DR

Key findings

Methods

Limitations

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks