ChatGPT in a programming course: benefits and limitations
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
This paper explores the potential use and limitations of ChatGPT in a programming course, specifically focusing on its evaluation in a Data Analytics course due to its broad applications. The study reveals that ChatGPT offers valuable assistance to teachers in creating class materials, facilitating teaching-learning activities, and designing assessments. Students also benefit from the technology, as it can generate R programming codes and serve as a learning companion. However, limitations were identified, including the generation of incorrect reference materials, the tendency to produce pattern-like content, and potential misuse. The paper encourages replication of the study in other courses to uncover additional strengths and limitations, contributing to the development of ethical guidelines for responsible utilization of this exciting technology.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Artificial Intelligence in Education: A Review
Chen, L., Chen, P., & Lin, Z. (2020) · IEEE Access · doi:10.1109/access.2020.2988510 · Cited by 4,133 · cited 1×
“Overall, AI tools in education contribute to more efficient, adaptive, and inclusive learning experiences (Chen et al., 2020).”
Ray, P. P. (2023) · Internet of Things and Cyber-Physical Systems · doi:10.1016/j.iotcps.2023.04.003 · Cited by 2,463 · cited 1×
“However, the use of this technology raises ethical concerns such as inequity, bias, and plagiarism (Huang and Tan, 2023; Ray, 2023).”
A Comprehensive Survey of Clustering Algorithms
Xu, D., & Tian, Y. (2015) · Annals of Data Science · doi:10.1007/s40745-015-0040-1 · Cited by 1,939
The k-means Algorithm: A Comprehensive Survey and Performance Evaluation
Ahmed, M., Seraj, R., & Islam, S. M. S. (2020) · Electronics · doi:10.3390/electronics9081295 · Cited by 1,717
ChatGPT for Education and Research: Opportunities, Threats, and Strategies
Rahman, M. M., & Watanobe, Y. (2023) · Applied Sciences · doi:10.3390/app13095783 · Cited by 1,080
ChatGPT listed as author on research papers: many scientists disapprove
Stokel-Walker, C. (2023) · Nature · doi:10.1038/d41586-023-00107-z · Cited by 868 · cited 1×
“It can understand and reply to a variety of topics, answer questions, provide explanations, make ideas, and participate in interactive dialogues (Haleem et al., 2022; Stokel-Walker, 2023).”
Chatbots for learning: A review of educational chatbots for the Facebook Messenger
Smutny, P., & Schreiberova, P. (2020) · Computers & Education · doi:10.1016/j.compedu.2020.103862 · Cited by 770 · cited 1×
“ChatGPT can be considered a chatbot—a conversational or interactive agent that provides responses and feedback from inquiries (Okonkwo and Ade-Ibijola, 2020; Smutny and Schreiberova, 2020).”
Haleem, A., Javaid, M., & Singh, R. P. (2022) · BenchCouncil Transactions on Benchmarks, Standards and Evaluations · doi:10.1016/j.tbench.2023.100089 · Cited by 694
van den Berg, G., & du Plessis, E. (2023) · Education Sciences · doi:10.3390/educsci13100998 · Cited by 401
Yilmaz, R., & Karaoglan Yilmaz, F. G. (2023) · Computers in Human Behavior: Artificial Humans · doi:10.1016/j.chbah.2023.100005 · Cited by 344
Sallam, M., Salim, N., Barakat, M., & Al-Tammemi, A. (2023) · Narra J · doi:10.52225/narra.v3i1.103 · Cited by 331
Study and Analysis of Chat GPT and its Impact on Different Fields of Study
Kalla, D., Smith, N., Kuraku, S., & Samaah, F. (2023) · International Journal of Innovative Science and Research Technology (IJISRT) · doi:10.5281/zenodo.7767674 · Cited by 284
Academic integrity and artificial intelligence: is ChatGPT hype, hero or heresy?
Currie, G. M. (2023) · Seminars in Nuclear Medicine · doi:10.1053/j.semnuclmed.2023.04.008 · Cited by 283 · cited 1×
“This issue has been reported in previous studies (Bringula, 2023; Currie, 2023; Kumar, 2023).”
“Intelligent tutoring systems,”
Graesser, A. C., Hu, X., & Sottilare, R. (2018) · International Handbook of the Learning Sciences · doi:10.4324/9781315617572-24 · Cited by 182
Artificial intelligence in scientific writing: a friend or a foe?
Altmäe, S., Sola-Leyva, A., & Salumets, A. (2023) · Reproductive BioMedicine Online · doi:10.1016/j.rbmo.2023.04.009 · Cited by 174
HS Kumar, A. (2023) · Biology, Engineering, Medicine and Science Reports · doi:10.5530/bems.9.1.5 · Cited by 165 · cited 1×
“This issue has been reported in previous studies (Bringula, 2023; Currie, 2023; Kumar, 2023).”
Cited by
ChatGPT in Teaching and Learning: A Systematic Review
Ali, D., Fatemi, Y., Boskabadi, E., Nikfar, M., Ugwuoke, J., & Ali, H. (2024) · Education Sciences · doi:10.3390/educsci14060643 · Cited by 146
Zhang, L., Jiang, Q., Xiong, W., & Zhao, W. (2025) · Journal of Educational Computing Research · doi:10.1177/07356331251333874 · Cited by 15
Chang, C. I., Choi, W. C., & Choi, I. C. (2024) · Proceedings of the 2024 7th Artificial Intelligence and Cloud Computing Conference · doi:10.1145/3719384.3719439 · Cited by 11
“Bringula [15] observed that teachers relying solely on AI responses might not develop their critical thinking skills, neglecting other educational materials.”
InfluentialCabrera, C., & Neville, R. (2025) · Perspectives: Policy and Practice in Higher Education · doi:10.1080/13603108.2025.2595453 · Cited by 4
Metadata
- Authors
- Bringula, R.
- Venue
- Frontiers in Education
- Publisher
- Frontiers Media SA
- Published
- 2024-02-15
- Volume
- 9
- ISSN
- 2504-284X (ISSN-L)
- OpenAlex
- W4391842038
- Cited by
- 55
- References
- 16
- FWCI
- 21.05
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.