The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
On the Educational Impact of ChatGPT: Is Artificial Intelligence Ready to Obtain a University Degree?
Open accessAbstract
In late 2022, OpenAI released a new version of ChatGPT, a sophisticated natural language processing system capable of holding natural conversations while preserving and responding to the context of the discussion. ChatGPT has exceeded expectations in its abilities, leading to extensive considerations of its potential applications and misuse. In this work, we evaluate the influence of ChatGPT on university education, with a primary focus on computer security-oriented specialization. We gather data regarding the effectiveness and usability of this tool for completing exams, programming assignments, and term papers. We evaluate multiple levels of tool misuse, ranging from utilizing it as a consultant to simply copying its outputs. While we demonstrate how easily ChatGPT can be used to cheat, we also discuss the potentially significant benefits to the educational system. For instance, it might be used as an aid (assistant) to discuss problems encountered while solving an assignment or to speed up the learning process. Ultimately, we discuss how computer science higher education should adapt to tools like ChatGPT.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“When producing AI-generated answers without engaging in analysis or reflection, students miss opportunities to develop their skills and knowledge, and to receive meaningful feedback on their progress [40, 224].”
From Navigating the Ethical and Societal Impacts of Generative AI in Higher Computing Education (2025) · cites this paper as [224]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Malinka et al. [21] provide similar advice on GenAI adoption in the classroom: 'If students use this technology responsibly, their performance might be boosted. In addition, educators might benefit from ChatGPT's abilities in curriculum creation or boosting their performance.'”
From Generative AI and Academic Integrity in Higher Education: A Systematic Review and Research Agenda (2025) · cites this paper as [21]
The cited source says what the claim attributes to it.
In the citing paper
“Malinka et al. [21] provide similar advice on GenAI adoption in the classroom: 'If students use this technology responsibly, their performance might be boosted. In addition, educators might benefit from ChatGPT's abilities in curriculum creation or boosting their performance.'”
From Generative AI and Academic Integrity in Higher Education: A Systematic Review and Research Agenda (2025) · cites this paper as [21]
The cited source says what the claim attributes to it.
In the citing paper
“Other studies investigated methods and tools to detect when GenAI tools had been used to produce content [224, 332].”
From Navigating the Ethical and Societal Impacts of Generative AI in Higher Computing Education (2025) · cites this paper as [224]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Chatting and Cheating. Ensuring academic integrity in the era of ChatGPT
Cotton, D., Cotton, P., & Shipway, J. R. (2023) · doi:10.35542/osf.io/mrz8h · Cited by 3,079
ChatGPT: The End of Online Exam Integrity?
Susnjak, T. (2022) · arXiv · doi:10.48550/arxiv.2212.09292 · Cited by 370 · cited 1×
“5 to solve tests has been tested by Susnjak [16] and Bommarito and Katz [1].”
MethodPlagiarism in the age of massive generative pre-trained transformers (GPT-3)
Dehouche, N. (2021) · Ethics in Science and Environmental Politics · doi:10.3354/esep00195 · Cited by 296 · cited 1×
“In his opinion paper on GPT-3 [5], Dehouche shows it can generate academic papers which pass current plagiarism checks, while Thunström and Steingrimsson [7] used it to generate a full scientific paper ( however, it contains typical flaws such as weak claims and unfit references).”
BackgroundGPT Takes the Bar ExamPreprint
Bommarito, M., & Katz, D. (2022) · Social Science Research Network · doi:10.48550/arxiv.2212.14402 · Cited by 195 · cited 2×
“5 to solve tests has been tested by Susnjak [16] and Bommarito and Katz [1].”
MethodBommarito, M. J., & Katz, D. M. (2022) · doi:10.2139/ssrn.4314839 · Cited by 181
Educational Research and AI-Generated Writing: Confronting the Coming Tsunami
Tate, T. P., Doroudi, S., Ritchie, D., Xu, Y., & uci, M. W. (2023) · doi:10.35542/osf.io/4mec3 · Cited by 137
Defcon Capture the Flag: defending vulnerable code from intense attack
Cowan, C. (2004) · DARPA Information Survivability Conference and Exposition · doi:10.1109/discex.2003.1194923 · Cited by 45
The AI teacher test: Measuring the pedagogical ability of blender and GPT-3 in educational dialogues
Tack, A., & Piech, C. (2022) · arXiv · doi:10.48550/arxiv.2205.07540 · Cited by 36 · cited 1×
“Zong and Krishnamachari [21], and Tack and Piech [18] investigated the use of Natural language processing (NLP) for personalized teaching.”
BackgroundDefcon Capture the Flag: defending vulnerable code from intense attack
Cowan, C., Arnold, S., Beattie, S., et al. (2004) · DARPA Information Survivability Conference and Exposition · doi:10.1109/discex.2003.1194878 · Cited by 26 · cited 3×
“One of the courses involves the Capture The Flag (CTF) task.”
MethodInfluentialEducating for a New Future: Making Sense of Technology-Enhanced Learning Adoption
(2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16290-9 · Cited by 12
Research works printed but not linked: 4
- 10.35542/osf.io · DOI
- Gpt Generative Pretrained Transformer, Almira Osmanovic Thunström, and Steinn Steingrimsson. 2022. Can GPT-3 write an academic paper on itself, with minimal human input? https://hal.archives-ouvertes.fr/hal-03701250
- NL Times. 2023. Dutch Students using ChatGPT to finish homework; Teachers aren't noticing. https://nltimes.nl/2023/01/16/dutch-students-using-chatgpt-finish-homework-teachers-arent-noticing
- Mingyu Zong and Bhaskar Krishnamachari. 2022. Solving Math Word Problems Concerning Systems of Equations with GPT-3. Proceedings of the Thirteenth AAAI Symposium on Educational Advances in Artificial Intelligence. https://anrg.usc.edu/www/wp-content/uploads/2022/12/Solving_Math_Word_Problems_with_GPT3--2022.pdf
Cited by
Sorted by citations
Unifying Large Language Models and Knowledge Graphs: A Roadmap
Pan, S., Luo, L., Wang, Y., Chen, C., Wang, J., & Wu, X. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3352100 · Cited by 1,376
ChatGPT for Education and Research: Opportunities, Threats, and Strategies
Rahman, M. M., & Watanobe, Y. (2023) · Applied Sciences · doi:10.3390/app13095783 · Cited by 1,080
What ChatGPT means for universities: Perceptions of scholars and students
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.1.22 · Cited by 431
“Malinka et al. (2023) explored the educational impact of ChatGPT and questioned whether artificial intelligence is ready to obtain a university degree.”
Background(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.1.23 · Cited by 421
Saif, N., Khan, S. U., Shaheen, I., ALotaibi, F. A., Alnfiai, M. M., & Arif, M. (2024) · Computers in Human Behavior · doi:10.1016/j.chb.2023.108097 · Cited by 301
Metadata
- Authors
- Malinka, K., Peresíni, M., Firc, A., Hujnák, O., & Janus, F.
- Affiliations
- Brno University of Technology (CZ)
- Brno University of Technology, Brno, Czech Rep
- Venue
- Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education V. 1
- Publisher
- ACM
- Published
- 2023-06-29
- Pages
- 47-53
- OpenAlex
- W4382652828
- Cited by
- 287
- References
- 6
- Citations by year
- 2026: 29 · 2025: 94 · 2024: 113 · 2023: 51
- FWCI
- 73.71
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- Brno University of Technology (FIT-S-23-8151)
- Topics
- Social Sciences › Education › Artificial Intelligence in Education
- Social Sciences › Education › Academic integrity and plagiarism
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- ChatGPT, large language models, academic dishonesty, university education, cybersecurity education, programming exercises, exam cheating, term papers, artificial intelligence in higher education, AI-assisted learning, tool misuse
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
