Cited by 289Artificial Intelligence in EducationAcademic integrity and plagiarismArtificial Intelligence in Healthcare and Education

On the Educational Impact of ChatGPT: Is Artificial Intelligence Ready to Obtain a University Degree?

Open access
Malinka, Kamil, Peresíni, Martin, Firc, Anton, Hujnák, Ondrej, Janus, Filip·2023·Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education V. 1

Abstract

In late 2022, OpenAI released a new version of ChatGPT, a sophisticated natural language processing system capable of holding natural conversations while preserving and responding to the context of the discussion. ChatGPT has exceeded expectations in its abilities, leading to extensive considerations of its potential applications and misuse. In this work, we evaluate the influence of ChatGPT on university education, with a primary focus on computer security-oriented specialization. We gather data regarding the effectiveness and usability of this tool for completing exams, programming assignments, and term papers. We evaluate multiple levels of tool misuse, ranging from utilizing it as a consultant to simply copying its outputs. While we demonstrate how easily ChatGPT can be used to cheat, we also discuss the potentially significant benefits to the educational system. For instance, it might be used as an aid (assistant) to discuss problems encountered while solving an assignment or to speed up the learning process. Ultimately, we discuss how computer science higher education should adapt to tools like ChatGPT.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3587102.3588827

Cites

10 of 10 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • When producing AI-generated answers without engaging in analysis or reflection, students miss opportunities to develop their skills and knowledge, and to receive meaningful feedback on their progress.

    “When producing AI-generated answers without engaging in analysis or reflection, students miss opportunities to develop their skills and knowledge, and to receive meaningful feedback on their progress [40, 224].”

    From Navigating the Ethical and Societal Impacts of Generative AI in Higher Computing Education (2025) · cites this paper as [224]

    The paper’s “Negative Impacts” section says that using ChatGPT to produce solutions can reduce students’ learning experience and the knowledge gained from solving assignments. Its “AI usage modes” section distinguishes copying answers from interpreting them. Neither passage says that students thereby miss meaningful feedback on their progress. (LLM, conf=0.86)

    Experimental — accuracy not yet measured
  • Educators might benefit from ChatGPT's abilities in curriculum creation or boosting their performance.

    “Malinka et al. [21] provide similar advice on GenAI adoption in the classroom: 'If students use this technology responsibly, their performance might be boosted. In addition, educators might benefit from ChatGPT's abilities in curriculum creation or boosting their performance.'”
  • If students use GenAI responsibly, their performance might be boosted.

    “Malinka et al. [21] provide similar advice on GenAI adoption in the classroom: 'If students use this technology responsibly, their performance might be boosted. In addition, educators might benefit from ChatGPT's abilities in curriculum creation or boosting their performance.'”
  • Other studies investigated methods and tools to detect when GenAI tools had been used to produce content.

    “Other studies investigated methods and tools to detect when GenAI tools had been used to produce content [224, 332].”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 2

  1. Gpt Generative Pretrained Transformer, Almira Osmanovic Thunström, and Steinn Steingrimsson. 2022. Can GPT-3 write an academic paper on itself, with minimal human input? https://hal.archives-ouvertes.fr/hal-03701250
  2. Mingyu Zong and Bhaskar Krishnamachari. 2022. Solving Math Word Prob- lems Concerning Systems of Equations with GPT-3. Proceedings of the Thirteenth AAAI Symposium on Educational Advances in Artificial Intelli- gence. https://anrg.usc.edu/www/wp-content/uploads/2022/12/Solving_Math_ Word_Problems_with_GPT3-2022.pdf

Cited by

Sorted by citations

Authors
Malinka, K., Peresíni, M., Firc, A., Hujnák, O., & Janus, F.
Affiliations
  • Brno University of Technology (CZ)
  • Brno University of Technology, Brno, Czech Rep
Venue
Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education V. 1
Publisher
ACM
Published
2023-06-29
Pages
47-53
OpenAlex
W4382652828
Cited by
287
References
6
Citations by year
2026: 29 · 2025: 94 · 2024: 113 · 2023: 51
FWCI
73.71
Type
conference paper
Language
en
Open access
Locations
  • ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
Brno University of Technology (FIT-S-23-8151)
Topics
  • Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
  • Social Sciences › Safety Research › Academic integrity and plagiarism
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
Keywords
ChatGPT, large language models, academic dishonesty, university education, cybersecurity education, programming exercises, exam cheating, term papers, artificial intelligence in higher education, AI-assisted learning, tool misuse

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review