ChatGPT in Education: Empowering Educators through Methods for Recognition and Assessment
Open accessThe DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
ChatGPT is widely used among students, a situation that challenges educators. The current paper presents two strategies that do not push educators into a defensive role but can empower them. Firstly, we show, based on statistical analysis, that ChatGPT use can be recognized from certain keywords such as ‘delves’ and ‘crucial’. This insight allows educators to detect ChatGPT-assisted work more effectively. Secondly, we illustrate that ChatGPT can be used to assess texts written by students. The latter topic was presented in two interactive workshops provided to educators and educational specialists. The results of the workshops, where prompts were tested live, indicated that ChatGPT, provided a targeted prompt is used, is good at recognizing errors in texts but not consistent in grading. Ethical and copyright concerns were raised as well in the workshops. In conclusion, the methods presented in this paper may help fortify the teaching methods of educators. The computer scripts that we used for live prompting are available and enable educators to give similar workshops.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Chatting and cheating: Ensuring academic integrity in the era of ChatGPT
Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2190148 · Cited by 3,087
Chatting and Cheating. Ensuring academic integrity in the era of ChatGPT
Cotton, D., Cotton, P., & Shipway, J. R. (2023) · doi:10.35542/osf.io/mrz8h · Cited by 3,079
ChatGPT in higher education: considerations for academic integrity and student learning
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.1.17 · Cited by 853
Exploring the potential of using an AI language model for automated essay scoring
Mizumoto, A., & Eguchi, M. (2023) · Research Methods in Applied Linguistics · doi:10.1016/j.rmal.2023.100050 · Cited by 647
Yu, H. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1181712 · Cited by 409
Can Large Language Models Provide Feedback to Students? A Case Study on ChatGPT
Dai, W., Lin, J., Jin, H., Li, T., Tsai, Y.-S., Gašević, D., & Chen, G. (2023) · 2023 IEEE International Conference on Advanced Learning Technologies (ICALT) · doi:10.1109/icalt58122.2023.00100 · Cited by 395 · cited 1×
“Examples include the use of ChatGPT for grading essays [27,28] and programming assignments [29,30].”
MethodCan Large Language Models Provide Feedback to Students? A Case Study on ChatGPT
Dai, W., Lin, J., Jin, F., Li, T., Tsai, Y.-S., Gasevic, D., & Chen, G. (2023) · doi:10.35542/osf.io/hcgzj · Cited by 395
A large-scale comparison of human-written versus ChatGPT-generated essays
Herbold, S., Hautli-Janisz, A., Heuer, U., Kikteva, Z., & Trautsch, A. (2023) · Scientific Reports · doi:10.1038/s41598-023-45644-9 · Cited by 338 · cited 1×
“Here, a concern arises from the fact that ChatGPT can complete writing assignments [3,4] or programming tasks [5,6] at a level that is sufficient or even above average.”
BackgroundMollick, E. R., & Mollick, L. (2023) · doi:10.2139/ssrn.4391243 · Cited by 278
Lau, S., & Guo, P. (2023) · Proceedings of the 2023 ACM Conference on International Computing Education Research V.1 · doi:10.1145/3568813.3600138 · Cited by 241 · cited 1×
“Considering that ChatGPT is widely used among students and researchers (e.g., [9–12]), a question that arises is how educators might have to modify their course content, learning outcomes, and assessment methods to render them ‘ChatGPT-proof’ (for suggestions, see [13,14]).”
BackgroundThe death of the short-form physics essay in the coming AI revolution
Yeadon, W., Inyang, O.-O., Mizouri, A., Peach, A., & Testrow, C. P. (2023) · Physics Education · doi:10.1088/1361-6552/acc5cf · Cited by 199 · cited 1×
“Here, a concern arises from the fact that ChatGPT can complete writing assignments [3,4] or programming tasks [5,6] at a level that is sufficient or even above average.”
BackgroundThe Death of the Short-Form Physics Essay in the Coming AI Revolution
Yeadon, W., Inyang, O.-O., Mizouri, A., Peach, A., & Testrow, C. (2022) · arXiv · doi:10.48550/arxiv.2212.11661 · Cited by 199
AI and Its Impact on Creativity and Diversity: An Empirical Study of LLM-Generated Product Ideas
Terwiesch, C., Meincke, L., Girotra, K., Mollick, E. R., Nave, G., & Ulrich, K. T. (2023) · doi:10.2139/ssrn.4526071 · Cited by 174
Ibrahim, H., Liu, F., Asim, R., Battu, B., Benabderrahmane, S., Alhafni, B., Adnan, W., Alhanai, T., AlShebli, B., Baghdadi, R., et al. (2023) · Scientific Reports · doi:10.1038/s41598-023-38964-3 · Cited by 154
Savelka, J., Agarwal, A., An, M., Bogart, C., & Sakr, M. (2023) · Proceedings of the 2023 ACM Conference on International Computing Education Research V.1 · doi:10.1145/3568813.3600142 · Cited by 141
Guerra, G. A., Hofmann, H., Sobhani, S., Hofmann, G., Gomez, D., Soroudi, D., Hopkins, B. S., Dallas, J., Pangal, D. J., Cheok, S., et al. (2023) · World Neurosurgery · doi:10.1016/j.wneu.2023.08.042 · Cited by 123
Can ChatGPT Pass High School Exams on English Language Comprehension?
de Winter, J. C. F. (2024) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-023-00372-z · Cited by 115 · cited 1×
“We explained that the GPT-4 update, launched in March 2023, scores highly on benchmarks, often outperforming the average student [36–39].”
BackgroundMondal, H., Marndi, G., Behera, J. K., & Mondal, S. (2023) · Indian Journal of Vascular and Endovascular Surgery · doi:10.4103/ijves.ijves_37_23 · Cited by 73
Waltzer, T., Cox, R. L., & Heyman, G. D. (2023) · Human Behavior and Emerging Technologies · doi:10.1155/2023/1923981 · Cited by 61
Malik, A., Khan, M. L., & Hussain, K. (2023) · doi:10.2139/ssrn.4413516 · Cited by 59 · cited 1×
“Therefore, the use of ChatGPT by students may jeopardize the attainment of learning goals [7,8].”
Methodde Winter, J. (2024) · Scientometrics · doi:10.1007/s11192-024-04939-y · Cited by 34 · cited 3×
“To resolve this, De Winter [33] used a self-consistency prompting method, where the items were repeatedly presented in a different order and the scores were averaged.”
BackgroundMethodInfluentialSelf-citationThe Unintended Consequences of Censoring Digital Technology - Evidence from Italy's ChatGPT Ban
Kreitmeir, D., & Raschky, P. A. (2023) · doi:10.31235/osf.io/v3cgs · Cited by 15
Cited by
Wang, H., Dang, A., Wu, Z., & Mac, S. (2024) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2024.100326 · Cited by 272
Personality and acceptance as predictors of ChatGPT use
de Winter, J., Dodou, D., & Eisma, Y. B. (2024) · Discover Psychology · doi:10.1007/s44202-024-00161-2 · Cited by 43
Self-citationEmerging Dynamics of ChatGPT in Academia: A Scoping Review
Mahrishi, M., Abbas, A., Radovanović, D., & Hosseini, S. (2024) · Journal of University Teaching and Learning Practice · doi:10.53761/b182ws13 · Cited by 28
Jongkind, R., Bikker, Y., Meinema, J., & Broens, T. (2025) · Frontiers in Education · doi:10.3389/feduc.2025.1658415 · Cited by 11
Metadata
- Authors
- de Winter, J. C. F., Dodou, D., & Stienen, A. H. A.
- Venue
- Informatics
- Publisher
- MDPI AG
- Published
- 2023-11-29
- Volume
- 10
- Issue
- 4
- Pages
- 87
- ISSN
- 2227-9709 (ISSN-L)
- OpenAlex
- W4389200893
- Cited by
- 40
- References
- 23
- FWCI
- 9.40
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.