Using ChatGPT in Education: Human Reflection on ChatGPT’s Self-Reflection
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
ChatGPT is a fascinating AI text generator tool. It is a language model developed by OpenAI, a research and deployment company with the mission, according to OpenAI’s website: “to ensure that artificial general intelligence benefits all of humanity”. ChatGPT is able to generate human-like texts. But how does it work? What about the quality of the texts it provides? And is it capable of being self-reflective? Information sources must be efficient, effective and reliable in education, in order to enhance students’ learning process. For this reason, we started a dialogue with ChatGPT-3 while using, among others, a SWOT analysis it generated about its own functioning in an educational setting. This enabled us, as human authors, to analyze the extent to which this AI system is able to practice self-reflection. Finally, the paper sketches implications for education and future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education
Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · doi:10.35542/osf.io/5er8f · Cited by 7,552
ChatGPT for good? On opportunities and challenges of large language models for education
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., et al. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102274 · Cited by 7,326
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
Wu, Y., Schuster, M., Chen, Z., Le, Q. V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., Macherey, K., et al. (2016) · arXiv · doi:10.48550/arxiv.1609.08144 · Cited by 5,319
Chatting and cheating: Ensuring academic integrity in the era of ChatGPT
Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2190148 · Cited by 3,087
Chatting and Cheating. Ensuring academic integrity in the era of ChatGPT
Cotton, D., Cotton, P., & Shipway, J. R. (2023) · doi:10.35542/osf.io/mrz8h · Cited by 3,079
What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education
Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., & Agyemang, B. (2023) · Smart Learning Environments · doi:10.1186/s40561-023-00237-x · Cited by 2,003 · cited 3×
“…(Weakness, point 1) and only limited contextual “understanding” (Weakness, point 2), it will not be able to interpret a student’s emotional struggles regarding the learning process in the way human teachers can (see Scenario 7 Absence of emotions or reflections on students’ engagements [28]).”
InfluentialChatGPT: Bullshit spewer or the end of traditional assessments in higher education?
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.1.9 · Cited by 1,806
Artificial hallucinations in ChatGPT: implications in scientific writing
Alkaissi, H., & McFarlane, S. I. (2023) · Cureus · doi:10.7759/cureus.35179 · Cited by 1,540
A SWOT analysis of ChatGPT: Implications for educational practice and research
Farrokhnia, M., Banihashem, S. K., Noroozi, O., & Wals, A. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2195846 · Cited by 1,384 · cited 3×
“We agree with [22] that the “lack of deep understanding, difficulty in evaluating the quality of responses, the risk of biases and discrimination, lack of higher-order thinking skills” (pp. 6 –7) (weaknesses) and “lack of understanding of the context, threatening academic integrity, perpetuating…”
InfluentialChatGPT listed as author on research papers: many scientists disapprove
Stokel-Walker, C. (2023) · Nature · doi:10.1038/d41586-023-00107-z · Cited by 868
Bender, E. M., & Friedman, B. (2018) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00041 · Cited by 854 · cited 3×
“They also result from prompts that are abstract or contain incorrect information [10,15–20].”
Chatbots in Education and Research: A Critical Examination of Ethical Implications and Solutions
Kooli, C. (2023) · Sustainability · doi:10.3390/su15075614 · Cited by 666 · cited 3×
“As well, the following weakness should be kept in mind, a point made by [23] who argues that: “Additionally, when students rely on AI to complete their work, they may not fully understand the material and may lack a sense of ownership over their learning.”
Tools such as ChatGPT threaten transparent science; here are our ground rules for their use
(2023) · Nature · doi:10.1038/d41586-023-00191-1 · Cited by 605
A Conversation on Artificial Intelligence, Chatbots, and Plagiarism in Higher Education
King, M. R., & chatGPT (2023) · Cellular and Molecular Bioengineering · doi:10.1007/s12195-022-00754-8 · Cited by 602
Reframing Information Literacy as a Metaliteracy
Mackey, T. P., & Jacobson, T. E. (2011) · College & Research Libraries · doi:10.5860/crl-76r1 · Cited by 567 · cited 2×
“Also called metalit-eracy [33], these focus on gaining an understanding of and acquiring the skills to collect, evaluate, process and share information [33–35].”
The role of ChatGPT in higher education: Benefits, challenges, and future research directions
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.1.29 · Cited by 561 · cited 1×
“…from forbidding the use of ChatGPT or adapting the assessment of students’ learning, to creative ways to embedding it in educational practices [22–24, ChatGPT also does not mention the important risk of social inequality arising in the future due to groups of students not having been exposed to…”
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.1.23 · Cited by 421
Casal, J. E., & Kessler, M. (2023) · Research Methods in Applied Linguistics · doi:10.1016/j.rmal.2023.100068 · Cited by 261
Will ChatGPT get you caught? Rethinking of Plagiarism Detection
Khalil, M., & Er, E. (2023) · doi:10.35542/osf.io/fnh48 · Cited by 259
Mahmood, K., & University of the Punjab (2016) · Comminfolit · doi:10.15760/comminfolit.2016.10.2.24 · Cited by 212 · cited 3×
“Teaching digital skills and critical thinking in this way is important, especially as low performers tend to overestimate their skills [46].”
Rapamycin in the context of Pascal's Wager: generative pre-trained transformer perspective
Generative Pre-trained Transformer, C., & Zhavoronkov, A. (2022) · Oncoscience · doi:10.18632/oncoscience.571 · Cited by 203
Chatgpt for next generation science learning
Zhai, X. (2023) · XRDS Crossroads The ACM Magazine for Students · doi:10.1145/3589649 · Cited by 178 · cited 2×
“…for training teachers, integration with other educational software and strategies for fact-checking AI-generated information, we refer to [21–29 (3) The de fi nition of “true” and “accurate” in the context of my training data is based on correspondence with objective reality ChatGPT, you…”
Peng, B., Galley, M., He, P., Cheng, H., Xie, Y., Hu, Y., Huang, Q., Liden, L., Yu, Z., Chen, W., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.12813 · Cited by 156 · cited 4×
“They also result from prompts that are abstract or contain incorrect information [10,15–20].”
InfluentialLiesenfeld, A., Lopez, A., & Dingemanse, M. (2023) · Proceedings of the 5th International Conference on Conversational User Interfaces · doi:10.1145/3571884.3604316 · Cited by 111
Should Artificial Intelligent Agents be Your Co-author? Arguments in Favour, Informed by ChatGPT
Polonsky, M. J., & Rotman, J. D. (2023) · Australasian Marketing Journal · doi:10.1177/14413582231167882 · Cited by 59
ChatGPT for Next Generation Science Learning
Zhai, X. (2023) · doi:10.2139/ssrn.4331313 · Cited by 58
The Effect of Using Automated Essay Evaluation on ESL Undergraduate Students’ Writing Skill
Aluthman, E. S. (2016) · International Journal of English Linguistics · doi:10.5539/ijel.v6n5p54 · Cited by 45
Cited by
Designing Home Automation Routines Using an LLM-Based Chatbot
Giudici, M., Padalino, L., Paolino, G., Paratici, I., Pascu, A. I., & Garzotto, F. (2024) · Designs · doi:10.3390/designs8030043 · Cited by 40
“For instance, they can generate misinformation and disinformation and amplify biases in training data, raising ethical and data privacy issues [11,41].”
BackgroundEmerging Dynamics of ChatGPT in Academia: A Scoping Review
Mahrishi, M., Abbas, A., Radovanović, D., & Hosseini, S. (2024) · Journal of University Teaching and Learning Practice · doi:10.53761/b182ws13 · Cited by 28
Improving Generative Ai Reliability: A Qualitative Study of Hallucination in Large Language Models
Gwon, H. J., Yoo, Y., & Lee, J. Y. (2025) · doi:10.2139/ssrn.5118420 · Cited by 4
Metadata
- Authors
- Loos, E., Gröpler, J., & Goudeau, M.-L. S.
- Venue
- Societies
- Publisher
- MDPI AG
- Published
- 2023-08-21
- Volume
- 13
- Issue
- 8
- Pages
- 196
- ISSN
- 2075-4698 (ISSN-L)
- OpenAlex
- W4386049855
- Cited by
- 64
- References
- 27
- FWCI
- 15.04
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.