Rethinking Homework in the Age of Artificial Intelligence
Open accessThe DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
The evolution of natural language processing techniques has led to the development of advanced conversational tools such as ChatGPT, capable of assisting users with a variety of activities. Media attention has centered on ChatGPT’s potential impact, policy implications, and ethical ramifications, particularly in the context of education. As such tools become more accessible, students across the globe may use them to assist with their homework. However, it is still unclear whether ChatGPT’s performance is advanced enough to pose a serious risk of plagiarism. We fill this gap by evaluating ChatGPT on two introductory and two advanced university-level courses. We find that ChatGPT receives near-perfect grades on the majority of questions in the introductory courses but has not yet reached the level of sophistication required to pass in advanced courses. Moreover, adding a few full stops or typos may fool a machine learning algorithm designed to detect ChatGPT-generated text. These findings suggest that, at least for some courses, current artificial intelligence tools pose a real threat that can no longer be overlooked by educational institutions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“GenAI has a double role as both a valuable teaching tool and a source of academic risk.”
From Perceptions vs. practices: academic integrity and actual ChatGPT use among EFL students (2026) · cites this paper as Ibrahim et al., 2023
The cited source says what the claim attributes to it.
In the citing paper
“Researchers emphasize that in AI-driven contexts, detection tools alone are insufficient to ensure academic integrity, especially given their current limitations in accuracy (Almanea, 2024; H. Ibrahim et al., 2023; Werdiningsih and Marzuki Rusdin, 2024).”
From Perceptions vs. practices: academic integrity and actual ChatGPT use among EFL students (2026) · cites this paper as H. Ibrahim et al., 2023
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bang, Y., Cahyawijaya, S., Lee, N., Dai, W., Su, D., Wilie, B., Lovenia, H., Ji, Z., Yu, T., Chung, W., et al. (2023) · Proceedings of the 13th International Joint Conference on Natural Language Processing and the 3rd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.ijcnlp-main.45 · Cited by 682 · cited 2×
“For example, Bang et al. 3 evaluated ChatGPT on eight common NLP tasks, where they fi nd that it outperforms other models on most tasks.”
MethodBang, Y., Cahyawijaya, S., Lee, N., Dai, W., Su, D., Wilie, B., Lovenia, H., Ji, Z., Yu, T., Chung, W., et al. (2023) · arXiv · doi:10.48550/arxiv.2302.04023 · Cited by 337 · cited 2×
“For example, Bang et al. 3 evaluated ChatGPT on eight common NLP tasks, where they fi nd that it outperforms other models on most tasks.”
MethodGraham, M., De Sabbata, S., & Zook, M. A. (2015) · Geo: Geography and Environment · doi:10.1002/geo2.8 · Cited by 179 · cited 1×
“9 While efforts have been made by OpenAI to limit ChatGPT from generating expletive or suggestive content, models trained on such information would inherently exhibit these same biases.”
Background
Research works printed but not linked: 8
- yang, 2023, New York city schools ban AI chatbot that writes essays and answers prompts
- vincent, 2023, The scary truth about AI copyright is nobody knows what will happen next
- nisa, 2023, Here’s a list of some of the exams chatGPT has passed so far
- face, 0, Gpt-2 output detector demo
- habash, 0, ZAEBUC: An annotated Arabic-English bilingual writer corpus, Proc 13th Lang Resour Eval Conf, 79
- roose, 2022, An A I -generated picture won an art prize Artists aren’t happy
- meckler, 2022, Teachers are on alert for inevitable cheating after release of ChatGPT
- 0, ChatGPT Optimizing Language Models for Dialogue
Cited by
Bahroun, Z., Anane, C., Ahmed, V., & Zacca, A. (2023) · Sustainability · doi:10.3390/su151712983 · Cited by 784
Ma, X., & Huo, Y. (2023) · Technology in Society · doi:10.1016/j.techsoc.2023.102362 · Cited by 346
ChatGPT in education: Methods, potentials, and limitations
Memarian, B., & Doleck, T. (2023) · Computers in Human Behavior: Artificial Humans · doi:10.1016/j.chbah.2023.100022 · Cited by 266
Ibrahim, H., Liu, F., Asim, R., Battu, B., Benabderrahmane, S., Alhafni, B., Adnan, W., Alhanai, T., AlShebli, B., Baghdadi, R., et al. (2023) · Scientific Reports · doi:10.1038/s41598-023-38964-3 · Cited by 154
“…work has examined the utility and performance of large language models in the context of education in a number of different disciplines, including medicine and healthcare 20–23 , computer and data science 24–26 , law 27,28 , business 29 , journalism and media 30 , and language learning 31,32 .”
Self-citationChatGPT in Teaching and Learning: A Systematic Review
Ali, D., Fatemi, Y., Boskabadi, E., Nikfar, M., Ugwuoke, J., & Ali, H. (2024) · Education Sciences · doi:10.3390/educsci14060643 · Cited by 146
Metadata
- Authors
- Ibrahim, H., Asim, R., Zaffar, F., Rahwan, T., & Zaki, Y.
- Affiliations
- New York University Abu Dhabi (AE)
- Lahore University of Management Sciences (PK)
- Venue
- IEEE Intelligent Systems
- Published
- 2023-03
- Volume
- 38
- Issue
- 2
- Pages
- 24-27
- ISSN
- 1541-1672 (ISSN-L)
- 1941-1294
- OpenAlex
- W4367330207
- Cited by
- 65
- References
- 2
- Citations by year
- 2026: 13 · 2025: 18 · 2024: 23 · 2023: 11
- FWCI
- 15.26
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- IEEE Intelligent Systems (publishedVersion, cc-by)
- Topics
- Social Sciences › Education › Artificial Intelligence in Education
- Social Sciences › Education › Academic integrity and plagiarism
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- ChatGPT, homework, academic integrity, plagiarism, AI-generated text detection, large language models, university courses, course difficulty, artificial intelligence in education
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Rethinking Homework in the Age of Artificial Intelligence. https://app.cochat.ai/papers/10.1109/mis.2023.3255599
- The paper
- Ibrahim, H., Asim, R., Zaffar, F., Rahwan, T., & Zaki, Y. (2023). Rethinking Homework in the Age of Artificial Intelligence. IEEE Intelligent Systems. https://doi.org/10.1109/mis.2023.3255599
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.