The DOI matches its Crossref record; 173 of the 173 references it cites were found in a registry or an index; 36 of the 96 sources its claims cite were checked for support.
Higher Education's Generative Artificial Intelligence Paradox: The Meaning of Chatbot Mania
Open accessAbstract
Commentary on opportunities and threats of AI chatbots in higher education. Advocates for critical AI literacy, responsible innovation, and informed use grounded in ethics and equity.
Overview
CoChat Summary
TL;DR
This commentary argues that generative AI in higher education presents a paradox: ten opportunities alongside ten threats, requiring critical AI literacy and ethical governance. It calls for integration grounded in ethics, equity, and human values while cautioning against hype, commercialisation, bias, labour displacement, and regulatory gaps.
Key findings
- The paper identifies ten opportunities (e.g., teaching assistant, feedback and assessments, adaptive curriculum development, research assistant, automated grading, collaborative circles, student intervention, administrative support, inclusive education, wellbeing initiatives) and ten threats (e.g., academic integrity challenges, dilution or automation of university teacher roles, quality/accuracy/ethical concerns, technological colonialism and concentration of power, erosion of graduate attributes, graduate employment, privacy and surveillance, bias, sustainability, regulatory and policy challenges).
- It cites that GPT-4 exceeded 91% of humans on an Alternative Uses Test for creativity and 99% on the Torrance Tests of Creative Thinking; Claude 3 can accept 200,000 tokens (equivalent to 150,000 words) in a single prompt; and GPT-3 was trained on 45 terabytes of text.
- It reports environmental costs: cloud computing had a greater carbon footprint than the airline industry in 2022, and a single data centre spent as much electricity as 50,000 homes; the AI lifecycle includes extractivism, water use for cooling, and e-waste offshored to developing economies.
- It notes bias and policy concerns: only 16% of tenure-track AI faculty positions worldwide were held by women (Stanford AI Index 2021); nearly half of the world’s top 50 universities published GenAI guidelines (Moorhouse et al., 2023); and an AI-generated fake image of the Pentagon in flames briefly dropped the S&P 500 by 0.3%.
Methods
- Design: a critical commentary prepared for the Special Issue of the Journal of University Teaching & Learning Practice on “Enhancing student engagement using Artificial Intelligence (AI) and chatbots.”
- Data or sample: no empirical sample or dataset; the paper draws on cited literature, media reports, and examples to discuss AI chatbots including ChatGPT.
- Main analysis: conceptual and narrative exploration structured around ten opportunities and ten threats, concluding with implications and advocacy for critical AI literacy among educators and students.
Limitations
- The paper states no limitations.
- Evident from the text: it is a commentary, not a systematic review or empirical study, with no data collection, sample, or formal analysis.
- Evident from the text: its claims rely on selected literature, media, and examples, and it presents broad opportunities and threats without testing them; the authors acknowledge the interconnected nature of these challenges and call for ongoing critical analysis.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
30 Valid · 0 Not valid · 46 Not checked · 27 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Integrating critical cognitive functions such as brainstorming, summarising, and drafting will likely lead to significant productivity gains (Mollick & Euchner, 2023) not only in administrative and research-related work but also in teaching-related processes such as the creation of learning activities, lesson plans and learning resources, and assessments (Al-Naqbi et al., 2024).”
§ Higher Education's Generative Artificial Intelligence Paradox: The Meaning of Chatbot Mania > Teaching Assistant
What the sources say
- Not checked — no full text of the sourcecites Mollick & Euchner, 2023 source
- Partly supportedcites Al-Naqbi et al., 2024 sourceExperimental — accuracy not yet measured
The review’s discussion under “Muhyidin et al. (2021) [28]” says generative AI can improve educational content creation and support teaching methods such as the flipped classroom. This supports the teaching-related extension attached to Al-Naqbi et al., but our copy does not specifically address productivity gains from creating lesson plans or assessments. The earlier claim about brainstorming, summarising and drafting is attached to a different citation. (LLM, conf=0.85)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Moreover, GenAI is capable of creating immersive and interactive learning experiences through the creation of virtual learning environments (Bondarenko et al., 2020).”
§ Higher Education's Generative Artificial Intelligence Paradox: The Meaning of Chatbot Mania > Adaptive Curriculum Development
What the sources say
- Partly supportedcites Bondarenko et al., 2020 sourceExperimental — accuracy not yet measured
The Results and discussion section describes virtual educational environments as enabling interactive learning, which supports that part of the sentence. It does not say that generative AI creates those environments or produces immersive learning experiences; searches for GenAI and artificial intelligence found no such passage. No page number is available in our copy. (LLM, conf=0.84)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“GenAI can also be used in the administrative process in higher education institutions.”
§ Higher Education's Generative Artificial Intelligence Paradox: The Meaning of Chatbot Mania > Administrative Support
What the sources say
- Partly supportedcites AlAfnan et al., 2023 sourceExperimental — accuracy not yet measured
The Literature Review says AI can perform administrative tasks and that some educational institutions have automated administrative chores. It does not specifically say that generative AI can do this in higher education institutions. (LLM, conf=0.82)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“using GenAI to automate routine administrative tasks in higher education, such as consolidation of grades, creating performance summaries of students, crafting out evaluation reports, and maintaining student enrolment and attendance records (Meyer et al., 2023).”
§ Higher Education's Generative Artificial Intelligence Paradox: The Meaning of Chatbot Mania > Administrative Support
What the sources say
- Partly supportedcites Meyer et al., 2023 sourceExperimental — accuracy not yet measured
The Education section (page not supplied) says ChatGPT can facilitate educators’ assessment and evaluation, which partly supports the reference to evaluation tasks. It does not describe automating grade consolidation, student performance summaries, evaluation reports, or enrolment and attendance records; searches for administrative tasks and student records found no such passage. (LLM, conf=0.82)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“This is because studies have demonstrated that creating fair and equitable assessments is one area that AI struggles with (Madaio et al., 2022;Yu, 2020;Fenu et al., 2022).”
§ Higher Education's Generative Artificial Intelligence Paradox: The Meaning of Chatbot Mania > Feedback and Assessments
What the sources say
- Not checked — no full text of the sourcecites Madaio et al., 2022 source
- Not matchedcites Yu, 2020
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Partly supportedcites Fenu et al., 2022 sourceExperimental — accuracy not yet measured
The Introduction (p. 1) describes unfair outcomes from an AI system evaluating applicants, and Section 3.4 (p. 9) reports experts’ concerns that fairness metrics can label unfair outcomes as fair. These passages support the broader point that fairness is a challenge for educational AI, but the paper does not specifically establish that AI struggles to create fair and equitable student assessments. (LLM, conf=0.82)
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
36 more claims · 8 with their cited sources checked
Create a free account to see all 103 claims and every source verdict.
- Probably not a substantial claim. 43
- It may state two separate claims as one. 40
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Higher Education's Generative Artificial Intelligence Paradox: The Meaning of Chatbot Mania > Bias
“Investigations into high-tech systems highlight their role in automating inequality, particularly against poor and working-class individuals (Eubanks, 2017).”
§ Higher Education's Generative Artificial Intelligence Paradox: The Meaning of Chatbot Mania > References
“Eubanks, V. (2018). Automating inequality: How high-tech tools profile, police, and punish the poor.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Higher Education's Generative Artificial Intelligence Paradox: The Meaning of Chatbot Mania > Bias
“Noble (2019) exposes that search engines' AI algorithms”
§ Higher Education's Generative Artificial Intelligence Paradox: The Meaning of Chatbot Mania > References
“Noble, S. U. (2018). Algorithms of oppression. New York University Press.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Higher Education's Generative Artificial Intelligence Paradox: The Meaning of Chatbot Mania > Collaborative Circles
“GenAI can help by organising discussion forums online and monitoring the content posted in these forums (Tomić et al., 2023).”
§ Higher Education's Generative Artificial Intelligence Paradox: The Meaning of Chatbot Mania > References
“Tomić, B. B., Kijevčanin, A. D., Ševarac, Z. V., & Jovanović, J. M. (2022). An AI-based approach for grading students' collaboration.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Higher Education's Generative Artificial Intelligence Paradox: The Meaning of Chatbot Mania > Administrative Support
“Automating such routine tasks is particularly advantageous as administrative staff can focus on more critical processes such as student recruitment, decision-making, focusing on operational tasks, and supporting teachers in the classroom (Chiu, 2023).”
§ Higher Education's Generative Artificial Intelligence Paradox: The Meaning of Chatbot Mania > References
“Chiu, T. K. F. (2024). Future research recommendations for transforming higher education with GenAI.”
Citations
Cites
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Kaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,690
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988 · cited 1×
“The bots are but “stochastic parrots” (Bender et al., 2021).”
Dwivedi, Y. K., Hughes, L., Ismagilova, E., Aarts, G., Coombs, C., Crick, T., Duan, Y., Dwivedi, R., Edwards, J., Eirug, A., et al. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2019.08.002 · Cited by 4,611
Artificial Intelligence in Education: A Review
Chen, L., Chen, P., & Lin, Z. (2020) · IEEE Access · doi:10.1109/access.2020.2988510 · Cited by 4,133 · cited 1×
“It is also possible that the AI system will suggest that students review the assignment guidelines and challenge them to work on the areas of improvement (Chen et al., 2020).”
BackgroundThe biodiversity of species and their rates of extinction, distribution, and protection
Pimm, S. L., Jenkins, C. N., Abell, R., Brooks, T. M., Gittleman, J. L., Joppa, L. N., Raven, P. H., Roberts, C. M., & Sexton, J. O. (2014) · Science · doi:10.1126/science.1246752 · Cited by 3,542 · cited 1×
“We are ensnared in the sixth mass extinction, with biodiversity loss occurring at rates 100 to 1,000 times the natural extinction rate (Pimm et al., 1995, 2014), signalling a catastrophic departure from the Holocene’s stability.”
Backgroundvan Dijck, J., Poell, T., & de Waal, M. (2018) · doi:10.1093/oso/9780190889760.001.0001 · Cited by 2,951
Fitzpatrick, K. K., Darcy, A., & Vierhile, M. (2017) · JMIR Mental Health · doi:10.2196/mental.7785 · Cited by 2,730 · cited 1×
“If used judiciously, GenAI may be able to offer valuable resources to support the stress and anxiety levels of students (Fitzpatrick et al., 2017) while reducing the workload for teachers (Hashem et al., 2024).”
Algorithms of Oppression: How Search Engines Reinforce Racism
Noble, S. U. (2020) · doi:10.2307/j.ctt1pwt9w5 · Cited by 2,709
(2016) · Cited by 2,334
Research works printed but not linked: 10
- [59]59. Gimpel, H., Hall, K., Decker, S., Eymann, T., Lämmermann, L., Mädche, A., Röglinger, R., Ruiner, C., Schoch, M., Schoop, M., Urbach, N., Vandirk, S. (2023, March 20). Unlocking the power of GenAI models and systems such as GPT-4 and ChatGPT for higher education: A guide for students and lecturers. University of Hohenheim. http://dx.doi.org/10.13140/RG.2.2.20710.09287/ · doi:10.13140/rg.2.2.20710.09287/
- [61]61. Goita, Y., & Kone, A. (2023). Comparison of basic education evaluation systems to determine the best strategy between Mali and China . Multidisciplinary Journal of Akseprin Indonesia, 1(3). https://jurnal.akseprin.org/index.php/MJAI/article/view/60
- [104]104. Luckin, R., Holmes, P., Griffiths, K., & Forcier, L. B. (2016). Artificial intelligence in education: Current challenges and future directions. International Journal of Artificial Intelligence in Education, 26(2), 582-599.
- [108]108. Liu, M., Ren, Y., Nyagoga, L. M., Stonier, F., Wu, Z., & Yu, L. (2023). Future of education in the era of generative artificial intelligence: Consensus among Chinese scholars on applications of ChatGPT in schools. Future in Educational Research, 1(1), 72-101. https://doi.org/https://doi.org/10.1002/fer3. · doi:10.1002/fer3
- [131]131. Noble, S. U. (2018). Algorithms of oppression. New York University Press.
- [141]141. Dubber, F. Pasquale and S. Das (Eds.), Oxford handbook of ethics of AI (pp. 271-287). https://ssrn.com/abstract=3647367
- [165]165. Schneider-Mayerson, M. (Ed.). (2020). Eating chilli crab in the Anthropocene: Environmental perspectives on life in Singapore. Ethos Books.
- [167]167. Shelley, M. W. (2017). Frankenstein: Or, the modern Prometheus: Annotated for engineers, scientists, and creators of all kinds. MIT Press.
- [168]168. Sharma, S., & Yadav, R. (2023). Chat GPT -A technological remedy or challenge for education system. Global Journal of Enterprise Information System, 14(4), 46-51. https://www.gjeis.com/index.php/GJEIS/article/view/698
- [170]170. Singha, S. & Singha, R. (2024). Revolutionizing content creation and curriculum development through Gen AI. In R. Sharma & A. Bozkurt (Eds.), Transforming education with Gen AI: Prompt engineering and synthetic content creation (pp. 261-280). IGI Global. https://doi.org/10.4018/979-8-3693-1351-0. · DOI
Cited by
Opportunities, challenges and school strategies for integrating generative AI in education
Ng, D. T. K., Chan, E. K. C., & Lo, C. K. (2025) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2025.100373 · Cited by 326
Saihi, A., Ben‐Daya, M., & Hariga, M. A. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-13023-0 · Cited by 74
“…to the growing reliance on digital technologies in educational practices, their potential to enhance pedagogy and offer timely support to users, and the increasing demand for personalized learning experiences (Alenezi et al., 2023; Rudolph et al., 2024; Antony & Ramnath, 2023; Alamri et al., 2021).”
Zlotnikova, I., Hlomani, H., Mokgetse, T. L., & Bagai, K. (2025) · Journal of Information Communication and Ethics in Society · doi:10.1108/jices-07-2024-0104 · Cited by 80
Sevnarayan, K., & Potter, M.-A. (2024) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2024.7.1.41 · Cited by 75
Transforming Financial Reporting with AI: Enhancing Accuracy and Timeliness
Antwi, B. O., Adelakun, B. O., & Eziefule, A. O. (2024) · International Journal of Advanced Economics · doi:10.51594/ijae.v6i6.1229 · Cited by 87
Metadata
- Authors
- Rudolph, J., Mohamed Ismail, F. M., & Popenici, S.
- Venue
- Journal of University Teaching and Learning Practice
- Publisher
- Open Access Publishing Association
- Published
- 2024-04-19
- Volume
- 21
- Issue
- 06
- ISSN
- 1449-9789 (ISSN-L)
- OpenAlex
- W4394964316
- Cited by
- 189
- References
- 159
- Citations by year
- 2026: 67 · 2025: 87 · 2024: 35
- FWCI
- 76.48
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Journal of University Teaching and Learning Practice (publishedVersion, cc-by-nd)
- Topics
- Social Sciences › Education › Artificial Intelligence in Education
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Keywords
- generative AI, AI chatbots, ChatGPT, higher education, academic integrity, critical AI literacy, responsible innovation, AI ethics, algorithmic bias, marketization of higher education, job displacement, environmental sustainability of AI, student engagement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-01, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Higher Education's Generative Artificial Intelligence Paradox: The Meaning of Chatbot Mania. https://app.cochat.ai/papers/10.53761/54fs5e77
- The paper
- Rudolph, J., Mohamed Ismail, F. M., & Popenici, S. (2024). Higher Education's Generative Artificial Intelligence Paradox: The Meaning of Chatbot Mania. Journal of University Teaching and Learning Practice. https://doi.org/10.53761/54fs5e77
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.