Cited by 113Artificial Intelligence in EducationArtificial Intelligence in Healthcare and EducationEthics and Social Impacts of AI

Generative Artificial Intelligence (AI) in Higher Education: A Comprehensive Review of Challenges, Opportunities, and Implications

Open access
Bobula, Michal·2024·Journal of Learning Development in Higher Education

Abstract

This paper explores recent advancements and implications of artificial intelligence (AI) technology, with a specific focus on Large Language Models (LLMs) like ChatGPT 3.5, within the realm of higher education. Through a review of the academic literature, this paper highlights the unprecedented growth of these models and their wide-reaching impact across various sectors. The discussion sheds light on the complex issues and potential benefits presented by LLMs, providing a overview of the field's current state. In the context of higher education, the paper explores the challenges and opportunities posed by LLMs. These include issues related to educational assessment, potential threats to academic integrity, privacy concerns, the propagation of misinformation, EDI aspects, copyright concerns and inherent biases within the models. While these challenges are multifaceted and significant, the paper emphasizes the availability of strategies to address them effectively and facilitate the successful adoption of LLMs in educational settings. Furthermore, the paper recognises the potential opportunities to transform higher education. It emphasises the need to update assessment policies, develop guidelines for staff and students, scaffold AI skills development, and find ways to leverage technology in the classroom. By proactively pursuing these steps, higher education institutions (HEIs) can harness the full potential of LLMs while managing their adoption responsibly. In conclusion, the paper urges HEIs to allocate resources to handle the adoption of LLMs effectively. This includes ensuring staff AI readiness and taking steps to modify their study programmes to align with the evolving educational landscape influenced by emerging technologies.

AI snapshot

Written from the paper’s full text.

TL;DR

This review synthesizes literature on generative AI and large language models, especially ChatGPT 3.5, in higher education, outlining challenges around academic integrity, assessment, copyright, EDI, privacy, and misinformation alongside opportunities for AI literacy and transformed teaching. It argues that higher education institutions should update assessment and misconduct policies, support staff AI readiness, and allocate resources to adopt LLMs responsibly.

Key findings

  • ChatGPT’s adoption was unprecedented: it reached an estimated 100 million monthly active users two months after launch, and a January 2023 survey of over 1,000 university students found more than one-third used ChatGPT for assessments, with 75% of those believing it was cheating but still using it.
  • Academic integrity is threatened because AI-generated text is often undetectable; detection tools perform only marginally better than a random classifier, are prone to false positives and false negatives, and can be biased against non-native English writers.
  • Copyright, privacy, and misinformation concerns are prominent: GPT-2 was trained on 40 GB of text and GPT-3 on 570 GB, while GPT-4’s dataset size is undisclosed; lawsuits have been filed against OpenAI and Google; Italy restricted ChatGPT in 2023; and LLMs can hallucinate or fabricate references.
  • Opportunities include using chatbots to support disadvantaged students, non-native English speakers, and neurodivergent students; embedding AI literacy, prompt engineering, and generative AI use cases into curricula; and providing personalised learning and immediate feedback.

Methods

  • Comprehensive narrative review of academic literature focused on LLMs such as ChatGPT 3.5 in higher education.
  • Synthesizes sources across themes including academic integrity, assessment design, available solutions, copyright, EDI, information privacy, misinformation, and opportunities.
  • No primary data collection or systematic search protocol is reported; the author used ChatGPT 3.5 and Claude 2 for proofreading and ChatGPT 3.5 API with AgentGPT to search for relevant publications, news stories, and themes.

Limitations

  • The paper does not state explicit limitations.
  • Evident from the text: it is a narrative review without a systematic search or inclusion criteria, relying on secondary literature, news, and preprints in a fast-moving technological field.
  • Evident from the text: it notes limited actual evidence of mass-scale cheating at the time of writing, and the author used generative AI tools in manuscript preparation.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.47408/jldhe.vi30.1137

Cites

48 of 48 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 74 cited sources checked · 0 supported · 0 flagged

  • Interpretationnone given

    At the point of writing, there is limited actual evidence of mass-scale cheating taking place using ChatGPT.

    “While ChatGPT can undeniably be used for academic cheating, at the point of writing, there is limited actual evidence of a mass-scale cheating taking place.”
    Quote in the paperNot a substantial claim
  • Interpretationcitation

    Increasing reliance on ChatGPT amplifies concerns about academic honesty and plagiarism risk.

    “Increasing reliance on this tool amplifies concerns about academic honesty and plagiarism risk (Stokel-Walker, 2022).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Stokel-Walker, 2022

      Not checked in the free run.

  • Premisecitation

    The detection tool is also bypassed by changing prompting strategy.

    “The same study finds that the detection tool is also bypassed by changing prompting strategy.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Liang et al., 2023

      Not checked in the free run.

  • Premisecitation

    AI detection performance is only marginally better than a random classifier.

    “leading to a performance that is only marginally better than a random classifier (Sadasivan et al., 2023)”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Sadasivan et al., 2023

      Not checked in the free run.

  • Premisecitation

    As ChatGPT is trained using a large amount of text data such as books, articles, and other written materials, some of the training data may be copyrighted.

    “As ChatGPT is trained using a large amount of text data, such as books, articles, and other written materials, some of the training data may be copyrighted (Karim, 2023).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Karim, 2023

      Not checked in the free run.

  • May combine two claims. 49
  • Classified as probably not a substantial claim. 50
  • May combine two claims.

    Interpretationnone given

    Generative AI and LLMs in higher education present challenges related to educational assessment, academic integrity, privacy, misinformation, EDI, copyright, and inherent biases.

    “In the context of higher education, the paper explores the challenges and opportunities posed by LLMs.These include issues related to educational assessment, potential threats to academic integrity, privacy concerns, the propagation of misinformation, Equity, Diversity, and Inclusion (EDI) aspects, copyright concerns and inherent biases within the models.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The academic literature reviewed provides a comprehensive and representative account of the current state of generative AI in higher education.
  • Classified as probably not a substantial claim.

    Interpretationnone given

    Strategies are available to address the challenges posed by LLMs and facilitate their successful adoption in educational settings.

    “While these challenges are multifaceted and significant, the paper emphasises the availability of strategies to address them effectively and facilitate the successful adoption of LLMs in educational settings.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The academic literature reviewed provides a comprehensive and representative account of the current state of generative AI in higher education.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Technology companies are in talks with leading media organisations about using their news content for AI training.

    “It has been reported that technology companies are in talks with leading media organisations about using their news content for AI training (Criddle et al., 2023).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Criddle et al., 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    ChatGPT reached an estimated 100 million monthly active users in just two months after its launch.

    “The app has become the fastest-growing online application in history, reaching an estimated 100 million monthly active users in just two months after its launch (Reuters, 2023).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Reuters, 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    ChatGPT can be fine-tuned for specific tasks or domains, increasing its versatility across various industries and applications.

    “Furthermore, ChatGPT can be fine-tuned for specific tasks or domains, increasing its versatility across various industries and applications (Ray, 2023).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Ray, 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The size of the data set used for OpenAI's most recent model, GPT-4, has not been disclosed.

    “The size of the data set used for OpenAI's most recent model, GPT-4, has not been disclosed (Heikkilä, 2023).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Heikkilä, 2023

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Bloomberg is developing a new generative AI model, trained on an extensive variety of financial data owed by the company.

    “Finally, Bloomberg, the information provider for financial services that is also used by over 300 universities worldwide (Bloomberg, 2023a), is developing a new generative AI model, trained on an extensive variety of financial data owed by the company (Bloomberg, 2023b).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Bloomberg, 2023b

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Copyrights differ between jurisdictions.

    “Further, it is important that copyrights differ between jurisdictions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    In AI development, the prevailing belief is that the larger the training data set, the better the results.

    “In the realm of AI development, the prevailing belief is that the larger the training data set, the better the results.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Traditional plagiarism-detection tools are rendered ineffective because AI is becoming increasingly proficient at imitating human-like text and AI-generated text is deemed original and thus undetectable.

    “Traditional plagiarism-detection tools are rendered ineffective in this context, as AI is becoming increasingly proficient at imitating human-like text and AI-generated text is deemed original and thus undetectable (Dwivedi et al., 2023.)”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Dwivedi et al., 2023

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    Current generative AI platforms have limitations such as inability to interpret visual media or understand up-to-date information beyond their training data.

    “Gonsalves (2023) suggests that educators using multiple choice test for assessment may consider outsmarting the system by taking advantage of the current limitations of generative AI platforms, such as their inability to interpret visual media or understand up-to-date information beyond its training data.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Gonsalves (2023)

      Not checked in the free run.

  • May combine two claims.

    Interpretationcitation

    Given TikTok's 3.7 million active UK users, with 26% aged 18-24, the potential for covert cheating is significant.

    “Given TikTok's 3.7 million active UK users, with 26% aged 18-24 (Bendix, 2023), the potential for covert cheating is significant.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Bendix, 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    ChatGPT is capable of generating human-like responses using natural language, essentially leading to an expert system that is available on demand.

    “ChatGPT is capable of generating human-like responses using natural language, essentially leading to an expert system that is available on demand.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Haleem et al., 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    OpenAI's GPT-2 model was trained using a data set that comprised 40 gigabytes of text.

    “OpenAI's GPT-2 model was trained using a data set that comprised 40 gigabytes of text.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Heikkilä, 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisereasoning

    ChatGPT can understand the context of a conversation and generate relevant responses, making it more effective at mimicking human-like interactions.

    “It can understand the context of a conversation and generate relevant responses, making it more effective at mimicking human-like interactions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisenone given

    ChatGPT has brought advancements to generative AI including improved contextual understanding, language generation, task adaptability, and multilingual proficiency.

    “While chatbots are not a new invention, ChatGPT has brought several advancements to generative AI, including improved contextual understanding, language generation, task adaptability, and multilingual proficiency.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Two authors have filed a lawsuit against OpenAI, alleging that their copyrighted books were used to train the AI model, ChatGPT, without their permission.

    “For instance, it has been reported that two authors have filed a lawsuit against OpenAI, alleging that their copyrighted books were used to train the AI model, ChatGPT, without their permission.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Creamer, 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    GPT-3, the model upon which ChatGPT is built, utilised a significantly larger data set of 570 GB.

    “GPT-3, the model upon which ChatGPT is built, utilised a significantly larger data set of 570 GB.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Heikkilä, 2023

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Adobe's 'Firefly', a generative AI image tool, guarantees commercial usage safety, offering IP indemnification as it is trained on company-owned images.

    “For instance, Adobe's 'Firefly', a generative AI image tool, guarantees commercial usage safety, offering IP indemnification as it is trained on company-owned images (Gold, 2023).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Gold, 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisenone given

    ChatGPT is trained on extensive data and is competent across disciplines.

    “Trained on extensive data, it is competent across disciplines.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationnone given

    There are potential opportunities to transform higher education through LLMs.

    “Furthermore, the paper recognises the potential opportunities to transform higher education.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The academic literature reviewed provides a comprehensive and representative account of the current state of generative AI in higher education.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given

    ChatGPT's advanced language generation capabilities allow it to produce coherent, contextually accurate, and grammatically correct text.

    “Its advanced language generation capabilities allow it to produce coherent, contextually accurate, and grammatically correct text.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    Designing tests to outsmart generative AI may be more time consuming, difficult in certain subjects, and attempts to out-design chatbots might prove fruitless in the long term as technology improves.

    “However, designing such tests may be more time consuming, difficult to do in certain subjects, and as technology improves, attempts to out-design chatbots might prove fruitless in the long term (Mills, 2023).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Mills, 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Google, along with its parent company Alphabet and AI subsidiary DeepMind, has been accused in a lawsuit of scraping user data without consent and violating copyright laws to train its AI products.

    “In a separate case, Google, along with its parent company Alphabet and AI subsidiary DeepMind, has been accused in a lawsuit of scraping user data without consent and violating copyright laws to train its AI products.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Dixit, 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    ChatGPT uses its training data to produce an answer.

    “This model uses its training data to produce an answer (Haleem et al., 2023).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Haleem et al., 2023

      Not checked in the free run.

  • May combine two claims.

    Interpretationcitation

    Both Tlili et al. and Haensch et al. emphasise very little discourse related to negative aspects of using generative AI in education, meaning systems such as ChatGPT may be used without much reflection and evaluation.

    “Moreover, both Tlili et al. (2023) and Haensch et al. (2023) emphasise very little discourse related to negative aspects of using generative AI in education, meaning that systems such as ChatGPT may be used without much reflection and evaluation.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Tlili et al. (2023)

      Not checked in the free run.

    • cites Haensch et al. (2023)

      Not checked in the free run.

  • May combine two claims.

    Interpretationcitation

    Using generative AI leads to substantial risks of accidental plagiarism and copyright infringements.

    “Therefore, using generative AI leads to substantial risks of accidental plagiarism and copyright infringements (Gimpel et al., 2023).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Gimpel et al., 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    While ChatGPT 3.5 does not have internet access, OpenAI allows its newer model GPT 4.0 internet access through the Bing search engine or third-party plug-ins.

    “For instance, while ChatGPT 3.5 does not have internet access, OpenAI allows its newer model GPT 4.0 internet access through the Bing search engine or third-party plug-ins (Wiggers, 2023).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Wiggers, 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Google has updated privacy terms which now clearly state their right to use publicly available data for AI model training.

    “Google has updated privacy terms which now clearly state their right to use publicly available data for AI model training.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    ChatGPT's content generation capabilities excel in aspects people previously used to filter information, potentially creating a false sense of reliability.

    “However, ChatGPT's content generation capabilities excel in these aspects, potentially creating a false sense of reliability.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Embedding AI literacy in graduate skills can enhance their employability in a rapidly evolving job market.

    “Thus, embedding AI literacy in graduate skills can enhance their employability in a rapidly evolving job market.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Developing use cases for generative AI is a significant challenge for educational providers.

    “Developing use cases for generative AI is a significant challenge for educational providers.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Non-native English speakers can use ChatGPT for grammar feedback and as a semi-translator for complex terms, aiding comprehension.

    “Non-native English speakers can use ChatGPT for grammar feedback and as a semi-translator for complex terms, aiding comprehension (Sullivan et al., 2023).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Sullivan et al., 2023

      Not checked in the free run.

  • May combine two claims.

    Interpretationnone given

    Generative AI may support research, writing, and data analysis, opening new possibilities for educators and students and potentially unleashing their digital creativity.

    “Overall, generative AI may support research, writing, and data analysis which effectively opens new possibilities for educators and students, potentially unleashing their digital creativity.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    Tlili et al. examined OpenAI's policies and found that while conversations with ChatGPT are stored and used to improve its performance, the specifics of storage and use are not entirely clear.

    “Tlili et al. (2023) examined OpenAI's policies and found that while conversations with ChatGPT are stored and used to improve its performance, the specifics of storage and use are not entirely clear.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Tlili et al. (2023)

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    ChatGPT has been widely criticised for producing biased and discriminatory content, which has been caused by using training data that reflects the biases of society.

    “ChatGPT has been widely criticised for producing biased and discriminatory content, which has been caused by using training data that reflects the biases of society (Weinberger, 2019;Dwivedi et al., 2023).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Weinberger, 2019

      Not checked in the free run.

    • cites Dwivedi et al., 2023

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Generative AI may assist in the creation of inventive assessments that could promote creativity and critical thinking skills, contributing to comprehensive and meaningful evaluation of learning outcomes.

    “This technology may assist in creation of inventive assessments which could promote creativity and critical thinking skills, contributing to comprehensive and meaningful evaluation of learning outcomes (Rasul et al., 2023).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Rasul et al., 2023

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Generative AI offers immediate feedback and advice, assisting students in rectifying mistakes and enhancing their study techniques.

    “In addition, it also offers immediate feedback and advice, assisting students in rectifying mistakes and enhancing their study techniques (Javaid at al., 2023;Yu and Guo, 2023).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Javaid at al., 2023

      Not checked in the free run.

    • cites Yu and Guo, 2023

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Given the vast data processed by ChatGPT's machine learning algorithms, it is vulnerable to cyberattacks, risking unauthorised access or misuse of sensitive information.

    “Given the vast data processed by ChatGPT's machine learning algorithms, it is vulnerable to cyberattacks, risking unauthorised access or misuse of sensitive information (Dwivedi et al., 2023).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Dwivedi et al., 2023

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    AI can support adaptive writing and highlight essential information in various formats.

    “AI can also support adaptive writing and highlight essential information in various formats (Kasneci et al., 2023).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Kasneci et al., 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    LLMs possess notable capabilities for education, but these are yet to be fully explored.

    “LLMs possess notable capabilities for education, but these are yet to be fully explored.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationreasoning

    While privacy issues are genuine, they should not hinder AI's integration into higher education.

    “In summary, while privacy issues are genuine, they should not hinder AI's integration into higher education.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    The US Federal Trade Commission is scrutinising OpenAI for potential false or harmful statements about real individuals and its data privacy methods.

    “The US Federal Trade Commission is also scrutinising OpenAI for potential false or harmful statements about real individuals and its data privacy methods (BBC News, 2023).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites BBC News, 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationreasoning

    Young learners could unintentionally share personal details with ChatGPT, underscoring the need to protect the privacy of users, particularly the younger demographic.

    “Young learners could unintentionally share personal details with ChatGPT, underscoring the need to protect the privacy of users, particularly the younger demographic.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    The widespread integration of LLMs in higher education can offer substantial advantages for students and faculty.

    “The widespread integration of LLMs in higher education can offer substantial advantages for students and faculty.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Many users still fall victim to misinformation despite the need to verify AI-provided information, due to cognitive biases, reliance on headlines, and the persistence of false information.

    “While users should verify AIprovided information, many still fall victim to misinformation (Lim et al., 2023), due to cognitive biases, reliance on headlines, and the persistence of false information (Centre for Information Technology and Society, 2023).”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Lim et al., 2023

      Not checked in the free run.

    • cites Centre for Information Technology and Society, 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation

    The fact that AI may produce biased responses represents a valuable opportunity to raise awareness and engage in a discussion about inherent biases which are present in society and therefore reflected in the LLM's training data.

    “Moreover, the fact that AI may produce biased responses represents a valuable opportunity to raise awareness and engage in a discussion about inherent biases which are present in society and therefore reflected in the LLM's training data (Heaven, 2023).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Heaven, 2023

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    AI poses challenges but also offers solutions to bolster equality, diversity, and inclusion.

    “While AI poses challenges, it also offers solutions to bolster equality, diversity, and inclusion.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    Chatbots can handle course queries, direct students to resources, provide materials suited to different learning styles, and simplify complex ideas, benefiting those with communication challenges.

    “They can handle course queries, direct students to resources, provide materials suited to different learning styles (Gupta and Chen, 2022), and simplify complex ideas, benefiting those with communication challenges (Hemsley et al., 2023).”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Gupta and Chen, 2022

      Not checked in the free run.

    • cites Hemsley et al., 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationnone given

    While the ability of AI to bolster EDI is clear, the risks associated with AI use can be managed.

    “In conclusion, while the ability of AI to bolster EDI is clear, the risks associated with AI use can be managed.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    As tools like ChatGPT become more common at work, graduates must be equipped with the right knowledge and skills to use them adeptly.

    “As tools like ChatGPT become more common at work, graduates must be equipped with the right knowledge and skills to use them adeptly.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    ChatGPT's initial answer could prompt further questioning and encourage students to apply their knowledge and reasoning skills.

    “Gilson et al. (2023), note that ChatGPT's initial answer could prompt further questioning and encourage students to apply their knowledge and reasoning skills”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Gilson et al. (2023)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationreasoning

    Once students have the necessary knowledge and skills, they can evaluate the outputs generated by AI, weeding out inaccuracies and leveraging the beneficial and helpful components of the responses offered by the technology.

    “Once students have the necessary knowledge and skills, they can evaluate the outputs generated by AI, weeding out inaccuracies and leveraging the beneficial and helpful components of the responses offered by the technology.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationreasoning

    Fictional references, which are often markers of AI-generated content, can help educators pinpoint students falsely claiming AI work as their own.

    “Moreover, fictional references, which are often markers of AI-generated content, can help educators pinpoint students falsely claiming AI work as their own.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Premisenone given

    ChatGPT is capable of generating computer code snippets in different programming languages, crafting tables and lists, and creating Excel formulas.

    “It is capable of generating computer code snippets in different programming languages, crafting tables and lists, and creating Excel formulas.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Japanese authorities have voiced privacy concerns, emphasising the need to weigh these against the benefits of generative AI.

    “Similarly, Japanese authorities have voiced privacy concerns, emphasising the need to weigh these against the benefits of generative AI (Kaur, 2023).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Kaur, 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    While these outputs may require some editing and verification, ChatGPT serves as a valuable time-saving resource.

    “While these outputs may require some editing and verification, ChatGPT undeniably serves as a valuable time-saving resource (Centre for Teaching and Learning, 2023).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Centre for Teaching and Learning, 2023

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    Generative AI, when used appropriately in education, offers significant potential to enhance EDI and promote inclusive learning.

    “Generative AI, when used appropriately in education, offers significant potential to enhance EDI and promote inclusive learning.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    The Covid-19 pandemic illustrated how AI can mass-produce questionable content and amplify misinformation through social media bots.

    “The Covid-19 pandemic illustrated how AI can mass-produce questionable content and amplify misinformation through social media bots (Gisondi, et al., 2023).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Gisondi, et al., 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    The privacy implications of ChatGPT are particularly relevant for learners and educators who may lack in-depth knowledge of technology and privacy.

    “The privacy implications of ChatGPT are particularly relevant for learners and educators who may lack in-depth knowledge of technology and privacy.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    OpenAI responded to Italy's restriction by addressing and clarifying privacy matters.

    “OpenAI responded by addressing and clarifying these privacy matters ( McCallum, 2023).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites McCallum, 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Generative AI could be used as an aid to improve writing and research skills.

    “while Rudolph et al. (2023) state that generative AI could be used as an aid to improve writing and research skills.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Rudolph et al. (2023)

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    For neurodivergent students, AI can assist in time management, information processing, and thought organisation.

    “For neurodivergent students, AI can assist in time management, information processing, and thought organisation (McMurtrie, 2023).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites McMurtrie, 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Companies developing LLMs are aware of these issues and are working to address them.

    “Companies developing LLMs are aware of these issues and are working to address them (O'Brien, 2023).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites O'Brien, 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationreasoning

    Integrating AI models into curricula can nurture creativity, promote critical thinking, and prepare students for a future where AI collaboration is commonplace in professional life.

    “Integrating these AI models into curricula can nurture creativity, promote critical thinking, and prepare students for a future where AI collaboration is commonplace in professional life.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    ChatGPT does not operate based on ethical principles, nor can it discern between right and wrong, or truth and falsehood.

    “It is crucial to understand that ChatGPT does not operate based on ethical principles, nor can it discern between right and wrong, or truth and falsehood.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Sabzalieva and Valentini, 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationreasoning

    Generative AI is set to enhance the educational landscape through aiding research, boosting writing skills, and enabling innovative problem-solving.

    “Through aiding research, boosting writing skills, and enabling innovative problem-solving, this technology is set to enhance the educational landscape”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    The multifaceted attributes of generative AI and LLMs underscore heightened efficiency and democratise AI, making it an accessible tool for diverse audiences.

    “Their multifaceted attributes not only underscore heightened efficiency but also democratise AI, making it an accessible tool for diverse audiences.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    OpenAI claims to have fine-tuned ChatGPT 4.0, achieving an 82% reduction in the model's tendency to produce disallowed content compared to its predecessor.

    “OpenAI has recognised this issue and claims to have fine-tuned ChatGPT 4.0, achieving an 82% reduction in the model's tendency to produce disallowed content compared to its predecessor.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites OpenAI, 2023b

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    ChatGPT has a pro-environmental, left-libertarian bias.

    “Furthermore, Hartmann et al. (2023) highlight ChatGPT's pro-environmental, left-libertarian bias.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Hartmann et al. (2023)

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    Generative AI and LLMs, with their capacity for personalised lessons and engaging with complex subjects, hold the potential to transform traditional classroom settings.

    “Generative AI and LLMs, with their capacity for personalised lessons and engaging with complex subjects, hold the potential to transform traditional classroom settings.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    ChatGPT merely gathers data from the databases and texts it processes online, thereby inheriting any cognitive biases present in that information.

    “This tool merely gathers data from the databases and texts it processes online, thereby inheriting any cognitive biases present in that information(Sabzalieva and Valentini, 2023).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Sabzalieva and Valentini, 2023

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Interpretationnone given

    Generative AI is still a relatively novel technology, and the question of how to successfully integrate it within higher education remains unanswered.

    “Currently, generative AI is still a relatively novel technology, therefore the question of how to successfully integrate it within higher education remains unanswered.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    GPT-4 is 29% more aligned with company safety policies on sensitive data handling.

    “Additionally, GPT-4 is 29% more aligned with company safety policies on sensitive data handling(OpenAI, 2023b).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites OpenAI, 2023b

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    LLMs can perpetuate and amplify existing biases and unfairness in society, which can negatively impact teaching and learning processes and outcomes.

    “Overall, LLMs can perpetuate and amplify existing biases and unfairness in society, which can negatively impact teaching and learning processes and outcomes(Abdelghani et al., 2023).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Abdelghani et al., 2023

      Not checked in the free run.

75 of 75
  • The paper relies on this without support.

    The academic literature reviewed provides a comprehensive and representative account of the current state of generative AI in higher education.

    “Through a comprehensive review of the academic literature, this paper highlights the unprecedented growth of these models and their widereaching impact across various sectors.”
    “The discussion sheds light on the complex issues and potential benefits presented by LLMs, providing a comprehensive overview of the field's current state.”
  • The paper relies on this without support.

    The publications, news stories and themes retrieved by the ChatGPT 3.5 API and AgentGPT search are sufficient and representative for drawing conclusions about generative AI in higher education.

    “ChatGPT 3.5 API in combination with AgentGPT was used to search for relevant publications, news stories, and themes during the initial stage of the project.”
2 of 2

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Gisondi citation year differs from reference

    Minor

    The text cites Gisondi et al. as a 2023 work, while the matching reference gives 2022.

  • Haleem citation year differs from reference

    Minor

    The text cites Haleem et al. as a 2023 work, but the matching reference lists it as published in 2022.

  • McMurtrie citation year differs from reference

    Minor

    The text cites McMurtrie as a 2022 work, but the McMurtrie reference is dated 2023.

3 of 3

Cites

Flagged first, then by citations

4 of the 52 references couldn’t be matched to a known paper.

Research works printed but not linked: 10

  1. Bloomberg (2023a) Bloomberg Terminal. Available at: https://www.bloomberg.com/professional/solution/bloomberg- terminal/?utm_medium=Adwords_SEM&utm_source=pdsrch&utm_content=Termin al&utm_campaign=835926&utm_term=bloomberg+professional+terminal&tactic=83 5926&gad_source=1&gclid=CjwKCAiA5L2tBhBTEiwAdSxJX3bxnX7YGTpHAzEjdth br4DQQh_bUFmLe0R6HSfUWV1fOkGVgC4DnBoCLTkQAvD_BwE. (Accessed: 12 July 2023). Bobula Generative Artificial Intelligence (AI) in higher education: a comprehensive review of challenges, opportunities, and implications Journal of Learning Development in Higher Education, Issue 30: March 2024 17
  2. Dixit, P. (2023) 'Google faces lawsuit alleging data scraping and copyright violations for AI development', Business Today, 12 July. Available at: https://www.businesstoday.in/technology/news/story/google-faces-lawsuit-alleging- Bobula Generative Artificial Intelligence (AI) in higher education: a comprehensive review of challenges, opportunities, and implications Journal of Learning Development in Higher Education, Issue 30: March 2024 19
  3. Geerling, W., Mateer, G. D., Wooten, J., and Damodaran, N. (2023) 'ChatGPT has Mastered the Principles of Economics: Now What?', SSRN. Available at: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4356034 (Accessed: 29 July 2023)
  4. Bobula Generative Artificial Intelligence (AI) in higher education: a comprehensive review of challenges, opportunities, and implications Journal of Learning Development in Higher Education, Issue 30: March 2024 20
  5. Gimpel, H., Hall, K., Decker, S., Eymann, T., Lämmermann, L., Maedche, A., Röglinger, M., Ruiner, C., et al. (2023) Unlocking the Power of Generative AI Models and Systems such as GPT-4 and ChatGPT for Higher Education A Guide for Students and Lecturers. https://doi.org/10.13140/RG.2.2.20710.09287/ · DOI
  6. Lim, W.M., Gunasekara, A., Pallant, J.L., Pallant, J.I., and Pechenkina, E. (2023) 'Generative AI and the future of education: Ragnarök or reformation? A paradoxical perspective from management educators', The International Journal of Management Education, 21(2), 100790. Available at: https://www.sciencedirect.com/science/article/pii/S1472811723000289 (Accessed: 09 July 2023).
  7. Mills, A. (2023a) 'AI Text Generators: Sources to Stimulate Discussion Among Teachers', Google Docs. Available at: Bobula Generative Artificial Intelligence (AI) in higher education: a comprehensive review of challenges, opportunities, and implications Journal of Learning Development in Higher Education, Issue 30: March 2024 23 https://docs.google.com/document/d/1V1drRG1XlWTBrEwgGqd- cCySUB12JrcoamB5i16-Ezw/edit#heading=h.qljyuxlccr6 (Accessed: 12 July 2023).
  8. Smith, D. P. and Francis, N. J. (2023) Generative AI in assessment. Available at: https://network.febs.org/posts/generative-ai-in-assessment (Accessed: 12 September 2023). Bobula Generative Artificial Intelligence (AI) in higher education: a comprehensive review of challenges, opportunities, and implications Journal of Learning Development in Higher Education, Issue 30: March 2024 25
  9. Wang, T., Lund, B.D., Marengo, A., Pagano, A., Mannuru, N.R., Teel, Z.A. and Pange, J. (2023) 'Exploring the Potential Impact of Artificial Intelligence (AI) on International Bobula Generative Artificial Intelligence (AI) in higher education: a comprehensive review of challenges, opportunities, and implications Journal of Learning Development in Higher Education, Issue 30: March 2024 26
  10. Weinberger, D. (2019) 'How machine learning pushes us to define fairness', Harvard Business Review, 11, pp.2-6.

Cited by

Sorted by citations

Authors
Bobula, M.
Affiliations
University of the West of England (GB)
Corresponding author
Bobula, Michal
Venue
Journal of Learning Development in Higher Education
Published
2024-03-27
Issue
30
ISSN
1759-667X (ISSN-L)
OpenAlex
W4393226952
Cited by
113
References
52
Citations by year
2026: 56 · 2025: 45 · 2024: 12
FWCI
42.49
Type
journal article
Language
en
Open access
Locations
  • Journal of Learning Development in Higher Education (publishedVersion, cc-by)
  • UWE Research Repository (UWE Bristol) (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
Keywords
generative AI, large language models, ChatGPT, higher education, educational assessment, academic integrity, privacy concerns, misinformation, diversity, equity, and inclusion, copyright, algorithmic bias, AI skills development, responsible AI adoption

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-08.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-08.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review