Cited by 1,093Artificial Intelligence in EducationIntelligent Tutoring Systems and Adaptive LearningArtificial Intelligence in Healthcare and Education

State of the art and practice in AI in education

Open access
Holmes, Wayne, Tuomi, Ilkka·2022·European Journal of Education

Abstract

Recent developments in Artificial Intelligence (AI) have generated great expectations for the future impact of AI in education and learning (AIED). Often these expectations have been based on misunderstanding current technical possibilities, lack of knowledge about state‐of‐the‐art AI in education, and exceedingly narrow views on the functions of education in society. In this article, we provide a review of existing AI systems in education and their pedagogic and educational assumptions. We develop a typology of AIED systems and describe different ways of using AI in education and learning, show how these are grounded in different interpretations of what AI and education is or could be, and discuss some potential roadblocks on the AIED highway.

Verified 2026-10-09 · 3 references not checked yet

AI snapshot

Written from the paper’s full text.

TL;DR

This review argues that AIED is not a single homogeneous field but a typology of student-, teacher-, and institution-focused applications, most of which remain grounded in narrow instructionist and mastery-learning assumptions. It concludes that robust evidence for AIED’s broad efficacy is elusive, while ethical, personalisation, techno-solutionist, colonial, and commercialisation roadblocks remain unresolved.

Key findings

  • The paper develops a taxonomy of AIED into student-focused, teacher-focused, and institution-focused systems, marking applications as speculative, researched, or commercially available; examples include ITS, chatbots, automatic essay writing, plagiarism detection, classroom monitoring, admissions, and e-proctoring.
  • Most existing AIED is student-focused and knowledge-based, especially ITS built on mastery learning and the “2-sigma effect”; however, evidence is contested: meta-reviews show modest learning gains, independent at-scale evaluations are rare, and the What Works Clearinghouse reported that Cognitive Tutor had mixed effects on algebra, no discernible effects on general mathematics, and potentially negative effects on geometry.
  • The paper identifies major roadblocks: ethics and human rights, limited interpretations of personalisation, weak efficacy evidence, techno-solutionism, AIED colonialism, and commercialisation of education; it notes that most AIED research and development has occurred without serious engagement with ethical consequences.
  • It distinguishes data-driven AI from knowledge-based AI, noting that knowledge-based AI still underpins most existing AIED systems, while data-driven AI has advanced through massive computation and data—e.g., GPT-3 has 175 billion adjustable parameters, was trained on about 400 billion words, and its training was estimated to generate 85,000 kg of CO₂ emissions.

Methods

  • Design: conceptual review and taxonomy development, not an empirical study; the paper reviews existing AI systems in education and their pedagogic and educational assumptions.
  • Data/sample: existing literature, examples of AIED systems, and policy/ethics sources; no primary sample or experimental dataset is reported.
  • Analysis: narrative synthesis that classifies AIED applications into student-, teacher-, and institution-focused categories and discusses potential roadblocks.

Limitations

  • The paper states that it is not possible to draw aggregate inferences or make grand claims about AIED’s efficacy because AIED applications vary widely; it also notes that its taxonomy categories can be argued over and that many applications remain speculative.
  • It states that robust independent evidence remains elusive, most impact studies are conducted by developers, often with small numbers of learners, and most large independent studies are US-based, limiting transferability.
  • Evident from the text: the review does not report a systematic search strategy, inclusion criteria, or formal quality appraisal, so its coverage and conclusions depend on the authors’ selected examples and synthesis.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1111/ejed.12533

Cites

109 of 113 references verified0 citation errors · 1 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 86 cited sources checked · 0 supported · 0 flagged

  • Findingreasoning

    There remain few commercial examples of automatic formative assessment (AFA).

    “Despite their potential for supporting student learning, and probably because of the difficulties of automatically providing accurate and helpful feedback, there remain few commercial examples of AFA.”
    Quote in the paperNot a substantial claim
  • Findingcitation

    There are no known commercial exploratory learning environments (ELEs).

    “There are no known commercial ELEs, although a research example is FractionsLab (IOE, 2018).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites IOE, 2018

      Not checked in the free run.

  • Findingreasoning

    There are few examples of genuinely teacher-focused AIED.

    “In fact, if for analysis we ignore the overlaps, there are few examples of genuinely teacher focused AIED.”
    Quote in the paperSubstantial claim
  • Premisenone given

    Over the past decade, AIED has become a focus of commercial interests.

    “Over the past decade, the situation has changed, and AIED is now also a focus of commercial interests.”
    Quote in the paperNot a substantial claim
  • Premisecitation

    Over the last three decades, a key conceptual starting point for student-focused AIED has been 'mastery learning', a pedagogic model advanced by Benjamin Bloom.

    “Instead, over the last three decades, a key conceptual starting point for student-focused AIED has been 'mastery learning', a pedagogic model advanced by Benjamin Bloom (Bloom, 1968;cf. Guskey, 2012).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Bloom, 1968

      Not checked in the free run.

    • cites Guskey, 2012

      Not checked in the free run.

  • Classified as probably not a substantial claim. 68
  • May combine two claims. 41
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Findingnone given

    We have not been able to identify currently available commercial examples of dialogue-based tutoring systems (DBTS).

    “We have not been able to identify currently available commercial examples of DBTS.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Findingnone given

    AI-assisted Lifelong Learning Assistants have received very little research effort to date.

    “However, to date such a tool has received very little research effort.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Findingnone given

    There are few researched and commercially available examples of learning network orchestrators.

    “There are few researched and commercially available examples of this.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Some influential ITS, such as the ASSISTments system, started explicitly as a system for high-stakes test preparation; and many widely used Chinese AIED systems are also focused on teaching for the test.

    “In fact, some influential ITS, such as the ASSISTments system, started explicitly as a system for high-stakes test preparation (Heffernan & Heffernan, 2014); and many widely used Chinese AIED systems are also focused on teaching for the test (Knox, 2020).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Heffernan & Heffernan, 2014

      Not checked in the free run.

    • cites Knox, 2020

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given

    In much existing student-focused AIED research and development, the ultimate rationale of using AI has been that it can lead to learning gains in specific knowledge domains independently of human teachers.

    “In much of the existing student-focused AIED research and development, the ultimate rationale of using AI has been that it can lead to learning gains in specific knowledge domains independently of human teachers.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Many current commercial AI systems developed for education, so-called Intelligent Tutoring Systems (ITS), focus on providing automated, adaptive and individualised instruction.

    “Many current commercial AI systems developed for education, so-called Intelligent Tutoring Systems (ITS), focus on providing automated, adaptive and individualised instruction, an approach that we explore in more detail below.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    AIED research and development has largely been driven by computer scientists.

    “Research and development in AI for education (AIED) has to a large extent been driven by computer scientists (Chen et al., 2020;Williamson & Eynon, 2020;Zawacki-Richter et al., 2019).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Chen et al., 2020

      Not checked in the free run.

    • cites Williamson & Eynon, 2020

      Not checked in the free run.

    • cites Zawacki-Richter et al., 2019

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The technological origins of student-focused AIED can be traced to the work of Sidney Pressey, B. F. Skinner, Gordon Pask, and Jaime Carbonell.

    “The technological origins of student focused AIED, however, can be traced to the work of Sidney Pressey, B. F. Skinner, Gordon Pask, and Jaime Carbonell (Holmes et al., 2019).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Holmes et al., 2019

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Learning as a developmental and socio-cultural phenomenon has only recently become a more common topic in AIED.

    “Learning as a developmental and socio-cultural phenomenon, however, has only recently become a more common topic in AIED (e.g., Thomas & Porayska-Pomsta, 2022).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Thomas & Porayska-Pomsta, 2022

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    These two latter functions (socialisation and subjectification) have received comparatively little attention from AIED researchers.

    “These two latter functions have received comparatively little attention from AIED researchers.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The close historical link between AI and cognitive science has meant that many influential AI systems in education have been built on cognitive architectures, themselves based on the idea that the human brain is an information processor.

    “The close historical link between AI and cognitive science (Gardner, 1985) has meant that many influential AI systems in education have been built on cognitive architectures, themselves based on the idea that the human brain is an information processor.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Gardner, 1985

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    In more recent AIED research, the impact of human tutoring has been found to be below one standard deviation, which the research also suggests has already been achieved by some ITS.

    “In more recent AIED research, the impact of human tutoring has been found to be below one standard deviation, which the research also suggests has already been achieved by some ITS (VanLehn, 2011).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites VanLehn, 2011

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Many higher education institutions, mainly in the US, use commercially available AI-assisted admissions software, not without controversy.

    “Many higher education institutions, mainly in the US, use commercially available AI-assisted admissions software to support their admission processes-however, not without controversy (Pangburn, 2019).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Pangburn, 2019

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    The human brain operates with about 20 Watts of energy, which suggests that data-driven AI is based on different principles than human intelligence.

    “The human brain, on the other hand, operates with about 20 Watts of energy, which suggests that data-driven AI is based on different principles than human intelligence (Tuomi, 2020).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Tuomi, 2020

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    E-proctoring is probably one of the clearest examples of using AI to automate poor pedagogic practices, rather than using it to develop innovative approaches.

    “In fact, e-Proctoring is probably one of the clearest examples of using AI to automate poor pedagogic practices, rather than using it to develop innovative approaches.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    All state-of-the-art data-driven AI systems work by being given input data, making a prediction, using the error to calculate a loss that the system tries to minimise during training by adapting its parameter values.

    “All state-of-the-art data-driven AI systems, therefore, work in the following way.First, the system is given some input data, and it is allowed to make a prediction.The error in prediction is used to calculate a 'loss' that the system tries to minimise during its training phase by adapting its parameter values.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Premisecitation

    The purported benefits of AI in education have received much visibility.

    “As noted in the introduction, the purported benefits of AI in education have received much visibility (e.g., OECD, 2020OECD, , 2021)).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites OECD, 2020

      Not checked in the free run.

    • cites OECD, 2021

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    Mastery learning requires individual-level differentiation or 'personalisation' of instruction, for which AIED systems have been proposed and designed as an answer.

    “Thus, mastery learning requires individual-level differentiation or 'personalisation' of instruction, for which AIED systems have been proposed and designed as an answer.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    One classical definition specifies that AI is research that develops technologies that can do things that would require intelligence if done by humans.

    “One classical definition specifies that AI is research that develops technologies that can do things that would require intelligence if done by humans (Minsky, 1969).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Minsky, 1969

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    Useful and usable definitions of AI depend on what they are used for.

    “It is, however, important to note that useful and usable definitions of AI depend on what they are used for.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationreasoning

    The 2-sigma effect provides a rarely contested implicit model of the function of education among AIED researchers, which ignores Biesta's socialisation and individuation functions.

    “Nonetheless, the 2-sigma effect also provides a rarely contested implicit model of the function of education among AIED researchers, which ignores Biesta's socialisation and individuation functions.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Energy consumption is now widely understood to be a major challenge for data-driven AI.

    “Energy consumption is now widely understood to be a major challenge for data-driven AI (Strubell et al., 2019).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Strubell et al., 2019

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Data-driven AI has seen extraordinary advances during the last decade because of three key factors: computational power, huge amounts of data, and massive human effort in labelling.

    “Data-driven AI has seen extraordinary advances during the last decade because of three key factors (Tuomi, 2018).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Tuomi, 2018

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    Kai-Fu Lee's vision neatly summarises the beliefs about AIED held by many of its keenest advocates.

    “Such a vision of the AI-enabled future neatly summarises the beliefs about AIED held by many of its keenest advocates.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Ambiguous results, methodological and practical challenges, lack of independence and scale, and more fundamental questions about the aims of education have left ample space to contest any generic claims about the benefits of student-focused AIED.

    “Ambiguous results, methodological and practical challenges, lack of independence and scale, and more fundamental questions about the aims of education have left ample space to contest any generic claims about the benefits of student-focused AIED.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Data-driven AI has produced impressive results in the last decade in computer vision, natural language processing, robotics, and in many other areas widely reported in the media.

    “Data-driven AI has produced impressive results in the last decade in computer vision, natural language processing, robotics, and in many other areas widely reported in the media.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Most current AI systems essentially are behaviouristic stimulus-response systems.

    “In fact, as most current AI systems essentially are behaviouristic stimulus-response systems, it has also been suggested that AI should more appropriately denote Artificial Instincts (Tuomi, 2018).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Tuomi, 2018

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Interpretationnone given

    AI is applied in education (AIED) in multiple ways.

    “AI is applied in education (AIED) in multiple ways.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    Many studies have shown learning gains when ITS have been used in the classroom, but the results are not unambiguous.

    “There are many studies that have shown learning gains when ITS have been used in the classroom (cf.du Boulay, 2019), but the results are not unambiguous.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites du Boulay, 2019

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    The market for plagiarism detection is now dominated by Turnitin, with other tools extensively used.

    “The market is now dominated by Turnitin (Turnitin, 2022), with its various tools such as iThenticate and Ouriginal, but also detection software such as Plagiarism Checker X (Plagiarism Checker X, 2022) and the more student oriented Grammarly's plagiarism checker (Grammarly, 2022b) are extensively used.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Turnitin, 2022

      Not checked in the free run.

    • cites Plagiarism Checker X, 2022

      Not checked in the free run.

    • cites Grammarly, 2022b

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning

    It is not entirely clear what such 'working' would comprise.

    “More importantly, it is not entirely clear what such 'working' would comprise.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The UNICEF definition of AI refers to machine-based systems that can, given a set of human-defined objectives, make predictions, recommendations, or decisions that influence real or virtual environments.

    “AI refers to machine-based systems that can, given a set of human-defined objectives, make predictions, recommendations, or decisions that influence real or virtual environments.AI systems interact with us and act on our environment, either directly or indirectly.Often, they appear to operate autonomously, and can adapt their behaviour by learning about the context.(UNICEF, 2021, p. 16)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites UNICEF, 2021

      Not checked in the free run.

  • May combine two claims.

    Premisereasoning

    In Open Tutor, the learner is in charge, deciding what they want to learn, while the AI plays a supporting role.

    “Nonetheless, what is particularly interesting is that the learner is in charge, deciding what they want to learn, while the AI (unlike with an ITS) plays a supporting role.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Only rare examples exist of independent evaluations at scale, while meta-level reviews show modest learning gain impacts across many relatively small settings.

    “Only rare examples exist of independent evaluations at scale (e.g., Roschelle et al., 2016), while meta-level reviews (e.g., Kulik & Fletcher, 2016;Ma et al., 2014) show modest learning gain impacts across many relatively small settings.”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Roschelle et al., 2016

      Not checked in the free run.

    • cites Kulik & Fletcher, 2016

      Not checked in the free run.

    • cites Ma et al., 2014

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    AI systems always make their recommendations, predictions and decisions based on objectives that are specified by the system designer at the time the system is developed.

    “For example, AI systems always make their recommendations, predictions and decisions based on objectives that are specified by the system designer at the time the system is developed.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    It is not possible to draw aggregate inferences or make grand claims about AIED's efficacy or otherwise.

    “Accordingly, it is not possible either to draw aggregate inferences or, for example, make grand claims about AIED's efficacy or otherwise.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationcitation

    Many AIED technologies are designed to save time for teachers, but in so doing they effectively take over teaching tasks, potentially reducing teachers to a functional role.

    “However, in so doing, they effectively take over teaching tasks, potentially reducing teachers to a functional role (Guilherme, 2019;Selwyn, 2019).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Guilherme, 2019

      Not checked in the free run.

    • cites Selwyn, 2019

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    This mastery learning model underpins most ITS, as well as the notion that AI can 'personalise' learning.

    “This model underpins most ITS, as well as the notion that AI can 'personalise' learning.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Training OpenAI's GPT-3 has been estimated to have required as much energy as driving a car to the moon and back, thus generating an equivalent of 85,000 kg of CO2 emissions.

    “Training OpenAI's GPT-3 has been estimated to have required as much energy as driving a car to the moon and back, thus generating an equivalent of 85,000 kg of CO 2 emissions (Quach, 2020).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Quach, 2020

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Historically, the emergence of new key technologies have led to exaggerated and over-optimistic expectations, subsequent economic crashes, and the gradual articulation of technological possibilities over relatively long periods of time.

    “Historically, the emergence of new key technologies have led to exaggerated and over-optimistic expectations, subsequent economic crashes, and the gradual articulation of technological possibilities over relatively long periods of time (Nemorin et al., 2022;Perez, 2002).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Nemorin et al., 2022

      Not checked in the free run.

    • cites Perez, 2002

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    The Open Tutor system involves human tutors and is relatively expensive to scale.

    “Inevitably, as this system involves human tutors, it is relatively expensive to scale.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Knowledge-based AI still underpins most existing AIED systems.

    “Data-driven AI might have great potential in education, depending on the intentions of the system, but knowledge-based AI still underpins most existing AIED systems.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The development of technologies to personalise learning to the strengths and weaknesses of individual students began almost 100 years ago, with the so-called teaching machines devised by Sidney Pressey and B. F. Skinner.

    “In fact, as discussed in the introduction, the development of technologies to personalise learning to the strengths and weaknesses of individual students began almost 100 years ago, with the so-called teaching machines devised by Sidney Pressey and B. F. Skinner (Watters, 2021).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Watters, 2021

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationcitation

    AIED colonialism might involve the adoption of AIED tools created in one context in other places, leading to market and economic gains for Global North corporations, with the extraction of local data and capital out of the host country.

    “AIED colonialism might involve the adoption of AIED tools created in one context in other places, leading to market and economic gains for the Global North corporations, with the extraction of local data and capital out of the host country (Nemorin et al., 2022).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Nemorin et al., 2022

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Early in the COVID-19 pandemic, much education moved online, leading to massive growth for e-Proctoring companies.

    “Early on in the COVID-19 pandemic, much education moved online, as did many examinations-which led to many exam-monitoring, or e-Proctoring, companies seeing their businesses grow massively (Nigam et al., 2021).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Nigam et al., 2021

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation

    AIED colonialism might simply involve the language in which most classroom AIED tends to be trained-mainly American English.

    “More subtly, it might simply involve the language in which most classroom AIED tends to be trained-mainly American English (Cotterell et al., 2020).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Cotterell et al., 2020

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    While the immediate cohort in a context such as rural areas in developing countries might benefit from being given access to an AIED tool, there are many challenges.

    “However, while the immediate cohort in such a context might benefit from being given access to an AIED tool, there are many challenges.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Technology has a significant impact on human development and cognition.

    “It has long been thought, ever since Socrates argued that writing led to forgetfulness (Plato, 257 C.E.), that technology has a significant impact on human development and cognition.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Plato, 257 C.E.

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisereasoning

    Academic researchers have conducted many studies into the efficacy of various AIED systems.

    “As the many articles published in the International Journal of Artificial Intelligence in Education show, academic researchers have conducted many studies into the efficacy of various AIED systems.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    These teaching machines failed to be widely accepted, and the personalised learning agenda more or less disappeared.

    “For various reasons, these machines failed to be widely accepted, and the personalised learning agenda more or less disappeared.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Watters, 2021

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S1 (asserted), S3 (load-bearing).

    Premisecitation

    Greater use of GPS navigation devices and applications leads to a decline in spatial memory.

    “For example, while one study has suggested that greater use of Global Positioning System (GPS) navigation devices and applications leads to a decline in spatial memory (Dahmani & Bohbot, 2020), another has shown that the use of smartphone alerts frees cognitive resources for other tasks (Fröscher et al., 2022).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Dahmani & Bohbot, 2020

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationreasoning

    It is not clear why some schools use ITS in classrooms, which are by definition social spaces.

    “While ITS might be useful when the student is without a teacher or their peers, perhaps when completing homework, it is not clear why some schools use them in classrooms, which are by definition social spaces.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    The personalisation of learning pathways offered by much current AIED is a very limited interpretation of personalisation.

    “The personalisation of learning pathways offered by much current AIED, however, is a very limited interpretation of personalisation.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The meaning of personalised learning remains unclear.

    “Despite the meaning of personalised learning remaining unclear (Holmes, Anastopoulou, et al., 2018), it increasingly informs the mainstream education narrative (e.g., European Parliament, 2021; UNICEF, 2022).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Holmes, Anastopoulou, et al., 2018

      Not checked in the free run.

  • May combine two claims.

    Interpretationnone given

    AIED corporations are increasingly selling their AIED tools globally, creating what has been called an AIED colonialism: Global North companies exporting their AIED tools into contexts in the Global South, creating asymmetries in power across and between nations.

    “AIED corporations are increasingly selling their AIED tools globally, creating what has been called an AIED colonialism: Global North companies exporting their AIED tools into contexts in the Global South, creating asymmetries in power across and between nations.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Classroom orchestration is at an early stage of development, but there is a growing body of research into how AI might assist.

    “This is at an early stage of development, nonetheless there is a growing body of research into how AI might assist classroom orchestration (Song, 2021).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Song, 2021

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationreasoning

    These gains and extractions may begin with individual schools embedding AIED tools into teachers' everyday practices before expanding to draw in entire state education systems in which single products are adopted across all schools.

    “These gains and extractions may begin with individual schools embedding AIED tools into teachers' everyday practices before expanding to draw in entire state education systems in which single products are adopted across all schools.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    AIED systems perform better than human teachers working in large classes, and slightly worse than one-on-one human tutors.

    “The overall conclusion of these metareviews and analyses is that AIED systems perform better than […] human teachers working in large classes.They perform slightly worse than one-on-one human tutors […].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites du Boulay, 2016

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Autograders have been used for the assessment of written tasks and in computer science and mathematics courses.

    “Autograders have been used for the assessment of written tasks (e.g., the US SATs) (Ramesh & Sanampudi, 2021), and in computer science and mathematics courses.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Ramesh & Sanampudi, 2021

      Not checked in the free run.

  • May combine two claims.

    Interpretationnone given

    Most of these large independent studies have been conducted in the US, limiting their transferability to other countries.

    “Most of these large independent studies have been conducted in the US, limiting their transferability to other countries.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    The vast majority of impact studies have been conducted by the developers of the particular technology being studied, and most often with relatively small numbers of learners.

    “The vast majority of impact studies have been conducted by the developers of the particular technology being studied (increasingly from commercial organisations), and most often with relatively small numbers of learners.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    The overwhelming balance of AIED research is carried out in the Global North, and rarely addresses cultural diversity or local policies and practices in any meaningful way.

    “This is exacerbated by the fact that the overwhelming balance of AIED research is also carried out in the Global North, and rarely addresses cultural diversity or local policies and practices in any meaningful way (Blanchard, 2015).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Blanchard, 2015

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisereasoning

    The personalised learning agenda re-emerged decades later, mainly from Silicon Valley, partly because the internet made mass customisation possible across a broad range of industries.

    “It re-emerged decades later, mainly from Silicon Valley, partly because the internet made mass customisation possible across a broad range of industries.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    E-proctoring tools are hugely controversial.

    “However, these tools are hugely controversial (Kelley, 2021).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Kelley, 2021

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    One important potential impact of AIED is on human cognition and brain development.

    “One important potential impact of AIED is on human cognition and brain development.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    Education is also about collaboration and the other social interaction aspects of teaching and learning, which are often ignored by current ITS and most other AIED.

    “Third, education is also about collaboration and the other social interaction aspects of teaching and learning, which are often ignored by current ITS and most other AIED.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The use of smartphone alerts frees cognitive resources for other tasks.

    “For example, while one study has suggested that greater use of Global Positioning System (GPS) navigation devices and applications leads to a decline in spatial memory (Dahmani & Bohbot, 2020), another has shown that the use of smartphone alerts frees cognitive resources for other tasks (Fröscher et al., 2022).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Fröscher et al., 2022

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    The so-called individual pathways provided by almost all AIED systems are mostly based on the averages of prior learners.

    “Second, the socalled individual pathways provided by almost all AIED systems are mostly based on the averages of prior learners.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationreasoning

    The impact of technology on human development and cognition is likely to be complex.

    “Inevitably, however, this impact is likely to be complex.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    Such institution-focused tools have a clear administrative function and share much with business-orientated AI.

    “Such tools have a clear administrative function and share much with business-orientated Artificial Intelligence.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    In recent years, for AI in general there has been a growing focus on ethics, resulting in more than 80 sets of ethical AI principles.

    “In recent years, for AI in general there has been a growing focus on ethics, resulting in more than 80 sets of ethical AI principles (Ayling & Chapman, 2021;Jobin et al., 2019;Tsamados et al., 2022).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Ayling & Chapman, 2021

      Not checked in the free run.

    • cites Jobin et al., 2019

      Not checked in the free run.

    • cites Tsamados et al., 2022

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    The ethical challenges related to AI in education are particularly difficult both conceptually and in practice because education has important social roles and aims at human development.

    “Although the general ethical concerns related to AI are now widely debated, education has important social roles and aims at human development, which makes the related ethical challenges particularly difficult both conceptually and in practice.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Education has important social roles and aims at human development.
  • May combine two claims.

    Interpretationreasoning

    AIED in such contexts might address the apparent symptoms of the problem (for example, learners not receiving a quality education), but not necessarily the underlying and long-term socio-political causes (the lack of experienced and qualified teachers).

    “Most importantly, AIED in such contexts might address the apparent symptoms of the problem (for example, learners not receiving a quality education), but not necessarily the underlying and long-term socio-political causes (the lack of experienced and qualified teachers).”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Many rural areas do not yet have the necessary infrastructure (electricity and access to the Internet).
    • Rests on an assumption: Rarely are there the skilled support staff needed for the deployment, management and support of the required hardware and software in rural areas.
  • May combine two claims.

    Premisecitation

    AI is increasingly being used to support admissions, often using tools provided by commercial companies such as Salesforce.

    “Nonetheless, AI is increasingly being used to support admissions (Marcinkowski et al., 2020), often using tools provided by commercial companies such as Salesforce (Salesforce, 2022).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Marcinkowski et al., 2020

      Not checked in the free run.

    • cites Salesforce, 2022

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Interpretationnone given

    Most teachers personalise their teaching moment by moment in response to each individual student, helping the student to self-actualise, to become the best that they can be.

    “However, most teachers personalise their teaching moment by moment in response to each individual student, helping the student (if the particular education system permits) to self-actualise, to become the best that they can be.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Google Classroom has become both a global collector of student data and a critical control point where the rules of participation are defined.

    “For example, a study on the complex ways in which Google binds AIED users and developers into its infrastructure has shown that the Google Classroom has become both a global collector of student data and also a critical control point where the rules of participation are defined (Perrotta et al., 2021;Williamson, 2021).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Perrotta et al., 2021

      Not checked in the free run.

    • cites Williamson, 2021

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    All our images of the future are based on our understanding and construction of history.

    “All our images of the future are based on our understanding and construction of history.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning

    The future of AI cannot necessarily be predicted by extrapolating the developments of the last decade.

    “As the progress in data-driven AI has led to exponentially growing computational requirements, it is now increasingly understood that the future of AI cannot necessarily be predicted by extrapolating the developments of the last decade.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    While original research is undertaken in academia with the explicit aim of enhancing teaching and learning, today's commercial organisations by definition focus on generating profits.

    “First, while original research is undertaken in academia with the explicit aim of enhancing teaching and learning, today's commercial organisations by definition focus on generating profits.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    AIED colonialism might also involve the imposition of particular approaches to pedagogy-at present often instructionist and behaviourist-as embedded in most current commercial AIED tutoring systems.

    “AIED colonialism might also involve the imposition of particular approaches to pedagogy-at present often instructionist and behaviourist-as embedded in most current commercial AIED tutoring systems.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    Many recent breakthroughs in data-driven AI, such as the capability to locate a cat in a picture or distinguish words in a spoken sentence, are simple tasks for an infant already years before the child enters school.

    “Many recent breakthroughs in datadriven AI, such as the capability to locate a cat in a picture or distinguish words in a spoken sentence, are simple tasks for an infant already years before the child enters school.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    The future of AIED should be understood from the point of view of AI-supported augmentation of human cognition and learning.

    “This suggests that the future of AIED should be understood from the point of view of AI-supported augmentation of human cognition and learning, an approach that has been an important line of thinking in AI throughout its history (Bush, 1945;Engelbart, 1963;Winograd & Flores, 1986).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites Bush, 1945

      Not checked in the free run.

    • cites Engelbart, 1963

      Not checked in the free run.

    • cites Winograd & Flores, 1986

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Data-driven AI provides important basic information processing functionality, such as pattern recognition.

    “Data-driven AI provides important basic information processing functionality, such as pattern recognition.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Commercial AIED organisations are not only shaping individual learners but are also beginning to influence governance and national policies.

    “Commercial AIED organisations are not only shaping individual learners but are also beginning to influence governance and national policies.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    In educational contexts, the development of AI may more constructively be seen as a joint development of human and artificial cognition.

    “In educational contexts, the development of AI, therefore, may more constructively be seen as a joint development of human and artificial cognition.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    This has potentially important consequences for the social control of education and educational innovation.

    “Beyond limiting interoperability, this has potentially important consequences for the social control of education and educational innovation.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Commercial organisations rarely share information about their proprietary systems and their effectiveness.
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    Learner-focused AI has been the subject of research for around 40 years, and almost a decade ago it shifted from being a focus of research labs to being developed into commercial products by a growing number of multi-million-dollar-funded AIED companies.

    “While learnerfocused AI has been the subject of research for around 40 years, almost a decade ago it shifted from having been a focus of research labs to be developed into commercial products by a growing number of multi-million-dollarfunded AIED companies.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    The commercialisation of education through an AIED back door is fraught with both practical and ideological issues.

    “In short, the commercialisation of education through an AIED back door is fraught with both practical and ideological issues.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Interpretationnone given

    It is mostly these commercial products that are being implemented in schools around the world, frequently by government (local and national) agencies.

    “It is mostly these products that are being implemented in schools around the world, frequently by government (local and national) agencies.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning

    The societal and cultural impact of commercial AIED may exceed the more surface level economic ones.

    “The societal and cultural impact may also exceed the more surface level economic ones.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    A final potential roadblock is the commercialisation of education by stealth.

    “A final potential roadblock noted in this article is the commercialisation of education by stealth.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

    Interpretationreasoning

    The future of AIED is also an economic and even a geopolitical issue.

    “The future of AIED, therefore, is also an economic and even a geopolitical issue.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    Colonialism might also fall along a spectrum.

    “Finally, colonialism might also fall along a spectrum.”
    Quote in the paperNot a substantial claim
93 of 93
  • The authors state this as an assumption.

    AI is a specific field of inquiry and development, not simply a type of intelligence that is artificial.

    “a name that we capitalise to highlight that it is a specific field of inquiry and development, and not simply a type of intelligence that is artificial.”
  • The paper relies on this without support.

    In education, knowledge-based AI continues to play a central role.

    “In education, however, knowledge-based AI continues to play a central role.”
  • The paper relies on this without support.

    Commercially available intelligent tutoring systems (ITS) are the most common applications of AI in education, and probably the most well-funded.

    “The commercially available so-called intelligent tutoring systems (ITS) are the most common applications of AI in education, and probably the most well-funded.”
  • The paper relies on this without support.

    Automatic summative assessment is a well-funded area of research, second only to ITS, and extensively commercialised.

    “For this reason, automatic summative assessment (sometimes also known as 'autograders') is a well-funded area of research, second only to ITS, and extensively commercialised.”
  • The paper relies on this without support.

    The use of automatic scoring, especially when the assessment is high-stakes, remains controversial.

    “Nonetheless, the use of automatic scoring, especially when the assessment is high-stakes, remains controversial.”
  • The paper relies on this without support.

    Currently no AI system is capable of the depth of interpretation or accuracy of analysis that a teacher can give.

    “A key problem is that currently no AI system is capable of the depth of interpretation or accuracy of analysis that a teacher can give, instead typically relying on surface features of the writing or other output.”
  • The paper relies on this without support.

    ITS and other dashboard-enabled AIED are mostly student-focused.

    “In any case, ITS and other dashboard-enabled AIED are all mostly student-focused.”
  • The paper relies on this without support.

    Commercially available plagiarism detection services are widely used by educators, and machine learning methods have been increasingly adapted for these systems during the last decade.

    “Commercially available plagiarism detection services are widely used by educators, and machine learning methods have been increasingly adapted for these systems during the last decade.”
  • The paper relies on this without support.

    In a few contexts, researched and commercially available AI-assisted systems are increasingly being used for classroom-based student monitoring.

    “In a few contexts, researched and commercially available AI-assisted systems are increasingly being used for classroom-based student monitoring.”
  • The paper relies on this without support.

    Similar EEG headsets are widely used in Chinese schools, where both teachers and parents can review student brain activity over the internet.

    “Similar headsets are widely used also in Chinese schools, where both teachers and parents can review student brain activity over the internet.”
  • The paper relies on this without support.

    High-stakes testing is one of the two high-risk use cases in the proposed EU AI Act.

    “In fact, high-stakes testing is one of the two high-risk use cases in the proposed EU AI Act, and so would be regulated by its provisions.”
  • The paper relies on this without support.

    By 2020, the GRADE admissions system had been dropped because it was quietly replicating the very problems that it aimed to address.

    “However, by 2020, GRADE had been dropped because it was quietly replicating the very problems that it aimed to address.”
  • The paper relies on this without support.

    There are already several commercial organisations that offer automatic essay writing (AEW) tools for students.

    “There are already several commercial organisations that offer automatic essay writing (AEW) tools for students that, in response to a prompt such as an essay question, can automatically generate individual paragraphs or entire essays.”
  • The paper relies on this without support.

    Whether AEW tools support or undermine student learning is unclear.

    “However, whether AEW tools support or undermine student learning is unclear.”
  • The paper relies on this without support.

    VR and AR simulations and digital games-based learning are frequently combined with AI and increasingly used in educational settings.

    “Although perhaps not traditionally thought of as AI technologies, commercially available Virtual Reality (VR) and Augmented Reality (AR) simulations and digital games-based learning are frequently combined with AI machine learning, image recognition and natural language processing, and are increasingly being used in educational settings.”
  • The paper relies on this without support.

    Google has developed more than a thousand VR and AR Expeditions suitable for educational contexts.

    “Google has developed more than a thousand VR and AR Expeditions suitable for educational contexts.”
  • The paper relies on this without support.

    Written essays remain an important component of educational assessment around the world, yet passing off someone else's writing as your own has long been common.

    “Written essays remain an important component of educational assessment around the world, yet passing off someone else's writing as your own has long been common.”
  • The paper relies on this without support.

    The Internet has made passing off someone else's writing as your own increasingly easy, with online commercial essay mills offering bespoke essays on any topic.

    “The Internet has made this increasingly easy, with online commercial essay mills offering bespoke essays on any topic.”
  • The paper relies on this without support.

    Exploratory learning environments provide an alternative to the step-by-step approach adopted by ITS and DBTS.

    “Exploratory learning environments (ELEs) provide an alternative to the step-by-step approach adopted by ITS and DBTS.”
  • The paper relies on this without support.

    Many recent AI-driven ELEs provide automatic feedback, addressing misconceptions and proposing alternative approaches during exploration.

    “However, this is where AI comes in, with many recent AI-driven ELEs providing automatic feedback, addressing misconceptions and proposing alternative approaches during exploration.”
  • The paper relies on this without support.

    The idea of AI-assisted admissions is to reduce costs while making the admissions system more equitable, by helping to remove unseen human biases.

    “The idea is to reduce costs while making the admissions system more equitable, by helping to remove unseen human biases (such as groupthink and racial and gender biases) that can impact decisions.”
  • The paper relies on this without support.

    E-proctoring aims to assure academic integrity by using AI-assisted cameras and microphones to automatically monitor students while they complete an online examination.

    “E-proctoring aims to assure academic integrity by using AI-assisted cameras and microphones to automatically monitor students-scanning their faces and tracking keystrokes and mouse movements-while they complete an online examination.”
  • The paper relies on this without support.

    Education has important social roles and aims at human development.

    “Although the general ethical concerns related to AI are now widely debated, education has important social roles and aims at human development, which makes the related ethical challenges particularly difficult both conceptually and in practice.”
  • The paper relies on this without support.

    Many rural areas do not yet have the necessary infrastructure (electricity and access to the Internet).

    “To begin with, many rural areas do not yet have the necessary infrastructure (electricity and access to the Internet).”
  • The paper relies on this without support.

    Rarely are there the skilled support staff needed for the deployment, management and support of the required hardware and software in rural areas.

    “Even when this is available, rarely are there the skilled support staff needed for the deployment, management and support of the required hardware and software.”
  • The paper relies on this without support.

    The way in which problems are articulated often depends on the interests of technology providers.

    “In practice, the way in which problems are articulated often depends on the interests of technology providers.”
  • The paper relies on this without support.

    The deeper social and cultural factors are rarely addressed because they are difficult to change without broad stakeholder participation and policy change.

    “The deeper social and cultural factors are rarely addressed as they are difficult to change without a broad participation of the stakeholders and policy change.”
  • The paper relies on this without support.

    Commercial organisations rarely share information about their proprietary systems and their effectiveness.

    “Commercial organisations rarely share information about their proprietary systems and their effectiveness.”
  • The paper relies on this without support.

    Data-driven AI has important scale benefits, and in the current networked ecosystems this potentially leads to natural monopolies.

    “Data-driven AI, in particular, has important scale benefits, and in the current networked ecosystems this potentially leads to natural monopolies.”
29 of 29

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • AI literacy has been increasingly framed as a precondition for lifelong learning and adaptive citizenship in a rapidly evolving technological environment.

    “From the standpoint of sustainable higher education, AI literacy has been increasingly framed as a precondition for lifelong learning and adaptive citizenship in a rapidly evolving technological environment [6,7,26].”

    From Toward Sustainable AI Literacy in Higher Education: A Delphi–AHP Approach to Identifying Key Components of AI/Data Extracurricular Programs (2026) · cites this paper as [26]

    The Introduction says AI literacy has received increasing attention in policy debates and describes a need for it in education. It does not frame AI literacy as a precondition for lifelong learning or adaptive citizenship. Section 3.1.11 discusses AI-assisted lifelong learning assistants, not AI literacy as a prerequisite for lifelong learning. (LLM, conf=0.85)

    Experimental — accuracy not yet measured
  • Studies demonstrate that AI can streamline administrative duties, generate personalized learning analytics, and support instructional planning.

    “These results align with studies that demonstrate how AI can streamline administrative duties, generate personalized learning analytics, and support instructional planning [15,17].”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Dialogue-based tutoring systems are classified as commercially available, then said to have no commercial examples

    Minor

    Table 1 defines three stars as commercially available and assigns that rating to dialogue-based tutoring systems. Section 3.1.9 says the authors could not identify any currently available commercial examples.

1 of 1

Cites

Flagged first, then by citations

Research works printed but not linked: 81

  1. AI HLEG, 2019, A definition of AI: Main capabilities and disciplines
  2. Aiken R. M., 2000, Ethical guidelines for AI in education: Starting a conversation, International Journal of Artificial Intelligence in Education, 11, 163
  3. Baker T., 2019, Educ‐AI‐tion rebooted? Exploring the future of artificial intelligence in schools and colleges
  4. Bush V., 1945, As we may think, Atlantic Monthly, 176, 101
  5. Chin M., 2020, Exam anxiety: How remote test‐proctoring is creeping students out, The Verge
  6. Clever Owl, 2022, Clever Owl
  7. Davydov V. V., 1982, Cognitive and motivational aspects of instruction
  8. Day E., 2021, Governance of data for children's learning in UK state schools
  9. Dillenbourg P., 2011, Computer Support for Collaborative Learning Conference. CSCL2011 Proceedings, 510
  10. Domoscio, 2022, Domoscio
  11. Drachsler H., 2016, Conference paper. Computer Support for Collaborative Learning Conference
  12. EC, 2018, Artificial intelligence for Europe. COM (2018) 237 final
  13. EC, 2021, Proposal for a regulation of the European Parliament and of the council laying down harmonised rules on artificial intelligence (artificial intelligence act) and amending certain union legislative acts. COM (2021) 206 final
  14. EC, 2022, Ethical guidelines on artificial intelligence (AI) and data usage in teaching and learning
  15. Egelandsdal K., 2019, Adaptiv læring i matematikk: Empirisk rapport om Multi Smart Øving i grunnskolen
  16. Engelbart D. C., 1963, Vistas in information handling, 1
  17. ETS, 2022, E‐rater scoring engine
  18. European Parliament, 2021, Artificial intelligence in education, culture and the audiovisual sector. 19 May 2021
  19. Gardner H., 1985, The Mind's new science: Cognitive revolution in the computer age
  20. GMI, 2022, AI in Education market size & share, growth forecast 2022–2030
  21. Google, 2022, Google Drive
  22. Gottschalk F., 2019, Impacts of technology use on children: exploring literature on the brain, cognition and well‐being
  23. GPT‐3, 2020, A robot wrote this entire article. Are you scared yet, human?, The Guardian
  24. Graide, 2022, Graide
  25. Grammarly, 2022, Grammarly: Free online writing assistant
  26. Grammarly, 2022, Plagiarism checker by grammarly
  27. Holmes W., 2022, Artificial intelligence and Education. A critical view through the lens of human rights, democracy, and the rule of law
  28. Holmes W., 2023, The ethics of AI in education. Practices, challenges, and debates
  29. Huawei, 2022, StorySign: Helping deaf children to learn to read
  30. Hussain A., 2017, Ada—Bolton College's latest digital assistant, Blogtext
  31. IBM, 2018, IBM Watson education classroom helps teachers deliver personalized learning that can improve student outcomes. Software announcement
  32. IOE (Director), 2018, Making fractions learning easier. Video
  33. Kelley J., 2021, A long overdue reckoning for online proctoring companies may finally Be here
  34. Krahulcova L., 2021, Techno solutionism—Very few things actually need to be an app
  35. LaPierre J., 2021, Educational games and AI
  36. LeCun Y., 2022, What AI can tell us about intelligence
  37. Lee K.‐F., 2021, AI 2041: Ten visions for our future
  38. Leetaru K., 2018, Does AI truly learn and why we need to stop overhyping deep learning, Forbes
  39. Lemoine B., 2022, Scientific data and religious opinions
  40. Lieu J., 2018, Eyes to the front camera: Chinese facial recognition tech targets inattentive students
  41. Marcus G., 2022, Artificial general intelligence is not as imminent as you might think, Scientific American
  42. Marcus G., 2020, GPT‐3, bloviator: OpenAI's language generator has no idea what it's talking about
  43. Metz C., 2021, Who is making sure the a.I. machines Aren't racist? Online article, The New York Times
  44. Moki, 2022, Moki—The fitness tracker for schools
  45. Moriarty‐Mclaughlin F., 2020, More colleges eye AI to track, monitor students
  46. NeuroMaker, 2022, NeuroMaker BCI
  47. OECD, 2019, Scoping the OECD AI principles: Deliberations of the expert group on artificial intelligence at the OECD (AIGO)
  48. OECD, 2019, Recommendation of the council on artificial intelligence
  49. OECD, 2020, Trustworthy artificial intelligence in Education
  50. Palmer M., 2006, Data is the new oil
  51. Pangburn D. J., 2019, Schools are using AI to help pick students. What could go wrong?
  52. Photomath, 2022, Photomath
  53. Plagiarism Checker X, 2022, Plagiarism Checker X
  54. Plato, Plato: Complete works
  55. Pressey S. L., 1926, A simple device for teaching, testing, and research in learning, School and Society, 23, 373
  56. Quach K., 2020, AI me to the Moon … Carbon footprint for ‘training GPT‐3’ same as driving to our natural satellite and back, The Register
  57. Salesforce, 2022, Salesforce.org
  58. SayHi, 2022, SayHi translate
  59. Sharples M., 2022, New AI tools that can write student essays require educators to rethink teaching and assessment
  60. Sparkes M., 2021, Why is Facebook ditching face recognition and will it delete my data?, New Scientist
  61. Sparkes M., 2022, Sentient AI: Has Google's LaMDA artificial intelligence really come to life?, New Scientist
  62. Statista, 2022, Total global AI investment 2015–2021
  63. Tencent, 2022, Tencent docs
  64. TikTok, 2022, TikTok—Make your day
  65. Tuomi I., 2020, The use of artificial intelligence (AI) in education
  66. Tuomi I., Proceedings of the 56th Hawaii International Conference on System Science. Maui, January 3‐6, 2023
  67. Turnitin, 2022, Turnitin
  68. UNESCO, 2021, Recommendation on the ethics of artificial intelligence
  69. UNICEF, 2021, Policy guidance on AI for children
  70. UNICEF, 2022, Trends in digital personalized learning in low‐ and middle‐income countries
  71. Vuorikari R., 2022, DigComp 2.2, the digital competence framework for citizens: With new examples of knowledge, skills and attitudes, 72
  72. Wall Street Journal, 2019, How China is using artificial intelligence in classrooms. Video
  73. Watters A., 2015, A brief history of calculators in the classroom
  74. WeChat, 2022, WeChat
  75. What Works Clearinghouse, 2016, Cognitive tutor®. What works clearinghouse intervention report
  76. WhatsApp, 2022, WhatsApp
  77. Williamson B., 2017, Big data in Education
  78. Williamson B., 2021, Google's plans to bring AI to education make its dominance in classrooms more alarming
  79. X5GON, 2022, X5GON
  80. XPRIZE, 2015, XPRIZE
  81. YouTube, 2022, YouTube

Cited by

Sorted by citations

Authors
Holmes, W., & Tuomi, I.
Affiliations
  • University College London (GB)
  • Meaning Processing (Finland) (FI)
Corresponding author
Holmes, Wayne
Venue
European Journal of Education
Publisher
Wiley
Published
2022-10-30
Volume
57
Issue
4
Pages
542-570
ISSN
  • 0141-8211 (ISSN-L)
  • 1465-3435
OpenAlex
W4307888124
Cited by
1,093
References
111
Citations by year
2026: 470 · 2025: 343 · 2024: 212 · 2023: 66 · 2022: 2
FWCI
154.40
Type
journal article
Language
en
Open access
Locations
  • European Journal of Education (publishedVersion, cc-by)
  • UCL Discovery (University College London) (submittedVersion)
Topics
  • Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
  • Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
Keywords
artificial intelligence in education, pedagogical assumptions, educational assumptions, functions of education

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-09.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-09.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review