Ethics of AI in Education: Towards a Community-Wide Framework
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
While Artificial Intelligence in Education (AIED) research has at its core the desire to support student learning, experience from other AI domains suggest that such ethical intentions are not by themselves sufficient. There is also the need to consider explicitly issues such as fairness, accountability, transparency, bias, autonomy, agency, and inclusion. At a more general level, there is also a need to differentiate between doing ethical things and doing things ethically , to understand and to make pedagogical choices that are ethical, and to account for the ever-present possibility of unintended consequences. However, addressing these and related questions is far from trivial. As a first step towards addressing this critical gap, we invited 60 of the AIED community’s leading researchers to respond to a survey of questions about ethics and the application of AI in educational contexts. In this paper, we first introduce issues around the ethics of AI in education. Next, we summarise the contributions of the 17 respondents, and discuss the complex issues that they raised. Specific outcomes include the recognition that most AIED researchers are not trained to tackle the emerging ethical questions. A well-designed framework for engaging with ethics of AIED that combined a multidisciplinary approach and a set of robust guidelines seems vital in this context.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Alongside the potential benefits of AI, negative perceptions such as job loss, ethical concerns, data privacy concerns, algorithmic bias, and reduced human interaction are also prevalent (Holmes et al., 2022;Tarafdar et al., 2023).”
From Development of the Artificial Intelligence Perception and Attitude Scale (AIPAS) (2025) · cites this paper as Holmes et al., 2022
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, the adoption of AIED has led to increasing ethical risks and concerns regarding several aspects such as personal data and learner autonomy.”
From Ethical principles for artificial intelligence in education (2023) · cites this paper as Holmes et al., 2021
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While AI has potential to revolutionize the education system, there are several concerns over its dangers [86].”
From New Era of Artificial Intelligence in Education: Towards a Sustainable Multifaceted Revolution (2023) · cites this paper as [86]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Moreover, the inconsistency and occasional inaccuracy of AI outputs, particularly in conceptually complex or creative tasks, highlight the need for human oversight and strong foundational knowledge (Holmes et al., 2022;Usher, 2025).”
From Integrating Generative AI into Programming Education: Student Perceptions and the Challenge of Correcting AI Errors (2025) · cites this paper as Holmes et al., 2022
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“This reinforces concerns about AI-amplified inequality [24].”
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220
Artificial intelligence in education : challenges and opportunities for sustainable development
Pedró, F., Subosa, M., Rivas, A., & Valverde, P. (2019) · MINISTERIO DE EDUCACIÓN · Cited by 2,426
Amazon Scraps Secret AI Recruiting Tool that Showed Bias against Women *
Dastin, J. (2022) · Ethics of Data and Analytics · doi:10.1201/9781003278290-44 · Cited by 1,165
Learning Analytics: Ethical Issues and Dilemmas
Slade, S., & Prinsloo, P. (2013) · American Behavioral Scientist · doi:10.1177/0002764213479366 · Cited by 1,078
(2019) · Open Research Online (The Open University) · Cited by 1,004
Self-citationTranslating Principles into Practices of Digital Ethics: Five Risks of Being Unethical
Floridi, L. (2019) · Philosophy & Technology · doi:10.1007/s13347-019-00354-x · Cited by 524 · cited 1×
“The ethics of artificial intelligence in general has received a great deal of attention, by researchers (e.g., Boddington 2017; Floridi 2019; Jobin et al. 2019; Whittaker et al. 2018; Winfield and Jirotka 2018) All of these efforts principally focus on data (involving issues such as informed…”
BackgroundEthical governance is essential to building trust in robotics and artificial intelligence systems
Winfield, A. F. T., & Jirotka, M. (2018) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2018.0085 · Cited by 493
Privacy and analytics: it's a DELICATE issue a checklist for trusted learning analytics
Drachsler, H., & Greller, W. (2016) · Proceedings of the Sixth International Conference on Learning Analytics & Knowledge - LAK '16 · doi:10.1145/2883851.2883893 · Cited by 367 · cited 1×
“…is genuinely informed and freely given, ensuring that data is truly anonymised, establishing and implementing procedures to guarantee individual privacy, and adopting clear and transparent obligations with any external agencies that might be involved with the data (Drachsler and Greller 2016).”
BackgroundThe global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000375277 · Cited by 360
Towards a Code of Ethics for Artificial Intelligence
Boddington, P. (2017) · Artificial Intelligence: Foundations, Theory, and Algorithms · doi:10.1007/978-3-319-60648-4 · Cited by 294 · cited 2×
“1): the ethics of data in AI in general (which is, as discussed, an ongoing focus of much research; e.g., Boddington 2017), the ethics of data in education (also an ongoing focus; e.g., Ferguson et al. 2016), and the ethics of algorithms applied in educational contexts.”
BackgroundFrom ethics washing to ethics bashing: a view on tech ethics from within moral philosophy
Bietti, E. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372860 · Cited by 261
Human-Centred Learning Analytics
Buckingham Shum, S., Ferguson, R., & Martinez-Maldonado, R. (2019) · Journal of Learning Analytics · doi:10.18608/jla.2019.62.1 · Cited by 258
Self-citationShould we welcome robot teachers?
Sharkey, A. J. C. (2016) · Ethics and Information Technology · doi:10.1007/s10676-016-9387-z · Cited by 249 · cited 1×
“…other AI research subdomains, and with ethical questions specific to the AIED subdomain itself (e.g., issues around pedagogy), many of which remain unasked and unanswered (although there are some exceptions - e.g., Aiken and Epstein 2000; Friedman and Kahn 1992; Holmes et al. 2019b; Sharkey 2016).”
BackgroundMurtarelli, G., Gregory, A., & Romenti, S. (2021) · Journal of Business Research · doi:10.1016/j.jbusres.2020.09.018 · Cited by 209 · cited 1×
“Finally, researchers and developers of intelligent agents such as chatbots are also increasingly focusing on the ethical issues raised by their work (e.g., Murtarelli et al. 2020; Richards and Dignum 2019).”
BackgroundHolstein, K., McLaren, B. M., & Aleven, V. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-23204-7_14 · Cited by 189 · cited 2×
“In addition, there remains limited research into what teachers and students actually want from AIED systems such as requirements around student agency and privacy about which teachers and students might not agree (Holstein et al. 2019).”
BackgroundSelf-citationKobsa, A. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-72079-9_4 · Cited by 188
Privacy-Enhanced Web Personalization
Kobsa, A. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-72079-9_21 · Cited by 184 · cited 1×
“For example, in the user modeling community, issues centred on security and privacy (e.g., Schreck 2003), inspectability (e.g., Zapata-Rivera and Greer 2004), and privacy (e.g., Kobsa 2007) have long been considered.”
BackgroundResearch Evidence on the Use of Learning Analytics: Implications for Education Policy
Ferguson, R., Andrew Brasher, A., Clow, D., Adam, C., Hillaire, G., Mittelmeier, J., Rienties, B., Ullmann, T., & Riina, V. (2016) · Research Explorer (The University of Manchester) · doi:10.2791/955210 · Cited by 179 · cited 3×
“Similarly, the ethics of educational data and learning analytics has also been the focus of much research (e.g., Ferguson et al. 2016; Slade and Prinsloo 2013; Potgieter 2020).”
BackgroundBull, S., & Kay, J. (2016) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-015-0090-8 · Cited by 164
Human agency and responsible computing: Implications for computer system design
Friedman, B., & Kahn, P. H. (1992) · Journal of Systems and Software · doi:10.1016/0164-1212(92)90075-u · Cited by 123
Interacting with Inspectable Bayesian Student Models
Zapata‐Rivera, D., & Greer, J. E. (2004) · doi:10.5555/1434858.1434859 · Cited by 119
Macfarlane, B. (2004) · ePrints Soton (University of Southampton) · doi:10.4324/9780203416501 · Cited by 118 · cited 1×
“Yet, while the ethics of education has been the focus of debate and research for more than 2000 years (e.g., Aristotle 2009; Macfarlane 2003; Peters 1970), it is mostly unacknowledged and unaccounted for by the wider AIED community.”
BackgroundPorayska‐Pomsta, K., & Rajendran, G. (2019) · Perspectives on rethinking and reforming education · doi:10.1007/978-981-13-8161-4_3 · Cited by 86
Self-citationEthical issues in online education
Anderson, B., & Simpson, M. L. (2007) · Open Learning The Journal of Open Distance and e-Learning · doi:10.1080/02680510701306673 · Cited by 75
Mitigating Demographic Bias in AI-based Resume Filtering
Deshpande, K. V., Pan, S., & Foulds, J. R. (2020) · Adjunct Publication of the 28th ACM Conference on User Modeling, Adaptation and Personalization · doi:10.1145/3386392.3399569 · Cited by 67 · cited 1×
“Most recently, dedicated workshops have been held at leading conferences (e.g., FairUMAP, Mobasher et al. 2020), with contributions exploring issues such as fairness (Sacharidis et al. 2020), transparency (Schelenz et al. 2020), and biases (Deshpande et al. 2020).”
BackgroundWeb accessibility standards and disability: developing critical perspectives on accessibility
Lewthwaite, S. (2014) · Disability and Rehabilitation · doi:10.3109/09638288.2014.938178 · Cited by 66
Richards, D., & Dignum, V. (2019) · British Journal of Educational Technology · doi:10.1111/bjet.12863 · Cited by 58
Facilitating Trust in Privacy-Preserving E-Learning Environments
Anwar, M., & Greer, J. (2012) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2011.23 · Cited by 56
Security and Privacy in User Modeling
Schreck, J. (2003) · Human-computer interaction series · doi:10.1007/978-94-017-0377-2 · Cited by 51 · cited 1×
“For example, in the user modeling community, issues centred on security and privacy (e.g., Schreck 2003), inspectability (e.g., Zapata-Rivera and Greer 2004), and privacy (e.g., Kobsa 2007) have long been considered.”
BackgroundAI in Education needs interpretable machine learning: Lessons from Open Learner Modelling
Conati, C., Porayska‐Pomsta, K., & Mavrikis, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.00154 · Cited by 50 · cited 1×
“For example, questions around data ownership and control over their interpretations have long been recognised as critical in AIED (e.g., in the context of open learner modelling: Bull and Kay 2016; Conati et al. 2018).”
BackgroundSelf-citationMarnau, N. (2019) · Figshare · doi:10.60882/cispa.24612372 · Cited by 47
Barana, A., Di, L., Fioravera, M., Marchisio, M., & Rabellino, S. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93846-2 · Cited by 45
What can we learn from the Facebook—Cambridge Analytica Scandal?
Tarran, B. (2018) · Significance · doi:10.1111/j.1740-9713.2018.01139.x · Cited by 33 · cited 1×
“…data scandal showed, data is vulnerable to hacking and manipulation: ‘ it ’ s impossible to have personal privacy and control at scale, so it is critical that the uses to which data will be put are ethical – and that the ethical guidelines are clearly understood ’ (Tarran 2018, pp. 4 – 5).”
BackgroundFairness and Diversity in Social-Based Recommender Systems
Sacharidis, D., Mukamakuza, C. P., & Werthner, H. (2020) · Adjunct Publication of the 28th ACM Conference on User Modeling, Adaptation and Personalization · doi:10.1145/3386392.3397603 · Cited by 32 · cited 1×
“Most recently, dedicated workshops have been held at leading conferences (e.g., FairUMAP, Mobasher et al. 2020), with contributions exploring issues such as fairness (Sacharidis et al. 2020), transparency (Schelenz et al. 2020), and biases (Deshpande et al. 2020).”
BackgroundAnalysis of Student Behaviour in Habitable Worlds Using Continuous\n Representation Visualization
Pardos, Z. A., & Horodyskyj, L. (2017) · eScholarship (California Digital Library) · Cited by 30
(2019) · Lecture notes in computer science · doi:10.1007/978-3-030-23204-7 · Cited by 29
Analyzing the relationships between learning analytics, educational data mining and AI for education
Labarthe, H., Luengo, V., & Bouchet, F. (2018) · HAL · Cited by 25
Best Practices for Transparency in Machine Generated Personalization
Schelenz, L., Segal, A., & Gal, K. (2020) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3386392.3397593 · Cited by 22 · cited 1×
“Most recently, dedicated workshops have been held at leading conferences (e.g., FairUMAP, Mobasher et al. 2020), with contributions exploring issues such as fairness (Sacharidis et al. 2020), transparency (Schelenz et al. 2020), and biases (Deshpande et al. 2020).”
BackgroundPrivacy concerns in educational data mining and learning analytics
Potgieter, I. (2020) · The International Review of Information Ethics · doi:10.29173/irie384 · Cited by 17 · cited 2×
“Similarly, the ethics of educational data and learning analytics has also been the focus of much research (e.g., Ferguson et al. 2016; Slade and Prinsloo 2013; Potgieter 2020).”
BackgroundHolmes, W., Bektik, D., Whitelock, D. M., & Woolf, B. P. (2018) · Open Research Online (The Open University) · Cited by 8
Self-citationGearhart, D. (2012) · International Journal of Technoethics · doi:10.4018/jte.2012100103 · Cited by 6 · cited 1×
“However, it is notable that other researchers in e-learning appear more interested in the ethical practices of the students, such as cheating and fraud (e.g., Gearhart 2012).”
BackgroundJustice Department wants Citizenship Question for 2020 Census
Tarran, B. (2018) · Significance · doi:10.1111/j.1740-9713.2018.01100.x · Cited by 6 · cited 1×
“…data scandal showed, data is vulnerable to hacking and manipulation: ‘ it ’ s impossible to have personal privacy and control at scale, so it is critical that the uses to which data will be put are ethical – and that the ethical guidelines are clearly understood ’ (Tarran 2018, pp. 4 – 5).”
BackgroundFairUMAP 2020: The 3rd Workshop on Fairness in User Modeling, Adaptation and Personalization
Mobasher, B., Kleanthous, S., Ekstrand, M. D., Berendt, B., Otterbacher, J., & Tal, A. S. (2020) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3340631.3398671 · Cited by 4 · cited 1×
“Most recently, dedicated workshops have been held at leading conferences (e.g., FairUMAP, Mobasher et al. 2020), with contributions exploring issues such as fairness (Sacharidis et al. 2020), transparency (Schelenz et al. 2020), and biases (Deshpande et al. 2020).”
Background
Research works printed but not linked: 3
- Aiken, 2000, Ethical guidelines for AI in education: Starting a conversation, International Journal of Artificial Intelligence in Education, 11, 163
- Aristotle. (2009). The Nicomachean Ethics n/e. Brown, L. (ed.) Ross, D. (Trans.) (Revised edition). OUP Oxford.
- World Economic Forum. (2019). Generation AI. May 2019 Workshop Report.http://www3.weforum.org/docs/WEF_Generation_AI_%20May_2019_Workshop_Report.pdf
Cited by
Ethical principles for artificial intelligence in education
Nguyen, A., Ngo, H. N., Hong, Y., Dang, B., & Nguyen, B.-P. T. (2023) · Education and Information Technologies · doi:10.1007/s10639-022-11316-w · Cited by 1,228
“…ethical implications and privacy risks which call for critical attention to differentiate between doing ethical things and doing things ethically (Holmes et al., 2021 ), or as in the words of Russell and Norvig ( 2002 ) “all AI researchers should be concerned with the ethical implications of…”
BackgroundInfluentialNew Era of Artificial Intelligence in Education: Towards a Sustainable Multifaceted Revolution
Kamalov, F., Santandreu Calonge, D., & Gurrib, I. (2023) · Sustainability · doi:10.3390/su151612451 · Cited by 1,089
“However, very few schemes currently exist for the specific issues raised by AI in education [86], except maybe the European Commission Ethics guidelines for trustworthy AI [17] and the forthcoming UNESCO IESALC Manual on AI in Higher Education.”
BackgroundState of the art and practice in AI in education
Holmes, W., & Tuomi, I. (2022) · European Journal of Education · doi:10.1111/ejed.12533 · Cited by 1,093
Self-citationCelik, I. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107468 · Cited by 1,012
Explainable Artificial Intelligence in education
Khosravi, H., Shum, S. B., Chen, G., Conati, C., Tsai, Y.-S., Kay, J., Knight, S., Martinez-Maldonado, R., Sadiq, S., & Gašević, D. (2022) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100074 · Cited by 863
Self-citation
Metadata
- Authors
- Holmes, W., Porayska-Pomsta, K., Holstein, K., Sutherland, E., Baker, T., Shum, S. B., Santos, O. C., Rodrigo, M. T., Cukurova, M., Bittencourt, I. I., & Koedinger, K. R.
- Affiliations
- University College London (GB)
- Nesta (GB)
- University of Technology Sydney (AU)
- Universidad Nacional de Educación a Distancia (ES)
- Universidade Federal de Alagoas (BR)
- Carnegie Mellon University (US)
- Corresponding author
- Holmes, Wayne
- ORCID
- Venue
- International Journal of Artificial Intelligence in Education
- Publisher
- Elsevier BV
- Published
- 2022-09
- Volume
- 32
- Issue
- 3
- Pages
- 504-526
- ISSN
- 1560-4292 (ISSN-L)
- OpenAlex
- W3155263273
- Semantic Scholar
- cfaea43aec271372091aadbc65f089ca67cac8d5
- Cited by
- 1,437
- References
- 43
- Citations by year
- 2026: 591 · 2025: 410 · 2024: 255 · 2023: 125 · 2022: 42
- FWCI
- 136.74
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- creativecommons.org/licenses/by-nc-nd/4.0/ (vor, 1329 d)
- Locations
- International Journal of Artificial Intelligence in Education (publishedVersion, cc-by)
- UCL Discovery (University College London) (submittedVersion)
- Greater South Information System
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Education › Artificial Intelligence in Education
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Keywords
- artificial intelligence in education, ethical frameworks, fairness, accountability, transparency, algorithmic bias, student independence, inclusion, unintended consequences, research ethics training, moral norms
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.