CoChat

Ethical and Responsible AI in Education: Situated Ethics for Democratic Learning

Open access
Hummel, Sandra · 2025 · Education Sciences

The DOI matches its Crossref record; 36 of the 46 references it cites were found in a registry or an index.

Abstract

As AI systems increasingly structure educational processes, they shape not only what is learned, but also how epistemic authority is distributed and whose knowledge is recognized. This article explores the normative and technopolitical implications of this development by examining two prominent paradigms in AI ethics: Ethical AI and Responsible AI. Although often treated as synonymous, these frameworks reflect distinct tensions between formal universalism and contextual responsiveness, between rule-based evaluation and governance-oriented design. Drawing on deontology, utilitarianism, responsibility ethics, contract theory, and the capability approach, the article analyzes the frictions that emerge when these frameworks are applied to algorithmically mediated education. The argument situates these tensions within broader philosophical debates on technological mediation, normative infrastructures, and the ethics of sociotechnical design. Through empirical examples such as algorithmic grading and AI-mediated admissions, the article shows how predictive systems embed values into optimization routines, thereby reshaping educational space and interpretive agency. In response, it develops the concept of situated ethics, emphasizing epistemic justice, learner autonomy, and democratic judgment as central criteria for evaluating educational AI. To clarify what is at stake, the article distinguishes adaptive learning optimization from education as a process of subject formation and democratic teaching objectives. Rather than viewing AI as an external tool, the article conceptualizes it as a co-constitutive actor within pedagogical practice. Ethical reflection must therefore be integrated into design, implementation, and institutional contexts from the outset. Accordingly, the article offers (1) a conceptual map of ethical paradigms, (2) a criteria-based evaluative lens, and (3) a practice-oriented diagnostic framework to guide situated ethics in educational AI. The paper ultimately argues for an approach that attends to the relational, political, and epistemic dimensions of AI systems in education.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3390/educsci15121594

Cites

36 of 46 references verified0 citation errors · 10 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 46 references

Research works printed but not linked: 29

  1. Arendt, H. (1958). The human condition, University of Chicago Press.
  2. Baker, 2021, Algorithmic bias in education, Computers & Education: Artificial Intelligence, 2, 100025
  3. Barocas, S., Hardt, M., and Narayanan, A. (2023). Fairness and machine learning: Limitations and opportunities, MIT Press. Available online: https://fairmlbook.org/pdf/fairmlbook.pdf.
  4. Bartok, 2023, Learning analytics—Studierende im fokus, Zeitschrift für Hochschulentwicklung: ZFHE; Beiträge zu Studium, Wissenschaft und Beruf, 18, 223
  5. Binns, R. (, January February). Fairness in machine learning: Lessons from political philosophy. 2018 Conference on Fairness, Accountability, and Transparency (FAT), New York, NY, USA. Available online: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3086546.
  6. Code, 1993, What can she know? Feminist theory and the construction of knowledge, Hypatia, 8, 202
  7. Kim, H., and Schönecker, D. (2022). Partners, not parts. Enhanced autonomy through artificial intelligence? A Kantian perspective. Kant and artificial intelligence, De Gruyter.
  8. Wollersheim, H.-W., Köhler, T., and Pinkwart, N. (in press). Systematic literature review of AI-mediated mentoring in higher education. Scalable mentoring in higher education. Technological approaches, teaching patterns and AI techniques, Springer VS.
  9. Feenberg, A. (1999). Questioning technology, Routledge.
  10. Feyerabend, P. (1975). Against method: Outline of an anarchistic theory of knowledge, New Left Books. Available online: https://hdl.handle.net/11299/184649.
  11. Floridi, 2019, A unified framework of five principles for AI in society, Harvard Data Science Review, 1, 1
  12. Harding, S. (1991). Whose science? Whose knowledge? Thinking from women’s lives, Cornell University Press.. Available online: https://www.jstor.org/stable/10.7591/j.ctt1hhfnmg. · doi:10.7591/j.ctt1hhfnmg
  13. 1976, Brief über den „Humanismus”, Gesamtausgabe, Vol. 9, 365
  14. Jaeger, 2005, Das Ge-Stell, Gesamtausgabe, Vol. 79, 24
  15. Hummel, 2023, KI-Anwendungen in der Hochschulbildung aus Studierendenperspektive, FNMA Magazin, 3, 38
  16. Köhler, T., Schopp, E., Kahnwald, N., and Sonntag, R. (2025a). Bildungstechnologie-Design von KI-gestützten Avataren zur Förderung selbstregulierten Lernens. Community in new media. Trust in crisis: Communication models in digital communities: Proceedings of 27th conference GeNeMe, TUDpress.
  17. Wollersheim, H.-W., Köhler, T., and Pinkwart, N. (in press). Turning tides in higher education? Exploring roles and didactic functions of the VISION AI mentor. Scalable mentoring in higher education. Technological approaches, teaching patterns and AI techniques, Springer VS.
  18. Hummel, S., Donner, M.-T., Wadhwa, G., and Abbas, S. H. (2025b). Competency assessment in higher education through the lens of artificial intelligence: A systematic review. International Journal of Artificial Intelligence in Education, in press.
  19. Köhler, T., Schopp, E., Kahnwald, N., and Sonntag, R. (2025c). AI-enhanced personalized learning in higher education: Tracing a path to tailored support. Community in new media. Trust in crisis: Communication models in digital communities: Proceedings of 27th conference GeNeMe, TUDpress.
  20. Porter, C. (1993). We have never been modern, Harvard University Press.
  21. Luckin, R. (2018). Machine learning and human intelligence: The future of education for the 21st century, UCL Press.
  22. Gray, J. (1987). Utilitarianism. The essential works of John Stuart Mill, Oxford University Press. (Original work published 1863).
  23. Rose, N. (2015). Powers of freedom: Reframing political thought, Cambridge University Press.
  24. Scanlon, T. M. (1998). What we owe to each other, Harvard University Press.
  25. Selwyn, N. (2019). Should robots replace teachers? AI and the future of education, Polity Press.
  26. Sen, A. (1999). Development as freedom, Oxford University Press.
  27. Simondon, G. (2020). Individuation in light of notions of form and information, University of Minnesota Press.
  28. Nelson, C., and Grossberg, L. (1988). Can the subaltern speak?. Marxism and the interpretation of culture, University of Illinois Press.
  29. Thaler, R. H., and Sunstein, C. R. (2008). Nudge: Improving decisions about health, wealth, and happiness, Yale University Press.

Cited by

Metadata

Authors
Hummel, S.
Affiliations
Center for Scalable Data Analytics and Artificial Intelligence (DE)
Corresponding author
Hummel, Sandra
Venue
Education Sciences
Publisher
MDPI AG
Published
2025-11-26
Volume
15
Issue
12
Pages
1594
ISSN
2227-7102 (ISSN-L)
OpenAlex
W4416691642
Cited by
21
References
35
Citations by year
2026: 20 · 2025: 1
FWCI
21.96
Type
journal article
Language
en
Open access
Locations
  • Education Sciences (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
Open Access Publication Fund of the SLUB/TU Dresden
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
  • Social Sciences › Education › Digital Education and Society
  • Social Sciences › Education › Artificial Intelligence in Education
Keywords
AI ethics in education, responsible AI, ethical AI, situated ethics, epistemic justice, learner autonomy, democratic education, epistemic authority, algorithmic prediction, socio-technical design, adaptive learning, subjectivation, AI governance, capability approach, contract theory, ethics of responsibility

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.