Ethical and Responsible AI in Education: Situated Ethics for Democratic Learning
Open accessThe DOI matches its Crossref record; 36 of the 46 references it cites were found in a registry or an index.
Abstract
As AI systems increasingly structure educational processes, they shape not only what is learned, but also how epistemic authority is distributed and whose knowledge is recognized. This article explores the normative and technopolitical implications of this development by examining two prominent paradigms in AI ethics: Ethical AI and Responsible AI. Although often treated as synonymous, these frameworks reflect distinct tensions between formal universalism and contextual responsiveness, between rule-based evaluation and governance-oriented design. Drawing on deontology, utilitarianism, responsibility ethics, contract theory, and the capability approach, the article analyzes the frictions that emerge when these frameworks are applied to algorithmically mediated education. The argument situates these tensions within broader philosophical debates on technological mediation, normative infrastructures, and the ethics of sociotechnical design. Through empirical examples such as algorithmic grading and AI-mediated admissions, the article shows how predictive systems embed values into optimization routines, thereby reshaping educational space and interpretive agency. In response, it develops the concept of situated ethics, emphasizing epistemic justice, learner autonomy, and democratic judgment as central criteria for evaluating educational AI. To clarify what is at stake, the article distinguishes adaptive learning optimization from education as a process of subject formation and democratic teaching objectives. Rather than viewing AI as an external tool, the article conceptualizes it as a co-constitutive actor within pedagogical practice. Ethical reflection must therefore be integrated into design, implementation, and institutional contexts from the outset. Accordingly, the article offers (1) a conceptual map of ethical paradigms, (2) a criteria-based evaluative lens, and (3) a practice-oriented diagnostic framework to guide situated ethics in educational AI. The paper ultimately argues for an approach that attends to the relational, political, and epistemic dimensions of AI systems in education.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Situated Knowledges: The Science Question in Feminism and the Privilege of Partial Perspective
Haraway, D. (1988) · Feminist Studies · doi:10.2307/3178066 · Cited by 18,364
Hutchins, E. (1995) · doi:10.7551/mitpress/1881.001.0001 · Cited by 10,801
Meeting the Universe Halfway: Quantum Physics and the Entanglement of Matter and Meaning
Barad, K. (2006) · doi:10.2307/j.ctv12101zq · Cited by 10,472
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423
A Theory of Justice: Original Edition
Rawls, J. (1971) · doi:10.4159/9780674042605 · Cited by 9,496
Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-019-0171-0 · Cited by 7,242
Women and Human Development: The Capabilities Approach
Nussbaum, M. C. (2000) · Cambridge University Press · doi:10.1017/cbo9780511841286 · Cited by 6,103
Technology and the Lifeworld: From Garden to Earth
Ihde, D. (1990) · Indiana University Press eBooks · doi:10.2979/3108.0 · Cited by 1,546
Research works printed but not linked: 35
- Arendt, H. (1958). The human condition. University of Chicago Press.
- Baker, R. S., & Hawn, A. (2021). Algorithmic bias in education. Computers & Education: Artificial Intelligence, 2(1), 100025.
- Barocas, S., Hardt, M., & Narayanan, A. (2023). Fairness and machine learning: Limitations and opportunities. MIT Press. Available online: https://fairmlbook.org/pdf/fairmlbook.pdf (accessed on 30 October 2025).
- Bartok, L., Donner, M.-T., Ebner, M., Gosch, N., Handle-Pfeiffer, D., Hummel, S., Kriegler-Kastelic, G., Leitner, P., Tang, T., Veljanova, H., Winter, C., & Zwiauer, C. (2023). Learning analytics-Studierende im fokus. Zeitschrift für Hochschulentwicklung: ZFHE; Beiträge zu Studium, Wissenschaft und Beruf, 18, 223-250.
- Binns, R. (2018, February 23-24). Fairness in machine learning: Lessons from political philosophy. 2018 Conference on Fairness, Accountability, and Transparency (FAT) (pp. 149-159), New York, NY, USA. Available online: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3086546 (accessed on 27 September 2025).
- Code, L., Harding, S., & Hekman, S. (1993). What can she know? Feminist theory and the construction of knowledge. Hypatia, 8(3), 202-210.
- Dierksmeier, C. (2022). Partners, not parts. Enhanced autonomy through artificial intelligence? A Kantian perspective. In H. Kim, & D. Schönecker (Eds.), Kant and artificial intelligence (pp. 239-256).
- Donner, M.-T., & Hummel, S. (in press). Systematic literature review of AI-mediated mentoring in higher education. In H.-W. Wollersheim, T. Köhler, & N. Pinkwart (Eds.), Scalable mentoring in higher education. Technological approaches, teaching patterns and AI techniques. Springer VS.
- Egger, R. (2008). Biografie und Lebenswelt. Möglichkeiten und Grenzen der Biografie-und Lebensweltorientierung in der sozialen Arbeit. In J. Bakic, M. Diebäcker, & E. Hammer (Eds.), Aktuelle Leitbegriffe der sozialen Arbeit. Ein kritisches Handbuch (pp. 40-55). Löcker.
- Feenberg, A. (1999). Questioning technology. Routledge.
- Feyerabend, P. (1975). Against method: Outline of an anarchistic theory of knowledge. New Left Books. Available online: https://hdl.handle.net/11299/184649 (accessed on 5 September 2025).
- Floridi, L., & Cowls, J. (2019). A unified framework of five principles for AI in society. Harvard Data Science Review, 1(1), 1-14.
- Habermas, J. (2022). Theorie des kommunikativen Handelns. Band 1: Handlungsrationalität und gesellschaftliche Rationalisierung (12th ed.). Suhrkamp.
- Harding, S. (1991). Whose science? Whose knowledge? Thinking from women's lives. Cornell University Press. Available online: https://www.jstor.org/stable/10.7591/j.ctt1hhfnmg (accessed on 24 September 2025). · doi:10.7591/j.ctt1hhfnmg
- Heidegger, M. (1976). Brief über den "Humanismus". In F. W. von Hermann (Ed.), Gesamtausgabe (Vol. 9, pp. 365-383).
- Das Ge-Stell. In P. Jaeger (Ed.), Gesamtausgabe (Vol. 79, pp. 24-45).
- Hummel, S., & Donner, M.-T. (2023). KI-Anwendungen in der Hochschulbildung aus Studierendenperspektive. FNMA Magazin, 3, 38-41.
- Hummel, S., Donner, M.-T., Abbas, S. H., & Wadhwa, G. (2025a). Bildungstechnologie-Design von KI-gestützten Avataren zur Förderung selbstregulierten Lernens. In T. Köhler, E. Schopp, N. Kahnwald, & R. Sonntag (Eds.), Community in new media. Trust in crisis: Communication models in digital communities: Proceedings of 27th conference GeNeMe. TUDpress.
- Hummel, S., Donner, M.-T., & Egger, R. (in press). Turning tides in higher education? Exploring roles and didactic functions of the VISION AI mentor. In H.-W. Wollersheim, T. Köhler, & N. Pinkwart (Eds.), Scalable mentoring in higher education. Technological approaches, teaching patterns and AI techniques. Springer VS.
- Hummel, S., Donner, M.-T., Wadhwa, G., & Abbas, S. H. (2025b). Competency assessment in higher education through the lens of artificial intelligence: A systematic review. International Journal of Artificial Intelligence in Education, in press.
- Hummel, S., Wadhwa, G., Abbas, S. H., & Donner, M.-T. (2025c). AI-enhanced personalized learning in higher education: Tracing a path to tailored support. In T. Köhler, E. Schopp, N. Kahnwald, & R. Sonntag (Eds.), Community in new media. Trust in crisis: Communication models in digital communities: Proceedings of 27th conference GeNeMe. TUDpress.
- Klafki, W. (1996). Neue Studien zur Bildungstheorie und Didaktik: Zeitgemäße Allgemeinbildung und kritisch-konstruktive Didaktik (7th ed.).
- Latour, B. (1993). We have never been modern (C. Porter, Trans.). Harvard University Press.
- Luckin, R. (2018). Machine learning and human intelligence: The future of education for the 21st century. UCL Press.
- MacIntyre, A. (2007). After virtue (3rd ed.). Duckworth.
- Mbiti, J. S. (1969). African religions and philosophy (2nd ed.). Heinemann Publishers.
- Mill, J. S. (1987). Utilitarianism. In J. Gray (Ed.), The essential works of John Stuart Mill (pp. 272-338). Oxford University Press. (Original work published 1863)
- Rose, N. (2015). Powers of freedom: Reframing political thought. Cambridge University Press.
- Samek, W., Wiegand, T., & Müller, K. R. (2019). Explainable artificial intelligence: Understanding, visualizing and interpreting deep learning models. Digital Signal Processing, 93, 101-110.
- Scanlon, T. M. (1998). What we owe to each other. Harvard University Press.
- Selwyn, N. (2019). Should robots replace teachers? AI and the future of education. Polity Press.
- Sen, A. (1999). Development as freedom. Oxford University Press.
- Simondon, G. (2020). Individuation in light of notions of form and information. University of Minnesota Press.
- Spivak, G. C. (1988). Can the subaltern speak? In C. Nelson, & L. Grossberg (Eds.), Marxism and the interpretation of culture (pp. 271-313). University of Illinois Press.
- Thaler, R. H., & Sunstein, C. R. (2008). Nudge: Improving decisions about health, wealth, and happiness. Yale University Press.
Cited by
Triantari, S., & Tzimas, G. (2026) · Dia-noesis. · doi:10.12681/dia.45803 · Cited by 6
Aristotle and AI in Education: Virtue, Wisdom, Human Flourishing and the Common Good
Makrakis, V. (2026) · Encyclopedia · doi:10.3390/encyclopedia6060116 · Cited by 5
Williams, A. (2026) · Cogent Education · doi:10.1080/2331186x.2026.2698137 · Cited by 2
Erita, Y., Anggraeni, A., Amini, R., & Hevria, S. (2025) · Jurnal Penelitian Pendidikan IPA · doi:10.29303/jppipa.v11i12.13096 · Cited by 1
Alfiana, N., & Romadhon, M. G. E. (2026) · Journal of Language Sector · doi:10.69673/jolse.v2i1.223 · Cited by 1
Metadata
- Authors
- Hummel, S.
- Affiliations
- Center for Scalable Data Analytics and Artificial Intelligence (DE)
- Corresponding author
- Hummel, Sandra
- ORCID
- Hummel, Sandra
- Venue
- Education Sciences
- Publisher
- MDPI AG
- Published
- 2025-11-26
- Volume
- 15
- Issue
- 12
- Pages
- 1594
- ISSN
- 2227-7102 (ISSN-L)
- OpenAlex
- W4416691642
- Cited by
- 21
- References
- 35
- Citations by year
- 2026: 20 · 2025: 1
- FWCI
- 21.96
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Education Sciences (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Open Access Publication Fund of the SLUB/TU Dresden
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Education › Digital Education and Society
- Social Sciences › Education › Artificial Intelligence in Education
- Keywords
- AI ethics in education, responsible AI, ethical AI, situated ethics, epistemic justice, learner autonomy, democratic education, epistemic authority, algorithmic prediction, socio-technical design, adaptive learning, subjectivation, AI governance, capability approach, contract theory, ethics of responsibility
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.