The DOI matches its Crossref record; 124 of the 124 references it cites were found in a registry or an index.
Artificial Moral Agents: A Survey of the Current Status
Abstract
One of the objectives in the field of artificial intelligence for some decades has been the development of artificial agents capable of coexisting in harmony with people and other systems. The computing research community has made efforts to design artificial agents capable of doing tasks the way people do, tasks requiring cognitive mechanisms such as planning, decision-making, and learning. The application domains of such software agents are evident nowadays. Humans are experiencing the inclusion of artificial agents in their environment as unmanned vehicles, intelligent houses, and humanoid robots capable of caring for people. In this context, research in the field of machine ethics has become more than a hot topic. Machine ethics focuses on developing ethical mechanisms for artificial agents to be capable of engaging in moral behavior. However, there are still crucial challenges in the development of truly Artificial Moral Agents. This paper aims to show the current status of Artificial Moral Agents by analyzing models proposed over the past two decades. As a result of this review, a taxonomy to classify Artificial Moral Agents according to the strategies and criteria used to deal with ethical problems is proposed. The presented review aims to illustrate (1) the complexity of designing and developing ethical mechanisms for this type of agent, and (2) that there is a long way to go (from a technological perspective) before this type of artificial agent can replace human judgment in difficult, surprising or ambiguous moral situations.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“These capacities also presuppose additional capacities, such as consciousness, self-awareness, personal memory, perception, general intelligence, and emotions [46, 95, 213].”
From The ethics of using artificial intelligence in scientific research: new guidance needed for a new tool (2025) · cites this paper as [46]
In the citing paper
“While the concept of moral agency, like the concept of consciousness, is controversial, there is general agreement that moral agency requires the capacity to perform intentional (or purposeful) actions, understand moral norms, and make decisions based on moral norms.”
From The ethics of using artificial intelligence in scientific research: new guidance needed for a new tool (2025) · cites this paper as [46]
Citations
Cites
An fMRI Investigation of Emotional Engagement in Moral Judgment
Greene, J. D., Sommerville, R. B., Nystrom, L. E., Darley, J. M., & Cohen, J. D. (2001) · Science · doi:10.1126/science.1062872 · Cited by 4,561
Batty, M., Axhausen, K. W., Giannotti, F., Pozdnoukhov, A., Bazzani, A., Wachowicz, M., Ouzounis, G., & Portugali, Y. (2012) · The European Physical Journal Special Topics · doi:10.1140/epjst/e2012-01703-3 · Cited by 2,424
A Contingency Framework for Understanding Ethical Decision Making in Marketing
Ferrell, O., & Gresham, L. (1985) · Journal of Marketing · doi:10.1177/002224298504900308 · Cited by 1,967
Internet of Things: Applications and Challenges in Technology and Standardization
Bandyopadhyay, D., & Sen, J. (2011) · Wireless Personal Communications · doi:10.1007/s11277-011-0288-5 · Cited by 1,603
Neuroscience-Inspired Artificial Intelligence
Hassabis, D., Kumaran, D., Summerfield, C., & Botvinick, M. (2017) · Neuron · doi:10.1016/j.neuron.2017.06.011 · Cited by 1,557
Wang, S., Wan, J., Zhang, D., Li, D., & Zhang, C. (2016) · Computer Networks · doi:10.1016/j.comnet.2015.12.017 · Cited by 1,408
Cognitive load selectively interferes with utilitarian moral judgment
Greene, J. D., Morelli, S. A., Lowenberg, K., Nystrom, L. E., & Cohen, J. D. (2008) · Cognition · doi:10.1016/j.cognition.2007.11.004 · Cited by 1,231
Feil-Seifer, D., & Matarić, M. J. (2005) · International Conference on Rehabilitation Robotics · doi:10.1109/icorr.2005.1501143 · Cited by 1,048
Granny and the robots: ethical issues in robot care for the elderly
Sharkey, A., & Sharkey, N. (2012) · Ethics and Information Technology · doi:10.1007/s10676-010-9234-6 · Cited by 985
Universal moral grammar: theory, evidence and the future
Mikhail, J. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.12.007 · Cited by 923
Research works printed but not linked: 2
- Arkoudas, K., Bringsjord, S., & Bello, P. (2005). Toward ethical robots via mechanized deontic logic. In AAAI Fall symposium on machine ethics (pp. 17–23).
- Govindarajulu, N. S., Bringjsord, S., & Ghosh, R. (2018). One formalization of virtue ethics via learning. arXiv preprint arXiv:180507797.
Cited by
Sorted by citations
Items 101–151 of 151
ChatGPT: Hilfe bei der medizinethischen Entscheidungsfindung?
Schmidt, K. W., & Lechner, F. (2024) · Die Anaesthesiologie · doi:10.1007/s00101-024-01385-6 · Cited by 2
Can’t Bottom-up Artificial Moral Agents Make Moral Judgements?
Boyles, R. J. M. (2024) · Filosofija Sociologija · doi:10.6001/fil-soc.2024.35.1.3 · Cited by 2
Rosmawati, A., Abunimye, P. I., & Obuchi, S. M. (2024) · Journal of Social Knowledge Education (JSKE) · doi:10.37251/jske.v5i1.890 · Cited by 2
The Use of AI in Personalized Marketing: Balancing Benefits and Privacy Concerns
Yadav, M., Kumar, A., & Jha, R. (2024) · International Journal of Advanced Research in Science Communication and Technology · doi:10.48175/ijarsct-17823 · Cited by 2
Manipulating Aggregate Societal values to Bias AI Social Choice Ethics
Baum, S. D. (2024) · AI and Ethics · doi:10.1007/s43681-024-00495-6 · Cited by 3
Philosophical grounds for regulating the lawful operation of autonomous vehicles
Kasap, A. (2025) · International Review of Law Computers & Technology · doi:10.1080/13600869.2025.2506312 · Cited by 2
Pinkert, L. A., Beever, J., Kuebler, S., Taylor, L. E., Vazquez, E., & Milanes, V. (2024) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--42341 · Cited by 2
Perspective-Dependent Value Alignment of Norms
Montes, N., Osman, N., & Carles Sierra, A. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-58202-8_4 · Cited by 2
The ethical shortlisting problem
Erdoğan, G. (2021) · Computers & Operations Research · doi:10.1016/j.cor.2021.105593 · Cited by 2
Antipov, A. V. (2024) · Concept philosophy religion culture · doi:10.24833/2541-8831-2024-2-30-8-21 · Cited by 1
Ethical Alignment in Citizen-Centric AI
Deshmukh, J., Yazdanpanah, V., Stein, S., & Norman, T. J. (2024) · Lecture notes in computer science · doi:10.1007/978-981-96-0128-8_4 · Cited by 1
Smuha, N. A. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009367783.002 · Cited by 1
A Case for End-Constrained Ethical Artificial Intelligence
Cook, T. (2025) · Science and Engineering Ethics · doi:10.1007/s11948-025-00577-6 · Cited by 1
Korzyński, P., Wojtczuk‐Turek, A., Turek, D., Meglio, O., & Zabicka-Wlodarczyk, M. (2026) · Journal of Change Management · doi:10.1080/14697017.2026.2719997 · Cited by 1
Civil Liability Regime for Artificial Intelligence in Indonesia: Become a Future Legal Subject?
Pratama, A. M., & Kharisma, D. B. (2022) · doi:10.2991/978-2-494069-75-6_30 · Cited by 1
A Partially Synthesized Position on the Automation of Machine Ethics
Nallur, V., Dennis, L. A., Bringsjord, S., & Govindarajulu, N. S. (2023) · Digital Society · doi:10.1007/s44206-023-00040-8 · Cited by 1
A qualified defense of top-down approaches in machine ethics
Cook, T. (2023) · AI & Society · doi:10.1007/s00146-023-01820-z · Cited by 1
Sharadin, N. (2024) · AI & Society · doi:10.1007/s00146-024-01926-y · Cited by 1
Moral Expertise and Socratic AI
Gordon, E. C. (2024) · doi:10.1093/oso/9780198877301.003.0013 · Cited by 1
Ethics, Culture, and Values Impacted by Human–Robot Interactions
Barfield, W., Weng, Y.-H., & Pagallo, U. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009386708.024 · Cited by 1
Schlögl-Flierl, K., & Ziethmann, P. (2025) · Magdeburger Forschungen zu Bildungs-, Kultur- und Sozialwissenschaften · doi:10.1007/978-3-658-46631-2_3 · Cited by 2
Künstliche Intelligenz in der Ethik?
Salloch, S. (2023) · Ethik in der Medizin · doi:10.1007/s00481-023-00779-1 · Cited by 1
Misselhorn, C. (2025) · Wiley eBooks · doi:10.1002/9781394238651.ch29 · Cited by 1
Digital Me Ontology and Ethics
Kocarev, L., & Koteska, J. (2022) · Futures of Education Culture and Nature - Learning to Become · doi:10.7146/fecun.v1i.130229 · Cited by 15
Measuring a Texts Fairness Dimensions Using Machine Learning Based on Social Psychological FactorsPreprint
Izzidien, A., & Stillwell, D. J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.00086 · Cited by 1
Grasping the Shape of Ethical Dilemmas: Towards an Educational Dilemma Generator
Casas-Roma, J., & Conesa, J. (2021) · Lecture notes in networks and systems · doi:10.1007/978-3-030-90677-1_33
Ethical education and artificial intelligence
(2020) · International Journal of Development Research · doi:10.37118/ijdr.20604.12.2020
ETHOSCHOOL: An Artificial Moral Agent Model for Collaborative Learning
Córdova, P. R., Filho, I. P. D. S., Guedes, G. T. A., & Vicari, R. M. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-32883-1_24
Machines and morality: juridical and philosophical considerations
Fornasier, M. D. O. (2022) · Revista Brasileira de Estudos Políticos · doi:10.9732/2022.v125.882
I’m Not Like the Others, I’m Your Friend
Nallur, V., & Bell, K. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009386708.033
Polak, P. J. (2024) · Studies in Logic Grammar and Rhetoric · doi:10.2478/slgr-2024-0021
Malle, B. F., & Robbins, P. (2025) · Cambridge University Press eBooks · doi:10.1017/9781108894357.002
Context Matters: Contextual Value-Based Deliberation in Water Consumption Scenarios
Oliva-Felipe, L., Lobo, I., McKinlay, J., Dignum, F. P. M., Vos, M. D., Cortés, U., & Cortés, À. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-85463-7_13
Responsibility in Multi-Step Decision Schemes
Shi, Q., & Naumov, P. (2025) · Journal of Philosophical Logic · doi:10.1007/s10992-025-09794-7
Zeng, J., & van Es, K. F. (2025) · Amsterdam University Press eBooks · doi:10.1515/9789048562725-014
Boyles, R. J. M. (2025) · Philosophia International Journal of Philosophy · doi:10.46992/pijp.26.2.a.3
Benzinger, L., Epping, J., Ursin, F., & Salloch, S. (2024) · Figshare · doi:10.6084/m9.figshare.26333205
Sharko, P. A., Burlutskaya, Z., Gintciak, A., Beketov, S. M., & Lundaeva, K. A. (2025) · Sustainability · doi:10.3390/su172411130
Against AI ethics: challenging the conventional narratives
Afroogh, S., Pouresmaeil, Y., & Dhurandhar, A. (2026) · AI and Ethics · doi:10.1007/s43681-025-00978-0
Krah, M., & Tröschel, M. (2026) · AI and Ethics · doi:10.1007/s43681-025-00971-7 · Cited by 2
Lozano, J. F. (2026) · Science and Engineering Ethics · doi:10.1007/s11948-026-00603-1
Rethinking the Red lines Against AI Existential Risks
Zeng, Y., Guan, X., Lu, E., & Fan, J. (2026) · Springer eBooks · doi:10.1007/978-3-032-11814-1_5
A Conceptual Framework for Artificial Moral Agents Based on the Standard Model of Mind
Ghazali, F., Banirostam, T., & Pedram, M. M. (2026) · International Biennial Conference on Advances in Artificial Intelligence and Data Science (IBAAIDS) · doi:10.1109/ibaaids66771.2026.11567418
Pathways, Limitations, and Future Directions for Embedding Values in Large Models
Zhou, Y., & Teng, Y. (2026) · Philosophy of engineering and technology · doi:10.1007/978-981-95-8023-1_21
Toward an internal moral purpose like normative governance function in artificial agency
Keleş, S. (2026) · AI and Ethics · doi:10.1007/s43681-026-01268-z
Amodio, C., & Diurni, A. (2025) · Springer eBooks · doi:10.1007/978-3-031-93247-2_1
Kim, C., & Ahn, S. (2026) · Journal of Intelligence · doi:10.3390/jintelligence14090212
Davidian, M., Mazliah, D., Slovin, G., Joshua, B., Lurie, Y., & Mark, S. (2026) · Software · doi:10.3390/software5030039
Modeling the Social and Normative Context of Human–Agent Interactions
Vázquez, M., Güneş, H., Williams, T., & Jackson, R. B. (2026) · Cambridge University Press eBooks · doi:10.1017/9781108872225.013
Fiebrink, R., Gillies, M. F. P., & Ramos, G. (2026) · Cambridge University Press eBooks · doi:10.1017/9781108872225.010
Limitations of Computational Morality: Can We Morally Enhance Ourselves via AI?
Richter, F. (2026) · Science and Engineering Ethics · doi:10.1007/s11948-026-00634-8
Metadata
- Authors
- Cervantes, J.-A., López, S., Rodríguez, L.-F., Cervantes, S., Cervantes, F., & Ramos, F.
- Affiliations
- Universidad de Guadalajara (MX)
- Sonora Institute of Technology (MX)
- Instituto Tecnológico y de Estudios Superiores de Occidente (MX)
- Centro de Investigación y de Estudios Avanzados del Instituto Politécnico Nacional (MX)
- Corresponding author
- Cervantes, José-Antonio
- ORCID
- Venue
- Science and Engineering Ethics
- Published
- 2019-11-12
- Volume
- 26
- Issue
- 2
- Pages
- 501-532
- ISSN
- 1353-3452 (ISSN-L)
- 1471-5546
- OpenAlex
- W2989113827
- Cited by
- 151
- References
- 124
- Citations by year
- 2026: 15 · 2025: 34 · 2024: 37 · 2023: 16 · 2022: 20 · 2021: 22 · 2020: 7
- FWCI
- 3.25
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science and Engineering Ethics (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Ethics in Business and Education
- Social Sciences › Arts and Humanities › Philosophy › Philosophical Ethics and Theory
- Keywords
- artificial moral agents, machine ethics, moral behavior, autonomous agents, human-robot interaction, decision-making, planning, learning, humanoid robots, unmanned vehicles, intelligent house
- MeSH terms
- Artificial Intelligence, Humans, Judgment, Morals, Surveys and Questionnaires, Software
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review