The DOI matches its Crossref record; 22 of the 23 references it cites were found in a registry or an index.
Prolegomena to any future artificial moral agent
Abstract
As artificial intelligence moves ever closer to the goal of producing fully autonomous agents, the question of how to design and implement an artificial moral agent (AMA) becomes increasingly pressing. Robots possessing autonomous capacities to do things that are useful to humans will also have the capacity to do things that are harmful to humans and other sentient beings. Theoretical challenges to developing artificial moral agents result both from controversies among ethicists about moral theory itself, and from computational limits to the implementation of such theories. In this paper the ethical disputes are surveyed, the possibility of a ‘moral Turing Test’ is considered and the computational difficulties accompanying the different types of approach are assessed. Human-like performance, which is prone to include immoral actions, may not be acceptable in machines, but moral perfection may be computationally unattainable. The risks posed by autonomous machines ignorantly or deliberately harming people and other sentient beings are great. The development of machines with enough intelligence to assess the effects of their actions on sentient beings and act accordingly may ultimately be the most important task faced by the designers of artificially intelligent automata.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“but this will require more coordinated and sophisticated approaches (Allen et al. 2000) to translating ethical principles into design protocols (Turilli 2007).”
From From What to How: An Initial Review of Publicly Available AI Ethics Tools, Methods and Research to Translate Principles into Practices (2020) · cites this paper as Allen et al. 2000
Citations
Cites
Axelrod, R., & Hamilton, W. D. (1981) · Science · doi:10.1126/science.7466396 · Cited by 20,065
(1976) · Cited by 10,423
I.—COMPUTING MACHINERY AND INTELLIGENCE
TURING, A. M. (1950) · Mind · doi:10.1093/mind/lix.236.433 · Cited by 10,290
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
An Introduction to the Principles of Morals and Legislation
de Champs, E. (2017) · HAL · Cited by 6,669
Computing Machinery and Intelligence (1950)
Turing, A. (2004) · The Essential Turing · doi:10.1093/oso/9780198250791.003.0017 · Cited by 6,118
(1986) · Cited by 3,616
Groundwork of The Metaphysic of Morals
Kant, I. (2020) · Immanuel Kant: Groundwork of the Metaphysic of Morals in focus · doi:10.4324/9780203714805-2 · Cited by 3,280
Moral Thinking: Its Levels, Method, and Point
Hare, R. M. (1981) · doi:10.1093/0198246609.001.0001 · Cited by 1,904
The psychology of moral development
Kohlberg, L. (1984) · Cited by 1,806
Research works printed but not linked: 6
- Coleman, K. Android Arete: virtue ethics for computational agents. Paper presented at the 14th Annual Conference on Computing and Philosophy, Carnegie Mellon University, Pittsburgh, PA. August5–7. Canada: Department of Philosophy, University of British Columbia.
- Dennett D., 1997, HAL's Legacy: 2001's Computer as Dream and Reality, 351
- Gert B., 1988, Morality
- Gips J., 1995, Android Epistemology, 243
- Harms W., 1999, Evolving artificial moral ecologies
- Mill J. S., 1957, Utilitarianism
Cited by
Brave new world: service robots in the frontline
Wirtz, J., Patterson, P. G., Kunz, W. H., Gruber, T., Lu, V. N., Paluch, S., & Martins, A. (2018) · Journal of Service Management · doi:10.1108/josm-04-2018-0119 · Cited by 2,315
On the Morality of Artificial Agents
Floridi, L., & Sanders, J. W. (2004) · Minds and Machines · doi:10.1023/b:mind.0000035461.63578.9d · Cited by 1,218
Morley, J., Floridi, L., Kinsey, L., & Elhalal, A. (2020) · Science and Engineering Ethics · doi:10.1007/s11948-019-00165-5 · Cited by 882
An Overview of Artificial Intelligence Ethics
Huang, C., Zhang, Z., Mao, B., & Yao, X. (2023) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2022.3194503 · Cited by 482
O'Sullivan, S., Nevejans, N., Allen, C., Blyth, A., Leonard, S., Pagallo, U., Holzinger, K., Holzinger, A., Sajid, M. I., & Ashrafian, H. (2019) · The International Journal of Medical Robotics and Computer Assisted Surgery · doi:10.1002/rcs.1968 · Cited by 437
Self-citation
Metadata
- Authors
- Allen, C., Varner, G., & Zinser, J.
- Affiliations
- Texas A&M University (US)
- ORCID
- Allen, Colin
- Venue
- Journal of Experimental & Theoretical Artificial Intelligence
- Publisher
- Informa UK Limited
- Published
- 2000-07
- Volume
- 12
- Issue
- 3
- Pages
- 251-261
- ISSN
- 0952-813X (ISSN-L)
- 1362-3079
- OpenAlex
- W2051031454
- Cited by
- 326
- References
- 23
- Citations by year
- 2026: 20 · 2025: 15 · 2024: 22 · 2023: 19 · 2022: 28 · 2021: 37 · 2020: 28 · 2019: 19 · 2018: 21 · 2017: 14 · 2016: 10 · 2015: 17 · 2014: 14 · 2013: 8 · 2012: 15
- FWCI
- 2.63
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Experimental & Theoretical Artificial Intelligence (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Arts and Humanities › Philosophy › Philosophical Ethics and Theory
- Social Sciences › Law › Literary and Philosophical Studies
- Keywords
- artificial moral agents, autonomous robots, moral theory, moral perfection, AI ethics, autonomous machines
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Prolegomena to any future artificial moral agent. https://app.cochat.ai/papers/10.1080/09528130050111428
- The paper
- Allen, C., Varner, G., & Zinser, J. (2000). Prolegomena to any future artificial moral agent. Journal of Experimental & Theoretical Artificial Intelligence. https://doi.org/10.1080/09528130050111428
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.