Motivations and Risks of Machine Ethics
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
This paper surveys reasons for and against pursuing the field of machine ethics, understood as research aiming to build “ethical machines.” We clarify the nature of this goal, why it is worth pursuing, and the risks involved in its pursuit. First, we survey and clarify some of the philosophical issues surrounding the concept of an “ethical machine” and the aims of machine ethics. Second, we argue that while there are good prima facie reasons for pursuing machine ethics, including the potential to improve the ethical alignment of both humans and machines, there are also potential risks that must be considered. Third, we survey these potential risks and point to where research should be devoted to clarifying and managing potential risks. We conclude by making some recommendations about the questions that future work could address.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Searle, J. R. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005756 · Cited by 6,954
Intentionality: An Essay in the Philosophy of Mind
Searle, J. R. (1983) · doi:10.1017/cbo9781139173452 · Cited by 4,575
Hegel: Elements of the Philosophy of Right
Hegel, G. W. F. (1991) · doi:10.1017/cbo9780511808012 · Cited by 1,801
List, C., & Pettit, P. (2011) · doi:10.1093/acprof:oso/9780199591565.001.0001 · Cited by 1,344
On the Morality of Artificial Agents
Floridi, L., & Sanders, J. W. (2004) · Minds and Machines · doi:10.1023/b:mind.0000035461.63578.9d · Cited by 1,218 · cited 2×
“[23] L.”
BackgroundWhat is consciousness, and could machines have it?
Dehaene, S., Lau, H., & Kouider, S. (2017) · Science · doi:10.1126/science.aan8871 · Cited by 855
Algorithmic Accountability and Public Reason
Binns, R. (2018) · Philosophy & Technology · doi:10.1007/s13347-017-0263-5 · Cited by 457 · cited 1×
“Political philosophy contains several theories of how collective compromises can be legitimately achieved in the face of deep and widespread disagreement [14]–[16].”
BackgroundArtificial Morality: Top-down, Bottom-up, and Hybrid Approaches
Allen, C., Smit, I., & Wallach, W. (2005) · Ethics and Information Technology · doi:10.1007/s10676-006-0004-4 · Cited by 346
Prolegomena to any future artificial moral agent
Allen, C., Varner, G., & Zinser, J. (2000) · Journal of Experimental & Theoretical Artificial Intelligence · doi:10.1080/09528130050111428 · Cited by 326
Himma, K. E. (2009) · Ethics and Information Technology · doi:10.1007/s10676-008-9167-5 · Cited by 276
Cited by
Artificial Intelligence Regulation: A framework for governance
de Almeida, P. G. R., dos Santos, C. D., & Farias, J. S. (2021) · Ethics and Information Technology · doi:10.1007/s10676-021-09593-z · Cited by 395
Embedding Values in Artificial Intelligence (AI) Systems
van de Poel, I. (2020) · Minds and Machines · doi:10.1007/s11023-020-09537-4 · Cited by 255
Artificial intelligence and clinical anatomical education: Promises and perils
Lazarus, M. D., Truong, M., Douglas, P., & Selwyn, N. (2024) · Anatomical Sciences Education · doi:10.1002/ase.2221 · Cited by 116
“…in relation to conceptual abstraction and analogy-making (the basis of commonsense) (Mitchell, 2021) as well as the need for human moral understanding and agency to be fostered through practice in the contexts in which they will be need to be applied (Cave et al., 2019; Wallach & Vallor, 2020).”
BackgroundFrom Responsibility to Reason-Giving Explainable Artificial Intelligence
Baum, K., Mantel, S., Schmidt, E., & Speith, T. (2022) · Philosophy & Technology · doi:10.1007/s13347-022-00510-w · Cited by 103
“…problems like those mentioned in the previous paragraphs; they provide arguments for XAI from the broader context of morality or society in general (e.g., Asaro, 2015; Binns et al., 2018; Cave et al., 2018; Floridi et al., 2018; Langer, Oster, et al., 2021; Lipton, 2018; Wachter et al., 2017).”
BackgroundAI Extenders: The Ethical and Societal Implications of Humans Cognitively Extended by AI
Hernández-Orallo, J., & Vold, K. (2019) · Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society · doi:10.1145/3306618.3314238 · Cited by 99
Self-citation
Metadata
- Authors
- Cave, S., Nyrup, R., Vold, K., & Weller, A.
- Venue
- Proceedings of the IEEE
- Published
- 2019-03
- Volume
- 107
- Issue
- 3
- Pages
- 562-574
- ISSN
- 0018-9219 (ISSN-L)
- 1558-2256
- OpenAlex
- W2890692457
- Cited by
- 61
- References
- 13
- FWCI
- 11.71
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Motivations and Risks of Machine Ethics. https://app.cochat.ai/papers/10.1109/jproc.2018.2865996
- The paper
- Cave, S., Nyrup, R., Vold, K., & Weller, A. (2019). Motivations and Risks of Machine Ethics. Proceedings of the IEEE. https://doi.org/10.1109/jproc.2018.2865996
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.