The Thorny Challenge of Making Moral Machines: Ethical Dilemmas with Self-Driving Cars
Open accessThe DOI matches its Crossref record.
Abstract
The algorithms that control AVs will need to embed moral principles guiding their decisions in situations of unavoidable harm. Manufacturers and regulators are confronted with three potentially incompatible objectives: being consistent, not causing public outrage, and not discouraging buyers. The presented moral machine study is a step towards solving this problem as it tries to learn how people all over the world feel about the alternative decisions the AI of self-driving vehicles might have to make. The global study displayed broad agreement across regions regarding how to handle unavoidable accidents. To master the moral challenges, all stakeholders should embrace the topic of machine ethics: this is a unique opportunity to decide as a community what we believe to be right or wrong, and to make sure that machines, unlike humans, unerringly follow the agreed-upon moral preferences. The integration of autonomous cars will require a new social contract that provides clear guidelines about who is responsible for different kinds of accidents, how monitoring and enforcement will be performed, and how trust among all stakeholders can be engendered.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“However, results show broad differences in relative preferences among different countries [153]. However, results show countries within close proximity to one another showed closer moral preferences, with three dominant clusters in the West, East, and South [154].”
From Public acceptance and perception of autonomous vehicles: a comprehensive review (2021) · cites this paper as [154]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Still being checked.
Cited by
Public acceptance and perception of autonomous vehicles: a comprehensive review
Othman, K. (2021) · AI and Ethics · doi:10.1007/s43681-021-00041-8 · Cited by 347
The leniency of return policy and consumers' repurchase intention in online retailing
Wang, Y., Anderson, J., Joo, S.-J., & Huscroft, J. R. (2019) · Industrial Management & Data Systems · doi:10.1108/imds-01-2019-0016 · Cited by 80
What ethics can say on artificial intelligence: Insights from a systematic literature review
Giarmoleo, F. V., Ferrero, I., Rocchi, M., & Pellegrini, M. M. (2024) · Business and Society Review · doi:10.1111/basr.12336 · Cited by 64
Moral decision-making in AI: A comprehensive review and recommendations
Ram, J. (2025) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2025.124150 · Cited by 16
Public perception of autonomous vehicles: a brief review
Souza, L. M., & Castañon, J. A. B. (2021) · Research Society and Development · doi:10.33448/rsd-v10i16.24236 · Cited by 7
Metadata
- Authors
- Awad, E., Bonnefon, J.-F., Shariff, A., & Rahwan, I.
- Affiliations
- MIT Media Lab (US)
- Centre National de la Recherche Scientifique (FR)
- University of British Columbia (CA)
- Max Planck Institute for Human Development (DE)
- Venue
- NIM Marketing Intelligence Review
- Publisher
- Walter de Gruyter GmbH
- Published
- 2019-11-01
- Volume
- 11
- Issue
- 2
- Pages
- 42-47
- ISSN
- 2628-166X (ISSN-L)
- OpenAlex
- W2985327985
- Cited by
- 12
- References
- 0
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 3 · 2021: 4 · 2019: 1
- FWCI
- 2.19
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- NIM Marketing Intelligence Review (publishedVersion, cc-by-nc-nd)
- DSpace@MIT (Massachusetts Institute of Technology) (submittedVersion, cc-by-nc-nd)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Ethics in Business and Education
- Life Sciences › Neuroscience › Cognitive Neuroscience › Psychology of Moral and Emotional Judgment
- Keywords
- autonomous vehicles, machine ethics, trolley problem, public attitudes, cross-cultural comparison, accident liability, social contract, trust in technology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Thorny Challenge of Making Moral Machines: Ethical Dilemmas with Self-Driving Cars. https://app.cochat.ai/papers/10.2478/nimmir-2019-0015
- The paper
- Awad, E., Bonnefon, J.-F., Shariff, A., & Rahwan, I. (2019). The Thorny Challenge of Making Moral Machines: Ethical Dilemmas with Self-Driving Cars. NIM Marketing Intelligence Review. https://doi.org/10.2478/nimmir-2019-0015
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.