Ethical Decision Making in Autonomous Vehicles: Challenges and Research Progress
The DOI matches its Crossref record; 44 of the 45 references it cites were found in a registry or an index.
Abstract
Ethical issues remain a significant concern for future large-scale deployment of autonomous vehicles. Although machine ethics have been developed for a few decades, ethical decision making in autonomous driving imposes more complex and emerging challenges to which some dedicated efforts from academia, policymakers, and automakers have been devoted in the past few years. This paper reviews the efforts and progress associated with the various aspects of ethical challenges in autonomous vehicles. Based on the critical review, it is clear that a consistent solution for ethical challenges does not currently exist and recommendations are provided, to potentially encourage the involving players to collaborate to tackle the remaining challenges.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“These laws can be translated for the case of AVs as follows [163]:An AV should not collide with a pedestrian or a cyclist.An AV should not collide with another vehicle unless this collision would not conflict with the first law.An AV should not collide with any other object in the environment unless avoiding such a collision does not conflict with the first and second laws.”
From Public acceptance and perception of autonomous vehicles: a comprehensive review (2021) · cites this paper as [163]
In the citing paper
“To sum up, in this hybrid approach, the rule system from the rational approach remains in place as boundary requirements, and the AI method focuses on situations not covered by the rational ones [163].”
From Public acceptance and perception of autonomous vehicles: a comprehensive review (2021) · cites this paper as [163]
Citations
Cites
Artificial intelligence: A modern approach
Nilsson, N. J. (1996) · Artificial Intelligence · doi:10.1016/0004-3702(96)00007-0 · Cited by 10,583
The value of a statistical life: A critical review of market estimates throughout the world
Viscusi, W. K., & Aldy, J. E. (2003) · Journal of Risk and Uncertainty · doi:10.1023/a:1025598106257 · Cited by 2,135
The social dilemma of autonomous vehicles
Bonnefon, J.-F., Shariff, A., & Rahwan, I. (2016) · Science · doi:10.1126/science.aaf2654 · Cited by 1,527
The ethics of artificial intelligence
Bostrom, N., & Yudkowsky, E. (2014) · The Cambridge Handbook of Artificial Intelligence · doi:10.1017/cbo9781139046855.020 · Cited by 918
(2015) · Cited by 809
Moral machines: teaching robots right from wrong
(2009) · Choice Reviews Online · doi:10.5860/choice.46-4493 · Cited by 793
Ross, D. (2002) · doi:10.1093/0199252653.001.0001 · Cited by 658
The Problem of Abortion and the Doctrine of the Double Effect
Foot, P. (2020) · The Doctrine of Double Effect · doi:10.2307/j.ctv19m64sz.11 · Cited by 481
Sweeney, L. (2013) · Queue · doi:10.1145/2460276.2460278 · Cited by 477
Klampfl, L., & Wotawa, F. (2024) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.4230/oasics.dx.2024.10 · Cited by 431
On a Formal Model of Safe and Scalable Self-driving Cars
Shalev‐Shwartz, S., Shammah, S., & Shashua, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.06374 · Cited by 405
(2016) · doi:10.1007/978-3-662-48847-8 · Cited by 344
Psychological roadblocks to the adoption of self-driving vehicles
Shariff, A., Bonnefon, J.-F., & Rahwan, I. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0202-6 · Cited by 336
Ethical Decision Making during Automated Vehicle Crashes
Goodall, N. J. (2014) · Transportation Research Record: Journal of the Transportation Research Board · doi:10.3141/2424-07 · Cited by 292
SGD Learns Over-parameterized Networks that Provably Generalize on Linearly Separable DataPreprint
Brutzkus, A., Globerson, A., Malach, E., & Shalev-Shwartz, S. (2017) · International Conference on Learning Representations · doi:10.48550/arxiv.1710.10174 · Cited by 287
Autonomous Cars: In Favor of a Mandatory Ethics Setting
Gogoll, J., & Müller, J. F. (2017) · Science and Engineering Ethics · doi:10.1007/s11948-016-9806-x · Cited by 251
Crash Mitigation in Motion Planning for Autonomous Vehicles
Wang, H., Huang, Y., Khajepour, A., Zhang, Y., Rasekhipour, Y., & Cao, D. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2018.2873921 · Cited by 251
Self-citationPublic Health, Ethics, and Autonomous Vehicles
Fleetwood, J. (2017) · American Journal of Public Health · doi:10.2105/ajph.2016.303628 · Cited by 214
Faulhaber, A. K., Dittmer, A. L., Blind, F., Wächter, M. A., Timm, S., Sütfeld, L. R., Stephan, A., Pipa, G., & König, P. (2018) · Science and Engineering Ethics · doi:10.1007/s11948-018-0020-x · Cited by 184
The dominant role of driver behavior in traffic safety.
Evans, L. (1996) · American Journal of Public Health · doi:10.2105/ajph.86.6.784 · Cited by 166
Can you program ethics into a self-driving car?
Goodall, N. J. (2016) · IEEE Spectrum · doi:10.1109/mspec.2016.7473149 · Cited by 139
Implementable Ethics for Autonomous Vehicles
Gerdes, J. C., & Thornton, S. M. (2015) · Autonomes Fahren · doi:10.1007/978-3-662-45854-9_5 · Cited by 127
Developments and Challenges for Autonomous Unmanned Vehicles
Finn, A., & Scheding, S. (2010) · Intelligent systems reference library · doi:10.1007/978-3-642-10704-7 · Cited by 126
Do we want to share our lives and bodies with robots? A 2000 people survey: A 2000-people survey
Arras, K. O., & Cerqui, D. (2005) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-a-010113633 · Cited by 113
Incorporating Ethical Considerations Into Automated Vehicle Control
Thornton, S. M., Pan, S., Erlien, S. M., & Gerdes, J. C. (2017) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2016.2609339 · Cited by 111
Applbaum, A. I. (2000) · Princeton University Press eBooks · doi:10.1515/9781400822935 · Cited by 101
Intelligence Explosion: Evidence and Import
Muehlhauser, L., & Salamon, A. (2012) · The frontiers collection · doi:10.1007/978-3-642-32560-1_2 · Cited by 100
Greene, J. D. (2016) · Science · doi:10.1126/science.aaf9534 · Cited by 93
People must retain control of autonomous vehicles
Nunes, A., Reimer, B., & Coughlin, J. F. (2018) · Nature · doi:10.1038/d41586-018-04158-5 · Cited by 93
Vila, I. C. (2017) · Criminal Law and Philosophy · doi:10.1007/s11572-017-9411-3 · Cited by 84
Ethical and Social Aspects of Self-Driving CarsPreprint
Holstein, T., Dodig-Crnković, G., & Pelliccione, P. (2018) · EasyChair preprint · doi:10.29007/mgcs · Cited by 57
Avoiding Unintended AI Behaviors
Hibbard, B. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-35506-6_12 · Cited by 40
Investigation into the Role of Rational Ethics in Crashes of Automated Vehicles
Kumfer, W. J., & Burgess, R. A. (2015) · Transportation Research Record Journal of the Transportation Research Board · doi:10.3141/2489-15 · Cited by 39
The moral challenges of driverless cars
Kirkpatrick, K. (2015) · Communications of the ACM · doi:10.1145/2788477 · Cited by 36
Bendel, O. (2013) · Institutional Repository (IHS Vienna) · doi:10.26041/fhnw-3245 · Cited by 33
Kusev, P., van Schaik, P., Alzahrani, S., Lonigro, S., & Purser, H. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-016-1029-2 · Cited by 31
Achievable safety of driverless ground vehicles
Benenson, R., Fraichard, T., & Parent, M. (2008) · 2008 10th International Conference on Control, Automation, Robotics and Vision · doi:10.1109/icarcv.2008.4795572 · Cited by 28
Applying Advanced Learning Algorithms to ALVINN
Batavia, P. H., Pomerleau, D., & Thorpe, C. (1999) · Cited by 27
Moral Machines and the Threat of Ethical Nihilism
Lin, P., Abney, K., & Bekey, G. A. (2012) · Cited by 26
Autonomous Vehicle Ethics: Stock or custom?
Applin, S. A. (2017) · IEEE Consumer Electronics Magazine · doi:10.1109/mce.2017.2684917 · Cited by 24
Role Morality in the Accounting Profession – How do we Compare to Physicians and Attorneys?
Radtke, R. R. (2007) · Journal of Business Ethics · doi:10.1007/s10551-007-9380-x · Cited by 23
Death in Traffic: Why Are the Ethical Issues Ignored?
Evans, L. (2008) · Studies in Ethics, Law, and Technology · doi:10.2202/1941-6008.1014 · Cited by 21
Powers, T. (2011) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2010.940152 · Cited by 20
Vehicle Automation and the Duty to ActPreprint
Goodall, N. J. (2020) · Engineering Archive (engrXiv) · doi:10.31224/osf.io/58rfv · Cited by 8
Research works printed but not linked: 28
- renda, 2015, Searching for harm or harming search? A look at the European Commission’s antitrust investigation against Google, 118
- rawls, 2009, A Theory of Justice
- asimov, 1950, I Robot
- lin, 2012, The Ethical and Social Implications of Robotics
- lin, 2013, The ethics of autonomous cars, Atlantic, 8
- 2017, BMVI-Ethics commission on automated and connected driving
- 2007, Animal–vehicle collision data collection
- 2016, Section 11: Ethical considerations, Federal Automated Vehicles Policy Accelerating the Next Revolution in Roadway Safety, 26
- 2017, On our way towards connected and automated driving in Europe
- pillath, 2016, Briefing Automated vehicles in the EU
- curtis, 2005, Reducing deer–vehicle crashes
- deamer, 2016, What the first driverless car fatality means for self-driving tech, Sci Am, 1
- marcus, 2012, Moral machines
- lin, 2013, The ethics of saving lives with autonomous cars are far murkier than you think
- goodall, 2014, Autonomous car ethics Interview with CBC radio
- arbesman, 2013, Explain it to me again, computer, Slate
- russell, 2016, Artificial Intelligence A Modern Approach
- lebeau, 2016, ‘Driverless’ beer run; Bud makes shipment with self-driving truck, CNBC
- devore, 2016, Which countries are testing driverless cars?
- asimov, 1942, Runaround, Astounding Science Fiction, 29, 94
- ackerman, 2016, People want driverless cars with utilitarian ethics unless they’re a passenger
- bertoncello, 2015, Ten ways autonomous driving could redefine the automotive world
- lafrance, 2015, Self-Driving Cars Could Save 300 000 Lives Per Decade in America
- 2016, About Uber ATG
- 0, Waymo FAQ
- 2016, Pittsburgh your self-driving Uber is arriving now
- wallach, 2008, Moral Machines Teaching Robots Right from Wrong
- driver, 2009, The history of utilitarianism
Cited by
Public acceptance and perception of autonomous vehicles: a comprehensive review
Othman, K. (2021) · AI and Ethics · doi:10.1007/s43681-021-00041-8 · Cited by 347
“To sum up, in this hybrid approach, the rule system from the rational approach remains in place as boundary requirements, and the AI method focuses on situations not covered by the rational ones [163].”
BackgroundMethodSIND: A Drone Dataset at Signalized Intersection in China
Xu, Y., Shao, W., Li, J., Yang, K., Wang, W., Huang, H., Lv, C., & Wang, H. (2022) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc55140.2022.9921959 · Cited by 158
Self-citationDriveLLM: Charting the Path Toward Full Autonomous Driving With Large Language Models
Cui, Y., Huang, S.-C., Zhong, J.-M., Liu, Z., Wang, Y.-T., Sun, C., Li, B., Wang, X., & Khajepour, A. (2024) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3327715 · Cited by 122
Self-citationVerification and Validation Methods for Decision-Making and Planning of Automated Vehicles: A Review
Ma, Y., Sun, C., Chen, J., Cao, D., & Xiong, L. (2022) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2022.3196396 · Cited by 119
Self-citationWang, H., Shao, W., Sun, C., Yang, K., Cao, D., & Li, J. (2024) · Engineering · doi:10.1016/j.eng.2023.10.011 · Cited by 123
Self-citation
Metadata
- Authors
- Wang, H., Khajepour, A., Cao, D., & Liu, T.
- Affiliations
- University of Waterloo (CA)
- Venue
- IEEE Intelligent Transportation Systems Magazine
- Published
- 2022-01
- Volume
- 14
- Issue
- 1
- Pages
- 6-17
- ISSN
- 1939-1390 (ISSN-L)
- 1941-1197
- OpenAlex
- W3014031421
- Cited by
- 84
- References
- 45
- Citations by year
- 2026: 7 · 2025: 16 · 2024: 22 · 2023: 21 · 2022: 10
- FWCI
- 13.27
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- IEEE Intelligent Transportation Systems Magazine (publishedVersion)
- Funders
- Natural Sciences and Engineering Research Council of Canada
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Ethics in Business and Education
- Keywords
- autonomous vehicles, ethical decision-making, machine ethics, ethical considerations, multi-stakeholder collaboration, policy recommendations
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.