Algorithmic Decision-Making in AVs: Understanding Ethical and Technical Concerns for Smart Cities
Open accessThe DOI matches its Crossref record; 153 of the 154 references it cites were found in a registry or an index.
Abstract
Autonomous Vehicles (AVs) are increasingly embraced around the world to advance smart mobility and more broadly, smart, and sustainable cities. Algorithms form the basis of decision-making in AVs, allowing them to perform driving tasks autonomously, efficiently, and more safely than human drivers and offering various economic, social, and environmental benefits. However, algorithmic decision-making in AVs can also introduce new issues that create new safety risks and perpetuate discrimination. We identify bias, ethics, and perverse incentives as key ethical issues in the AV algorithms’ decision-making that can create new safety risks and discriminatory outcomes. Technical issues in the AVs’ perception, decision-making and control algorithms, limitations of existing AV testing and verification methods, and cybersecurity vulnerabilities can also undermine the performance of the AV system. This article investigates the ethical and technical concerns surrounding algorithmic decision-making in AVs by exploring how driving decisions can perpetuate discrimination and create new safety risks for the public. We discuss steps taken to address these issues, highlight the existing research gaps and the need to mitigate these issues through the design of AV’s algorithms and of policies and regulations to fully realise AVs’ benefits for smart and sustainable cities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Similar to AVs’ accidents, ethics have a significant influence on the public acceptance of any new technology. AVs’ ethical dilemma is similar to the famous trolley paradox; however, the paradox will be more frequent for the case of AVs.”
From Public acceptance and perception of autonomous vehicles: a comprehensive review (2021) · cites this paper as [142]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This dilemma can occur when a collision is unavoidable, so the vehicle’s software has to choose how and what to crash. [142–145].”
From Public acceptance and perception of autonomous vehicles: a comprehensive review (2021) · cites this paper as [142]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The ethics of algorithms: Mapping the debate
Mittelstadt, B. D., Allo, P., Taddeo, M., Wachter, S., & Floridi, L. (2016) · Big Data & Society · doi:10.1177/2053951716679679 · Cited by 4,567 · cited 1×
“In autonomous systems in general, scholars have recommended ways to detect and offset the effects of bias, such as modifying algorithmic outputs to balance the effects of bias between protected and unprotected groups, introducing minimally intrusive modification to remove bias from the data [71], incorporating individ…”
BackgroundThe Limitations of Deep Learning in Adversarial Settings
Papernot, N., McDaniel, P., Jha, S., Fredrikson, M., Celik, Z. B., & Swami, A. (2016) · 2016 IEEE European Symposium on Security and Privacy (EuroS&P) · doi:10.1109/eurosp.2016.36 · Cited by 3,993
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048 · cited 2×
“In American anti-discrimination law, discrimination exists when there is disparate treatment, which is the “discriminatory intent or the formal application of different rules to people of different groups”, and/or disparate impact, which is the result that “differ for different groups” [29,68].”
BackgroundDistillation as a Defense to Adversarial Perturbations Against Deep Neural Networks
Papernot, N., McDaniel, P., Wu, X., Jha, S., & Swami, A. (2016) · 2016 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2016.41 · Cited by 2,982
A Survey of Motion Planning and Control Techniques for Self-Driving Urban Vehicles
Paden, B., Cap, M., Yong, S. Z., Yershov, D., & Frazzoli, E. (2016) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2016.2578706 · Cited by 2,585
European Union Regulations on Algorithmic Decision Making and a “Right to Explanation”
Goodman, B., & Flaxman, S. (2017) · AI Magazine · doi:10.1609/aimag.v38i3.2741 · Cited by 2,131 · cited 1×
“The GDPR also mandates a right to explanation, which aims to increase the interpretability and transparency of automated decisions by requiring firms to provide data subjects with “meaningful information about the logic involved” in “concise, intelligible and easily accessible” forms [83].”
BackgroundAnanny, M., & Crawford, K. (2018) · New Media & Society · doi:10.1177/1461444816676645 · Cited by 1,836 · cited 1×
“Algorithmic transparency should also target the type of decision being made and empower its observers to understand, challenge and improve the relations between humans and the algorithms across the system [47,157,158].”
BackgroundCertifying and Removing Disparate Impact
Feldman, M., Friedler, S. A., Moeller, J., Scheidegger, C., & Venkatasubramanian, S. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783311 · Cited by 1,827
A Review of Motion Planning Techniques for Automated Vehicles
Gonzalez, D., Perez, J., Milanes, V., & Nashashibi, F. (2016) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2015.2498841 · Cited by 1,670
Silva, B. N., Khan, M., & Han, K. (2018) · Sustainable Cities and Society · doi:10.1016/j.scs.2018.01.053 · Cited by 1,668
Research works printed but not linked: 6
- 2016, Autonomous vehicles and smart mobility related technologies, Infocommun. J., 8, 17
- IEEE Standards Association (2018). Ethically Aligned Design a Vision for Prioritizing Well-Being with Artificial Intelligence and Autonomous Systems, IEEE.
- Institute for Information and Communications Policy (IICP), and Ministry of Internal Affairs and Communications (MIC) (2019, October 17). Proceedings of the Conference toward AI Network Society including the Draft AI R&D Guidelines for International Discussions, Tokyo, Japan, 28 July 2017. Available online: http://www.soumu.go.jp/main_sosiki/joho_tsusin/eng/Releases/Telecommunications/170728_05.html.
- Dafoe, A. (2018). AI Governance: A Research Agenda. Governance of AI Program—Future of Humanity Institute, University of Oxford.
- Gal, Y., and Ghahramani, Z. (2015, January 10–11). Dropout as a bayesian approximation: Insights and applications. Proceedings of the Deep Learning Workshop in International Conference on Machine-Learning, New York, NY, USA.
- Mavromatis, I., Tassi, A., Rigazzi, G., Piechocki, R.J., and Nix, A. (2018). Multi-radio 5g architecture for connected and autonomous vehicles: Application and design insights. arXiv. · doi:10.4108/eai.20-3-2018.154368
Cited by
Governance of artificial intelligence
Taeihagh, A. (2021) · Policy and Society · doi:10.1080/14494035.2021.1928377 · Cited by 562
Self-citationPublic acceptance and perception of autonomous vehicles: a comprehensive review
Othman, K. (2021) · AI and Ethics · doi:10.1007/s43681-021-00041-8 · Cited by 347
Ahmad, K., Maabreh, M., Ghaly, M., Khan, K., Qadir, J., & Al-Fuqaha, A. (2022) · Computer Science Review · doi:10.1016/j.cosrev.2021.100452 · Cited by 291
Bibri, S. E., Huang, J., Jagatheesaperumal, S. K., & Krogstie, J. (2024) · Environmental Science and Ecotechnology · doi:10.1016/j.ese.2024.100433 · Cited by 242
Framing governance for a contested emerging technology:insights from AI policy
Ulnicane, I., Knight, W., Leach, T., Stahl, B. C., & Wanjiku, W.-G. (2021) · Policy and Society · doi:10.1080/14494035.2020.1855800 · Cited by 242
Metadata
- Authors
- Lim, H. S. M., & Taeihagh, A.
- Affiliations
- National University of Singapore (SG)
- Corresponding author
- Taeihagh, Araz
- ORCID
- Taeihagh, Araz
- Venue
- Sustainability
- Publisher
- MDPI AG
- Published
- 2019-10-18
- Volume
- 11
- Issue
- 20
- Pages
- 5791
- ISSN
- 2071-1050 (ISSN-L)
- OpenAlex
- W2980573810
- Cited by
- 136
- References
- 154
- Citations by year
- 2026: 19 · 2025: 32 · 2024: 23 · 2023: 13 · 2022: 14 · 2021: 21 · 2020: 13 · 2019: 1
- FWCI
- 21.40
- Type
- journal article
- Language
- en
- Open access
- gold
- dx.doi.org
- Licence
- Locations
- Sustainability (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- National University of Singapore (submittedVersion, cc-by)
- SSRN Electronic Journal (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- arXiv (Cornell University) (cc-by)
- Funders
- Lee Kuan Yew School of Public Policy, National University of Singapore (Start-up Research Grant.)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Safety Systems Engineering in Autonomy
- Keywords
- autonomous vehicles, algorithmic decision-making, algorithmic bias, algorithmic discrimination, safety risk, perverse incentives, cybersecurity vulnerabilities, smart cities, sustainable cities, AI ethics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Algorithmic Decision-Making in AVs: Understanding Ethical and Technical Concerns for Smart Cities. https://app.cochat.ai/papers/10.3390/su11205791
- The paper
- Lim, H. S. M., & Taeihagh, A. (2019). Algorithmic Decision-Making in AVs: Understanding Ethical and Technical Concerns for Smart Cities. Sustainability. https://doi.org/10.3390/su11205791
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.