Algorithmic Decision-Making in AVs: Understanding Ethical and Technical Concerns for Smart Cities
Open accessThe DOI matches its Crossref record; 153 of the 154 references it cites were found in a registry or an index.
Abstract
Autonomous Vehicles (AVs) are increasingly embraced around the world to advance smart mobility and more broadly, smart, and sustainable cities. Algorithms form the basis of decision-making in AVs, allowing them to perform driving tasks autonomously, efficiently, and more safely than human drivers and offering various economic, social, and environmental benefits. However, algorithmic decision-making in AVs can also introduce new issues that create new safety risks and perpetuate discrimination. We identify bias, ethics, and perverse incentives as key ethical issues in the AV algorithms’ decision-making that can create new safety risks and discriminatory outcomes. Technical issues in the AVs’ perception, decision-making and control algorithms, limitations of existing AV testing and verification methods, and cybersecurity vulnerabilities can also undermine the performance of the AV system. This article investigates the ethical and technical concerns surrounding algorithmic decision-making in AVs by exploring how driving decisions can perpetuate discrimination and create new safety risks for the public. We discuss steps taken to address these issues, highlight the existing research gaps and the need to mitigate these issues through the design of AV’s algorithms and of policies and regulations to fully realise AVs’ benefits for smart and sustainable cities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Similar to AVs’ accidents, ethics have a significant influence on the public acceptance of any new technology. AVs’ ethical dilemma is similar to the famous trolley paradox; however, the paradox will be more frequent for the case of AVs.”
From Public acceptance and perception of autonomous vehicles: a comprehensive review (2021) · cites this paper as [142]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This dilemma can occur when a collision is unavoidable, so the vehicle’s software has to choose how and what to crash. [142–145].”
From Public acceptance and perception of autonomous vehicles: a comprehensive review (2021) · cites this paper as [142]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The ethics of algorithms: Mapping the debate
Mittelstadt, B. D., Allo, P., Taddeo, M., Wachter, S., & Floridi, L. (2016) · Big Data & Society · doi:10.1177/2053951716679679 · Cited by 4,567 · cited 1×
“In autonomous systems in general, scholars have recommended ways to detect and offset the effects of bias, such as modifying algorithmic outputs to balance the effects of bias between protected and unprotected groups, introducing minimally intrusive modification to remove bias from the data [71], incorporating individ…”
BackgroundThe Limitations of Deep Learning in Adversarial Settings
Papernot, N., McDaniel, P., Jha, S., Fredrikson, M., Celik, Z. B., & Swami, A. (2016) · 2016 IEEE European Symposium on Security and Privacy (EuroS&P) · doi:10.1109/eurosp.2016.36 · Cited by 3,993
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048 · cited 2×
“In American anti-discrimination law, discrimination exists when there is disparate treatment, which is the “discriminatory intent or the formal application of different rules to people of different groups”, and/or disparate impact, which is the result that “differ for different groups” [29,68].”
BackgroundDistillation as a Defense to Adversarial Perturbations Against Deep Neural Networks
Papernot, N., McDaniel, P., Wu, X., Jha, S., & Swami, A. (2016) · 2016 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2016.41 · Cited by 2,982
A Survey of Motion Planning and Control Techniques for Self-Driving Urban Vehicles
Paden, B., Cap, M., Yong, S. Z., Yershov, D., & Frazzoli, E. (2016) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2016.2578706 · Cited by 2,585
European Union Regulations on Algorithmic Decision Making and a “Right to Explanation”
Goodman, B., & Flaxman, S. (2017) · AI Magazine · doi:10.1609/aimag.v38i3.2741 · Cited by 2,131 · cited 1×
“The GDPR also mandates a right to explanation, which aims to increase the interpretability and transparency of automated decisions by requiring firms to provide data subjects with “meaningful information about the logic involved” in “concise, intelligible and easily accessible” forms [83].”
BackgroundAnanny, M., & Crawford, K. (2018) · New Media & Society · doi:10.1177/1461444816676645 · Cited by 1,836 · cited 1×
“Algorithmic transparency should also target the type of decision being made and empower its observers to understand, challenge and improve the relations between humans and the algorithms across the system [47,157,158].”
BackgroundCertifying and Removing Disparate Impact
Feldman, M., Friedler, S. A., Moeller, J., Scheidegger, C., & Venkatasubramanian, S. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783311 · Cited by 1,827
A Review of Motion Planning Techniques for Automated Vehicles
Gonzalez, D., Perez, J., Milanes, V., & Nashashibi, F. (2016) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2015.2498841 · Cited by 1,670
Silva, B. N., Khan, M., & Han, K. (2018) · Sustainable Cities and Society · doi:10.1016/j.scs.2018.01.053 · Cited by 1,668
The social dilemma of autonomous vehicles
Bonnefon, J.-F., Shariff, A., & Rahwan, I. (2016) · Science · doi:10.1126/science.aaf2654 · Cited by 1,527
Semantic Foggy Scene Understanding with Synthetic Data
Sakaridis, C., Dai, D., & Van Gool, L. (2018) · International Journal of Computer Vision · doi:10.1007/s11263-018-1072-8 · Cited by 1,341
LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loop
Yu, F., Seff, A., Zhang, Y., Song, S., Funkhouser, T., & Xiao, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.03365 · Cited by 1,245
Kalra, N., & Paddock, S. M. (2016) · Transportation Research Part A: Policy and Practice · doi:10.1016/j.tra.2016.09.010 · Cited by 1,221
DeepTest: automated testing of deep-neural-network-driven autonomous cars
Tian, Y., Pei, K., Jana, S., & Ray, B. (2018) · Proceedings of the 40th International Conference on Software Engineering · doi:10.1145/3180155.3180220 · Cited by 1,217
de Jong, M., Joss, S., Schraven, D., Zhan, C., & Weijnen, M. (2015) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2015.02.004 · Cited by 1,069
Planning and Decision-Making for Autonomous Vehicles
Schwarting, W., Alonso-Mora, J., & Rus, D. (2018) · Annual Review of Control, Robotics, and Autonomous Systems · doi:10.1146/annurev-control-060117-105157 · Cited by 972
Adversarial Examples Are Not Easily Detected: Bypassing Ten Detection Methods
Carlini, N., & Wagner, D. (2017) · Proceedings of the 10th ACM Workshop on Artificial Intelligence and Security · doi:10.1145/3128572.3140444 · Cited by 966
Safety Verification of Deep Neural Networks
Huang, X., Kwiatkowska, M., Wang, S., & Wu, M. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-63387-9_1 · Cited by 818
Ethical Implications and Accountability of Algorithms
Martin, K. (2019) · Journal of Business Ethics · doi:10.1007/s10551-018-3921-3 · Cited by 757
Appio, F. P., Lima, M., & Paroutis, S. (2019) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2018.12.018 · Cited by 747
Artificial Intelligence and the ‘Good Society’: the US, EU, and UK approach
Cath, C., Wachter, S., Mittelstadt, B., Taddeo, M., & Floridi, L. (2017) · Science and Engineering Ethics · doi:10.1007/s11948-017-9901-7 · Cited by 733
Lepri, B., Oliver, N., Letouzé, E., Pentland, A., & Vinck, P. (2018) · Philosophy & Technology · doi:10.1007/s13347-017-0279-x · Cited by 709 · cited 3×
“Firstly, algorithms are susceptible to biases originating from the data and the human designer [62,63].”
BackgroundCan cities become smart without being sustainable? A systematic review of the literature
Yigitcanlar, T., Kamruzzaman, M., Foth, M., Sabatini-Marques, J., da Costa, E., & Ioppolo, G. (2019) · Sustainable Cities and Society · doi:10.1016/j.scs.2018.11.033 · Cited by 708
Autonomous Vehicle Safety: An Interdisciplinary Challenge
Koopman, P., & Wagner, M. (2017) · IEEE Intelligent Transportation Systems Magazine · doi:10.1109/mits.2016.2583491 · Cited by 688 · cited 4×
“Firstly, it is difficult to evaluate whether AV test results are correct as non-deterministic algorithms in AV systems produce non-repeatable and probabilistic outputs, which suggests potential differences in system behaviour under almost identical tests, its high sensitivity to minor changes in environmental conditio…”
BackgroundInfluentialChallenges in autonomous vehicle testing and validation
Koopman, P., & Wagner, M. (2016) · SAE International Journal of Transportation Safety · doi:10.4271/2016-01-0128 · Cited by 675 · cited 7×
“…may be covered as even experienced test designers have blind spots, and the high sensitivity of non-deterministic systems to slight input changes exacerbates the challenge of formulating particular situations with particular combinations of inputs for the system to detect a corner-case [147].”
BackgroundMethodInfluentialHengstler, M., Enkel, E., & Duelli, S. (2016) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2015.12.014 · Cited by 661
Perception, Planning, Control, and Coordination for Autonomous Vehicles
Pendleton, S., Andersen, H., Du, X., Shen, X., Meghjani, M., Eng, Y., Rus, D., & Ang, M. (2017) · Machines · doi:10.3390/machines5010006 · Cited by 657
Taeihagh, A., & Lim, H. S. M. (2019) · Transport Reviews · doi:10.1080/01441647.2018.1494640 · Cited by 601
Self-citationSmart Sustainable Cities: Definition and Challenges
Höjer, M., & Wangel, J. (2015) · Advances in Intelligent Systems and Computing · doi:10.1007/978-3-319-09228-7_20 · Cited by 570
(2014) · Digital Commons at University of Maryland Carey Law (University of Maryland Francis King Carey School of Law) · Cited by 524
Edwards, L., & Veale, M. (2017) · doi:10.31228/osf.io/97upg · Cited by 524
Certified Defenses against Adversarial Examples
Raghunathan, A., Steinhardt, J., & Liang, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.09344 · Cited by 520
The governance of smart mobility
Docherty, I., Marsden, G., & Anable, J. (2018) · Transportation Research Part A: Policy and Practice · doi:10.1016/j.tra.2017.09.012 · Cited by 519
Safe, Multi-Agent, Reinforcement Learning for Autonomous Driving
Shalev-Shwartz, S., Shammah, S., & Shashua, A. (2016) · arXiv · doi:10.48550/arxiv.1610.03295 · Cited by 509 · cited 2×
“AVs will also have to negotiate with other road users during activities (e.g., giving way, overtaking, and merging), and this requires balancing between uncertainties in human behaviour while avoiding overly-defensive driving behaviour to ensure smooth tra ffi c flows [126].”
BackgroundAlgorithmic Bias in Autonomous Systems
Danks, D., & London, A. J. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/654 · Cited by 472 · cited 4×
“ed by bias in software [73,74] and creating algorithms that certify the absence of data bias [75]. Apart from bias originating from the data and selection of variables and criterion, Danks and London [30] recommend clarifying ethical standards such as fairness to evaluate bias. Furthermore, scholars recommend increasi…”
BackgroundInfluentialSustainable development of smart cities: a systematic review of the literature
Trindade, E. P., Hinnig, M. P. F., da Costa, E. M., Marques, J. S., Bastos, R. C., & Yigitcanlar, T. (2017) · Journal of Open Innovation: Technology, Market, and Complexity · doi:10.1186/s40852-017-0063-2 · Cited by 446
A multi-sensor fusion system for moving object detection and tracking in urban driving environments
Cho, H., Seo, Y.-W., Kumar, B. V. K. V., & Rajkumar, R. R. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6907100 · Cited by 428
Zarsky, T. (2016) · Science, Technology, & Human Values · doi:10.1177/0162243915605575 · Cited by 422
Fairness testing: testing software for discrimination
Galhotra, S., Brun, Y., & Meliou, A. (2017) · Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering · doi:10.1145/3106237.3106277 · Cited by 405 · cited 1×
“In autonomous systems in general, scholars have recommended ways to detect and offset the effects of bias, such as modifying algorithmic outputs to balance the effects of bias between protected and unprotected groups, introducing minimally intrusive modification to remove bias from the data [71], incorporating individ…”
BackgroundAmer, N. H., Zamzuri, H., Hudha, K., & Kadir, Z. A. (2017) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-016-0442-0 · Cited by 397
Incorporating Ethics into Artificial Intelligence
Etzioni, A., & Etzioni, O. (2017) · The Journal of Ethics · doi:10.1007/s10892-017-9252-2 · Cited by 388 · cited 2×
“…whereby the algorithm constructs its own rules by learning from past driving experiences and human judgements that are deemed morally correct [93,94,99,100], but doing so can also introduce its own safety risks to AVs due to several implementation challenges, the potential for the system to…”
BackgroundThe Impact of Autonomous Vehicles on Cities: A Review
Duarte, F., & Ratti, C. (2018) · Journal of Urban Technology · doi:10.1080/10630732.2018.1493883 · Cited by 378
Machine Learning, Social Learning and the Governance of Self-Driving Cars
Stilgoe, J. (2017) · doi:10.2139/ssrn.2937316 · Cited by 376
Machine learning, social learning and the governance of self-driving cars
Stilgoe, J. (2018) · Social Studies of Science · doi:10.1177/0306312717741687 · Cited by 375
Algorithmic governance: Developing a research agenda through the power of collective intelligence
Danaher, J., Hogan, M. J., Noone, C., Kennedy, R., Behan, A., De Paor, A., Felzmann, H., Haklay, M., Khoo, S.-M., Morison, J., et al. (2017) · Big Data & Society · doi:10.1177/2053951717726554 · Cited by 369 · cited 2×
“The limitations of the top-down approach can be offset by the bottom-up approach, whereby the algorithm constructs its own rules by learning from past driving experiences and human judgements that are deemed morally correct [93,94,99,100], but doing so can also introduce its own safety risks to AVs due to several impl…”
BackgroundThe Architectural Implications of Autonomous Driving: Constraints and Acceleration
Lin, S.-C., Zhang, Y., Hsu, C.-H., Skach, M., Haque, M. E., Tang, L., & Mars, J. (2018) · Proceedings of the Twenty-Third International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3173162.3173191 · Cited by 367
The challenges and limits of big data algorithms in technocratic governance
Janssen, M., & Kuk, G. (2016) · Government Information Quarterly · doi:10.1016/j.giq.2016.08.011 · Cited by 363
Artificial Morality: Top-down, Bottom-up, and Hybrid Approaches
Allen, C., Smit, I., & Wallach, W. (2005) · Ethics and Information Technology · doi:10.1007/s10676-006-0004-4 · Cited by 346 · cited 2×
“However, it is di ffi cult to clearly specify a self-learning system’s high-level goals and to prompt the system to expand the domain of possible choices to choose from [101].”
BackgroundTaxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles
On-Road Automated Driving (ORAD) Committee (2018) · doi:10.4271/j3016_201806 · Cited by 344
The Ugly Truth About Ourselves and Our Robot Creations: The Problem of Bias and Social Inequity
Howard, A., & Borenstein, J. (2018) · Science and Engineering Ethics · doi:10.1007/s11948-017-9975-2 · Cited by 337
The Ethics of Accident-Algorithms for Self-Driving Cars: an Applied Trolley Problem?
Nyholm, S., & Smids, J. (2016) · Ethical Theory and Moral Practice · doi:10.1007/s10677-016-9745-2 · Cited by 331
An Intelligence in Our Image: The Risks of Bias and Errors in Artificial Intelligence
Osoba, O., & Welser, W. (2017) · doi:10.7249/rr1744 · Cited by 326
From Garden City to Eco-urbanism: The quest for sustainable neighborhood development
Sharifi, A. (2016) · Sustainable Cities and Society · doi:10.1016/j.scs.2015.09.002 · Cited by 324
ICT and sustainability in smart cities management
Bifulco, F., Tregua, M., Amitrano, C. C., & D'Auria, A. (2016) · International Journal of Public Sector Management · doi:10.1108/ijpsm-07-2015-0132 · Cited by 322
Adversarial Examples Are Not Easily Detected: Bypassing Ten Detection Methods
Carlini, N., & Wagner, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.07263 · Cited by 307
Kroll, J. A., Huey, J., Barocas, S., Felten, E. W., Reidenberg, J. R., Robinson, D. G., & Yu, H. (2017) · FLASH - Fordham Law Archive of Scholarship & History (Fordham University) · Cited by 299
(2018) · Harvard journal of law & technology · Cited by 295
Trajectory planning and tracking for autonomous overtaking: State-of-the-art and future prospects
Dixit, S., Fallah, S., Montanaro, U., Dianati, M., Stevens, A., Mccullough, F., & Mouzakitis, A. (2018) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2018.02.001 · Cited by 256
Slave to the Algorithm? Why a Right to Explanationn is Probably Not the Remedy You are Looking for
Edwards, L., & Veale, M. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.2972855 · Cited by 244
Kapania, N. R., & Gerdes, J. C. (2015) · Vehicle System Dynamics · doi:10.1080/00423114.2015.1055279 · Cited by 236
Machine Ethics and Automated Vehicles
Goodall, N. J. (2014) · Lecture Notes in Mobility · doi:10.1007/978-3-319-05990-7_9 · Cited by 231
Concrete Problems for Autonomous Vehicle Safety: Advantages of Bayesian Deep Learning
McAllister, R., Gal, Y., Kendall, A., van der Wilk, M., Shah, A., Cipolla, R., & Weller, A. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/661 · Cited by 229
Why Ethics Matters for Autonomous Cars
Lin, P. (2016) · Autonomous Driving · doi:10.1007/978-3-662-48847-8_4 · Cited by 226
Looking at Humans in the Age of Self-Driving and Highly Automated Vehicles
Ohn-Bar, E., & Trivedi, M. M. (2016) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2016.2571067 · Cited by 218
Public Health, Ethics, and Autonomous Vehicles
Fleetwood, J. (2017) · American Journal of Public Health · doi:10.2105/ajph.2016.303628 · Cited by 214
DeepTest: Automated Testing of Deep-Neural-Network-driven Autonomous Cars
Tian, Y., Pei, K., Jana, S., & Ray, B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.08559 · Cited by 208
Autonomous vehicles and the future of urban tourism
Cohen, S. A., & Hopkins, D. (2019) · Annals of Tourism Research · doi:10.1016/j.annals.2018.10.009 · Cited by 203
Nikitas, A., Kougias, I., Alyavina, E., & Njoya Tchouamou, E. (2017) · Urban Science · doi:10.3390/urbansci1040036 · Cited by 190
Why Ethics Matters for Autonomous Cars
Lin, P. (2015) · Autonomes Fahren · doi:10.1007/978-3-662-45854-9_4 · Cited by 189
When human beings are like drunk robots: Driverless vehicles, ethics, and the future of transport
Sparrow, R., & Howard, M. (2017) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2017.04.014 · Cited by 182 · cited 2×
“For instance, accidents occurred when AVs stopped unexpectedly when human drivers do not expect them to stop, such as at an amber tra ffi c light or at a congested intersection [129].”
BackgroundAutomated Driving: Safer and More Efficient Future Driving
Sorniotti, A., Barber, P., & Pinto, S. D. (2016) · Springer eBooks · doi:10.1007/978-3-319-31895-0 · Cited by 180
Automated Vehicles and Pedestrian Safety: Exploring the Promise and Limits of Pedestrian Detection
Combs, T. S., Sandt, L. S., Clamann, M. P., & McDonald, N. C. (2019) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2018.06.024 · Cited by 179
Internet of Vehicles: From intelligent grid to autonomous cars and vehicular fogs
Lee, E.-K., Gerla, M., Pau, G., Lee, U., & Lim, J.-H. (2016) · International Journal of Distributed Sensor Networks · doi:10.1177/1550147716665500 · Cited by 177
Emergency steering control of autonomous vehicle for collision avoidance and stabilisation
He, X., Liu, Y., Lv, C., Ji, X., & Liu, Y. (2019) · Vehicle System Dynamics · doi:10.1080/00423114.2018.1537494 · Cited by 177
Lim, H. S. M., & Taeihagh, A. (2018) · Energies · doi:10.3390/en11051062 · Cited by 175
Self-citationInvestigating end-user acceptance of autonomous electric buses to accelerate diffusion
Herrenkind, B., Brendel, A. B., Nastjuk, I., Greve, M., & Kolbe, L. M. (2019) · Transportation Research Part D: Transport and Environment · doi:10.1016/j.trd.2019.08.003 · Cited by 175
FairTest: Discovering Unwarranted Associations in Data-Driven Applications
Tramer, F., Atlidakis, V., Geambasu, R., Hsu, D., Hubaux, J.-P., Humbert, M., Juels, A., & Lin, H. (2017) · 2017 IEEE European Symposium on Security and Privacy (EuroS&P) · doi:10.1109/eurosp.2017.29 · Cited by 171 · cited 1×
“…to remove bias from the data [71], incorporating individuals from potentially discriminated groups [72], testing techniques to measure discrimination and identify groups of users significantly a ff ected by bias in software [73,74] and creating algorithms that certify the absence of data bias [75].”
BackgroundFairTest: Discovering Unwarranted Associations in Data-Driven Applications
Tramèr, F., Atlidakis, V., Geambasu, R., Hsu, D., Hubaux, J.-P., Humbert, M., Juels, A., & Lin, H. (2015) · arXiv · doi:10.48550/arxiv.1510.02377 · Cited by 171
Geistfeld, M. (2017) · California Law Review · doi:10.15779/z38416sz9r · Cited by 171
Never Mind the Trolley: The Ethics of Autonomous Vehicles in Mundane Situations
Himmelreich, J. (2018) · Ethical Theory and Moral Practice · doi:10.1007/s10677-018-9896-4 · Cited by 170
The German Ethics Code for Automated and Connected Driving
Luetge, C. (2017) · Philosophy & Technology · doi:10.1007/s13347-017-0284-0 · Cited by 160
Kummitha, R. K. R., & Crutzen, N. (2019) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2018.12.001 · Cited by 155
Tan, S. Y., & Taeihagh, A. (2021) · Government Information Quarterly · doi:10.1016/j.giq.2020.101546 · Cited by 154
Self-citationMachine morality: bottom-up and top-down approaches for modelling human moral faculties
Wallach, W., Allen, C., & Smit, I. (2008) · AI & SOCIETY · doi:10.1007/s00146-007-0099-0 · Cited by 152 · cited 3×
“The “top-down” approach involves mapping a set of ethical theories, such as utilitarianism and deontology, to computational requirements and programming them into the algorithm [93,94], but programming each ethical theory entails their own set of limitations and issues that can undermine AV safety and also perpetuate…”
BackgroundGu, Y., Hsu, L., & Kamijo, S. (2015) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2015.2497001 · Cited by 151
Smooth path and speed planning for an automated public transport vehicle
Villagrá, J., Milanés, V., Perez, J., & Godoy, J. (2011) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2011.11.001 · Cited by 148
Towards Verified Artificial Intelligence
Seshia, S. A., Sadigh, D., & Sastry, S. S. (2016) · arXiv · doi:10.48550/arxiv.1606.08514 · Cited by 142 · cited 2×
“Formal verification tools such as online verification of control algorithms and networks require traffic scenarios and road users to be represented in terms of probabilities, whereas traditional verification tools face challenges in modelling complex environments and specifying the system’s desired properties [22,153].”
BackgroundLevel 5 autonomy: The new face of disruption in road transport
Skeete, J.-P. (2018) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2018.05.003 · Cited by 142
Concrete Problems for Autonomous Vehicle Safety: Advantages of Bayesian Deep Learning
McAllister, R., Gal, Y., Kendall, A., van der Wilk, M., Shah, A., Cipolla, R., & Weller, A. (2017) · Cambridge University Engineering Department Publications Database · doi:10.17863/cam.12760 · Cited by 141
Cagliari and smart urban mobility: Analysis and comparison
Garau, C., Masala, F., & Pinna, F. (2016) · Cities · doi:10.1016/j.cities.2016.02.012 · Cited by 139
Implementable Ethics for Autonomous Vehicles
Gerdes, J. C., & Thornton, S. M. (2015) · Autonomes Fahren · doi:10.1007/978-3-662-45854-9_5 · Cited by 127
Away from Trolley Problems and Toward Risk Management
Goodall, N. J. (2016) · Applied Artificial Intelligence · doi:10.1080/08839514.2016.1229922 · Cited by 124
Embedded ethics: some technical and ethical challenges
Bonnemains, V., Saurel, C., & Tessier, C. (2018) · Ethics and Information Technology · doi:10.1007/s10676-018-9444-x · Cited by 123
Yigitcanlar, T., & Kamruzzaman, M. (2019) · Journal of Urban Technology · doi:10.1080/10630732.2018.1476794 · Cited by 123
Laws on Robots, Laws by Robots, Laws in Robots: Regulating Robot Behaviour by Design
Leenes, R., & Lucivero, F. (2014) · Law, Innovation and Technology · doi:10.5235/17579961.6.2.193 · Cited by 121
Noy, K., & Givoni, M. (2018) · Sustainability · doi:10.3390/su10020422 · Cited by 120
Towards time-optimal race car driving using nonlinear MPC in real-time
Verschueren, R., De Bruyne, S., Zanon, M., Frasch, J. V., & Diehl, M. (2014) · 53rd IEEE Conference on Decision and Control · doi:10.1109/cdc.2014.7039771 · Cited by 112
Incorporating Ethical Considerations Into Automated Vehicle Control
Thornton, S. M., Pan, S., Erlien, S. M., & Gerdes, J. C. (2017) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2016.2609339 · Cited by 111
An Analysis of ISO 26262: Machine Learning and Safety in Automotive Software
Salay, R., Queiroz, R., & Czarnecki, K. (2018) · SAE Technical Paper Series · doi:10.4271/2018-01-1075 · Cited by 109
Taiebat, M., & Xu, M. (2019) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2019.05.142 · Cited by 109
Chander, A. (2017) · Michigan Law Review · doi:10.36644/mlr.115.6.racist · Cited by 105
The Potential Implications of Autonomous Vehicles in and around the Workplace
Pettigrew, S., Fritschi, L., & Norman, R. (2018) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph15091876 · Cited by 103 · cited 1×
“Among the various smart mobility solutions proposed, AVs offer improved safety, congestion, traffic efficiency, mobility for the elderly and disabled and reduced environmental impact [1,15–18] and many governments around the world have been accelerating AV developments and trials [19,20].”
BackgroundPangbourne, K., Stead, D., Mladenović, M., & Milakis, D. (2018) · Governance of the Smart Mobility Transition · doi:10.1108/978-1-78754-317-120181003 · Cited by 100
An Analysis of ISO 26262: Using Machine Learning Safely in Automotive Software
Salay, R., Queiroz, R., & Czarnecki, K. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.02435 · Cited by 99
Alessandrini, A., Cattivera, A., Holguin, C., & Stam, D. (2014) · Lecture notes in mobility · doi:10.1007/978-3-319-05990-7 · Cited by 96
Vila, I. C. (2017) · Criminal Law and Philosophy · doi:10.1007/s11572-017-9411-3 · Cited by 84
Follow the Past: a path-tracking algorithm for autonomous vehicles
Hellstrom, T., & Ringdahl, O. (2006) · International Journal of Vehicle Autonomous Systems · doi:10.1504/ijvas.2006.012208 · Cited by 78
Li, S., Sui, P.-C., Xiao, J., & Chahine, R. (2019) · Transportation Research Part A: Policy and Practice · doi:10.1016/j.tra.2018.05.010 · Cited by 73
Comparative evaluation of dynamic and kinematic vehicle models
Kang, C. M., Lee, S.-H., & Chung, C. C. (2014) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2014.7039455 · Cited by 69
Smart infrastructure: an emerging frontier for multidisciplinary research
Ogie, R. I., Perez, P., & Dignum, V. (2017) · Proceedings of the Institution of Civil Engineers - Smart Infrastructure and Construction · doi:10.1680/jsmic.16.00002 · Cited by 67
Moral Decision Making Frameworks for Artificial Intelligence
Conitzer, V., Sinnott-Armstrong, W., Schaich Borg, J., Deng, Y., & Kramer, M. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11140 · Cited by 65
Design of a Path-Tracking Steering Controller for Autonomous Vehicles
Sun, C., Zhang, X., Xi, L., & Tian, Y. (2018) · Energies · doi:10.3390/en11061451 · Cited by 64
Crash Algorithms for Autonomous Cars: How the Trolley Problem Can Move Us Beyond Harm Minimisation
Hübner, D., & White, L. (2018) · Ethical Theory and Moral Practice · doi:10.1007/s10677-018-9910-x · Cited by 64
Implementable Ethics for Autonomous Vehicles
Gerdes, J. C., & Thornton, S. M. (2016) · Autonomous Driving · doi:10.1007/978-3-662-48847-8_5 · Cited by 63
Integration of GPS, Monocular Vision, and High Definition (HD) Map for Accurate Vehicle Localization
Cai, H., Hu, Z., Huang, G., Zhu, D., & Su, X. (2018) · Sensors · doi:10.3390/s18103270 · Cited by 63
Artificial Intelligence and the Problem of AutonomyPreprint
Chesterman, S. A. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3450540 · Cited by 53
A hierarchical approach for primitive-based motion planning and control of autonomous vehicles
Grymin, D. J., Neas, C. B., & Farhood, M. (2013) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2013.10.003 · Cited by 52
Smart Cities IoT: Enablers and Technology Road Map
Suzuki, L. (2017) · Springer optimization and its applications · doi:10.1007/978-3-319-61313-0_10 · Cited by 50
Irresponsibilities, inequalities and injustice for autonomous vehicles
Liu, H.-Y. (2017) · Ethics and Information Technology · doi:10.1007/s10676-017-9436-2 · Cited by 48
Learn from experience: Probabilistic prediction of perception performance to avoid failure
Gurău, C., Rao, D., Tong, C. H., & Posner, I. (2017) · The International Journal of Robotics Research · doi:10.1177/0278364917730603 · Cited by 47
Wolkenstein, A. (2018) · Ethics and Information Technology · doi:10.1007/s10676-018-9456-6 · Cited by 47
Introduction to Automated Driving
Watzenig, D., & Horn, M. (2016) · Springer eBooks · doi:10.1007/978-3-319-31895-0_1 · Cited by 45
Roboethics: Fundamental Concepts and Future Prospects
Tzafestas, S. G. (2018) · Information · doi:10.3390/info9060148 · Cited by 41
Challenges and Approaches to Realizing Autonomous Vehicle Safety
Kalra, N. (2017) · doi:10.7249/ct463 · Cited by 40 · cited 1×
“Firstly, many developers conduct extensive road testing and analyse data such as the number of km/mi travelled, injuries, and fatalities to improve the AV’s performance until a relatively low proportion of fatalities and injuries is achieved, but this requires AVs to be driven a significant number of miles that could…”
Development of a self-driving car that can handle the adverse weather
Lee, U., Jung, J., Jung, S., & Shim, D. H. (2017) · International Journal of Automotive Technology · doi:10.1007/s12239-018-0018-z · Cited by 38
Influencing Factors of Driving Decision-Making Under the Moral Dilemma
Li, S., Zhang, J., Li, P., Wang, Y., & Wang, Q. (2019) · IEEE Access · doi:10.1109/access.2019.2932043 · Cited by 37
Vulnerable users' perceptions of transport technologies
Sochor, J., & Nikitas, A. (2016) · Proceedings of the Institution of Civil Engineers - Urban Design and Planning · doi:10.1680/jurdp.14.00054 · Cited by 36
Li, Q., Wang, Y., Pu, Z., Wang, S., & Zhang, W. (2019) · Transportation Research Record Journal of the Transportation Research Board · doi:10.1177/0361198119837180 · Cited by 34
Accurate vehicle self-localization in high definition map dataset
Zang, A., Li, Z., Doria, D. L., & Trajcevski, G. (2017) · doi:10.1145/3149092.3149094 · Cited by 33
Zhan, C., de Jong, M., & de Bruijn, H. (2018) · Sustainability · doi:10.3390/su10114256 · Cited by 31
Governing Cities for Sustainability: A Research Agenda and Invitation
Evans, J. (2019) · Frontiers in Sustainable Cities · doi:10.3389/frsc.2019.00002 · Cited by 31
Development of sustainable transport in smart cities
Makarova, I., Shubenkova, K. A., Геннадьевич, М. В., Boyko, A., & Katunin, A. (2017) · IEEE International Forum on Research and Technology for Society and Industry (RTSI) · doi:10.1109/rtsi.2017.8065922 · Cited by 30
Smart cities: A challenge to research and policy analysis
Borseková, K., & Nijkamp, P. J. (2018) · Cities · doi:10.1016/j.cities.2018.03.015 · Cited by 30
From Antenna Design to High Fidelity, Full Physics Automotive Radar Sensor Corner Case Simulation
Chipengo, U., Krenz, P. M., & Carpenter, S. (2018) · Modelling and Simulation in Engineering · doi:10.1155/2018/4239725 · Cited by 30
Qi, L., Liu, Y., Liu, C., Chen, B., Zhang, W., Li, L., & Ji, X. (2018) · Sensors · doi:10.3390/s18082544 · Cited by 28
Assessing and Addressing Algorithmic Bias - But Before We Get There
Garcia-Gathright, J. I., Springer, A., & Cramer, H. S. M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.03332 · Cited by 26
Integrated 5G satellite-terrestrial systems: Use cases for road safety and autonomous ships
Höyhtyä, M., Ojanperä, T., Mäkelä, J., Ruponen, S., & Järvensivu, P. (2017) · Cited by 26
From Trolleys to Risk: Models for Ethical Autonomous Driving
Goodall, N. J. (2017) · American Journal of Public Health · doi:10.2105/ajph.2017.303672 · Cited by 24
Johnsen, A., Strand, N., Andersson, J., Patten, C., Kraetsch, C., & Takman, J. (2017) · DiVA (Digitala Vetenskapliga Arkivet) · Cited by 23
Anastasiadou, K., & Vougias, S. (2019) · Transport Policy · doi:10.1016/j.tranpol.2019.07.009 · Cited by 21
Ethical Implications and Accountability of AlgorithmsPreprint
Martin, K. E. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3056716 · Cited by 21
#BigData: Discrimination in data-supported decision making
(2019) · Human Rights Documents online · doi:10.1163/2210-7975_hrd-9992-20180020 · Cited by 21
Kang, C. M., Lee, S.-H., & Chung, C. C. (2016) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2016.7798629 · Cited by 17
Pugnetti, C., & Schläpfer, R. (2018) · Journal of risk and financial management · doi:10.3390/jrfm11020028 · Cited by 17
Monroy, I. T., Raddo, T. R., Rommel, S., Okonkwo, C. M., Calabretta, N., Johannsen, U., Dubbelman, G., Scholtes, J., & Rutten, B. (2018) · International Conference on Transparent Optical Networks · doi:10.1109/icton.2018.8473880 · Cited by 13
Three Types of Structural Discrimination Introduced by Autonomous Vehicles
Liu, H.-Y. (2018) · Research at the University of Copenhagen (University of Copenhagen) · Cited by 13
Positive Invariant Sets for Safe Integrated Vehicle Motion Planning and Control
Berntorp, K., Danielson, C., Weiss, A., & Cairano, S. D. (2018) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2018.8619458 · Cited by 12
Does the GDPR Help or Hinder Fair Algorithmic Decision-Making?Preprint
Henderson, T. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3140887 · Cited by 9
Cancila, D., Gerstenmayer, J.-L., Espinoza, H., & Passerone, R. (2018) · Designs · doi:10.3390/designs2040052 · Cited by 4
Deontic Counteridenticals and the Design of Ethically Correct Intelligent Agents: First Steps.
Bringsjord, S., Ghosh, R., & Pane-Joyce, J. (2016) · Cited by 2
Schiller, P. L., & Kenworthy, J. R. (2017) · Routledge eBooks · doi:10.4324/9781315644486-8 · Cited by 2
Research works printed but not linked: 6
- 2016, Autonomous vehicles and smart mobility related technologies, Infocommun. J., 8, 17
- IEEE Standards Association (2018). Ethically Aligned Design a Vision for Prioritizing Well-Being with Artificial Intelligence and Autonomous Systems, IEEE.
- Institute for Information and Communications Policy (IICP), and Ministry of Internal Affairs and Communications (MIC) (2019, October 17). Proceedings of the Conference toward AI Network Society including the Draft AI R&D Guidelines for International Discussions, Tokyo, Japan, 28 July 2017. Available online: http://www.soumu.go.jp/main_sosiki/joho_tsusin/eng/Releases/Telecommunications/170728_05.html.
- Dafoe, A. (2018). AI Governance: A Research Agenda. Governance of AI Program—Future of Humanity Institute, University of Oxford.
- Gal, Y., and Ghahramani, Z. (2015, January 10–11). Dropout as a bayesian approximation: Insights and applications. Proceedings of the Deep Learning Workshop in International Conference on Machine-Learning, New York, NY, USA.
- Mavromatis, I., Tassi, A., Rigazzi, G., Piechocki, R.J., and Nix, A. (2018). Multi-radio 5g architecture for connected and autonomous vehicles: Application and design insights. arXiv. · doi:10.4108/eai.20-3-2018.154368
Cited by
Governance of artificial intelligence
Taeihagh, A. (2021) · Policy and Society · doi:10.1080/14494035.2021.1928377 · Cited by 562
Self-citationPublic acceptance and perception of autonomous vehicles: a comprehensive review
Othman, K. (2021) · AI and Ethics · doi:10.1007/s43681-021-00041-8 · Cited by 347
Ahmad, K., Maabreh, M., Ghaly, M., Khan, K., Qadir, J., & Al-Fuqaha, A. (2022) · Computer Science Review · doi:10.1016/j.cosrev.2021.100452 · Cited by 291
Bibri, S. E., Huang, J., Jagatheesaperumal, S. K., & Krogstie, J. (2024) · Environmental Science and Ecotechnology · doi:10.1016/j.ese.2024.100433 · Cited by 242
Framing governance for a contested emerging technology:insights from AI policy
Ulnicane, I., Knight, W., Leach, T., Stahl, B. C., & Wanjiku, W.-G. (2021) · Policy and Society · doi:10.1080/14494035.2020.1855800 · Cited by 242
Metadata
- Authors
- Lim, H. S. M., & Taeihagh, A.
- Affiliations
- National University of Singapore (SG)
- Corresponding author
- Taeihagh, Araz
- ORCID
- Taeihagh, Araz
- Venue
- Sustainability
- Publisher
- MDPI AG
- Published
- 2019-10-18
- Volume
- 11
- Issue
- 20
- Pages
- 5791
- ISSN
- 2071-1050 (ISSN-L)
- OpenAlex
- W2980573810
- Cited by
- 136
- References
- 154
- Citations by year
- 2026: 19 · 2025: 32 · 2024: 23 · 2023: 13 · 2022: 14 · 2021: 21 · 2020: 13 · 2019: 1
- FWCI
- 21.40
- Type
- journal article
- Language
- en
- Open access
- gold
- dx.doi.org
- Licence
- Locations
- Sustainability (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- National University of Singapore (submittedVersion, cc-by)
- SSRN Electronic Journal (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- arXiv (Cornell University) (cc-by)
- Funders
- Lee Kuan Yew School of Public Policy, National University of Singapore (Start-up Research Grant.)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Safety Systems Engineering in Autonomy
- Keywords
- autonomous vehicles, algorithmic decision-making, algorithmic bias, algorithmic discrimination, safety risk, perverse incentives, cybersecurity vulnerabilities, smart cities, sustainable cities, AI ethics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.