Hands Off the Wheel in Autonomous Vehicles?: A Systems Perspective on over a Million Miles of Field Data
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Autonomous vehicle (AV) technology is rapidly becoming a reality on U.S. roads, offering the promise of improvements in traffic management, safety, and the comfort and efficiency of vehicular travel. The California Department of Motor Vehicles (DMV) reports that between 2014 and 2017, manufacturers tested 144 AVs, driving a cumulative 1,116,605 autonomous miles, and reported 5,328 disengagements and 42 accidents involving AVs on public roads. This paper investigates the causes, dynamics, and impacts of such AV failures by analyzing disengagement and accident reports obtained from public DMV databases. We draw several conclusions. For example, we find that autonomous vehicles are 15 - 4000× worse than human drivers for accidents per cumulative mile driven; that drivers of AVs need to be as alert as drivers of non-AVs; and that the AVs' machine-learning-based systems for perception and decision-and-control are the primary cause of 64% of all disengagements.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897
Preparing a nation for autonomous vehicles: opportunities, barriers and policy recommendations
Fagnant, D. J., & Kockelman, K. (2015) · Transportation Research Part A: Policy and Practice · doi:10.1016/j.tra.2015.04.003 · Cited by 3,214
Engineering a Safer World: Systems Thinking Applied to Safety
(2012) · Choice Reviews Online · doi:10.5860/choice.49-6305 · Cited by 1,566 · cited 1×
“However, to identify multidimensional causes of AV disengagements/accidents, we built a hierarchical control structure for AVs by using the systems-theoretic hazard modeling and analysis abstraction STPA (Systems-Theoretic Process Analysis) [23].”
MethodAutonomous driving in urban environments: Boss and the Urban Challenge
Urmson, C., Anhalt, J., Bagnell, D., Baker, C., Bittner, R., Clark, M. N., Dolan, J., Duggins, D., Galatali, T., Geyer, C., et al. (2008) · Journal of Field Robotics · doi:10.1002/rob.20255 · Cited by 1,555
Towards fully autonomous driving: Systems and algorithms
Levinson, J., Askeland, J., Becker, J., Dolson, J., Held, D., Kammel, S., Kolter, J. Z., Langer, D., Pink, O., Pratt, V., et al. (2011) · 2011 IEEE Intelligent Vehicles Symposium (IV) · doi:10.1109/ivs.2011.5940562 · Cited by 1,374
Kalra, N., & Paddock, S. M. (2016) · Transportation Research Part A: Policy and Practice · doi:10.1016/j.tra.2016.09.010 · Cited by 1,221
Engineering a Safer World: Systems Thinking Applied to Safety
Leveson, N. G. (2012) · doi:10.7551/mitpress/8179.001.0001 · Cited by 1,077
Impacts of cooperative adaptive cruise control on freeway traffic flow
Shladover, S. E., Su, D., & Lu, X.-Y. (2012) · Transportation Research Record: Journal of the Transportation Research Board · doi:10.3141/2324-08 · Cited by 887 · cited 1×
“Prior research into AVs has focused predominantly on the design of automation technology [2]–[7], its adoption [8], the impact of AVs on congestion [9], and the legal [10], [11] and regulatory barriers [12]–[15] for AV implementation.”
MethodInternet of vehicles: From intelligent grid to autonomous cars and vehicular clouds
Gerla, M., Lee, E.-K., Pau, G., & Lee, U. (2014) · 2014 IEEE World Forum on Internet of Things (WF-IoT) · doi:10.1109/wf-iot.2014.6803166 · Cited by 828
Autonomous Vehicle Safety: An Interdisciplinary Challenge
Koopman, P., & Wagner, M. (2017) · IEEE Intelligent Transportation Systems Magazine · doi:10.1109/mits.2016.2583491 · Cited by 688 · cited 1×
“How this will be handled in autonomous vehicles remains an open question [50].”
Background
Cited by
Machine Learning Testing: Survey, Landscapes and Horizons
Zhang, J. M., Harman, M., Ma, L., & Liu, Y. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2019.2962027 · Cited by 897
TensorFI: A Flexible Fault Injection Framework for TensorFlow Applications
Chen, Z., Narayanan, N., Fang, B., Li, G., Pattabiraman, K., & DeBardeleben, N. (2020) · 2020 IEEE 31st International Symposium on Software Reliability Engineering (ISSRE) · doi:10.1109/issre5003.2020.00047 · Cited by 93
“ML is also being increasingly deployed in safety-critical applications such as Autonomous Vehicles (AVs) [2] and aircraft control [3].”
BackgroundBinFI: an efficient fault injector for safety-critical machine learning systems
Chen, Z., Li, G., Pattabiraman, K., & DeBardeleben, N. (2019) · Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis · doi:10.1145/3295500.3356177 · Cited by 91
Liu, P., Du, Y., & Xu, Z. (2019) · Accident Analysis & Prevention · doi:10.1016/j.aap.2019.02.012 · Cited by 65
Evaluation of Autonomous Driving Safety by Operational Design Domains (ODD) in Mixed Traffic
Kim, H., Ko, J., Oh, C., & Kim, S. (2024) · Sustainability · doi:10.3390/su16229672 · Cited by 18
“In addition, several studies have been conducted on reaction times for take-over [21–23].”
Metadata
- Authors
- Banerjee, S. S., Jha, S., Cyriac, J., Kalbarczyk, Z. T., & Iyer, R. K.
- Venue
- 2018 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN)
- Publisher
- IEEE
- Published
- 2018-06
- Pages
- 586-597
- OpenAlex
- W2884928388
- Cited by
- 142
- References
- 12
- FWCI
- 26.60
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Hands Off the Wheel in Autonomous Vehicles?: A Systems Perspective on over a Million Miles of Field Data. https://app.cochat.ai/papers/10.1109/dsn.2018.00066
- The paper
- Banerjee, S. S., Jha, S., Cyriac, J., Kalbarczyk, Z. T., & Iyer, R. K. (2018). Hands Off the Wheel in Autonomous Vehicles?: A Systems Perspective on over a Million Miles of Field Data. 2018 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN). https://doi.org/10.1109/dsn.2018.00066
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.