The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
MIT Advanced Vehicle Technology Study: Large-Scale Naturalistic Driving Study of Driver Behavior and Interaction With Automation
Open accessAbstract
Today, and possibly for a long time to come, the full driving task is too complex an activity to be fully formalized as a sensing-acting robotics system that can be explicitly solved through model-based and learning-based approaches in order to achieve full unconstrained vehicle autonomy. Localization, mapping, scene perception, vehicle control, trajectory optimization, and higher-level planning decisions associated with autonomous vehicle development remain full of open challenges. This is especially true for unconstrained, real-world operation where the margin of allowable error is extremely small and the number of edge-cases is extremely large. Until these problems are solved, human beings will remain an integral part of the driving task, monitoring the AI system as it performs anywhere from just over 0% to just under 100% of the driving. The governing objectives of the MIT Advanced Vehicle Technology (MIT-AVT) study are to 1) undertake large-scale real-world driving data collection that includes high-definition video to fuel the development of deep learning-based internal and external perception systems; 2) gain a holistic understanding of how human beings interact with vehicle automation technology by integrating video data with vehicle state data, driver characteristics, mental models, and self-reported experiences with technology; and 3) identify how technology and other factors related to automation adoption and use can be improved in ways that save lives. In pursuing these objectives, we have instrumented 23 Tesla Model S and Model X vehicles, 2 Volvo S90 vehicles, 2 Range Rover Evoque, and 2 Cadillac CT6 vehicles for both long-term (over a year per driver) and medium-term (one month per driver) naturalistic driving data collection. Furthermore, we are continually developing new methods for the analysis of the massive-scale dataset collected from the instrumented vehicle fleet. The recorded data streams include IMU, GPS, and CAN messages, and high-definition video streams of the driver's face, the driver cabin, the forward roadway, and the instrument cluster (on select vehicles). The study is on-going and growing. To date, we have 122 participants, 15610 days of participation, 511638 mi, and 7.1 billion video frames. This paper presents the design of the study, the data collection hardware, the processing of the data, and the computer vision algorithms currently being used to extract actionable knowledge from the data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
Multiple View Geometry in Computer Vision
Hartley, R., & Zisserman, A. (2004) · doi:10.1017/cbo9780511811685 · Cited by 21,070
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897
The Cityscapes Dataset for Semantic Urban Scene Understanding
Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., & Schiele, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.350 · Cited by 12,433 · cited 1×
“2 billion frames would require an incredible investment [20].”
BackgroundVision meets robotics: The KITTI dataset
Geiger, A., Lenz, P., Stiller, C., & Urtasun, R. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913491297 · Cited by 9,913 · cited 3×
“Leveraging the release large-scale annotated driving datasets [35], [38], automotive deep learning research aims to address detection, estimation, prediction, labeling, generation, control, and planning tasks.”
BackgroundDeformable Convolutional Networks
Dai, J., Qi, H., Xiong, Y., Li, Y., Zhang, G., Hu, H., & Wei, Y. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.89 · Cited by 7,513 · cited 1×
“Successful methods [30], [33], [34] jointly model the two tasks together and simultaneously output bounding boxes and masks of objects.”
MethodLabelMe: A Database and Web-Based Tool for Image Annotation
Russell, B. C., Torralba, A., Murphy, K. P., & Freeman, W. T. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0090-8 · Cited by 4,210
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2844175 · Cited by 3,457
Research works printed but not linked: 46
- 10.1109/CVPR.2017.660 · DOI · Paper page
- 10.1007/978-3-319-10602-1_48 · DOI · Paper page
- 10.1007/s11263-015-0816-y · DOI · Paper page
- bojarski, 2016, End to end learning for self-driving cars, arXiv 1604 07316 [cs]
- 2016, Advanced Vehicle Technology Consortium (AVT)
- li, 2008, A design for automotive CAN bus monitoring system, Proc IEEE Veh Power Propuls Conf, 1
- 10.1093/ijl/3.4.235 · DOI · Paper page
- 10.17077/drivingassessment.1294 · DOI
- davies, 2015, Oh Look More Evidence Humans Shouldn’t Be Driving
- 10.3141/2663-15 · DOI
- 10.17077/drivingassessment.1571 · doi:10.17077/drivingassessment.1571
- 10.3141/2061-01 · DOI
- fridman, 2017, Arguing machines: Human supervision of black box AI systems that make life-critical decisions, arXiv 1710 04459
- goodfellow, 2016, Deep Learning
- 10.1109/TITS.2015.2396031 · DOI · Paper page
- 10.1109/ICIP.2014.7026203 · DOI · Paper page
- 10.1109/CVPR.2017.376 · DOI · Paper page
- zhou, 2014, Learning deep features for scene recognition using places database, Proc Int Conf Neural Inf Process, 487
- 10.1109/TITS.2013.2262098 · DOI · Paper page
- sadigh, 2014, Data-driven probabilistic modeling and verification of human driver behavior, Formal Verification and Modeling in Human-Machine Systems, 1
- tompson, 2014, Joint training of a convolutional network and a graphical model for human pose estimation, Proc 27th Int Conf Neural Inf Process Syst, 1799
- 10.1109/CVPR.2014.214 · DOI · Paper page
- 10.1145/2398356.2398381 · DOI · Paper page
- abdic, 2016, Driver frustration detection from audio and video in the wild, Proc 39th Annu German Conf AI Adv Artif Intell KI, 9904, 237
- barry, 2011, Too Much Safety Could Make Drivers Less Safe
- neale, 2005, An overview of the 100-car naturalistic study and findings
- wang, 2017, Understanding convolution for semantic segmentation, arXiv 1702 08502
- dingus, 2006, The 100-car naturalistic driving study, phase II-results of the 100-car field experiment, 10.1037/e624282011-001 · DOI · Paper page
- klauer, 2006, The impact of driver inattention on near-crash/crash risk: An analysis using the 100-car naturalistic driving study data, 10.1037/e729262011-001 · DOI · Paper page
- benmimoun, 0, Incident detection based on vehicle CAN-data within the large scale field operational test ‘euroFOT, Proc 22nd Tech Conf Enhanced Safety Veh, 1
- 10.1109/MIS.2016.47 · doi:10.1109/mis.2016.47
- 10.1049/iet-cvi.2015.0296 · doi:10.1049/iet-cvi.2015.0296
- 10.1007/978-3-642-03991-1 · DOI · Paper page
- 2015, Global status report on road safety 2015
- 10.1371/journal.pone.0184952 · DOI · Paper page
- 10.1518/001872095779064555 · DOI · Paper page
- 10.1145/3025453.3025929 · DOI
- 10.1093/ppar/prt006 · DOI
- 10.1145/2818346.2830595 · DOI · Paper page
- 10.1109/CVPR.2014.233 · DOI · Paper page
- wi?niewska, 2014, Robust eye gaze estimation, Proc Int Conf Comput Vis Graph, 636
- 10.1038/71152 · DOI · Paper page
- 10.1016/j.patrec.2008.04.005 · DOI · Paper page
- 10.1109/ICCV.2017.378 · DOI · Paper page
- 10.1109/CVPR.2010.5540054 · DOI
- 10.1109/CVPR.2015.7299143 · DOI · Paper page
Cited by
Secure, privacy-preserving and federated machine learning in medical imaging
Kaissis, G. A., Makowski, M. R., Rückert, D., & Braren, R. F. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0186-1 · Cited by 1,676
SPINN: synergistic progressive inference of neural networks over device and cloud
Laskaridis, S., Venieris, S. I., Almeida, M., Leontiadis, I., & Lane, N. D. (2020) · Proceedings of the 26th Annual International Conference on Mobile Computing and Networking · doi:10.1145/3372224.3419194 · Cited by 310
Neural circuit policies enabling auditable autonomy
Lechner, M., Hasani, R., Amini, A., Henzinger, T. A., Rus, D., & Grosu, R. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-00237-3 · Cited by 308
Urban artificial intelligence: from automation to autonomy in the smart city
Cugurullo, F. (2020) · Frontiers in Sustainable Cities · doi:10.3389/frsc.2020.00038 · Cited by 290
“In fact, although the technology of autonomous driving is rapidly progressing, severe technological limitations currently exist which are limiting both its employment in real-life environments and people’s trust in it (Fridman et al., 2019).”
BackgroundEvaluating progress in automatic chest X-ray radiology report generation
Yu, F., Endo, M., Krishnan, R., Pan, I., Tsai, A., Reis, E. P., Fonseca, E. K. U. N., Lee, H. M. H., Abad, Z. S. H., Ng, A. Y., et al. (2023) · Patterns · doi:10.1016/j.patter.2023.100802 · Cited by 200
The transition to autonomous cars, the redesign of cities and the future of urban sustainability
Cugurullo, F., Acheampong, R. A., Gueriau, M., & Dusparic, I. (2021) · Urban Geography · doi:10.1080/02723638.2020.1746096 · Cited by 151
Metadata
- Authors
- Fridman, L., Brown, D. E., Glazer, M., Angell, W., Dodd, S., Jenik, B., Terwilliger, J., Patsekin, A., Kindelsberger, J., Ding, L., Seaman, S., Mehler, A., Sipperley, A., Pettinato, A., Seppelt, B. D., Angell, L., Mehler, B., & Reimer, B.
- Venue
- IEEE Access
- Published
- 2019
- Volume
- 7
- Pages
- 102021-102038
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W2959716684
- Cited by
- 236
- References
- 15
- FWCI
- 40.21
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.