The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
The Architectural Implications of Autonomous Driving: Constraints and Acceleration
Abstract
Autonomous driving systems have attracted a significant amount of interest recently, and many industry leaders, such as Google, Uber, Tesla, and Mobileye, have invested a large amount of capital and engineering power on developing such systems. Building autonomous driving systems is particularly challenging due to stringent performance requirements in terms of both making the safe operational decisions and finishing processing at real-time. Despite the recent advancements in technology, such systems are still largely under experimentation and architecting end-to-end autonomous driving systems remains an open research question. To investigate this question, we first present and formalize the design constraints for building an autonomous driving system in terms of performance, predictability, storage, thermal and power. We then build an end-to-end autonomous driving system using state-of-the-art award-winning algorithms to understand the design trade-offs for building such systems. In our real-system characterization, we identify three computational bottlenecks, which conventional multicore CPUs are incapable of processing under the identified design constraints. To meet these constraints, we accelerate these algorithms using three accelerator platforms including GPUs, FPGAs, and ASICs, which can reduce the tail latency of the system by 169x, 10x, and 93x respectively. With accelerator-based designs, we are able to build an end-to-end autonomous driving system that meets all the design constraints, and explore the trade-offs among performance, power and the higher accuracy enabled by higher resolution cameras.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
YOLO9000: Better, Faster, Stronger
Redmon, J., & Farhadi, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.690 · Cited by 19,892
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897
ORB-SLAM: A Versatile and Accurate Monocular SLAM System
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015) · IEEE Transactions on Robotics · doi:10.1109/tro.2015.2463671 · Cited by 6,778
A benchmark for the evaluation of RGB-D SLAM systems
Sturm, J., Engelhard, N., Endres, F., Burgard, W., & Cremers, D. (2012) · 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2012.6385773 · Cited by 3,976
Speed of processing in the human visual system
Thorpe, S., Fize, D., & Marlot, C. (1996) · Nature · doi:10.1038/381520a0 · Cited by 3,538
ORB-SLAM: A Versatile and Accurate Monocular SLAM System
Mur-Artal, R., Montiel, J. M. M., & Tardos, J. D. (2015) · Zaguan (Universidad de Zaragoza) · Cited by 3,153
EIE: efficient inference engine on compressed deep neural network
Han, S., Liu, X., Mao, H., Pu, J., Pedram, A., Horowitz, M. A., & Dally, W. J. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001163 · Cited by 1,937
DianNao: a small-footprint high-throughput accelerator for ubiquitous machine-learning
Chen, T., Du, Z., Sun, N., Wang, J., Wu, C., Chen, Y., & Temam, O. (2014) · Proceedings of the 19th international conference on Architectural support for programming languages and operating systems · doi:10.1145/2541940.2541967 · Cited by 1,297
ShiDianNao: shifting vision processing closer to the sensor
Du, Z., Fasthuber, R., Chen, T., Ienne, P., Li, L., Luo, T., Feng, X., Chen, Y., & Temam, O. (2015) · Proceedings of the 42nd Annual International Symposium on Computer Architecture · doi:10.1145/2749469.2750389 · Cited by 933
The Changing Automotive Environment: High-Temperature Electronics
Johnson, R. W., Evans, J. L., Jacobsen, P., Thompson, J. R. R., & Christopher, M. (2004) · IEEE Transactions on Electronics Packaging Manufacturing · doi:10.1109/tepm.2004.843109 · Cited by 869
Visual-lidar odometry and mapping: low-drift, robust, and fast
Zhang, J., & Singh, S. (2015) · 2015 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2015.7139486 · Cited by 747
Cnvlutin: ineffectual-neuron-free deep neural network computing
Albericio, J., Judd, P., Hetherington, T., Aamodt, T., Jerger, N. E., & Moshovos, A. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001138 · Cited by 614
Safe, Multi-Agent, Reinforcement Learning for Autonomous Driving
Shalev-Shwartz, S., Shammah, S., & Shashua, A. (2016) · arXiv · doi:10.48550/arxiv.1610.03295 · Cited by 509 · cited 11×
“the industry standards recently published by Mobileye [62] and the design speciications from Udacity [72].”
MethodInfluentialYOLO9000: Better, Faster, Stronger
Redmon, J., & Farhadi, A. (2016) · arXiv · doi:10.48550/arxiv.1612.08242 · Cited by 488
Map-Based Precision Vehicle Localization in Urban Environments
Levinson, J., Montemerlo, M., & Thrun, S. (2007) · Robotics: Science and Systems III · doi:10.15607/rss.2007.iii.016 · Cited by 477 · cited 1×
“, precision at decimeter-level is needed to keep the vehicle staying in certain lanes [40]) and the spacial accessibility [5] to localize the vehicle (step 1b in Figure 1) for autonomous driving tasks.”
BackgroundAmer, N. H., Zamzuri, H., Hudha, K., & Kadir, Z. A. (2017) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-016-0442-0 · Cited by 397
Visual localization within LIDAR maps for automated urban driving
Wolcott, R. W., & Eustice, R. M. (2014) · 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2014.6942558 · Cited by 374
The Prospects for Psychological Science in Human-Computer Interaction
Newell, A., & Card, S. K. (1985) · Human–Computer Interaction · doi:10.1207/s15327051hci0103_1 · Cited by 370
Motion planning for autonomous driving with a conformal spatiotemporal lattice
McNaughton, M., Urmson, C., Dolan, J. M., & Lee, J.-W. (2011) · 2011 IEEE International Conference on Robotics and Automation · doi:10.1109/icra.2011.5980223 · Cited by 363
vDNN: Virtualized deep neural networks for scalable, memory-efficient neural network design
Rhu, M., Gimelshein, N., Clemons, J., Zulfiqar, A., & Keckler, S. W. (2016) · 2016 49th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2016.7783721 · Cited by 338
Caffeine: towards uniformed representation and acceleration for deep convolutional neural networks
Zhang, C., Fang, Z., Zhou, P., Pan, P., & Cong, J. (2016) · Proceedings of the 35th International Conference on Computer-Aided Design · doi:10.1145/2966986.2967011 · Cited by 299
PuDianNao: A Polyvalent Machine Learning Accelerator
Liu, D., Chen, T., Liu, S., Zhou, J., Zhou, S., Teman, O., Feng, X., Zhou, X., & Chen, Y. (2015) · Proceedings of the Twentieth International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/2694344.2694358 · Cited by 240
Cnvlutin: Ineffectual-Neuron-Free Deep Neural Network Computing
Albericio, J., Judd, P., Hetherington, T., Aamodt, T., Jerger, N. E., & Moshovos, A. (2016) · 2016 ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca.2016.11 · Cited by 226
Farrington, R. B., & Rugh, J. P. (2000) · University of North Texas Digital Library (University of North Texas) · Cited by 203
Fast LIDAR localization using multiresolution Gaussian mixture maps
Wolcott, R. W., & Eustice, R. M. (2015) · 2015 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2015.7139582 · Cited by 188
McGehee, D. V., Mazzae, E. N., & Baldwin, G. H. S. (2000) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120004402026 · Cited by 178
Comprehensive Modeling of Vehicle Air Conditioning Loads Using Heat Balance Method
Fayazbakhsh, M. A., & Bahrami, M. (2013) · SAE Technical Paper Series · doi:10.4271/2013-01-1507 · Cited by 170
TABLA: A unified template-based framework for accelerating statistical machine learning
Mahajan, D., Park, J., Amaro, E., Sharma, H., Yazdanbakhsh, A., Kim, J. K., & Esmaeilzadeh, H. (2016) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2016.7446050 · Cited by 157
Life cycle approach to sustainability assessment: a case study of remanufactured alternators
Schau, E. M., Traverso, M., & Finkbeiner, M. (2012) · Journal of remanufacturing · doi:10.1186/2210-4690-2-5 · Cited by 112
Neuromorphic accelerators: a comparison between neuroscience and machine-learning approaches
Du, Z., Rubin, D. B. D., Chen, Y., He, L., Chen, T., Zhang, L., Wu, C., & Temam, O. (2015) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1145/2830772.2830789 · Cited by 96
Stewart, A. D., & Newman, P. M. (2012) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2012.6224750 · Cited by 60
Hill, P., Jain, A., Hill, M., Zamirai, B., Hsu, C.-H., Laurenzano, M. A., Mahlke, S. A., Tang, L., & Mars, J. (2017) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1145/3123939.3123970 · Cited by 59
Self-citationNEUTRAMS: neural network transformation and co-design under neuromorphic hardware constraints
Ji, Y., Zhang, Y., Li, S., Chi, P., Jiang, C., Qu, P., Xie, Y., & Chen, W. (2016) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.5555/3195638.3195663 · Cited by 57
Self-citationShallow Networks for High-accuracy Road Object-detection
Ashraf, K. M., Wu, B., Iandola, F., Moskewicz, M. W., & Keutzer, K. (2017) · International Conference on Vehicle Technology and Intelligent Transport Systems (VEHITS) · doi:10.5220/0006214900330040 · Cited by 55
An ultra low-power hardware accelerator for automatic speech recognition
Yazdani, R., Segura, A., Arnau, J.-M., & González, A. M. (2016) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2016.7783750 · Cited by 49
Distraction suppression for vision-based pose estimation at city scales
McManus, C., Churchill, W., Napier, A. A., Davis, B., & Newman, P. M. (2013) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2013.6631106 · Cited by 25
Generation and exploitation of local orthographic imagery for road vehicle localisation
Napier, A. A., & Newman, P. M. (2012) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2012.6232165 · Cited by 24
Cited by
Edge Computing for Autonomous Driving: Opportunities and Challenges
Liu, S., Liu, L., Tang, J., Yu, B., Wang, Y., & Shi, W. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2915983 · Cited by 778
Toward an Intelligent Edge: Wireless Communication Meets Machine Learning
Zhu, G., Liu, D., Du, Y., You, C., Zhang, J., & Huang, K. (2020) · IEEE Communications Magazine · doi:10.1109/mcom.001.1900103 · Cited by 606
Mobile Edge Intelligence and Computing for the Internet of Vehicles
Zhang, J., & Letaief, K. B. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2947490 · Cited by 537
Milestones in Autonomous Driving and Intelligent Vehicles: Survey of Surveys
Chen, L., Li, Y., Huang, C., Li, B., Xing, Y., Tian, D., Li, L., Hu, Z., Na, X., Li, Z., et al. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2022.3223131 · Cited by 511
Edge-Computing-Enabled Smart Cities: A Comprehensive Survey
Khan, L. U., Yaqoob, I., Tran, N. H., Kazmi, S. M. A., Dang, T. N., & Hong, C. S. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2987070 · Cited by 475
Metadata
- Authors
- Lin, S.-C., Zhang, Y., Hsu, C.-H., Skach, M., Haque, M. E., Tang, L., & Mars, J.
- Venue
- Proceedings of the Twenty-Third International Conference on Architectural Support for Programming Languages and Operating Systems
- Publisher
- ACM
- Published
- 2018-03-19
- Pages
- 751-766
- OpenAlex
- W2791175987
- Cited by
- 367
- References
- 38
- FWCI
- 42.99
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.