A Survey of Autonomous Driving: Common Practices and Emerging Technologies
Open accessThe DOI matches its Crossref record; 332 of the 359 references it cites were found in a registry or an index; 64 of the 183 sources its claims cite were checked for support.
Abstract
Automated driving systems (ADSs) promise a safe, comfortable and efficient driving experience. However, fatalities involving vehicles equipped with ADSs are on the rise. The full potential of ADSs cannot be realized unless the robustness of state-of-the-art is improved further. This paper discusses unsolved problems and surveys the technical aspect of automated driving. Studies regarding present challenges, high-level system architectures, emerging methodologies and core functions including localization, mapping, perception, planning, and human machine interfaces, were thoroughly reviewed. Furthermore, many state-of-the-art algorithms were implemented and compared on our own platform in a real-world driving setting. The paper concludes with an overview of available datasets and tools for ADS development.
Overview
CoChat Summary
TL;DR
This survey reviews automated driving systems (ADSs), covering architectures, localization/mapping, perception, assessment, planning, human-machine interaction, datasets, and tools, while also implementing and comparing state-of-the-art algorithms on the authors’ own vehicle in real-world driving. It concludes that robust urban automation and level 4/5 driving remain unsolved, with open problems in sensing, assessment, connectivity, weather robustness, and HMI.
Key findings
- ADSs promise safety and efficiency: 94% of road accidents are attributed to human errors, and annual social benefits are projected to reach nearly $800 billion by 2050; owned-to-shared vehicles are expected to reach 50:50 by 2030.
- Most state-of-the-art ADSs are ego-only and modular; modular pipelines risk error propagation (e.g., a Tesla perception error misclassifying a white trailer as sky led to the first ADS-related fatality), while end-to-end driving lacks hard-coded safety and interpretability and has not been implemented in real-world urban scenes except limited demonstrations.
- Localization: GPS-IMU alone does not meet performance criteria; SLAM can work anywhere but is less efficient than a priori map-based localization; point cloud matching is state-of-the-art, but map-based methods require map-making and are affected by environmental changes.
- Perception and planning: cameras are common but illumination-sensitive; lidar is accurate under 200 m but affected by weather and size; radar is long-range and cheap but low-resolution; event cameras have microsecond response but low resolution (DAVIS240: 240 × 180, 18.5 × 18.5 µm). Deep learning dominates detection (YOLO at 45 FPS full / 155 FPS smaller; Mask R-CNN at 5 fps), while global route planning is mature and local planning, risk assessment, driving-style recognition, and HMI handover remain open.
Methods
- Design: a structured, comprehensive survey of ADS hardware-software practices, covering present challenges, high-level system architectures, core functions (localization, mapping, perception, assessment, planning, HMI), and available datasets, software stacks, and simulators.
- Implementation/comparison: the authors implemented and compared state-of-the-art algorithms on their own ADS-equipped platform in real-world driving, using open-source software such as Autoware and OpenPlanner, and algorithms including NDT matching, YOLOv3, Mask R-CNN, DeepLabv3, SECOND, particle-filter tracking, and a deep spatiotemporal risk-detection framework.
- Data/sample: no human-subject sample is described; the work uses the authors’ vehicle and campus/real-world data plus existing datasets and benchmarks such as KITTI, nuScenes, COCO, Cityscapes, Oxford RobotCar, SHRP2, Comma.ai, and DDD17.
Limitations
- Stated in the paper: robust automated driving in urban environments has not been achieved; no production vehicle is capable of level 4 or level 5 automation; no operational connected ADS exists; the optimal sensing modality is still disputed; algorithms lack accuracy and efficiency; online assessment is needed; poor road conditions and intemperate weather remain open; V2V communication is in its infancy; HMI is under-researched; end-to-end driving lacks hard-coded safety and interpretability; deep-learning planners are not widely used in real-world systems; and a priori map-based localization requires map-making and is affected by environmental changes.
- Evident from the text: the implementation/comparison is limited to the authors’ own platform and campus/real-world setting rather than a systematic benchmark across all surveyed methods, and the survey is narrative rather than a formal systematic review.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures





![FIGURE 6 We used NDT matching [101], [118] to localize our vehicle in the Nagoya University campus. White points belong to the offline pre-built map and the colored ones were obtained from online scans. The objective is to find the best match between colored points and white points, thus localizing the vehicle.](https://figures.cochat.ai/paper-figures/c2e4eb4ca0094a05a07abdbc429b0543/a-survey-of-autonomous-driving-i-common-practices-and-emerging-technologies-i-figure-6.png)
![FIGURE 7 Creating a 3D pointcloud map with congregation of scans. We used Autoware [122] for mapping.](https://figures.cochat.ai/paper-figures/97352e2cf83346aab58bfb2a41a7c46e/a-survey-of-autonomous-driving-i-common-practices-and-emerging-technologies-i-figure-7.png)
![FIGURE 8 An urban scene near Nagoya University, with camera and lidar data collected by our experimental vehicle and object detection outputs from state-of-the-art perception algorithms. (a) A front facing camera's view, with bounding box results from YOLOv3 [128] and (b) instance segmentation results from MaskRCNN [138]. (c) Semantic segmentation masks produced by DeepLabv3 [139]. (d) The 3D Lidar data with object detection results from SECOND [140]. Amongst the four, only the 3D perception algorithm outputs range to detected objects.](https://figures.cochat.ai/paper-figures/c0084d02810541888d12472c00a50147/a-survey-of-autonomous-driving-i-common-practices-and-emerging-technologies-i-figure-8.png)

![FIGURE 10 A depth image produced from synthetic lidar data, generated in the CARLA [164] simulator.](https://figures.cochat.ai/paper-figures/65fc60d94d964e22a80057c0eb57ad7e/a-survey-of-autonomous-driving-i-common-practices-and-emerging-technologies-i-figure-10.png)
![FIGURE 11 Bird's eye view perspective of 3D lidar data, a sample from the KITTI dataset [177].](https://figures.cochat.ai/paper-figures/a1cc2cab140e406d89b71406f1b01684/a-survey-of-autonomous-driving-i-common-practices-and-emerging-technologies-i-figure-11.png)

![FIGURE 13 Annotating a 3D point cloud map with topological information. A large number of annotators were employed to build the map shown on the right-hand side. The point-cloud and annotated maps are available on [197].](https://figures.cochat.ai/paper-figures/69ca5f24e0724af990cc82d611b48b4a/a-survey-of-autonomous-driving-i-common-practices-and-emerging-technologies-i-figure-13.png)



![FIGURE 15 Global plan and the local paths. The annotated vector map shown in Figure 13 was utilized by the planner. We employed OpenPlanner [219], which is a graph-based planner, to illustrate a typical planning approach.](https://figures.cochat.ai/paper-figures/873fe6637e604072911645a23054fa06/a-survey-of-autonomous-driving-i-common-practices-and-emerging-technologies-i-figure-15.png)




Verification
Claims the paper makes
26 Valid · 65 Not valid · 82 Not checked · 129 Own results and interpretations
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“The first convincing results for point cloud-only 3D bounding box estimation were produced by VoxelNet [167].”
§ A Survey of Autonomous Driving: Common Practices and Emerging Technologies > 3) 3D OBJECT DETECTION
What the sources say
- Disputedcites [167] 167. D. Z. Wang and I. Posner, ''Voting for voting in online point cloud object detection,'' in Proc. Robot., Sci. Syst., Jul. 2015, pp. 1-9. sourceExperimental — accuracy not yet measured
The cited 2015 paper does not identify VoxelNet as producing the first convincing results. Its Related Works section says its own detector operates solely on 3D data, and its Evaluation section describes 3D bounding-box annotations and reports superior detection performance. Those passages run contrary to attributing the first such results to VoxelNet. (LLM, conf=0.86)
Checked by a reasoning model — may be wrong.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Developing individual modules separately divides the challenging task of automated driving into an easier-to-solve set of problems [69].”
§ A Survey of Autonomous Driving: Common Practices and Emerging Technologies > 2) MODULAR SYSTEMS
What the sources say
- Partly supportedcites [69] 69. L. Chi and Y. Mu, ''Deep steering: Learning end-to-end driving model from spatial and temporal visual cues,'' 2017, arXiv:1708.03798. [Online]. Available: http://arxiv.org/abs/1708.03798 sourceExperimental — accuracy not yet measured
The Introduction (page unavailable) describes automated driving as challenging and presents Apollo’s modular architecture as a way to address those difficulties, with distinct modules for perception, prediction, planning, and control. It does not say that developing those modules separately turns the overall task into easier-to-solve problems. (LLM, conf=0.82)
states a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“However, a survey that covers: present challenges, available and emerging high-level system architectures, individual core functions such as localization, mapping, perception, planning, vehicle control, and human-machine interface altogether does not exist.”
§ A Survey of Autonomous Driving: Common Practices and Emerging Technologies > I. INTRODUCTION
What the sources say
- Not checked — no full text of the sourcecites [15] 15. J. Levinson, J. Askeland, J. Becker, J. Dolson, D. Held, S. Kammel, J. Z. Kolter, D. Langer, O. Pink, V. Pratt, M. Sokolsky, G. Stanek, D. Stavens, A. Teichman, M. Werling, and S. Thrun, ''Towards fully autonomous driving: Systems and algorithms,'' in Proc. IEEE Intell. Vehicles Symp. (IV), Jun. 2011, pp. 163-168. source
- Could not verifycites [16] 16. M. Campbell, M. Egerstedt, J. P. How, and R. M. Murray, ''Autonomous driving in urban environments: Approaches, lessons and challenges,'' Phil. Trans. Roy. Soc. A, Math., Phys. Eng. Sci., vol. 368, no. 1928, pp. 4649-4672, Oct. 2010. sourceExperimental — accuracy not yet measured
The Introduction discusses a gap in multimodal autonomous-driving datasets, not a gap in surveys. Searches for comprehensive surveys, system architectures, and human-machine interfaces found no passage assessing whether a survey covering all the listed topics exists. (LLM, conf=0.76)
- Not checked — no full text of the sourcecites [18] 18. B. Paden, M. Cap, S. Z. Yong, D. Yershov, and E. Frazzoli, ''A survey of motion planning and control techniques for self-driving urban vehicles,'' IEEE Trans. Intell. Vehicles, vol. 1, no. 1, pp. 33-55, Mar. 2016.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Furthermore, these design philosophies are realized with two alternative approaches: modular [15], [47], [51]- [58] or endto-end driving [59]- [67].”
§ A Survey of Autonomous Driving: Common Practices and Emerging Technologies > A. SYSTEM ARCHITECTURE
What the sources say
- Not checked — no full text of the sourcecites [15] 15. J. Levinson, J. Askeland, J. Becker, J. Dolson, D. Held, S. Kammel, J. Z. Kolter, D. Langer, O. Pink, V. Pratt, M. Sokolsky, G. Stanek, D. Stavens, A. Teichman, M. Werling, and S. Thrun, ''Towards fully autonomous driving: Systems and algorithms,'' in Proc. IEEE Intell. Vehicles Symp. (IV), Jun. 2011, pp. 163-168. source
- Partly supportedcites [47] 47. C. Urmson et al., ''Autonomous driving in urban environments: Boss and the urban challenge,'' J. Field Robot., vol. 25, no. 8, pp. 425-466, 2008. sourceExperimental — accuracy not yet measured
Section 4, “3D Detection with Frustum PointNets” (page unavailable), describes a three-module object-detection pipeline, supporting its use as an example of modular design. The paper does not present a modular driving system or establish modular and end-to-end driving as the two alternative approaches. (LLM, conf=0.82)
- Not matchedcites [51]- [58]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Ego-only is the most common approach amongst the state-of-the-art ADSs [15], [47], [51]- [56], [56]- [58].”
§ A Survey of Autonomous Driving: Common Practices and Emerging Technologies > 1) EGO-ONLY SYSTEMS
What the sources say
- Not checked — no full text of the sourcecites [15] 15. J. Levinson, J. Askeland, J. Becker, J. Dolson, D. Held, S. Kammel, J. Z. Kolter, D. Langer, O. Pink, V. Pratt, M. Sokolsky, G. Stanek, D. Stavens, A. Teichman, M. Werling, and S. Thrun, ''Towards fully autonomous driving: Systems and algorithms,'' in Proc. IEEE Intell. Vehicles Symp. (IV), Jun. 2011, pp. 163-168. source
- Partly supportedcites [47] 47. C. Urmson et al., ''Autonomous driving in urban environments: Boss and the urban challenge,'' J. Field Robot., vol. 25, no. 8, pp. 425-466, 2008. sourceExperimental — accuracy not yet measured
The Figure 1 pipeline description (SUN-RGBD visualizations; page unavailable) describes a 3D detector that takes RGB-D data as input, so the paper supports an example of an ego-only perception approach. The Introduction (page unavailable) reports its performance on detection benchmarks, but the paper does not establish that ego-only is the most common approach among state-of-the-art autonomous driving systems. (LLM, conf=0.82)
- Not matchedcites [51]- [56]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
78 more claims · 19 with their cited sources checked
Create a free account to see all 302 claims and every source verdict.
- It may state two separate claims as one. 114
- Probably not a substantial claim. 162
- Borderline: one of the tests for a substantial claim is unclear. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Autonomous driving has the potential to radically change the cityscape and save many human lives [78].”
From nuScenes: A Multimodal Dataset for Autonomous Driving (2020) · cites this paper as [78]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ A Survey of Autonomous Driving: Common Practices and Emerging Technologies > 3) EVENT CAMERAS
“For example, the DAVIS40 image shown in Figure 4 has a pixel size of 18.5×18.5µm and a resolution of 240 × 180.”
§ A Survey of Autonomous Driving: Common Practices and Emerging Technologies > X. CONCLUSIONS
“FIGURE 4. DAVIS240 events, overlayed on the image (left) and corresponding RBG image from a different camera (right), collected by our data collection platform, at a road crossing near Nagoya University.”
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 1×
“9 Inception v4 [127] 41 75 5 ResNet101 [128] 45 100 6.”
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148 · cited 1×
“Another widely used algorithm, even faster than YOLO, is the Single Shot Detector (SSD) [138], which uses standard DCNN architectures such as VGG [131] to achieve competitive results on public benchmarks.”
MethodImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404 · cited 1×
“nation of convolutions, for feature extractions, followed by deconvolutions, also called transposed convolutions, to obtain pixel resolution labels [152], [153].”
BackgroundFaster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472 · cited 2×
“The aforementioned Mask R-CNN [124] is a generalization of Faster R-CNN [151].”
MethodFaster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · cited 2×
“In 2012, the deep convolutional neural network (DCNN) AlexNet [12] shattered the ImageNet image recognition challenge [132].”
BackgroundYou Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803 · cited 3×
“Once surfaces are estimated, model fitting is used to establish the continuity of the road and lanes.”
BackgroundDensely Connected Convolutional Networks
Huang, G., Liu, Z., van der Maaten, L., & Weinberger, K. Q. (2016) · arXiv · doi:10.48550/arxiv.1608.06993 · Cited by 48,960
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566 · cited 1×
“ational cost of the algorithm. Architecture Num. Params Num. ImageNet1K ( 106) Layers Top 5 Error % Incept.ResNet v2 [127] 30 95 4.9 Inception v4 [127] 41 75 5 ResNet101 [128] 45 100 6.05 DenseNet201 [129] 18 200 6.34 YOLOv3-608 [123] 63 53+1 6.2 ResNet50 [128] 26 49 6.7 GoogLeNet [130] 6 22 6.7 VGGNet16 [131] 134 13+…”
InfluentialGoing deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562 · cited 1×
“ers Top 5 Error % Incept.ResNet v2 [127] 30 95 4.9 Inception v4 [127] 41 75 5 ResNet101 [128] 45 100 6.05 DenseNet201 [129] 18 200 6.34 YOLOv3-608 [123] 63 53+1 6.2 ResNet50 [128] 26 49 6.7 GoogLeNet [130] 6 22 6.7 VGGNet16 [131] 134 13+2 6.8 AlexNet [12] 57 5+2 15.3 prior. Camera based localization approaches can bec…”
InfluentialMicrosoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460 · cited 3×
“More recent versions of this method, YOLOv2, YOLO9000 [137] and YOLOv3 [123] briefly took over the PASCAL VOC and MS COCO benchmarks while maintaining low computation and memory cost.”
BackgroundMethodFully convolutional networks for semantic segmentation
Long, J., Shelhamer, E., & Darrell, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298965 · Cited by 38,834 · cited 1×
“More recently, machine learningbased methods which either fuse maps with vision [196] or use fully appearance-based segmentation [205] have been used.”
(2016) · Cited by 31,590
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357 · cited 1×
“This raises an import design question: should the ADS drive like a human? A novel deep reinforcement learning model, Deep Q Networks (DQN), combined reinforcement learning with deep learning [69].”
BackgroundHe, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
SSD: Single Shot MultiBox Detector
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2015) · arXiv · doi:10.48550/arxiv.1512.02325 · Cited by 22,443
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392 · cited 1×
“[155], with the most recent version being the current state-ofthe-art for object segmentation [125].”
BackgroundChen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018) · arXiv · doi:10.48550/arxiv.1802.02611 · Cited by 20,063
Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_49 · Cited by 20,054 · cited 3×
“(c ) Semantic segmentation masks produced by DeepLabv3 [125].”
BackgroundYOLO9000: Better, Faster, Stronger
Redmon, J., & Farhadi, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.690 · Cited by 19,892 · cited 3×
“More recent versions of this method, YOLOv2, YOLO9000 [137] and YOLOv3 [123] briefly took over the PASCAL VOC and MS COCO benchmarks while maintaining”
BackgroundMethodYOLOv3: An Incremental Improvement
Redmon, J., & Farhadi, A. (2018) · arXiv · doi:10.48550/arxiv.1804.02767 · Cited by 17,141 · cited 5×
“More recent versions of this method, YOLOv2, YOLO9000 [137] and YOLOv3 [123] briefly took over the PASCAL VOC and MS COCO benchmarks while maintaining low computation and memory cost.”
BackgroundMethodInfluentialZhao, H., Shi, J., Qi, X., Wang, X., & Jia, J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.660 · Cited by 16,438 · cited 1×
“Feature pyramid networks are also commonly used, for example in PSPNet [154], which also introduced dilated convolutions for segmentation.”
MethodAre we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897 · cited 8×
“State-of-the-art algorithms are currently being evaluated on the KITTI dataset [174] and nuScenes dataset [175] as they offer labeled 3D scenes.”
BackgroundMethodInfluentialA Multi-Modal Distributed Real-Time IoT System for Urban Traffic Control (Invited Paper)
Khanam, Z., Achari, V. P. S., Boukhennoufa, I., Jindal, A., & Singh, A. K. (2024) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/oasics.ng-res.2024.2 · Cited by 14,040
A Formal Basis for the Heuristic Determination of Minimum Cost Paths
Hart, P., Nilsson, N., & Raphael, B. (1968) · IEEE Transactions on Systems Science and Cybernetics · doi:10.1109/tssc.1968.300136 · Cited by 12,738 · cited 3×
“Graph search Dijkstra [250], A* [245], State lattice [251] Slow and jerky”
BackgroundMethodThe Cityscapes Dataset for Semantic Urban Scene Understanding
Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., & Schiele, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.350 · Cited by 12,433 · cited 2×
“Cityscapes [270] X X Vehicle Berkley DeepDrive [271] X X Vehicle X X Mapillary [272] X X Vehicle X X Oxford RobotCar [49] X X Vehicle X X X KITTI [174] X X X X Vehicle H3D [273] X X X Vehicle ApolloScape [274] X X X X Vehicle nuScenes [175] X X X X Vehicle X X Udacity [275] X X X X Vehicle DDD17 [85] X X X Vehicle X X…”
BackgroundMethodShi, J., & Tomasi (1994) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94 · doi:10.1109/cvpr.1994.323794 · Cited by 7,724 · cited 1×
“the use of color histograms, gradients and other features such as KLT to evaluate the similarity [182].”
MethodnuScenes: A Multimodal Dataset for Autonomous Driving
Caesar, H., Bankiti, V., Lang, A. H., Vora, S., Liong, V. E., Xu, Q., Krishnan, A., Pan, Y., Baldan, G., & Beijbom, O. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01164 · Cited by 7,152 · cited 3×
“Cityscapes [270] X X Vehicle Berkley DeepDrive [271] X X Vehicle X X Mapillary [272] X X Vehicle X X Oxford RobotCar [49] X X Vehicle X X X KITTI [174] X X X X Vehicle H3D [273] X X X Vehicle ApolloScape [274] X X X X Vehicle nuScenes [175] X X X X Vehicle X X Udacity [275] X X X X Vehicle DDD17 [85] X X X Vehicle X X…”
BackgroundMethodProbabilistic roadmaps for path planning in high-dimensional configuration spaces
Kavraki, L. E., Svestka, P., Latombe, J.-C., & Overmars, M. H. (1996) · IEEE Transactions on Robotics and Automation · doi:10.1109/70.508439 · Cited by 6,343 · cited 5×
“RRT is faster than PRM and both are probabilistically complete [253], which means a path that satisfies the given conditions will be guaranteed to be found with enough runtime.”
MethodInfluentialObject Detection With Deep Learning: A Review
Zhao, Z.-Q., Zheng, P., Xu, S.-T., & Wu, X. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2876865 · Cited by 5,545
U-Net: Convolutional Networks for Biomedical Image SegmentationPreprint
Ronneberger, O., Fischer, P., & Brox, T. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.04597 · Cited by 5,282
Sampling-based algorithms for optimal motion planning
Karaman, S., & Frazzoli, E. (2011) · The International Journal of Robotics Research · doi:10.1177/0278364911406761 · Cited by 5,275 · cited 2×
“RRT* [258], an extension of the RRT, provides more optimal paths instead of completely random ones while sacrificing computational efficiency.”
BackgroundMethodVoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection
Zhou, Y., & Tuzel, O. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00472 · Cited by 4,813 · cited 3×
“The first convincing results for point cloud-only 3D bounding box estimation were produced by VoxelNet [164].”
MethodInfluentialPointPillars: Fast Encoders for Object Detection From Point Clouds
Lang, A. H., Vora, S., Caesar, H., Zhou, L., Yang, J., & Beijbom, O. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01298 · Cited by 4,673
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Szegedy, C., Ioffe, S., Vanhoucke, V., & Alemi, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11231 · Cited by 4,636
Learning Deconvolution Network for Semantic Segmentation
Noh, H., Hong, S., & Han, B. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.178 · Cited by 4,422 · cited 1×
“nation of convolutions, for feature extractions, followed by deconvolutions, also called transposed convolutions, to obtain pixel resolution labels [152], [153].”
BackgroundRajamani, R. (2012) · Mechanical Engineering Series · doi:10.1007/978-1-4614-1433-9 · Cited by 4,401 · cited 2×
“Primitive driver assistance systems such as adaptive cruise control, anti-lock braking systems and stability control start with level one [32].”
BackgroundCARLA: An open urban driving simulator
Dosovitskiy, A., Ros, G., Codevilla, F., Lopez, A., & Koltun, V. (2017) · arXiv · doi:10.48550/arxiv.1711.03938 · Cited by 3,718
Design and use paradigms for gazebo, an open-source multi-robot simulator
Koenig, N., & Howard, A. (2005) · 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566) · doi:10.1109/iros.2004.1389727 · Cited by 3,638 · cited 1×
“Gazebo [295] is a common simulation environment for robotics.”
BackgroundHe, K., Gkioxari, G., Dollar, P., & Girshick, R. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2844175 · Cited by 3,457
Multi-view 3D Object Detection Network for Autonomous Driving
Chen, X., Ma, H., Wan, J., Li, B., & Xia, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.691 · Cited by 3,450 · cited 1×
“The MV3D algorithm [169] used camera images, depth images, as well as multi-channel BV images; each channel corresponding to a different range of heights, so as to minimize these occlusions.”
MethodSECOND: Sparsely Embedded Convolutional Detection
Yan, Y., Mao, Y., & Li, B. (2018) · Sensors · doi:10.3390/s18103337 · Cited by 3,352 · cited 6×
“2D methods are far less computationally expensive, but recent methods that take point sparsity into account [126] are real-time viable and rapidly”
BackgroundMethodInfluentialRandomized Kinodynamic Planning
LaValle, S. M., & Kuffner, J. J. (2001) · The International Journal of Robotics Research · doi:10.1177/02783640122067453 · Cited by 3,254
End to End Learning for Self-Driving Cars
Bojarski, M., Del Testa, D., Dworakowski, D., Firner, B., Flepp, B., Goyal, P., Jackel, L. D., Monfort, M., Muller, U., Zhang, J., et al. (2016) · arXiv · doi:10.48550/arxiv.1604.07316 · Cited by 3,198 · cited 1×
“A deep convolutional neural network that takes image as input and outputs steering was proposed in [58].”
BackgroundPointRCNN: 3D Object Proposal Generation and Detection From Point Cloud
Shi, S., Wang, X., & Li, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00086 · Cited by 3,093 · cited 1×
“ion (AP) in % on the KITTI 3D object detection test set car class, ordered based on moderate category accuracy. These algorithms only use pointcloud data. Algorithm T [s] Easy Moderate Hard PointRCNN [179] 0.10 85.9 75.8 68.3 PointPillars [180] 0.02 79.1 75.0 68.3 SECOND [140] 0.04 83.1 73.7 66.2 IPOD [181] 0.20 82.1…”
MethodInfluentialDeep Learning for Generic Object Detection: A Survey
Liu, L., Ouyang, W., Wang, X., Fieguth, P., Chen, J., Liu, X., & Pietikäinen, M. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01247-4 · Cited by 2,965 · cited 1×
“There exists a number of extensive surveys on general image-based object detection [133]–[135].”
BackgroundDeep Learning for Generic Object Detection: A Survey
Liu, L., Ouyang, W., Wang, X., Fieguth, P., Chen, J., Liu, X., & Pietikäinen, M. (2018) · arXiv · doi:10.48550/arxiv.1809.02165 · Cited by 2,965 · cited 1×
“There exists a number of extensive surveys on general image-based object detection [133]–[135].”
BackgroundImageNet: A large-scale hierarchical image database
Deng, J. H., Dong, W. F., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206848 · Cited by 2,714
Frustum PointNets for 3D Object Detection from RGB-D Data
Qi, C. R., Liu, W., Wu, C., Su, H., & Guibas, L. J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00102 · Cited by 2,655 · cited 1×
“intcloud data. Algorithm T [s] Easy Moderate Hard PointRCNN [179] 0.10 85.9 75.8 68.3 PointPillars [180] 0.02 79.1 75.0 68.3 SECOND [140] 0.04 83.1 73.7 66.2 IPOD [181] 0.20 82.1 72.6 66.3 F-PointNet [182] 0.17 81.2 70.4 62.2 VoxelNet (Lidar) [167] 0.23 77.5 65.1 57.7 MV3D (Lidar) [172] 0.24 66.8 52.8 51.3 of depth im…”
InfluentialA Survey of Motion Planning and Control Techniques for Self-Driving Urban Vehicles
Paden, B., Cap, M., Yong, S. Z., Yershov, D., & Frazzoli, E. (2016) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2016.2578706 · Cited by 2,585 · cited 3×
“[20] X X X X X [21] X X X [22] X X [23] X [24] X X X X [25] X X X [26] X [27] X X X X X [28] X X X X Ours X X X X X X X X X”
BackgroundMicrosoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Bourdev, L., Girshick, R., Hays, J., Perona, P., Ramanan, D., Zitnick, C. L., & Dollár, P. (2014) · arXiv · doi:10.48550/arxiv.1405.0312 · Cited by 2,579 · cited 3×
“More recent versions of this method, YOLOv2, YOLO9000 [137] and YOLOv3 [123] briefly took over the PASCAL VOC and MS COCO benchmarks while maintaining low computation and memory cost.”
BackgroundMethodGallego, G., Delbruck, T., Orchard, G., Bartolozzi, C., Taba, B., Censi, A., Leutenegger, S., Davison, A. J., Conradt, J., Daniilidis, K., et al. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3008413 · Cited by 2,566
Simultaneous localization and mapping (SLAM): part II
Bailey, T., & Durrant-Whyte, H. (2006) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2006.1678144 · Cited by 2,554 · cited 1×
“Absolute positioning sensors low low low small lowest [90] Odometry/dead reckoning low low low smallest low [91] GPS-IMU fusion medium medium low small low [92] SLAM medium-high medium high large very high [93] A priori Map-based Landmark search high medium high large medium [94], [95] Point cloud matching highest hig…”
BackgroundA 128$\times$128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision Sensor
Lichtsteiner, P., Posch, C., & Delbruck, T. (2008) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2007.914337 · Cited by 2,485
World report on road traffic injury prevention
Jindal, A., & Mukherji, S. (2005) · Medical Journal Armed Forces India · doi:10.1016/s0377-1237(05)80135-2 · Cited by 2,169
DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving
Chen, C., Seff, A., Kornhauser, A., & Xiao, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.312 · Cited by 1,876 · cited 5×
“[55]–[59] Direct supervised deep learning Imitates the target data: usually a human driver.”
BackgroundInfluentialA Review of Motion Planning Techniques for Automated Vehicles
Gonzalez, D., Perez, J., Milanes, V., & Nashashibi, F. (2016) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2015.2498841 · Cited by 1,670 · cited 6×
“local planning review is presented in [19] where the taxonomy of motion planning was divided into four groups; graph-based planners, sampling-based planners, interpolating curve planners and numerical optimization approaches.”
BackgroundInfluential1 year, 1000 km: The Oxford RobotCar dataset
Maddern, W., Pascoe, G., Linegar, C., & Newman, P. (2017) · The International Journal of Robotics Research · doi:10.1177/0278364916679498 · Cited by 1,632 · cited 4×
“RobotCar [49] is a cheaper research platform aimed for data collection.”
BackgroundMethodInfluentialAutonomous driving in urban environments: Boss and the Urban Challenge
Urmson, C., Anhalt, J., Bagnell, D., Baker, C., Bittner, R., Clark, M. N., Dolan, J., Duggins, D., Galatali, T., Geyer, C., et al. (2008) · Journal of Field Robotics · doi:10.1002/rob.20255 · Cited by 1,555
The social dilemma of autonomous vehicles
Bonnefon, J.-F., Shariff, A., & Rahwan, I. (2016) · Science · doi:10.1126/science.aaf2654 · Cited by 1,527 · cited 1×
“In an inevitable accident situation, how should the system behave [40]? Experimental ethics were proposed regarding this issue [41].”
BackgroundA modified Hausdorff distance for object matching
Dubuisson, M.-P., & Jain, A. K. (2002) · Proceedings of 12th International Conference on Pattern Recognition · doi:10.1109/icpr.1994.576361 · Cited by 1,464 · cited 1×
“Point cloud based methods may also use similarity metrics such as point density and Hausdorff distance [161], [183].”
MethodThe Mapillary Vistas Dataset for Semantic Understanding of Street Scenes
Neuhold, G., Ollmann, T., Bulo, S. R., & Kontschieder, P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.534 · Cited by 1,434 · cited 2×
“Cityscapes [270] X X Vehicle Berkley DeepDrive [271] X X Vehicle X X Mapillary [272] X X Vehicle X X Oxford RobotCar [49] X X Vehicle X X X KITTI [174] X X X X Vehicle H3D [273] X X X Vehicle ApolloScape [274] X X X X Vehicle nuScenes [175] X X X X Vehicle X X Udacity [275] X X X X Vehicle DDD17 [85] X X X Vehicle X X…”
BackgroundFeng, D., Haase-Schutz, C., Rosenbaum, L., Hertlein, H., Glaser, C., Timm, F., Wiesbeck, W., & Dietmayer, K. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.2972974 · Cited by 1,425
Towards fully autonomous driving: Systems and algorithms
Levinson, J., Askeland, J., Becker, J., Dolson, J., Held, D., Kammel, S., Kolter, J. Z., Langer, D., Pink, O., Pratt, V., et al. (2011) · 2011 IEEE Intelligent Vehicles Symposium (IV) · doi:10.1109/ivs.2011.5940562 · Cited by 1,374 · cited 9×
“[20] X X X X X [21] X X X [22] X X [23] X [24] X X X X [25] X X X [26] X [27] X X X X X [28] X X X X Ours X X X X X X X X X”
BackgroundMethodInfluentialALVINN: An autonomous land vehicle in a neural network
Pomerleau, D. A. (2018) · Carnegie Mellon University · doi:10.1184/r1/6603146.v1 · Cited by 1,340
ALVINN, an autonomous land vehicle in a neural network
Pomerleau, D. (2018) · doi:10.1184/r1/6603146 · Cited by 1,338
PIXOR: Real-time 3D Object Detection from Point Clouds
Yang, B., Luo, W., & Urtasun, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00798 · Cited by 1,249
DeepTest: automated testing of deep-neural-network-driven autonomous cars
Tian, Y., Pei, K., Jana, S., & Ray, B. (2018) · Proceedings of the 40th International Conference on Software Engineering · doi:10.1145/3180155.3180220 · Cited by 1,217 · cited 3×
“Even though there is promising projects in this regard such as DeepTest [42], the design-simulation-test-redesigncertification procedure is still not established by the industry nor the rule-makers.”
BackgroundInfluentialBadue, C., Guidolini, R., Carneiro, R. V., Azevedo, P., Cardoso, V. B., Forechi, A., Jesus, L., Berriel, R., Paixão, T. M., Mutz, F., et al. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113816 · Cited by 1,209 · cited 2×
“[20] X X X X X [21] X X X [22] X X [23] X [24] X X X X [25] X X X [26] X [27] X X X X X [28] X X X X Ours X X X X X X X X X”
BackgroundLearning to Track at 100 FPS with Deep Regression Networks
Held, D., Thrun, S., & Savarese, S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_45 · Cited by 1,199 · cited 1×
“Tracking in monocular images was achieved in real-time through a CNN-based method [191], [192].”
MethodThe Cityscapes Dataset for Semantic Urban Scene Understanding
Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., & Schiele, B. (2016) · arXiv · doi:10.48550/arxiv.1604.01685 · Cited by 1,174
(2006) · Mechanical Engineering Series · doi:10.1007/0-387-28823-6 · Cited by 1,129
A survey on motion prediction and risk assessment for intelligent vehicles
Lefèvre, S., Vasquez, D., & Laugier, C. (2014) · ROBOMECH Journal · doi:10.1186/s40648-014-0001-z · Cited by 1,112 · cited 1×
“[17] - - X - - - - - - - [18] - - - - - X X - - - [19] - - - - - X - - - - [20] X X X X - - - - - - [21] X - X - - - - - X - [22] X - - - - - - - - - [23] - - X X - X X - - X [24] - X - - X X X - - - [25] - - - - X X - - - - Ours X X X X X X - X X X complete the challenge attracted significant attention. After DARPA Ur…”
Multiple object tracking: A literature review
Luo, W., Xing, J., Milan, A., Zhang, X., Liu, W., & Kim, T.-K. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2020.103448 · Cited by 1,099 · cited 2×
“Object tracking is also often referred to as multiple object tracking (MOT) [180] and detection and tracking of multiple objects (DATMO) [181].”
BackgroundDeep Reinforcement Learning framework for Autonomous Driving
Sallab, A. E., Abdou, M., Perot, E., & Yogamani, S. (2017) · Electronic Imaging · doi:10.2352/issn.2470-1173.2017.19.avm-023 · Cited by 1,045 · cited 3×
“introduced in [60], where the network was tested in a simulation environment.”
BackgroundVideo-Based Lane Estimation and Tracking for Driver Assistance: Survey, System, and Evaluation
McCall, J. C., & Trivedi, M. M. (2006) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2006.869595 · Cited by 1,028 · cited 2×
“In this section, we provide an overview of current methods used for road and lane detection, and refer the reader to in-depth surveys of traditional methods [194] and the state-of-the-art methods [195], [196].”
BackgroundMethodRobot Motion Planning: A Distributed Representation Approach
Barraquand, J., & Latombe, J.-C. (1991) · The International Journal of Robotics Research · doi:10.1177/027836499101000604 · Cited by 995 · cited 3×
“Randomized Potential Planner (RPP) [252] is one of the earliest SBP approaches, where random walks are generated for escaping local minimums.”
BackgroundMethod(2005) · Cited by 981
Path Planning for Autonomous Vehicles in Unknown Semi-structured Environments
Dolgov, D., Thrun, S., Montemerlo, M., & Diebel, J. (2010) · The International Journal of Robotics Research · doi:10.1177/0278364909359210 · Cited by 976 · cited 2×
“A* trajectories were optimized with numeric non-linear functions in [258].”
MethodPlanning and Decision-Making for Autonomous Vehicles
Schwarting, W., Alonso-Mora, J., & Rus, D. (2018) · Annual Review of Control, Robotics, and Autonomous Systems · doi:10.1146/annurev-control-060117-105157 · Cited by 972 · cited 1×
“This enables DL planners to be integrated into conventional pipelines [28].”
BackgroundSemantic 3D Object Maps for Everyday Manipulation in Human Living Environments
Rusu, R. B. (2010) · KI - Künstliche Intelligenz · doi:10.1007/s13218-010-0059-6 · Cited by 938 · cited 1×
“Traditional methods often used euclidean clustering [158] or region-growing methods [159] for grouping points into objects.”
Simultaneous Localization and Mapping: A Survey of Current Trends in Autonomous Driving
Bresson, G., Alsayed, Z., Yu, L., & Glaser, S. (2017) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2017.2749181 · Cited by 885 · cited 25×
“Like in aircraft, ADSs need to be designed with high redundancies that will minimize the chance of a catastrophic failure.”
BackgroundMethodInfluentialEnd-to-End Learning of Driving Models from Large-Scale Video Datasets
Xu, H., Gao, Y., Yu, F., & Darrell, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.376 · Cited by 884 · cited 2×
“A spatiotemporal network, an FCN-LSTM architecture, was developed for predicting ego-vehicle motion in [63].”
BackgroundMethodAutonomous vehicle perception: The technology of today and tomorrow
Van Brummelen, J., O’Brien, M., Gruyer, D., & Najjaran, H. (2018) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2018.02.012 · Cited by 869 · cited 2×
“[20] X X X X X [21] X X X [22] X X [23] X [24] X X X X [25] X X X [26] X [27] X X X X X [28] X X X X Ours X X X X X X X X X”
MethodMaking Bertha Drive—An Autonomous Journey on a Historic Route
Ziegler, J., Bender, P., Schreiber, M., Lategahn, H., Strauss, T., Stiller, C., Dang, T., Franke, U., Appenrodt, N., Keller, C. G., et al. (2014) · IEEE Intelligent Transportation Systems Magazine · doi:10.1109/mits.2014.2306552 · Cited by 854 · cited 3×
“Bertha [53] is developed by Daimler and has 4 120 ◦ short-range radars, two long-range range radar on the sides, stereo camera, wide angle-monocular color camera on the dashboard, another wide-angle camera for the back.”
BackgroundRobot Motion Planning and Control
(1998) · Lecture Notes in Control and Information Sciences · doi:10.1007/bfb0036069 · Cited by 831 · cited 1×
“These sub-tasks have their corresponding literature in robotics [66], computer vision [67] and vehicle dynamics [32], which makes the accumulated know-how and expertise directly transferable.”
BackgroundInternet of vehicles: From intelligent grid to autonomous cars and vehicular clouds
Gerla, M., Lee, E.-K., Pau, G., & Lee, U. (2014) · 2014 IEEE World Forum on Internet of Things (WF-IoT) · doi:10.1109/wf-iot.2014.6803166 · Cited by 828 · cited 5×
“4) Connected systems: There is no operational connected ADS in use yet, however, some researchers [44]–[46] be-”
BackgroundInfluential(2015) · Cited by 809
Kuutti, S., Fallah, S., Katsaros, K., Dianati, M., Mccullough, F., & Mouzakitis, A. (2018) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2812300 · Cited by 801 · cited 2×
“to [106] for a broader localization overview.”
BackgroundSampling-Based Robot Motion Planning: A Review
Elbanhawi, M., & Simic, M. (2014) · IEEE Access · doi:10.1109/access.2014.2302442 · Cited by 786 · cited 1×
“A detailed overview of Sampling Based Planning (SBP) methods can be found in [262].”
MethodInterworking of DSRC and Cellular Network Technologies for V2X Communications: A Survey
Abboud, K., Omar, H. A., & Zhuang, W. (2016) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2016.2591558 · Cited by 785 · cited 5×
“[20] X X X X X [21] X X X [22] X X [23] X [24] X X X X [25] X X X [26] X [27] X X X X X [28] X X X X Ours X X X X X X X X X”
MethodInfluentialRecent progress in road and lane detection: A survey
Bar Hillel, A., Lerner, R., Levi, D., & Raz, G. (2014) · Machine Vision and Applications · doi:10.1007/s00138-011-0404-2 · Cited by 775 · cited 2×
“rates, but fully automated driving will require a complete, semantic understanding of road structures and the ability to detect several lanes at long ranges [195].”
BackgroundMethodThe 2005 PASCAL Visual Object Classes Challenge
Everingham, M., Zisserman, A., Williams, C. K. I., Van Gool, L., Allan, M., Bishop, C. M., Chapelle, O., Dalal, N., Deselaers, T., Dorkó, G., et al. (2006) · Lecture Notes in Computer Science · doi:10.1007/11736790_8 · Cited by 765 · cited 1×
“The PASCAL VOC dataset [288], which grew from 2005 to 2012, was one of the first dataset featuring a large amount of data with relevant classes for ADS.”
MethodA survey on vehicular cloud computing
Whaiduzzaman, M., Sookhak, M., Gani, A., & Buyya, R. (2014) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2013.08.004 · Cited by 750 · cited 1×
“Regular cloud computing was compared to vehicular cloud computing and it was reported that VCC is technologically feasible [76].”
MethodNeuroevolution: from architectures to learning
Floreano, D., Dürr, P., & Mattiussi, C. (2008) · Evolutionary Intelligence · doi:10.1007/s12065-007-0002-4 · Cited by 734 · cited 1×
“Neuroevolution refers to using evolutionary algorithms to train artificial neural networks [70].”
BackgroundDriving style recognition using a smartphone as a sensor platform
Johnson, D. A., & Trivedi, M. M. (2011) · 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2011.6083078 · Cited by 727 · cited 3×
“In [229]–[231] driving style was categorized into three and into two in [74], [209], [217], [218], [222].”
BackgroundKendall, A., Hawke, J., Janz, D., Mazur, P., Reda, D., Allen, J.-M., Lam, V.-D., Bewley, A., & Shah, A. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8793742 · Cited by 694 · cited 3×
“There are three main approaches for end-to-end driving: direct supervised deep learning [55]–[59], neuroevolution [62], [63] and the more recent deep reinforcement learning [60], [61].”
BackgroundMFNet: Towards real-time semantic segmentation for autonomous vehicles with multi-spectral scenes
Ha, Q., Watanabe, K., Karasawa, T., Ushiku, Y., & Harada, T. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206396 · Cited by 693 · cited 2×
“Other camera types gaining interest for ADS include flash cameras [78], thermal cameras [80], [81], and”
Background(2018) · arXiv (Cornell University) · Cited by 679
The ApolloScape Dataset for Autonomous Driving
Huang, X., Cheng, X., Geng, Q., Cao, B., Zhou, D., Wang, P., Lin, Y., & Yang, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00141 · Cited by 679 · cited 1×
“Cityscapes [270] X X Vehicle Berkley DeepDrive [271] X X Vehicle X X Mapillary [272] X X Vehicle X X Oxford RobotCar [49] X X Vehicle X X X KITTI [174] X X X X Vehicle H3D [273] X X X Vehicle ApolloScape [274] X X X X Vehicle nuScenes [175] X X X X Vehicle X X Udacity [275] X X X X Vehicle DDD17 [85] X X X Vehicle X X…”
BackgroundRandomized kinodynamic planning
LaValle, S. M., & Kuffner, J. J. (2003) · Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C) · doi:10.1109/robot.1999.770022 · Cited by 673
Schwarz, B. (2010) · Nature Photonics · doi:10.1038/nphoton.2010.148 · Cited by 667 · cited 1×
“The accumulated knowledge in vehicle dynamics, breakthroughs in computer vision caused by the advent of deep learning [4] and availability of new sensor modalities, such as lidar [5], catalyzed ADS research and industrial implementation.”
Background(2015) · Cited by 656
Computer Vision for Autonomous Vehicles: Problems, Datasets and State of the Art
Janai, J., Güney, F., Behl, A., & Geiger, A. (2020) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000079 · Cited by 643 · cited 1×
“Panoramic view is particularly desirable for applications such as navigation, localization and mapping [84].”
BackgroundTransition to manual: Driver behaviour when resuming control from a highly automated vehicle
Merat, N., Jamson, A. H., Lai, F. C. H., Daly, M., & Carsten, O. M. J. (2014) · Transportation Research Part F: Traffic Psychology and Behaviour · doi:10.1016/j.trf.2014.09.005 · Cited by 642 · cited 2×
“Recent studies [36], [37] investigated this problem and found that the takeover”
BackgroundMethod(2002) · elib (German Aerospace Center) · Cited by 632
Driving Style Recognition for Intelligent Vehicle Control and Advanced Driver Assistance: A Survey
Marina Martinez, C., Heucke, M., Wang, F.-Y., Gao, B., & Cao, D. (2018) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2017.2706978 · Cited by 620 · cited 1×
“algorithms for intelligent vehicles is given in [216].”
BackgroundThe ApolloScape Open Dataset for Autonomous Driving and Its Application
Huang, X., Wang, P., Cheng, X., Zhou, D., Geng, Q., & Yang, R. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2926463 · Cited by 615 · cited 1×
“ApolloScape is a very recent dataset that is not fully public yet [278].”
BackgroundThe ApolloScape Open Dataset for Autonomous Driving and its Application
Huang, X., Wang, P., Cheng, X., Zhou, D., Geng, Q., & Yang, R. (2018) · arXiv · doi:10.48550/arxiv.1803.06184 · Cited by 615 · cited 1×
“Cityscapes [270] X X Vehicle Berkley DeepDrive [271] X X Vehicle X X Mapillary [272] X X Vehicle X X Oxford RobotCar [49] X X Vehicle X X X KITTI [174] X X X X Vehicle H3D [273] X X X Vehicle ApolloScape [274] X X X X Vehicle nuScenes [175] X X X X Vehicle X X Udacity [275] X X X X Vehicle DDD17 [85] X X X Vehicle X X…”
BackgroundRoute Planning in Transportation Networks
Bast, H., Delling, D., Goldberg, A., Müller-Hannemann, M., Pajor, T., Sanders, P., Wagner, D., & Werneck, R. F. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-49487-6_2 · Cited by 610 · cited 3×
“HL is the fastest query time algorithm for route planning [244], in the expense of high storage usage.”
BackgroundMethodIndependent driving pattern factors and their influence on fuel-use and exhaust emission factors
Ericsson, E. (2001) · Transportation Research Part D: Transport and Environment · doi:10.1016/s1361-9209(01)00003-7 · Cited by 608
Gallego, G., Delbrück, T., Orchard, G., Bartolozzi, C., Taba, B., Censi, A., Leutenegger, S., Davison, A. J., Conradt, J., Daniilidis, K., et al. (2020) · Zurich Open Repository and Archive (University of Zurich) · doi:10.3929/ethz-b-000521357 · Cited by 591
Robust vehicle localization in urban environments using probabilistic maps
Levinson, J., & Thrun, S. (2010) · 2010 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2010.5509700 · Cited by 581
Vehicle Detection from 3D Lidar Using Fully Convolutional Network
Li, B., Zhang, T., & Xia, T. (2016) · Robotics: Science and Systems XII · doi:10.15607/rss.2016.xii.042 · Cited by 577 · cited 1×
“The VeloFCN network [167] proposed to use single-channel depth image as input to a shallow, single-stage convolutional neural”
MethodAn Open Approach to Autonomous Vehicles
Kato, S., Takeuchi, E., Ishiguro, Y., Ninomiya, Y., Takeda, K., & Hamada, T. (2015) · IEEE Micro · doi:10.1109/mm.2015.133 · Cited by 564 · cited 4×
“Autoware [110], Apollo [290], Nvidia DriveWorks [291] and openpilot [292] are amongst the most used software-stacks capable of running an ADS platform in real world.”
MethodInfluentialSelf-citationMagnusson, M. (2009) · KTH Publication Database DiVA (KTH Royal Institute of Technology) · Cited by 547
An Empirical Evaluation of Deep Learning on Highway Driving
Huval, B., Wang, T., Tandon, S., Kiske, J., Song, W., Pazhayampallil, J., Andriluka, M., Rajpurkar, P., Migimatsu, T., Cheng-Yue, R., et al. (2015) · arXiv · doi:10.48550/arxiv.1504.01716 · Cited by 537 · cited 1×
“Tracking in monocular images was achieved in real-time through a CNN-based method [191], [192].”
MethodReachability and Distance Queries via 2-Hop Labels
Cohen, E., Halperin, E., Kaplan, H., & Zwick, U. (2003) · SIAM Journal on Computing · doi:10.1137/s0097539702403098 · Cited by 518 · cited 1×
“One possible solution to this is to use hub labeling (HL) [248].”
BackgroundEvent-Based Vision Meets Deep Learning on Steering Prediction for Self-Driving Cars
Maqueda, A. I., Loquercio, A., Gallego, G., Garcia, N., & Scaramuzza, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00568 · Cited by 514 · cited 1×
“types gaining interest for ADS include flash cameras [77], thermal cameras [79], [80], and event cameras [78].”
BackgroundA Toolbox for Easily Calibrating Omnidirectional Cameras
Scaramuzza, D., Martinelli, A., & Siegwart, R. (2006) · 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2006.282372 · Cited by 510 · cited 1×
“These are however difficult to intrinsically calibrate; the spherical images are highly distorted and the camera model used must account for mirror reflections or fisheye lens distortions, depending on the camera model producing the panoramic images [139], [140].”
A Unifying Theory for Central Panoramic Systems and Practical Implications
Geyer, C., & Daniilidis, K. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45053-x_29 · Cited by 502 · cited 1×
“ibrate; the spherical images are highly distorted and the camera model used must account for mirror reflections or fisheye lens distortions, depending on the camera model producing the panoramic images [141], [142]. The accuracy of the model and calibration dictates the quality of undistorted images produced, on which t…”
MethodEvent-Based Vision Meets Deep Learning on Steering Prediction for Self-Driving Cars
Maqueda, A. I., Loquercio, A., Gallego, G., Garcia, N. N., & Scaramuzza, D. (2018) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-175994 · Cited by 493
Map-Based Precision Vehicle Localization in Urban Environments
Levinson, J., Montemerlo, M., & Thrun, S. (2007) · Robotics: Science and Systems III · doi:10.15607/rss.2007.iii.016 · Cited by 477 · cited 4×
“GPS-IMU systems by themselves cannot be used for vehicle localization as they do not meet the performance criteria [109].”
BackgroundMethodInfluential(2005) · neural information processing systems · Cited by 446
CommonRoad: Composable benchmarks for motion planning on roads
Althoff, M., Koschi, M., & Manzinger, S. (2017) · 2017 IEEE Intelligent Vehicles Symposium (IV) · doi:10.1109/ivs.2017.7995802 · Cited by 443 · cited 1×
“are referred to sources for details of the datasets. DDD17 [89] around 12 hours of driving data is recorded. The LiVi-Set [281] is a new dataset that has lidar, image and driving behavior. CommonRoad [294] is a new benchmark for motion-planning. Naturalistic driving data is another type of dataset that concentrates on…”
BackgroundTrajectory planning for Bertha — A local, continuous method
Ziegler, J., Bender, P., Dang, T., & Stiller, C. (2014) · 2014 IEEE Intelligent Vehicles Symposium Proceedings · doi:10.1109/ivs.2014.6856581 · Cited by 443 · cited 1×
“Kalman filtering is sufficient for simple linear models, while the extended and and unscented Kalman filters [186] are used to handle nonlinear dynamic models [187].”
MethodA Review of Research on Driving Styles and Road Safety
Sagberg, F., Selpi, Bianchi Piccinini, G. F., & Engström, J. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720815591313 · Cited by 443 · cited 1×
“A thorough review of the literature can be found in [215] and a survey of driving style recognition”
BackgroundGold, C., Körber, M., Lechner, D., & Bengler, K. (2016) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720816634226 · Cited by 440 · cited 1×
“Recent studies [36], [37] investigated this problem and found that the takeover”
BackgroundModel based vehicle detection and tracking for autonomous urban driving
Petrovskaya, A., & Thrun, S. (2009) · Autonomous Robots · doi:10.1007/s10514-009-9115-1 · Cited by 430 · cited 1×
“rameters such as the size of the object are tracked alongside dynamics [188].”
BackgroundA perception‐driven autonomous urban vehicle
Leonard, J., How, J., Teller, S., Berger, M., Campbell, S., Fiore, G., Fletcher, L., Frazzoli, E., Huang, A., Karaman, S., et al. (2008) · Journal of Field Robotics · doi:10.1002/rob.20262 · Cited by 429 · cited 2×
“While not as accurate as the lidar, it can detect at object at high range and estimate their velocity [112].”
BackgroundMethodRichter, S. R., Hayder, Z., & Koltun, V. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.243 · Cited by 419 · cited 1×
“Some researchers even used computer games such as Grand Theft Auto V [294].”
MethodLearning-based approach for online lane change intention prediction
Kumar, P., Perrollaz, M., Lefevre, S., & Laugier, C. (2013) · 2013 IEEE Intelligent Vehicles Symposium (IV) · doi:10.1109/ivs.2013.6629564 · Cited by 410 · cited 1×
“3 seconds in advance with support vector machines (SVM) and Bayesian filters [214].”
MethodA toolbox for easily calibrating omnidirectional cameras
Scaramuzza, D., Martinelli, A., & Siegwart, R. (2006) · doi:10.3929/ethz-a-005704721 · Cited by 405
(2015) · IEEE Control Systems · doi:10.1109/mcs.2015.2471046 · Cited by 392 · cited 2×
“Platooning is a well-studied phenomenon; it reduces drag and therefore fuel consumption [99].”
BackgroundNavigating Occluded Intersections with Autonomous Vehicles Using Deep Reinforcement Learning
Isele, D., Rahimi, R., Cosgun, A., Subramanian, K., & Fujimura, K. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8461233 · Cited by 379
Visual localization within LIDAR maps for automated urban driving
Wolcott, R. W., & Eustice, R. M. (2014) · 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2014.6942558 · Cited by 374 · cited 1×
“A monocular camera was used to localize the vehicle in a point cloud map in [121].”
MethodKAIST Multi-Spectral Day/Night Data Set for Autonomous and Assisted Driving
Choi, Y., Kim, N., Hwang, S., Park, K., Yoon, J. S., An, K., & Kweon, I. S. (2018) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2018.2791533 · Cited by 370 · cited 1×
“KAIST multi-spectral [283] X X X Vehicle X”
BackgroundSliding Shapes for 3D Object Detection in Depth Images
Song, S., & Xiao, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10599-4_41 · Cited by 359 · cited 3×
“There are two main representations of point cloud data in 2D, the first being a so-called depth image shown in Figure 14, largely inspired by camera-based methods that perform 3D object detection through depth estimation [165] and methods that operate on RGB-D data [166].”
MethodInfluentialAutonomous driving in urban environments: approaches, lessons and challenges
Campbell, M., Egerstedt, M., How, J. P., & Murray, R. M. (2010) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2010.0110 · Cited by 353 · cited 2×
“[20] X X X X X [21] X X X [22] X X [23] X [24] X X X X [25] X X X [26] X [27] X X X X X [28] X X X X Ours X X X X X X X X X”
Background50 Years of object recognition: Directions forward
Andreopoulos, A., & Tsotsos, J. K. (2013) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2013.04.005 · Cited by 347 · cited 1×
“There exists a number of extensive surveys on general image-based object detection [132]– [134].”
BackgroundLearning Depth with Convolutional Spatial Propagation Network
Cheng, X., Wang, P., & Yang, R. (2018) · arXiv · doi:10.48550/arxiv.1810.02695 · Cited by 345 · cited 1×
“therefore necessary, which is in fact possible through single camera [156] though stereo or multi-view systems are more robust [157].”
BackgroundLearning Depth with Convolutional Spatial Propagation Network
Cheng, X., Wang, P., & Yang, R. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2947374 · Cited by 341 · cited 1×
“therefore necessary, which is in fact possible through single camera [156] though stereo or multi-view systems are more robust [157].”
BackgroundSafe Driving Using Mobile Phones
Fazeen, M., Gozick, B., Dantu, R., Bhukhiya, M., & González, M. C. (2012) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2012.2187640 · Cited by 341 · cited 1×
“In [229]–[231] driving style was categorized into three and into two in [74], [209], [217], [218], [222].”
BackgroundThe DARPA Urban Challenge: Autonomous Vehicles in City Traffic
(2009) · Springer Tracts in Advanced Robotics · doi:10.1007/978-3-642-03991-1 · Cited by 341 · cited 4×
“During DARPA Urban Challenge [7], held in 2007, many”
BackgroundInfluentialDriver Modeling Based on Driving Behavior and Its Evaluation in Driver Identification
Miyajima, C., Nishiwaki, Y., Ozawa, K., Wakita, T., Itou, K., Takeda, K., & Itakura, F. (2007) · Proceedings of the IEEE · doi:10.1109/jproc.2006.888405 · Cited by 339 · cited 1×
“GMM based driver model was used to identify individual drivers with success in [241].”
MethodSelf-citationVoting for Voting in Online Point Cloud Object Detection
Zeng Wang, D., & Posner, I. (2015) · Robotics: Science and Systems XI · doi:10.15607/rss.2015.xi.035 · Cited by 337 · cited 1×
“Shortly thereafter, a similar approach was used on point clouds created by lidars [163].”
MethodGuidelines in nonholonomic motion planning for mobile robots
Laumond, J. P., Sekhavat, S., & Lamiraux, F. (2006) · Lecture Notes in Control and Information Sciences · doi:10.1007/bfb0036070 · Cited by 330
Accurate Monocular 3D Object Detection via Color-Embedded 3D Reconstruction for Autonomous Driving
Ma, X., Wang, Z., Li, H., Zhang, P., Ouyang, W., & Fan, X. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00695 · Cited by 330
Exact Routing in Large Road Networks Using Contraction Hierarchies
Geisberger, R., Sanders, P., Schultes, D., & Vetter, C. (2012) · Transportation Science · doi:10.1287/trsc.1110.0401 · Cited by 323 · cited 1×
“Contraction Hierarchies (CH) method was proposed in [247]”
MethodVoxelNet: End-to-End Learning for Point Cloud Based 3D Object DetectionPreprint
Zhou, Y., & Tuzel, O. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.06396 · Cited by 318
TORCS, The Open Racing Car Simulator
Espié, E., Guionneau, C., Wymann, B., Dimitrakakis, C., Coulom, R., & Sumner, A. J. (2005) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 313
A Survey of Vehicle to Everything (V2X) Testing
Wang, J., Shao, Y., Ge, Y., & Yu, R. (2019) · Sensors · doi:10.3390/s19020334 · Cited by 312
OVERVIEW OF PLATOONING SYSTEMS
Bergenhem, C., Shladover, S. E., Coelingh, E., Englund, C., & Tsugawa, S. (2012) · Chalmers Publication Library (Chalmers University of Technology) · Cited by 303
Cooperative Collision Avoidance at Intersections: Algorithms and Experiments
Hafner, M. R., Cunningham, D., Caminiti, L., & Del Vecchio, D. (2013) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2013.2252901 · Cited by 301 · cited 1×
“Level two is partial automation to which advanced assistance systems such as emergency braking or collision avoidance [33], [34]”
BackgroundAppearance-Guided Monocular Omnidirectional Visual Odometry for Outdoor Ground Vehicles
Scaramuzza, D., & Siegwart, R. (2008) · IEEE Transactions on Robotics · doi:10.1109/tro.2008.2004490 · Cited by 292
How can humans understand their automated cars? HMI principles, problems and solutions
Carsten, O., & Martens, M. H. (2019) · Cognition, Technology & Work · doi:10.1007/s10111-018-0484-0 · Cited by 284 · cited 2×
“The user and the ADS need to have a mutual understanding; otherwise, they will not be able to grasp the intentions of each other [266].”
BackgroundThe 2005 DARPA Grand Challenge: The Great Robot Race
(2007) · Springer Tracts in Advanced Robotics · doi:10.1007/978-3-540-73429-1 · Cited by 276
Cheng, H. T., Shan, H., & Zhuang, W. (2011) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2010.11.009 · Cited by 273
Driver's style classification using jerk analysis
Murphey, Y. L., Milton, R., & Kiliaris, L. (2009) · 2009 IEEE Workshop on Computational Intelligence in Vehicles and Vehicular Systems · doi:10.1109/civvs.2009.4938719 · Cited by 270 · cited 1×
“For example, [227] introduced a rule-based model that classified driving styles with respect to jerk.”
BackgroundInformation-centric networking for connected vehicles: a survey and future perspectives
Amadeo, M., Campolo, C., & Molinaro, A. (2016) · IEEE Communications Magazine · doi:10.1109/mcom.2016.7402268 · Cited by 264 · cited 3×
“For vehicular applications, lots of data have to be distributed amongst agents with intermittent and in less than ideal connections while maintaining high mobility [46].”
BackgroundThe H3D Dataset for Full-Surround 3D Multi-Object Detection and Tracking in Crowded Urban Scenes
Patil, A., Malla, S., Gang, H., & Chen, Y.-T. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8793925 · Cited by 263 · cited 1×
“Cityscapes [270] X X Vehicle Berkley DeepDrive [271] X X Vehicle X X Mapillary [272] X X Vehicle X X Oxford RobotCar [49] X X Vehicle X X X KITTI [174] X X X X Vehicle H3D [273] X X X Vehicle ApolloScape [274] X X X X Vehicle nuScenes [175] X X X X Vehicle X X Udacity [275] X X X X Vehicle DDD17 [85] X X X Vehicle X X…”
BackgroundFeng, D., Rosenbaum, L., & Dietmayer, K. (2018) · arXiv · doi:10.48550/arxiv.1804.05132 · Cited by 260
Feng, D., Rosenbaum, L., & Dietmayer, K. (2018) · 2018 21st International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2018.8569814 · Cited by 259 · cited 1×
“Several other works have reused camera-based algorithms and trained efficient networks for 3D object detection on 2D BV images [170]–[173].”
BackgroundBaidu Apollo EM Motion Planner
Fan, H., Zhu, F., Liu, C., Zhang, L., Zhuang, L., Li, D., Zhu, W., Hu, J., Li, H., & Kong, Q. (2018) · arXiv · doi:10.48550/arxiv.1807.08048 · Cited by 259
Gerla, M. (2012) · 2012 The 11th Annual Mediterranean Ad Hoc Networking Workshop (Med-Hoc-Net) · doi:10.1109/medhocnet.2012.6257116 · Cited by 257 · cited 1×
“In [75], the term Vehicular Cloud Computing (VCC) was coined and the main advantages of it over conventional Internet cloud applications was introduced.”
BackgroundZhao, H., Shi, J., Qi, X., Wang, X., & Jia, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.01105 · Cited by 255
Holistic Scene Understanding for 3D Object Detection with RGBD Cameras
Lin, D., Fidler, S., & Urtasun, R. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.179 · Cited by 253 · cited 1×
“point cloud data in 2D, the first being a so-called depth image shown in Figure 14, largely inspired by camera-based methods that perform 3D object detection through depth estimation [165] and methods that operate on RGB-D data [166].”
MethodAutomotive Radar and Lidar Systems for Next Generation Driver Assistance Functions
Rasshofer, R. H., & Gresser, K. (2005) · Advances in Radio Science · doi:10.5194/ars-3-205-2005 · Cited by 252 · cited 3×
“An easy alternative is to use an alternate sensing modalities for perception, but lidar also has difficulties with some weather conditions like snow [144],”
BackgroundMethodInfluentialTowards a viable autonomous driving research platform
Wei, J., Snider, J. M., Kim, J., Dolan, J. M., Rajkumar, R., & Litkouhi, B. (2013) · 2013 IEEE Intelligent Vehicles Symposium (IV) · doi:10.1109/ivs.2013.6629559 · Cited by 243 · cited 5×
“and radars lack the necessary resolution for many perception tasks [47].”
BackgroundInfluentialPATH at 20—History and Major Milestones
Shladover, S. E. (2007) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2007.903052 · Cited by 238 · cited 2×
“were developed for the PATH program in California [98], which utilized magnetic markers on the road.”
MethodDriver Behavior and Situation Aware Brake Assistance for Intelligent Vehicles
McCall, J. C., & Trivedi, M. M. (2007) · Proceedings of the IEEE · doi:10.1109/jproc.2006.888388 · Cited by 229 · cited 1×
“Bayesian approaches were utilized in [236] for modeling driving style on roundabouts and in [237] to asses critical braking situations.”
MethodAccurate odometry and error modelling for a mobile robot
Chong, K. S., & Kleeman, L. (2002) · Proceedings of International Conference on Robotics and Automation · doi:10.1109/robot.1997.606708 · Cited by 229
Concrete Problems for Autonomous Vehicle Safety: Advantages of Bayesian Deep Learning
McAllister, R., Gal, Y., Kendall, A., van der Wilk, M., Shah, A., Cipolla, R., & Weller, A. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/661 · Cited by 229
Driving Style Analysis Using Data Mining Techniques
Constantinescu, Z., Marinoiu, C., & Vladoiu, M. (2010) · International Journal of Computers Communications & Control · doi:10.15837/ijccc.2010.5.2221 · Cited by 226 · cited 2×
“Principal component analysis was used and five distinct driving classes were detected in an unsupervised manner in [233] and A GMM based driver model was used to identify individual drivers”
MethodLane Detection With Moving Vehicles in the Traffic Scenes
Cheng, H.-Y., Jeng, B.-S., Tseng, P.-T., & Fan, K.-C. (2006) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2006.883940 · Cited by 217 · cited 1×
“Color statistics and intensity information [204], gradient information [205], and various other filters”
BackgroundEvaluation of 3D registration reliability and speed - A comparison of ICP and NDT
Magnusson, M., Nuchter, A., Lorken, C., Lilienthal, A. J., & Hertzberg, J. (2009) · 2009 IEEE International Conference on Robotics and Automation · doi:10.1109/robot.2009.5152538 · Cited by 210
A 3-D Scan Matching using Improved 3-D Normal Distributions Transform for Mobile Robotic Mapping
Takeuchi, E., & Tsubouchi, T. (2006) · 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems · doi:10.1109/iros.2006.282246 · Cited by 205 · cited 3×
“6: We used NDT matching [97], [105] to localize our vehicle in the Nagoya University campus.”
BackgroundMethodExtensive Tests of Autonomous Driving Technologies
Broggi, A., Buzzoni, M., Debattisti, S., Grisleri, P., Laghi, M. C., Medici, P., & Versari, P. (2013) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2013.2262331 · Cited by 205 · cited 1×
“Ours 1 4 Boss [43] 1 9 5 2 Junior [20] 1 2 6 4 BRAiVE [48] 5 1 10 RobotCar [49] 3 4 Google car (prius) [51] 1 4 1 Uber car (XC90) [52] 1 10 7 Uber car (Fusion) [52] 1 7 7 20 Bertha [53] 6 3 Apollo Auto [54] 1 3 2 2”
Robust lane detection and tracking with ransac and Kalman filter
Borkar, A., Hayes, M., & Smith, M. T. (2009) · 2009 16th IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2009.5413980 · Cited by 205 · cited 1×
“Geometric fitting through parametric models such as lines [206] and splines”
MethodBDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learning
Yu, F., Chen, H., Wang, X., Xian, W., Chen, Y., Liu, F., Madhavan, V., & Darrell, T. (2018) · arXiv · doi:10.48550/arxiv.1805.04687 · Cited by 204
Autonomous driving: investigating the feasibility of car-driver handover assistance
Walch, M., Lange, K., Baumann, M., & Weber, M. (2015) · Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications · doi:10.1145/2799250.2799268 · Cited by 201 · cited 1×
“the driver for handover with visual and auditory cues [286] in simulation environments, a real world system with an efficient handover interaction module does not exist at the moment.”
BackgroundThe 2005 DARPA Grand Challenge – The Great Robot Race
(2008) · Industrial Robot: An International Journal · doi:10.1108/ir.2008.04935fae.001 · Cited by 198 · cited 1×
“This time five teams managed to complete the off-road track without any human interference [6].”
BackgroundSBNet: Sparse Blocks Network for Fast Inference
Ren, M., Pokrovsky, A., Yang, B., & Urtasun, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00908 · Cited by 198 · cited 1×
“Several other works have reused camera-based algorithms and trained efficient networks for 3D object detection on 2D BV images [170]–[173].”
BackgroundAutonomous Driving in Urban Environments: Boss and the Urban Challenge
Urmson, C., Anhalt, J., Bagnell, D., Baker, C., Bittner, R., Clark, M. N., Dolan, J., Duggins, D., Galatali, T., Geyer, C., et al. (2009) · Springer Tracts in Advanced Robotics · doi:10.1007/978-3-642-03991-1_1 · Cited by 198
Modeling and Nonlinear Adaptive Control for Autonomous Vehicle Overtaking
Petrov, P., & Nashashibi, F. (2014) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2014.2303995 · Cited by 193 · cited 2×
“Curve interpolation clothoids [255], polynomials [256], Bezier [257], splines [100] Smooth but slow”
BackgroundMethodObject Detection and Tracking for Autonomous Navigation in Dynamic Environments
Ess, A., Schindler, K., Leibe, B., & Van Gool, L. (2010) · The International Journal of Robotics Research · doi:10.1177/0278364910365417 · Cited by 191 · cited 1×
“Kalman filtering is sufficient for simple linear models, while the extended and and unscented Kalman filters [186] are used to handle nonlinear dynamic models [187].”
MethodEnd-to-End Learning of Driving Models with Surround-View Cameras and Route Planners
Hecker, S., Dai, D., & Van Gool, L. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_27 · Cited by 191 · cited 1×
“However, robust automated driving in urban environments has not been achieved yet [14].”
BackgroundCombining hierarchical and goal-directed speed-up techniques for dijkstra's algorithm
Bauer, R., Delling, D., Sanders, P., Schieferdecker, D., Schultes, D., & Wagner, D. (2010) · ACM Journal of Experimental Algorithmics · doi:10.1145/1671970.1671976 · Cited by 190 · cited 1×
“For example, [249] combined a separator with a bounded-hop method and created the Transit Node Routing with Arc Flags (TNR+AF) algorithm.”
MethodIncremental Sampling-based Algorithms for Optimal Motion Planning
Karaman, S., & Frazzoli, E. (2011) · Robotics · doi:10.7551/mitpress/9123.003.0038 · Cited by 190
Fast LIDAR localization using multiresolution Gaussian mixture maps
Wolcott, R. W., & Eustice, R. M. (2015) · 2015 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2015.7139582 · Cited by 188
TorontoCity: Seeing the World with a Million Eyes
Wang, S., Bai, M., Mattyus, G., Chu, H., Luo, W., Yang, B., Liang, J., Cheverie, J., Fidler, S., & Urtasun, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.327 · Cited by 186 · cited 2×
“TorontoCity benchmark [282] is a very detailed dataset; however it is not public yet.”
BackgroundCrayton, T. J., & Meier, B. M. (2017) · Journal of Transport & Health · doi:10.1016/j.jth.2017.04.004 · Cited by 181 · cited 1×
“mobility-impaired and reducing driving related stress [2].”
YOLO3D: End-to-End Real-Time 3D Oriented Object Bounding Box Detection from LiDAR Point Cloud
Ali, W., Abdelkarim, S., Zidan, M., Zahran, M., & Sallab, A. E. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-11015-4_54 · Cited by 181
Sensor Fusion-Based Low-Cost Vehicle Localization System for Complex Urban Environments
Suhr, J. K., Jang, J., Min, D., & Jung, H. G. (2017) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2016.2595618 · Cited by 178 · cited 1×
“A vision based roadmarking detection method was introduced in [115].”
MethodInternet of Vehicles: From intelligent grid to autonomous cars and vehicular fogs
Lee, E.-K., Gerla, M., Pau, G., Lee, U., & Lim, J.-H. (2016) · International Journal of Distributed Sensor Networks · doi:10.1177/1550147716665500 · Cited by 177 · cited 2×
“term ”Internet of Vehicles” (IoV) was proposed for describing a connected ADS [44] and the term ”vehicular fog” was introduced in [45].”
BackgroundA Combined Model- and Learning-Based Framework for Interaction-Aware Maneuver Prediction
Bahram, M., Hubmann, C., Lawitzky, A., Aeberhard, M., & Wollherr, D. (2016) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2015.2506642 · Cited by 175 · cited 1×
“its. The proposed system tagged observations with predefined maneuvers. Then, the features of each type were learned in a data-centric manner with HMMs. Another learning based approach was proposed in [215], where a Bayesian network classifier was used to predict maneuvers of individual drivers on highways. A framework…”
MethodSantana, E., & Hotz, G. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1608.01230 · Cited by 174 · cited 1×
“of their dataset [289] which includes 7.”
Detection, classification and tracking of moving objects in a 3D environment
Azim, A., & Aycard, O. (2012) · 2012 IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2012.6232303 · Cited by 171 · cited 2×
“Object tracking is also often referred to as multiple object tracking (MOT) [180] and detection and tracking of multiple objects (DATMO) [181].”
Background
Research works printed but not linked: 23
- ross, 2017, The audi a8: The World’s first production car to achieve level 3 autonomy, IEEE Spectr, 1
- 2017, World population prospects the 2017 revision key findings and advance tables, Proc World Popul Prospect, 1
- 2016, Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles
- 2019, The Automotive Digital Transformation and the Economic Impacts of Existing Data Access Models
- 2019, 2019 Deloitte Global Automotive Consumer Study—Advanced Vehicle Technologies and Multimodal Transportation Global Focus Countries
- 2019, Udacity dataset
- 2018, OpenPilot
- 2018, Driveworks SDK
- maddern, 2014, Illumination invariant imaging: Applications in robust vision-based localisation, mapping and classification for autonomous vehicles, Proc Vis Place Recognit Changing Environ Workshop IEEE Int Conf Robot Automat (ICRA), 2, 3
- 2019, Apollo Auto
- somerville, 2018, Uber’s Use of Fewer Safety Sensors Prompts Questions After Arizona Crash Business News Reuters
- guizzo, 2011, How Google’s self-driving car works, IEEE Spectr, 18, 1132
- davies, 2018, Google's Self-Driving Car Caused Its First Crash
- lavrinc, 2018, This Is How Bad Self-Driving Cars Suck In The Rain
- mcfarland, 2019, Who's responsible when an autonomous car crashes?
- ackerman, 2017, Toyota’s gill pratt on self-driving cars and the reality of full autonomy, IEEE Spectr
- d’onfro, 2019, ‘I Hate Them’ Locals Reportedly Are Frustrated With Alphabet’s Self-Driving Cars
- jain, 1995, Machine Vision, 5
- 2016, Chris Urmson Explains Google Self-Driving Car Project
- 2018, Press Kit - Autopilot
- lee, 2019, How 10 Leading Companies Are Trying To Make Powerful Low-Cost Lidar
- lee, 2019, Autopilot Was Active When a Tesla Crashed Into a Truck Killing Driver
- 2019, E! 45 Programme For a European Traffic System With Highest Efficiency and Unprecedented Safety
Cited by
nuScenes: A Multimodal Dataset for Autonomous Driving
Caesar, H., Bankiti, V., Lang, A. H., Vora, S., Liong, V. E., Xu, Q., Krishnan, A., Pan, Y., Baldan, G., & Beijbom, O. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01164 · Cited by 7,152
“Since the release, nuScenes has received strong interest from the AV community [90, 70, 50, 91, 9, 5, 68, 28, 49, 86, 89].”
BackgroundSensor and Sensor Fusion Technology in Autonomous Vehicles: A Review
Yeong, D. J., Velasco-Hernandez, G., Barry, J., & Walsh, J. (2021) · Sensors · doi:10.3390/s21062140 · Cited by 1,032
Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problems
Levine, S., Kumar, A., Tucker, G., & Fu, J. (2020) · arXiv · doi:10.48550/arxiv.2005.01643 · Cited by 824
Perception and sensing for autonomous vehicles under adverse weather conditions: A survey
Zhang, Y., Carballo, A., Yang, H., & Takeda, K. (2023) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2022.12.021 · Cited by 592
Self-citationGupta, A., Anpalagan, A., Guan, L., & Khwaja, A. S. (2021) · Array · doi:10.1016/j.array.2021.100057 · Cited by 565
Metadata
- Authors
- Yurtsever, E., Lambert, J., Carballo, A., & Takeda, K.
- Affiliations
- Nagoya University (JP)
- TIER IV (Japan) (JP)
- Venue
- IEEE Access
- Published
- 2020
- Volume
- 8
- Pages
- 58443-58469
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W2953303875
- Cited by
- 1,889
- References
- 359
- Citations by year
- 2026: 230 · 2025: 421 · 2024: 372 · 2023: 301 · 2022: 240 · 2021: 232 · 2020: 91
- FWCI
- 79.88
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Engineering › Automotive Engineering › Vehicle Dynamics and Control Systems
- Keywords
- autonomous driving, autonomous vehicles, localization, mapping, perception, path planning, human-machine interaction, system architecture, driving safety, benchmark dataset, algorithm comparison
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-09-29, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-09-29 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.