Making Bertha Drive—An Autonomous Journey on a Historic Route
The DOI matches its Crossref record; 38 of the 43 references it cites were found in a registry or an index.
Abstract
Abstract-125 years after Bertha Benz completed the first overland journey in automotive history, the Mercedes Benz S-Class S 500 INTELLIGENT DRIVE followed the same route from Mannheim to Pforzheim, Germany, in fully autonomous manner. The autonomous vehicle was equipped with close-to-production sensor hardware and relied solely on vision and radar sensors in combination with accurate digital maps to obtain a comprehensive understanding of complex traffic situations. The historic Bertha Benz Memorial Route is particularly challenging for autonomous driving. The course taken by the autonomous vehicle had a length of 103 km and covered rural roads, 23 small villages and major cities (e.g. downtown Mannheim and Heidelberg). The route posed a large variety of difficult traffic scenarios including intersections with and without traffic lights, roundabouts, and narrow passages with oncoming traffic. This paper gives an overview of the autonomous vehicle and presents details on vision and radar-based perception, digital road maps and video-based self-localization, as well as motion planning in complex urban scenarios.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
(2006) · Springer Series in Operations Research and Financial Engineering · doi:10.1007/978-0-387-40065-5 · Cited by 9,008
Statecharts: a visual formalism for complex systems
Harel, D. (1987) · Science of Computer Programming · doi:10.1016/0167-6423(87)90035-9 · Cited by 6,751
An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision
Boykov, Y., & Kolmogorov, V. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.60 · Cited by 4,577
Stanley: The robot that won the DARPA Grand Challenge
Thrun, S., Montemerlo, M., Dahlkamp, H., Stavens, D., Aron, A., Diebel, J., Fong, P., Gale, J., Halpenny, M., Hoffmann, G., et al. (2006) · Journal of Field Robotics · doi:10.1002/rob.20147 · Cited by 2,237 · cited 2×
“125 years later, a Mercedes Benz S-Class prototype vehicle revisited the Bertha Benz Memorial Route, yet this time in a fully autonomous manner. et al. are: Clemens Rabe, David Pfeiffer, Frank Lindner, Fridtjof Stein, Friedrich Erbs, Markus Enzweiler, Carsten Knöppel, Jochen Hipp, Martin Haueis, Maximilian Trepte, Ca…”
BackgroundAccurate and Efficient Stereo Processing by Semi-Global Matching and Mutual Information
Hirschmuller, H. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.56 · Cited by 1,698
Autonomous driving in urban environments: Boss and the Urban Challenge
Urmson, C., Anhalt, J., Bagnell, D., Baker, C., Bittner, R., Clark, M. N., Dolan, J., Duggins, D., Galatali, T., Geyer, C., et al. (2008) · Journal of Field Robotics · doi:10.1002/rob.20255 · Cited by 1,555
(2012) · Elsevier eBooks · doi:10.1016/c2010-0-68548-8 · Cited by 1,074
Toward Efficient Trajectory Planning: The Path-Velocity Decomposition
Kant, K., & Zucker, S. W. (1986) · The International Journal of Robotics Research · doi:10.1177/027836498600500304 · Cited by 753
The Robot That Won the DARPA Grand Challenge
Thrun, S. (2007) · Cited by 406
Research works printed but not linked: 4
- lategahn, 0, Urban localizationwith camera and inertial measurement unit, Proc IEEE Intelligent Vehicles Symp, 719
- enzweiler, 0, Towards multicue urban curb recognition, Proc 2013 IEEE Intell Vehicles Symp, 902
- 2013, Vislab
- enzweiler, 0, Efficient stixelbased object recognition, Proc Intelligent Vehicles Symp, 1066
Cited by
A Survey of Motion Planning and Control Techniques for Self-Driving Urban Vehicles
Paden, B., Cap, M., Yong, S. Z., Yershov, D., & Frazzoli, E. (2016) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2016.2578706 · Cited by 2,585
“CONTENTS I Introduction 2”
A Survey of Autonomous Driving: Common Practices and Emerging Technologies
Yurtsever, E., Lambert, J., Carballo, A., & Takeda, K. (2020) · IEEE Access · doi:10.1109/access.2020.2983149 · Cited by 1,889
“Bertha [53] is developed by Daimler and has 4 120 ◦ short-range radars, two long-range range radar on the sides, stereo camera, wide angle-monocular color camera on the dashboard, another wide-angle camera for the back.”
BackgroundA Review of Motion Planning Techniques for Automated Vehicles
Gonzalez, D., Perez, J., Milanes, V., & Nashashibi, F. (2016) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2015.2498841 · Cited by 1,670
“work has been already started by KIT [5] and CMU [108].”
BackgroundMethodInfluentialFeng, D., Haase-Schutz, C., Rosenbaum, L., Hertlein, H., Glaser, C., Timm, F., Wiesbeck, W., & Dietmayer, K. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.2972974 · Cited by 1,425
“S-Class car to drive autonomously on the Bertha Benz memorial route in 2013 [16].”
MethodBadue, C., Guidolini, R., Carneiro, R. V., Azevedo, P., Cardoso, V. B., Forechi, A., Jesus, L., Berriel, R., Paixão, T. M., Mutz, F., et al. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113816 · Cited by 1,209
Simultaneous Localization and Mapping: A Survey of Current Trends in Autonomous Driving
Bresson, G., Alsayed, Z., Yu, L., & Glaser, S. (2017) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2017.2749181 · Cited by 885
“An interesting observation is that even the algorithms that utilize more precise lane maps (built manually) do not reach the critical accuracy (around 20 cm [109]) for automated driving.”
InfluentialAutonomous vehicle perception: The technology of today and tomorrow
Van Brummelen, J., O’Brien, M., Gruyer, D., & Najjaran, H. (2018) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2018.02.012 · Cited by 869
Three Decades of Driver Assistance Systems: Review and Future Perspectives
Bengler, K., Dietmayer, K., Farber, B., Maurer, M., Stiller, C., & Winner, H. (2014) · IEEE Intelligent Transportation Systems Magazine · doi:10.1109/mits.2014.2336271 · Cited by 868
Self-citationKatrakazas, C., Quddus, M., Chen, W.-H., & Deka, L. (2015) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2015.09.011 · Cited by 800
Learning Lane Graph Representations for Motion Forecasting
Liang, M., Yang, B., Hu, R., Chen, Y., Liao, R., Feng, S., & Urtasun, R. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58536-5_32 · Cited by 700
Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networks
Cui, H., Radosavljevic, V., Chou, F.-C., Lin, T.-H., Nguyen, T., Huang, T.-K., Schneider, J., & Djuric, N. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8793868 · Cited by 676
“Following approach in [21] where each vehicle is associated to a lane (referred to as a lane-following vehicle), we propose a method that implicitly outputs multiple trajectories.”
MethodInfluentialMFNet: Towards real-time semantic segmentation for autonomous vehicles with multi-spectral scenes
Ha, Q., Watanabe, K., Karasawa, T., Ushiku, Y., & Harada, T. (2017) · 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206396 · Cited by 693
Autonomous Vehicle Safety: An Interdisciplinary Challenge
Koopman, P., & Wagner, M. (2017) · IEEE Intelligent Transportation Systems Magazine · doi:10.1109/mits.2016.2583491 · Cited by 688
“(e.g., Urmson 2008, Levinson 2011, Broggi 2013, Ziegler 2014, Aeberhard 2015, SAE J3018) However, it is well known that a testing-only approach is insufficient to ensure the safety of even non-autonomous software-based critical systems.”
BackgroundA Survey on Trajectory-Prediction Methods for Autonomous Driving
Huang, Y., Du, J., Yang, Z., Zhou, Z., Zhang, L., & Chen, H. (2022) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2022.3167103 · Cited by 677
“2) Graph Neural Network Using Vector Maps: Benz [136] first applies HD maps to trajectory prediction, and executes map topology based on the lane information associated with the vehicle to obtain its future trajectory along the lane.”
MethodA Review of Motion Planning for Highway Autonomous Driving
Claussmann, L., Revilloud, M., Gruyer, D., & Glaser, S. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2913998 · Cited by 670
“In 2013, another demonstration by Daimler and Karlsruhe Institute of Technology completed the Bertha Benz Memorial Route [18] with both city and highway driving.”
BackgroundMethodInfluentialControl of connected and automated vehicles: State of the art and future challenges
Guanetti, J., Kim, Y., & Borrelli, F. (2018) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2018.04.011 · Cited by 643
Computer Vision for Autonomous Vehicles: Problems, Datasets and State of the Art
Janai, J., Güney, F., Behl, A., & Geiger, A. (2020) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000079 · Cited by 643
Seeing Through Fog Without Seeing Fog: Deep Multimodal Sensor Fusion in Unseen Adverse Weather
Bijelic, M., Gruber, T., Mannan, F., Kraus, F., Ritter, W., Dietmayer, K., & Heide, F. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01170 · Cited by 609
“The most promising autonomous vehicle systems rely on redundant inputs from multiple sensor modalities [59, 6, 74], including camera, lidar, radar, and emerging sensor such as FIR [30].”
BackgroundComputing Systems for Autonomous Driving: State of the Art and Challenges
Liu, L., Lu, S., Zhong, R., Wu, B., Yao, Y., Zhang, Q., & Shi, W. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3043716 · Cited by 450
“LiDAR is widely used in object detection, distance estimation, edge detection, Simultaneously Localization and Mapping (SLAM) [38], [11], and High-Definition (HD) Map generation [39], [40], [41], [12].”
BackgroundMethodResearch Advances and Challenges of Autonomous and Connected Ground Vehicles
Eskandarian, A., Wu, C., & Sun, C. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2958352 · Cited by 381
Real-Time Trajectory Planning for Autonomous Urban Driving: Framework, Algorithms, and Verifications
Li, X., Sun, Z., Cao, D., He, Z., & Zhu, Q. (2016) · IEEE/ASME Transactions on Mechatronics · doi:10.1109/tmech.2015.2493980 · Cited by 325
Path Smoothing Techniques in Robot Navigation: State-of-the-Art, Current and Future Challenges
Ravankar, A., Ravankar, A. A., Kobayashi, Y., Hoshino, Y., & Peng, C.-C. (2018) · Sensors · doi:10.3390/s18093170 · Cited by 314
“Work in [135,136] presents an algorithm for trajectory planning used on-board the vehicle that completed the 103 km of the Bertha-Benz-Memorial-Route fully autonomously.”
MethodA Review of Sensor Technologies for Perception in Automated Driving
Marti, E., de Miguel, M. A., Garcia, F., & Perez, J. (2019) · IEEE Intelligent Transportation Systems Magazine · doi:10.1109/mits.2019.2907630 · Cited by 315
“Some of them started independent research lines, for example BMW has been testing automation prototypes in roads since 2011 [112] and Mercedes-Benz Bertha project [113] drove in 2013 a 103 km route in automated mode using close-to-market sensors (8 radars and 3 video cameras), but in the end most manufacturers have cr…”
MethodLanelet2: A high-definition map framework for the future of automated driving
Poggenhans, F., Pauls, J.-H., Janosovits, J., Orf, S., Naumann, M., Kuhnt, F., & Mayr, M. (2018) · 2018 21st International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2018.8569929 · Cited by 312
“For the first time used for Bertha-Benz drive [1], this is a map format that was specially developed for HAD, especially for motion planning.”
MethodProbabilistic decision-making under uncertainty for autonomous driving using continuous POMDPs
Brechtel, S., Gindele, T., & Dillmann, R. (2014) · 17th International IEEE Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2014.6957722 · Cited by 279
“Ziegler et al. [8] used a hierarchical, concurrent state machine to generate basic behaviors.”
BackgroundAutonomous Vehicles Enabled by the Integration of IoT, Edge Intelligence, 5G, and Blockchain
Biswas, A., & Wang, H.-C. (2023) · Sensors · doi:10.3390/s23041963 · Cited by 274
High Definition Map for Automated Driving: Overview and Analysis
Liu, R., Wang, J., & Zhang, B. (2020) · Journal of Navigation · doi:10.1017/s0373463319000638 · Cited by 262
Experience, Results and Lessons Learned from Automated Driving on Germany's Highways
Aeberhard, M., Rauch, S., Bahram, M., Tanzmeister, G., Thomas, J., Pilat, Y., Homm, F., Huber, W., & Kaempchen, N. (2015) · IEEE Intelligent Transportation Systems Magazine · doi:10.1109/mits.2014.2360306 · Cited by 250
“The automotive industry has also been quite active in recent years with automated driving, such as in the HAVEit [11] and SARTRE [12] European Union projects, but also in independent projects, such as the Bertha Benz drive [13].”
BackgroundAsvadi, A., Premebida, C., Peixoto, P., & Nunes, U. (2016) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2016.06.007 · Cited by 245
“In case of 3D, and for intelligent/autonomous vehicles applications, a perception system perceives and interprets the surrounding environment using, commonly, data from stereo cameras [2], [3] and/or from 3D-LIDARs [4], [5].”
Uncertainty-aware Short-term Motion Prediction of Traffic Actors for Autonomous Driving
Djuric, N., Radosavljevic, V., Cui, H., Nguyen, T., Chou, F.-C., Lin, T.-H., Singh, N., & Schneider, J. (2020) · 2020 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv45572.2020.9093332 · Cited by 225
“Accurate prediction of actor motion is a critical component of deployed self-driving systems [10, 49].”
BackgroundInfluentialComputer Vision for Autonomous Vehicles: Problems, Datasets and State of the Art
Janai, J., Güney, F., Behl, A., & Geiger, A. (2020) · doi:10.1561/9781680836899 · Cited by 232
Lane Change Maneuvers for Automated Vehicles
Nilsson, J., Brannstrom, M., Coelingh, E., & Fredriksson, J. (2017) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2016.2597966 · Cited by 227
“control system, and the necessary sensor technology are given in [16]–[18] respectively, while the assumed prediction systems can utilize any prediction model e.”
Multimodal vehicle detection: fusing 3D-LIDAR and color camera data
Asvadi, A., Garrote, L., Premebida, C., Peixoto, P., & J. Nunes, U. (2018) · Pattern Recognition Letters · doi:10.1016/j.patrec.2017.09.038 · Cited by 225
Häne, C., Heng, L., Lee, G. H., Fraundorfer, F., Furgale, P., Sattler, T., & Pollefeys, M. (2017) · Image and Vision Computing · doi:10.1016/j.imavis.2017.07.003 · Cited by 222
“Similarly, the Bertha Benz self-driving car [43] uses vision and radar albeit with many more sensors to achieve a near-surround-view.”
BackgroundA Learning-Based Framework for Velocity Control in Autonomous Driving
Lefevre, S., Carvalho, A., & Borrelli, F. (2016) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2015.2498192 · Cited by 211
“Standard architecture of an automated ground vehicle (adapted from [3]). evolved much; current autonomous vehicles use the same architecture as the Urban DARPA Challenge vehicles did [1]–[4].”
Automotive Radar Signal Processing: Research Directions and Practical Challenges
Engels, F., Heidenreich, P., Wintermantel, M., Stacker, L., Al Kadi, M., & Zoubir, A. M. (2021) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2021.3063666 · Cited by 211
“Notably, also the Mercedes-Benz S 500 Intelligent Drive research vehicle employed radar and camera sensors to autonomously drive the Bertha Benz historic route in 2013 [68].”
MethodAADS: Augmented autonomous driving simulation using data-driven algorithms
Li, W., Pan, C. W., Zhang, R., Ren, J. P., Ma, Y. X., Fang, J., Yan, F. L., Geng, Q. C., Huang, X. Y., Gong, H. J., et al. (2019) · Science Robotics · doi:10.1126/scirobotics.aaw0863 · Cited by 209
Robust Multimodal Vehicle Detection in Foggy Weather Using Complementary Lidar and Radar Signals
Qian, K., Zhu, S., Zhang, X., & Li, L. E. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00051 · Cited by 206
“Aside from lidar and camera, radar has been widely deployed on autonomous vehicles [6, 3, 58] and has the potential to overcome foggy weather.”
BackgroundAutonomous Driving Motion Planning With Constrained Iterative LQR
Chen, J., Zhan, W., & Tomizuka, M. (2019) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2019.2904385 · Cited by 199
“An example of this method in autonomous driving is the work by Mercedes-Benz [4], [16], which utilized SQP for autonomous driving motion planning.”
MethodTPCN: Temporal Point Cloud Networks for Motion Forecasting
Ye, M., Cao, T., & Chen, Q. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01116 · Cited by 186
“Traditional methods for motion forecasting [15, 28, 34, 39] are based on kinematic constraints and road map information with handcrafted rules.”
MethodAutomated driving recognition technologies for adverse weather conditions
Yoneda, K., Suganuma, N., Yanase, R., & Aldibaja, M. (2019) · IATSS Research · doi:10.1016/j.iatssr.2019.11.005 · Cited by 182
Hybrid Trajectory Planning for Autonomous Driving in On-Road Dynamic Scenarios
Lim, W., Lee, S., Sunwoo, M., & Jo, K. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2957797 · Cited by 181
“autonomous driving [2]–[5], have been conducted, several challenges remain for fully autonomous driving.”
BackgroundRadar Sensors for Autonomous Driving: Modulation Schemes and Interference Mitigation
Roos, F., Bechter, J., Knill, C., Schweizer, B., & Waldschmidt, C. (2019) · IEEE Microwave Magazine · doi:10.1109/mmm.2019.2922120 · Cited by 182
“To operate at the full automation level, a multi radar sensor setup is necessary [2], such as the one used in the autonomous vehicle “Bertha” [25] in Fig.”
MethodSensor Fusion-Based Low-Cost Vehicle Localization System for Complex Urban Environments
Suhr, J. K., Jang, J., Min, D., & Jung, H. G. (2017) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2016.2595618 · Cited by 178
“V EHICLE localization is a key component of both autonomous driving and advanced driver assistance systems (ADAS) [1].”
BackgroundIntelligent and connected vehicles: Current status and future perspectives
Yang, D., Jiang, K., Zhao, D., Yu, C., Cao, Z., Xie, S., Xiao, Z., Jiao, X., Wang, S., & Zhang, K. (2018) · Science China Technological Sciences · doi:10.1007/s11431-017-9338-1 · Cited by 176
Internet of Vehicles: From intelligent grid to autonomous cars and vehicular fogs
Lee, E.-K., Gerla, M., Pau, G., Lee, U., & Lim, J.-H. (2016) · International Journal of Distributed Sensor Networks · doi:10.1177/1550147716665500 · Cited by 177
“Recall that the AUV must be capable of sensing its surroundings and of self-driving without human inputs.(8) To this end, it uses a myriad of on-board sensors, ranging from radio detection and ranging (RADAR), GPS, video cameras to controller area network (CAN) bus sensors that monitor vehicle’s internal operation sta…”
MethodGlobal and Local Path Planning Study in a ROS-Based Research Platform for Autonomous Vehicles
Marin-Plaza, P., Hussein, A., Martin, D., & Escalera, A. D. L. (2018) · Journal of Advanced Transportation · doi:10.1155/2018/6392697 · Cited by 166
“Some research groups test these modules on real vehicles such as PROUD in Parma in 2013 [1] or Karlsruhe Institute of Technology (KIT) driving around the cities with advanced technology in perception, navigation, and decision making [2].”
BackgroundAlgorithm and hardware implementation for visual perception system in autonomous vehicle: A survey
Shi, W., Alawieh, M. B., Li, X., & Yu, H. (2017) · Integration · doi:10.1016/j.vlsi.2017.07.007 · Cited by 175
The Role of Machine Vision for Intelligent Vehicles
Ranft, B., & Stiller, C. (2016) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2016.2551553 · Cited by 168
“Two-frame methods require this information between every pair of frames; the more complex multi-frame methods employ techniques, i.a., bundle adjustment to track the scale for varying amounts of time [81].”
BackgroundMethodSelf-citationA Survey on Map-Based Localization Techniques for Autonomous Vehicles
Chalvatzaras, A., Pratikakis, I., & Amanatiadis, A. A. (2022) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2022.3192102 · Cited by 195
“…back to the first Google car where a detailed map was recorded in a prior manual drive utilizing a roof-mounted laser scanner [19], and the Bertha Benz experimental vehicle [20], where such a map was the critical component for obtaining a comprehensive understanding of the complex traffic situations.”
MethodAutomatic Generation of Safety-Critical Test Scenarios for Collision Avoidance of Road Vehicles
Althoff, M., & Lutz, S. (2018) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2018.8500374 · Cited by 144
Sharma, O., Sahoo, N. C., & Puhan, N. B. (2021) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2021.104211 · Cited by 161
Kim, J., & Kum, D. (2017) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2017.2768318 · Cited by 141
“Among others, global automotive companies such as BMW, Volvo, and Mercedes-Benz have already invested considerable efforts in developing autonomous driving technologies [1].”
BackgroundLocalization and Mapping for Robots in Agriculture and Forestry: A Survey
Aguiar, A., dos Santos, F. N., Boaventura‐Cunha, J., Sobreira, H., & Sousa, A. J. (2020) · Robotics · doi:10.3390/robotics9040097 · Cited by 168
“In the ideal case the accuracy show be less that some value (usually 20 cm [37,57]).”
BackgroundHigh-Definition Maps: Comprehensive Survey, Challenges, and Future Perspectives
Elghazaly, G., Frank, R., Harvey, S., & Safko, S. (2023) · IEEE Open Journal of Intelligent Transportation Systems · doi:10.1109/ojits.2023.3295502 · Cited by 213
“These features are either geometric (e.g., lane markings) or semantic map elements (traffic signs, road signs, and POI) [14].”
BackgroundMethodInfluentialUsing Reachable Sets for Trajectory Planning of Automated Vehicles
Manzinger, S., Pek, C., & Althoff, M. (2020) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2020.3017342 · Cited by 163
“, using ontologies [43]–[45] or state-machines [46]– [49], may fail in unforeseen traffic situations.”
MethodTransitioning to manual driving requires additional time after automation deactivation
Vogelpohl, T., Kuhn, M. G., Hummel, T., Gehlert, T., & Vollrath, M. (2018) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2018.03.019 · Cited by 156
Heng, L., Choi, B., Cui, Z., Geppert, M., Hu, S., Kuan, B., Liu, P., Nguyen, R. M. H., Yeo, Y. C., Geiger, A., et al. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8793949 · Cited by 162
“We follow the traditional approach [33, 3] of applying multi-view geometry to localization and 3D geometric mapping, and machine learning to cross-modal matching, object detection, and scene segmentation.”
A Noncooperative Game Approach to Autonomous Racing
Liniger, A., & Lygeros, J. (2019) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2019.2895282 · Cited by 145
Coordination of Cooperative Autonomous Vehicles: Toward safer and more efficient road transportation
Hult, R., de Campos, G. R., Steinmetz, E., Hammarstrand, L., Falcone, P., & Wymeersch, H. (2016) · IEEE Signal Processing Magazine · doi:10.1109/msp.2016.2602005 · Cited by 150
“In the case where the map is pre-constructed, the mapping and the localization problem can be separated and only the localization part needs to be solved online [28].”
BackgroundBharilya, V., & Kumar, N. (2024) · Vehicular Communications · doi:10.1016/j.vehcom.2024.100733 · Cited by 203
Stellet, J. E., Zofka, M. R., Schumacher, J., Schamm, T., Niewels, F., & Zollner, J. M. (2015) · 2015 IEEE 18th International Conference on Intelligent Transportation Systems · doi:10.1109/itsc.2015.236 · Cited by 124
“Typically, this applies to public road tests or field operational tests like the Bertha-Benz drive [78].”
End-to-end Contextual Perception and Prediction with Interaction Transformer
Li, L. L., Yang, B., Liang, M., Zeng, W., Ren, M., Segal, S., & Urtasun, R. (2020) · 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341392 · Cited by 119
Walch, M., Mühl, K., Kraus, J., Stoll, T., Baumann, M. R. K., & Weber, M. (2017) · Human-computer interaction series · doi:10.1007/978-3-319-49448-7_10 · Cited by 145
Autonomous driving at Ulm University: A modular, robust, and sensor-independent fusion approach
Kunz, F., Nuß, D., Wiest, J., Deusch, H., Reuter, S., Gritschneder, F., Scheel, A., Stübler, M., Bach, M., Hatzelmann, P., et al. (2015) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2015.7225761 · Cited by 124
“Bertha [10], an autonomous S-Class equipped with close-tomarket sensors.”
BackgroundA functional architecture for autonomous driving
Behere, S., & Törngren, M. (2015) · Proceedings of the First International Workshop on Automotive Software Architecture · doi:10.1145/2752489.2752491 · Cited by 121
“However, each allocation has slightly different responsibilities and scope of operation.”
BackgroundToward a Framework for Highly Automated Vehicle Safety Validation
Koopman, P. J., & Wagner, M. (2018) · SAE technical papers on CD-ROM/SAE technical paper series · doi:10.4271/2018-01-1071 · Cited by 146
A Survey of FPGA-Based Robotic Computing
Wan, Z., Bo, Y., Li, T. Y., Tang, J., Zhu, Y., Wang, Y., Raychowdhury, A., & Liu, S. (2021) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2021.3071609 · Cited by 151
“Apart from these techniques, sensor fusion strategy is also often utilized to combine multiple sensors for localization, which can improve the reliability and robustness of robot [31], [32].”
MethodA functional reference architecture for autonomous driving
Behere, S. S., & Törngren, M. (2015) · Information and Software Technology · doi:10.1016/j.infsof.2015.12.008 · Cited by 122
Creating Autonomous Vehicle Systems
Liu, S., Li, L., Tang, J., Wu, S., & Gaudiot, J. (2017) · Synthesis lectures on computer science · doi:10.2200/s00787ed1v01y201707csl009 · Cited by 135
Functional system architectures towards fully automated driving
Taş, Ö. Ş., Kuhnt, F., Zöllner, J. M., & Stiller, C. (2016) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2016.7535402 · Cited by 145
“Benz Memorial Route [23].”
Self-citation3D Point Cloud Generation with Millimeter-Wave Radar
Qian, K., He, Z., & Zhang, X. (2020) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3432221 · Cited by 141
“With a field-of-view spanned by the range and cross-range direction, the MilliPoint point cloud can be post-processed to facilitate parking, lane change, blind spot detection, and other perception functions such as cross-traffic monitoring [71].”
MethodLearning to Predict Vehicle Trajectories with Model-based PlanningPreprint
Song, H., Luan, D., Ding, W., Wang, M. Y., & Chen, Q. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.04027 · Cited by 131
A Review of Deep Learning-Based Methods for Pedestrian Trajectory Prediction
Sighencea, B. I., Stanciu, R., & Căleanu, C. D. (2021) · Sensors · doi:10.3390/s21227543 · Cited by 128
“To be able to perform such tasks, SDVs rely on several sensors (such as LiDAR, radars, and cameras) to detect objects in its vicinity, as well as predict their future trajectory and their motion uncertainty [7].”
MethodTrajectory prediction for heterogeneous traffic-agents using knowledge correction data-driven model
Xu, X., Liu, W., & Yu, L. (2022) · Information Sciences · doi:10.1016/j.ins.2022.06.073 · Cited by 114
EPSILON: An Efficient Planning System for Automated Vehicles in Highly Interactive Environments
Ding, W., Zhang, L., Chen, J., & Shen, S. (2021) · IEEE Transactions on Robotics · doi:10.1109/tro.2021.3104254 · Cited by 141
A review of high-definition map creation methods for autonomous driving
Bao, Z., Hossain, S., Lang, H., & Lin, X. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.106125 · Cited by 174
Summary Maps for Lifelong Visual Localization
Mühlfellner, P., Bürki, M., Bosse, M., Derendarz, W., Philippsen, R., & Furgale, P. (2016) · Journal of Field Robotics · doi:10.1002/rob.21595 · Cited by 110
“Map-based robotic navigation is one of the dominant paradigms for implementing driverless cars (Furgale et al., 2013; Lategahn & Stiller, 2012; Ziegler et al., 2014b).”
BackgroundSet-Based Prediction of Traffic Participants on Arbitrary Road Networks
Althoff, M., & Magdici, S. (2016) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2016.2622920 · Cited by 135
“It can be expected that lane information is provided in future autonomous vehicles, see e.g. [55].”
BackgroundCoherent Automotive Radar Networks: The Next Generation of Radar-Based Imaging and Mapping
Gottinger, M., Hoffmann, M., Christmann, M., Schütz, M., Kirsch, F., Gulden, P., & Vossiek, M. (2021) · IEEE Journal of Microwaves · doi:10.1109/jmw.2020.3034475 · Cited by 106
“As demonstrated in [4], autonomous test vehicles can be equipped with eight radar sensors and additional stereo cameras for sensing”
BackgroundPrediction of Lane-Changing Maneuvers with Automatic Labeling and Deep Learning
Mahajan, V., Katrakazas, C., & Antoniou, C. (2020) · Transportation Research Record Journal of the Transportation Research Board · doi:10.1177/0361198120922210 · Cited by 115
Turay, T., & Vladimirova, T. (2022) · IEEE Access · doi:10.1109/access.2022.3147495 · Cited by 132
“At present, this approach is the most preferred system type [26], [218], [46], [178], [222]–[226], as it may be that the enormous development challenges force the industry to focus on this system type for now.”
BackgroundDeep Object-Centric Policies for Autonomous Driving
Wang, D., Devin, C., Cai, Q.-Z., Yu, F., & Darrell, T. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8794224 · Cited by 100
“These modular pipelines with rule-based system dominate autonomous driving industry [6], [7], [8].”
Deep Kinematic Models for Kinematically Feasible Vehicle Trajectory Predictions
Cui, H., Nguyen, T., Chou, F., Lin, T.-H., Schneider, J., Bradley, D., & Djuric, N. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9197560 · Cited by 139
“An alternative method explicitly models lane-following driving behavior by using map information as a constraint on future vehicle positions [16].”
MethodGeneration of a Precise and Efficient Lane-Level Road Map for Intelligent Vehicle Systems
Gwon, G.-P., Hur, W.-S., Kim, S.-W., & Seo, S. (2016) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2016.2535210 · Cited by 103
“Various methods based on perception sensors have been introduced in recent years to tackle the problems of using GPSbased methods [20], [26], [30]–[33].”
MethodGhorai, P., Eskandarian, A., Kim, Y., & Mehr, G. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3160932 · Cited by 125
“Among them are not only platforms from academia such as Stanford’s Junior [48], CMU’s Boss [49], and RobotCar [50], but also commercial ones like the Tesla Autopilot [51], Uber Car (Ford Fusion) [52], Apollo Auto [53], Bertha [54], and Google’s self-driving car [55].”
BackgroundOptimal Vehicle Path Planning Using Quadratic Optimization for Baidu Apollo Open Platform
Zhang, Y., Sun, H., Zhou, J., Pan, J., Hu, J., & Miao, J. (2020) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv47402.2020.9304787 · Cited by 111
“The work in [16] runs a quadratic programming procedure in global/map frame to directly compute a trajectory (path and assigned speed profile at the same time).”
PROUD—Public Road Urban Driverless-Car Test
Broggi, A., Cerri, P., Debattisti, S., Laghi, M. C., Medici, P., Molinari, D., Panciroli, M., & Prioletti, A. (2015) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2015.2477556 · Cited by 96
“In August 2013, an S-Class vehicle with close-to-production sensors drove completely autonomously for about 100 km, following the well-known historic Bertha Benz Memorial Route [16], [17].”
MethodA non-conservatively defensive strategy for urban autonomous driving
Zhan, W., Liu, C., Chan, C., & Tomizuka, M. (2016) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2016.7795595 · Cited by 98
“Typically, the relationship between decision-making and motion planning is hierachical [4].”
BackgroundLiu, Q., Li, X., Yuan, S., & Li, Z. (2021) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc48978.2021.9564580 · Cited by 130
“Classical Methods Rule-based Methods [13-19] Strong interpretability and adjustability Strong feasibility of implementation since its low requirements for hardware Good decision-making breadth Difficult to handle complex driving conditions since the lack of decision-making depth Poor robustness for dynamic d…”
BackgroundMethodInfluentialSchuster, M. J., Brunner, S. G., Bussmann, K., Büttner, S., Dömel, A., Hellerer, M., Lehner, H., Lehner, P., Porges, O., Reill, J., et al. (2017) · Journal of Intelligent & Robotic Systems · doi:10.1007/s10846-017-0680-9 · Cited by 117
Machine Learning-Based Detection for Cyber Security Attacks on Connected and Autonomous Vehicles
He, Q., Meng, X., Qu, R., & Xi, R. (2020) · Mathematics · doi:10.3390/math8081311 · Cited by 88
“The HardwareData class is the sensor data collected from the vehicle’s surroundings by various CAV sensors, including Radar, Global Navigation Satellite Systems (GNSS) and camera [38]; for example, GNSS and image data which determine the current position of a CAV.”
MethodAutomotive radar gridmap representations
Werber, K., Rapp, M., Klappstein, J., Hahn, M., Dickmann, J., Dietmayer, K., & Waldschmidt, C. (2015) · IEEE MTT-S International Conference on Microwaves for Intelligent Mobility (ICMIM) · doi:10.1109/icmim.2015.7117922 · Cited by 88
“Many autonomous driving applications focus on the sharp distinction between obstacles and free space, e.g. path planning [10].”
Learning From Naturalistic Driving Data for Human-Like Autonomous Highway Driving
Xu, D., Ding, Z., Xu, H., Zhao, H., Moze, M., Aioun, F., & Guillemard, F. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.3001131 · Cited by 98
Towards Cooperative Driving: Involving the Driver in an Autonomous Vehicle's Decision Making
Walch, M., Sieber, T., Höck, P., Baumann, M. R. K., & Weber, M. (2016) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3003715.3005458 · Cited by 106
“It has already been shown that the technology is at a point where prototypes can drive autonomously on public roads (e.g. [1, 8, 17]).”
BackgroundMapping Two Decades of Autonomous Vehicle Research: A Systematic Scientometric Analysis
Faisal, A., Yigitcanlar, T., Kamruzzaman, M., & Paz, A. (2021) · Journal of Urban Technology · doi:10.1080/10630732.2020.1780868 · Cited by 85
Bézier curve‐based trajectory planning for autonomous vehicles with collision avoidance
Zheng, L., Zeng, P., Yang, W., Li, Y., & Zhan, Z. (2020) · IET Intelligent Transport Systems · doi:10.1049/iet-its.2020.0355 · Cited by 99
Challenges in Perception and Decision Making for Intelligent Automotive Vehicles: A Case Study
Okumura, B., James, M. R., Kanzawa, Y., Derry, M., Sakai, K., Nishi, T., & Prokhorov, D. V. (2016) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2016.2551545 · Cited by 93
“…a solution for the perception and decision making system as a whole, e.g., as in the recent paper about the historic test of the Mercedes Benz S-Class prototype vehicle " Bertha " [2] or in the paper overviewing the results of BMW's highly automated driving experience on German highways [7].”
BackgroundSPOT: A tool for set-based prediction of traffic participants
Koschi, M., & Althoff, M. (2017) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2017.7995951 · Cited by 87
Multi-View Fusion of Sensor Data for Improved Perception and Prediction in Autonomous Driving
Fadadu, S., Pandey, S., Hegde, D. K., Shi, Y., Chou, F., Djuric, N., & Vallespi-Gonzalez, C. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00335 · Cited by 117
Metadata
- Authors
- Ziegler, J., Bender, P., Schreiber, M., Lategahn, H., Strauss, T., Stiller, C., Dang, T., Franke, U., Appenrodt, N., Keller, C. G., Kaus, E., Herrtwich, R. G., Rabe, C., Pfeiffer, D., Lindner, F., Stein, F., Erbs, F., Enzweiler, M., Knoppel, C., Hipp, J., Haueis, M., Trepte, M., Brenk, C., Tamke, A., Ghanaat, M., Braun, M., Joos, A., Fritz, H., Mock, H., Hein, M., & Zeeb, E.
- Affiliations
- FZI Research Center for Information Technology (DE)
- Karlsruhe Institute of Technology (DE)
- Daimler (Germany) (DE)
- ORCID
- Venue
- IEEE Intelligent Transportation Systems Magazine
- Published
- 2014
- Volume
- 6
- Issue
- 2
- Pages
- 8-20
- ISSN
- 1939-1390 (ISSN-L)
- OpenAlex
- W2032924574
- Cited by
- 854
- References
- 43
- Citations by year
- 2026: 24 · 2025: 44 · 2024: 50 · 2023: 51 · 2022: 71 · 2021: 86 · 2020: 111 · 2019: 97 · 2018: 97 · 2017: 74 · 2016: 76 · 2015: 65 · 2014: 8
- FWCI
- 91.66
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Intelligent Transportation Systems Magazine (publishedVersion)
- Topics
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Robotics and Sensor-Based Localization
- Physical Sciences › Engineering › Automotive Engineering › Vehicle Dynamics and Control Systems
- Keywords
- autonomous driving, camera-based perception, radar sensors, digital road maps, motion planning, urban traffic scenarios, roundabouts, intersections, narrow passages
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.