The DOI matches its Crossref record; 161 of the 161 references it cites were found in a registry or an index.
Deep Learning Sensor Fusion for Autonomous Vehicle Perception and Localization: A Review
Open accessAbstract
Autonomous vehicles (AV) are expected to improve, reshape, and revolutionize the future of ground transportation. It is anticipated that ordinary vehicles will one day be replaced with smart vehicles that are able to make decisions and perform driving tasks on their own. In order to achieve this objective, self-driving vehicles are equipped with sensors that are used to sense and perceive both their surroundings and the faraway environment, using further advances in communication technologies, such as 5G. In the meantime, local perception, as with human beings, will continue to be an effective means for controlling the vehicle at short range. In the other hand, extended perception allows for anticipation of distant events and produces smarter behavior to guide the vehicle to its destination while respecting a set of criteria (safety, energy management, traffic optimization, comfort). In spite of the remarkable advancements of sensor technologies in terms of their effectiveness and applicability for AV systems in recent years, sensors can still fail because of noise, ambient conditions, or manufacturing defects, among other factors; hence, it is not advisable to rely on a single sensor for any of the autonomous driving tasks. The practical solution is to incorporate multiple competitive and complementary sensors that work synergistically to overcome their individual shortcomings. This article provides a comprehensive review of the state-of-the-art methods utilized to improve the performance of AV systems in short-range or local vehicle environments. Specifically, it focuses on recent studies that use deep learning sensor fusion algorithms for perception, localization, and mapping. The article concludes by highlighting some of the current trends and possible future research directions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
(2016) · Cited by 31,590
Girshick, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.169 · Cited by 28,105
SSD: Single Shot MultiBox Detector
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_2 · Cited by 22,128
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
YOLO9000: Better, Faster, Stronger
Redmon, J., & Farhadi, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.690 · Cited by 19,892
A logical calculus of the ideas immanent in nervous activity
McCulloch, W. S., & Pitts, W. (1943) · The Bulletin of Mathematical Biophysics · doi:10.1007/bf02478259 · Cited by 18,566
YOLOv3: An Incremental Improvement
Redmon, J., & Farhadi, A. (2018) · arXiv · doi:10.48550/arxiv.1804.02767 · Cited by 17,141
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2389824 · Cited by 11,971
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
Charles, R. Q., Su, H., Kaichun, M., & Guibas, L. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.16 · Cited by 9,237
Gulshan, V., Peng, L., Coram, M., Stumpe, M. C., Wu, D., Narayanaswamy, A., Venugopalan, S., Widner, K., Madams, T., Cuadros, J., et al. (2016) · JAMA · doi:10.1001/jama.2016.17216 · Cited by 7,697
ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras
Mur-Artal, R., & Tardos, J. D. (2017) · IEEE Transactions on Robotics · doi:10.1109/tro.2017.2705103 · Cited by 6,898
VoxNet: A 3D Convolutional Neural Network for real-time object recognition
Maturana, D., & Scherer, S. (2015) · 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353481 · Cited by 3,458
Multi-view 3D Object Detection Network for Autonomous Driving
Chen, X., Ma, H., Wan, J., Li, B., & Xia, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.691 · Cited by 3,450
Deep neural networks are easily fooled: High confidence predictions for unrecognizable images
Nguyen, A., Yosinski, J., & Clune, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298640 · Cited by 3,258
Unsupervised Learning of Depth and Ego-Motion from Video
Zhou, T., Brown, M., Snavely, N., & Lowe, D. G. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.700 · Cited by 2,910
An introduction to multisensor data fusion
Hall, D. L., & Llinas, J. (1997) · Proceedings of the IEEE · doi:10.1109/5.554205 · Cited by 2,629
Robust physical-world attacks on deep learning visual classification
Eykholt, K., Evtimov, I., Fernandes, E., Li, B., Rahmati, A., Xiao, C., Prakash, A., Kohno, T., & Song, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00175 · Cited by 2,173
Introduction to autonomous mobile robots
(2011) · Choice Reviews Online · doi:10.5860/choice.49-1492 · Cited by 2,169
Multisensor data fusion: A review of the state-of-the-art
Khaleghi, B., Khamis, A., Karray, F. O., & Razavi, S. N. (2013) · Information Fusion · doi:10.1016/j.inffus.2011.08.001 · Cited by 2,074
DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving
Chen, C., Seff, A., Kornhauser, A., & Xiao, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.312 · Cited by 1,876
DSSD : Deconvolutional Single Shot Detector
Fu, C.-Y., Liu, W., Ranga, A., Tyagi, A., & Berg, A. C. (2017) · arXiv · doi:10.48550/arxiv.1701.06659 · Cited by 1,624
Feng, D., Haase-Schutz, C., Rosenbaum, L., Hertlein, H., Glaser, C., Timm, F., Wiesbeck, W., & Dietmayer, K. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.2972974 · Cited by 1,425
DS-SLAM: A Semantic Visual SLAM towards Dynamic Environments
Yu, C., Liu, Z., Liu, X.-J., Xie, F., Yang, Y., Wei, Q., & Fei, Q. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8593691 · Cited by 1,154
Deep Learning for Household Load Forecasting—A Novel Pooling Deep RNN
Shi, H., Xu, M., & Li, R. (2018) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2017.2686012 · Cited by 1,102
Very Deep Convolutional Networks for Text Classification
Conneau, A., Schwenk, H., Barrault, L., & Lecun, Y. (2017) · Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers · doi:10.18653/v1/e17-1104 · Cited by 1,046
A Review of Data Fusion Techniques
Castanedo, F. (2013) · The Scientific World Journal · doi:10.1155/2013/704504 · Cited by 1,027
Monocular 3D Object Detection for Autonomous Driving
Chen, X., Kundu, K., Zhang, Z., Ma, H., Fidler, S., & Urtasun, R. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.236 · Cited by 1,019
Deepvo: towards end-to-end visual odometry with deep recurrent convolutional neural networks
Wang, S., Clark, R., Wen, H., & Trigoni, N. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989236 · Cited by 970 · cited 1×
“To demonstrate the advantage of adopting a recurrent neural network for VO, Wang et al. [154] implemented an end-to-end deep recurrent convolutional network that takes sequential RGB images and detects poses.”
Simultaneous Localization and Mapping: A Survey of Current Trends in Autonomous Driving
Bresson, G., Alsayed, Z., Yu, L., & Glaser, S. (2017) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2017.2749181 · Cited by 885
Autonomous vehicle perception: The technology of today and tomorrow
Van Brummelen, J., O’Brien, M., Gruyer, D., & Najjaran, H. (2018) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2018.02.012 · Cited by 869
Self-citationSpeech enhancement based on deep denoising autoencoder
Lu, X., Tsao, Y., Matsuda, S., & Hori, C. (2013) · Interspeech 2013 · doi:10.21437/interspeech.2013-130 · Cited by 834
(2015) · Cited by 809
CNN-SLAM: Real-Time Dense Monocular SLAM with Learned Depth Prediction
Tateno, K., Tombari, F., Laina, I., & Navab, N. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.695 · Cited by 800
Katrakazas, C., Quddus, M., Chen, W.-H., & Deka, L. (2015) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2015.09.011 · Cited by 800
Visual-lidar odometry and mapping: low-drift, robust, and fast
Zhang, J., & Singh, S. (2015) · 2015 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2015.7139486 · Cited by 747
Matsugu, M., Mori, K., Mitari, Y., & Kaneda, Y. (2003) · Neural Networks · doi:10.1016/s0893-6080(03)00115-1 · Cited by 715
Semi-Supervised Deep Learning for Monocular Depth Map Prediction
Kuznietsov, Y., Stuckler, J., & Leibe, B. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.238 · Cited by 680
Perception, Planning, Control, and Coordination for Autonomous Vehicles
Pendleton, S., Andersen, H., Du, X., Shen, X., Meghjani, M., Eng, Y., Rus, D., & Ang, M. (2017) · Machines · doi:10.3390/machines5010006 · Cited by 657
Deep Captioning with Multimodal Recurrent Neural Networks (m-RNN)
Mao, J., Xu, W., Yang, Y., Wang, J., Huang, Z., & Yuille, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.6632 · Cited by 620
Seeing Through Fog Without Seeing Fog: Deep Multimodal Sensor Fusion in Unseen Adverse Weather
Bijelic, M., Gruber, T., Mannan, F., Kraus, F., Ritter, W., Dietmayer, K., & Heide, F. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01170 · Cited by 609
UnDeepVO: Monocular Visual Odometry Through Unsupervised Deep Learning
Li, R., Wang, S., Long, Z., & Gu, D. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8461251 · Cited by 581
Multispectral Deep Neural Networks for Pedestrian Detection
Liu, J., Zhang, S., Wang, S., & Metaxas, D. (2016) · Procedings of the British Machine Vision Conference 2016 · doi:10.5244/c.30.73 · Cited by 543
Large-scale direct SLAM with stereo cameras
Engel, J., Stuckler, J., & Cremers, D. (2015) · 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353631 · Cited by 539
Illumination-aware faster R-CNN for robust multispectral pedestrian detection
Li, C., Song, D., Tong, R., & Tang, M. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2018.08.005 · Cited by 533
Object Classification Using CNN-Based Fusion of Vision and LIDAR in Autonomous Vehicle Environment
Gao, H., Cheng, B., Wang, J., Li, K., Zhao, J., & Li, D. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2822828 · Cited by 524
Sensor fusion potential exploitation-innovative architectures and illustrative applications
Dasarathy, B. V. (1997) · Proceedings of the IEEE · doi:10.1109/5.554206 · Cited by 498
Efficient Surfel-Based SLAM using 3D Laser Range Data in Urban Environments
Behley, J., & Stachniss, C. (2018) · Robotics: Science and Systems XIV · doi:10.15607/rss.2018.xiv.016 · Cited by 494
The Microsoft 2017 Conversational Speech Recognition System
Xiong, W., Wu, L., Alleva, F., Droppo, J., Huang, X., & Stolcke, A. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8461870 · Cited by 472
Using very deep autoencoders for content-based image retrieval.
Krizhevsky, A., & Hinton, G. E. (2011) · The European Symposium on Artificial Neural Networks · Cited by 471
Robust Physical-World Attacks on Deep Learning Models
Eykholt, K., Evtimov, I., Fernandes, E., Li, B., Rahmati, A., Xiao, C., Prakash, A., Kohno, T., & Song, D. X. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.08945 · Cited by 444
D3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometry
Yang, N., von Stumberg, L., Wang, R., & Cremers, D. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00136 · Cited by 438
DeepID-Net: Deformable deep convolutional neural networks for object detection
Ouyang, W., Wang, X., Zeng, X., Qiu, S., Luo, P., Tian, Y., Li, H., Yang, S., Wang, Z., Loy, C.-C., et al. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298854 · Cited by 430
Pfeiffer, M., Schaeuble, M., Nieto, J., Siegwart, R., & Cadena, C. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989182 · Cited by 413
GPS/IMU data fusion using multisensor Kalman filtering: introduction of contextual aspects
Caron, F., Duflos, E., Pomorski, D., & Vanheeghe, P. (2006) · Information Fusion · doi:10.1016/j.inffus.2004.07.002 · Cited by 401
Kato, S., Tsugawa, S., Tokuda, K., Matsui, T., & Fujii, H. (2002) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2002.802929 · Cited by 401
Remote sensing image fusion based on two-stream fusion network
Liu, X., Liu, Q., & Wang, Y. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.07.010 · Cited by 395
IMLS-SLAM: Scan-to-Model Matching Based on 3D Data
Deschaud, J.-E. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460653 · Cited by 383
A deep learning ensemble approach for crude oil price forecasting
Zhao, Y., Li, J., & Yu, L. (2017) · Energy Economics · doi:10.1016/j.eneco.2017.05.023 · Cited by 380
FSSD: Feature Fusion Single Shot Multibox Detector
Li, Z., Yang, L., & Zhou, F. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.00960 · Cited by 373
LIDAR–camera fusion for road detection using fully convolutional neural networks
Caltagirone, L., Bellone, M., Svensson, L., & Wahde, M. (2019) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2018.11.002 · Cited by 370
Xiao, L., Wang, J., Qiu, X., Rong, Z., & Zou, X. (2019) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2019.03.012 · Cited by 348
Why deep-learning AIs are so easy to fool
Heaven, D. (2019) · Nature · doi:10.1038/d41586-019-03013-5 · Cited by 342 · cited 1×
“Additionally, [178,179] introduced an overview that illustrates how deep learning methods can be deceived and breached.”
Guan, D., Cao, Y., Yang, J., Cao, Y., & Yang, M. Y. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.11.017 · Cited by 342
An Overview to Visual Odometry and Visual SLAM: Applications to Mobile Robotics
Yousif, K., Bab-Hadiashar, A., & Hoseinnezhad, R. (2015) · Intelligent Industrial Systems · doi:10.1007/s40903-015-0032-7 · Cited by 322
L3-Net: Towards Learning Based LiDAR Localization for Autonomous Driving
Lu, W., Zhou, Y., Wan, G., Hou, S., & Song, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00655 · Cited by 311
Advhat: Real-world adversarial attack on arcface face id system
Komkov, S., & Petiushko, A. (2021) · 2020 25th International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr48806.2021.9412236 · Cited by 294
Limo: Lidar-monocular visual odometry
Graeter, J., Wilczynski, A., & Lauer, M. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594394 · Cited by 261
Multispectral Pedestrian Detection using Deep Fusion Convolutional Neural Networks.
Wagner, J., Fischer, V., Herman, M., & Behnke, S. (2016) · The European Symposium on Artificial Neural Networks · Cited by 244
Deep Auxiliary Learning for Visual Localization and Odometry
Valada, A., Radwan, N., & Burgard, W. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8462979 · Cited by 241
End-to-end, sequence-to-sequence probabilistic visual odometry through deep neural networks
Wang, S., Clark, R., Wen, H., & Trigoni, N. (2018) · The International Journal of Robotics Research · doi:10.1177/0278364917734298 · Cited by 238
Multimodal vehicle detection: fusing 3D-LIDAR and color camera data
Asvadi, A., Garrote, L., Premebida, C., Peixoto, P., & J. Nunes, U. (2018) · Pattern Recognition Letters · doi:10.1016/j.patrec.2017.09.038 · Cited by 225
GPS/INS integration utilizing dynamic neural networks for vehicular navigation
Noureldin, A. M., El‐Shafie, A., & Bayoumi, M. M. (2010) · Information Fusion · doi:10.1016/j.inffus.2010.01.003 · Cited by 224
LIMO: Lidar-Monocular Visual OdometryPreprint
Gräter, J., Wilczynski, A., & Lauer, M. (2018) · IEEE/RJS International Conference on Intelligent RObots and Systems · doi:10.48550/arxiv.1807.07524 · Cited by 216
Alatise, M., & Hancke, G. (2017) · Sensors · doi:10.3390/s17102164 · Cited by 210
Bhateja, V., Patel, H., Krishn, A., Sahu, A., & Lay-Ekuakille, A. (2015) · IEEE Sensors Journal · doi:10.1109/jsen.2015.2465935 · Cited by 192
Pires, I. M., García, N. M., Pombo, N. G. C. C., & Flórez‐Revuelta, F. (2016) · Sensors · doi:10.3390/s16020184 · Cited by 179
Relative Camera Pose Estimation Using Convolutional Neural Networks
Melekhov, I., Ylioinas, J., Kannala, J., & Rahtu, E. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-70353-4_57 · Cited by 174
Convolutional neural network-based image representation for visual loop closure detection
Hou, Y., Zhang, H., & Zhou, S. (2015) · 2015 IEEE International Conference on Information and Automation · doi:10.1109/icinfa.2015.7279659 · Cited by 171
Lightweight Unsupervised Deep Loop Closure
Merrill, N., & Huang, G. P. (2018) · Robotics: Science and Systems · doi:10.15607/rss.2018.xiv.032 · Cited by 171
Hybrid conditional random field based camera-LIDAR fusion for road detection
Xiao, L., Wang, R., Dai, B., Fang, Y., Liu, D., & Wu, T. (2018) · Information Sciences · doi:10.1016/j.ins.2017.04.048 · Cited by 166
Cvišić, I., Ćesić, J., Marković, I., & Petrovic, I. K. (2017) · Journal of Field Robotics · doi:10.1002/rob.21762 · Cited by 163
An obstacle detection method by fusion of radar and motion stereo
Kato, T., Ninomiya, Y., & Masaki, I. (2002) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2002.802932 · Cited by 150
Fusing LIDAR and images for pedestrian detection using convolutional neural networks
Schlosser, J., Chow, C. K., & Kira, Z. (2016) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2016.7487370 · Cited by 150
A Review of SLAM Techniques and Security in Autonomous Driving
Singandhupe, A., & La, H. M. (2019) · 2019 Third IEEE International Conference on Robotic Computing (IRC) · doi:10.1109/irc.2019.00122 · Cited by 147
Olia, A., Abdelgawad, H., Abdulhai, B., & Razavi, S. (2015) · Journal of Intelligent Transportation Systems · doi:10.1080/15472450.2015.1062728 · Cited by 143
Choosing smartly: Adaptive multimodal fusion for object detection in changing environments
Mees, O., Eitel, A., & Burgard, W. (2016) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759048 · Cited by 143
Perception, information processing and modeling: Critical stages for autonomous driving applications
Gruyer, D., Magnier, V., Hamdi, K., Claussmann, L., Orfila, O., & Rakotonirainy, A. (2017) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2017.09.012 · Cited by 141
Self-citationAn INS/GNSS integrated navigation in GNSS denied environment using recurrent neural network
Dai, H.-F., Bian, H., Wang, R., & Ma, H. (2019) · Defence Technology · doi:10.1016/j.dt.2019.08.011 · Cited by 132
Multisensor Fusion and Integration: A Review on Approaches and Its Applications in Mechatronics
Luo, R. C., & Chang, C.-C. B. (2011) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2011.2173942 · Cited by 119
Mask-SLAM: Robust Feature-Based Monocular SLAM by Masking Using Semantic Segmentation
Kaneko, M., Iwami, K., Ogawa, T., Yamasaki, T., & Aizawa, K. (2018) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00063 · Cited by 118
Rohani, M., Gingras, D., & Gruyer, D. (2015) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2015.2465141 · Cited by 111
Self-citationImproving vehicle localization using semantic and pole-like landmarks
Sefati, M., Daum, M., Sondermann, B., Kreisköther, K., & Kampker, A. (2017) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2017.7995692 · Cited by 108
Semi-Supervised Deep Learning for Monocular Depth Map PredictionPreprint
Kuznietsov, Y., Stückler, J., & Leibe, B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.02706 · Cited by 103
Visual–Inertial Navigation Systems for Aerial Robotics: Sensor Fusion and Technology
Santoso, F., Garratt, M., & Anavatti, S. G. (2016) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2016.2582752 · Cited by 101
GFD-SSD: Gated Fusion Double SSD for Multispectral Pedestrian DetectionPreprint
Zheng, Y., Izzat, I. H., & Ziaee, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.06999 · Cited by 96
Du, X., Ang, M. H., & Rus, D. L. (2017) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8202234 · Cited by 94
Global Pose Estimation with an Attention-Based Recurrent Network
Parisotto, E., Chaplot, D. S., Zhang, J., & Salakhutdinov, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00061 · Cited by 88
Obstacle detection and classification fusing radar and vision
Bertozzi, M., Bombini, L., Cerri, P., et al. (2008) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2008.4621304 · Cited by 85
DeepID-Net: Deformable Deep Convolutional Neural Networks for Object DetectionPreprint
Ouyang, W., Wang, X., Zeng, X., Qiu, S., Luo, P., Tian, Y., Li, H., Yang, S., Wang, Z., Loy, C. C., et al. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.5661 · Cited by 85
Driver behavior recognition based on deep convolutional neural networks
Yan, S., Teng, Y., Smith, J. S., & Zhang, B. (2016) · International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD) · doi:10.1109/fskd.2016.7603248 · Cited by 83
Deep Visible and Thermal Image Fusion for Enhanced Pedestrian Visibility
Shopovska, I., Jovanov, L., & Philips, W. R. (2019) · Sensors · doi:10.3390/s19173727 · Cited by 82
Road terrain detection: Avoiding common obstacle detection assumptions using sensor fusion
Shinzato, P. Y., Wolf, D. F., & Stiller, C. (2014) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2014.6856454 · Cited by 78
Kim, J. H., Batchuluun, G., & Park, K. R. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.07.020 · Cited by 77
Accurate lateral positioning from map data and road marking detection
Gruyer, D., Belaroussi, R., & Revilloud, M. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.08.015 · Cited by 75
Self-citationA Mixed Deep Recurrent Neural Network for MEMS Gyroscope Noise Suppressing
Jiang, C., Chen, Y., Chen, S., Bo, Y., Li, W., Tian, W., & Guo, J. Y. (2019) · Electronics · doi:10.3390/electronics8020181 · Cited by 75
Laidlow, T., Czarnowski, J., & Leutenegger, S. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8793527 · Cited by 74
3-D LiDAR + Monocular Camera: An Inverse-Depth-Induced Fusion Framework for Urban Road Detection
Gu, S., Lu, T., Zhang, Y., Álvarez, J. M., Yang, J. J., & Kong, H. (2018) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2018.2843170 · Cited by 70
Multispectral pedestrian detection based on deep convolutional neural networks
Hou, Y.-L., Song, Y., Hao, X., Shen, Y., Qian, M., & Chen, H. (2018) · Infrared Physics & Technology · doi:10.1016/j.infrared.2018.08.029 · Cited by 70
DeepVO: A Deep Learning approach for Monocular Visual Odometry
Mohanty, V., Agrawal, S., Datta, S., Ghosh, A., Sharma, V. D., & Chakravarty, D. (2016) · arXiv · doi:10.48550/arxiv.1611.06069 · Cited by 67
Real-Time Vehicle Detection Algorithm Based on Vision and Lidar Point Cloud Fusion
Wang, H., Lou, X., Cai, Y., Li, Y., & Chen, L. (2019) · Journal of Sensors · doi:10.1155/2019/8473980 · Cited by 67
Advanced surveillance systems: combining video and thermal imagery for pedestrian detection
Torresan, H., Turgeon, B., Ibarra‐Castanedo, C., Hébert, P., & Maldague, X. (2004) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.548359 · Cited by 64
End-to-end deep learning for autonomous navigation of mobile robot
Kim, Y.-H., Jang, J., & Yun, S. (2018) · International Conference on Consumer Electronics · doi:10.1109/icce.2018.8326229 · Cited by 63
Target Fusion Detection of LiDAR and Camera Based on the Improved YOLO Algorithm
Han, J., Liao, Y., Zhang, J., Wang, S., & Li, S. (2018) · Mathematics · doi:10.3390/math6100213 · Cited by 62
Bangla handwritten character recognition using deep belief network
Sazal, M. M. R., Biswas, S. K., Amin, M. F., & Murase, K. (2014) · International Conference on Electrical Information and Communication Technology (EICT) · doi:10.1109/eict.2014.6777907 · Cited by 61
Low cost IMU–Odometer–GPS ego localization for unusual maneuvers
Ndjeng, A. N., Gruyer, D., Glaser, S., & Lambert, A. (2010) · Information Fusion · doi:10.1016/j.inffus.2010.06.006 · Cited by 54
Self-citationNon-Linear Autoregressive Delay-Dependent INS/GPS Navigation System Using Neural Networks
Jaradat, M. A., & Abdel–Hafez, M. F. (2016) · IEEE Sensors Journal · doi:10.1109/jsen.2016.2642040 · Cited by 54
Self-citationA multi-modal system for road detection and segmentation
Hu, X. G., Rodríguez, S., & Gepperth, A. (2014) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2014.6856466 · Cited by 53
Wang, S., Deng, Z., & Yin, G. (2016) · Sensors · doi:10.3390/s16030280 · Cited by 51
CPFG-SLAM:a Robust Simultaneous Localization and Mapping based on LIDAR in Off-Road Environment
Ji, K., Chen, H., Di, H., Gong, J., Xiong, G., Qi, J., & Yi, T. (2018) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2018.8500599 · Cited by 51
MC2SLAM: Real-Time Inertial Lidar Odometry Using Two-Scan Motion Compensation
Neuhaus, F., Koß, T., Kohnen, R., & Paulus, D. W. R. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-12939-2_5 · Cited by 50
DF-SLAM: A Deep-Learning Enhanced Visual SLAM System based on Deep Local FeaturesPreprint
Kang, R., Shi, J., Li, X., Liu, Y., & Liu, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.07223 · Cited by 49
Multispectral pedestrian detection based on deep convolutional neural networks
Hou, Y.-L., Song, Y., Hao, X., Shen, Y., & Qian, M. (2017) · IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC) · doi:10.1109/icspcc.2017.8242507 · Cited by 47
Multimodal CNN Pedestrian Classification: A Study on Combining LIDAR and Camera Data
Melotti, G., Premebida, C., Gonçalves, N., Nunes, U., & Faria, D. R. (2018) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2018.8569666 · Cited by 43
Kim, H.-U., & Bae, T. (2019) · Journal of Sensors · doi:10.1155/2019/3737265 · Cited by 40
Real-Time Multispectral Pedestrian Detection with a Single-Pass Deep Neural Network
Vandersteegen, M., Beeck, K. V., & Goedemé, T. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-93000-8_47 · Cited by 39
Robust Camera Lidar Sensor Fusion Via Deep Gated Information Fusion Network
Kim, J., Choi, J., Kim, Y., Koh, J., Chung, C. C., & Choi, J. W. (2018) · 2018 IEEE Intelligent Vehicles Symposium (IV) · doi:10.1109/ivs.2018.8500711 · Cited by 36
Detecting unfocused raindrops: In-vehicle multipurpose cameras
Cord, A., & Gimonet, N. (2014) · IEEE Robotics & Automation Magazine · doi:10.1109/mra.2013.2287451 · Cited by 35
Real-time Depth Estimation Using Recurrent CNN with Sparse Depth Cues for SLAM System
Lee, S. J., Choi, H., & Hwang, S. S. (2019) · International Journal of Control Automation and Systems · doi:10.1007/s12555-019-0350-8 · Cited by 35
Exploration of Deep Learning-based Multimodal Fusion for Semantic Road Scene Segmentation
Zhang, Y., Morel, O., Blanchon, M., Seulin, R., Rastgoo, M., & Sidibé, D. (2019) · International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP) · doi:10.5220/0007360400002108 · Cited by 34
Seeing Through Fog Without Seeing Fog: Deep Sensor Fusion in the Absence of Labeled Training Data.Preprint
Bijelic, M., Mannan, F., Gruber, T., Ritter, W., Dietmayer, K., & Heide, F. (2019) · arXiv (Cornell University) · Cited by 32
A cooperative fusion architecture for robust localization: Application to autonomous driving
Bresson, G., Rahal, M.-C., Gruyer, D., Revilloud, M., & Alsayed, Z. (2016) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2016.7795656 · Cited by 31
Self-citationImage Gradient-based Joint Direct Visual Odometry for Stereo Camera
Zhu, J. (2017) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/636 · Cited by 31
Multisensor Data Fusion and Integration for Mobile Robots: A Review
Nagla, K. S., Uddin, M., & Singh, D. (2014) · IAES International Journal of Robotics and Automation (IJRA) · doi:10.11591/ijra.v3i2.4075 · Cited by 30
Remote Sensing Image Fusion Based on Two-Stream Fusion Network
Liu, X., Wang, Y., & Liu, Q. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-73603-7_35 · Cited by 30
Relative Camera Pose Estimation Using Convolutional Neural NetworksPreprint
Melekhov, I., Ylioinas, J., Kannala, J., & Rahtu, E. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.01381 · Cited by 29
Exactly sparse delayed state filter on Lie groups for long-term pose graph SLAM
Lenac, K., Ćesić, J., Marković, I., & Petrovic, I. K. (2018) · The International Journal of Robotics Research · doi:10.1177/0278364918767756 · Cited by 27
Lightweight Unsupervised Deep Loop ClosurePreprint
Merrill, N., & Huang, G. P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.07703 · Cited by 25
Bresson, G., Li, Y., Joly, C., & Moutarde, F. (2019) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2019.8813892 · Cited by 22
A Novel Approach for Detecting Road Based on Two-Stream Fusion Fully Convolutional Network
Lv, X., Liu, Z., Xin, J., & Zheng, N. (2018) · 2018 IEEE Intelligent Vehicles Symposium (IV) · doi:10.1109/ivs.2018.8500551 · Cited by 21
Pedestrian Detection based on Deep Fusion Network using Feature Correlation
Lee, Y., Bui, T. D., & Shin, J. (2018) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.23919/apsipa.2018.8659688 · Cited by 21
Human detection using image fusion of thermal and visible image with new joint bilateral filter
Choi, E., & Park, D.-J. (2010) · International Conference on Computer Sciences and Convergence Information Technology · doi:10.1109/iccit.2010.5711182 · Cited by 20
SliceNet: A proficient model for real-time 3D shape-based recognition
Chen, X., Chen, Y., Gupta, K., Zhou, J., & Najjaran, H. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.07.061 · Cited by 19
Self-citationINS/GPS localization for reliable cooperative driving
Kaviani, S., O’Brien, M., Brummelen, J. V., Najjaran, H., & Michelson, D. G. (2016) · Conference proceedings - Canadian Conference on Electrical and Computer Engineering · doi:10.1109/ccece.2016.7726750 · Cited by 17
Self-citationDeep Sensor Fusion for Real-Time Odometry Estimation
Valente, M., Joly, C., & Fortelle, A. D. L. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8967803 · Cited by 15
Improving Map Re-localization with Deep ‘Movable’ Objects Segmentation on 3D LiDAR Point Clouds
Vaquero, V., Fischer, K., Moreno-Noguer, F., Sanfeliu, A., & Milz, S. (2019) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2019.8917390 · Cited by 14
A Fusion Model for Road Detection based on Deep Learning and Fully Connected CRF
Yang, F., Yang, J., Jin, Z., & Wang, H. (2018) · 2018 13th Annual Conference on System of Systems Engineering (SoSE) · doi:10.1109/sysose.2018.8428696 · Cited by 13
CNN-LIDAR pedestrian classification: combining range and reflectance data
Melotti, G., Asvadi, A., & Premebida, C. (2018) · IEEE International Conference on Vehicular Electronics and Safety (ICVES) · doi:10.1109/icves.2018.8519497 · Cited by 13
3D object classification with point convolution network
Chen, X., Chen, Y., & Najjaran, H. (2017) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8202239 · Cited by 10
Self-citationBoosting CNN-Based Pedestrian Detection via 3D LiDAR Fusion in Autonomous Driving
Dou, J., Fang, J., Li, T., & Xue, J. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-71589-6_1 · Cited by 9
Static and dynamic fusion for outdoor vehicle localization
Vincke, B., Lambert, A., Gruyera, D., Elouardi, A., & Seignez, E. (2010) · International Conference on Control, Automation, Robotics and Vision (ICARCV) · doi:10.1109/icarcv.2010.5707822 · Cited by 8
Accurate Stereo Visual Odometry Based on Keypoint Selection
Dias, N. J. B., & Laureano, G. T. (2019) · Latin American Robotics Symposium, Brazilian Symposium on Robotics and Workshop on Robotics in Education (LARS/SBR/WRE) · doi:10.1109/lars-sbr-wre48964.2019.00021 · Cited by 8
A Reliable and Low Cost Vehicle Localization Approach Using Interval Analysis
Wang, Z., & Lambert, A. (2018) · IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech) · doi:10.1109/dasc/picom/datacom/cyberscitec.2018.00095 · Cited by 6
Exploitation of road signalling for localization refinement of autonomous vehicles
D’Orazio, L., Conci, N., & Stoffella, F. (2018) · AEIT International Conference of Electrical and Electronic Technologies for Automotive (AEIT AUTOMOTIVE) · doi:10.23919/eeta.2018.8493200 · Cited by 3
Vehicle Absolute Ego-Localization from Vision, Using Only Pre-existing Geo-Referenced Panoramas
Moutarde, F., Bresson, G., Li, Y., & Joly, C. (2020) · Lecture notes in networks and systems · doi:10.1007/978-3-030-44610-9_1 · Cited by 3
A Velocity-Based Rao-Blackwellized Particle Filter Approach to Monocular vSLAM
Farrokhsiar, M., & Najjaran, H. (2011) · Journal of Intelligent Learning Systems and Applications · doi:10.4236/jilsa.2011.33013 · Cited by 1
Self-citation
Cited by
Sensor and Sensor Fusion Technology in Autonomous Vehicles: A Review
Yeong, D. J., Velasco-Hernandez, G., Barry, J., & Walsh, J. (2021) · Sensors · doi:10.3390/s21062140 · Cited by 1,032
Gupta, A., Anpalagan, A., Guan, L., & Khwaja, A. S. (2021) · Array · doi:10.1016/j.array.2021.100057 · Cited by 565
Milestones in Autonomous Driving and Intelligent Vehicles: Survey of Surveys
Chen, L., Li, Y., Huang, C., Li, B., Xing, Y., Tian, D., Li, L., Hu, Z., Na, X., Li, Z., et al. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2022.3223131 · Cited by 511
Machine Learning Methods in Drug Discovery
Patel, L., Shukla, T., Huang, X., Ussery, D. W., & Wang, S. (2020) · Molecules · doi:10.3390/molecules25225277 · Cited by 460
A Survey of Autonomous Vehicles: Enabling Communication Technologies and Challenges
Ahangar, M. N., Ahmed, Q. Z., Khan, F. A., & Hafeez, M. (2021) · Sensors · doi:10.3390/s21030706 · Cited by 373
Metadata
- Authors
- Fayyad, J., Jaradat, M. A., Gruyer, D., & Najjaran, H.
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2020-07-29
- Volume
- 20
- Issue
- 15
- Pages
- 4220
- ISSN
- 1424-8220 (ISSN-L)
- OpenAlex
- W3045897451
- Cited by
- 498
- References
- 161
- FWCI
- 20.47
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.