CoChat
Sign Up
PreprintCited by 260Autonomous Vehicle Technology and SafetyAdvanced Neural Network ApplicationsAdversarial Robustness in Machine Learning

The DOI matches its DataCite record.

Towards Safe Autonomous Driving: Capture Uncertainty in the Deep Neural Network For Lidar 3D Vehicle Detection

Open access
Feng, Di, Rosenbaum, Lars, Dietmayer, Klaus·2018·arXiv
DOI 10.48550/arxiv.1804.05132arXiv 1804.05132
Open this paper in CoChat — free accountOpen PDF

Abstract

To assure that an autonomous car is driving safely on public roads, its object detection module should not only work correctly, but show its prediction confidence as well. Previous object detectors driven by deep learning do not explicitly model uncertainties in the neural network. We tackle with this problem by presenting practical methods to capture uncertainties in a 3D vehicle detector for Lidar point clouds. The proposed probabilistic detector represents reliable epistemic uncertainty and aleatoric uncertainty in classification and localization tasks. Experimental results show that the epistemic uncertainty is related to the detection accuracy, whereas the aleatoric uncertainty is influenced by vehicle distance and occlusion. The results also show that we can improve the detection performance by 1%-5% by modeling the aleatoric uncertainty.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1804.05132

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • State-of-the-art algorithms are currently being evaluated on the KITTI dataset and nuScenes dataset as they offer labeled 3D scenes.

    “State-of-the-art algorithms are currently being evaluated on the KITTI dataset [177] and nuScenes dataset [178] as they offer labeled 3D scenes.”

    From A Survey of Autonomous Driving: Common Practices and Emerging Technologies (2020) · cites this paper as [177]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

No references could be resolved yet.

Research works printed but not linked: 32

  1. X. Chen, K. Kundu, Z. Zhang, H. Ma, S. Fidler, and R. Urtasun, "Monocular 3d object detection for autonomous driving," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, pp. 2147-2156.
  2. X. Chen, K. Kundu, Y. Zhu, A. G. Berneshawi, H. Ma, S. Fidler, and R. Urtasun, "3d object proposals for accurate object class detection," in Advances in Neural Information Processing Systems, 2015, pp. 424-432.
  3. A. Mousavian, D. Anguelov, J. Flynn, and J. Košecká, "3d bounding box estimation using deep learning and geometry," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 2017, pp. 5632-5640.
  4. B. Li, "3d fully convolutional network for vehicle detection in point cloud," in Intelligent Robots and Systems (IROS), 2017 IEEE/RSJ International Conference on. IEEE, 2017, pp. 1513-1518.
  5. Y. Zhou and O. Tuzel, "Voxelnet: End-to-end learning for point cloud based 3d object detection," arXiv preprint arXiv:1711.06396, 2017. · arXiv
  6. M. Engelcke, D. Rao, D. Z. Wang, C. H. Tong, and I. Posner, "Vote3deep: Fast object detection in 3d point clouds using efficient convolutional neural networks," in IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2017, pp. 1355-1361.
  7. L. Caltagirone, S. Scheidegger, L. Svensson, and M. Wahde, "Fast lidar- based road detection using fully convolutional neural networks," in IEEE Intelligent Vehicles Symposium (IV). IEEE, 2017, pp. 1019-1024.
  8. A. Asvadi, L. Garrote, C. Premebida, P. Peixoto, and U. J. Nunes, "Depthcn: vehicle detection using 3d-lidar and convnet," in IEEE International Conference on Intelligent Transportation Systems, 2017.
  9. B. Yang, W. Luo, and R. Urtasun, "Pixor: Real-time 3d object detection from point clouds," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 7652-7660.
  10. X. Chen, H. Ma, J. Wan, B. Li, and T. Xia, "Multi-view 3d object detection network for autonomous driving," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017.
  11. C. R. Qi, W. Liu, C. Wu, H. Su, and L. J. Guibas, "Frustum pointnets for 3d object detection from rgb-d data," arXiv preprint arXiv:1711.08488, 2017. · arXiv
  12. D. Xu, D. Anguelov, and A. Jain, "Pointfusion: Deep sensor fusion for 3d bounding box estimation," arXiv preprint arXiv:1711.10871, 2017. · arXiv
  13. J. Ku, M. Mozifian, J. Lee, A. Harakeh, and S. Waslander, "Joint 3d proposal generation and object detection from view aggregation," arXiv preprint arXiv:1712.02294, 2017. · arXiv
  14. Z. Wang, W. Zhan, and M. Tomizuka, "Fusing bird view lidar point cloud and front view camera image for deep object detection," arXiv preprint arXiv:1711.06703, 2017. · arXiv
  15. X. Du, M. H. Ang Jr, S. Karaman, and D. Rus, "A general pipeline for 3d detection of vehicles," arXiv preprint arXiv:1803.00387, 2018. · arXiv
  16. A. Pfeuffer and K. Dietmayer, "Optimal sensor data fusion architecture for object detection in adverse weather conditions," in Proceedings of International Conference on Information Fusion, 2018, pp. 2592 -2599.
  17. A. Geiger, P. Lenz, C. Stiller, and R. Urtasun, "Vision meets robotics: The kitti dataset," The International Journal of Robotics Research, vol. 32, no. 11, pp. 1231-1237, 2013.
  18. M. Cordts, M. Omran, S. Ramos, T. Rehfeld, M. Enzweiler, R. Be- nenson, U. Franke, S. Roth, and B. Schiele, "The cityscapes dataset for semantic urban scene understanding," in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 3213- 3223.
  19. D. J. MacKay, "A practical bayesian framework for backpropagation networks," Neural computation, vol. 4, no. 3, pp. 448-472, 1992.
  20. G. E. Hinton and D. Van Camp, "Keeping the neural networks simple by minimizing the description length of the weights," in Proceedings of the sixth annual conference on Computational learning theory. ACM, 1993, pp. 5-13.
  21. A. Graves, "Practical variational inference for neural networks," in Advances in neural information processing systems, 2011, pp. 2348- 2356.
  22. I. Osband, C. Blundell, A. Pritzel, and B. Van Roy, "Deep exploration via bootstrapped dqn," in Advances in neural information processing systems, 2016, pp. 4026-4034.
  23. Y. Gal, "Uncertainty in deep learning," Ph.D. dissertation, University of Cambridge, 2016.
  24. Y. Gal, R. Islam, and Z. Ghahramani, "Deep bayesian active learning with image data," in International Conference on Machine Learning, 2017, pp. 1183-1192.
  25. A. Kendall and Y. Gal, "What uncertainties do we need in bayesian deep learning for computer vision?" in Advances in Neural Information Processing Systems, 2017, pp. 5580-5590.
  26. A. Kendall, V. Badrinarayanan, and R. Cipolla, "Bayesian segnet: Model uncertainty in deep convolutional encoder-decoder architectures for scene understanding," arXiv preprint arXiv:1511.02680, 2015. · arXiv
  27. D. Miller, L. Nicholson, F. Dayoub, and N. Sünderhauf, "Dropout sampling for robust object detection in open-set conditions," arXiv preprint arXiv:1710.06677, 2017. · arXiv
  28. K. He, X. Zhang, S. Ren, and J. Sun, "Identity mappings in deep residual networks," in European Conference on Computer Vision. Springer, 2016, pp. 630-645.
  29. S. Ren, K. He, R. Girshick, and J. Sun, "Faster r-cnn: Towards real-time object detection with region proposal networks," in Advances in neural information processing systems, 2015, pp. 91-99.
  30. Y. Gal, J. Hron, and A. Kendall, "Concrete dropout," in Advances in Neural Information Processing Systems, 2017, pp. 3584-3593.
  31. W. Liu, D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C.-Y. Fu, and A. C. Berg, "Ssd: Single shot multibox detector," in European conference on computer vision. Springer, 2016, pp. 21-37.
  32. H. Hu, J. Gu, Z. Zhang, J. Dai, and Y. Wei, "Relation networks for object detection," in The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2018.

Cited by

Sorted by citations

Metadata

Authors
Feng, D., Rosenbaum, L., & Dietmayer, K.
Affiliations
  • Robert Bosch (Germany) (DE)
  • Universität Ulm (DE)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2018
Pages
3266-3273
DOI
10.48550/arxiv.1804.05132
arXiv
1804.05132
OpenAlex
W2963167203
Cited by
260
References
0
Citations by year
2026: 9 · 2025: 31 · 2024: 22 · 2023: 39 · 2022: 33 · 2021: 45 · 2020: 55 · 2019: 25 · 2018: 1
FWCI
32.30
Type
conference paper
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • IEEE International Conference on Intelligent Transportation Systems (ITSC) (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
Keywords
autonomous driving, LiDAR point cloud, uncertainty estimation, epistemic uncertainty, aleatoric uncertainty, occlusion, vehicle localization

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review