The DOI matches its Crossref record; 161 of the 161 references it cites were found in a registry or an index.
A Review and Comparative Study on Probabilistic Object Detection in Autonomous Driving
Open accessAbstract
Capturing uncertainty in object detection is indispensable for safe autonomous driving. In recent years, deep learning has become the de-facto approach for object detection, and many probabilistic object detectors have been proposed. However, there is no summary on uncertainty estimation in deep object detection, and existing methods are either built with different network architectures and uncertainty estimation methods, or evaluated on different datasets with a wide range of evaluation metrics. As a result, a comparison among methods remains challenging, as does the selection of a model that best suits a particular application. This paper aims to alleviate this problem by providing a review and comparative study on existing probabilistic object detection methods for autonomous driving applications. First, we provide an overview of practical uncertainty estimation methods in deep learning, and then systematically survey existing methods and evaluation metrics for probabilistic object detection. Next, we present a strict comparative study for probabilistic object detection based on an image detector and three public autonomous driving datasets. Finally, we present a discussion of the remaining challenges and future works. Code has been made available athttps://github.com/asharakeh/pod_compare.git.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · cited 1×
“[76] conduct a large-scale study to benchmark classification uncertainty estimation, including the image classification using MNIST, ImageNet [83] and CIFAR [84] datasets, as well the text and ad-click classification.”
BackgroundYou Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
(2016) · Cited by 31,590
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
SSD: Single Shot MultiBox Detector
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_2 · Cited by 22,128
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58452-8_13 · Cited by 18,285
End-to-End Object Detection with Transformers
Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., & Zagoruyko, S. (2020) · arXiv · doi:10.48550/arxiv.2005.12872 · Cited by 18,253
Are we ready for autonomous driving? The KITTI vision benchmark suite
Geiger, A., Lenz, P., & Urtasun, R. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248074 · Cited by 14,897
The Cityscapes Dataset for Semantic Urban Scene Understanding
Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., & Schiele, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.350 · Cited by 12,433 · cited 1×
“The dataset is based on Cityscapes [127], which is a popular semantic segmentation dataset for urban autonomous driving.”
MethodFocal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2858826 · Cited by 9,556
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
Charles, R. Q., Su, H., Kaichun, M., & Guibas, L. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.16 · Cited by 9,237
nuScenes: A Multimodal Dataset for Autonomous Driving
Caesar, H., Bankiti, V., Lang, A. H., Vora, S., Liong, V. E., Xu, Q., Krishnan, A., Pan, Y., Baldan, G., & Beijbom, O. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01164 · Cited by 7,152
FCOS: Fully Convolutional One-Stage Object Detection
Tian, Z., Shen, C., Chen, H., & He, T. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00972 · Cited by 7,013
Strictly Proper Scoring Rules, Prediction, and Estimation
Gneiting, T., & Raftery, A. E. (2007) · Journal of the American Statistical Association · doi:10.1198/016214506000001437 · Cited by 5,793
VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection
Zhou, Y., & Tuzel, O. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00472 · Cited by 4,813
PointPillars: Fast Encoders for Object Detection From Point Clouds
Lang, A. H., Vora, S., Caesar, H., Zhou, L., Yang, J., & Beijbom, O. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01298 · Cited by 4,673
Bayesian Learning for Neural Networks
Neal, R. M. (1996) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-0745-0 · Cited by 4,276
Online Object Tracking: A Benchmark
Wu, Y., Lim, J., & Yang, M.-H. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.312 · Cited by 4,138
CARLA: An open urban driving simulator
Dosovitskiy, A., Ros, G., Codevilla, F., Lopez, A., & Koltun, V. (2017) · arXiv · doi:10.48550/arxiv.1711.03938 · Cited by 3,718 · cited 1×
“[47] 2019 E CARLA Simulation [48]”
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles
Lakshminarayanan, B., Pritzel, A., & Blundell, C. (2016) · arXiv · doi:10.48550/arxiv.1612.01474 · Cited by 3,666
Multi-view 3D Object Detection Network for Autonomous Driving
Chen, X., Ma, H., Wan, J., Li, B., & Xia, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.691 · Cited by 3,450
Scalability in Perception for Autonomous Driving: Waymo Open Dataset
Sun, P., Kretzschmar, H., Dotiwalla, X., Chouard, A., Patnaik, V., Tsui, P., Guo, J., Zhou, Y., Chai, Y., Caine, B., et al. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00252 · Cited by 3,437
On calibration of modern neural networks
Guo, C., Pleiss, G., Sun, Y., & Weinberger, K. Q. (2017) · arXiv · doi:10.48550/arxiv.1706.04599 · Cited by 3,435
SECOND: Sparsely Embedded Convolutional Detection
Yan, Y., Mao, Y., & Li, B. (2018) · Sensors · doi:10.3390/s18103337 · Cited by 3,352
PointRCNN: 3D Object Proposal Generation and Detection From Point Cloud
Shi, S., Wang, X., & Li, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00086 · Cited by 3,093
What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?
Kendall, A., & Gal, Y. (2017) · arXiv · doi:10.48550/arxiv.1703.04977 · Cited by 3,088
Deep Learning for Generic Object Detection: A Survey
Liu, L., Ouyang, W., Wang, X., Fieguth, P., Chen, J., Liu, X., & Pietikäinen, M. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01247-4 · Cited by 2,965
Deep Learning for Generic Object Detection: A Survey
Liu, L., Ouyang, W., Wang, X., Fieguth, P., Chen, J., Liu, X., & Pietikäinen, M. (2018) · arXiv · doi:10.48550/arxiv.1809.02165 · Cited by 2,965
A practical Bayesian framework for backpropagation networks
MacKay, D. J. C. (1992) · Neural Computation · doi:10.1162/neco.1992.4.3.448 · Cited by 2,917
ImageNet: A large-scale hierarchical image database
Deng, J. H., Dong, W. F., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206848 · Cited by 2,714
BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learning
Yu, F., Chen, H., Wang, X., Xian, W., Chen, Y., Liu, F., Madhavan, V., & Darrell, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00271 · Cited by 2,641 · cited 5×
“[13] evaluate 2D probabilistic object detection with ten common road scene object categories in the BDD dataset [18], as well as 80 object categories in the COCO dataset [98].”
BackgroundMethodInfluentialPoseNet: A Convolutional Network for Real-Time 6-DOF Camera Relocalization
Kendall, A., Grimes, M., & Cipolla, R. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.336 · Cited by 2,489
PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detection
Shi, S., Guo, C., Jiang, L., Wang, Z., Shi, J., Wang, X., & Li, H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01054 · Cited by 2,341
Soft-NMS — Improving Object Detection with One Line of Code
Bodla, N., Singh, B., Chellappa, R., & Davis, L. S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.593 · Cited by 2,274 · cited 1×
“[117] 2020 R Self-recorded data A Direct modeling Soft NMS [128] Average Precision”
MethodA Benchmark and Simulator for UAV Tracking
Mueller, M., Smith, N., & Ghanem, B. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_27 · Cited by 1,944
SUN RGB-D: A RGB-D scene understanding benchmark suite
Song, S., Lichtenberg, S. P., & Xiao, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298655 · Cited by 1,943 · cited 1×
“[37] 2017 E CamVid [38], SUN RGB-D [39], Pascal-VOC [40]”
Bayesian Learning via Stochastic Gradient Langevin Dynamics
Welling, M., & Teh, Y. W. (2012) · Cited by 1,860
A Naturalistic Open Source Movie for Optical Flow Evaluation
Butler, D. J., Wulff, J., Stanley, G. B., & Black, M. J. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33783-3_44 · Cited by 1,842
Probabilistic Forecasts, Calibration and Sharpness
Gneiting, T., Balabdaoui, F., & Raftery, A. E. (2007) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2007.00587.x · Cited by 1,783
Joint 3D Proposal Generation and Object Detection from View Aggregation
Ku, J., Mozifian, M., Lee, J., Harakeh, A., & Waslander, S. L. (2018) · 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2018.8594049 · Cited by 1,697
Self-citationFeng, D., Haase-Schutz, C., Rosenbaum, L., Hertlein, H., Glaser, C., Timm, F., Wiesbeck, W., & Dietmayer, K. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.2972974 · Cited by 1,425
Self-citationSemantic object classes in video: A high-definition ground truth database
Brostow, G. J., Fauqueur, J., & Cipolla, R. (2009) · Pattern Recognition Letters · doi:10.1016/j.patrec.2008.04.005 · Cited by 1,397
Weight Uncertainty in Neural Networks
Blundell, C., Cornebise, J., Kavukcuoglu, K., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1505.05424 · Cited by 1,342
Weight Uncertainty in Neural Network
Blundell, C., Cornebise, J., Kavukcuoglu, K., & Wierstra, D. (2015) · International Conference on Machine Learning · Cited by 1,335
Cosmides, L. (1996) · Cognition · doi:10.1016/0010-0277(95)00664-8 · Cited by 1,293 · cited 1×
“Further, cognitive psychologists have found that humans are good intuitive statisticians, and have a frequentist sense of uncertainties [1].”
BackgroundPIXOR: Real-time 3D Object Detection from Point Clouds
Yang, B., Luo, W., & Urtasun, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00798 · Cited by 1,249
Practical Variational Inference for Neural Networks
Graves, A. (2011) · Cited by 1,078
Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift
Ovadia, Y., Fertig, E., Ren, J., Nado, Z., Sculley, D., Nowozin, S., Dillon, J. V., Lakshminarayanan, B., & Snoek, J. (2019) · arXiv · doi:10.48550/arxiv.1906.02530 · Cited by 989
PointFusion: Deep Sensor Fusion for 3D Bounding Box Estimation
Xu, D., Anguelov, D., & Jain, A. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00033 · Cited by 856
Probabilistic Regression for Visual Tracking
Danelljan, M., Van Gool, L., & Timofte, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00721 · Cited by 798
Kendall, A., Badrinarayanan, V., & Cipolla, R. (2017) · Procedings of the British Machine Vision Conference 2017 · doi:10.5244/c.31.57 · Cited by 784
Evidential Deep Learning to Quantify Classification Uncertainty
Sensoy, M., Kaplan, L., & Kandemir, M. (2018) · arXiv · doi:10.48550/arxiv.1806.01768 · Cited by 694
The Power of Ensembles for Active Learning in Image Classification
Beluch, W. H., Genewein, T., Nurnberger, A., & Kohler, J. M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00976 · Cited by 655
Autoware on Board: Enabling Autonomous Vehicles with Embedded Systems
Kato, S., Tokunaga, S., Maruyama, Y., Maeda, S., Hirabayashi, M., Kitsukawa, Y., Monrroy, A., Ando, T., Fujii, Y., & Azumi, T. (2018) · 2018 ACM/IEEE 9th International Conference on Cyber-Physical Systems (ICCPS) · doi:10.1109/iccps.2018.00035 · Cited by 649
Computer Vision for Autonomous Vehicles: Problems, Datasets and State of the Art
Janai, J., Güney, F., Behl, A., & Geiger, A. (2020) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000079 · Cited by 643
Bounding Box Regression With Uncertainty for Accurate Object Detection
He, Y., Zhu, C., Wang, J., Savvides, M., & Zhang, X. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00300 · Cited by 623
The ApolloScape Open Dataset for Autonomous Driving and its Application
Huang, X., Wang, P., Cheng, X., Zhou, D., Geng, Q., & Yang, R. (2018) · arXiv · doi:10.48550/arxiv.1803.06184 · Cited by 615
The ApolloScape Open Dataset for Autonomous Driving and Its Application
Huang, X., Wang, P., Cheng, X., Zhou, D., Geng, Q., & Yang, R. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2926463 · Cited by 615
Expected Information as Expected Utility
Bernardo, J. M. (1979) · The Annals of Statistics · doi:10.1214/aos/1176344689 · Cited by 568
Vote3Deep: Fast object detection in 3D point clouds using efficient convolutional neural networks
Engelcke, M., Rao, D., Wang, D. Z., Tong, C. H., & Posner, I. (2017) · 2017 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2017.7989161 · Cited by 549
Modelling uncertainty in deep learning for camera relocalization
Kendall, A., & Cipolla, R. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487679 · Cited by 548 · cited 1×
“…in different components of autonomous driving such as semantic segmentation [36]–[38], optical flow [39], [40], depth estimation [35], [41]–[43], visual odometry [44]– [46], image annotation [47]–[50], visual tracking [51], trajectory prediction [52]–[55] and end-to-end perception [56]–[58].”
BackgroundCrowdHuman: A Benchmark for Detecting Human in a Crowd
Shao, S., Zhao, Z., Li, B., Xiao, T., Yu, G., Zhang, X., & Sun, J. (2018) · arXiv · doi:10.48550/arxiv.1805.00123 · Cited by 534 · cited 1×
“[119] 2020 C COCO [122], VOC [40], CrowdHuman [129], VehicleOcclusion [130] A Direct modeling Mixture of Gaussians, NMS Average Precision, PDQ”
MethodNeed for Speed: A Benchmark for Higher Frame Rate Object Tracking
Galoogahi, H. K., Fagg, A., Huang, C., Ramanan, D., & Lucey, S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.128 · Cited by 522
Choi, J., Chun, D., Kim, H., & Lee, H.-J. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00059 · Cited by 505 · cited 6×
“Nevertheless, the majority of recent work on probabilistic object detection [9], [12], [14]–[17], [88], [90], [91], [94] still use mAP as the only metric to provide a quantitative assessment of their proposed methods, emphasizing a secondary effect of accuracy improvement when integrating…”
BackgroundMethodInfluentialDecomposition of Uncertainty in Bayesian Deep Learning for Efficient and Risk-sensitive LearningPreprint
Depeweg, S., Hernández-Lobato, J. M., Doshi‐Velez, F., & Udluft, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.07283 · Cited by 481
D3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometry
Yang, N., von Stumberg, L., Wang, R., & Cremers, D. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00136 · Cited by 438
Stochastic Gradient Hamiltonian Monte Carlo
Chen, T., Fox, E. B., & Guestrin, C. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1402.4102 · Cited by 434
A Simple Baseline for Bayesian Uncertainty in Deep Learning
Maddox, W., Garipov, T., Izmailov, P., Vetrov, D., & Wilson, A. G. (2019) · arXiv · doi:10.48550/arxiv.1902.02476 · Cited by 429 · cited 1×
“Still, it is reported that approximation techniques in BNNs are highly sensitive to hyper-parameters, and hard to scale to large datasets and network architectures [33].”
BackgroundLaserNet: An Efficient Probabilistic 3D Object Detector for Autonomous Driving
Meyer, G. P., Laddha, A., Kee, E., Vallespi-Gonzalez, C., & Wellington, C. K. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01296 · Cited by 374
Stochastic Gradient Descent as Approximate Bayesian Inference
Mandt, S., Hoffman, M. D., & Blei, D. M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.04289 · Cited by 369
Complex-YOLO: An Euler-Region-Proposal for Real-Time 3D Object Detection on Point Clouds
Simon, M., Milz, S., Amende, K., & Gross, H.-M. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-11009-3_11 · Cited by 354
Predictive Uncertainty Estimation via Prior Networks
Malinin, A., & Gales, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.10501 · Cited by 337
Accurate Uncertainties for Deep Learning Using Calibrated Regression
Kuleshov, V., Fenner, N., & Ermon, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.00263 · Cited by 337
QuadricSLAM: Dual Quadrics From Object Detections as Landmarks in Object-Oriented SLAM
Nicholson, L., Milford, M., & Sunderhauf, N. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2866205 · Cited by 325
MonoPair: Monocular 3D Object Detection Using Pairwise Spatial Relationships
Chen, Y., Tai, L., Sun, K., & Li, M. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01211 · Cited by 316
EuroCity Persons: A Novel Benchmark for Person Detection in Traffic Scenes
Braun, M., Krebs, S., Flohr, F., & Gavrila, D. M. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2897684 · Cited by 307
SceneNet RGB-D: Can 5M Synthetic Images Beat Generic ImageNet Pre-training on Indoor Segmentation?
McCormac, J., Handa, A., Leutenegger, S., & Davison, A. J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.292 · Cited by 291
A General Framework for Uncertainty Estimation in Deep Learning
Loquercio, A., Segu, M., & Scaramuzza, D. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.2974682 · Cited by 291
Reliability, sufficiency, and the decomposition of proper scores
Bröcker, J. (2009) · Quarterly Journal of the Royal Meteorological Society · doi:10.1002/qj.456 · Cited by 278
Verified Uncertainty CalibrationPreprint
Kumar, A., Liang, P., & Ma, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.10155 · Cited by 276
A General Framework for Uncertainty Estimation in Deep Learning
Loquercio, A., Segù, M., & Scaramuzza, D. (2020) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-197704 · Cited by 261
Feng, D., Rosenbaum, L., & Dietmayer, K. (2018) · arXiv · doi:10.48550/arxiv.1804.05132 · Cited by 260
Self-citationFeng, D., Rosenbaum, L., & Dietmayer, K. (2018) · 2018 21st International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2018.8569814 · Cited by 259
Self-citationConcrete DropoutPreprint
Gal, Y., Hron, J., & Kendall, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.07832 · Cited by 257
Evaluating Scalable Bayesian Deep Learning Methods for Robust Computer Vision
Gustafsson, F. K., Danelljan, M., & Schon, T. B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00167 · Cited by 257
Dropout Sampling for Robust Object Detection in Open-Set Conditions
Miller, D., Nicholson, L., Dayoub, F., & Sunderhauf, N. (2018) · 2018 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2018.8460700 · Cited by 247
Statistical inference for model parameters in stochastic gradient descent
Chen, X., Lee, J. D., Tong, X. T., & Zhang, Y. (2020) · The Annals of Statistics · doi:10.1214/18-aos1801 · Cited by 235
LiDARsim: Realistic LiDAR Simulation by Leveraging the Real World
Manivasagam, S., Wang, S., Wong, K., Zeng, W., Sazanovich, M., Tan, S., Yang, B., Ma, W.-C., & Urtasun, R. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01118 · Cited by 233
Computer Vision for Autonomous Vehicles: Problems, Datasets and State of the Art
Janai, J., Güney, F., Behl, A., & Geiger, A. (2020) · doi:10.1561/9781680836899 · Cited by 232
Concrete Problems for Autonomous Vehicle Safety: Advantages of Bayesian Deep Learning
McAllister, R., Gal, Y., Kendall, A., van der Wilk, M., Shah, A., Cipolla, R., & Weller, A. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/661 · Cited by 229
Uncertainty Estimates and Multi-hypotheses Networks for Optical Flow
Ilg, E., Çiçek, Ö., Galesso, S., Klein, A., Makansi, O., Hutter, F., & Brox, T. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_40 · Cited by 213
Orthographic feature transform for monocular 3d object detection
Roddick, T., Kendall, A., & Cipolla, R. (2018) · arXiv · doi:10.48550/arxiv.1811.08188 · Cited by 211
Scoring Probabilistic Forecasts: The Importance of Being Proper
Bröcker, J., & Smith, L. A. (2007) · Weather and Forecasting · doi:10.1175/waf966.1 · Cited by 201
Sampling-Free Epistemic Uncertainty Estimation Using Approximated Variance Propagation
Postels, J., Ferroni, F., Coskun, H., Navab, N., & Tombari, F. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00302 · Cited by 197
Probabilistic Prediction of Vehicle Semantic Intention and Motion
Hu, Y., Zhan, W., & Tomizuka, M. (2018) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2018.8500419 · Cited by 188
(2018) · UCL Discovery (University College London) · Cited by 183
Makansi, O., Ilg, E., Çiçek, Ö., & Brox, T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00731 · Cited by 181
Pitfalls of In-Domain Uncertainty Estimation and Ensembling in Deep Learning
Ashukha, A., Lyzhov, A., Molchanov, D., & Vetrov, D. (2020) · arXiv · doi:10.48550/arxiv.2002.06470 · Cited by 178
Place categorization and semantic mapping on a mobile robot
Sünderhauf, N., Dayoub, F., McMahon, S., Talbot, B., Schulz, R., Corke, P., Wyeth, G. F., Upcroft, B., & Milford, M. J. (2016) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2016.7487796 · Cited by 173
Lightweight Probabilistic Deep Networks
Gast, J., & Roth, S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00355 · Cited by 169
Probabilistic Object Detection: Definition and Evaluation
Hall, D., Dayoub, F., Skinner, J., Zhang, H., Miller, D., Corke, P., Carneiro, G., Angelova, A., & Sünderhauf, N. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093599 · Cited by 168
Uncertainty-Aware CNNs for Depth Completion: Uncertainty from Beginning to End
Eldesokey, A., Felsberg, M., Holmquist, K., & Persson, M. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01203 · Cited by 164
Concrete Problems for Autonomous Vehicle Safety: Advantages of Bayesian Deep Learning
McAllister, R., Gal, Y., Kendall, A., van der Wilk, M., Shah, A., Cipolla, R., & Weller, A. (2017) · Cambridge University Engineering Department Publications Database · doi:10.17863/cam.12760 · Cited by 163
Predictive Uncertainty Estimation via Prior Networks
Malinin, A., & Gales, M. (2018) · Apollo (University of Cambridge) · doi:10.17863/cam.35237 · Cited by 163
BayesOD: A Bayesian Approach for Uncertainty Estimation in Deep Object Detectors
Harakeh, A., Smart, M. H. W., & Waslander, S. L. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9196544 · Cited by 161
Self-citationCortinhal, T., Tzelepis, G., & Aksoy, E. E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.03653 · Cited by 155
SurfelGAN: Synthesizing Realistic Sensor Data for Autonomous Driving
Yang, Z., Chai, Y., Anguelov, D., Zhou, Y., Sun, P., Erhan, D., Rafferty, S., & Kretzschmar, H. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01113 · Cited by 151
A Systematic Comparison of Bayesian Deep Learning Robustness in Diabetic Retinopathy TasksPreprint
Filos, A., Farquhar, S., Gomez, A. N., Rudner, T. G. J., Kenton, Z., Smith, L., Alizadeh, M., de Kroon, A., & Gal, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.10481 · Cited by 150
Uncertainty Quantification with Statistical Guarantees in End-to-End Autonomous Driving Control
Michelmore, R., Wicker, M., Laurenti, L., Cardelli, L., Gal, Y., & Kwiatkowska, M. (2020) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra40945.2020.9196844 · Cited by 149
Fishyscapes: A Benchmark for Safe Semantic Segmentation in Autonomous Driving
Blum, H., Sarlin, P.-E., Nieto, J. I., Siegwart, R., & Cadena, C. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00294 · Cited by 142
Evaluating Merging Strategies for Sampling-based Uncertainty Techniques in Object Detection
Miller, D., Dayoub, F., Milford, M. J., & Sünderhauf, N. (2019) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2019.8793821 · Cited by 137
Choi, S., Lee, K., Lim, S., & Oh, S. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8462978 · Cited by 136
MonoLoco: Monocular 3D Pedestrian Localization and Uncertainty Estimation
Bertoni, L., Kreiss, S., & Alahi, A. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00696 · Cited by 132
Willers, O., Sudholt, S., Raafatnia, S., & Abrecht, S. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-55583-2_25 · Cited by 120
Evaluating Predictive Uncertainty Challenge
Quiñonero-Candela, J., Rasmussen, C. E., Sinz, F., Bousquet, O., & Schölkopf, B. (2006) · Lecture Notes in Computer Science · doi:10.1007/11736790_1 · Cited by 116
Uncertainty Estimation in One-Stage Object Detection
Kraus, F., & Dietmayer, K. (2019) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2019.8917494 · Cited by 116
Self-citationKendall, A., Badrinarayanan, V., & Cipolla, R. (2017) · Apollo (University of Cambridge) · doi:10.17863/cam.56535 · Cited by 114
Probabilistic Future Prediction for Video Scene Understanding
Hu, A., Cotter, F., Mohan, N. C., Gurău, C., & Kendall, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58517-4_45 · Cited by 113
Scalable Active Learning for Object Detection
Haussmann, E., Fenzi, M., Chitta, K., Ivanecky, J., Xu, H., Roy, D., Mittel, A., Koumchatzky, N., Farabet, C., & Alvarez, J. M. (2020) · 2020 IEEE Intelligent Vehicles Symposium (IV) · doi:10.1109/iv47402.2020.9304793 · Cited by 110
Gated2Depth: Real-Time Dense Lidar From Gated Images
Gruber, T., Julca-Aguilar, F., Bijelic, M., & Heide, F. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00159 · Cited by 101
Uncertainty Estimation for Deep Neural Object Detectors in Safety-Critical Applications
Le, M. T., Diehl, F., Brunner, T., & Knoll, A. (2018) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2018.8569637 · Cited by 95
Leveraging Heteroscedastic Aleatoric Uncertainties for Robust Real-Time LiDAR 3D Object Detection
Feng, D., Rosenbaum, L., Timm, F., & Dietmayer, K. (2019) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2019.8814046 · Cited by 88
Self-citationDeep Active Learning for Efficient Training of a LiDAR 3D Object Detector
Feng, D., Wei, X., Rosenbaum, L., Maki, A., & Dietmayer, K. (2019) · 2019 IEEE Intelligent Vehicles Symposium (IV) · doi:10.1109/ivs.2019.8814236 · Cited by 85
Self-citationEnergy-Based Models for Deep Probabilistic Regression
Gustafsson, F., Danelljan, M., Bhat, G., & Schön, T. B. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58565-5_20 · Cited by 85
Learning an Uncertainty-Aware Object Detector for Autonomous Driving
Meyer, G. P., & Thakurdesai, N. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341623 · Cited by 81
Probabilistic Oriented Object Detection in Automotive Radar
Xu, D., Wang, P., Zhang, P., & Liu, L. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00059 · Cited by 81
Reliability, Sufficiency, and the Decomposition of Proper Scores
Bröcker, J. (2008) · MPG.PuRe (Max Planck Society) · Cited by 80
DepthCN: Vehicle detection using 3D-LIDAR and ConvNet
Asvadi, A., Garrote, L., Premebida, C., Peixoto, P., & Nunes, U. (2017) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2017.8317880 · Cited by 77
Towards a Framework to Manage Perceptual Uncertainty for Safe Automated Driving
Czarnecki, K., & Salay, R. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-99229-7_37 · Cited by 77
Object Detection and Classification in Occupancy Grid Maps Using Deep Convolutional Networks
Wirges, S., Fischer, T., Stiller, C., & Balado, J. (2018) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2018.8569433 · Cited by 66
Uncertainty Estimation for Data-Driven Visual Odometry
Costante, G., & Mancini, M. (2020) · IEEE Transactions on Robotics · doi:10.1109/tro.2020.3001674 · Cited by 57
Estimating and Evaluating Regression Predictive Uncertainty in Deep Object DetectorsPreprint
Harakeh, A., & Waslander, S. L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.05036 · Cited by 57
Self-citationCan We Trust You? On Calibration of a Probabilistic Object Detector for Autonomous DrivingPreprint
Feng, D., Rosenbaum, L., Glaeser, C., Timm, F., & Dietmayer, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.12358 · Cited by 53
Self-citationLaserFlow: Efficient and Probabilistic Object Detection and Motion Forecasting
Meyer, G. P., Charland, J., Pandey, S., Laddha, A., Gautam, S., Vallespi-Gonzalez, C., & Wellington, C. (2020) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2020.3047793 · Cited by 46
Labels are Not Perfect: Inferring Spatial Uncertainty in Object Detection
Feng, D., Wang, Z., Zhou, Y., Rosenbaum, L., Timm, F., Dietmayer, K., Tomizuka, M., & Zhan, W. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3096943 · Cited by 44
Self-citationLocalization Uncertainty Estimation for Anchor-Free Object Detection
Lee, Y., Hwang, J., Kim, H.-I., Yun, K., Kwon, Y., Bae, Y., & Hwang, S. J. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-25085-9_2 · Cited by 42
Fei, J., Chen, W., Heidenreich, P., Wirges, S., & Stiller, C. (2020) · IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI) · doi:10.1109/mfi49285.2020.9235240 · Cited by 41
Capturing Object Detection Uncertainty in Multi-Layer Grid Maps
Wirges, S., Reith‐Braun, M., Lauer, M., & Stiller, C. (2019) · IEEE Intelligent Vehicles Symposium · doi:10.1109/ivs.2019.8814073 · Cited by 39
Leveraging Uncertainties for Deep Multi-modal Object Detection in Autonomous Driving
Feng, D., Cao, Y., Rosenbaum, L., Timm, F., & Dietmayer, K. (2020) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv47402.2020.9304551 · Cited by 39
Self-citationLarge-Scale Visual Active Learning with Deep Probabilistic EnsemblesPreprint
Chitta, K., Álvarez, J. M., & Lesnikowski, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.03575 · Cited by 38
SalsaNext: Fast Semantic Segmentation of LiDAR Point Clouds for Autonomous Driving.
Cortinhal, T., Tzelepis, G., & Aksoy, E. E. (2020) · Cited by 37
Pan, H., Wang, Z., Zhan, W., & Tomizuka, M. (2020) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc45102.2020.9294177 · Cited by 34
Inferring Spatial Uncertainty in Object Detection
Wang, Z., Feng, D., Zhou, Y., Rosenbaum, L., Timm, F., Dietmayer, K., Tomizuka, M., & Zhan, W. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9340798 · Cited by 34
Self-citationDetecting Semantic Parts on Partially Occluded Objects
Wang, J., Zhang, Z., Xie, C., Zhu, J., Xie, L., & Yuille, A. (2017) · British Machine Vision Conference (BMVC) · doi:10.5244/c.31.73 · Cited by 32
Visual-based Autonomous Driving Deployment from a Stochastic and Uncertainty-aware Perspective
Tai, L., Peng, Y., Chen, Y., Liu, C., Ye, H., & Liu, M. (2019) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros40897.2019.8968307 · Cited by 30
Deep Mixture Density Network for Probabilistic Object Detection
He, Y., & Wang, J. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9340882 · Cited by 28
Benchmarking Sampling-based Probabilistic Object Detectors.
Miller, D., Suenderhauf, N., Zhang, H., Hall, D., & Dayoub, F. (2019) · QUT ePrints (Queensland University of Technology) · Cited by 27
Lessons Learned in the Challenge: Making Predictions and Scoring Them
Kohonen, J., & Suomela, J. (2006) · Lecture notes in computer science · doi:10.1007/11736790_7 · Cited by 18
Uncertainty depth estimation with gated images for 3D reconstruction
Walz, S., Gruber, T., Ritter, W., & Dietmayer, K. (2020) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc45102.2020.9294571 · Cited by 17
Self-citationRobust Aleatoric Modeling for Future Vehicle Localization
Hudnell, M., Price, T., & Frahm, J. (2019) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00355 · Cited by 8
Brake Maneuver Prediction – An Inference Leveraging RNN Focus on Sensor Confidence
Liu, S., Koch, K., Gahr, B., & Wortmann, F. (2019) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2019.8917405 · Cited by 8
Labels Are Not Perfect: Improving Probabilistic Object Detection via Label UncertaintyPreprint
Feng, D., Rosenbaum, L., Timm, F., & Dietmayer, K. (2020) · arXiv (Cornell University) · doi:10.13140/rg.2.2.35361.22888 · Cited by 7
Self-citationTowards Data-driven Multi-target Tracking for Autonomous Driving
Fruhwirth-Reisinger, C., Krispel, G., Possegger, H., & Bischof, H. (2020) · Cited by 6
Verification of forecasts expressed in terms of probability
BRIER, G. W. (1950) · Monthly Weather Review · doi:10.1175/1520-0493(1950)078%3c0001:vofeit%3e2.0.co;2
VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITY
BRIER, G. W. (1950) · Monthly Weather Review · doi:10.1175/1520-0493(1950)078<0001:vofeit>2.0.co;2
Cited by
Milestones in Autonomous Driving and Intelligent Vehicles: Survey of Surveys
Chen, L., Li, Y., Huang, C., Li, B., Xing, Y., Tian, D., Li, L., Hu, Z., Na, X., Li, Z., et al. (2023) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2022.3223131 · Cited by 511
Domain Adaptive Object Detection for Autonomous Driving under Foggy Weather
Li, J., Xu, R., Ma, J., Zou, Q., Ma, J., & Yu, H. (2023) · 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv56688.2023.00068 · Cited by 160
“Recent advancement in deep learning has brought outstanding progress in autonomous driving [6, 25, 33, 50], and object detection has been one of the most active topic under this field [8, 41, 56].”
BackgroundI Find Your Lack of Uncertainty in Computer Vision Disturbing
Valdenegro-Toro, M. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00139 · Cited by 15
Introspective Perception for Long-Term Aerial Telemanipulation With Virtual Reality
Lee, J., Balachandran, R., Kondak, K., Coelho, A., Stefano, M. D., Humt, M., Feng, J., Asfour, T., & Triebel, R. (2024) · IEEE Transactions on Field Robotics · doi:10.55417/fr.2023010 · Cited by 8
“The combination operation are to deal with having to combine the two di ff erent tasks per instance of an object detector, and the aggregation operation are to handle the multiple instances in an single image (Feng et al., 2022b).”
Influential
Metadata
- Authors
- Feng, D., Harakeh, A., Waslander, S. L., & Dietmayer, K.
- Venue
- IEEE Transactions on Intelligent Transportation Systems
- Published
- 2022-08
- Volume
- 23
- Issue
- 8
- Pages
- 9961-9980
- ISSN
- 1524-9050 (ISSN-L)
- 1558-0016
- OpenAlex
- W3109915642
- Cited by
- 316
- References
- 161
- FWCI
- 17.81
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.