CoChat
Sign Up
PreprintCited by 297Advanced Neural Network Applications3D Shape Modeling and AnalysisAutonomous Vehicle Technology and Safety

Class-balanced Grouping and Sampling for Point Cloud 3D Object Detection

Open access
Zhu, Benjin, Jiang, Zhengkai, Zhou, Xiangxin, Li, Zeming, Yu, Gang·2019·arXiv
DOI 10.48550/arxiv.1908.09492arXiv 1908.09492
Open this paper in CoChat — free accountOpen PDF

Abstract

This report presents our method which wins the nuScenes3D Detection Challenge [17] held in Workshop on Autonomous Driving(WAD, CVPR 2019). Generally, we utilize sparse 3D convolution to extract rich semantic features, which are then fed into a class-balanced multi-head network to perform 3D object detection. To handle the severe class imbalance problem inherent in the autonomous driving scenarios, we design a class-balanced sampling and augmentation strategy to generate a more balanced data distribution. Furthermore, we propose a balanced group-ing head to boost the performance for the categories withsimilar shapes. Based on the Challenge results, our methodoutperforms the PointPillars [14] baseline by a large mar-gin across all metrics, achieving state-of-the-art detection performance on the nuScenes dataset. Code will be released at CBGS.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1908.09492

Cites

6 of 6 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Among all submissions to the nuScenes detection challenge 2019, Megvii gave the best performance.

    “Among all submissions, Megvii [90] gave the best performance.”

    From nuScenes: A Multimodal Dataset for Autonomous Driving (2020) · cites this paper as [90]

    The Abstract (p. 1) says the method won the 2019 nuScenes 3D Detection Challenge, and Table 2 (p. 5) identifies MEGVII as the top-performing team shown. But the Introduction (p. 2) says the team entered the Lidar Track, and Table 2 compares only lidar submissions; the copy does not establish that Megvii outperformed submissions across all three tracks. (LLM, conf=0.85)

    Experimental — accuracy not yet measured

  • The detection challenge enabled lidar based and camera based detection works that improved over the state-of-the-art at the time of initial release by 40% and 81%.

    “The detection challenge enabled lidar based and camera based detection works such as [90, 70], that improved over the state-of-the-art at the time of initial release [51, 69] by 40% and 81% (Table 4).”

    From nuScenes: A Multimodal Dataset for Autonomous Driving (2020) · cites this paper as [90]

  • Since the release, nuScenes has received strong interest from the AV community.

    “Since the release, nuScenes has received strong interest from the AV community [90, 70, 50, 91, 9, 5, 68, 28, 49, 86, 89].”

    From nuScenes: A Multimodal Dataset for Autonomous Driving (2020) · cites this paper as [90]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 25

  1. [3][3] Xiaozhi Chen, Huimin Ma, Ji Wan, Bo Li, and Tian Xia. Multi-view 3d object detection network for autonomous driving. CoRR , abs/1611.07759, 2016. - · arXiv
  2. [4][4] Zhao Chen, Vijay Badrinarayanan, Chen-Yu Lee, and Andrew Rabinovich. Gradnorm: Gradient normalization for - adaptive loss balancing in deep multitask networks. CoRR , abs/1711.02257, 2017. - · arXiv
  3. [5][5] Christopher Bongsoo Choy, JunYoung Gwak, and Silvio Savarese. 4d spatio-temporal convnets: Minkowski convolutional neural networks. CoRR , abs/1904.08755, 2019. - · arXiv
  4. [6][6] Martin A. Fischler and Robert C. Bolles. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Readings in Computer Vision , pages 726-740, 1987. -
  5. [8][8] Andreas Geiger, Philip Lenz, and Raquel Urtasun. Are we ready for autonomous driving? the kitti vision benchmark suite. In Conference on Computer Vision and Pattern Recognition (CVPR) , 2012. -
  6. [9][9] Benjamin Graham, Martin Engelcke, and Laurens van der Maaten. 3d semantic segmentation with submanifold sparse convolutional networks. CoRR , abs/1711.10275, 2017. - · arXiv
  7. [10][10] Benjamin Graham and Laurens van der Maaten. Submanifold sparse convolutional networks. CoRR , abs/1706.01307, 2017. - · arXiv
  8. [12][12] Sergey Ioffe and Christian Szegedy. Batch normalization: Accelerating deep network training by reducing internal covariate shift. CoRR , abs/1502.03167, 2015. - · arXiv
  9. [13][13] J. Ku, M. Mozifian, J. Lee, A. Harakeh, and S. L. Waslander. Joint 3d proposal generation and object detection from view aggregation. In 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) , pages 1-8, Oct 2018. -
  10. [15][15] Ming Liang, Bin Yang, Shenlong Wang, and Raquel Urtasun. Deep continuous fusion for multi-sensor 3d object detection. In The European Conference on Computer Vision (ECCV) , September 2018. -
  11. [16][16] Ilya Loshchilov and Frank Hutter. Fixing weight decay regularization in adam. CoRR , abs/1711.05101, 2017. - · arXiv
  12. [17][17] nuTonomy. nuScenes 3D Object Detection Challenge, WAD, CVPR 2019. https://www.nuscenes. org/object-detection?externalData=all& mapData=all&modalities=Any . -
  13. [20][20] Charles Ruizhongtai Qi, Hao Su, Kaichun Mo, and Leonidas J. Guibas. Pointnet: Deep learning on point sets for 3d classification and segmentation. CoRR , abs/1612.00593, 2016. - · arXiv
  14. [21][21] Charles Ruizhongtai Qi, Li Yi, Hao Su, and Leonidas J. Guibas. Pointnet++: Deep hierarchical feature learning on point sets in a metric space. CoRR , abs/1706.02413, 2017. - · arXiv
  15. [22][22] Siyuan Qiao, Huiyu Wang, Chenxi Liu, Wei Shen, and Alan L. Yuille. Weight standardization. CoRR , abs/1903.10520, 2019. - · arXiv
  16. [23][23] Ozan Sener and Vladlen Koltun. Multi-task learning as multi-objective optimization. CoRR , abs/1810.04650, 2018. - · arXiv
  17. [24][24] Shaoshuai Shi, Xiaogang Wang, and Hongsheng Li. Pointrcnn: 3d object proposal generation and detection from point cloud. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , June 2019. -
  18. [25][25] Shaoshuai Shi, Zhe Wang, Xiaogang Wang, and Hongsheng Li. Part-a 2 net: 3d part-aware and aggregation neural network for object detection from point cloud. arXiv preprint arXiv:1907.03670 , 2019. - · arXiv
  19. [26][26] S. Song and J. Xiao. Deep sliding shapes for amodal 3d object detection in rgb-d images. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , pages 808-816, June 2016. -
  20. [27][27] Danfei Xu, Dragomir Anguelov, and Ashesh Jain. Pointfusion: Deep sensor fusion for 3d bounding box estimation. CoRR , abs/1711.10871, 2017. - · arXiv
  21. [28][28] Yan Yan, Yuxing Mao, and Bo Li. Second: Sparsely embedded convolutional detection. Sensors , 18(10):3337, Oct 2018. -
  22. [29][29] Bin Yang, Wenjie Luo, and Raquel Urtasun. Pixor: Realtime 3d object detection from point clouds. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , June 2018. -
  23. [30][30] Zetong Yang, Yanan Sun, Shu Liu, Xiaoyong Shen, and Jiaya Jia. STD: sparse-to-dense 3d object detector for point cloud. ICCV , 2019. -
  24. [31][31] Qian-Yi Zhou, Jaesik Park, and Vladlen Koltun. Open3d: A modern library for 3d data processing. CoRR , abs/1801.09847, 2018. - · arXiv
  25. [32][32] Yin Zhou and Oncel Tuzel. Voxelnet: End-to-end learning for point cloud based 3d object detection. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , June 2018.

Cited by

Sorted by citations

Authors
Zhu, B., Jiang, Z., Zhou, X., Li, Z., & Yu, G.
Affiliations
  • Megvii (China) (CN)
  • Chinese Academy of Sciences (CN)
  • Tsinghua University (CN)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2019
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.1908.09492
arXiv
1908.09492
OpenAlex
W2969987486
Cited by
297
References
6
Citations by year
2026: 2 · 2025: 13 · 2024: 62 · 2023: 94 · 2022: 38 · 2021: 47 · 2020: 41
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Engineering › Computational Mechanics › 3D Shape Modeling and Analysis
  • Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
Keywords
3D object detection, point clouds, class imbalance, class-balanced sampling, data augmentation, autonomous driving, PointPillars

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review