The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
VoxelNeXt: Fully Sparse VoxelNet for 3D Object Detection and Tracking
Open accessAbstract
3D object detectors usually rely on hand-crafted proxies, e.g., anchors or centers, and translate well-studied 2D frameworks to 3D. Thus, sparse voxel features need to be densified and processed by dense prediction heads, which inevitably costs extra computation. In this paper, we instead propose VoxelNext for fully sparse 3D object detection. Our core insight is to predict objects directly based on sparse voxel features, without relying on hand-crafted proxies. Our strong sparse convolutional network VoxelNeXt detects and tracks 3D objects through voxel features entirely. It is an elegant and efficient framework, with no need for sparse-to-dense conversion or NMS post-processing. Our method achieves a better speed-accuracy trade-off than other mainframe detectors on the nuScenes dataset. For the first time, we show that a fully sparse voxel-based representation works decently for LIDAR 3D object detection and tracking. Extensive experiments on nuScenes, Waymo, and Argoverse2 benchmarks validate the effectiveness of our approach. Without bells and whistles, our model outperforms all existing LIDAR methods on the nuScenes tracking test benchmark. Code and models are available at github.com/dvlab-research/VoxelNeXt.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Focal Loss for Dense Object Detection
Lin, T.-Y., Goyal, P., Girshick, R., He, K., & Dollar, P. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2858826 · Cited by 9,556
nuScenes: A Multimodal Dataset for Autonomous Driving
Caesar, H., Bankiti, V., Lang, A. H., Vora, S., Liong, V. E., Xu, Q., Krishnan, A., Pan, Y., Baldan, G., & Beijbom, O. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01164 · Cited by 7,152
VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection
Zhou, Y., & Tuzel, O. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00472 · Cited by 4,813
PointPillars: Fast Encoders for Object Detection From Point Clouds
Lang, A. H., Vora, S., Caesar, H., Zhou, L., Yang, J., & Beijbom, O. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01298 · Cited by 4,673
CenterNet: Keypoint Triplets for Object Detection
Duan, K., Bai, S., Xie, L., Qi, H., Huang, Q., & Tian, Q. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00667 · Cited by 4,079
Scalability in Perception for Autonomous Driving: Waymo Open Dataset
Sun, P., Kretzschmar, H., Dotiwalla, X., Chouard, A., Patnaik, V., Tsui, P., Guo, J., Zhou, Y., Chai, Y., Caine, B., et al. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00252 · Cited by 3,437
SECOND: Sparsely Embedded Convolutional Detection
Yan, Y., Mao, Y., & Li, B. (2018) · Sensors · doi:10.3390/s18103337 · Cited by 3,352
PointRCNN: 3D Object Proposal Generation and Detection From Point Cloud
Shi, S., Wang, X., & Li, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00086 · Cited by 3,093
PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detection
Shi, S., Guo, C., Jiang, L., Wang, Z., Shi, J., Wang, X., & Li, H. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01054 · Cited by 2,341
PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space
Qi, C. R., Yi, L., Su, H., & Guibas, L. J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.02413 · Cited by 2,114
Center-based 3D Object Detection and Tracking
Yin, T., Zhou, X., & Krahenbuhl, P. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01161 · Cited by 2,082
3D Semantic Segmentation with Submanifold Sparse Convolutional Networks
Graham, B., Engelcke, M., & Maaten, L. V. D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00961 · Cited by 1,788
Zhou, X., Koltun, V., & Krähenbühl, P. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58548-8_28 · Cited by 1,428
Bevfusion: Multi-task multi-sensor fusion with unified bird’s-eye view representation
Liu, Z., Tang, H., Amini, A., Yang, X., Mao, H., Rus, D. L., & Han, S. (2023) · 2023 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48891.2023.10160968 · Cited by 1,307
Deep Hough Voting for 3D Object Detection in Point Clouds
Qi, C. R., Litany, O., He, K., & Guibas, L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00937 · Cited by 1,244
3DSSD: Point-Based 3D Single Stage Object Detector
Yang, Z., Sun, Y., Liu, S., & Jia, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01105 · Cited by 1,176
Self-citationVoxel R-CNN: Towards High Performance Voxel-based 3D Object Detection
Deng, J., Shi, S., Li, P., Zhou, W., Zhang, Y., & Li, H. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i2.16207 · Cited by 1,048
TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformers
Bai, X., Hu, Z., Zhu, X., Huang, Q., Chen, Y., Fu, H., & Tai, C.-L. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00116 · Cited by 990
Self-citationShi, S., Wang, Z., Shi, J., Wang, X., & Li, H. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2977026 · Cited by 918
Stratified Transformer for 3D Point Cloud Segmentation
Lai, X., Liu, J., Jiang, L., Wang, L., Zhao, H., Liu, S., Qi, X., & Jia, J. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00831 · Cited by 566
Self-citationShi, S., Jiang, L., Deng, J., Wang, Z., Guo, C., Shi, J., Wang, X., & Li, H. (2023) · International Journal of Computer Vision · doi:10.1007/s11263-022-01710-9 · Cited by 546
3D Multi-Object Tracking: A Baseline and New Evaluation Metrics
Weng, X., Wang, J., Held, D., & Kitani, K. (2020) · 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341164 · Cited by 534
Voxel Transformer for 3D Object Detection
Mao, J., Xue, Y., Niu, M., Bai, H., Feng, J., Liang, X., Xu, H., & Xu, C. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00315 · Cited by 520
Not All Points Are Equal: Learning Highly Efficient Point-based Detectors for 3D LiDAR Point Clouds
Zhang, Y., Hu, Q., Xu, G., Ma, Y., Wan, J., & Guo, Y. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01838 · Cited by 420
Voting for Voting in Online Point Cloud Object Detection
Zeng Wang, D., & Posner, I. (2015) · Robotics: Science and Systems XI · doi:10.15607/rss.2015.xi.035 · Cited by 337
Focal Sparse Convolutional Networks for 3D Object Detection
Chen, Y., Li, Y., Zhang, X., Sun, J., & Jia, J. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00535 · Cited by 325
Self-citationClass-balanced Grouping and Sampling for Point Cloud 3D Object Detection
Zhu, B., Jiang, Z., Zhou, X., Li, Z., & Yu, G. (2019) · arXiv · doi:10.48550/arxiv.1908.09492 · Cited by 297
Embracing Single Stride 3D Object Detector with Sparse Transformer
Fan, L., Pang, Z., Zhang, T., Wang, Y.-X., Zhao, H., Wang, F., Wang, N., & Zhang, Z. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00827 · Cited by 293
RangeDet: In Defense of Range View for LiDAR-based 3D Object Detection
Fan, L., Xiong, X., Wang, F., Wang, N., & Zhang, Z. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00291 · Cited by 257
SimpleTrack: Understanding and Rethinking 3D Multi-object Tracking
Pang, Z., Li, Z., & Wang, N. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-25056-9_43 · Cited by 252
Spherical Transformer for LiDAR-Based 3D Recognition
Lai, X., Chen, Y., Lu, F., Liu, J., & Jia, J. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01683 · Cited by 243
Self-citationLiDAR R-CNN: An Efficient and Universal 3D Object Detector
Li, Z., Wang, F., & Wang, N. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00746 · Cited by 242
Voxel Set Transformer: A Set-to-Set Approach to 3D Object Detection from Point Clouds
He, C., Li, R., Li, S., & Zhang, L. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00823 · Cited by 237
PillarNet: Real-Time and High-Performance Pillar-Based 3D Object Detection
Shi, G., Li, R., & Ma, C. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-20080-9_3 · Cited by 229
Pillar-Based Object Detection for Autonomous Driving
Wang, Y., Fathi, A., Kundu, A., Ross, D. A., Pantofaru, C., Funkhouser, T., & Solomon, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58542-6_2 · Cited by 220
SWFormer: Sparse Window Transformer for 3D Object Detection in Point Clouds
Sun, P., Tan, M., Wang, W., Liu, C., Xia, F., Leng, Z., & Anguelov, D. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20080-9_25 · Cited by 208
M3DETR: Multi-representation, Multi-scale, Mutual-relation 3D Object Detection with Transformers
Guan, T., Wang, J., Lan, S., Chandra, R., Wu, Z., Davis, L. S., & Manocha, D. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00235 · Cited by 206
BEVFusion: A Simple and Robust LiDAR-Camera Fusion Framework
Liang, T., Xie, H., Yu, K., Xia, Z., Lin, Z., Wang, Y., Tang, T., Wang, B., & Tang, Z. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2205.13790 · Cited by 201
Object as Hotspots: An Anchor-Free 3D Object Detection Approach via Firing of Hotspots
Chen, Q., Sun, L., Wang, Z., Jia, K., & Yuille, A. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58589-1_5 · Cited by 188
Pyramid R-CNN: Towards Better Performance and Adaptability for 3D Object Detection
Mao, J., Niu, M., Bai, H., Liang, X., Xu, H., & Xu, C. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00272 · Cited by 187
Probabilistic 3D Multi-Modal, Multi-Object Tracking for Autonomous Driving
Chiu, H.-K., Li, J., Ambrus, R., & Bohg, J. (2021) · 2021 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48506.2021.9561754 · Cited by 175
Guided Point Contrastive Learning for Semi-supervised Point Cloud Semantic Segmentation
Jiang, L., Shi, S., Tian, Z., Lai, X., Liu, S., Fu, C., & Jia, J. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00636 · Cited by 174
Self-citationRSN: Range Sparse Net for Efficient, Accurate LiDAR 3D Object Detection
Sun, P., Wang, W., Chai, Y., Elsayed, G., Bewley, A., Zhang, X., Sminchisescu, C., & Anguelov, D. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00567 · Cited by 167
Self-citationAFDetV2: Rethinking the Necessity of the Second Stage for Object Detection from Point Clouds
Hu, Y., Ding, Z., Ge, R., Shao, W., Huang, L., Li, K., & Liu, Q. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19980 · Cited by 166
Fully Sparse 3D Object Detection
Fan, L., Wang, F., Wang, N., & Zhang, Z. (2022) · neural information processing systems · doi:10.52202/068431-0026 · Cited by 155
3D-MAN: 3D Multi-frame Attention Network for Object Detection
Yang, Z., Zhou, Y., Chen, Z., & Ngiam, J. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00190 · Cited by 142
Graph R-CNN: Towards Accurate 3D Object Detection with Semantic-Decorated Local Graph
Yang, H., Liu, Z., Wu, X., Wang, W., Qian, W., He, X., & Cai, D. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20074-8_38 · Cited by 139
Unifying Voxel-based Representation with Transformer for 3D Object Detection
Li, Y., Chen, Y., Qi, X., Li, Z., Sun, J., & Jia, J. (2022) · arXiv · doi:10.48550/arxiv.2206.00630 · Cited by 125
Self-citationChen, Q., Sun, L., Cheung, E. C. H., & Yuille, A. (2020) · neural information processing systems · Cited by 118
VISTA: Boosting 3D Object Detection via Dual Cross-VIew SpaTial Attention
Deng, S., Liang, Z., Sun, L., & Jia, K. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00826 · Cited by 118
Learnable Online Graph Representations for 3D Multi-Object Tracking
Zaech, J.-N., Liniger, A., Dai, D., Danelljan, M., & Gool, L. V. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3145952 · Cited by 110
Score refinement for confidence-based 3D multi-object tracking
Benbarka, N., Schröder, J., & Zell, A. (2021) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros51168.2021.9636032 · Cited by 97
Super Sparse 3D Object Detection
Fan, L., Yang, Y., Feng, W., Wang, N., & Zhang, Z. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3286409 · Cited by 61
Spatial Pruned Sparse Convolution for Efficient 3D Object Detection
Liu, J., Chen, Y., Qi, X., Tian, Z., Tan, X., & Qi, X. (2022) · neural information processing systems · doi:10.52202/068431-0488 · Cited by 58
Self-citationTWIST: Two-Way Inter-label Self-Training for Semi-supervised 3D Instance Segmentation
Chu, R., Ye, X., Liu, Z., Tan, X., Qi, X., Fu, C., & Jia, J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00117 · Cited by 33
Self-citationICM-3D: Instantiated Category Modeling for 3D Instance Segmentation
Chu, R., Chen, Y., Kong, T., Qi, L., & Li, L. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3108483 · Cited by 31
Self-citationSparse2Dense: Learning to Densify 3D Features for 3D Object Detection
Wang, T., Hu, X., Liu, Z., & Fu, C. (2022) · neural information processing systems · doi:10.52202/068431-2792 · Cited by 31
Cited by
Cross Modal Transformer: Towards Fast and Robust 3D Object Detection
Yan, J., Liu, Y., Sun, J., Jia, F., Li, S., Wang, T., & Zhang, X. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01675 · Cited by 182
“On AV2, our model is trained 6 epochs, following common practice [11, 23].”
MethodSelf-citationIS-Fusion: Instance-Scene Collaborative Fusion for Multimodal 3D Object Detection
Yin, J., Shen, J., Chen, R., Li, W., Yang, R., Frossard, P., & Wang, W. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01412 · Cited by 133
FocalFormer3D : Focusing on Hard Instance for 3D Object Detection
Chen, Y., Yu, Z., Chen, Y., Lan, S., Anandkumar, A., Jia, J., & Alvarez, J. M. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00771 · Cited by 119
“Modern 3D object detectors, either LiDAR-based [1– 3, 12, 13, 22–29], or Camera-based [30–37], or Multi-Modal [4–8 , 38– 45] 3D object detectors Different from dense detectors, point-based 3D detectors [11, 50–52] directly process point clouds via Point-Net [53, 54] and perform grouping or…”
BackgroundSelf-citationMultimodal fusion and vision–language models: A survey for robot vision
Han, X., Chen, S., Fu, Z., Feng, Z., Fan, L., An, D., Wang, C., Guo, L., Meng, W., Zhang, X., et al. (2026) · Information Fusion · doi:10.1016/j.inffus.2025.103652 · Cited by 105
“However, in the real world, the presence of low-quality data seriously affects the performance of multimodal learning, making it difficult for models to work stably in complex environments.”
Self-citationMulti-Sem Fusion: Multimodal Semantic Fusion for 3-D Object Detection
Xu, S., Li, F., Song, Z., Fang, J., Wang, S., & Yang, Z.-X. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3387732 · Cited by 26
Metadata
- Authors
- Chen, Y., Liu, J., Zhang, X., Qi, X., & Jia, J.
- Venue
- 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2023-06
- Pages
- 21674-21683
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W4386076253
- Cited by
- 472
- References
- 59
- FWCI
- 53.67
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.