Cited by 4,813Advanced Neural Network Applications3D Shape Modeling and AnalysisAutonomous Vehicle Technology and Safety

VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection

Open access
Zhou, Yin, Tuzel, Oncel·2018·2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition

Abstract

Accurate detection of objects in 3D point clouds is a central problem in many applications, such as autonomous navigation, housekeeping robots, and augmented/virtual reality. To interface a highly sparse LiDAR point cloud with a region proposal network (RPN), most existing efforts have focused on hand-crafted feature representations, for example, a bird's eye view projection. In this work, we remove the need of manual feature engineering for 3D point clouds and propose VoxelNet, a generic 3D detection network that unifies feature extraction and bounding box prediction into a single stage, end-to-end trainable deep network. Specifically, VoxelNet divides a point cloud into equally spaced 3D voxels and transforms a group of points within each voxel into a unified feature representation through the newly introduced voxel feature encoding (VFE) layer. In this way, the point cloud is encoded as a descriptive volumetric representation, which is then connected to a RPN to generate detections. Experiments on the KITTI car detection benchmark show that VoxelNet outperforms the state-of-the-art LiDAR based 3D detection methods by a large margin. Furthermore, our network learns an effective discriminative representation of objects with various geometries, leading to encouraging results in 3D detection of pedestrians and cyclists, based on only LiDAR.

Integrity signals

Registry

Crossref · 10.1109/cvpr.2018.00472

Cites

49 of 49 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • VoxelNet suffers from substantial computational demands due to its dense voxel representation, hindering its feasibility for real-time implementation.

    “However, due to its dense voxel representation, VoxelNet suffers from substantial computational demands, in this way to hinder its feasibility for real-time implementation.”
  • The effectiveness of deep learning components to adapt based on past experiences can be used to learn the parameters of the car's control system, better approximating the underlying true system model.

    “The effectiveness of deep learning components to adapt based on past experiences can also be used to learn the parameters of the car's control system, thus better approximating the underlaying true system model [174, 94].”

    From A survey of deep learning techniques for autonomous driving (2020) · cites this paper as [174]

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Zhou, Y., & Tuzel, O.
Affiliations
Apple (United States) (US)
Venue
2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
Publisher
IEEE
Published
2018-06
Pages
4490-4499
ISSN
1063-6919 (ISSN-L)
OpenAlex
W2963727135
Cited by
4,813
References
49
Citations by year
2026: 381 · 2025: 778 · 2024: 854 · 2023: 809 · 2022: 615 · 2021: 590 · 2020: 448 · 2019: 283 · 2018: 53 · 2017: 2
FWCI
103.55
Type
conference paper
Language
en
Open access
Locations
  • IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Engineering › Computational Mechanics › 3D Shape Modeling and Analysis
  • Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
Keywords
3D object detection, point clouds, LiDAR, region proposal network, end-to-end learning, volumetric representation, pedestrian and cyclist detection, autonomous driving

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review