The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
FlowNet3D: Learning Scene Flow in 3D Point Clouds
Open accessAbstract
Many applications in robotics and human-computer interaction can benefit from understanding 3D motion of points in a dynamic environment, widely noted as scene flow. While most previous methods focus on stereo and RGB-D images as input, few try to estimate scene flow directly from point clouds. In this work, we propose a novel deep neural network named FlowNet3D that learns scene flow from point clouds in an end-to-end fashion. Our network simultaneously learns deep hierarchical features of point clouds and flow embeddings that represent point motions, supported by two newly proposed learning layers for point sets. We evaluate the network on both challenging synthetic data from FlyingThings3D and real Lidar scans from KITTI. Trained on synthetic data only, our network successfully generalizes to real scans, outperforming various baselines and showing competitive results to the prior art. We also demonstrate two applications of our scene flow output (scan registration and motion segmentation) to show its potential wide use cases.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A method for registration of 3-D shapes
Besl, P. J., & McKay, N. D. (1992) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.121791 · Cited by 18,103
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation
Charles, R. Q., Su, H., Kaichun, M., & Guibas, L. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.16 · Cited by 9,237
Self-citationDynamic Graph CNN for Learning on Point Clouds
Wang, Y., Sun, Y., Liu, Z., Sarma, S. E., Bronstein, M. M., & Solomon, J. M. (2019) · ACM Transactions on Graphics · doi:10.1145/3326362 · Cited by 7,199
Flownet: Learning optical flow with convolutional networks
Dosovitskiy, A., Fischer, P., Ilg, E., Hausser, P., Hazirbas, C., Golkov, V., Smagt, P. V. D., Cremers, D., & Brox, T. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.316 · Cited by 4,313
FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networks
Ilg, E., Mayer, N., Saikia, T., Keuper, M., Dosovitskiy, A., & Brox, T. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.179 · Cited by 3,152
Mayer, N., Ilg, E., Hausser, P., Fischer, P., Cremers, D., Dosovitskiy, A., & Brox, T. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.438 · Cited by 2,488
ShapeNet: An Information-Rich 3D Model Repository
Chang, A. X., Funkhouser, T., Guibas, L., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., Su, H., et al. (2015) · arXiv · doi:10.48550/arxiv.1512.03012 · Cited by 2,330
Self-citationObject scene flow for autonomous vehicles
Menze, M., & Geiger, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298925 · Cited by 2,270
ShapeNet: An Information-Rich 3D Model Repository
Chang, A. X., Funkhouser, T. A., Guibas, L. J., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., Su, H., et al. (2023) · doi:10.5281/zenodo.10089705 · Cited by 1,623
Self-citationUnique Signatures of Histograms for Local Surface Description
Tombari, F., Salti, S., & Di Stefano, L. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15558-1_26 · Cited by 1,480
Large Displacement Optical Flow: Descriptor Matching in Variational Motion Estimation
Brox, T., & Malik, J. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.143 · Cited by 1,295
Vedula, S., Baker, S., Rander, P., Collins, R., & Kanade, T. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790293 · Cited by 426
Deep Parametric Continuous Convolutional Neural Networks
Wang, S., Suo, S., Ma, W.-C., Pokrovsky, A., & Urtasun, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00274 · Cited by 359
JOINT 3D ESTIMATION OF VEHICLES AND SCENE FLOW
Menze, M., Heipke, C., & Geiger, A. (2015) · ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences · doi:10.5194/isprsannals-ii-3-w5-427-2015 · Cited by 341
A Variational Method for Scene Flow Estimation from Stereo Sequences
Huguet, F., & Devernay, F. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4409000 · Cited by 283
Multi-View Stereo Reconstruction and Scene Flow Estimation with a Global Image-Based Matching Score
Pons, J.-P., Keriven, R., & Faugeras, O. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-006-8671-5 · Cited by 279
3D Scene Flow Estimation with a Piecewise Rigid Scene Model
Vogel, C., Schindler, K., & Roth, S. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0806-0 · Cited by 209
Vogel, C., Schindler, K., & Roth, S. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.174 · Cited by 195
Efficient Dense Scene Flow from Sparse or Dense Stereo Data
Wedel, A., Rabe, C., Vaudrey, T., Brox, T., Franke, U., & Cremers, D. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88682-2_56 · Cited by 174
RGB-D flow: Dense 3-D motion estimation using color and depth
Herbst, E. V., Ren, X., & Fox, D. (2013) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2013.6630885 · Cited by 174
Stereoscopic Scene Flow Computation for 3D Motion Understanding
Wedel, A., Brox, T., Vaudrey, T., Rabe, C., Franke, U., & Cremers, D. (2011) · International Journal of Computer Vision · doi:10.1007/s11263-010-0404-0 · Cited by 164
Dense Semi-rigid Scene Flow Estimation from RGBD Images
Quiroga, J., Brox, T., Frédéric Devernay, A., & Crowley, J. L. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10584-0_37 · Cited by 121
Multi-view Scene Flow Estimation: A View Centered Variational Approach
Basha, T., Moses, Y., & Kiryati, N. (2012) · International Journal of Computer Vision · doi:10.1007/s11263-012-0542-7 · Cited by 110
Rigid scene flow for 3D LiDAR scans
Dewan, A., Caselitz, T., Tipaldi, G. D., & Burgard, W. (2016) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759282 · Cited by 104
Scene flow estimation by growing correspondence seeds
Čech, J., Sànchez-Riera, J., & Horaud, R. (2011) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2011.5995442 · Cited by 101
3D scene flow estimation with a rigid motion prior
Vogel, C., Schindler, K., & Roth, S. (2011) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2011.6126381 · Cited by 100
Joint Estimation of Motion, Structure and Geometry from Stereo Sequences
Valgaerts, L., Bruhn, A., Zimmer, H., Weickert, J., Stoll, C., & Theobalt, C. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15561-1_41 · Cited by 88
Kinecting the dots: Particle based scene flow from depth sensors
Hadfield, S., & Bowden, R. (2011) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2011.6126509 · Cited by 85
A learning approach for real-time temporal scene flow estimation from LIDAR data
Ushani, A. K., Wolcott, R. W., Walls, J. M., & Eustice, R. M. (2017) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2017.7989666 · Cited by 74
Layered RGBD scene flow estimation
Sun, D., Sudderth, E. B., & Pfister, H. (2015) · Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2015.7298653 · Cited by 73
SphereFlow: 6 DoF Scene Flow from RGB-D Pairs
Hornáček, M., Fitzgibbon, A. W., & Rother, C. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.451 · Cited by 73
Motion-Based Object Segmentation Based on Dense RGB-D Scene Flow
Shao, L., Shah, P., Dwaracherla, V., & Bohg, J. (2018) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2018.2856525 · Cited by 40
Cited by
Deep Learning for 3D Point Clouds: A Survey
Guo, Y., Wang, H., Hu, Q., Liu, H., Liu, L., & Bennamoun, M. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3005434 · Cited by 2,398
Argoverse: 3D Tracking and Forecasting With Rich Maps
Chang, M.-F., Lambert, J., Sangkloy, P., Singh, J., Bak, S., Hartnett, A., Wang, D., Carr, P., Lucey, S., Ramanan, D., et al. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00895 · Cited by 1,474
A point-cloud deep learning framework for prediction of fluid flow fields on irregular geometries
Kashefi, A., Rempe, D., & Guibas, L. J. (2021) · Physics of Fluids · doi:10.1063/5.0033376 · Cited by 295
Self-citationMoving Object Segmentation in 3D LiDAR Data: A Learning-Based Approach Exploiting Sequential Data
Chen, X., Li, S., Mersch, B., Wiesmann, L., Gall, J., Behley, J., & Stachniss, C. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3093567 · Cited by 254
Offboard 3D Object Detection from Point Cloud Sequences
Qi, C. R., Zhou, Y., Najibi, M., Sun, P., Vo, K., Deng, B., & Anguelov, D. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00607 · Cited by 176
Self-citation
Metadata
- Authors
- Liu, X., Qi, C. R., & Guibas, L. J.
- Venue
- 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2019-06
- Pages
- 529-537
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2962771259
- Cited by
- 499
- References
- 32
- FWCI
- 20.58
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.