The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
V2V-PoseNet: Voxel-to-Voxel Prediction Network for Accurate 3D Hand and Human Pose Estimation from a Single Depth Map
Abstract
Most of the existing deep learning-based methods for 3D hand and human pose estimation from a single depth map are based on a common framework that takes a 2D depth map and directly regresses the 3D coordinates of keypoints, such as hand or human body joints, via 2D convolutional neural networks (CNNs). The first weakness of this approach is the presence of perspective distortion in the 2D depth map. While the depth map is intrinsically 3D data, many previous methods treat depth maps as 2D images that can distort the shape of the actual object through projection from 3D to 2D space. This compels the network to perform perspective distortion-invariant estimation. The second weakness of the conventional approach is that directly regressing 3D coordinates from a 2D image is a highly nonlinear mapping, which causes difficulty in the learning procedure. To overcome these weaknesses, we firstly cast the 3D hand and human pose estimation problem from a single depth map into a voxel-to-voxel prediction that uses a 3D voxelized grid and estimates the per-voxel likelihood for each keypoint. We design our model as a 3D CNN that provides accurate estimates while running in real-time. Our system outperforms previous methods in almost all publicly available 3D hand and human pose estimation datasets and placed first in the HANDS 2017 frame-based 3D hand pose estimation challenge. The code is available in1.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Stacked Hourglass Networks for Human Pose Estimation
Newell, A., Yang, K., & Deng, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_29 · Cited by 5,634
3D ShapeNets: A deep representation for volumetric shapes
Wu, Z., Song, S., Khosla, A., Yu, F., Zhang, L., Tang, X., & Xiao, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298801 · Cited by 4,550
VoxNet: A 3D Convolutional Neural Network for real-time object recognition
Maturana, D., & Scherer, S. (2015) · 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2015.7353481 · Cited by 3,458
Real-time human pose recognition in parts from single depth images
Shotton, J., Sharp, T., Kipman, A., Fitzgibbon, A., Finocchio, M., Blake, A., Cook, M., & Moore, R. (2013) · Communications of the ACM · doi:10.1145/2398356.2398381 · Cited by 2,044
Torch7: A Matlab-like Environment for Machine Learning
Collobert, R., Kavukcuoglu, K., & Farabet, C. (2011) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 1,186
Joint Training of a Convolutional Network and a Graphical Model for Human Pose Estimation
Tompson, J., Jain, A., LeCun, Y., & Bregler, C. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.2984 · Cited by 915
Coarse-to-Fine Volumetric Prediction for Single-Image 3D Human Pose
Pavlakos, G., Zhou, X., Derpanis, K. G., & Daniilidis, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.139 · Cited by 884
Real-Time Continuous Pose Recovery of Human Hands Using Convolutional Networks
Tompson, J., Stein, M., Lecun, Y., & Perlin, K. (2014) · ACM Transactions on Graphics · doi:10.1145/2629500 · Cited by 801
Deep Sliding Shapes for Amodal 3D Object Detection in RGB-D Images
Song, S., & Xiao, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.94 · Cited by 681
First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotations
Garcia-Hernando, G., Yuan, S., Baek, S., & Kim, T.-K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00050 · Cited by 519
Realtime and Robust Hand Tracking from Depth
Qian, C., Sun, X., Wei, Y., Tang, X., & Sun, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.145 · Cited by 470
Accurate, Robust, and Flexible Real-time Hand Tracking
Sharp, T., Keskin, C., Robertson, D., Taylor, J., Shotton, J., Kim, D., Rhemann, C., Leichter, I., Vinnikov, A., Wei, Y., et al. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702179 · Cited by 431
Sun, X., Wei, Y., Liang, S., Tang, X., & Sun, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298683 · Cited by 414
Latent Regression Forest: Structured Estimation of 3D Articulated Hand Posture
Tang, D., Chang, H. J., Tejani, A., & Kim, T.-K. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.490 · Cited by 398
Efficient regression of general-activity human poses from depth images
Girshick, R., Shotton, J., Kohli, P., Criminisi, A., & Fitzgibbon, A. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126270 · Cited by 344
Hands Deep in Deep Learning for Hand Pose Estimation
Oberweger, M., Wohlhart, P., & Lepetit, V. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.06807 · Cited by 298
Ge, L., Liang, H., Yuan, J., & Thalmann, D. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.602 · Cited by 291
Robust 3D Hand Pose Estimation in Single Depth Images: From Single-View CNN to Multi-View CNNs
Ge, L., Liang, H., Yuan, J., & Thalmann, D. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.391 · Cited by 289
Hand Pose Estimation and Hand Shape Classification Using Multi-layered Randomized Decision Forests
Keskin, C., Kıraç, F., Kara, Y. E., & Akarun, L. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33783-3_61 · Cited by 284
Training a Feedback Loop for Hand Pose Estimation
Oberweger, M., Wohlhart, P., & Lepetit, V. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.379 · Cited by 272
DeepPrior++: Improving Fast and Accurate 3D Hand Pose Estimation
Oberweger, M., & Lepetit, V. (2017) · 2017 IEEE International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw.2017.75 · Cited by 270
BigHand2.2M Benchmark: Hand Pose Dataset and State of the Art Analysis
Yuan, S., Ye, Q., Stenger, B., Jain, S., & Kim, T.-K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.279 · Cited by 243
Real-Time Articulated Hand Pose Estimation Using Semi-supervised Transductive Regression Forests
Tang, D., Yu, T.-H., & Kim, T.-K. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.400 · Cited by 219
Depth-Based 3D Hand Pose Estimation: From Current Achievements to Future Goals
Yuan, S., Garcia-Hernando, G., Stenger, B., Moon, G., Chang, J. Y., Lee, K. M., Molchanov, P., Kautz, J., Honari, S., Ge, L., et al. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00279 · Cited by 217
Self-citationRobust Articulated‐ICP for Real‐Time Hand Tracking
Tagliasacchi, A., Schröder, M., Tkach, A., Bouaziz, S., Botsch, M., & Pauly, M. (2015) · Computer Graphics Forum · doi:10.1111/cgf.12700 · Cited by 216
Pose guided structured region ensemble network for cascaded hand pose estimation
Chen, X., Wang, G., Guo, H., & Zhang, C. (2020) · Neurocomputing · doi:10.1016/j.neucom.2018.06.097 · Cited by 205
Dynamics based 3D skeletal hand tracking
Melax, S., Keselman, L., & Orsten, S. (2013) · Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games · doi:10.1145/2448196.2448232 · Cited by 172
Towards Viewpoint Invariant 3D Human Pose Estimation
Haque, A., Peng, B., Luo, Z., Alahi, A., Yeung, S., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_10 · Cited by 169
Crossing Nets: Combining GANs and VAEs with a Shared Latent Space for Hand Pose Estimation
Wan, C., Probst, T., Gool, L. V., & Yao, A. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.132 · Cited by 167
Real-Time Simultaneous Pose and Shape Estimation for Articulated Objects Using a Single Depth Camera
Ye, M., & Yang, R. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.301 · Cited by 164
Spatial Attention Deep Net with Partial PSO for Hierarchical Hybrid Hand Pose Estimation
Ye, Q., Yuan, S., & Kim, T.-K. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_21 · Cited by 163
DeepHand: Robust Hand Pose Estimation by Completing a Matrix Imputed with Deep Features
Sinha, A., Choi, C., & Ramani, K. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.450 · Cited by 159
Region ensemble network: Improving convolutional network for hand pose estimation
Guo, H., Wang, G., Chen, X., Zhang, C., Qiao, F., & Yang, H. (2017) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2017.8297136 · Cited by 153
Real-Time Human Pose Tracking from Range Data
Ganapathi, V., Plagemann, C., Koller, D., & Thrun, S. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33783-3_53 · Cited by 150
Opening the Black Box: Hierarchical Sampling Optimization for Estimating Human Hand Pose
Tang, D., Taylor, J., Kohli, P., Keskin, C., Kim, T., & Shotton, J. (2015) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.380 · Cited by 142
Sensor fusion for 3D human body tracking with an articulated 3D body model
Knoop, S., Vacek, S., & Dillmann, R. (2006) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/robot.2006.1641949 · Cited by 137
Xu, C. Y., Govindarajan, L. N., Zhang, Y., & Cheng, L. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-017-0998-6 · Cited by 127
Nonlinear Body Pose Estimation from Depth Images
Grest, D., Woetzel, J., & Koch, R. (2005) · Lecture notes in computer science · doi:10.1007/11550518_36 · Cited by 120
Monocular real-time 3D articulated hand pose estimation
Romero, J., Kjellström, H., & Kragić, D. (2009) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/ichr.2009.5379596 · Cited by 104
Parsing the Hand in Depth Images
Liang, H., Yuan, J., & Thalmann, D. (2014) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2014.2306177 · Cited by 98
Random tree walk toward instantaneous 3D human pose estimation
Jung, H. Y., Lee, S., Heo, Y. S., & Yun, I. D. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298861 · Cited by 97
Personalization and Evaluation of a Real-Time Depth-Based Full Body Tracker
Helten, T., Baak, A., Bharaj, G., Müller, M., Seidel, H., & Theobalt, C. (2013) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2013.44 · Cited by 97
Hand Pose Estimation from Local Surface Normals
Wan, C., Yao, A., & Gool, L. V. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46487-9_34 · Cited by 72
Multi-task, multi-domain learning: Application to semantic segmentation and pose regression
Fourure, D., Emonet, R., Fromont, É., Muselet, D., Neverova, N., Trémeau, A., & Wolf, C. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.04.014 · Cited by 64
Hand3D: Hand Pose Estimation using 3D Neural NetworkPreprint
Deng, X., Yang, S., Zhang, Y., Tan, P., Chang, L., & Wang, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.02224 · Cited by 59
Towards Good Practices for Deep 3D Hand Pose EstimationPreprint
Guo, H., Wang, G., Chen, X., & Zhang, C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.07248 · Cited by 42
DISCO Nets: DISsimilarity COefficient NetworksPreprint
Bouchacourt, D., Mudigonda, P. K., & Nowozin, S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.02556 · Cited by 42
Learning Hand Articulations by Hallucinating Heat Distribution
Choi, C., Kim, S., & Ramani, K. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.337 · Cited by 39
Occlusion Aware Hand Pose Recovery from Sequences of Depth Images
Madadi, M., Escalera, S., Carruesco, A., Andújar, C., Baró, X., & Gonzàlez, J. (2017) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2017.37 · Cited by 18
Hand Pose Regression via a Classification-Guided Approach
Yang, H.-W., & Zhang, J.-Y. (2016) · Asian Conference on Computer Vision · doi:10.1007/978-3-319-54187-7_30 · Cited by 11
Cited by
Moon, G., & Lee, K. M. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58571-6_44 · Cited by 377
Self-citationMoon, G., Yu, S.-I., Wen, H., Shiratori, T., & Lee, K. M. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58565-5_33 · Cited by 293
Self-citationRigNet: Neural Rigging for Articulated Characters
Xu, Z., Zhou, Y., Kalogerakis, E., Landreth, C., & Singh, K. (2020) · arXiv · doi:10.48550/arxiv.2005.00559 · Cited by 13
“Unlike pose estimation approaches designed for particular shape classes, such as humans or hands [Haque et al. 2016; Huang et al. 2018; Moon et al. 2018; Pavlakos et al. 2017; Shotton et al. 2011; Xu et al. 2017], our approach is not restricted by shape categorization or fixed skeleton structure.”
BackgroundMethod
Metadata
- Authors
- Chang, J. Y., Moon, G., & Lee, K. M.
- Venue
- 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2018-06
- Pages
- 5079-5088
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2963508807
- Cited by
- 381
- References
- 52
- FWCI
- 17.00
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.