The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Real-time human pose recognition in parts from single depth images
Abstract
We propose a new method to quickly and accurately predict human pose ---the 3D positions of body joints---from a single depth image, without depending on information from preceding frames. Our approach is strongly rooted in current object recognition strategies. By designing an intermediate representation in terms of body parts, the difficult pose estimation problem is transformed into a simpler per-pixel classification problem, for which efficient machine learning techniques exist. By using computer graphics to synthesize a very large dataset of training image pairs, one can train a classifier that estimates body part labels from test images invariant to pose, body shape, clothing, and other irrelevances. Finally, we generate confidence-scored 3D proposals of several body joints by reprojecting the classification result and finding local modes. The system runs in under 5ms on the Xbox 360. Our evaluation shows high accuracy on both synthetic and real test sets, and investigates the effect of several training parameters. We achieve state-of-the-art accuracy in our comparison with related work and demonstrate improved generalization over exact whole-skeleton nearest neighbor matching.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Quinlan, J. R. (1986) · Machine Learning · doi:10.1007/bf00116251 · Cited by 21,439
Research works printed but not linked: 26
- 10.5555/1896300.1896427 · doi:10.5555/1896300.1896427
- 10.1162/neco.1997.9.7.1545 · DOI · Paper page
- 10.1109/34.993558 · DOI · Paper page
- 10.1109/34.1000236 · DOI · Paper page
- 10.1109/CVPR.2003.1211479 · DOI · Paper page
- 10.1109/CVPR.2010.5540141 · DOI · Paper page
- 10.5555/645314.649425 · doi:10.5555/645314.649425
- Gonzalez , T. Clustering to minimize the maximum intercluster distance. Theor. Comp. Sci. 38 ( 1985 ). Gonzalez, T. Clustering to minimize the maximum intercluster distance. Theor. Comp. Sci. 38 (1985).
- 10.1109/CVPR.2005.288 · DOI · Paper page
- 10.1016/j.cviu.2006.08.002 · DOI · Paper page
- 10.1109/ICCV.2007.4408976 · DOI
- Ning , H. , Xu , W. , Gong , Y. , Huang , T.S. Discriminative learning of visual words for 3D human pose estimation . In Proceedings of CVPR ( 2008 ). Ning, H., Xu, W., Gong, Y., Huang, T.S. Discriminative learning of visual words for 3D human pose estimation. In Proceedings of CVPR (2008).
- 10.1007/978-3-540-88688-4_32 · DOI
- 10.1109/ROBOT.2010.5509559 · DOI · Paper page
- 10.1016/j.cviu.2006.10.016 · DOI · Paper page
- 10.1109/CVPR.2003.1211504 · DOI · Paper page
- 10.5555/946247.946721 · doi:10.5555/946247.946721
- 10.1007/978-3-540-88693-8_44 · DOI
- 10.1007/11744023_1 · DOI · Paper page
- 10.1109/CVPRW.2010.5543618 · DOI
- 10.5555/645315.649172 · doi:10.5555/645315.649172
- 10.1109/CVPR.2004.1315063 · DOI · Paper page
- 10.1109/CVPR.2008.4587360 · DOI
- 10.1145/1576246.1531369 · DOI
- 10.1109/CVPR.2006.305 · DOI · Paper page
- 10.5555/1775614.1775663 · doi:10.5555/1775614.1775663
Cited by
Stacked Hourglass Networks for Human Pose Estimation
Newell, A., Yang, K., & Deng, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_29 · Cited by 5,634
Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition
Yan, S., Xiong, Y., & Lin, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12328 · Cited by 5,410
Unsupervised Monocular Depth Estimation with Left-Right Consistency
Godard, C., Aodha, O. M., & Brostow, G. J. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.699 · Cited by 3,270
SUN RGB-D: A RGB-D scene understanding benchmark suite
Song, S., Lichtenberg, S. P., & Xiao, J. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298655 · Cited by 1,943
Learning Rich Features from RGB-D Images for Object Detection and Segmentation
Gupta, S., Girshick, R., Arbeláez, P., & Malik, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10584-0_23 · Cited by 1,528
Soli: ubiquitous gesture sensing with millimeter wave radar
Lien, J., Gillian, N., Karagozler, M. E., Amihood, P., Schwesig, C., Olson, E., Raja, H., & Poupyrev, I. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925953 · Cited by 957
Machine learning for internet of things data analysis: a survey
Mahdavinejad, M. S., Rezvan, M., Barekatain, M., Adibi, P., Barnaghi, P., & Sheth, A. P. (2018) · Digital Communications and Networks · doi:10.1016/j.dcan.2017.10.002 · Cited by 921
Kendall, A., Badrinarayanan, V., & Cipolla, R. (2017) · Procedings of the British Machine Vision Conference 2017 · doi:10.5244/c.31.57 · Cited by 784
Geodesic Convolutional Neural Networks on Riemannian Manifolds
Masci, J., Boscaini, D., Bronstein, M. M., & Vandergheynst, P. (2015) · 2015 IEEE International Conference on Computer Vision Workshop (ICCVW) · doi:10.1109/iccvw.2015.112 · Cited by 721
Scornet, E., Biau, G., & Vert, J.-P. (2015) · The Annals of Statistics · doi:10.1214/15-aos1321 · Cited by 612
Corneanu, C. A., Simon, M. O., Cohn, J. F., & Guerrero, S. E. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2515606 · Cited by 527
A Comprehensive Survey of Vision-Based Human Action Recognition Methods
Zhang, H.-B., Zhang, Y.-X., Zhong, B., Lei, Q., Yang, L., Du, J.-X., & Chen, D.-S. (2019) · Sensors · doi:10.3390/s19051005 · Cited by 503
“[77] proposed a real-time pose estimation method from depth images, which allows rapid human segmentation according to depth.”
MethodSkeleton based action recognition with convolutional neural network
Du, Y., Fu, Y., & Wang, L. (2015) · 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR) · doi:10.1109/acpr.2015.7486569 · Cited by 445
Capturing the human figure through a wall
Adib, F., Hsu, C.-Y., Mao, H., Katabi, D., & Durand, F. (2015) · ACM Transactions on Graphics · doi:10.1145/2816795.2818072 · Cited by 443
A survey of depth and inertial sensor fusion for human action recognition
Chen, C., Jafari, R., & Kehtarnavaz, N. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-015-3177-1 · Cited by 356
Huang, Y., Kaufmann, M., Aksan, E., Black, M. J., Hilliges, O., & Pons-Moll, G. (2018) · ACM Transactions on Graphics · doi:10.1145/3272127.3275108 · Cited by 342
Unsupervised feature learning for 3D scene labeling
Lai, K., Bo, L., & Fox, D. (2014) · 2014 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2014.6907298 · Cited by 317
McDuff, D., el Kaliouby, R., Senechal, T., Amr, M., Cohn, J. F., & Picard, R. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2013.130 · Cited by 234
Multimodal Gesture Recognition Based on the ResC3D Network
Miao, Q., Li, Y., Ouyang, W., Ma, Z., Xu, X., Shi, W., & Cao, X. (2017) · 2017 IEEE International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw.2017.360 · Cited by 168
Towards Viewpoint Invariant 3D Human Pose Estimation
Haque, A., Peng, B., Luo, Z., Alahi, A., Yeung, S., & Fei-Fei, L. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_10 · Cited by 169
Exploiting uncertainty in regression forests for accurate camera relocalization
Valentin, J., Niebner, M., Shotton, J., Fitzgibbon, A., Izadi, S., & Torr, P. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299069 · Cited by 156
Self-citationMoDeep: A Deep Learning Framework Using Motion Features for Human Pose Estimation
Jain, A., Tompson, J., LeCun, Y., & Bregler, C. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-16808-1_21 · Cited by 142
Ellis, K., Godbole, S., Marshall, S., Lanckriet, G., Staudenmayer, J., & Kerr, J. (2014) · Frontiers in Public Health · doi:10.3389/fpubh.2014.00036 · Cited by 123
Slater, H., Dear, B. F., Merolli, M. A., Li, L. C., & Briggs, A. M. (2016) · Best Practice & Research Clinical Rheumatology · doi:10.1016/j.berh.2016.08.006 · Cited by 88
Human Activity Recognition Based on Dynamic Active Learning
Bi, H., Perello-Nieto, M., Santos-Rodriguez, R., & Flach, P. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.3013403 · Cited by 81
Encoding atlases by randomized classification forests for efficient multi-atlas label propagation
Zikic, D., Glocker, B., & Criminisi, A. (2014) · Medical Image Analysis · doi:10.1016/j.media.2014.06.010 · Cited by 81
Body Joint Guided 3-D Deep Convolutional Descriptors for Action Recognition
Cao, C., Zhang, Y., Zhang, C., & Lu, H. (2018) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2756840 · Cited by 78
Vision-Based Driver Assistance Systems: Survey, Taxonomy and Advances
Horgan, J., Hughes, C., McDonald, J., & Yogamani, S. (2015) · 2015 IEEE 18th International Conference on Intelligent Transportation Systems · doi:10.1109/itsc.2015.329 · Cited by 72
Unsupervised Monocular Depth Estimation with Left-Right Consistency
Godard, C., Mac Aodha, O., & Brostow, G. J. (2016) · arXiv · doi:10.48550/arxiv.1609.03677 · Cited by 28
Li, Q., Lin, W., & Li, J. (2018) · Signal Processing: Image Communication · doi:10.1016/j.image.2018.06.013 · Cited by 19
Deep Learning for Skeleton-Based Human Activity Segmentation: An Autoencoder Approach
Hossen, M. A., Naim, A. G., & Abas, P. E. (2024) · Technologies · doi:10.3390/technologies12070096 · Cited by 7
Accurate estimation of joint motion trajectories for rehabilitation using Kinect
Sinha, S., Bhowmick, B., Sinha, A., & Das, A. (2017) · 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2017.8037700 · Cited by 6
Multimodal Observation and Interpretation of Subjects Engaged in Problem Solving
Guntz, T., Balzarini, R., Vaufreydaz, D., & Crowley, J. L. (2017) · arXiv · doi:10.48550/arxiv.1710.04486 · Cited by 4
Metadata
- Authors
- Shotton, J., Sharp, T., Kipman, A., Fitzgibbon, A., Finocchio, M., Blake, A., Cook, M., & Moore, R.
- Venue
- Communications of the ACM
- Published
- 2013-01
- Volume
- 56
- Issue
- 1
- Pages
- 116-124
- ISSN
- 0001-0782 (ISSN-L)
- 1557-7317
- OpenAlex
- W2060280062
- Cited by
- 2,044
- References
- 2
- FWCI
- 350.15
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.