The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Deep learning based 2D human pose estimation: A survey
Open accessAbstract
Human pose estimation has received significant attention recently due to its various applications in the real world. As the performance of the state-of-the-art human pose estimation methods can be improved by deep learning, this paper presents a comprehensive survey of deep learning based human pose estimation methods and analyzes the methodologies employed. We summarize and discuss recent works with a methodology-based taxonomy. Single-person and multi-person pipelines are first reviewed separately. Then, the deep learning techniques applied in these pipelines are compared and analyzed. The datasets and metrics used in this task are also discussed and compared. The aim of this survey is to make every step in the estimation pipelines interpretable and to provide readers a readily comprehensible explanation. Moreover, the unsolved problems and challenges for future research are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Feature Pyramid Networks for Object Detection
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.106 · Cited by 30,939
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2016) · arXiv · doi:10.48550/arxiv.1606.00915 · Cited by 22,392
Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., & Yuille, A. L. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2699184 · Cited by 22,392
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Aggregated Residual Transformations for Deep Neural Networks
Xie, S., Girshick, R., Dollar, P., Tu, Z., & He, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.634 · Cited by 12,465
Realtime Multi-person 2D Pose Estimation Using Part Affinity Fields
Cao, Z., Simon, T., Wei, S.-E., & Sheikh, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.143 · Cited by 7,539
Stacked Hourglass Networks for Human Pose Estimation
Newell, A., Yang, K., & Deng, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_29 · Cited by 5,634
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Szegedy, C., Ioffe, S., Vanhoucke, V., & Alemi, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11231 · Cited by 4,636
DeepPose: Human Pose Estimation via Deep Neural Networks
Toshev, A., & Szegedy, C. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.214 · Cited by 3,185
Wei, S.-E., Ramakrishna, V., Kanade, T., & Sheikh, Y. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.511 · Cited by 2,966
2D Human Pose Estimation: New Benchmark and State of the Art Analysis
Andriluka, M., Pishchulin, L., Gehler, P., & Schiele, B. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.471 · Cited by 2,688
Deep learning for visual understanding: A review
Guo, Y., Liu, Y., Oerlemans, A., Lao, S., Wu, S., & Lew, M. S. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.09.116 · Cited by 2,504
RMPE: Regional Multi-person Pose Estimation
Fang, H.-S., Xie, S., Tai, Y.-W., & Lu, C. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.256 · Cited by 1,884
Cascaded Pyramid Network for Multi-person Pose Estimation
Chen, Y., Wang, Z., Peng, Y., Zhang, Z., Yu, G., & Sun, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00742 · Cited by 1,799
A Simple Yet Effective Baseline for 3d Human Pose Estimation
Martinez, J., Hossain, R., Romero, J., & Little, J. J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.288 · Cited by 1,462
Head Pose Estimation in Computer Vision: A Survey
Murphy-Chutorian, E., & Trivedi, M. M. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.106 · Cited by 1,301
DeeperCut: A Deeper, Stronger, and Faster Multi-person Pose Estimation Model
Insafutdinov, E., Pishchulin, L., Andres, B., Andriluka, M., & Schiele, B. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46466-4_3 · Cited by 1,130
DeepCut: Joint Subset Partition and Labeling for Multi Person Pose Estimation
Pishchulin, L., Insafutdinov, E., Tang, S., Andres, B., Andriluka, M., Gehler, P., & Schiele, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.533 · Cited by 1,051
Articulated pose estimation with flexible mixtures-of-parts
Yang, Y., & Ramanan, D. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995741 · Cited by 990
Joint Training of a Convolutional Network and a Graphical Model for Human Pose Estimation
Tompson, J., Jain, A., LeCun, Y., & Bregler, C. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.2984 · Cited by 915
Vision-based hand pose estimation: A review
Erol, A., Bebis, G., Nicolescu, M., Boyle, R. D., & Twombly, X. (2007) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2006.10.012 · Cited by 866
Towards Accurate Multi-person Pose Estimation in the Wild
Papandreou, G., Zhu, T., Kanazawa, N., Toshev, A., Tompson, J., Bregler, C., & Murphy, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.395 · Cited by 860
Articulated Human Detection with Flexible Mixtures of Parts
Yang, Y., & Ramanan, D. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.261 · Cited by 852
Vision-based human motion analysis: An overview
Poppe, R. (2007) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2006.10.016 · Cited by 835
Clustered Pose and Nonlinear Appearance Models for Human Pose Estimation
Johnson, S., & Everingham, M. (2010) · Procedings of the British Machine Vision Conference 2010 · doi:10.5244/c.24.12 · Cited by 819
Human Pose Estimation with Iterative Error Feedback
Carreira, J., Agrawal, P., Fragkiadaki, K., & Malik, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.512 · Cited by 805
Multi-context Attention for Human Pose Estimation
Chu, X., Yang, W., Ouyang, W., Ma, C., Yuille, A. L., & Wang, X. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.601 · Cited by 737
Progressive search space reduction for human pose estimation
Ferrari, V., Marin-Jimenez, M., & Zisserman, A. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587468 · Cited by 612
Detect What You Can: Detecting and Representing Objects Using Holistic Models and Body Parts
Chen, X., Mottaghi, R., Liu, X., Fidler, S., Urtasun, R., & Yuille, A. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.254 · Cited by 605
Compositional Human Pose Regression
Sun, X., Shang, J., Liang, S., & Wei, Y. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.284 · Cited by 542
Flowing ConvNets for Human Pose Estimation in Videos
Pfister, T., Charles, J., & Zisserman, A. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.222 · Cited by 500
PoseTrack: A Benchmark for Human Pose Estimation and Tracking
Andriluka, M., Iqbal, U., Insafutdinov, E., Pishchulin, L., Milan, A., Gall, J., & Schiele, B. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00542 · Cited by 486
Associative Embedding: End-to-End Learning for Joint Detection and Grouping
Newell, A., Huang, Z., & Deng, J. H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.05424 · Cited by 461
MODEC: Multimodal Decomposable Models for Human Pose Estimation
Sapp, B., & Taskar, B. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.471 · Cited by 423
Data Distillation: Towards Omni-Supervised Learning
Radosavovic, I., Dollar, P., Girshick, R., Gkioxari, G., & He, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00433 · Cited by 421
Adversarial PoseNet: A Structure-Aware Convolutional Network for Human Pose Estimation
Chen, Y., Shen, C., Wei, X.-S., Liu, L., & Yang, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.137 · Cited by 357
Articulated Pose Estimation by a Graphical Model with Image Dependent Pairwise Relations
Chen, X., & Yuille, A. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1407.3399 · Cited by 299
Human pose regression by combining indirect part detection and contextual information
Luvizon, D. C., Tabia, H., & Picard, D. (2019) · Computers & Graphics · doi:10.1016/j.cag.2019.09.002 · Cited by 277
ArtTrack: Articulated Multi-Person Tracking in the Wild
Insafutdinov, E., Andriluka, M., Pishchulin, L., Tang, S., Levinkov, E., Andres, B., & Schiele, B. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.142 · Cited by 237
2D Articulated Human Pose Estimation and Retrieval in (Almost) Unconstrained Still Images
Eichner, M., Marin-Jimenez, M., Zisserman, A., & Ferrari, V. (2012) · International Journal of Computer Vision · doi:10.1007/s11263-012-0524-9 · Cited by 233
Articulated part-based model for joint object detection and pose estimation
Sun, M., & Savarese, S. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126309 · Cited by 195
Articulated Pose Estimation by a Graphical Model with Image Dependent Pairwise Relations
Chen, X., & Yuille, A. (2015) · Cited by 191
A Survey on Deep Learning Based Approaches for Action and Gesture Recognition in Image Sequences
Asadi-Aghbolaghi, M., Clapes, A., Bellantonio, M., Escalante, H. J., Ponce-Lopez, V., Baro, X., Guyon, I., Kasaei, S., & Escalera, S. (2017) · 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017) · doi:10.1109/fg.2017.150 · Cited by 173
Deep Convolutional Neural Networks for Efficient Pose Estimation in Gesture Videos
Pfister, T., Simonyan, K., Charles, J., & Zisserman, A. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16865-4_35 · Cited by 160
Human Pose Estimation from Monocular Images: A Comprehensive Survey
Gong, W., Zhang, X., Gonzàlez, J., Sobral, A., Bouwmans, T., Tu, C., & Zahzah, E.-H. (2016) · Sensors · doi:10.3390/s16121966 · Cited by 159
Multi-person Pose Estimation with Local Joint-to-Person Associations
Iqbal, U., & Gall, J. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-48881-3_44 · Cited by 156
Beyond Physical Connections: Tree Models in Human Pose Estimation
Wang, F., & Li, Y. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.83 · Cited by 152
A survey of human pose estimation: The body parts parsing based methods
Liu, Z., Zhu, J., Bu, J., & Chen, C. (2015) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2015.06.013 · Cited by 134
Mixing Body-Part Sequences for Human Pose Estimation
Cherian, A., Mairal, J., Alahari, K., & Schmid, C. (2014) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2014.302 · Cited by 112
We Are Family: Joint Pose Estimation of Multiple Persons
Eichner, M. L., & Ferrari, V. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15549-9_17 · Cited by 109
Improving Object Detection With One Line of Code.Preprint
Bodla, N., Singh, B., Chellappa, R., & Davis, L. S. (2017) · arXiv (Cornell University) · Cited by 91
Practical Network Blocks Design with Q-Learning.Preprint
Zhong, Z., Yan, J., & Liu, C. (2017) · arXiv (Cornell University) · Cited by 90
Zero-Shot Learning via Visual Abstraction
Antol, S., Zitnick, C. L., & Parikh, D. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10593-2_27 · Cited by 87
Parsing occluded people by flexible compositions
Chen, X., & Yuille, A. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7299020 · Cited by 82
Compositional Human Pose Regression
Liang, S., Sun, X. N., & Wei, Y. (2018) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2018.10.006 · Cited by 78
A Survey on Human Pose Estimation
Zhang, H., Lei, Q., Zhong, B., Du, J., & Peng, J. (2015) · Intelligent Automation & Soft Computing · doi:10.1080/10798587.2015.1095419 · Cited by 33
ArtTrack: Articulated Multi-person Tracking in the WildPreprint
Insafutdinov, E., Andriluka, M., Pishchulin, L., Tang, S., Levinkov, E., Andres, B., & Schiele, B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.01465 · Cited by 32
Merging Pose Estimates Across Space and Time
Burgos-Artizzu, X. P., Hall, D., Perona, P., & Dollár, P. (2013) · British Machine Vision Conference (BMVC) · doi:10.5244/c.27.58 · Cited by 29
Cited by
Artificial intelligence for the metaverse: A survey
Huynh-The, T., Pham, Q.-V., Pham, X.-Q., Nguyen, T. T., Han, Z., & Kim, D.-S. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105581 · Cited by 710
Deep learning tools for the measurement of animal behavior in neuroscience
Mathis, M. W., & Mathis, A. (2020) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2019.10.008 · Cited by 450
Synthetic Data for Deep Learning
Nikolenko, S. I. (2021) · Springer Optimization and Its Applications · doi:10.1007/978-3-030-75178-4 · Cited by 423
Wade, L., Needham, L., McGuigan, P., & Bilzon, J. (2022) · PeerJ · doi:10.7717/peerj.12995 · Cited by 384
Munea, T. L., Jembre, Y. Z., Weldegebriel, H. T., Chen, L., Huang, C., & Yang, C. (2020) · IEEE Access · doi:10.1109/access.2020.3010248 · Cited by 275
Metadata
- Authors
- Dang, Q., Yin, J., Wang, B., & Zheng, W.
- Venue
- Tsinghua Science and Technology
- Publisher
- Tsinghua University Press
- Published
- 2019-12
- Volume
- 24
- Issue
- 6
- Pages
- 663-676
- ISSN
- 1007-0214 (ISSN-L)
- OpenAlex
- W2948527806
- Cited by
- 281
- References
- 64
- FWCI
- 11.73
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.