OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields
Open accessThe DOI matches its Crossref record, with a small difference in title or year; 78 of the 78 references it cites were found in a registry or an index.
Abstract
Realtime multi-person 2D pose estimation is a key component in enabling machines to have an understanding of people in images and videos. In this work, we present a realtime approach to detect the 2D pose of multiple people in an image. The proposed method uses a nonparametric representation, which we refer to as Part Affinity Fields (PAFs), to learn to associate body parts with individuals in the image. This bottom-up system achieves high accuracy and realtime performance, regardless of the number of people in the image. In previous work, PAFs and body part location estimation were refined simultaneously across training stages. We demonstrate that a PAF-only refinement rather than both PAF and body part location refinement results in a substantial increase in both runtime performance and accuracy. We also present the first combined body and foot keypoint detector, based on an internal annotated foot dataset that we have publicly released. We show that the combined detector not only reduces the inference time compared to running them sequentially, but also maintains the accuracy of each component individually. This work has culminated in the release of OpenPose, the first open-source realtime system for multi-person 2D pose detection, including body, foot, hand, and facial keypoints.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“OpenPose can detect people in a frame and generate a skeleton of body parts for each person detected.”
From Opportunity++: A Multimodal Dataset for Video- and Wearable, Object and Ambient Sensors-Based Human Activity Recognition (2021) · cites this paper as Cao et al. (2021)
The cited source says what the claim attributes to it.
In the citing paper
“However, in order to make the videos interesting for researchers, we also provide the pose tracking of all the people in the scene generated with OpenPose (Cao et al. (2021)).”
From Opportunity++: A Multimodal Dataset for Video- and Wearable, Object and Ambient Sensors-Based Human Activity Recognition (2021) · cites this paper as Cao et al. (2021)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
(2016) · Cited by 31,590
An Algorithm for Least-Squares Estimation of Nonlinear Parameters
Marquardt, D. W. (1963) · Journal of the Society for Industrial and Applied Mathematics · doi:10.1137/0111030 · Cited by 30,728
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
SSD: Single Shot MultiBox Detector
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_2 · Cited by 22,128
Cited by
Adding Conditional Control to Text-to-Image Diffusion Models
Zhang, L., Rao, A., & Agrawala, M. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00355 · Cited by 4,547
Cellpose: a generalist algorithm for cellular segmentation
Stringer, C., Wang, T., Michaelos, M., & Pachitariu, M. (2021) · Nature Methods · doi:10.1038/s41592-020-01018-x · Cited by 4,369
Probabilistic machine learning an introduction
Murphy, K. P. (2022) · Cited by 1,622
Lee, L.-H., Braud, T., Zhou, P., Wang, L., Xu, D., Lin, Z., Kumar, A., Bermejo, C., & Hui, P. (2021) · arXiv · doi:10.48550/arxiv.2110.05352 · Cited by 1,088
“Among the SoTA methods for 2D pose tracking, OpenPose [328] has been broadly used by researchers to track users’ bodies in various virtual environments such as VR [333], [334], AR [335]–[337], and metaverse [338].”
BackgroundMethodLee, L.-H., Braud, T., Zhou, P. Y., Wang, L., Xu, D., Lin, Z., Kumar, A., Bermejo, C., & Hui, P. (2024) · Foundations and Trends® in Human-Computer Interaction · doi:10.1561/1100000095 · Cited by 1,082
Learning to Reconstruct 3D Human Pose and Shape via Model-Fitting in the Loop
Kolotouros, N., Pavlakos, G., Black, M., & Daniilidis, K. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00234 · Cited by 1,039
VIBE: Video Inference for Human Body Pose and Shape Estimation
Kocabas, M., Athanasiou, N., & Black, M. J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00530 · Cited by 1,031
Mou, C., Wang, X., Xie, L., Wu, Y., Zhang, J., Qi, Z., & Shan, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i5.28226 · Cited by 923
Revisiting Skeleton-based Action Recognition
Duan, H., Zhao, Y., Chen, K., Lin, D., & Dai, B. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00298 · Cited by 834
AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Time
Fang, H.-S., Li, J., Tang, H., Xu, C., Zhu, H., Xiu, Y., Li, Y.-L., & Lu, C. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3222784 · Cited by 756
RTMPose: Real-Time Multi-Person Pose Estimation based on MMPosePreprint
Jiang, T., Lu, P., Zhang, L., Ma, N., Han, R., Lyu, C., Li, Y., & Chen, K. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2303.07399 · Cited by 742
DiffusionDet: Diffusion Model for Object Detection
Chen, S., Sun, P., Song, Y., & Luo, P. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01816 · Cited by 657
Soft Rasterizer: A Differentiable Renderer for Image-Based 3D Reasoning
Liu, S., Chen, W., Li, T., & Li, H. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00780 · Cited by 641
Li, D., Opazo, C. R., Yu, X., & Li, H. (2020) · 2020 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv45572.2020.9093512 · Cited by 641
Pose-Guided Feature Alignment for Occluded Person Re-Identification
Miao, J., Wu, Y., Liu, P., Ding, Y., & Yang, Y. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00063 · Cited by 638
Colyer, S. L., Evans, M., Cosker, D. P., & Salo, A. I. T. (2018) · Sports Medicine - Open · doi:10.1186/s40798-018-0139-y · Cited by 629
CrowdPose: Efficient Crowded Scenes Pose Estimation and a New Benchmark
Li, J., Wang, C., Zhu, H., Mao, Y., Fang, H.-S., & Lu, C. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01112 · Cited by 613
AI Choreographer: Music Conditioned 3D Dance Generation with AIST++
Li, R., Yang, S., Ross, D. A., & Kanazawa, A. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01315 · Cited by 553
“Training data for 2D pose and audio is abundant thanks to the high reliability of 2D pose detectors [14].”
BackgroundHigh-Order Information Matters: Learning Relation and Topology for Occluded Person Re-Identification
Wang, G., Yang, S., Liu, H., Wang, Z., Yang, Y., Wang, S., Yu, G., Zhou, E., & Sun, J. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00648 · Cited by 512
A model-based gait recognition method with body pose and human prior knowledge
Liao, R., Yu, S., An, W., & Huang, Y. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2019.107069 · Cited by 509
BlazePose: On-device Real-time Body Pose tracking
Bazarevsky, V., Grishchenko, I., Raveendran, K., Zhu, T., Zhang, F., & Grundmann, M. (2020) · arXiv · doi:10.48550/arxiv.2006.10204 · Cited by 475
Cobot programming for collaborative industrial tasks: An overview
El Zaatari, S., Marei, M., Li, W., & Usman, Z. (2019) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2019.03.003 · Cited by 470
OpenCap: Human movement dynamics from smartphone videos
Uhlrich, S. D., Falisse, A., Kidziński, Ł., Muccini, J., Ko, M., Chaudhari, A. S., Hicks, J. L., & Delp, S. L. (2023) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1011462 · Cited by 449
Skeleton-based action recognition via spatial and temporal transformer networks
Plizzari, C., Cannici, M., & Matteucci, M. (2021) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2021.103219 · Cited by 409
Few-shot Video-to-Video SynthesisPreprint
Wang, T.-C., Liu, M.-Y., Tao, A., Liu, G., Kautz, J., & Catanzaro, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.12713 · Cited by 400
Deep 3D human pose estimation: A review
Wang, J., Tan, S., Zhen, X., Xu, S., Zheng, F., He, Z., & Shao, L. (2021) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2021.103225 · Cited by 399
Animatable Neural Radiance Fields for Modeling Dynamic Human Bodies
Peng, S., Dong, J., Wang, Q., Zhang, S., Shuai, Q., Zhou, X., & Bao, H. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01405 · Cited by 387
Wade, L., Needham, L., McGuigan, P., & Bilzon, J. (2022) · PeerJ · doi:10.7717/peerj.12995 · Cited by 384
Evaluation of 3D Markerless Motion Capture Accuracy Using OpenPose With Multiple Video Cameras
Nakano, N., Sakura, T., Ueda, K., Omura, L., Kimura, A., Iino, Y., Fukashiro, S., & Yoshioka, S. (2020) · Frontiers in Sports and Active Living · doi:10.3389/fspor.2020.00050 · Cited by 378
Sapiens: Foundation for Human Vision Models
Khirodkar, R., Bagautdinov, T., Martinez, J., Zhaoen, S., James, A., Selednik, P., Anderson, S., & Saito, S. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-73235-5_12 · Cited by 363
PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loop
Zhang, H., Tian, Y., Zhou, X., Ouyang, W., Liu, Y., Wang, L., & Sun, Z. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01125 · Cited by 341
Dynamic GCN: Context-enriched Topology Learning for Skeleton-based Action Recognition
Ye, F., Pu, S., Zhong, Q., Li, C., Xie, D., & Tang, H. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413941 · Cited by 341
Anatomy-Aware 3D Human Pose Estimation With Bone-Based Pose Decomposition
Chen, T., Fang, C., Shen, X., Zhu, Y., Chen, Z., & Luo, J. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3057267 · Cited by 338
Monocular Total Capture: Posing Face, Body, and Hands in the Wild
Xiang, D., Joo, H., & Sheikh, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01122 · Cited by 335
Self-citationAnipose: A toolkit for robust markerless 3D pose estimation
Karashchuk, P., Rupp, K. L., Dickinson, E. S., Walling-Bell, S., Sanders, E., Azim, E., Brunton, B. W., & Tuthill, J. C. (2021) · Cell Reports · doi:10.1016/j.celrep.2021.109730 · Cited by 324
Two-dimensional video-based analysis of human gait using pose estimation
Stenum, J., Rossi, C., & Roemmich, R. T. (2021) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1008935 · Cited by 321
WHAM: Reconstructing World-Grounded Humans with Accurate 3D Motion
Shin, S., Kim, J.-Y., Halilaj, E., & Black, M. J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00202 · Cited by 318
VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalization
Choi, S., Park, S., Lee, M., & Choo, J. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01391 · Cited by 312
Core Challenges of Social Robot Navigation: A Survey
Mavrogiannis, C., Baldini, F., Wang, A., Zhao, D., Trautman, P., Steinfeld, A., & Oh, J. (2023) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3583741 · Cited by 306
HuMoR: 3D Human Motion Model for Robust Pose Estimation
Rempe, D., Birdal, T., Hertzmann, A., Yang, J., Sridhar, S., & Guibas, L. J. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01129 · Cited by 304
B-SOiD, an open-source unsupervised algorithm for identification and fast prediction of behaviors
Hsu, A. I., & Yttri, E. A. (2021) · Nature Communications · doi:10.1038/s41467-021-25420-x · Cited by 298
BEAT: A Large-Scale Semantic and Emotional Multi-modal Dataset for Conversational Gestures Synthesis
Liu, H., Zhu, Z., Iwamoto, N., Peng, Y., Li, Z., Zhou, Y., Bozkurt, E., & Zheng, B. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20071-7_36 · Cited by 298
Person Re-Identification by Contour Sketch Under Moderate Clothing Change
Yang, Q., Wu, A., & Zheng, W.-S. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2960509 · Cited by 293
A-NeRF: Articulated Neural Radiance Fields for Learning Human Shape, Appearance, and PosePreprint
Su, S.-Y., Yu, F., Zollhöfer, M., & Rhodin, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.06199 · Cited by 292
Zhou, X., Wang, D., & Krähenbühl, P. (2019) · arXiv · doi:10.48550/arxiv.1904.07850 · Cited by 288
Robots As Intentional Agents: Using Neuroscientific Methods to Make Robots Appear More Social
Wiese, E., Metta, G., & Wykowska, A. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01663 · Cited by 286
The Devil Is in the Details: Delving Into Unbiased Data Processing for Human Pose Estimation
Huang, J., Zhu, Z., Guo, F., & Huang, G. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00574 · Cited by 281
ViTPose++: Vision Transformer for Generic Body Pose Estimation
Xu, Y., Zhang, J., Zhang, Q., & Tao, D. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3330016 · Cited by 280
OpenSim Moco: Musculoskeletal optimal control
Dembia, C. L., Bianco, N. A., Falisse, A., Hicks, J. L., & Delp, S. L. (2020) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1008493 · Cited by 276
Action Transformer: A self-attention model for short-time pose-based human action recognition
Mazzia, V., Angarano, S., Salvetti, F., Angelini, F., & Chiaberge, M. (2022) · Pattern Recognition · doi:10.1016/j.patcog.2021.108487 · Cited by 276
XNect: real-time multi-person 3D motion capture with a single RGB camera
Mehta, D., Sotnychenko, O., Mueller, F., Xu, W., Elgharib, M., Fua, P., Seidel, H.-P., Rhodin, H., Pons-Moll, G., & Theobalt, C. (2020) · ACM Transactions on Graphics · doi:10.1145/3386569.3392410 · Cited by 274
A Survey of Deep Learning for Scientific DiscoveryPreprint
Raghu, M., & Schmidt, E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.11755 · Cited by 274
Albert, J. A., Owolabi, V., Gebel, A., Brahms, C. M., Granacher, U., & Arnrich, B. (2020) · Sensors · doi:10.3390/s20185104 · Cited by 261
How2Sign: A Large-scale Multimodal Dataset for Continuous American Sign Language
Duarte, A., Palaskar, S., Ventura, L., Ghadiyaram, D., DeHaan, K., Metze, F., Torres, J., & Giro-i-Nieto, X. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00276 · Cited by 261
Gait Recognition in the Wild with Dense 3D Representations and A Benchmark
Zheng, J., Liu, X., Liu, W., He, L., Yan, C., & Mei, T. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01959 · Cited by 260
Capturing and Inferring Dense Full-Body Human-Scene Contact
Huang, C.-H. P., Yi, H., Höschle, M., Safroshkin, M., Alexiadis, T., Polikovsky, S., Scharstein, D., & Black, M. J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01292 · Cited by 260
OOTDiffusion: Outfitting Fusion Based Latent Diffusion for Controllable Virtual Try-On
Xu, Y., Gu, T., Chen, W., & Chen, A. (2025) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v39i9.32973 · Cited by 259
Structure-Aware Positional Transformer for Visible-Infrared Person Re-Identification
Chen, C., Ye, M., Qi, M., Wu, J., Jiang, J., & Lin, C.-W. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3141868 · Cited by 255
Cross-Domain Correspondence Learning for Exemplar-Based Image Translation
Zhang, P., Zhang, B., Chen, D., Yuan, L., & Wen, F. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00519 · Cited by 253
PyMAF-X: Towards Well-Aligned Full-Body Model Regression From Monocular Images
Zhang, H., Tian, Y., Zhang, Y., Li, M., An, L., Sun, Z., & Liu, Y. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3271691 · Cited by 246
Towards Multimodal Sarcasm Detection (An _Obviously_ Perfect Paper)
Castro, S., Hazarika, D., Pérez-Rosas, V., Zimmermann, R., Mihalcea, R., & Poria, S. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1455 · Cited by 243
Whole-Body Human Pose Estimation in the Wild
Jin, S., Xu, L., Xu, J., Wang, C., Liu, W., Qian, C., Ouyang, W., & Luo, P. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58545-7_12 · Cited by 243
Automated markerless pose estimation in freely moving macaques with OpenMonkeyStudio
Bala, P. C., Eisenreich, B. R., Yoo, S. B. M., Hayden, B. Y., Park, H. S., & Zimmermann, J. (2020) · Nature Communications · doi:10.1038/s41467-020-18441-5 · Cited by 243
Liu, H., Zhu, Z., Becherini, G., Peng, Y., Su, M., Zhou, Y., Zhe, X., Iwamoto, N., Zheng, B., & Black, M. J. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00115 · Cited by 239
Monocular Expressive Body Regression Through Body-Driven Attention
Choutas, V., Pavlakos, G., Bolkart, T., Tzionas, D., & Black, M. J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58607-2_2 · Cited by 238
3D Human Action Representation Learning via Cross-View Consistency Pursuit
Li, L., Wang, M., Ni, B., Wang, H., Yang, J., & Zhang, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00471 · Cited by 236
“Due to the lightweight and robust estimation algorithms [3, 56], 3D skeleton has become a popular feature representation to study human action dynamics.”
BackgroundYu, B. X. B., Zhi, Z., Liu, Y., Zhong, S.-H., Liu, Y., & Chen, C. W. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00810 · Cited by 236
Taming Diffusion Models for Audio-Driven Co-Speech Gesture Generation
Zhu, L., Liu, X., Liu, X., Qian, R., Liu, Z., & Yu, L. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01016 · Cited by 234
A Survey on 3D Skeleton-Based Action Recognition Using Learning Method
Ren, B., Liu, M., Ding, R., & Liu, H. (2024) · Cyborg and Bionic Systems · doi:10.34133/cbsystems.0100 · Cited by 232
A Primer on Motion Capture with Deep Learning: Principles, Pitfalls, and Perspectives
Mathis, A., Schneider, S., Lauer, J., & Mathis, M. W. (2020) · Neuron · doi:10.1016/j.neuron.2020.09.017 · Cited by 231
SimCC: A Simple Coordinate Classification Perspective for Human Pose Estimation
Li, Y., Yang, S., Liu, P., Zhang, S., Wang, Y., Wang, Z., Yang, W., & Xia, S.-T. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-20068-7_6 · Cited by 230
Effective Whole-body Pose Estimation with Two-stages Distillation
Yang, Z., Zeng, A., Yuan, C., & Li, Y. (2023) · 2023 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw60793.2023.00455 · Cited by 227
Reconstructing Hand-Object Interactions in the Wild
Cao, Z., Radosavovic, I., Kanazawa, A., & Malik, J. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01219 · Cited by 227
Self-citationINCLUDE: A Large Scale Dataset for Indian Sign Language Recognition
Sridhar, A., Ganesan, R. G., Kumar, P., & Khapra, M. M. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413528 · Cited by 226
Occlusion-Aware Networks for 3D Human Pose Estimation in Video
Cheng, Y., Yang, B., Wang, B., Wending, Y., & Tan, R. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00081 · Cited by 225
Towards a Deeper Understanding of Skeleton-based Gait Recognition
Teepe, T., Gilg, J., Herzog, F., Hörmann, S., & Rigoll, G. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00163 · Cited by 224
Not All Tokens Are Equal: Human-centric Visual Analysis via Token Clustering Transformer
Zeng, W., Jin, S., Liu, W., Qian, C., Luo, P., Ouyang, W., & Wang, X. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01082 · Cited by 224
Al-Hammadi, M., Muhammad, G., Abdul, W., Alsulaiman, M., Bencherif, M. A., Alrayes, T. S., Mathkour, H., & Mekhtiche, M. A. (2020) · IEEE Access · doi:10.1109/access.2020.3032140 · Cited by 222
Collaborative Regression of Expressive Bodies using Moderation
Feng, Y., Choutas, V., Bolkart, T., Tzionas, D., & Black, M. J. (2021) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv53792.2021.00088 · Cited by 222
A Comprehensive Review of Data‐Driven Co‐Speech Gesture Generation
Nyatsanga, S., Kucherenko, T., Ahuja, C., Henter, G. E., & Neff, M. (2023) · Computer Graphics Forum · doi:10.1111/cgf.14776 · Cited by 222
The IKEA ASM Dataset: Understanding People Assembling Furniture through Actions, Objects and Pose
Ben-Shabat, Y., Yu, X., Saleh, F. S., Campbell, D., Rodríguez-Opazo, C., Li, H., & Gould, S. J. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00089 · Cited by 220
GP-VTON: Towards General Purpose Virtual Try-On via Collaborative Local-Flow Global-Parsing Learning
Xiel, Z., Huang, Z., Dong, X., Zhao, F., Dong, H., Zhang, X., Zhu, F., & Liang, X. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02255 · Cited by 220
Roggio, F., Trovato, B., Sortino, M., & Musumeci, G. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e39977 · Cited by 218
Music2Dance: DanceNet for Music-Driven Dance Generation
Zhuang, W., Wang, C., Chai, J., Wang, Y., Shao, M., & Xia, S. (2022) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3485664 · Cited by 216
Multi-channel Transformers for Multi-articulatory Sign Language Translation
Camgöz, N. C., Koller, O., Hadfield, S., & Bowden, R. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-66823-5_18 · Cited by 215
DeepCap: Monocular Human Performance Capture Using Weak Supervision
Habermann, M., Xu, W., Zollhofer, M., Pons-Moll, G., & Theobalt, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00510 · Cited by 214
Learning Hierarchical Cross-Modal Association for Co-Speech Gesture Generation
Liu, X., Wu, Q., Zhou, H., Xu, Y., Qian, R., Lin, X., Zhou, X., Wu, W., Dai, B., & Zhou, B. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01021 · Cited by 214
FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and Integration
Rong, Y., Shiratori, T., & Joo, H. (2021) · 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw54120.2021.00201 · Cited by 213
EHPE: Skeleton Cues-Based Gaussian Coordinate Encoding for Efficient Human Pose Estimation
Liu, H., Liu, T., Chen, Y., Zhang, Z., & Li, Y.-F. (2024) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3197364 · Cited by 213
One-Stage 3D Whole-Body Mesh Recovery with Component Aware Transformer
Jing, L., Zeng, A., Wang, H., Zhang, L., & Li, Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02027 · Cited by 213
Dash, A., Ye, J., & Wang, G. (2024) · IEEE Access · doi:10.1109/access.2023.3346273 · Cited by 211
Predicting Pedestrian Crossing Intention With Feature Fusion and Spatio-Temporal Attention
Yang, D., Zhang, H., Yurtsever, E., Redmill, K. A., & Ozguner, U. (2022) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2022.3162719 · Cited by 210
DexPilot: Vision-Based Teleoperation of Dexterous Robotic Hand-Arm System
Handa, A., Van Wyk, K., Yang, W., Liang, J., Chao, Y.-W., Wan, Q., Birchfield, S., Ratliff, N., & Fox, D. (2020) · 2020 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra40945.2020.9197124 · Cited by 209
C 2 SLR: Consistency-enhanced Continuous Sign Language Recognition
Zuo, R., & Mak, B. K.-W. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00507 · Cited by 209
Ultra Fast Deep Lane Detection With Hybrid Anchor Driven Ordinal Classification
Qin, Z., Zhang, P., & Li, X. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3182097 · Cited by 206
AI and 6G Into the Metaverse: Fundamentals, Challenges and Future Research Trends
Zawish, M., Dharejo, F. A., Khowaja, S. A., Raza, S., Davy, S., Dev, K., & Bellavista, P. (2024) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2024.3349465 · Cited by 203
Foley Music: Learning to Generate Music from Videos
Gan, C., Huang, D. Y., Chen, P., Tenenbaum, J. B., & Torralba, A. B. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58621-8_44 · Cited by 203
Guo, T., Liu, H., Chen, Z., Liu, M., Wang, T., & Ding, R. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i1.19957 · Cited by 202
“Due to the development of depth sensors (Zhang 2012) and the human pose estimation algorithms (Cao et al. 2019; Fang et al. 2017), skeleton-based action recognition has gradually become a significant branch of action recognition.”
BackgroundMultiview Detection with Feature Perspective Transformation
Hou, Y., Zheng, L., & Gould, S. J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58571-6_1 · Cited by 199
PYSKL: Towards Good Practices for Skeleton Action Recognition
Duan, H., Wang, J., Chen, K., & Lin, D. (2022) · Proceedings of the 30th ACM International Conference on Multimedia · doi:10.1145/3503161.3548546 · Cited by 198
Metadata
- Authors
- Cao, Z., Hidalgo, G., Simon, T., Wei, S.-E., & Sheikh, Y.
- Affiliations
- University of California, Berkeley (US)
- Carnegie Mellon University (US)
- Meta (United States) (US)
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2021-01-01
- Volume
- 43
- Issue
- 1
- Pages
- 172-186
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W2962730651
- Cited by
- 5,536
- References
- 77
- Citations by year
- 2026: 608 · 2025: 777 · 2024: 752 · 2023: 882 · 2022: 918 · 2021: 965
- FWCI
- 280.23
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Intelligence Advanced Research Projects Activity
- Department of Interior / Interior Business Center (D17PC00340)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Keywords
- part affinity fields, real-time pose detection, bottom-up pose estimation, hand keypoint detection, facial keypoint detection, inference latency reduction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.