OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields
Open accessThe DOI matches its Crossref record, with a small difference in title or year; 78 of the 78 references it cites were found in a registry or an index.
Abstract
Realtime multi-person 2D pose estimation is a key component in enabling machines to have an understanding of people in images and videos. In this work, we present a realtime approach to detect the 2D pose of multiple people in an image. The proposed method uses a nonparametric representation, which we refer to as Part Affinity Fields (PAFs), to learn to associate body parts with individuals in the image. This bottom-up system achieves high accuracy and realtime performance, regardless of the number of people in the image. In previous work, PAFs and body part location estimation were refined simultaneously across training stages. We demonstrate that a PAF-only refinement rather than both PAF and body part location refinement results in a substantial increase in both runtime performance and accuracy. We also present the first combined body and foot keypoint detector, based on an internal annotated foot dataset that we have publicly released. We show that the combined detector not only reduces the inference time compared to running them sequentially, but also maintains the accuracy of each component individually. This work has culminated in the release of OpenPose, the first open-source realtime system for multi-person 2D pose detection, including body, foot, hand, and facial keypoints.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“OpenPose can detect people in a frame and generate a skeleton of body parts for each person detected.”
From Opportunity++: A Multimodal Dataset for Video- and Wearable, Object and Ambient Sensors-Based Human Activity Recognition (2021) · cites this paper as Cao et al. (2021)
The cited source says what the claim attributes to it.
In the citing paper
“However, in order to make the videos interesting for researchers, we also provide the pose tracking of all the people in the scene generated with OpenPose (Cao et al. (2021)).”
From Opportunity++: A Multimodal Dataset for Video- and Wearable, Object and Ambient Sensors-Based Human Activity Recognition (2021) · cites this paper as Cao et al. (2021)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
(2016) · Cited by 31,590
An Algorithm for Least-Squares Estimation of Nonlinear Parameters
Marquardt, D. W. (1963) · Journal of the Society for Industrial and Applied Mathematics · doi:10.1137/0111030 · Cited by 30,728
He, K., Gkioxari, G., Dollar, P., & Girshick, R. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.322 · Cited by 29,137
SSD: Single Shot MultiBox Detector
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., & Berg, A. C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_2 · Cited by 22,128 · cited 3×
“If we use the state-of-the-art object detector, Single Shot MultiBox Detector (SSD) [74], the performance drops 10%.”
BackgroundMethod
Research works printed but not linked: 1
- [5] K. He, G. Gkioxari, P. Doll´ ar, and R. Girshick, 'Mask r-cnn,' in ICCV , 2017. -
Cited by
Items 901–1,000 of 1,017
Human Keypoint Detection for Close Proximity Human-Robot Interaction
Docekal, J., Rozlivek, J., Matas, J., & Hoffmann, M. (2022) · IEEE-RAS International Conference on Humanoid Robots (Humanoids) · doi:10.1109/humanoids53995.2022.10000133 · Cited by 38
Physics-based Motion Retargeting from Sparse Inputs
Reda, D., Won, J., Ye, Y., van de Panne, M., & Winkler, A. (2023) · Proceedings of the ACM on Computer Graphics and Interactive Techniques · doi:10.1145/3606928 · Cited by 39
Visual–Motion–Interaction-Guided Pedestrian Intention Prediction Framework
Sharma, N., Dhiman, C., & Indu, S. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3317426 · Cited by 38
FOF: Learning Fourier Occupancy Field for Monocular Real-Time Human Reconstruction
Feng, Q., Liu, Y., Li, K., Yang, J., & Li, K. (2022) · neural information processing systems · doi:10.52202/068431-0537 · Cited by 38
Gesture Recognition in RGB Videos Using Human Body Keypoints and Dynamic Time Warping
Schneider, P., Memmesheimer, R., Kramer, I., & Paulus, D. W. R. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-35699-6_22 · Cited by 38
Linking Art through Human Poses
Jenícek, T., & Chum, O. (2019) · IAPR International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2019.00216 · Cited by 38
A Novel Spatial-Temporal Graph for Skeleton-based Driver Action Recognition
Li, P., Lu, M., Zhang, Z., Shan, D., & Yang, Y. (2019) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2019.8916929 · Cited by 38
Recognizing Exercises and Counting Repetitions in Real TimePreprint
Alatiah, T., & Chen, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.03194 · Cited by 38
Reconstructing Signing Avatars from Video Using Linguistic Priors
Forte, M., Kulits, P., Huang, C., Choutas, V., Tzionas, D., Kuchenbecker, K. J., & Black, M. J. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01230 · Cited by 37
Exercise quantification from single camera view markerless 3D pose estimation
Mercadal-Baudart, C., Liu, C.-J., Farrell, G., Boyne, M., Escribano, J. G., Smolić, A., & Simms, C. K. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e27596 · Cited by 37
Sign Language Translation Across Multiple Languages
Antad, S. M., Chakrabarty, S., Bhat, S., Bisen, S., & Jain, S. (2024) · International Conference on Emerging Systems and Intelligent Computing (ESIC) · doi:10.1109/esic60604.2024.10481626 · Cited by 38
GaitPT: Skeletons are All You Need for Gait Recognition
Cǎtrunǎ, A., Cosma, A., & Rǎdoi, E. (2024) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg59268.2024.10581947 · Cited by 37
GALA: Generating Animatable Layered Assets from a Single Scan
Kim, T., Kim, B., Saito, S., & Joo, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00152 · Cited by 37
Imam, M., Bäına, K., Tabii, Y., Ressami, E. M., Adlaoui, Y., Boufousse, S., Benzakour, I., & Abdelwahed, E. H. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.129080 · Cited by 37
Group Level Audio-Video Emotion Recognition Using Hybrid Networks
Liu, C., Jiang, W., Wang, M., & Tang, T. (2020) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3382507.3417968 · Cited by 37
Schepper, D. D., Moyaers, B., Schouterden, G., Kellens, K., & Demeester, E. (2021) · Procedia CIRP · doi:10.1016/j.procir.2020.05.245 · Cited by 37
Zahiri, M., Wang, C., Gardea‐Resendez, M., Nguyen, H., Shahbazi, M., Sharafkhaneh, A., Ruiz, I. P. T., Nguyen, C. K., Bryant, M., & Najafi, B. (2020) · IEEE Access · doi:10.1109/access.2020.3042451 · Cited by 37
Human interaction recognition framework based on interacting body part attention
Lee, D.-G., & Lee, S. (2022) · Pattern Recognition · doi:10.1016/j.patcog.2022.108645 · Cited by 37
MUMBAI: multi-person, multimodal board game affect and interaction analysis dataset
Doyran, M., Schimmel, A., Baki, P., Ergin, K., Türkmen, B., Salah, A. A. A., Bakkes, S. C. J., Kaya, H., Poppe, R. W., & Salah, A. A. (2021) · Journal on Multimodal User Interfaces · doi:10.1007/s12193-021-00364-0 · Cited by 37
Near-Realtime Face Mask Wearing Recognition Based on Deep Learning
Lin, H., Tse, R. T., Tang, S.-K., Chen, Y., Ke, W., & Pau, G. (2021) · IEEE Consumer Communications and Networking Conference · doi:10.1109/ccnc49032.2021.9369493 · Cited by 37
Automated Tackle Injury Risk Assessment in Contact-Based Sports - A Rugby Union Example
Martin, Z., Hendricks, S., & Patel, A. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00517 · Cited by 37
Antoniadis, P., Pikoulis, I., Filntisis, P. P., & Maragos, P. A. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00407 · Cited by 37
Human Pose and Shape Estimation From Single Polarization Images
Zou, S., Zuo, X., Wang, S., Qian, Y., Guo, C., & Cheng, L. (2022) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3162469 · Cited by 37
Towards Automatic Speech to Sign Language Generation
Kapoor, P., Mukhopadhyay, R., Hegde, S. B., Namboodiri, V. P., & Jawahar, C. V. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1094 · Cited by 37
Unsupervised 3D Pose Estimation for Hierarchical Dance Video Recognition
Hu, X., & Ahuja, N. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01083 · Cited by 37
A Computational Look at Oral History Archives
Pessanha, F., & Salah, A. A. A. (2021) · Journal on Computing and Cultural Heritage · doi:10.1145/3477605 · Cited by 38
Anet: A Deep Neural Network for Automatic 3D Anthropometric Measurement Extraction
Kaashki, N. N., Hu, P., & Munteanu, A. (2021) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3132487 · Cited by 37
Milardo, S., Rathore, P., Amorim, M., Fugiglando, U., Santi, P., & Ratti, C. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3130438 · Cited by 38
Human Performance Capture from Monocular Video in the Wild
Guo, C., Chen, X., Song, J., & Hilliges, O. (2021) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv53792.2021.00097 · Cited by 37
Multi-Person Pose Estimation With Accurate Heatmap Regression and Greedy Association
Li, J., & Wang, M. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3153044 · Cited by 37
Evaluation of Various State of the Art Head Pose Estimation Algorithms for Clinical Scenarios
Hammadi, Y., Grondin, F., Ferland, F., & Lebel, K. (2022) · Sensors · doi:10.3390/s22186850 · Cited by 37
Amprimo, G., Masi, G., Priano, L., Azzaro, C., Galli, F., Pettiti, G., Mauro, A., & Ferraris, C. (2022) · Sensors · doi:10.3390/s22218173 · Cited by 37
Desai, M. M., & Mewada, H. K. (2023) · PeerJ Computer Science · doi:10.7717/peerj-cs.1152 · Cited by 37
EgoFish3D: Egocentric 3D Pose Estimation From a Fisheye Camera via Self-Supervised Learning
Liu, Y., Yang, J., Gu, X., Chen, Y., Guo, Y., & Yang, G. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3242551 · Cited by 37
UIESC: An Underwater Image Enhancement Framework via Self-Attention and Contrastive Learning
Chen, R., Cai, Z., & Yuan, J. (2023) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2023.3249794 · Cited by 37
Liu, S., Mangla, T., Shaowang, T., Zhao, J., Paparrizos, J., Krishnan, S., & Feamster, N. (2023) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3580818 · Cited by 37
TPMv2: An end-to-end tomato pose method based on 3D key points detection
Zhang, F., Gao, J., Song, C., Zhou, H., Zou, K., Xie, J., Yuan, T., & Zhang, J. (2023) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2023.107878 · Cited by 37
Pedestrian Crossing Action Recognition and Trajectory Prediction with 3D Human Keypoints
Li, J., Shi, X., Chen, F., Stroud, J., Zhang, Z., Lan, T., Mao, J., Kang, J., Refaat, K. S., Yang, W., et al. (2023) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48891.2023.10160273 · Cited by 37
Facial Prior Guided Micro-Expression Generation
Zhang, Y., Xu, X., Zhao, Y., Wen, Y., Tang, Z., & Liu, M. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3345177 · Cited by 37
Using New AI-Driven Techniques to Ease Serious Games Authoring
Pérez-Colado, I. J., Pérez-Colado, V. M., Calvo-Morata, A., Píriz, R. S. C., & Fernández‐Manjón, B. (2023) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie58773.2023.10343021 · Cited by 37
Physics-Augmented Autoencoder for 3D Skeleton-Based Gait Recognition
Guo, H., & Ji, Q. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01798 · Cited by 37
GAZED– Gaze-guided Cinematic Editing of Wide-Angle Monocular Video Recordings
Moorthy, K. L. B., Kumar, M., Subramanian, R., & Gandhi, V. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376544 · Cited by 37
CatV2TON: Taming Diffusion Transformers for Vision-Based Virtual Try-On with Temporal ConcatenationPreprint
Zheng, C., Zhang, W., Zhang, S., Zheng, J., Dong, X. M., Li, H., Wu, Y., Jiang, D., & Liang, X. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2501.11325 · Cited by 37
MCIP: Multi-Stream Network for Pedestrian Crossing Intention Prediction
Ham, J.-S., Bae, K., & Moon, J. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-25056-9_42 · Cited by 36
Automated Analysis of Stereotypical Movements in Videos of Children With Autism Spectrum Disorder
Barami, T., Manelis, L., Kaiser, H., Ilan, M., Slobodkin, A., Hadashi, O., Hadad, D., Waissengreen, D., Nitzan, T., Menashe, I., et al. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.32851 · Cited by 36
Gait Measurement at Home Using A Single RGB Camera
Yagi, K., Sugiura, Y., Hasegawa, K., & Saitô, H. (2019) · Gait & Posture · doi:10.1016/j.gaitpost.2019.10.006 · Cited by 36
Human Activity Recognition with Deep Reinforcement Learning using the Camera of a Mobile Robot
Kumrai, T., Korpela, J., Maekawa, T., Yu, Y., & Kanai, R. (2020) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom45495.2020.9127376 · Cited by 36
Generation of Indian sign language by sentence processing and generative adversarial networks
Vasani, N., Autee, P., Kalyani, S., & Karani, R. B. (2020) · International Conference on Intelligent Sustainable Systems (ICISS) · doi:10.1109/iciss49785.2020.9315979 · Cited by 36
SSN3D: Self-Separated Network to Align Parts for 3D Convolution in Video Person Re-Identification
Jiang, X., Qiao, Y., Yan, J., Li, Q., Zheng, W., & Chen, D. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i2.16262 · Cited by 36
Flow Guided Transformable Bottleneck Networks for Motion Retargeting
Ren, J., Chai, M., Woodford, O. J., Olszewski, K., & Tulyakov, S. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01065 · Cited by 36
Multi-level feature fusion for fruit bearing branch keypoint detection
Sun, Q., Chai, X., Zeng, Z., Zhou, G., & Sun, T. (2021) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2021.106479 · Cited by 38
Progress of Human Action Recognition Research in the Last Ten Years: A Comprehensive Survey
Singh, P. K., Kundu, S., Adhikary, T., Sarkar, R., & Bhattacharjee, D. (2021) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-021-09681-9 · Cited by 37
Proposing Posture Recognition System Combining MobilenetV2 and LSTM for Medical Surveillance
Huu, P. N., Thi, N. N., & Ngoc, T. P. (2021) · IEEE Access · doi:10.1109/access.2021.3138778 · Cited by 36
Pandurević, D., Draga, P., Sutor, A., & Hochradel, K. (2022) · Sensors · doi:10.3390/s22062251 · Cited by 36
A Vision-Based System for In-Sleep Upper-Body and Head Pose Classification
Li, Y., Wang, S.-J., & Hung, Y. (2022) · Sensors · doi:10.3390/s22052014 · Cited by 36
DetPoseNet: Improving Multi-Person Pose Estimation via Coarse-Pose Filtering
Ke, L., Chang, M., Qi, H., & Lyu, S. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3161081 · Cited by 36
Ebbesen, C. L., & Froemke, R. C. (2022) · Nature Communications · doi:10.1038/s41467-022-28153-7 · Cited by 36
Scaling Up Sign Spotting Through Sign Language Dictionaries
Varol, G., Momeni, L., Albanie, S., Afouras, T., & Zisserman, A. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01589-6 · Cited by 36
Promise Into Practice: Application of Computer Vision in Empirical Research on Social Distancing
Bernasco, W., Hoeben, E. M., Koelma, D. C., Liebst, L. S., Thomas, J., Appelman, J., Snoek, C. G. M., & Lindegaard, M. R. (2022) · Sociological Methods & Research · doi:10.1177/00491241221099554 · Cited by 37
HULC: 3D HUman Motion Capture with Pose Manifold SampLing and Dense Contact Guidance
Shimada, S., Golyanik, V., Li, Z., Pérez, P., Xu, W., & Theobalt, C. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-20047-2_30 · Cited by 36
Forecasting Characteristic 3D Poses of Human Actions
Diller, C., Funkhouser, T. A., & Dai, A. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01545 · Cited by 36
Learning Spatial-Preserved Skeleton Representations for Few-Shot Action Recognition
Ma, N., Zhang, H., Li, X., Zhou, S., Zhang, Z., Wen, J., Li, H., Gu, J., & Bu, J. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19772-7_11 · Cited by 36
Multi-speed transformer network for neurodegenerative disease assessment and activity recognition
Cheriet, M., Dentamaro, V., Hamdan, M., Impedovo, D., & Pirlo, G. (2023) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2023.107344 · Cited by 36
Gait Recognition Using 3-D Human Body Shape Inference
Zhu, H., Zheng, Z., & Nevatia, R. (2023) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv56688.2023.00097 · Cited by 37
Prime: Privacy-preserving video anomaly detection via Motion Exemplar guidance
Su, Y. R., Zhu, H., Tan, Y., An, S., & Xing, M. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110872 · Cited by 36
Thiel, S., Bernhardt, J., & Medien, B. D. B. F. K. U. (2023) · Edition Museum · doi:10.1515/9783839467107 · Cited by 36
Computer Vision Based Transfer Learning-Aided Transformer Model for Fall Detection and Prediction
Mccall, S., Kolawole, S. S., Naz, A., Gong, L., Ahmed, S. W., Prasad, P. S., Yu, M., Wingate, J., & Ardakani, S. P. (2024) · IEEE Access · doi:10.1109/access.2024.3368065 · Cited by 36
Comparative analysis of respiratory motion tracking using Microsoft Kinect v2 sensor
Silverstein, E., & Snyder, M. (2018) · Journal of Applied Clinical Medical Physics · doi:10.1002/acm2.12318 · Cited by 36
'Tiny numbers' are actually tiny: Evidence from gestures in the TV News Archive
Woodin, G., Winter, B., Perlman, M., Littlemore, J., & Matlock, T. (2020) · PLoS ONE · doi:10.1371/journal.pone.0242142 · Cited by 36
Multi-Instrumentalist Net: Unsupervised Generation of Music from Body MovementsPreprint
Su, K., Liu, X., & Shlizerman, E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.03478 · Cited by 36
Ciliberto, M., Fortes Rey, V., Calatroni, A., Lukowicz, P., & Roggen, D. (2021) · Frontiers in Computer Science · doi:10.3389/fcomp.2021.792065 · Cited by 35
“This is an important area of research in wearable, mobile and ubiquitous computing Kim et al. (2010); Bulling et al.”
BackgroundInfluentialIntelligent Video Analytics for Human Action Recognition: The State of Knowledge
Kulbacki, M., Segen, J., Chaczko, Z., Rozenblit, J. W., Kulbacki, M., Klempous, R., & Wojciechowski, K. W. (2023) · Sensors · doi:10.3390/s23094258 · Cited by 35
Developing a Multimodal Classroom Engagement Analysis Dashboard for Higher-Education
Sabuncuoğlu, A., & Sezgin, T. M. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3593240 · Cited by 35
TCNet: Continuous Sign Language Recognition from Trajectories and Correlated Regions
Lu, H., Salah, A. A., & Poppe, R. W. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i4.28181 · Cited by 35
Kim, S., Ha, Y., Kim, D., & Yoo, J. (2024) · Journal of Bone Metabolism · doi:10.11005/jbm.2024.31.2.150 · Cited by 35
Comparative Analysis of Markerless Motion Capture Systems for Measuring Human Kinematics
Ceriola, L., Taborri, J., Donati, M., Rossi, S., Patanè, F., & Mileti, I. (2024) · IEEE Sensors Journal · doi:10.1109/jsen.2024.3431873 · Cited by 35
Learning Disentangled Identifiers for Action-Customized Text-to-Image Generation
Huang, S., Gong, B., Feng, Y., Chen, X., Fu, Y., Liu, Y., & Wang, D. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.00745 · Cited by 35
Next-generation fall detection: harnessing human pose estimation and transformer technology
Sykes, E. R. (2024) · Health Systems · doi:10.1080/20476965.2024.2395574 · Cited by 35
UV Gaussians: Joint learning of mesh deformation and Gaussian textures for human avatar modeling
Jiang, Y., Liao, Q., Li, X., Ma, L., Zhang, Q., Zhang, C., Lu, Z., & Shan, Y. (2025) · Knowledge-Based Systems · doi:10.1016/j.knosys.2025.113470 · Cited by 35
CoachAI: A Project for Microscopic Badminton Match Data Collection and Tactical Analysis
Hsu, T.-H., Wang, C.-C., Lin, Y., Chen, C., Jut, N. P., İk, T.-U., Peng, W.-C., Wang, Y.-S., Tseng, Y., Huang, J., et al. (2019) · Asia-Pacific Network Operations and Management Symposium (APNOMS) · doi:10.23919/apnoms.2019.8893039 · Cited by 35
Theagarajan, R., & Bhanu, B. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.2982580 · Cited by 35
Reactive Video: Adaptive Video Playback Based on User Motion for Supporting Physical Activity
Clarke, C., Cavdir, D., Chiu, P., Denoue, L., & Kimber, D. (2020) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3379337.3415591 · Cited by 35
Kovalenko, E., Talitckii, A., Anikina, A., Shcherbak, A., Zimniakova, O., Semenov, M., Витальевна, Б. Е., Dylov, D. V., & Somov, A. (2020) · IEEE Sensors Journal · doi:10.1109/jsen.2020.3035240 · Cited by 35
MSST-RT: Multi-Stream Spatial-Temporal Relative Transformer for Skeleton-Based Action Recognition
Sun, Y., Shen, Y., & Ma, L. (2021) · Sensors · doi:10.3390/s21165339 · Cited by 35
DriPE: A Dataset for Human Pose Estimation in Real-World Driving Settings
Guesdon, R., Crispim-Junior, C. F., & Tougne, L. (2021) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw54120.2021.00321 · Cited by 35
FenceNet: Fine-grained Footwork Recognition in Fencing
Zhu, K. X., Wong, A. K. C., & McPhee, J. (2022) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00403 · Cited by 35
Pose2UV: Single-Shot Multiperson Mesh Recovery With Deep UV Prior
Huang, B., Zhang, T., & Wang, Y. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3187294 · Cited by 35
Kwon, Y.-J., Kim, D., Son, B., Choi, K.-H., Kwak, S., & Kim, T. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19169803 · Cited by 35
Capturing Eating Behavior from Video Analysis: A Systematic Review
Tufano, M., Lasschuijt, M. P., Chauhan, A., Feskens, E. J. M., & Camps, G. (2022) · Nutrients · doi:10.3390/nu14224847 · Cited by 35
Towards Single Camera Human 3D-Kinematics
Bittner, M., Yang, W.-T., Zhang, X., Seth, A., van Gemert, J. V., & van der Helm, F. C. T. (2022) · Italian National Conference on Sensors · doi:10.3390/s23010341 · Cited by 23
Francisco, J. A., & Rodrigues, P. S. (2023) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2022.3226459 · Cited by 32
“Our work uses the Openpose proposed by [5] as an initial method for the methodology proposed here.”
BackgroundMethodInfluentialLifting Monocular Events to 3D Human Poses
Scarpellini, G., Morerio, P., & Del Bue, A. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00150 · Cited by 31
“Next, they predict human-poses with VNect [38] and Openpose [6] models and optimize a multi-step optimization scheme to refine the prediction.”
MethodKwon, H., Abowd, G. D., & Plötz, T. (2021) · Sensors · doi:10.3390/s21248337 · Cited by 30
“Standard multi-person 2D pose detectors often confuse people in a scene with non-human objects that may look like humans, which results in erroneous tracking [52].”
BackgroundTowards data-driven stroke rehabilitation via wearable sensors and deep learning
Kaku, A., Parnandi, A., Venkatesan, A., Pandit, N., Schambra, H., & Fernandez-Granda, C. (2020) · arXiv · doi:10.48550/arxiv.2004.08297 · Cited by 30
Lee, J. H., & You, S. J. (2024) · IEEE Access · doi:10.1109/access.2024.3352146 · Cited by 29
Embodied AI Agents: Modeling the World
Fung, P., Bachrach, Y., Celikyilmaz, A., Chaudhuri, K., Chen, D., Chung, W., Dupoux, E., Gong, H., Jégou, H., Lazaric, A., et al. (2025) · arXiv · doi:10.48550/arxiv.2506.22355 · Cited by 29
Interpersonal synchronization of spontaneously generated body movements
Koul, A., Ahmar, D., Iannetti, G. D., & Novembre, G. (2023) · iScience · doi:10.1016/j.isci.2023.106104 · Cited by 28
Enhancing elderly care: Efficient and reliable real-time fall detection algorithm
Wang, Y., & Deng, T. (2024) · DIGITAL HEALTH · doi:10.1177/20552076241233690 · Cited by 28
Best practices for sign language technology research
Fox, N., Woll, B., & Cormier, K. (2025) · Universal Access in the Information Society · doi:10.1007/s10209-023-01039-1 · Cited by 27
“It is also important to consider the extraction of data for computational processing, most commonly pose keypoints [19, 99].”
Interpretable video-based tracking and quantification of Parkinsonism clinical motor states
Deng, D., Ostrem, J. L., Nguyen, V., Cummins, D. D., Sun, J., Pathak, A., Little, S., & Abbasi-Asl, R. (2024) · npj Parkinson's Disease · doi:10.1038/s41531-024-00742-x · Cited by 25
Metadata
- Authors
- Cao, Z., Hidalgo, G., Simon, T., Wei, S.-E., & Sheikh, Y.
- Affiliations
- University of California, Berkeley (US)
- Carnegie Mellon University (US)
- Meta (United States) (US)
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2021-01-01
- Volume
- 43
- Issue
- 1
- Pages
- 172-186
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W2962730651
- Cited by
- 5,536
- References
- 77
- Citations by year
- 2026: 608 · 2025: 777 · 2024: 752 · 2023: 882 · 2022: 918 · 2021: 965
- FWCI
- 280.23
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Intelligence Advanced Research Projects Activity
- Department of Interior / Interior Business Center (D17PC00340)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Keywords
- part affinity fields, real-time pose detection, bottom-up pose estimation, hand keypoint detection, facial keypoint detection, inference latency reduction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.