Body Parts Dependent Joint Regressors for Human Pose Estimation in Still Images
Open accessThe DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
Abstract
In this work, we address the problem of estimating 2d human pose from still images. Articulated body pose estimation is challenging due to the large variation in body poses and appearances of the different body parts. Recent methods that rely on the pictorial structure framework have shown to be very successful in solving this task. They model the body part appearances using discriminatively trained, independent part templates and the spatial relations of the body parts using a tree model. Within such a framework, we address the problem of obtaining better part templates which are able to handle a very high variation in appearance. To this end, we introduce parts dependent body joint regressors which are random forests that operate over two layers. While the first layer acts as an independent body part classifier, the second layer takes the estimated class distributions of the first one into account and is thereby able to predict joint locations by modeling the interdependence and co-occurrence of the parts. This helps to overcome typical ambiguities of tree structures, such as self-similarities of legs and arms. In addition, we introduce a novel data set termed FashionPose that contains over 7,000 images with a challenging variation of body part appearances due to a large variation of dressing styles. In the experiments, we demonstrate that the proposed parts dependent joint regressors outperform independent classifiers or regressors. The method also performs better or similar to the state-of-the-art in terms of accuracy, while running with a couple of frames per second.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Object Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853
Real-time human pose recognition in parts from single depth images
Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., & Blake, A. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995316 · Cited by 3,491
Pictorial Structures for Object Recognition
Felzenszwalb, P. F., & Huttenlocher, D. P. (2005) · International Journal of Computer Vision · doi:10.1023/b:visi.0000042934.15159.49 · Cited by 2,180
Statistical Color Models with Application to Skin Detection
Jones, M. J., & Rehg, J. M. (2002) · International Journal of Computer Vision · doi:10.1023/a:1013200319198 · Cited by 1,542
The Representation and Matching of Pictorial Structures
Fischler, M. A., & Elschlager, R. A. (1973) · IEEE Transactions on Computers · doi:10.1109/t-c.1973.223602 · Cited by 1,322
Semantic texton forests for image categorization and segmentation
Shotton, J., Johnson, M., & Cipolla, R. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587503 · Cited by 1,014
Articulated pose estimation with flexible mixtures-of-parts
Yang, Y., & Ramanan, D. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995741 · Cited by 990
Robust Object Detection with Interleaved Categorization and Segmentation
Leibe, B., Leonardis, A., & Schiele, B. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0095-3 · Cited by 933
Articulated Human Detection with Flexible Mixtures of Parts
Yang, Y., & Ramanan, D. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.261 · Cited by 852
Clustered Pose and Nonlinear Appearance Models for Human Pose Estimation
Johnson, S., & Everingham, M. (2010) · Procedings of the British Machine Vision Conference 2010 · doi:10.5244/c.24.12 · Cited by 819
Pictorial structures revisited: People detection and articulated pose estimation
Andriluka, M., Roth, S., & Schiele, B. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206754 · Cited by 799
Progressive search space reduction for human pose estimation
Ferrari, V., Marin-Jimenez, M., & Zisserman, A. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587468 · Cited by 612
Decision Forests for Computer Vision and Medical Image Analysis
(2013) · Advances in Computer Vision and Pattern Recognition · doi:10.1007/978-1-4471-4929-3 · Cited by 595
Hough Forests for Object Detection, Tracking, and Action Recognition
Gall, J., Yao, A., Razavi, N., Van Gool, L., & Lempitsky, V. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.70 · Cited by 583
Self-citationEfficient Human Pose Estimation from Single Depth Images
Shotton, J., Girshick, R., Fitzgibbon, A., Sharp, T., Cook, M., Finocchio, M., Moore, R., Kohli, P., Criminisi, A., Kipman, A., et al. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.241 · Cited by 576
Random Forests for Real Time 3D Face Analysis
Fanelli, G., Dantone, M., Gall, J., Fossati, A., & Van Gool, L. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-012-0549-0 · Cited by 566
Self-citationParsing clothing in fashion photographs
Yamaguchi, K., Kiapour, M. H., Ortiz, L. E., & Berg, T. L. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248101 · Cited by 464
Learning to parse images of articulated bodies
Ramanan, D. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0146 · Cited by 414
Learning effective human pose estimation from inaccurate annotation
Johnson, S., & Everingham, M. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995318 · Cited by 411
Poselet Conditioned Pictorial Structures
Pishchulin, L., Andriluka, M., Gehler, P., & Schiele, B. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.82 · Cited by 370
Real-time facial feature detection using conditional regression forests
Dantone, M., Gall, J., Fanelli, G., & Van Gool, L. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247976 · Cited by 368
Self-citationDetecting People Using Mutually Consistent Poselet Activations
Bourdev, L., Maji, S., Brox, T., & Malik, J. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15567-3_13 · Cited by 367
Efficient regression of general-activity human poses from depth images
Girshick, R., Shotton, J., Kohli, P., Criminisi, A., & Fitzgibbon, A. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126270 · Cited by 344
Robust and Accurate Shape Model Fitting Using Random Forest Regression Voting
Cootes, T. F., Ionita, M. C., Lindner, C., & Sauer, P. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33786-4_21 · Cited by 297
Human Pose Estimation Using Body Parts Dependent Joint Regressors
Dantone, M., Gall, J., Leistner, C., & Van Gool, L. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.391 · Cited by 287
Self-citationHand Pose Estimation and Hand Shape Classification Using Multi-layered Randomized Decision Forests
Keskin, C., Kıraç, F., Kara, Y. E., & Akarun, L. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33783-3_61 · Cited by 284
Twin Gaussian Processes for Structured Prediction
Bo, L., & Sminchisescu, C. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-008-0204-y · Cited by 250
2D Articulated Human Pose Estimation and Retrieval in (Almost) Unconstrained Still Images
Eichner, M., Marin-Jimenez, M., Zisserman, A., & Ferrari, V. (2012) · International Journal of Computer Vision · doi:10.1007/s11263-012-0524-9 · Cited by 233
Articulated people detection and pose estimation: Reshaping the future
Pishchulin, L., Jain, A., Andriluka, M., Thormahlen, T., & Schiele, B. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248052 · Cited by 232
Measure Locally, Reason Globally: Occlusion-sensitive Articulated Pose Estimation
Sigal, L., & Black, M. J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.180 · Cited by 221
Real-Time Articulated Hand Pose Estimation Using Semi-supervised Transductive Regression Forests
Tang, D., Yu, T.-H., & Kim, T.-K. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.400 · Cited by 219
Learning to Parse Pictures of People
Ronfard, R., Schmid, C., & Triggs, B. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-47979-1_47 · Cited by 211
Strong Appearance and Expressive Spatial Models for Human Pose Estimation
Pishchulin, L., Andriluka, M., Gehler, P., & Schiele, B. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.433 · Cited by 204
Joint induction of shape features and tree classifiers
Amit, Y., Geman, D., & Wilder, K. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.632990 · Cited by 198
Recovering human body configurations using pairwise constraints between parts
Ren, X., Berg, A. C., & Malik, J. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.204 · Cited by 197
Articulated part-based model for joint object detection and pose estimation
Sun, M., & Savarese, S. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126309 · Cited by 195
Do We Need More Training Data or Better Models for Object Detection?
Zhu, X., Vondrick, C., Ramanan, D., & Fowlkes, C. (2012) · Procedings of the British Machine Vision Conference 2012 · doi:10.5244/c.26.80 · Cited by 178 · cited 1×
“Index Terms—Human pose estimation, fashion, random forest, regression, classification F”
Randomized trees for human pose detection
Rogez, G., Rihan, J., Ramalingam, S., Orrite, C., & Torr, P. H. S. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587617 · Cited by 173
Visual Analysis of Humans: Looking at People
(2011) · Springer eBooks · doi:10.1007/978-0-85729-997-0 · Cited by 163
Multiple Tree Models for Occlusion and Spatial Constraints in Human Pose Estimation
Wang, Y., & Mori, G. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-88690-7_53 · Cited by 160
3D Pictorial Structures for Multiple View Articulated Pose Estimation
Burenius, M., Sullivan, J., & Carlsson, S. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.464 · Cited by 158
Beyond Physical Connections: Tree Models in Human Pose Estimation
Wang, F., & Li, Y. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.83 · Cited by 151
Appearance Sharing for Collective Human Pose Estimation
Eichner, M. L., & Ferrari, V. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-37331-2_11 · Cited by 148
Learning hierarchical poselets for human parsing
Wang, Y., Tran, D., & Liao, Z. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995519 · Cited by 146
A Study of Parts-Based Object Class Detection Using Complete Graphs
Bergtholdt, M., Kappes, J. H., Schmidt, S., & Schnörr, C. (2009) · International Journal of Computer Vision · doi:10.1007/s11263-009-0209-1 · Cited by 142
Exploring the Spatial Hierarchy of Mixture Models for Human Pose Estimation
Tian, Y., Zitnick, C. L., & Narasimhan, S. G. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33715-4_19 · Cited by 137
Markerless Motion Capture of Multiple Characters Using Multiview Image Segmentation
Liu, Y., Gall, J., Stoll, C., Dai, Q., Seidel, H.-P., & Theobalt, C. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.47 · Cited by 135
Self-citationAdaptive pose priors for pictorial structures
Sapp, B., Jordan, C., & Taskar, B. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5540182 · Cited by 134
Joint Classification-Regression Forests for Spatially Structured Multi-object Segmentation
Glocker, B., Pauly, O., Konukoğlu, E., & Criminisi, A. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33765-9_62 · Cited by 101
Improved Human Parsing with a Full Relational Model
Tran, D., & Forsyth, D. A. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15561-1_17 · Cited by 96
Articulated Pose Estimation Using Discriminative Armlet Classifiers
Gkioxari, G., Arbelaez, P., Bourdev, L., & Malik, J. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.429 · Cited by 91
Fast globally optimal 2D human detection with loopy graph models
Tian, T.-P., & Sclaroff, S. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5540227 · Cited by 86
From Pictorial Structures to deformable structures
Zuffi, S., Freifeld, O., & Black, M. J. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6248098 · Cited by 71
Discriminative Appearance Models for Pictorial Structures
Andriluka, M., Roth, S., & Schiele, B. (2011) · International Journal of Computer Vision · doi:10.1007/s11263-011-0498-z · Cited by 69
Efficient Inference with Multiple Heterogeneous Part Detectors for Human Pose Estimation
Singh, V. K., Nevatia, R., & Huang, C. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15558-1_23 · Cited by 48
Latent Hough Transform for Object Detection
Razavi, N., Gall, J., Kohli, P., & Gool, L. V. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33712-3_23 · Cited by 43
Self-citationA Non-parametric Bayesian Network Prior of Human Pose
Lehrmann, A., Gehler, P., & Nowozin, S. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.162 · Cited by 42
Putting the pieces together: Connected Poselets for human pose estimation
Holt, B., Ong, E.-J., Cooper, H., & Bowden, R. (2011) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2011.6130386 · Cited by 41
An efficient branch-and-bound algorithm for optimal human pose estimation
Sun, M., Telaprolu, M., Lee, H., & Savarese, S. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247854 · Cited by 40
Fast Pedestrian Detection by Cascaded Random Forest with Dominant Orientation Templates
Tang, D., Liu, Y., & Kim, T. (2012) · British Machine Vision Conference (BMVC) · doi:10.5244/c.26.58 · Cited by 39
Fast Human Pose Detection Using Randomized Hierarchical Cascades of Rejectors
Rogez, G., Rihan, J., Orrite-Uruñuela, C., & Torr, P. H. S. (2012) · International Journal of Computer Vision · doi:10.1007/s11263-012-0516-9 · Cited by 29
Human pose estimation with implicit shape models
Müller, J., & Arens, M. (2010) · doi:10.1145/1877868.1877873 · Cited by 27
Sangineto, E., Cristani, M., Bue, A. D., & Murino, V. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33709-3_20 · Cited by 6
Learning Visual Symbols for Parsing Human Poses in ImagesPreprint
Wang, F., & Li, Y. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1304.6291 · Cited by 4
Cited by
MS-TCN: Multi-Stage Temporal Convolutional Network for Action Segmentation
Farha, Y. A., & Gall, J. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00369 · Cited by 673
“Stacking several predictors sequentially has shown significant improvements in many tasks like human pose estimation [44], [45], [46].”
BackgroundSelf-citationUnite the People: Closing the Loop Between 3D and 2D Human Representations
Lassner, C., Romero, J., Kiefel, M., Bogo, F., Black, M. J., & Gehler, P. V. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.500 · Cited by 541
Neural Body Fitting: Unifying Deep Learning and Model Based Human Pose and Shape Estimation
Omran, M., Lassner, C., Pons-Moll, G., Gehler, P., & Schiele, B. (2018) · 2018 International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2018.00062 · Cited by 498
ClothCap: seamless 4D clothing capture and retargeting
Pons-Moll, G., Pujades, S., Hu, S., & Black, M. J. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073711 · Cited by 495
MS-TCN++: Multi-Stage Temporal Convolutional Network for Action Segmentation
Li, S., Farha, Y. A., Liu, Y., Cheng, M.-M., & Gall, J. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3021756 · Cited by 349
“Stacking several predictors sequentially has shown significant improvements in many tasks like human pose estimation [44], [45], [46].”
BackgroundSelf-citation
Metadata
- Authors
- Dantone, M., Gall, J., Leistner, C., & Van Gool, L.
- Affiliations
- ETH Zurich (CH)
- Microsoft (United States) (US)
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2014-11-01
- Volume
- 36
- Issue
- 11
- Pages
- 2131-2143
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2023866509
- Cited by
- 73
- References
- 66
- Citations by year
- 2025: 2 · 2024: 2 · 2023: 6 · 2022: 2 · 2021: 4 · 2020: 8 · 2019: 7 · 2018: 6 · 2017: 15 · 2016: 11 · 2015: 8
- FWCI
- 10.09
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- Lirias (submittedVersion)
- Repository for Publications and Research Data (ETH Zurich) (submittedVersion, other-oa)
- ETH Zürich Research Collection
- Funders
- RADHAR (FP7-ICT-248873)
- TANGO (FP7-ICT-249858)
- CTI (12618.1 PFES-ES)
- DFG Emmy Noether (GA 1927/1-1)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- 2D human pose estimation, random forest, pictorial structure model
- MeSH terms
- Algorithms, Humans, Image Processing, Computer-Assisted, Joints, Posture, Databases, Factual
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.