The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Articulated Human Detection with Flexible Mixtures of Parts
Open accessAbstract
We describe a method for articulated human detection and human pose estimation in static images based on a new representation of deformable part models. Rather than modeling articulation using a family of warped (rotated and foreshortened) templates, we use a mixture of small, nonoriented parts. We describe a general, flexible mixture model that jointly captures spatial relations between part locations and co-occurrence relations between part mixtures, augmenting standard pictorial structure models that encode just spatial relations. Our models have several notable properties: 1) They efficiently model articulation by sharing computation across similar warps, 2) they efficiently model an exponentially large set of global mixtures through composition of local mixtures, and 3) they capture the dependency of global geometry on local appearance (parts look different at different locations). When relations are tree structured, our models can be efficiently optimized with dynamic programming. We learn all parameters, including local appearances, spatial relations, and co-occurrence relations (which encode local rigidity) with a structured SVM solver. Because our model is efficient enough to be used as a detector that searches over scales and image locations, we introduce novel criteria for evaluating pose estimation and human detection, both separately and jointly. We show that currently used evaluation criteria may conflate these two issues. Most previous approaches model limbs with rigid and articulated templates that are trained independently of each other, while we present an extensive diagnostic evaluation that suggests that flexible structure and joint training are crucial for strong performance. We present experimental results on standard benchmarks that suggest our approach is the state-of-the-art system for pose estimation, improving past work on the challenging Parse and Buffy datasets while being orders of magnitude faster.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
Object Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853
Self-citationPictorial Structures for Object Recognition
Felzenszwalb, P. F., & Huttenlocher, D. P. (2005) · International Journal of Computer Vision · doi:10.1023/b:visi.0000042934.15159.49 · Cited by 2,180
The Representation and Matching of Pictorial Structures
Fischler, M. A., & Elschlager, R. A. (1973) · IEEE Transactions on Computers · doi:10.1109/t-c.1973.223602 · Cited by 1,322
Support vector machine learning for interdependent and structured output spaces
Tsochantaridis, I., Hofmann, T., Joachims, T., & Altun, Y. (2004) · Twenty-first international conference on Machine learning - ICML '04 · doi:10.1145/1015330.1015341 · Cited by 1,243
Yuille, A. L., & Rangarajan, A. (2003) · Neural Computation · doi:10.1162/08997660360581958 · Cited by 1,151
Articulated pose estimation with flexible mixtures-of-parts
Yang, Y., & Ramanan, D. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995741 · Cited by 990
Self-citationPoselets: Body part detectors trained using 3D human pose annotations
Bourdev, L., & Malik, J. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459303 · Cited by 961
Cascade object detection with deformable part models
Felzenszwalb, P. F., Girshick, R. B., & McAllester, D. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539906 · Cited by 913
Clustered Pose and Nonlinear Appearance Models for Human Pose Estimation
Johnson, S., & Everingham, M. (2010) · Procedings of the British Machine Vision Conference 2010 · doi:10.5244/c.24.12 · Cited by 819
Pictorial structures revisited: People detection and articulated pose estimation
Andriluka, M., Roth, S., & Schiele, B. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206754 · Cited by 799
Progressive search space reduction for human pose estimation
Ferrari, V., Marin-Jimenez, M., & Zisserman, A. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587468 · Cited by 612
Recovering human body con .gurations:combining segmentation and recognition
Mori, G., Ren, X., Efros, A. A., & Malik, J. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315182 · Cited by 507
Model-based vision: a program to see a walking person
Hogg, D. (1983) · Image and Vision Computing · doi:10.1016/0262-8856(83)90003-3 · Cited by 467
Model-based image analysis of human motion using constraint propagation
O'Rourke, J., & Badler, N. I. (1980) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1980.6447699 · Cited by 432
Learning to parse images of articulated bodies
Ramanan, D. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0146 · Cited by 414
Self-citationLearning effective human pose estimation from inaccurate annotation
Johnson, S., & Everingham, M. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995318 · Cited by 411
Towards Model-Based Recognition of Human Movements in Image Sequences
Rohr, K. (1994) · CVGIP: Image Understanding · doi:10.1006/ciun.1994.1006 · Cited by 384
Estimating Human Body Configurations Using Shape Context Matching
Mori, G., & Malik, J. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-47977-5_44 · Cited by 353
LIBLINEAR: A Library for Large Linear Classification
FanRong-En, ChangKai-Wei, HsiehCho-Jui, WangXiang-Rui, & LinChih-Jen (2008) · Journal of Machine Learning Research · doi:10.5555/1390681.1442794 · Cited by 328
2D Articulated Human Pose Estimation and Retrieval in (Almost) Unconstrained Still Images
Eichner, M., Marin-Jimenez, M., Zisserman, A., & Ferrari, V. (2012) · International Journal of Computer Vision · doi:10.1007/s11263-012-0524-9 · Cited by 233
Cascaded Models for Articulated Pose Estimation
Sapp, B., Toshev, A., & Taskar, B. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15552-9_30 · Cited by 222
Measure Locally, Reason Globally: Occlusion-sensitive Articulated Pose Estimation
Sigal, L., & Black, M. J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.180 · Cited by 221
Better appearance models for pictorial structures
Eichner, M., & Ferrari, V. (2009) · Procedings of the British Machine Vision Conference 2009 · doi:10.5244/c.23.3 · Cited by 219
Probabilistic Methods for Finding People
Ioffe, S., & Forsyth, D. A. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011179004708 · Cited by 203
Recognizing human actions from still images with latent poses
Yang, W., Wang, Y., & Mori, G. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539879 · Cited by 201
Articulated part-based model for joint object detection and pose estimation
Sun, M., & Savarese, S. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126309 · Cited by 195
Recognizing and Tracking Human Action
Sullivan, J., & Carlsson, S. (2002) · Lecture notes in computer science · doi:10.1007/3-540-47969-4_42 · Cited by 171
Multiple Tree Models for Occlusion and Spatial Constraints in Human Pose Estimation
Wang, Y., & Mori, G. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-88690-7_53 · Cited by 160
Solving multiclass support vector machines with LaRank
Bordes, A., Bottou, L., Gallinari, P., et al. (2007) · International Conference on Machine Learning · doi:10.1145/1273496.1273508 · Cited by 158
Beyond trees: common-factor models for 2D human pose recovery
Lan, X., & Huttenlocher, D. P. (2005) · doi:10.1109/iccv.2005.48 · Cited by 148
Parsing human motion with stretchable models
Sapp, B., Weiss, D. A., & Taskar, B. (2011) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2011.5995607 · Cited by 143
Adaptive pose priors for pictorial structures
Sapp, B., Jordan, C., & Taskar, B. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5540182 · Cited by 134
Human tracking with mixtures of trees
Ioffe, S., & Forsyth, D. A. (2002) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2001.937589 · Cited by 106
Improved Human Parsing with a Full Relational Model
Tran, D., & Forsyth, D. A. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15561-1_17 · Cited by 96
Training Deformable Models for Localization
Ramanan, D., & Sminchisescu, C. (2006) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2006.315 · Cited by 91
Self-citationFast globally optimal 2D human detection with loopy graph models
Tian, T.-P., & Sclaroff, S. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5540227 · Cited by 86
Efficient discriminative learning of parts-based models
Kumar, M., Zisserman, A., & Torr, P. H. S. (2009) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2009.5459192 · Cited by 82
Bottom-up Recognition and Parsing of the Human Body
Srinivasan, P., & Shi, J. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.383301 · Cited by 71
Discriminative Hierarchical Part-Based Models for Human Parsing and Action Recognition
Wang, Y., Tran, D., Liao, Z., & Forsyth, D. A. (2017) · The Springer series on challenges in machine learning · doi:10.1007/978-3-319-57021-1_9 · Cited by 54
Efficient Inference with Multiple Heterogeneous Part Detectors for Human Pose Estimation
Singh, V. K., Nevatia, R., & Huang, C. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15558-1_23 · Cited by 48
Pirsiavash, H., & Ramanan, D. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6248058 · Cited by 42
Self-citationSemantic Hierarchies for Recognizing Objects and Parts
Epshtein, B., & Ullman, S. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.383086 · Cited by 39
Discriminative hierarchical part-based models for human parsing and action recognition
WangYang, TranDuan, LiaoZicheng, & ForsythDavid (2012) · Journal of Machine Learning Research · doi:10.5555/2503308.2503340 · Cited by 30
Combining discriminative appearance and segmentation cues for articulated human pose estimation
Johnson, S., & Everingham, M. (2009) · doi:10.1109/iccvw.2009.5457673 · Cited by 29
Part-Based Models for Finding People and Estimating Their Pose
Ramanan, D. (2011) · Springer eBooks · doi:10.1007/978-0-85729-997-0_11 · Cited by 29
Self-citation
Cited by
Realtime Multi-person 2D Pose Estimation Using Part Affinity Fields
Cao, Z., Simon, T., Wei, S.-E., & Sheikh, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.143 · Cited by 7,539
“Human 2D pose estimation—the problem of localizing anatomical keypoints or “parts”—has largely focused on finding body parts of individuals [8, 4, 3, 21, 33, 13, 25, 31, 6, 24].”
BackgroundStacked Hourglass Networks for Human Pose Estimation
Newell, A., Yang, K., & Deng, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_29 · Cited by 5,634
OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields
Cao, Z., Hidalgo, G., Simon, T., Wei, S.-E., & Sheikh, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2929257 · Cited by 5,536
Wei, S.-E., Ramakrishna, V., Kanade, T., & Sheikh, Y. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.511 · Cited by 2,966
2D Human Pose Estimation: New Benchmark and State of the Art Analysis
Andriluka, M., Pishchulin, L., Gehler, P., & Schiele, B. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.471 · Cited by 2,688
Metadata
- Authors
- Yang, Y., & Ramanan, D.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2013-12
- Volume
- 35
- Issue
- 12
- Pages
- 2878-2890
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2013640163
- Cited by
- 852
- References
- 47
- FWCI
- 42.95
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
