The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
MHFormer: Multi-Hypothesis Transformer for 3D Human Pose Estimation
Open accessAbstract
Estimating 3D human poses from monocular videos is a challenging task due to depth ambiguity and self-occlusion. Most existing works attempt to solve both issues by exploiting spatial and temporal relationships. However, those works ignore the fact that it is an inverse problem where multiple feasible solutions (i.e., hypotheses) exist. To relieve this limitation, we propose a Multi-Hypothesis Transformer (MHFormer) that learns spatio-temporal representations of multiple plausible pose hypotheses. In order to effectively model multi-hypothesis dependencies and build strong relationships across hypothesis features, the task is decomposed into three stages: (i) Generate multiple initial hypothesis representations; (ii) Model self-hypothesis communication, merge multiple hypotheses into a single converged representation and then partition it into several diverged hypotheses; (iii) Learn cross-hypothesis communication and aggregate the multi-hypothesis features to synthesize the final 3D pose. Through the above processes, the final representation is enhanced and the synthesized pose is much more accurate. Extensive experiments show that MHFormer achieves state-of-the-art results on two challenging datasets: Human3.6M and MPI-INF-3DHP. Without bells and whistles, its performance surpasses the previous best result by a large margin of 3% on Human3.6M. Code and models are available at https://github.com/Vegetebird/MHFormer.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
Stacked Hourglass Networks for Human Pose Estimation
Newell, A., Yang, K., & Deng, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46484-8_29 · Cited by 5,634
Human3.6M: Large Scale Datasets and Predictive Methods for 3D Human Sensing in Natural Environments
Ionescu, C., Papava, D., Olaru, V., & Sminchisescu, C. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.248 · Cited by 3,653 · cited 1×
“6M dataset [12] is the largest and most representative benchmark for 3D HPE.”
BackgroundCrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification
Chen, C.-F. R., Fan, Q., & Panda, R. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00041 · Cited by 2,074
Cascaded Pyramid Network for Multi-person Pose Estimation
Chen, Y., Wang, Z., Peng, Y., Zhang, Z., Yu, G., & Sun, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00742 · Cited by 1,799
A Simple Yet Effective Baseline for 3d Human Pose Estimation
Martinez, J., Hossain, R., Romero, J., & Little, J. J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.288 · Cited by 1,462
Han, K., Xiao, A., Wu, E., Guo, J., Xu, C., & Wang, Y. (2021) · arXiv · doi:10.48550/arxiv.2103.00112 · Cited by 1,394 · cited 1×
“Recently, Transformer [39] equipped with the powerfully global self-attention mechanism has received increasingly research interest in the computer vision community [10, 11, 23, 28, 46].”
Background3D Human Pose Estimation in Video With Temporal Convolutions and Semi-Supervised Training
Pavllo, D., Feichtenhofer, C., Grangier, D., & Auli, M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00794 · Cited by 1,297
(1994) · Aston Publications Explorer (Aston University) · Cited by 1,245
TransReID: Transformer-based Object Re-Identification
He, S., Luo, H., Wang, P., Wang, F., Li, H., & Jiang, W. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01474 · Cited by 1,244
Self-citationMonocular 3D Human Pose Estimation in the Wild Using Improved CNN Supervision
Mehta, D., Rhodin, H., Casas, D., Fua, P., Sotnychenko, O., Xu, W., & Theobalt, C. (2017) · 2017 International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2017.00064 · Cited by 1,142
VNect: real-time 3D human pose estimation with a single RGB camera
Mehta, D., Sridhar, S., Sotnychenko, O., Rhodin, H., Shafiei, M., Seidel, H.-P., Xu, W., Casas, D., & Theobalt, C. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073596 · Cited by 1,113
Coarse-to-Fine Volumetric Prediction for Single-Image 3D Human Pose
Pavlakos, G., Zhou, X., Derpanis, K. G., & Daniilidis, K. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.139 · Cited by 884
Integral Human Pose Regression
Sun, X., Xiao, B., Wei, F., Liang, S., & Wei, Y. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01231-1_33 · Cited by 874
Enhanced skeleton visualization for view invariant human action recognition
Liu, M., Liu, H., & Chen, C. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.02.030 · Cited by 842
Self-citationEnd-to-End Human Pose and Mesh Reconstruction with Transformers
Lin, K., Wang, L., & Liu, Z. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00199 · Cited by 740
3D Human Pose Estimation with Spatial and Temporal Transformers
Zheng, C., Zhu, S., Mendieta, M., Yang, T., Chen, C., & Ding, Z. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01145 · Cited by 711
Exploiting Spatial-Temporal Relationships for 3D Pose Estimation via Graph Convolutional Networks
Cai, Y., Ge, L., Liu, J., Cai, J., Cham, T.-J., Yuan, J., & Thalmann, N. M. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00236 · Cited by 519
3D Human Pose Estimation from Monocular Images with Deep Convolutional Neural Network
Li, S., & Chan, A. B. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-16808-1_23 · Cited by 443
Anatomy-Aware 3D Human Pose Estimation With Bone-Based Pose Decomposition
Chen, T., Fang, C., Shen, X., Zhu, Y., Chen, Z., & Luo, J. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3057267 · Cited by 338
Recognizing Human Actions as the Evolution of Pose Estimation Maps
Liu, M., & Yuan, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00127 · Cited by 336
Learning Pose Grammar to Encode Human Body Configuration for 3D Pose Estimation
Fang, H.-S., Xu, Y., Wang, W., Liu, X., & Zhu, S.-C. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12270 · Cited by 332
Exploiting Temporal Contexts With Strided Transformer for 3D Human Pose Estimation
Li, W., Liu, H., Ding, R., Liu, M., Wang, P., & Yang, W. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3141231 · Cited by 314
Self-citationGraph Stacked Hourglass Networks for 3D Human Pose Estimation
Xu, T., & Takano, W. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01584 · Cited by 302
Attention Mechanism Exploits Temporal Contexts: Real-Time 3D Human Pose Reconstruction
Liu, R., Shen, J., Wang, H., Chen, C., Cheung, S.-C., & Asari, V. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00511 · Cited by 266
CDTrans: Cross-domain Transformer for Unsupervised Domain AdaptationPreprint
Xu, T., Chen, W., Wang, P., Wang, F., Li, H., & Jin, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.06165 · Cited by 236
Self-citationPropagating LSTM: 3D Pose Estimation Based on Joint Interdependency
Lee, K., Lee, I., & Lee, S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_8 · Cited by 235
Motion Guided 3D Pose Estimation from Videos
Wang, J., Yan, S., Xiong, Y., & Lin, D. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58601-0_45 · Cited by 225
Generating Multiple Hypotheses for 3D Human Pose Estimation With Mixture Density Network
Li, C., & Lee, G. H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01012 · Cited by 223
Transformer-Based Attention Networks for Continuous Pixel-Wise Prediction
Yang, G., Tang, H., Ding, M., Sebe, N., & Ricci, E. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01596 · Cited by 210
Self-citationModulated Graph Convolutional Network for 3D Human Pose Estimation
Zou, Z., & Tang, W. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01128 · Cited by 192
SRNet: Improving Generalization in 3D Human Pose Estimation with a Split-and-Recombine Approach
Zeng, A., Sun, X., Huang, F., Liu, M., Xu, Q., & Lin, S. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58568-6_30 · Cited by 189
Depth Pooling Based Large-Scale 3-D Action Recognition With Convolutional Neural Networks
Wang, P., Li, W., Gao, Z., Tang, C., & Ogunbona, P. O. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2818329 · Cited by 182
Self-citationCascaded Deep Monocular 3D Human Pose Estimation With Evolutionary Training Data
Li, S., Ke, L., Pratama, K., Tai, Y.-W., Tang, C.-K., & Cheng, K.-T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00621 · Cited by 175
PoseAug: A Differentiable Pose Augmentation Framework for 3D Human Pose Estimation
Gong, K., Zhang, J., & Feng, J. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00847 · Cited by 175
Monocular 3D Human Pose Estimation by Generation and Ordinal Ranking
Sharma, S., Varigonda, P. T., Bindal, P., Sharma, A., & Jain, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00241 · Cited by 172
Learning Skeletal Graph Neural Networks for Hard 3D Pose Estimation
Zeng, A., Sun, X., Yang, L., Zhao, N., Liu, M., & Xu, Q. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01124 · Cited by 170
Probabilistic Monocular 3D Human Pose Estimation with Normalizing Flows
Wehrbein, T., Rudolph, M., Rosenhahn, B., & Wandt, B. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01101 · Cited by 144
Conditional Directed Graph Convolution for 3D Human Pose Estimation
Hu, W., Zhang, C., Zhan, F., Zhang, L., & Wong, T. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475219 · Cited by 128
Multi-Instance Pose Networks: Rethinking Top-Down Pose Estimation
Khirodkar, R., Chari, V., Agrawal, A., & Tyagi, A. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00311 · Cited by 102
Generating Multiple Diverse Hypotheses for Human 3D Pose Consistent with 2D Joint Detections
Jahangiri, E., & Yuille, A. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.100 · Cited by 98
Context Modeling in 3D Human Pose Estimation: A Unified Perspective
Ma, X., Su, J., Wang, C., Ci, H., & Wang, Y. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00617 · Cited by 89
A Video Is Worth Three Views: Trigeminal Transformers for Video-Based Person Re-Identification
Liu, X., Zhang, P., Yu, C., Qian, X., Yang, X., & Lu, H. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3386914 · Cited by 80
GraphMDN: Leveraging graph structure and deep learning to solve inverse problems
Oikarinen, T., Hannah, D., & Kazerounian, S. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9534301 · Cited by 37
Cited by
MotionBERT: A Unified Perspective on Learning Human Motion Representations
Zhu, W., Ma, X., Liu, Z., Liu, L., Wu, W., & Wang, Y. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01385 · Cited by 348
A Systematic Review of Recent Deep Learning Approaches for 3D Human Pose Estimation
El Kaid, A., & Baïna, K. (2023) · Journal of Imaging · doi:10.3390/jimaging9120275 · Cited by 44
Metadata
- Authors
- Li, W., Liu, H., Tang, H., Wang, P., & Van Gool, L.
- Venue
- 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
- Publisher
- IEEE
- Published
- 2022-06
- Pages
- 13137-13146
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W4312249545
- Cited by
- 458
- References
- 45
- FWCI
- 37.18
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.