CoChat

Deep High-Resolution Representation Learning for Visual Recognition

Wang, Jingdong, Sun, Ke, Cheng, Tianheng, Jiang, Borui, Deng, Chaorui, Zhao, Yang, Liu, Dong, Mu, Yadong, Tan, Mingkui, Wang, Xinggang, Liu, Wenyu, Xiao, Bin · 2021 · IEEE Transactions on Pattern Analysis and Machine Intelligence

The DOI matches its Crossref record; 190 of the 190 references it cites were found in a registry or an index.

Abstract

High-resolution representations are essential for position-sensitive vision problems, such as human pose estimation, semantic segmentation, and object detection. Existing state-of-the-art frameworks first encode the input image as a low-resolution representation through a subnetwork that is formed by connecting high-to-low resolution convolutions in series (e.g., ResNet, VGGNet), and then recover the high-resolution representation from the encoded low-resolution representation. Instead, our proposed network, named as High-Resolution Network (HRNet), maintains high-resolution representations through the whole process. There are two key characteristics: (i) Connect the high-to-low resolution convolution streams in parallel and (ii) repeatedly exchange the information across resolutions. The benefit is that the resulting representation is semantically richer and spatially more precise. We show the superiority of the proposed HRNet in a wide range of applications, including human pose estimation, semantic segmentation, and object detection, suggesting that the HRNet is a stronger backbone for computer vision problems. All the codes are available at https://github.com/HRNet.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/tpami.2020.2983686

Cites

190 of 190 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 190 references

Research works printed but not linked: 35

  1. [45] G. Ghiasi and C. C. Fowlkes. Occlusion coherence: Localizing occluded faces with a hierarchical deformable part model. In CVPR , pages 1899-1906, 2014. 20 -
  2. [48] R. A. G¨ uler, G. Trigeorgis, E. Antonakos, P. Snape, S. Zafeiriou, and I. Kokkinos. Densereg: Fully convolutional dense shape regression in-the-wild. In CVPR , pages 2614-2623, 2017. 21 -
  3. [34] X. Dong, Y. Yan, W. Ouyang, and Y. Yang. Style aggregated network for facial landmark detection. In CVPR , pages 379-388, 2018. 20, 21 -
  4. [35] X. Dong, S. Yu, X. Weng, S. Wei, Y. Yang, and Y. Sheikh. Supervision-by-registration: An unsupervised approach to improve the precision of facial landmark detectors. In CVPR , pages 360-368, 2018. 20, 21 -
  5. [39] Z. Feng, G. Hu, J. Kittler, W. J. Christmas, and X. Wu. Cascaded collaborative regression for robust facial landmark detection trained using a mixture of synthetic and real images with dynamic weighting. IEEE Trans. Image Processing , 24(11):3425-3440, 2015. 20 -
  6. [40] Z. Feng, J. Kittler, M. Awais, P. Huber, and X. Wu. Wing loss for robust facial landmark localisation with convolutional neural networks. In CVPR , pages 2235-2245, 2018. 19, 20 -
  7. [41] Z. Feng, J. Kittler, W. J. Christmas, P. Huber, and X. Wu. Dynamic attention-controlled cascaded shape regression exploiting training data augmentation and fuzzy-set sample weighting. In CVPR , pages 3681-3690, 2017. 20 -
  8. [191] S. Zhu, C. Li, C. C. Loy, and X. Tang. Face alignment by coarseto-fine shape searching. In CVPR , pages 4998-5006, 2015. 19, 20, 21 -
  9. [192] S. Zhu, C. Li, C. C. Loy, and X. Tang. Unconstrained face alignment via cascaded compositional learning. In CVPR , pages 3409-3417, 2016. 20 -
  10. [193] X. Zhu and D. Ramanan. Face detection, pose estimation, and landmark localization in the wild. In CVPR , pages 2879-2886, 2012. 19 -
  11. [186] E. Zhou, H. Fan, Z. Cao, Y. Jiang, and Q. Yin. Extensive facial landmark localization with coarse-to-fine convolutional network cascade. In ICCVW , pages 386-391, 2013. 21 -
  12. [75] M. K¨ ostinger, P. Wohlhart, P. M. Roth, and H. Bischof. Annotated facial landmarks in the wild: A large-scale, real-world database for facial landmark localization. In ICCV , pages 2144-2151, 2011. 19 -
  13. [5] P. N. Belhumeur, D. W. Jacobs, D. J. Kriegman, and N. Kumar. Localizing parts of faces using a consensus of exemplars. IEEE Trans. Pattern Anal. Mach. Intell. , 35(12):2930-2940, 2013. 19 -
  14. [10] X. P. Burgos-Artizzu, P. Perona, and P. Doll´ ar. Robust face landmark estimation under occlusion. In ICCV , pages 1513-1520, 2013. 19, 20 7. We provide the facial landmark detection results in the supplementary file. -
  15. [57] P. Hu and D. Ramanan. Bottom-up and top-down reasoning with hierarchical rectified gaussians. In CVPR , pages 5600-5609, 2016. 2 -
  16. [153] S. Xiao, J. Feng, J. Xing, H. Lai, S. Yan, and A. A. Kassim. Robust facial landmark detection via recurrent attentive-refinement networks. In ECCV , pages 57-72, 2016. 20 -
  17. [150] W. Wu and S. Yang. Leveraging intra and inter-dataset variations for robust face alignment. In CVPR , pages 2096-2105, 2017. 20 -
  18. [158] X. Xiong and F. D. la Torre. Supervised descent method and its applications to face alignment. In CVPR , pages 532-539. IEEE Computer Society, 2013. 20, 21 -
  19. [162] J. Yan, Z. Lei, D. Yi, and S. Z. Li. Learn to combine multiple hypotheses for accurate face alignment. In ICCVW , pages 392396, 2013. 21 -
  20. [164] S. Yang, P. Luo, C. C. Loy, and X. Tang. WIDER FACE: A face detection benchmark. In CVPR , pages 5525-5533, 2016. 19 -
  21. [169] X. Yu, J. Huang, S. Zhang, W. Yan, and D. N. Metaxas. Posefree facial landmark fitting via optimized part mixtures and cascaded deformable shape model. In ICCV , pages 1944-1951. IEEE Computer Society, 2013. 20 -
  22. [80] V. Le, J. Brandt, Z. Lin, L. D. Bourdev, and T. S. Huang. Interactive facial feature localization. In ECCV (3) , volume 7574 of Lecture Notes in Computer Science , pages 679-692. Springer, 2012. 19 -
  23. [78] A. Kumar and R. Chellappa. Disentangling 3d pose in a dendritic CNN for unconstrained 2d face alignment. In CVPR , pages 430439. IEEE Computer Society, 2018. 21 -
  24. [174] J. Zhang, M. Kan, S. Shan, and X. Chen. Occlusion-free face alignment: Deep regression networks coupled with de-corrupt autoencoders. In CVPR , pages 3428-3437, 2016. 20 -
  25. [175] J. Zhang, S. Shan, M. Kan, and X. Chen. Coarse-to-fine autoencoder networks (CFAN) for real-time face alignment. In ECCV (2) , volume 8690, pages 1-16. Springer, 2014. 21 -
  26. [116] S. Ren, X. Cao, Y. Wei, and J. Sun. Face alignment at 3000 FPS via regressing local binary features. In CVPR , pages 1685-1692, 2014. 20, 21 -
  27. [117] S. Ren, X. Cao, Y. Wei, and J. Sun. Face alignment via regressing local binary features. IEEE Trans. Image Processing , 25(3):12331245, 2016. 19 -
  28. [120] O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. S. Bernstein, A. C. Berg, and F. Li. Imagenet large scale visual recognition challenge. International Journal of Computer Vision , 115(3):211-252, 2015. 16 -
  29. [121] C. Sagonas, G. Tzimiropoulos, S. Zafeiriou, and M. Pantic. 300 faces in-the-wild challenge: The first facial landmark localization challenge. In ICCV Workshops , pages 397-403, 2013. 19 -
  30. [14] X. Cao, Y. Wei, F. Wen, and J. Sun. Face alignment by explicit shape regression. In CVPR , pages 2887-2894, 2012. 20, 21 -
  31. [101] J. Lv, X. Shao, J. Xing, C. Cheng, and X. Zhou. A deep regression architecture with two-stage re-initialization for high performance facial landmark detection. In CVPR , pages 3691-3700, 2017. 20 -
  32. [102] X. Miao, X. Zhen, X. Liu, C. Deng, V. Athitsos, and H. Huang. Direct shape regression networks for end-to-end face alignment. In CVPR , pages 5040-5049, 2018. 20, 21 -
  33. [23] Y. Chen, C. Shen, X. Wei, L. Liu, and J. Yang. Adversarial posenet: A structure-aware convolutional network for human pose estimation. In ICCV , pages 1221-1230, 2017. 19, 21 -
  34. [138] G. Trigeorgis, P. Snape, M. A. Nicolaou, E. Antonakos, and S. Zafeiriou. Mnemonic descent method: A recurrent process applied for end-to-end face alignment. In CVPR , pages 41774187, 2016. 21 -
  35. [146] Z. Wang, W. Li, B. Yin, Q. Peng, T. Xiao, Y. Du, Z. Li, X. Zhang, G. Yu, and J. Sun. Mscoco keypoints challenge 2018. In Joint Recognition Challenge Workshop at ECCV 2018 , 2018. 6 -

Cited by

Metadata

Authors
Wang, J., Sun, K., Cheng, T., Jiang, B., Deng, C., Zhao, Y., Liu, D., Mu, Y., Tan, M., Wang, X., Liu, W., & Xiao, B.
Affiliations
  • Microsoft Research Asia (China) (CN)
  • University of Science and Technology of China (CN)
  • Huazhong University of Science and Technology (CN)
  • Peking University (CN)
  • South China University of Technology (CN)
  • Griffith University (AU)
  • Microsoft (United States) (US)
Venue
IEEE Transactions on Pattern Analysis and Machine Intelligence
Published
2021-10-01
Volume
43
Issue
10
Pages
3349-3364
ISSN
  • 0162-8828 (ISSN-L)
  • 2160-9292
  • 1939-3539
OpenAlex
W3014641072
Cited by
4,894
References
169
Citations by year
2026: 762 · 2025: 984 · 2024: 1040 · 2023: 896 · 2022: 670 · 2021: 454
FWCI
204.78
Type
journal article
Language
en
Open access
closed
Locations
  • IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
  • PubMed (publishedVersion)
  • Griffith Research Online (submittedVersion)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Human Pose and Action Recognition
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
Keywords
HRNet, human pose estimation, semantic segmentation, object detection, backbone networks

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.