ARHPE: Asymmetric Relation-Aware Representation Learning for Head Pose Estimation in Industrial Human–Computer Interaction
The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
Head pose estimation (HPE) has wide industrial applications, such as online education, human–robot interaction, and automatic manufacturing. In this article, we address two key problems in HPE based on label learning and asymmetric relation cues: 1) how to bridge the gap between the better prediction performance of networks and incorrectly label pose images in the HPE datasets and 2) how to take full advantage of the adjacent poses information around the centered pose image. We reconstruct all the incorrect labels as a two-dimensional Lorentz distribution to tackle the first problem. Instead of directly adopting the angle values ashardlabels, we assign part of the probability values (softlabels) to adjacent labels for learning discriminative feature representations. To address the second problem, we reveal the asymmetric relation nature of HPE datasets. The yaw direction and pitch direction are assigned different weights by introducing the half at half-maximum of the Lorentz distribution. Compared with the traditional end-to-end frameworks, the proposed one can leverage the asymmetric relation cues for predicting the head pose angle in the incorrect label scenarios. Extensive experiments on two public datasets and our infrared dataset demonstrate that the proposed ARHPE network significantly outperforms other state-of-the-art approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Ranjan, R., Patel, V. M., & Chellappa, R. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2781233 · Cited by 1,333
Head Pose Estimation in Computer Vision: A Survey
Murphy-Chutorian, E., & Trivedi, M. M. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.106 · Cited by 1,301
Region Covariance: A Fast Descriptor for Detection and Classification
Tuzel, O., Porikli, F., & Meer, P. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744047_45 · Cited by 1,115
The CAS-PEAL large-scale chinese face database and baseline evaluations
Gao, W., Cao, B., Shan, S., Chen, X., Zhou, D., Zhang, X., & Zhao, D. (2008) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/tsmca.2007.909557 · Cited by 773
Kostinger, M., Wohlhart, P., Roth, P. M., & Bischof, H. (2011) · 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops) · doi:10.1109/iccvw.2011.6130513 · Cited by 715
Geng, X. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2016.2545658 · Cited by 691
Fine-Grained Head Pose Estimation Without Keypoints
Ruiz, N., Chong, E., & Rehg, J. M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00281 · Cited by 631
Facial Age Estimation by Learning from Label Distributions
Geng, X., Yin, C., & Zhou, Z.-H. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.51 · Cited by 618
FSA-Net: Learning Fine-Grained Structure Aggregation for Head Pose Estimation From a Single Image
Yang, T.-Y., Chen, Y.-T., Lin, Y.-Y., & Chuang, Y.-Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00118 · Cited by 347
Is Second-Order Information Helpful for Large-Scale Visual Recognition?
Li, P., Xie, J., Wang, Q., & Zuo, W. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.228 · Cited by 294
Murphy-Chutorian, E., & Trivedi, M. M. (2010) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2010.2044241 · Cited by 290
Head pose estimation in the wild using Convolutional Neural Networks and adaptive gradient methods
Patacchiola, M., & Cangelosi, A. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.06.009 · Cited by 205
Head Pose Estimation Based on Multivariate Label Distribution
Geng, X., & Xia, Y. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.237 · Cited by 180
KEPLER: Keypoint and Pose Estimation of Unconstrained Faces by Learning Efficient H-CNN Regressors
Kumar, A., Alavi, A., & Chellappa, R. (2017) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2017.149 · Cited by 172
QuatNet: Quaternion-Based Head Pose Estimation With Multiregression Loss
Hsu, H.-W., Wu, T.-Y., Wan, S., Wong, W. H., & Lee, C.-Y. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2866770 · Cited by 172
Recognizing Visual Focus of Attention From Head Pose in Natural Meetings
Ba, S. O., & Odobez, J.-M. (2009) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.927274 · Cited by 155
Face-from-Depth for Head Pose Estimation on Depth Images
Borghi, G., Fabbri, M., Vezzani, R., Calderara, S., & Cucchiara, R. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2885472 · Cited by 115
Ordinary Preserving Manifold Analysis for Human Age and Head Pose Estimation
Lu, J., & Tan, Y. (2013) · IEEE Transactions on Human-Machine Systems · doi:10.1109/tsmcc.2012.2192727 · Cited by 107
Multi-Task Head Pose Estimation in-the-Wild
Valle, R., Buenaposada, J. M., & Baumela, L. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3046323 · Cited by 97
Face distributions in similarity space under varying head pose
Sherrah, J., Gong, S., & Ong, E.-J. (2001) · Image and Vision Computing · doi:10.1016/s0262-8856(00)00096-2 · Cited by 89
Robust Head-Pose Estimation Based on Partially-Latent Mixture of Linear Regressions
Drouard, V., Horaud, R., Deleforge, A., et al. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2654165 · Cited by 82
Web-Shaped Model for Head Pose Estimation: An Approach for Best Exemplar Selection
Barra, P., Barra, S., Bisogni, C., Marsico, M. D., & Nappi, M. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.2984373 · Cited by 60
Forecasting People Trajectories and Head Poses by Jointly Reasoning on Tracklets and Vislets
Hasan, I., Setti, F., Tsesmelis, T., Belagiannis, V., Amin, S., Bue, A. D., Cristani, M., & Galasso, F. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2949414 · Cited by 53
Facial Pose Estimation by Deep Learning from Label Distributions
Liu, Z., Chen, Z., Bai, J., Li, S., & Lian, S. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00156 · Cited by 45
A Novel Eye Center Localization Method for Head Poses With Large Rotations
Hsu, W., & Chung, C.-J. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3044209 · Cited by 45
Chen, H., Li, Y., & Su, D. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2934986 · Cited by 44
Self-citationFASHE: A FrActal Based Strategy for Head Pose Estimation
Bisogni, C., Nappi, M., Pero, C., & Ricciardi, S. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3059409 · Cited by 35
Towards Improving Social Communication Skills With Multimodal Sensory Information
Chen, J., Chen, D., Li, X., & Zhang, K. (2013) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2013.2271914 · Cited by 34
Robust head pose estimation using Dirichlet-tree distribution enhanced random forests
Liu, Y., Chen, J., Su, Z., Luo, Z., Luo, N., Liu, L., & Zhang, K. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.03.096 · Cited by 30
Liu, Y., Lasang, P., Pranata, S., Shen, S., & Zhang, W. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2921325 · Cited by 29
Head and Body Orientation Estimation Using Convolutional Random Projection Forests
Lee, D., Yang, M., & Oh, S. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2784424 · Cited by 22
Coupled cascade regression for simultaneous facial landmark detection and head pose estimation
Gou, C., Wu, Y., Wang, F., & Ji, Q. (2017) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2017.8296814 · Cited by 19
Locating Nose-Tips and Estimating Head Poses in Images by Tensorposes
Tu, J., Fu, Y., & Huang, T. S. (2008) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2008.2005806 · Cited by 17
Heading Reference-Assisted Pose Estimation for Ground Vehicles
Wang, H., Jiang, R., Zhang, H., & Ge, S. S. (2018) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2018.2828078 · Cited by 14
Cited by
Convolutional Neural Networks: A Survey
Krichen, M. (2023) · Computers · doi:10.3390/computers12080151 · Cited by 623
“CNNs can offer significant improvements in accuracy and efficiency compared to traditional ML algorithms, particularly for tasks such as image classification, object detection, and natural language processing [176,177].”
Metadata
- Authors
- Liu, H., Liu, T., Zhang, Z., Sangaiah, A. K., Yang, B., & Li, Y.
- Venue
- IEEE Transactions on Industrial Informatics
- Published
- 2022-10
- Volume
- 18
- Issue
- 10
- Pages
- 7107-7117
- ISSN
- 1551-3203 (ISSN-L)
- 1941-0050
- OpenAlex
- W4210773761
- Cited by
- 288
- References
- 35
- FWCI
- 21.37
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.