Multimodal Face-Pose Estimation With Multitask Manifold Deep Learning
Open accessThe DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
Face-pose estimation aims at estimating the gazing direction with two-dimensional face images. It gives important communicative information and visual saliency. However, it is challenging because of lights, background, face orientations, and appearance visibility. Therefore, a descriptive representation of face images and mapping it to poses are critical. In this paper, we use multimodal data and propose a novel face-pose estimation framework named multitask manifold deep learning ($\text{M}^2\text{DL}$). It is based on feature extraction with improved convolutional neural networks (CNNs) and multimodal mapping relationship with multitask learning. In the proposed CNNs, manifold regularized convolutional layers learn the relationship between outputs of neurons in a low-rank space. Besides, in the proposed mapping relationship learning method, different modals of face representations are naturally combined by applying multitask learning with incoherent sparse and low-rank learning with a least-squares loss. Experimental results on three challenging benchmark datasets demonstrate the performance of$\text{M}^2\text{DL}$.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Global Geometric Framework for Nonlinear Dimensionality Reduction
Tenenbaum, J. B., Silva, V. D., & Langford, J. C. (2000) · Science · doi:10.1126/science.290.5500.2319 · Cited by 13,585
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
Ranjan, R., Patel, V. M., & Chellappa, R. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2781233 · Cited by 1,333
Recovering 3D human pose from monocular images
Agarwal, A., & Triggs, B. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.21 · Cited by 727
Random Forests for Real Time 3D Face Analysis
Fanelli, G., Dantone, M., Gall, J., Fossati, A., & Van Gool, L. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-012-0549-0 · Cited by 566
Real time head pose estimation with random regression forests
Fanelli, G., Gall, J., & Van Gool, L. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995458 · Cited by 436
Patch Alignment for Dimensionality Reduction
Zhang, T., Tao, D., Li, X., & Yang, J. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.212 · Cited by 381
Bypassing synthesis: PLS for face recognition with pose, low-resolution and sketch
Sharma, A., & Jacobs, D. W. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995350 · Cited by 376
Wind Turbine Gearbox Failure Identification With Deep Neural Networks
Wang, L., Zhang, Z., Long, H., Xu, J., & Liu, R. (2017) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2016.2607179 · Cited by 348
Rough Deep Neural Architecture for Short-Term Wind Speed Forecasting
Khodayar, M., Kaynak, O., & Khodayar, M. E. (2017) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2017.2730846 · Cited by 348
Multi-Task Pose-Invariant Face Recognition
Ding, C., Xu, C., & Tao, D. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2390959 · Cited by 265
Twin Gaussian Processes for Structured Prediction
Bo, L., & Sminchisescu, C. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-008-0204-y · Cited by 250
Head Pose Estimation for Driver Assistance Systems: A Robust Algorithm and Experimental Evaluation
Murphy-Chutorian, E., Doshi, A., & Trivedi, M. M. (2007) · 2007 IEEE Intelligent Transportation Systems Conference · doi:10.1109/itsc.2007.4357803 · Cited by 217
Scene Recognition by Manifold Regularized Deep Learning Architecture
Yuan, Y., Mou, L., & Lu, X. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2359471 · Cited by 214
Deep Convolutional Computation Model for Feature Learning on Big Data in Internet of Things
Li, P., Chen, Z., Yang, L. T., Zhang, Q., & Deen, M. J. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2017.2739340 · Cited by 199
Chen, D. (2017) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2017.2682855 · Cited by 197
Deep Head Pose: Gaze-Direction Estimation in Multimodal Video
Mukherjee, S. S., & Robertson, N. M. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2015.2482819 · Cited by 182
Monocular Free-Head 3D Gaze Tracking with Deep Learning and Geometry Constraints
Deng, H., & Zhu, W. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.341 · Cited by 162
Detecting People Looking at Each Other in Videos
Marín-Jiménez, M. J., Zisserman, A., Eichner, M. L., & Ferrari, V. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0655-7 · Cited by 157
Head pose estimation by nonlinear manifold learning
Raytchev, B., Yoda, I., & Sakaue, K. (2004) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2004.1333802 · Cited by 150
A Multi-Task Learning Framework for Head Pose Estimation under Target Motion
Yan, Y., Ricci, E., Subramanian, R., Liu, G., Lanz, O., & Sebe, N. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2477843 · Cited by 136
Pławiak, P., Sośnicki, T., Niedźwiecki, M., Tabor, Z., & Rzecki, K. (2016) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2016.2550528 · Cited by 124
Pose-Invariant Face Alignment with a Single CNN
Jourabloo, A., Ye, M., Liu, X., & Ren, L. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.347 · Cited by 124
Capturing High-Discriminative Fault Features for Electronics-Rich Analog System via Deep Learning
Liu, Z., Jia, Z., Vong, C.-M., Bu, S., Han, J., & Tang, X. (2017) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2017.2690940 · Cited by 116
Funnel-structured cascade for multi-view face detection with alignment-awareness
Wu, S., Kan, M., He, Z., Shan, S., & Chen, X. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.09.072 · Cited by 111
Machado, O., Martín, P., Rodriguez, F. J., & Bueno, E. J. (2017) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2017.2691461 · Cited by 96
Adly, F., Alhussein, O., Yoo, P. D., Al-Hammadi, Y., Taha, K., Muhaidat, S., Jeong, Y., Lee, U.-H., & Ismail, M. (2015) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2015.2481719 · Cited by 92
Du, G., Zhang, P., & Liu, X. (2016) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2016.2526674 · Cited by 91
Robust Head-Pose Estimation Based on Partially-Latent Mixture of Linear Regressions
Drouard, V., Horaud, R., Deleforge, A., et al. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2654165 · Cited by 82
Learning Incoherent Sparse and Low-Rank Patterns from Multiple Tasks
Chen, J.-H., Liu, J., & Ye, J. (2012) · TKDD · doi:10.1145/2086737.2086742 · Cited by 75
Head pose estimation via probabilistic high-dimensional regression
Drouard, V., Ba, S., Evangelidis, G., Deleforge, A., & Horaud, R. (2015) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2015.7351683 · Cited by 68
A Probabilistic Framework for Joint Pedestrian Head and Body Orientation Estimation
Flohr, F. B., Dumitru-Guzu, M., Kooij, J. F. P., & Gavrila, D. M. (2015) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2014.2379441 · Cited by 65
Rajagopal, A. K., Subramanian, R., Ricci, E., et al. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0692-2 · Cited by 62
Deep Mixture of Linear Inverse Regressions Applied to Head-Pose Estimation
Lathuilière, S., Juge, R., Mesejo, P., Muñoz‐Salinas, R., & Horaud, R. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.756 · Cited by 62
Unsupervised Gesture Segmentation by Motion Detection of a Real-Time Data Stream
Simao, M. A., Neto, P., & Gibaru, O. (2016) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2016.2613683 · Cited by 46
Head Pose Estimation by Perspective-n-Point Solution Based on 2D Markerless Face Tracking
Rocca, F., Mancaş, M., & Gosselin, B. H. (2014) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-319-08189-2_8 · Cited by 32
Voit, M., & Stiefelhagen, R. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-04667-4_42 · Cited by 18
An Adaptation Framework for Head-Pose Classification in Dynamic Multi-view Scenarios
Rajagopal, A. K., Subramanian, R., Vieriu, R. L., et al. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-37444-9_51 · Cited by 18
Cited by
Elharrouss, O., Almaadeed, N., Al-Maadeed, S., & Akbari, Y. (2020) · Neural Processing Letters · doi:10.1007/s11063-019-10163-0 · Cited by 341
Metadata
- Authors
- Hong, C., Yu, J., Zhang, J., Jin, X., & Lee, K.-H.
- Venue
- IEEE Transactions on Industrial Informatics
- Published
- 2019-07
- Volume
- 15
- Issue
- 7
- Pages
- 3952-3961
- ISSN
- 1551-3203 (ISSN-L)
- 1941-0050
- OpenAlex
- W2963087412
- Cited by
- 313
- References
- 38
- FWCI
- 18.57
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.