The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Heterogeneous Face Attribute Estimation: A Deep Multi-Task Learning Approach
Open accessAbstract
Face attribute estimation has many potential applications in video surveillance, face retrieval, and social media. While a number of methods have been proposed for face attribute estimation, most of them did not explicitly consider the attribute correlation and heterogeneity (e.g., ordinal versus nominal and holistic versus local) during feature representation learning. In this paper, we present a Deep Multi-Task Learning (DMTL) approach to jointly estimate multiple heterogeneous attributes from a single face image. In DMTL, we tackle attribute correlation and heterogeneity with convolutional neural networks (CNNs) consisting of shared feature learning for all the attributes, and category-specific feature learning for heterogeneous attributes. We also introduce an unconstrained face database (LFW+), an extension of public-domain LFW, with heterogeneous demographic attributes (age, gender, and race) obtained via crowdsourcing. Experimental results on benchmarks with multiple face attributes (MORPH II, LFW+, CelebA, LFWA, and FotW) show that the proposed approach has superior performance compared to state of the art. Finally, evaluations on a public-domain face database (LAP) with a single attribute show that the proposed approach has excellent generalization ability.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Robust Real-Time Face Detection
Viola, P., & Jones, M. J. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000013087.49260.fb · Cited by 14,097
Algorithms for Clustering Data
Sarle, W. S. (1990) · Technometrics · doi:10.1080/00401706.1990.10484648 · Cited by 7,865
Deep Learning Face Attributes in the Wild
Liu, Z., Luo, P., Wang, X., & Tang, X. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.425 · Cited by 7,747
Caruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636
Algorithms for clustering data
Flury, B. (1989) · Journal of Statistical Planning and Inference · doi:10.1016/0378-3758(89)90033-5 · Cited by 6,432
Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments
Huang, G. B., Mattar, M., Berg, T. L., & Miller, E. G. (2008) · HAL · Cited by 4,822
A Tutorial on the Cross-Entropy Method
de Boer, P.-T., Kroese, D. P., Mannor, S., & Rubinstein, R. Y. (2005) · Annals of Operations Research · doi:10.1007/s10479-005-5724-z · Cited by 3,024
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
Zeng, Z., Pantic, M., Roisman, G. I., & Huang, T. S. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.52 · Cited by 2,797
Comprehensive database for facial expression analysis
Kanade, T., Cohn, J. F., & Tian, Y. (2002) · Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580) · doi:10.1109/afgr.2000.840611 · Cited by 2,591
(2011) · Springer eBooks · doi:10.1007/978-0-85729-932-1 · Cited by 1,819
Learning Face Representation from Scratch
Yi, D., Lei, Z., Liao, S., & Li, S. Z. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.7923 · Cited by 1,521
(1992) · Cited by 1,405
Age and gender classification using convolutional neural networks
Levi, G., & Hassncer, T. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2015.7301352 · Cited by 1,151
Learning Deep Representation for Imbalanced Classification
Huang, C., Li, Y., Loy, C. C., & Tang, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.580 · Cited by 988
Automatic Age Estimation Based on Facial Aging Patterns
Geng, X., Zhou, Z.-H., & Smith-Miles, K. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.70733 · Cited by 964
Deep Expectation of Real and Apparent Age from a Single Image Without Facial Landmarks
Rothe, R., Timofte, R., & Van Gool, L. (2018) · International Journal of Computer Vision · doi:10.1007/s11263-016-0940-3 · Cited by 896
Age and Gender Estimation of Unfiltered Faces
Eidinger, E., Enbar, R., & Hassner, T. (2014) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2014.2359646 · Cited by 809
MORPH: A Longitudinal Image Database of Normal Adult Age-Progression
Ricanek, K., & Tesafaye, T. (2006) · 7th International Conference on Automatic Face and Gesture Recognition (FGR06) · doi:10.1109/fgr.2006.78 · Cited by 778
300 Faces In-The-Wild Challenge: Database and results
Sagonas, C., Antonakos, E., Tzimiropoulos, G., Zafeiriou, S., & Pantic, M. (2016) · Image and Vision Computing · doi:10.1016/j.imavis.2016.01.002 · Cited by 638
Facial Age Estimation by Learning from Label Distributions
Geng, X., Yin, C., & Zhou, Z.-H. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.51 · Cited by 618
Age Synthesis and Estimation via Faces: A Survey
Fu, Y., Guo, G., & Huang, T. S. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.36 · Cited by 569
PANDA: Pose Aligned Networks for Deep Attribute Modeling
Zhang, N., Paluri, M., Ranzato, M., Darrell, T., & Bourdev, L. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.212 · Cited by 495
Describable Visual Attributes for Face Verification and Image Search
Kumar, N., Berg, A., Belhumeur, P. N., & Nayar, S. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.48 · Cited by 434
Learning Deep Representation for Face Alignment with Auxiliary Attributes
Zhang, Z., Luo, P., Loy, C. C., & Tang, X. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2469286 · Cited by 424
FaceTracer: A Search Engine for Large Collections of Images with Faces
Kumar, N., Belhumeur, P., & Nayar, S. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88693-8_25 · Cited by 368
Demographic Estimation from Face Images: Human vs. Machine Performance
Han, H., Otto, C., Liu, X., & Jain, A. K. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2362759 · Cited by 325
Self-citationMulti-Task CNN Model for Attribute Prediction
Abdulnabi, A. H., Wang, G., Lu, J., & Jia, K. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2015.2477680 · Cited by 262
EMPATH: Face, Emotion, and Gender Recognition Using Holons
Cottrell, G. W., & Metcalfe, J. (1990) · neural information processing systems · Cited by 231
Overview of research on facial ageing using the FG-NET ageing database
Panis, G., Lanitis, A., Tsapatsoulis, N., & Cootes, T. F. (2016) · IET Biometrics · doi:10.1049/iet-bmt.2014.0053 · Cited by 227
Deeply-Learned Feature for Age Estimation
Wang, X., Guo, R., & Kambhamettu, C. (2015) · 2015 IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2015.77 · Cited by 214
Age Estimation by Multi-scale Convolutional Network
Yi, D., Lei, Z., & Li, S. Z. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-16811-1_10 · Cited by 207
An experimental comparison of gender classification methods
Mäkinen, E., & Raisamo, R. (2008) · Pattern Recognition Letters · doi:10.1016/j.patrec.2008.03.016 · Cited by 191
Attribute-based people search in surveillance environments
Vaquero, D. A., Feris, R. S., Tran, D., Brown, L., Hampapur, A., & Turk, M. (2009) · 2009 Workshop on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2009.5403131 · Cited by 189
Heterogeneous Multi-task Learning for Human Pose Estimation with Deep Convolutional Neural Network
Li, S., Liu, Z.-Q., & Chan, A. B. (2014) · International Journal of Computer Vision · doi:10.1007/s11263-014-0767-8 · Cited by 185
Exploring Context and Content Links in Social Media: A Latent Space Method
Qi, G.-J., Aggarwal, C. C., Tian, Q., Ji, H., & Huang, T. S. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.191 · Cited by 158
ChaLearn Looking at People 2015: Apparent Age and Cultural Event Recognition Datasets and Results
Escalera, S., Fabián, J., Pardo, P. L., Baró, X., Gonzàlez, J., Escalante, H. J., Misevic, D., Steiner, U. K., & Guyon, I. (2015) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2015.40 · Cited by 149
ChaLearn Looking at People and Faces of the World: Face AnalysisWorkshop and Challenge 2016
Escalera, S., Bagheri, M. A., Valstar, M., Torres, M. T., Martínez, B., Baró, X., Escalante, H. J., Guyon, I., Tzimiropoulos, G., Corneanu, C. A., et al. (2016) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.93 · Cited by 109
Face attribute prediction using off-the-shelf CNN features
Zhong, Y., Sullivan, J., & Li, H. (2016) · International Conference on Biometrics · doi:10.1109/icb.2016.7550092 · Cited by 100
Scalable Face Image Retrieval with Identity-Based Quantization and Multireference Reranking
Wu, Z., Ke, Q., Sun, J. Z., & Shum, H. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.111 · Cited by 98
Facial Attributes Classification Using Multi-task Representation Learning
Ehrlich, M., Shields, T. J., Almaev, T. R., & Amer, M. R. (2016) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.99 · Cited by 95
A framework for joint estimation of age, gender and ethnicity on a large database
Guo, G., & Mu, G. (2014) · Image and Vision Computing · doi:10.1016/j.imavis.2014.04.011 · Cited by 94
A Deep Sum-Product Architecture for Robust Facial Attributes Analysis
Luo, P., Wang, X., & Tang, X. (2013) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2013.356 · Cited by 84
Demographic Analysis from Biometric Data: Achievements, Challenges, and New Frontiers
Sun, Y., Zhang, M., Sun, Z., & Tan, T. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2669035 · Cited by 75
Gender and Smile Classification Using Deep Convolutional Neural Networks
Zhang, K., Tan, L., Li, Z., & Qiao, Y. (2016) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.97 · Cited by 63
Learning semantic distance from community-tagged media collection
Qi, G.-J., Hua, X., & Zhang, H.-J. (2009) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1631272.1631307 · Cited by 60
Structured Output SVM Prediction of Apparent Age, Gender and Smile from Deep Features
Uřičář, M., Timofte, R., Rothe, R., et al. (2016) · IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.96 · Cited by 60
Web Image and Video Mining Towards Universal and Robust Age Estimator
Ni, B., Zheng, S., & Yan, S. (2011) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2011.2167317 · Cited by 59
How Does Aging Affect Facial Components?
Otto, C., Han, H., & Jain, A. K. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33868-7_19 · Cited by 50
Self-citationDeep Multi-Task Learning for Joint Prediction of Heterogeneous Face Attributes
Wang, F., Han, H., Shan, S., & Chen, X. (2017) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/fg.2017.30 · Cited by 42
Self-citationChaLearn looking at people: A review of events and resources
Escalera, S., Baró, X., Escalante, H. J., & Guyon, I. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966041 · Cited by 38
Attributes for Improved Attributes: A Multi-Task Network for Attribute ClassificationPreprint
Hand, E., & Chellappa, R. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.07360 · Cited by 25
DeepBE: Learning Deep Binary Encoding for Multi-label Classification
Li, C., Kang, Q., Ge, G., Song, Q., Lu, H., & Cheng, J. (2016) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.98 · Cited by 19
Cited by
Karkkainen, K., & Joo, J. (2021) · 2021 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv48630.2021.00159 · Cited by 527
Xu, D., Ouyang, W., Wang, X., & Sebe, N. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00077 · Cited by 518
Gao, Y., Ma, J., Zhao, M., Liu, W., & Yuille, A. L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00332 · Cited by 284
Deep Learning for Biometrics: A Survey
Sundararajan, K., & Woodard, D. L. (2019) · ACM Computing Surveys · doi:10.1145/3190618 · Cited by 275
Distributed Deep Learning Model for Intelligent Video Surveillance Systems with Edge Computing
Chen, J., Li, K., Deng, Q., Li, K., & Yu, P. S. (2024) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2909473 · Cited by 253
Metadata
- Authors
- Han, H., Jain, A. K., Wang, F., Shan, S., & Chen, X.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2018-11-01
- Volume
- 40
- Issue
- 11
- Pages
- 2597-2609
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- 1939-3539
- OpenAlex
- W2962786991
- Cited by
- 278
- References
- 56
- FWCI
- 16.51
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.