Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks
Open accessThe DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
Face detection and alignment in unconstrained environment are challenging due to various poses, illuminations, and occlusions. Recent studies show that deep learning approaches can achieve impressive performance on these two tasks. In this letter, we propose a deep cascaded multitask framework that exploits the inherent correlation between detection and alignment to boost up their performance. In particular, our framework leverages a cascaded architecture with three stages of carefully designed deep convolutional networks to predict face and landmark location in a coarse-to-fine manner. In addition, we propose a new online hard sample mining strategy that further improves the performance in practice. Our method achieves superior accuracy over the state-of-the-art techniques on the challenging face detection dataset and benchmark and WIDER FACE benchmarks for face detection, and annotated facial landmarks in the wild benchmark for face alignment, while keeps real-time performance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Recently, jointly modeling face detection with other auxiliary tasks including face alignment, pose estimation, and gender classification, can achieve improved performance, owing to the extra abundant supervisory signals for learning a shared discriminative feature representation [96], [97].”
From Empowering things with intelligence: a survey of the progress, challenges, and opportunities in artificial intelligence of things (2021) · cites this paper as [96]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Some works (Dai et al., 2021; Liang et al., 2021; Hu et al., 2021; Zhao et al., 2022b) also extract facial representations using various tools, such as MTCNN (Zhang et al., 2016).”
From A Facial Expression-Aware Multimodal Multi-task Learning Framework for Emotion Recognition in Multi-party Conversations (2023) · cites this paper as Zhang et al., 2016
The cited source says what the claim attributes to it.
In the citing paper
“In recent years, cascaded detection has been especially applied to those detection tasks of 'small objects in large scenes', e.g., face detection [126, 127], pedestrian detection [101, 124, 128], etc.”
From Object Detection in 20 Years: A Survey (2023) · cites this paper as [127]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Robust Real-Time Face Detection
Viola, P., & Jones, M. J. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000013087.49260.fb · Cited by 14,097
Deep Learning Face Attributes in the Wild
Liu, Z., Luo, P., Wang, X., & Tang, X. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.425 · Cited by 7,747
Cootes, T. F., Edwards, G. J., & Taylor, C. J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.927467 · Cited by 5,409
Face detection, pose estimation, and landmark localization in the wild
Zhu, X., & Ramanan, D. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248014 · Cited by 2,120
Deep Learning Face Representation by Joint Identification-Verification
Sun, Y., Wang, X., & Tang, X. (2014) · arXiv · doi:10.48550/arxiv.1406.4773 · Cited by 1,906
Supervised Descent Method and Its Applications to Face Alignment
Xiong, X., & De la Torre, F. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.75 · Cited by 1,896
WIDER FACE: A Face Detection Benchmark
Yang, S., Luo, P., Loy, C. C., & Tang, X. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.596 · Cited by 1,830
Fast Human Detection Using a Cascade of Histograms of Oriented Gradients
Zhu, Q., Yeh, M.-C., Cheng, K.-T., & Avidan, S. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.119 · Cited by 1,399
Cited by
Items 1,001–1,025 of 1,025
DFGC 2021: A DeepFake Game Competition
Peng, B., Fan, H., Wang, W., Dong, J., Li, Y., Lyu, S., Li, Q., Sun, Z., Chen, H., Chen, B., et al. (2021) · 2021 IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb52358.2021.9484387 · Cited by 23
“Faces are detected by MTCNN [28].”
MethodInfluentialMissing the Forest for the Trees: End-to-End AI Application Performance in Edge Data Centers
Richins, D., Doshi, D., Blackmore, M., Thulaseedharan Nair, A., Pathapati, N., Patel, A., Daguman, B., Dobrijalowski, D., Illikkal, R., Long, K., et al. (2020) · 2020 IEEE International Symposium on High Performance Computer Architecture (HPCA) · doi:10.1109/hpca47549.2020.00049 · Cited by 23
“The Face Recognition application consists of four primary processing stages (Figure 1a) and is built from MT-CNNs (multi-task cascaded convolutional networks) [25] along with Google’s FaceNet [13, 26].”
MethodDeepfakes Detection Methods: A Literature Survey
Weerawardana, M., & Fernando, T. (2021) · 2021 10th International Conference on Information and Automation for Sustainability (ICIAfS) · doi:10.1109/iciafs52090.2021.9606067 · Cited by 23
Stacked Dense U-Nets with Dual Transformers for Robust Face Alignment
Guo, J., Deng, J., Xue, N., & Zafeiriou, S. P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.01936 · Cited by 23
DeSI: Deepfake Source Identifier for Social Media
Narayan, K., Agarwal, H., Mittal, S., Thakral, K., Kundu, S., Vatsa, M., & Singh, R. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00323 · Cited by 21
Likelihood ratios for deep neural networks in face comparison
Macarulla Rodriguez, A., Geradts, Z., & Worring, M. (2020) · Journal of Forensic Sciences · doi:10.1111/1556-4029.14324 · Cited by 21
Erdem Güler, S., & Patlar Akbulut, F. (2025) · IEEE Access · doi:10.1109/access.2025.3538642 · Cited by 21
Realtime Vehicle Tracking Method Based on YOLOv5 + DeepSORT
Lin, L., He, H., Xu, Z., & Wu, D. (2023) · Computational Intelligence and Neuroscience · doi:10.1155/2023/7974201 · Cited by 18
“Traditional target detection algorithms rely on image features and classifers such as SVM (support vector machine) [16], Adaboost [17], Random Forest [18], artifcially designed color features [19], gradient features [20], and pattern features [21].”
Automatic Attendance Management System based on Deep One-Shot Learning
Menezes, A. G., Sa, J. M. D. D. C., Llapa, E., & Estombelo-Montesco, C. A. (2020) · 2020 International Conference on Systems, Signals and Image Processing (IWSSIP) · doi:10.1109/iwssip48289.2020.9145230 · Cited by 16
“Even though this problem presents itself as a simple binary classification, several face detection algorithms need to be trained exhaustively so that they can give good results [10].”
BackgroundFace Recognition in Children: A Longitudinal Study
Bahmani, K., & Schuckers, S. (2022) · 2022 International Workshop on Biometrics and Forensics (IWBF) · doi:10.1109/iwbf55382.2022.9794551 · Cited by 15
Katı, B. E., Küçüksille, E. U., & Sarıman, G. (2025) · Applied Sciences · doi:10.3390/app15020525 · Cited by 12
Atamna, M., Tkachenko, I., & Miguet, S. (2023) · 2023 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip49359.2023.10222043 · Cited by 8
“For each video, the first 120 frames are extracted, and the MTCNN [19] face detector is used to crop the subject’s face in each frame.”
Yao, W., Farooq, M. A., Lemley, J., & Corcoran, P. (2023) · IEEE Access · doi:10.1109/access.2023.3312612 · Cited by 8
Mining Generalized Multi-timescale Inconsistency for Detecting Deepfake Videos
Yu, Y., Ni, R., Yang, S., Ni, Y., Zhao, Y., & Kot, A. C. (2025) · International Journal of Computer Vision · doi:10.1007/s11263-024-02249-7 · Cited by 7
“For each dataset, we use face detector MTCNN (Zhang et al., 2016) for face extraction.”
Efficient Facial Expression Recognition Through Lightweight CNN Technique on Public Datasets
Grover, R., & Bansal, S. (2024) · SN Computer Science · doi:10.1007/s42979-024-03557-y · Cited by 6
Attention-based Multimodal learning framework for Generalized Audio-Visual Deepfake Detection
Masood, M., Javed, A., & Irtaza, A. (2023) · Preprint (Research Square) · doi:10.21203/rs.3.rs-3415144/v1 · Cited by 6
Longitudinal Evaluation of Child Face Recognition and the Impact of Underlying Age
Singh, S., Bahmani, K., & Schuckers, S. (2024) · 2024 IEEE International Joint Conference on Biometrics (IJCB) · doi:10.1109/ijcb62174.2024.10744505 · Cited by 5
“MTCNN (Multi-Task Cascaded Convolutional Neural Network) face detection model, as referenced in [19] was employed to accurately detect and align faces.”
MethodCan Deepfakes be created on a whim?
Mehta, P., Jagatap, G., Gallagher, K., Timmerman, B., Deb, P., Garg, S., Greenstadt, R., & Dolan-Gavitt, B. (2023) · Companion Proceedings of the ACM Web Conference 2023 · doi:10.1145/3543873.3587581 · Cited by 5
Child Face Age-Progression via Deep Feature Aging
Deb, D., Aggarwal, D., & Jain, A. K. (2020) · arXiv · doi:10.48550/arxiv.2003.08788 · Cited by 4
Bhattacharyya, C., Wang, H., Zhang, F., Kim, S., & Zhu, X. (2024) · arXiv · doi:10.48550/arxiv.2404.01579 · Cited by 4
Lu, C.-K., Lu, C.-W., & Bo Lin, G. (2026) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2025.3621086 · Cited by 4
Atamna, M., Tkachenko, I., & Miguet, S. (2025) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-88223-4_16 · Cited by 1
Quantitative Metrics for Evaluating Explanations of Video DeepFake Detectors
Baldassarre, F., Debard, Q., Pontiveros, G. F., & Wijaya, T. K. (2022) · arXiv · doi:10.48550/arxiv.2210.03683 · Cited by 1
“[92] Kaipeng Zhang, Zhanpeng Zhang, Zhifeng Li, and Yu Qiao.”
BackgroundMethodEdge-Constrained Video Analytics: A Comprehensive Survey on Detection, Tracking, and Recognition
Toshpulatov, M. A., Lee, W., & Cho, J. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6614394
Cross-Age LFW: A Database for Studying Cross-Age Face Recognition in Unconstrained Environments
Zheng, T., Deng, W., & Hu, J. (2017) · arXiv · doi:10.48550/arxiv.1708.08197
Metadata
- Authors
- Zhang, K., Zhang, Z., Li, Z., & Qiao, Y.
- Affiliations
- Chinese Academy of Sciences (CN)
- Chinese University of Hong Kong (HK)
- Venue
- IEEE Signal Processing Letters
- Published
- 2016-10
- Volume
- 23
- Issue
- 10
- Pages
- 1499-1503
- ISSN
- 1070-9908 (ISSN-L)
- 1558-2361
- OpenAlex
- W2341528187
- Semantic Scholar
- 9e60942aa15670ed9ee03af3c0ae011fa4966b7c
- Cited by
- 6,214
- References
- 29
- Citations by year
- 2026: 411 · 2025: 634 · 2024: 668 · 2023: 833 · 2022: 851 · 2021: 966 · 2020: 735 · 2019: 649 · 2018: 334 · 2017: 123 · 2016: 9
- FWCI
- 252.26
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Signal Processing Letters (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- External Cooperation Program of BIC
- Chinese Academy of Sciences (172644KYSB20160033, 172644KYSB20150019)
- Shenzhen Research Program (KQCX2015033117354153, JSGG20150925164740726, CXZZ20150930104115529, CYJ20150925163005055, JCYJ201 60510154736343)
- Guangdong Research Program (2014B050505017, 2015B010129013)
- Natural Science Foundation of Guangdong Province (2014A030313688)
- Key Laboratory of Human Machine Intelligence-Synergy Systems
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
- Keywords
- face detection, facial landmark detection, multi-task learning, coarse-to-fine detection, occlusion handling, real-time face detection
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.