The DOI matches its Crossref record; 148 of the 148 references it cites were found in a registry or an index.
Face recognition: A literature survey
Abstract
As one of the most successful applications of image analysis and understanding, face recognition has recently received significant attention, especially during the past several years. At least two reasons account for this trend: the first is the wide range of commercial and law enforcement applications, and the second is the availability of feasible technologies after 30 years of research. Even though current machine recognition systems have reached a certain level of maturity, their success is limited by the conditions imposed by many real applications. For example, recognition of face images acquired in an outdoor environment with changes in illumination and/or pose remains a largely unsolved problem. In other words, current systems are still far away from the capability of the human perception system.This paper provides an up-to-date critical survey of still- and video-based face recognition research. There are two underlying motivations for us to write this survey paper: the first is to provide an up-to-date review of the existing literature, and the second is to offer some insights into the studies of machine recognition of faces. To provide a comprehensive survey, we not only categorize existing recognition techniques but also present detailed descriptions of representative methods within each category. In addition, relevant topics such as psychophysical studies, system evaluation, and issues of illumination and pose variation are covered.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
Rapid object detection using a boosted cascade of simple features
Viola, P., & Jones, M. (2005) · Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001 · doi:10.1109/cvpr.2001.990517 · Cited by 18,300
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · doi:10.1109/cvpr.1993 · Cited by 17,667
Turk, M., & Pentland, A. (1991) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1991.3.1.71 · Cited by 13,733
Eigenfaces vs. Fisherfaces: recognition using class specific linear projection
Belhumeur, P. N., Hespanha, J. P., & Kriegman, D. J. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598228 · Cited by 11,707
The expression of the emotions in man and animals.
Darwin, C. (1872) · J. Murray eBooks · doi:10.1037/10001-000 · Cited by 11,657
An Information-Maximization Approach to Blind Separation and Blind Deconvolution
Bell, A. J., & Sejnowski, T. J. (1995) · Neural Computation · doi:10.1162/neco.1995.7.6.1129 · Cited by 8,986
Active Shape Models-Their Training and Application
Cootes, T. F., Taylor, C. J., Cooper, D. H., & Graham, J. (1995) · Computer Vision and Image Understanding · doi:10.1006/cviu.1995.1004 · Cited by 7,190
Recognition-by-components: A theory of human image understanding.
Biederman, I. (1987) · Psychological Review · doi:10.1037/0033-295x.94.2.115 · Cited by 5,621
Cootes, T. F., Edwards, G. J., & Taylor, C. J. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.927467 · Cited by 5,409
Cited by
Items 101–140 of 140
Face recognition based on convolutional neural network
Coskun, M., Ucar, A., Yildirim, O., & Demir, Y. (2017) · 2017 International Conference on Modern Electrical and Energy Systems (MEES) · doi:10.1109/mees.2017.8248937 · Cited by 295
Independent comparative study of PCA, ICA, and LDA on the FERET data set
Delac, K., Grgic, M., & Grgic, S. (2005) · International Journal of Imaging Systems and Technology · doi:10.1002/ima.20059 · Cited by 287
Fusing Gabor and LBP Feature Sets for Kernel-Based Face Recognition
Tan, X., & Triggs, B. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-75690-3_18 · Cited by 282
Face sketch synthesis and recognition
Tang, X., & Wang, X. (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238414 · Cited by 281
Linear discriminant analysis for the small sample size problem: an overview
Sharma, A., & Paliwal, K. K. (2015) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-013-0226-9 · Cited by 279
Probabilistic recognition of human faces from video
Zhou, S., Krueger, V., & Chellappa, R. (2003) · Computer Vision and Image Understanding · doi:10.1016/s1077-3142(03)00080-8 · Cited by 277
Self-citationGabor-Based Region Covariance Matrices for Face Recognition
Pang, Y., Yuan, Y., & Li, X. (2008) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2008.924108 · Cited by 277
KinectFaceDB: A Kinect Database for Face Recognition
Min, R., Kose, N., & Dugelay, J.-L. (2014) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2014.2331215 · Cited by 274
Face recognition using discriminant locality preserving projections
Yu, W., Teng, X., & Liu, C. (2006) · Image and Vision Computing · doi:10.1016/j.imavis.2005.11.006 · Cited by 273
Locally Linear Regression for Pose-Invariant Face Recognition
Chai, X., Shan, S., Chen, X., & Gao, W. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.899195 · Cited by 272
Sequential three-way decision and granulation for cost-sensitive face recognition
Li, H., Zhang, L., Huang, B., & Zhou, X. (2016) · Knowledge-Based Systems · doi:10.1016/j.knosys.2015.07.040 · Cited by 270
Unconstrained face verification using deep CNN features
Chen, J.-C., Patel, V. M., & Chellappa, R. (2016) · 2016 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv.2016.7477557 · Cited by 269
Self-citationFace Recognition: A Literature Review
Tolba, A. S., El-Baz, A. H., & El-Harby, A. A. (2008) · doi:10.5281/zenodo.1334651 · Cited by 265
ViBand: High-Fidelity Bio-Acoustic Sensing Using Commodity Smartwatch Accelerometers
Laput, G., Xiao, R., & Harrison, C. (2016) · Proceedings of the 29th Annual Symposium on User Interface Software and Technology · doi:10.1145/2984511.2984582 · Cited by 265
A survey on generative adversarial networks for imbalance problems in computer vision tasks
Sampath, V., Maurtua, I., Aguilar Martín, J. J., & Gutierrez, A. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00414-0 · Cited by 259
Regularized Robust Coding for Face Recognition
Yang, M., Zhang, L., Yang, J., & Zhang, D. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2235849 · Cited by 259
Machine Analysis of Facial Expressions
Pantic, M., & Stewart, M. (2007) · Face Recognition · doi:10.5772/4847 · Cited by 248
“For surveys of computer vision efforts aimed at face recognition, the readers are referred to: Zhao et al. (2003), Bowyer (2004), and Li and Jain (2005).”
Physiology-Based Face Recognition in the Thermal Infrared Spectrum
Buddharaju, P., Pavlidis, I. T., Tsiamyrtzis, P., & Bazakos, M. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1007 · Cited by 236
“To establish feasibility, we propose a specific methodology to capture facial physiological patterns using the bioheat information contained in thermal imagery.”
MethodLearning from facial aging patterns for automatic age estimation
Geng, X., Zhou, Z.-H., Zhang, Y., Li, G., & Dai, H. (2006) · Proceedings of the 14th ACM international conference on Multimedia · doi:10.1145/1180639.1180711 · Cited by 207
3D Face Recognition Using Simulated Annealing and the Surface Interpenetration Measure
Queirolo, C. C., Silva, L., Bellon, O. R. P., & Segundo, M. P. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.14 · Cited by 201
Thermistor at a Distance: Unobtrusive Measurement of Breathing
Fei, J., & Pavlidis, I. (2010) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2009.2032415 · Cited by 201
How Sexually Dimorphic Are Human Mate Preferences?
Conroy-Beam, D., Buss, D. M., Pham, M. N., & Shackelford, T. K. (2015) · Personality and Social Psychology Bulletin · doi:10.1177/0146167215590987 · Cited by 187
“Email: dconroybeam@utexas.edu”
Cloudlets: at the Leading Edge of Mobile-Cloud Convergence
Satyanarayanan, M., Chen, Z., Ha, K., Hu, W., Richter, W., & Pillai, P. (2014) · Proceedings of the 6th International Conference on Mobile Computing, Applications and Services · doi:10.4108/icst.mobicase.2014.257757 · Cited by 165
A survey of biometric technology based on hand shape
Duta, N. (2009) · Pattern Recognition · doi:10.1016/j.patcog.2009.02.007 · Cited by 165
Efficient Large-Scale Multi-Modal Classification
Kiela, D., Grave, E., Joulin, A., & Mikolov, T. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11945 · Cited by 177
Investigating Spontaneous Facial Action Recognition through AAM Representations of the Face
Lucey, S., Bilal, A., & F., J. (2007) · Face Recognition · doi:10.5772/4841 · Cited by 161
Artificial intelligence surgery: how do we get to autonomous actions in surgery?
Gumbs, A. A., Frigerio, I., Spolverato, G., Croner, R., Illanes, A., Chouillard, E., & Elyan, E. (2021) · Sensors · doi:10.3390/s21165526 · Cited by 161
“These methods and their extensions have significantly advanced this area of research and solved some of the most challenging and inherent vision problems, such as occlusions, light conditions, and orientation, among others, which were considered major challenges, even for a specific vision task in a more controlled en…”
BackgroundWiley, R. H. (2013) · Biological Reviews · doi:10.1111/j.1469-185x.2012.00246.x · Cited by 136
“, 2011), a subject with clear relevance to the continuing interest in machine recognition of faces (Zhao et al., 2003; Tsao & Livingstone, 2008).”
BackgroundA Study of Face Recognition as People Age
Ling, H., Soatto, S., Ramanathan, N., & Jacobs, D. W. (2007) · 2007 IEEE 11th International Conference on Computer Vision · doi:10.1109/iccv.2007.4409069 · Cited by 101
Objective 3D face recognition: Evolution, approaches and challenges
Smeets, D., Claes, P., Vandermeulen, D., & Clement, J. G. (2010) · Forensic Science International · doi:10.1016/j.forsciint.2010.03.023 · Cited by 90
A Face Recognition Application for People with Visual Impairments: Understanding Use Beyond the Lab
Zhao, Y., Wu, S., Reynolds, L., & Azenkot, S. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173789 · Cited by 84
“State-of-the-art computer vision algorithms can detect [31,39,57] and recognize faces [19,43,60] in the presence of blur, occlusion, noise, and with different poses and lighting conditions.”
BackgroundA survey of the effects of aging on biometric identity verification
Lanitis, A. (2010) · International Journal of Biometrics · doi:10.1504/ijbm.2010.030415 · Cited by 75
Human Facial Expression Recognition using a 3D Morphable Model
Ramanathan, S., Kassim, A., Venkatesh, Y. V., & Wah, W. S. (2006) · 2006 International Conference on Image Processing · doi:10.1109/icip.2006.312417 · Cited by 62
“, recognition has turned out to be difficult [1].”
BackgroundMultimodal interfaces: Challenges and perspectives
Sebe, N. (2009) · Journal of Ambient Intelligence and Smart Environments · doi:10.3233/ais-2009-0003 · Cited by 57
3D Assisted Face Recognition: A Survey of 3D Imaging, Modelling and Recognition Approachest
Kittler, J., Hilton, A., Hamouz, M., & Illingworth, J. (2006) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops · doi:10.1109/cvpr.2005.377 · Cited by 45
Unsupervised detection and tracking of moving objects for video surveillance applications
Elafi, I., Jedra, M., & Zahid, N. (2016) · Pattern Recognition Letters · doi:10.1016/j.patrec.2016.08.008 · Cited by 37
A Validated Method for Dense Non-rigid 3D Face Registration
Tena, J., Hamouz, M., Hilton, A., & Illingworth, J. (2006) · 2006 IEEE International Conference on Video and Signal Based Surveillance · doi:10.1109/avss.2006.15 · Cited by 32
Enhancing CCTV: Averages improve face identification from poor-quality images
Ritchie, K. L., White, D., Kramer, R. S. S., Noyes, E., Jenkins, R., & Burton, A. M. (2018) · Applied Cognitive Psychology · doi:10.1002/acp.3449 · Cited by 18
The Role of the Human Operator in Image-Based Airport Security Technologies
Graves, I., Butavicius, M., MacLeod, V., Heyer, R., Parsons, K., Kuester, N., McCormac, A., Jacques, P., & Johnson, R. (2011) · Studies in Computational Intelligence · doi:10.1007/978-3-642-17764-4_5 · Cited by 16
AttAuth: An implicit authentication framework for smartphone users using multimodality data
Zhao, C., Gao, F., & Shen, Z. (2024) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3314717 · Cited by 10
Metadata
- Authors
- Zhao, W., Chellappa, R., Phillips, P. J., & Rosenfeld, A.
- Venue
- ACM Computing Surveys
- Published
- 2003-12
- Volume
- 35
- Issue
- 4
- Pages
- 399-458
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W1989702938
- Cited by
- 6,163
- References
- 148
- FWCI
- 267.35
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.