The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
An Efficient Multimodal 2D-3D Hybrid Approach to Automatic Face Recognition
Abstract
We present a fully automatic face recognition algorithm and demonstrate its performance on the FRGC v2.0 data. Our algorithm is multimodal (2D and 3D) and performs hybrid (feature-based and holistic) matching in order to achieve efficiency and robustness to facial expressions. The pose of a 3D face along with its texture is automatically corrected using a novel approach based on a single automatically detected point and the Hotelling transform. A novel 3D Spherical Face Representation (SFR) is used in conjunction with the SIFT descriptor to form a rejection classifier which quickly eliminates a large number of candidate faces at an early stage for efficient recognition in case of large galleries. The remaining faces are then verified using a novel region-based matching approach which is robust to facial expressions. This approach automatically segments the eyes-forehead and the nose regions, which are relatively less sensitive to expressions, and matches them separately using a modified ICP algorithm. The results of all the matching engines are fused at the metric level to achieve higher accuracy. We use the FRGC benchmark to compare our results to other algorithms which used the same database. Our multimodal hybrid algorithm performed better than others by achieving 99.74% and 98.31% verification rates at 0.001 FAR and identification rates of 99.02% and 95.37% for probes with neutral and non-neutral expression respectively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
A method for registration of 3-D shapes
Besl, P. J., & McKay, N. D. (1992) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.121791 · Cited by 18,103
Robust Real-Time Face Detection
Viola, P., & Jones, M. J. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000013087.49260.fb · Cited by 14,097
Turk, M., & Pentland, A. (1991) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1991.3.1.71 · Cited by 13,733
Eigenfaces vs. Fisherfaces: recognition using class specific linear projection
Belhumeur, P. N., Hespanha, J. P., & Kriegman, D. J. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598228 · Cited by 11,707
Face recognition: A literature survey
Zhao, W., Chellappa, R., Phillips, P. J., & Rosenfeld, A. (2003) · ACM Computing Surveys · doi:10.1145/954339.954342 · Cited by 6,163
An introduction to biometric recognition
Jain, A. K., Ross, A., & Prabhakar, S. (2004) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2003.818349 · Cited by 4,974
Least-Squares Fitting of Two 3-D Point Sets
Arun, K. S., Huang, T. S., & Blostein, S. D. (1987) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1987.4767965 · Cited by 3,952
Face recognition by elastic bunch graph matching
Wiskott, L., Fellous, J.-M., Kuiger, N., & von der Malsburg, C. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598235 · Cited by 2,883
Using spin images for efficient object recognition in cluttered 3D scenes
Johnson, A. E., & Hebert, M. (1999) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.765655 · Cited by 2,599
Overview of the Face Recognition Grand Challenge
Phillips, P. J., Flynn, P. J., Scruggs, T., Bowyer, K. W., Chang, J., Hoffman, K., Marques, J., Min, J., & Worek, W. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.268 · Cited by 2,438
Brinkmann, K.-D. (1991) · Police Research in the Federal Republic of Germany · doi:10.1007/978-3-642-74176-0_23 · Cited by 2,389
View-based and modular eigenspaces for face recognition
Pentland, Moghaddam, & Starner (1994) · Proceedings of IEEE Conference on Computer Vision and Pattern Recognition CVPR-94 · doi:10.1109/cvpr.1994.323814 · Cited by 1,800
Face Recognition by Elastic Bunch Graph Matching*†
Wiskott, L., Fellous, J.-M., Krüger, N., & von der Malsburg, C. (2022) · INTELLIGENT BIOMETRIC TECHNIQUES in FINGERPRINT and FACE RECOGNITION · doi:10.1201/9780203750520-11 · Cited by 1,781
Probabilistic visual learning for object representation
Moghaddam, B., & Pentland, A. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598227 · Cited by 1,441
A survey of approaches and challenges in 3D and multi-modal 3D+2D face recognition
Bowyer, K. W., Chang, K., & Flynn, P. (2006) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2005.05.005 · Cited by 979
Jain, A. K., Lin, H., & Pankanti, S. (2000) · Communications of the ACM · doi:10.1145/328236.328110 · Cited by 734
Point Signatures: A New Representation for 3D Object Recognition
Chua, C. S., & Jarvis, R. (1997) · International Journal of Computer Vision · doi:10.1023/a:1007981719186 · Cited by 587
Three-Dimensional Model-Based Object Recognition and Segmentation in Cluttered Scenes
Mian, A. S., Bennamoun, M., & Owens, R. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.213 · Cited by 502
Self-citationThree-Dimensional Face Recognition
Bronstein, A. M., Bronstein, M. M., & Kimmel, R. (2005) · International Journal of Computer Vision · doi:10.1007/s11263-005-1085-y · Cited by 424
Support vector machines applied to face recognition
Phillips, P. J. (1998) · doi:10.6028/nist.ir.6241 · Cited by 389
Matching 2.5D face scans to 3D models
Lu, X., Jain, A. K., & Colbry, D. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.15 · Cited by 339
Component-Based Face Recognition with 3D Morphable Models
Weyrauch, B., Heisele, B., Huang, J., & Blanz, V. (2005) · 2004 Conference on Computer Vision and Pattern Recognition Workshop · doi:10.1109/cvpr.2004.315 · Cited by 330
Automatic face identification system using flexible appearance models
Lanitis, A., Taylor, C., & Cootes, T. (1995) · Image and Vision Computing · doi:10.1016/0262-8856(95)99726-h · Cited by 328
Evolutionary pursuit and its application to face recognition
Liu, C., & Wechsler, H. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.862196 · Cited by 323
Independent component representations for face recognition:
Stewart Bartlett, M., Lades, M. H., & Sejnowski, T. J. (1998) · SPIE Proceedings · doi:10.1117/12.320144 · Cited by 316
HMM-based architecture for face identification
Samaria, F., & Young, S. (1994) · Image and Vision Computing · doi:10.1016/0262-8856(94)90007-8 · Cited by 299
3D human face recognition using point signature
Chua, C.-S., Han, F., & Ho, Y.-K. (2002) · Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580) · doi:10.1109/afgr.2000.840640 · Cited by 289
Feature-based face recognition using mixture-distance
Cox, I. J., Ghosn, J., & Yianilos, P. N. (1996) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.1996.517076 · Cited by 240
Mian, A. S., Bennamoun, M., & Owens, R. A. (2006) · International Journal of Computer Vision · doi:10.1007/s11263-005-3221-0 · Cited by 198
Self-citationPreliminary Face Recognition Grand Challenge Results
Phillips, P. J., Flynn, P. J., Scruggs, T., Bowyer, K. W., & Worek, W. (2006) · 7th International Conference on Automatic Face and Gesture Recognition (FGR06) · doi:10.1109/fgr.2006.87 · Cited by 167
Face recognition using 2D and 3D facial data
Chang, K. I., Bowyer, K. W., & Flynn, P. J. (2003) · Cited by 151
Empirical Evaluation of Advanced Ear Biometrics
Yan, P., & Bowyer, K. W. (2006) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvpr.2005.450 · Cited by 145
Component-Based Face Recognition with 3D Morphable Models
Huang, J. C., Heisele, B., & Blanz, V. (2003) · Lecture notes in computer science · doi:10.1007/3-540-44887-x_4 · Cited by 140
Strategies and Benefits of Fusion of 2D and 3D Face Recognition
Hüsken, M., Brauckmann, M., Gehlen, S., & von der Malsburg, C. (2006) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvpr.2005.584 · Cited by 140
Performance of Geometrix ActiveID^TM 3D Face Recognition Engine on the FRGC Data
Maurer, T., Guigonis, D., Maslov, I. V., Pesenti, B., Tsaregorodtsev, A., West, D., & Medioni, G. G. (2006) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvpr.2005.581 · Cited by 125
Adaptive Rigid Multi-region Selection for Handling Expression Variation in 3D Face Recognition
Chang, K. I., Bowyer, K. W., & Flynn, P. J. (2006) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvpr.2005.567 · Cited by 112
Passalis, G., Kakadiaris, I. A., Theoharis, T., Toderici, G. D., & Murtuza, N. (2006) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvpr.2005.573 · Cited by 111
Neugebauer, P. J. (1997) · International Journal of Shape Modeling · doi:10.1142/s0218654397000070 · Cited by 110
Xu, C., Wang, Y., Tan, T., & Quan, L. (2004) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2004.1301549 · Cited by 110
Multimodal 2D and 3D biometrics for face recognition
Chang, K. I., Bowyer, K. W., & Flynn, P. J. (2004) · IEEE International SOI Conference (SOI) · doi:10.1109/amfg.2003.1240842 · Cited by 103
Automatic 3D Face Detection, Normalization and Recognition
Mian, A. S., Bennamoun, M., & Owens, R. A. (2006) · International Symposium on 3D Data Processing, Visualization and Transmission · doi:10.1109/3dpvt.2006.32 · Cited by 76
Self-citationRecognize High Resolution Faces: From Macrocosm to Microcosm
Lin, D., & Tang, X. (2006) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2006.243 · Cited by 69
Region-based Matching for Robust 3D Face Recognition
Mian, A. S., Bennamoun, M., & Owens, R. A. (2005) · British Machine Vision Conference (BMVC) · doi:10.5244/c.19.33 · Cited by 25
Self-citation
Cited by
Face Recognition Systems: A Survey
Kortli, Y., Jridi, M., Al Falou, A., & Atri, M. (2020) · Sensors · doi:10.3390/s20020342 · Cited by 623
Partial Face Recognition: Alignment-Free Approach
Liao, S., Jain, A. K., & Li, S. Z. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.191 · Cited by 313
3D Face Recognition Using Simulated Annealing and the Surface Interpenetration Measure
Queirolo, C. C., Silva, L., Bellon, O. R. P., & Segundo, M. P. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.14 · Cited by 201
3D facial expression recognition using SIFT descriptors of automatically detected keypoints
Berretti, S., Ben Amor, B., Daoudi, M., & del Bimbo, A. (2011) · The Visual Computer · doi:10.1007/s00371-011-0611-x · Cited by 138
3-D Face Detection, Landmark Localization, and Registration Using a Point Distribution Model
Nair, P., & Cavallaro, A. (2009) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2009.2017629 · Cited by 135
Metadata
- Authors
- Mian, A., Bennamoun, M., & Owens, R.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2007-11
- Volume
- 29
- Issue
- 11
- Pages
- 1927-1943
- ISSN
- 0162-8828 (ISSN-L)
- OpenAlex
- W2166335841
- Cited by
- 470
- References
- 44
- FWCI
- 41.46
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.