3D Face Recognition Using Simulated Annealing and the Surface Interpenetration Measure
Abstract
This paper presents a novel automatic framework to perform 3D face recognition. The proposed method uses a Simulated Annealing-based approach (SA) for range image registration with the Surface Interpenetration Measure (SIM), as similarity measure, in order to match two face images. The authentication score is obtained by combining the SIM values corresponding to the matching of four different face regions: circular and elliptical areas around the nose, forehead, and the entire face region. Then, a modified SA approach is proposed taking advantage of invariant face regions to better handle facial expressions. Comprehensive experiments were performed on the FRGC v2 database, the largest available database of 3D face images composed of 4,007 images with different facial expressions. The experiments simulated both verification and identification systems and the results compared to those reported by state-of-the-art works. By using all of the images in the database, a verification rate of 96.5 percent was achieved at a False Acceptance Rate (FAR) of 0.1 percent. In the identification scenario, a rank-one accuracy of 98.4 percent was achieved. To the best of our knowledge, this is the highest rank-one score ever achieved for the FRGC v2 database when compared to results published in the literature.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
Optimization by Simulated Annealing
Kirkpatrick, S., Gelatt, C. D., & Vecchi, M. P. (1983) · Science · doi:10.1126/science.220.4598.671 · Cited by 45,134 · see citing works
A Method for Registration of 3-D Shapes
Besl, P., & Mckay, N. D. (1992) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.121791 · Cited by 22,163 · see citing works
Zhao, W., Chellappa, R., Phillips, P. J., & Rosenfeld, A. (2003) · ACM Computing Surveys · doi:10.1145/954339.954342 · Cited by 6,174 · see citing works
Kittler, J., Hatef, M., Duin, R. P. W., & Matas, J. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.667881 · Cited by 5,312 · see citing works
Efficient variants of the ICP algorithm
Rusinkiewicz, S., & Levoy, M. (2002) · Proceedings Third International Conference on 3-D Digital Imaging and Modeling · doi:10.1109/im.2001.924423 · Cited by 3,945 · see citing works
Overview of the Face Recognition Grand Challenge
Phillips, P. J., Flynn, P. J., Scruggs, T., Bowyer, K. W., Chang, J., Hoffman, K., Marques, J., Min, J., & Worek, W. J. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2005.268 · Cited by 2,493 · see citing works
MLESAC: A New Robust Estimator with Application to Estimating Image Geometry
Torr, P. H. S., & Zisserman, A. (2000) · Computer Vision and Image Understanding · doi:10.1006/cviu.1999.0832 · Cited by 2,402 · see citing works
A survey of approaches and challenges in 3D and multi-modal 3D+2D face recognition
Bowyer, K. W., Chang, K. J., & Flynn, P. J. (2005) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2005.05.005 · Cited by 982 · see citing works
2D and 3D face recognition: A survey
Abate, A. F., Nappi, M., Riccio, D., & Sabatino, G. (2007) · Pattern Recognition Letters · doi:10.1016/j.patrec.2006.12.018 · Cited by 875 · see citing works
Martı́nez, A. M. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2002.1008382 · Cited by 816 · see citing works
Convergence of an annealing algorithm
Lundy, M. E., & Mees, A. I. (1986) · Mathematical Programming · doi:10.1007/bf01582166 · Cited by 702 · see citing works
Bolle, R. M., Connell, J. H., Pankanti, S., et al. (2004) · Springer eBooks · doi:10.1007/978-1-4757-4036-3 · Cited by 592 · see citing works
An Efficient Multimodal 2D-3D Hybrid Approach to Automatic Face Recognition
Mian, A. S., Bennamoun, M., & Owens, R. A. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1105 · Cited by 469 · see citing works
Modern Heuristic Search Methods
Rayward-Smith, V. J., Osman, I. H., Reeves, C. R., et al. (1996) · Cited by 459 · see citing works
Kakadiaris, I. A., Passalis, G., Toderici, G. D., et al. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1017 · Cited by 446 · see citing works
Multiple Nose Region Matching for 3D Face Recognition under Varying Facial Expression
Chang, K. I., Bowyer, K. W., & Flynn, P. J. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.210 · Cited by 362 · see citing works
Geometrically stable sampling for the ICP algorithm
Gelfand, N., Ikemoto, L., Rusinkiewicz, S. M., et al. (2004) · doi:10.1109/im.2003.1240258 · Cited by 354 · see citing works
Matching 2.5D face scans to 3D models
Lu, X., Jain, A. K., & Colbry, D. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.15 · Cited by 338 · see citing works
Component-Based Face Recognition with 3D Morphable Models
Weyrauch, B., Heisele, B., Huang, J., & Blanz, V. (2005) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvpr.2004.315 · Cited by 332 · see citing works
A Region Ensemble for 3-D Face Recognition
Faltemier, T. C., Bowyer, K. W., & Flynn, P. J. (2008) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2007.916287 · Cited by 234 · see citing works
da Silva, L. T., Bellon, O. R. P., & Boyer, K. L. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.108 · Cited by 223 · see citing works
Self-citationComponent-Based Face Recognition with 3D Morphable Models
Huang, J. C., Heisele, B., & Blanz, V. (2003) · Lecture notes in computer science · doi:10.1007/3-540-44887-x_4 · Cited by 138 · see citing works
Strategies and Benefits of Fusion of 2D and 3D Face Recognition
Hüsken, M., Brauckmann, M., Gehlen, S., et al. (2006) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvpr.2005.584 · Cited by 136 · see citing works
Performance of Geometrix ActiveID^TM 3D Face Recognition Engine on the FRGC Data
Maurer, T., Guigonis, D., Maslov, I. V., et al. (2006) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvpr.2005.581 · Cited by 119 · see citing works
An Expression Deformation Approach to Non-rigid 3D Face Recognition
Al-Osaimi, F. R., Bennamoun, M., & Mian, A. S. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-008-0174-0 · Cited by 109 · see citing works
Using a Multi-Instance Enrollment Representation to Improve 3D Face Recognition
Faltemier, T. C., Bowyer, K. W., & Flynn, P. J. (2007) · IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS) · doi:10.1109/btas.2007.4401928 · Cited by 81 · see citing works
Deformation Modeling for Robust 3D Face Matching
Lu, X., & Jain, A. K. (2006) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2006.96 · Cited by 64 · see citing works
Automatic 3D facial segmentation and landmark detection
Segundo, M. P., Queirolo, C. C., Bellon, O. R. P., et al. (2007) · International Conference on Image Analysis and Processing · doi:10.1109/iciap.2007.4362816 · Cited by 55 · see citing works
Self-citationCombined 2D/3D Face Recognition Using Log-Gabor Templates
Cook, J., McCool, C., Chandran, V., et al. (2006) · doi:10.1109/avss.2006.35 · Cited by 51 · see citing works
Face recognition from 3d data using iterative closest point algorithm and gaussian mixture models
Cook, J., Chandran, V., Sridharan, S., et al. (2004) · International Symposium on 3D Data Processing, Visualization and Transmission · doi:10.1109/tdpvt.2004.1335279 · Cited by 45 · see citing works
Face recognition from 3D data using Iterative Closest Point algorithm and Gaussian mixture models
Cook, J., Chandran, V., Sridharan, S., et al. (2004) · QUT ePrints (Queensland University of Technology) · doi:10.1109/3dpvt.2004.57 · Cited by 37 · see citing works
Range image registration: A software platform and empirical evaluation
Dalley, G., & Flynn, P. J. (2002) · doi:10.1109/im.2001.924446 · Cited by 27 · see citing works
Robust Range Image Registration Using Genetic Algorithms and the Surface Interpenetration Measure
da Silva, L. T., Bellon, O. R. P., & Boyer, K. L. (2004) · Series in machine perception and artificial intelligence · doi:10.1142/9789812563125 · Cited by 23 · see citing works
Self-citation3D Face Recognition Under Expression Variations using Similarity Metrics Fusion
Lin, W.-Y., Wong, K.-C., Boston, N., et al. (2007) · doi:10.1109/icme.2007.4284753 · Cited by 17 · see citing works
Range image registration using enhanced genetic algorithms
da Silva, L. T., Bellon, O. R. P., Gotardo, P. F. U., et al. (2004) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2003.1246779 · Cited by 15 · see citing works
Self-citation3D Face Image Registration for Face Matching Guided by the Surface Interpenetration Measure
Bellon, O. R. P., da Silva, L. T., Queirolo, C. C., et al. (2006) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2006.313057 · Cited by 9 · see citing works
Self-citationNoise versus Facial Expression on 3D Face Recognition
Queirolo, C. C., Segundo, M. P., Bellon, O. R. P., et al. (2007) · International Conference on Image Analysis and Processing · doi:10.1109/iciap.2007.94 · Cited by 9 · see citing works
Self-citationNoise versus Facial Expression on 3D Face Recognition
Queirolo, C. C., Segundo, M. P., Bellon, O. R. P., et al. (2007) · International Conference on Image Analysis and Processing · doi:10.1109/iciap.2007.4362775 · Cited by 7 · see citing works
Self-citationRobust Range Image Registration Using Genetic Algorithms and the Surface Interpenetration Measure
da Silva, L. T., Bellon, O. R. P., & Boyer, K. L. (2004) · Series in machine perception and artificial intelligence · doi:10.1142/5714 · Cited by 7 · see citing works
Self-citationFlynn, P. J., Faltemier, T. C., & Bowyer, K. W. (2007) · Springer eBooks · doi:10.1007/978-0-387-71041-9_11 · Cited by 5 · see citing works
HIERARCHICAL EVALUATION MODEL FOR 3D FACE RECOGNITION
Drovetto, S. A., da Silva, L. T., & Bellon, O. R. P. (2008) · International Conference on Computer Vision Theory and Applications · doi:10.5220/0001087900670074 · Cited by 4 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Corneanu, C. A., Simon, M. O., Cohn, J. F., & Guerrero, S. E. (2016) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2515606 · Cited by 527 · see citing works
3D facial expression recognition using SIFT descriptors of automatically detected keypoints
Berretti, S., Ben Amor, B., Daoudi, M., & del Bimbo, A. (2011) · The Visual Computer · doi:10.1007/s00371-011-0611-x · Cited by 138 · see citing works
- Authors
- Queirolo, C. C., Silva, L., Bellon, O. R. P., & Segundo, M. P.
- Affiliations
- Universidade Federal do Paraná (BR)
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2010-02
- Volume
- 32
- Issue
- 2
- Pages
- 206-219
- ISSN
- 0162-8828 (ISSN-L)
- OpenAlex
- W2106309519
- Cited by
- 201
- References
- 41
- Citations by year
- 2024: 2 · 2023: 5 · 2022: 11 · 2021: 5 · 2020: 6 · 2019: 9 · 2018: 19 · 2017: 10 · 2016: 14 · 2015: 23 · 2014: 19 · 2013: 21 · 2012: 23
- FWCI
- 20.96
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Pattern Analysis and Machine Intelligence (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Conselho Nacional de Desenvolvimento Científico e Tecnológico
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face recognition and analysis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Face and Expression Recognition
- Physical Sciences › Computer Science › Signal Processing › Biometric Identification and Security
- Keywords
- 3D face recognition, simulated annealing, range image registration, similarity measures, facial expression robustness, face verification, face identification
- MeSH terms
- Computer Simulation, Face, Humans, Pattern Recognition, Automated, Databases, Factual, Artifacts, Imaging, Three-Dimensional, Principal Component Analysis, Biometric Identification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
