The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Discriminant Correlation Analysis: Real-Time Feature Level Fusion for Multimodal Biometric Recognition
Abstract
Information fusion is a key step in multimodal biometric systems. The fusion of information can occur at different levels of a recognition system, i.e., at the feature level, matching-score level, or decision level. However, feature level fusion is believed to be more effective owing to the fact that a feature set contains richer information about the input biometric data than the matching score or the output decision of a classifier. The goal of feature fusion for recognition is to combine relevant information from two or more feature vectors into a single one with more discriminative power than any of the input feature vectors. In pattern recognition problems, we are also interested in separating the classes. In this paper, we present discriminant correlation analysis (DCA), a feature level fusion technique that incorporates the class associations into the correlation analysis of the feature sets. DCA performs an effective feature fusion by maximizing the pairwise correlations across the two feature sets and, at the same time, eliminating the between-class correlations and restricting the correlations to be within the classes. Our proposed method can be used in pattern recognition applications for fusing the features extracted from multiple modalities or combining different feature vectors extracted from a single modality. It is noteworthy that DCA is the first technique that considers class structure in feature fusion. Moreover, it has a very low computational complexity and it can be employed in real-time applications. Multiple sets of experiments performed on various biometric databases and using different feature extraction techniques, show the effectiveness of our proposed method, which outperforms other state-of-the-art approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Turk, M., & Pentland, A. (1991) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1991.3.1.71 · Cited by 13,733
Speeded-Up Robust Features (SURF)
Bay, H., Ess, A., Tuytelaars, T., & Van Gool, L. (2008) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2007.09.014 · Cited by 13,557 · cited 3×
“Parallel feature fusion [7], [8] does not show a more discriminative feature either and in case of Gabor-SURF fusion, the fused feature vector works almost similar to the SURF feature vector.”
(1973) · CERN Document Server (European Organization for Nuclear Research) · Cited by 12,895
Eigenfaces vs. Fisherfaces: recognition using class specific linear projection
Belhumeur, P. N., Hespanha, J. P., & Kriegman, D. J. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598228 · Cited by 11,707
Object Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853
Robust Face Recognition via Sparse Representation
Wright, J., Yang, A. Y., Ganesh, A., Sastry, S. S., & Ma, Y. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.79 · Cited by 9,388
Image Super-Resolution Via Sparse Representation
Yang, J., Wright, J., Huang, T. S., & Ma, Y. (2010) · IEEE Transactions on Image Processing · doi:10.1109/tip.2010.2050625 · Cited by 5,217
Pattern Recognition and Machine Learning
Neal, R. M. (2007) · Technometrics · doi:10.1198/tech.2007.s518 · Cited by 4,571
Pattern Classification and Scene Analysis
Thompson, M., Duda, R. O., & Hart, P. E. (1974) · Leonardo · doi:10.2307/1573081 · Cited by 4,495
Martinez, A. M., & Kak, A. C. (2001) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.908974 · Cited by 3,249
Martínez, A. M. (1998) · Medical Entomology and Zoology · Cited by 2,830
Martínez, A. M. (1998) · CTIT technical reports series · Cited by 2,778
Vlfeat: an open and portable library of computer vision algorithms
Vedaldi, A., & Fulkerson, B. (2010) · Proceedings of the 18th ACM international conference on Multimedia · doi:10.1145/1873951.1874249 · Cited by 2,664
Score normalization in multimodal biometric systems
Jain, A., Nandakumar, K., & Ross, A. (2005) · Pattern Recognition · doi:10.1016/j.patcog.2005.01.012 · Cited by 2,154
Face detection, pose estimation, and landmark localization in the wild
Zhu, X., & Ramanan, D. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248014 · Cited by 2,120
Liu, C., & Wechsler, H. (2002) · IEEE Transactions on Image Processing · doi:10.1109/tip.2002.999679 · Cited by 1,886
Information fusion in biometrics
Ross, A., & Jain, A. (2003) · Pattern Recognition Letters · doi:10.1016/s0167-8655(03)00079-5 · Cited by 1,107
Filterbank-based fingerprint matching
Jain, A. K., Prabhakar, S., Hong, L., & Pankanti, S. (2000) · IEEE Transactions on Image Processing · doi:10.1109/83.841531 · Cited by 1,106
Principles of Multivariate Analysis, A User's Perspective.
Kocherlakota, K., Kocherlakota, S., & Krzanowski, W. J. (1989) · Biometrics · doi:10.2307/2531791 · Cited by 1,080
Face Photo-Sketch Synthesis and Recognition
Wang, X., & Tang, X. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.222 · Cited by 900
Canonical analysis of several sets of variables
KETTENRING, J. R. (1971) · Biometrika · doi:10.1093/biomet/58.3.433 · Cited by 896
Sparse multinomial logistic regression: fast algorithms and generalization bounds
Krishnapuram, B., Carin, L., Figueiredo, M. A. T., & Hartemink, A. J. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.127 · Cited by 877
Wagner, A., Wright, J., Ganesh, A., Zhou, Z., Mobahi, H., & Ma, Y. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.112 · Cited by 629
Multimodal Biometrics: An Overview
Ross, A., & Jain, A. (2004) · Zenodo · doi:10.5281/zenodo.38715 · Cited by 593
Discriminative Learning and Recognition of Image Set Classes Using Canonical Correlations
Kim, T.-K., Kittler, J., & Cipolla, R. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1037 · Cited by 590
A new method of feature fusion and its application in image recognition
Sun, Q.-S., Zeng, S.-G., Liu, Y., Heng, P.-A., & Xia, D.-S. (2005) · Pattern Recognition · doi:10.1016/j.patcog.2004.12.013 · Cited by 517
Feature fusion: parallel strategy vs. serial strategy
Yang, J., Yang, J.-Y., Zhang, D., & Lu, J.-F. (2003) · Pattern Recognition · doi:10.1016/s0031-3203(02)00262-5 · Cited by 456
Principles of multivariate analysis: a user's perspective
(1989) · Choice Reviews Online · doi:10.5860/choice.26-5111 · Cited by 417
Joint Blind Source Separation by Multiset Canonical Correlation Analysis
Li, Y.-O., Adali, T., Wang, W., & Calhoun, V. D. (2009) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2009.2021636 · Cited by 337
Invariance properties of Gabor filter-based features-overview and applications
Kamarainen, J.-K., Kyrki, V., & Kalviainen, H. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.864174 · Cited by 333
Periocular Biometrics in the Visible Spectrum
Park, U., Jillela, R. R., Ross, A., & Jain, A. K. (2011) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2010.2096810 · Cited by 332
CloudID: Trustworthy cloud-based and cross-enterprise biometric identification
Haghighat, M., Zonouz, S., & Abdel-Mottaleb, M. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.06.025 · Cited by 296
Self-citationMultiset canonical correlations analysis and multispectral, truly multitemporal remote sensing data
Nielsen, A. A. (2002) · IEEE Transactions on Image Processing · doi:10.1109/83.988962 · Cited by 293
Joint Sparse Representation for Robust Multimodal Biometrics Recognition
Shekhar, S., Patel, V. M., Nasrabadi, N. M., & Chellappa, R. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.109 · Cited by 286
Canonical Correlation Analysis for Data Fusion and Group Inferences
Correa, N., Adali, T., Li, Y.-O., & Calhoun, V. (2010) · IEEE Signal Processing Magazine · doi:10.1109/msp.2010.936725 · Cited by 264
A shape- and texture-based enhanced Fisher classifier for face recognition
Liu, C., & Wechsler, H. (2001) · IEEE Transactions on Image Processing · doi:10.1109/83.913594 · Cited by 261
Multimodal Biometric System Using Rank-Level Fusion Approach
Monwar, M. M., & Gavrilova, M. L. (2009) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2008.2009071 · Cited by 198
Matching Composite Sketches to Face Photos: A Component-Based Approach
Han, H., Klare, B. F., Bonnen, K., & Jain, A. K. (2013) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2012.2228856 · Cited by 196
Feature-level fusion of fingerprint and finger-vein for personal identification
Yang, J., & Zhang, X. (2012) · Pattern Recognition Letters · doi:10.1016/j.patrec.2011.11.002 · Cited by 187
Abaza, A., Ross, A., Hebert, C., Harrison, M. A. F., & Nixon, M. S. (2013) · ACM Computing Surveys · doi:10.1145/2431211.2431221 · Cited by 178
Multimodal Task-Driven Dictionary Learning for Image Classification
Bahrampour, S., Nasrabadi, N. M., Ray, A., & Jenkins, W. K. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2496275 · Cited by 177
Identification Using Encrypted Biometrics
Haghighat, M., Zonouz, S., & Abdel-Mottaleb, M. S. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40246-3_55 · Cited by 143
Self-citationFully automatic face normalization and single sample face recognition in unconstrained environments
Haghighat, M., Abdel-Mottaleb, M. S., & Alhalabi, W. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.10.047 · Cited by 142
Self-citationGeneralized K–L transform based combined feature extraction
Yang, J. J., & Yang, J.-Y. (2002) · Pattern Recognition · doi:10.1016/s0031-3203(01)00152-2 · Cited by 84
Non-ideal iris segmentation using graph cuts
Pundlik, S. J., Woodard, D. L., & Birchfield, S. T. (2008) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2008.4563108 · Cited by 82
Multi-resolution feature fusion for face recognition
Pong, K.-H., & Lam, K. (2013) · Pattern Recognition · doi:10.1016/j.patcog.2013.08.023 · Cited by 73
Real time face and mouth recognition using radial basis function neural networks
Balasubramanian, M., Palanivel, S., & Ramalingam, V. (2008) · Expert Systems with Applications · doi:10.1016/j.eswa.2008.08.001 · Cited by 53
Discriminant correlation analysis for feature level fusion with application to multimodal biometrics
Haghighat, M., Abdel-Mottaleb, M. S., & Alhalabi, W. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472000 · Cited by 53
Self-citationFeature Fusion Method Based on KCCA for Ear and Profile Face Based Multimodal Recognition
Xu, X., & Mu, Z. (2007) · IEEE International Conference on Automation and Logistics (ICAL) · doi:10.1109/ical.2007.4338638 · Cited by 52
The effect of lighting direction/condition on the performance of face recognition algorithms
Fahmy, G. F., El‐Sherbeeny, A. M., Mandala, S., Abdel-Mottaleb, M. S., & Ammar, H. H. (2006) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.666527 · Cited by 19
Self-citationLi, W., Yang, J., & Zhang, J. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.08.063 · Cited by 11
Cited by
Chen, Z., & Li, W. (2017) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2017.2669947 · Cited by 883
Deep Feature Fusion for VHR Remote Sensing Scene Classification
Chaib, S., Liu, H., Gu, Y., & Yao, H. (2017) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2017.2700322 · Cited by 461
Recent trends in deep learning based personality detection
Mehta, Y., Majumder, N., Gelbukh, A., & Cambria, E. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-019-09770-z · Cited by 329
Multimodal Gesture Recognition Based on the ResC3D Network
Miao, Q., Li, Y., Ouyang, W., Ma, Z., Xu, X., Shi, W., & Cao, X. (2017) · 2017 IEEE International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw.2017.360 · Cited by 168
Metadata
- Authors
- Haghighat, M., Abdel-Mottaleb, M., & Alhalabi, W.
- Venue
- IEEE Transactions on Information Forensics and Security
- Published
- 2016-09
- Volume
- 11
- Issue
- 9
- Pages
- 1984-1996
- ISSN
- 1556-6013 (ISSN-L)
- 1556-6021
- OpenAlex
- W2405680777
- Cited by
- 379
- References
- 53
- FWCI
- 52.57
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.