The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Linear discriminant analysis: A detailed tutorial
Open accessAbstract
Linear Discriminant Analysis (LDA) is a very common technique for dimensionality reduction problems as a pre-processing step for machine learning and pattern classification applications. At the same time, it is usually used as a black box, but (sometimes) not well understood. The aim of this paper is to build a solid intuition for what is LDA, and how LDA works, thus enabling readers of all levels be able to get a better understanding of the LDA and to know how to apply this technique in different applications. The paper first gave the basic definitions and steps of how LDA technique works supported with visual explanations of these steps. Moreover, the two methods of computing the LDA space, i.e. class-dependent and class-independent methods, were explained in details. Then, in a step-by-step approach, two numerical examples are demonstrated to show how the LDA space can be calculated in case of the class-dependent and class-independent methods. Furthermore, two of the most common LDA problems (i.e. Small Sample Size (SSS) and non-linearity problems) were highlighted and illustrated, and state-of-the-art solutions to these problems were investigated and explained. Finally, a number of experiments was conducted with different datasets to (1) investigate the effect of the eigenvectors that used in the LDA space on the robustness of the extracted feature for the classification accuracy, and (2) to show when the SSS problem occurs and how it can be addressed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
(2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_5195 · Cited by 19,370
Turk, M., & Pentland, A. (1991) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1991.3.1.71 · Cited by 13,733
A tutorial on support vector regression
Smola, A. J., & Schölkopf, B. (2004) · Statistics and Computing · doi:10.1023/b:stco.0000035301.49549.88 · Cited by 13,387
Eigenfaces vs. Fisherfaces: recognition using class specific linear projection
Belhumeur, P. N., Hespanha, J. P., & Kriegman, D. J. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598228 · Cited by 11,707
Nonlinear Component Analysis as a Kernel Eigenvalue Problem
Schölkopf, B., Smola, A., & Müller, K.-R. (1998) · Neural Computation · doi:10.1162/089976698300017467 · Cited by 8,084
Advances in kernel methods: support vector learning
Schölkopf, B., Burges, C. J. C., & Smola, A. J. (1999) · doi:10.5555/299094 · Cited by 5,789
A review of feature selection techniques in bioinformatics
Saeys, Y., Inza, I., & Larrañaga, P. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm344 · Cited by 5,244
Two-dimensional pca: a new approach to appearance-based face representation and recognition
Yang, J., Zhang, D., Frangi, A. F., & Yang, J.-Y. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.1261097 · Cited by 3,563
Comparison of Discrimination Methods for the Classification of Tumors Using Gene Expression Data
Dudoit, S., Fridlyand, J., & Speed, T. P. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502753479248 · Cited by 2,672
Fisher discriminant analysis with kernels
Mika, S., Ratsch, G., Weston, J., Scholkopf, B., & Mullers, K. R. (2003) · Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468) · doi:10.1109/nnsp.1999.788121 · Cited by 2,661
Parameterisation of a stochastic model for human face identification
Samaria, F. S., & Harter, A. C. (2002) · Proceedings of 1994 IEEE Workshop on Applications of Computer Vision · doi:10.1109/acv.1994.341300 · Cited by 2,593
Hand, D. J., Mannila, H., & Smyth, P. (2001) · Cited by 2,581
Regularized Discriminant Analysis
Friedman, J. H. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478752 · Cited by 2,421
Generalized Discriminant Analysis Using a Kernel Approach
Baudat, G., & Anouar, F. (2000) · Neural Computation · doi:10.1162/089976600300014980 · Cited by 1,673
Introduction to linear algebra
(2016) · Cybersecurity and Applied Mathematics · doi:10.1016/b978-0-12-804452-0.09998-x · Cited by 1,646
Using discriminant eigenfeatures for image retrieval
Swets, D. L., & Weng, J. J. (1996) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.531802 · Cited by 1,620
A direct LDA algorithm for high-dimensional data — with application to face recognition
Yu, H., & Yang, J. (2001) · Pattern Recognition · doi:10.1016/s0031-3203(00)00162-x · Cited by 1,578
A new LDA-based face recognition system which can solve the small sample size problem
Chen, L.-F., Liao, H.-Y. M., Ko, M.-T., Lin, J.-C., & Yu, G.-J. (2000) · Pattern Recognition · doi:10.1016/s0031-3203(99)00139-9 · Cited by 1,427
Discovering knowledge in data: an introduction to data mining
(2005) · Choice Reviews Online · doi:10.5860/choice.42-4687 · Cited by 1,347
Bramer, M. (2013) · Undergraduate Topics in Computer Science · doi:10.1007/978-1-4471-4884-5 · Cited by 838
Discriminant Analysis by Gaussian Mixtures
Hastie, T., & Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02073.x · Cited by 813
Face recognition using LDA-based algorithms
Lu, J., Plataniotis, K. N., & Venetsanopoulos, A. N. (2003) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2002.806647 · Cited by 798
LINEAR DISCRIMINANT ANALYSIS - A BRIEF TUTORIAL
Balakrishnama, S., & Ganapathiraju, A. (1995) · Cited by 705
When Does Non-Negative Matrix Factorization Give a Correct Decomposition into Parts?
Donoho, D. L., & Stodden, V. (2004) · doi:10.7916/d88d05n7 · Cited by 685
Discovering Knowledge in Data: An Introduction to Data Mining
Larose, D. T., & Larose, C. D. (2014) · Wiley eBooks · doi:10.1002/9781118874059 · Cited by 602
Barshan, E., Ghodsi, A., Azimifar, Z., & Zolghadri Jahromi, M. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2010.12.015 · Cited by 343
Linear discriminant analysis for improved large vocabulary continuous speech recognition
Haeb-Umbach, R., & Ney, H. (1992) · [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1992.225984 · Cited by 321
Lu, J., Plataniotis, K. N., & Venetsanopoulos, A. N. (2005) · Pattern Recognition Letters · doi:10.1016/j.patrec.2004.09.014 · Cited by 305
Principal component analysis - a tutorial
Tharwat, A. (2016) · International Journal of Applied Pattern Recognition · doi:10.1504/ijapr.2016.079733 · Cited by 303
Self-citationSolving the small sample size problem of LDA
Huang, R., Liu, Q., Lu, H., & Ma, S. (2003) · doi:10.1109/icpr.2002.1047787 · Cited by 296
Noise Reduction in BOLD-Based fMRI Using Component Analysis
Thomas, C. G., Harshman, R. A., & Menon, R. S. (2002) · NeuroImage · doi:10.1006/nimg.2002.1200 · Cited by 280
Linear discriminant analysis for the small sample size problem: an overview
Sharma, A., & Paliwal, K. K. (2015) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-013-0226-9 · Cited by 279
Using discriminant analysis for multi-class classification: an experimental investigation
Li, T., Zhu, S., & Ogihara, M. (2006) · Knowledge and Information Systems · doi:10.1007/s10115-006-0013-y · Cited by 269
Gaussian kernel based fuzzy rough sets: Model, uncertainty measures and applications
Hu, Q., Zhang, L., Chen, D., Witold Pedrycz, C., & Yu, D. (2010) · International Journal of Approximate Reasoning · doi:10.1016/j.ijar.2010.01.004 · Cited by 227
Chen, L., Carpita, N. C., Reiter, W., Wilson, R. H., Jeffries, C., & McCann, M. C. (1998) · The Plant Journal · doi:10.1046/j.1365-313x.1998.00301.x · Cited by 212
Chan, H.-P., Wei, D., Helvie, M. A., Sahiner, B., Adler, D. D., Goodsitt, M. M., & Petrick, N. (1995) · Physics in Medicine and Biology · doi:10.1088/0031-9155/40/5/010 · Cited by 208
Gait Recognition Using Radon Transform and Linear Discriminant Analysis
Boulgouris, N. V., & Chi, Z. X. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2007.891157 · Cited by 185
Information Retrieval Perspective to Nonlinear Dimensionality Reduction for Data Visualization
VennaJarkko, PeltonenJaakko, NyboKristian, AidosHelena, & KaskiSamuel (2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1756019 · Cited by 177
Rezzi, S., Axelson, D. E., Héberger, K., Reniero, F., Mariani, C., & Guillou, C. (2005) · Analytica Chimica Acta · doi:10.1016/j.aca.2005.07.057 · Cited by 169
A BA-based algorithm for parameter optimization of Support Vector Machine
Tharwat, A., Hassanien, A. E., & Elnaghi, B. E. (2017) · Pattern Recognition Letters · doi:10.1016/j.patrec.2016.10.007 · Cited by 166
Self-citationRegularized discriminant analysis for the small sample size problem in face recognition
Lu, J., Plataniotis, K. N., & Venetsanopoulos, A. N. (2003) · Pattern Recognition Letters · doi:10.1016/s0167-8655(03)00167-3 · Cited by 162
(2D)2LDA: An efficient approach for face recognition
Shaffi, N., Kumar, G. H., & Shivakumara, P. (2006) · Pattern Recognition · doi:10.1016/j.patcog.2006.01.018 · Cited by 153
Generalized spectral bounds for sparse LDA
Moghaddam, B., Weiss, Y., & Avidan, S. (2006) · International Conference on Machine Learning · doi:10.1145/1143844.1143925 · Cited by 149
Wu, M. C., Zhang, L., Wang, Z., Christiani, D. C., & Lin, X. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp019 · Cited by 120
Biometric cattle identification approach based on Weber’s Local Descriptor and AdaBoost classifier
Gaber, T., Tharwat, A., Hassanien, A. E., & Snåšel, V. (2016) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2015.12.022 · Cited by 120
Self-citationHéberger, K., Csomós, E., & Simon‐Sarkadi, L. (2003) · Journal of Agricultural and Food Chemistry · doi:10.1021/jf034851c · Cited by 118
Tharwat, A., Moemen, Y. S., & Hassanien, A. E. (2017) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.03.002 · Cited by 84
Self-citationCancer classification by gradient LDA technique using microarray gene expression data
Sharma, A. K., & Paliwal, K. K. (2008) · Data & Knowledge Engineering · doi:10.1016/j.datak.2008.04.004 · Cited by 82
Null space based feature selection method for gene expression data
Sharma, A. K., Imoto, S., Miyano, S., & Sharma, V. (2011) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-011-0061-9 · Cited by 74
Ear Recognition based on 2D Images
Li, Y., & Mu, Z. (2007) · IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS) · doi:10.1109/btas.2007.4401941 · Cited by 67
Compression neural networks for feature extraction: Application to human recognition from ear images
Carreira-Perpiñán, M. Á. (1995) · Medical Entomology and Zoology · Cited by 58
Sharma, A. K., & Paliwal, K. K. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2011.11.018 · Cited by 49
Honda, K., & Ichihashi, H. (2005) · International Journal of Approximate Reasoning · doi:10.1016/j.ijar.2005.10.011 · Cited by 12
Cited by
Selecting critical features for data classification based on machine learning methods
Chen, R.-C., Dewi, C., Huang, S.-W., & Caraka, R. E. (2020) · Journal of Big Data · doi:10.1186/s40537-020-00327-4 · Cited by 979
Recent advances in decision trees: an updated survey
Costa, V. G., & Pedreira, C. E. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10275-5 · Cited by 572
Overview and comparative study of dimensionality reduction techniques for high dimensional data
Ayesha, S., Hanif, M. K., & Talib, R. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.01.005 · Cited by 569
Sui, X., He, S., Vilsen, S. B., Meng, J., Teodorescu, R., & Stroe, D.-I. (2021) · Applied Energy · doi:10.1016/j.apenergy.2021.117346 · Cited by 409
Toğaçar, M., Ergen, B., Cömert, Z., & Özyurt, F. (2020) · IRBM · doi:10.1016/j.irbm.2019.10.006 · Cited by 297
Metadata
- Authors
- Tharwat, A., Gaber, T., Ibrahim, A., & Hassanien, A. E.
- Venue
- AI Communications
- Publisher
- SAGE Publications
- Published
- 2017-05-16
- Volume
- 30
- Issue
- 2
- Pages
- 169-190
- ISSN
- 0921-7126 (ISSN-L)
- 1875-8452
- OpenAlex
- W2611159092
- Cited by
- 1,072
- References
- 55
- FWCI
- 30.91
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.