The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Least squares linear discriminant analysis
Abstract
Linear Discriminant Analysis (LDA) is a well-known method for dimensionality reduction and classification. LDA in the binaryclass case has been shown to be equivalent to linear regression with the class label as the output. This implies that LDA for binary-class classifications can be formulated as a least squares problem. Previous studies have shown certain relationship between multivariate linear regression and LDA for the multi-class case. Many of these studies show that multivariate linear regression with a specific class indicator matrix as the output can be applied as a preprocessing step for LDA. However, directly casting LDA as a least squares problem is challenging for the multi-class case. In this paper, a novel formulation for multivariate linear regression is proposed. The equivalence relationship between the proposed least squares formulation and LDA for multi-class classifications is rigorously established under a mild condition, which is shown empirically to hold in many applications involving high-dimensional data. Several LDA extensions based on the equivalence relationship are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Golub, G. (2012) · doi:10.56021/9781421407944 · Cited by 34,505
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
(2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_5195 · Cited by 19,370
THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS
FISHER, R. A. (1936) · Annals of Eugenics · doi:10.1111/j.1469-1809.1936.tb02137.x · Cited by 15,227
Eigenfaces vs. Fisherfaces: recognition using class specific linear projection
Belhumeur, P. N., Hespanha, J. P., & Kriegman, D. J. (1997) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.598228 · Cited by 11,707
Efron, B., Hastie, T., Johnstone, I., & Tibshirani, R. (2004) · The Annals of Statistics · doi:10.1214/009053604000000067 · Cited by 9,357
Russell, E. L., Chiang, L. H., & Braatz, R. D. (2000) · Advances in Industrial Control · doi:10.1007/978-1-4471-0409-4_3 · Cited by 7,862
Face recognition using eigenfaces
Turk, M. A., & Pentland, A. P. (2002) · Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.1991.139758 · Cited by 5,197
Introduction to statistical pattern recognition (2nd ed.)
Fukunaga, K. (1990) · Academic Press Professional, Inc. eBooks · Cited by 3,797
(2006) · Cited by 3,624
Sparse Principal Component Analysis
Zou, H., Hastie, T., & Tibshirani, R. (2006) · Journal of Computational and Graphical Statistics · doi:10.1198/106186006x113430 · Cited by 3,152
Comparison of Discrimination Methods for the Classification of Tumors Using Gene Expression Data
Dudoit, S., Fridlyand, J., & Speed, T. P. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502753479248 · Cited by 2,672
Duda, R. O., Hart, P. E., & Stork, D. G. (2001) · Cited by 2,463
Regularized Discriminant Analysis
Friedman, J. H. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478752 · Cited by 2,421
In Defense of One-Vs-All Classification
Rifkin, R. M., & Klautau, A. (2004) · Journal of Machine Learning Research · Cited by 2,056
Using discriminant eigenfeatures for image retrieval
Swets, D. L., & Weng, J. J. (1996) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.531802 · Cited by 1,620
Regularization Networks and Support Vector Machines
Evgeniou, T., Pontil, M., & Poggio, T. (2000) · Advances in Computational Mathematics · doi:10.1023/a:1018946025316 · Cited by 1,197
Flexible Discriminant Analysis by Optimal Scoring
Hastie, T., Tibshirani, R., & Buja, A. (1994) · Journal of the American Statistical Association · doi:10.1080/01621459.1994.10476866 · Cited by 883
Penalized Discriminant Analysis
Hastie, T., Buja, A., & Tibshirani, R. (1995) · The Annals of Statistics · doi:10.1214/aos/1176324456 · Cited by 849
Proximal support vector machine classifiers
Fung, G., & Mangasarian, O. L. (2001) · Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/502512.502527 · Cited by 842
Cristianini, N., Kandola, J., Elisseeff, A., & Shawe-Taylor, J. (2006) · Studies in Fuzziness and Soft Computing · doi:10.1007/3-540-33486-6_8 · Cited by 837
A Modified Principal Component Technique Based on the LASSO
Jolliffe, I. T., Trendafilov, N. T., & Uddin, M. (2003) · Journal of Computational and Graphical Statistics · doi:10.1198/1061860032148 · Cited by 809
Ridge Regression: Biased Estimation for Nonorthogonal Problems
Hoerl, A. E., & Kennard, R. W. (2000) · Technometrics · doi:10.1080/00401706.2000.10485983 · Cited by 808
1-norm Support Vector Machines
Zhu, J., Rosset, S., Tibshirani, R. J., & Hastie, T. J. (2003) · Cited by 797
Benchmarking Least Squares Support Vector Machine Classifiers
van Gestel, T., Suykens, J. A. K., Baesens, B., Viaene, S., Vanthienen, J., Dedene, G., de Moor, B., & Vandewalle, J. (2004) · Machine Learning · doi:10.1023/b:mach.0000008082.80494.e0 · Cited by 745
Lee, Y., Lin, Y., & Wahba, G. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000000098 · Cited by 741
Geometric Representation of High Dimension, Low Sample Size Data
Hall, P., Marron, J. S., & Neeman, A. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00510.x · Cited by 483
Edrei, A., Saff, E. B., & Varga, R. S. (1983) · Lecture Notes in Mathematics · doi:10.1007/bfb0070488 · Cited by 421
The Mathematics of Learning: Dealing With Data
Smale, S. (2005) · 2005 International Conference on Neural Networks and Brain · doi:10.1109/icnnb.2005.1614860 · Cited by 398
Face recognition based on the uncorrelated discriminant transformation
Jin, Z., Yang, J.-Y., Hu, Z.-S., & Lou, Z. (2001) · Pattern Recognition · doi:10.1016/s0031-3203(00)00084-4 · Cited by 370
Ye, J. (2005) · Cited by 353
Self-citationMulticategory Proximal Support Vector Machine Classifiers
Fung, G. M., & Mangasarian, O. L. (2005) · Machine Learning · doi:10.1007/s10994-005-0463-6 · Cited by 314
Edrei, A., Saff, E. B., & Varga, R. S. (1983) · Lecture Notes in Mathematics · doi:10.1007/bfb0070484 · Cited by 276
Krzanowski, W. J., Jonathan, P., McCarthy, W. V., & Thomas, M. R. (1995) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.2307/2986198 · Cited by 216
Using uncorrelated discriminant analysis for tissue classification with gene expression data
Ye, J., Li, T., Xiong, T., & Janardan, R. (2004) · IEEE/ACM Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2004.45 · Cited by 183
Self-citationHowland, P., Jeon, M., & Park, H. (2003) · SIAM Journal on Matrix Analysis and Applications · doi:10.1137/s0895479801393666 · Cited by 178
A Direct Formulation for Sparse Pca Using Semidefinite ProgrammingPreprint
d’Aspremont, A., Ghaoui, L. E., Jordan, M. I., & Lanckriet, G. R. G. (2004) · SSRN Electronic Journal · doi:10.2139/ssrn.563524 · Cited by 130
Mika, S. (2003) · doi:10.14279/depositonce-575 · Cited by 123
Cited by
Clemmensen, L., Hastie, T., Witten, D., & Ersbøll, B. (2011) · Technometrics · doi:10.1198/tech.2011.08118 · Cited by 534
Spectral Embedded Clustering: A Framework for In-Sample and Out-of-Sample Spectral Clustering
Nie, F., Zeng, Z., Tsang, I. W., Xu, D., & Zhang, C. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2011.2162000 · Cited by 325
Sun, L., Ji, S., & Ye, J. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.160 · Cited by 299
Self-citationPresence‐Only Data and the EM Algorithm
Ward, G., Hastie, T., Barry, S., Elith, J., & Leathwick, J. R. (2009) · Biometrics · doi:10.1111/j.1541-0420.2008.01116.x · Cited by 295
Hypergraph spectral learning for multi-label classification
Sun, L., Ji, S., & Ye, J. (2008) · Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1401890.1401971 · Cited by 258
Self-citation
Metadata
- Authors
- Ye, J.
- Venue
- Proceedings of the 24th international conference on Machine learning
- Publisher
- ACM
- Published
- 2007-06-20
- Pages
- 1087-1093
- OpenAlex
- W2014596061
- Cited by
- 274
- References
- 40
- FWCI
- 35.36
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.