The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Geometric Mean for Subspace Selection
Abstract
Subspace selection approaches are powerful tools in pattern classification and data visualization. One of the most important subspace approaches is the linear dimensionality reduction step in the Fisher's linear discriminant analysis (FLDA), which has been successfully employed in many fields such as biometrics, bioinformatics, and multimedia information management. However, the linear dimensionality reduction step in FLDA has a critical drawback: for a classification task with c classes, if the dimension of the projected subspace is strictly lower than c - 1, the projection to a subspace tends to merge those classes, which are close together in the original feature space. If separate classes are sampled from Gaussian distributions, all with identical covariance matrices, then the linear dimensionality reduction step in FLDA maximizes the mean value of the Kullback-Leibler (KL) divergences between different classes. Based on this viewpoint, the geometric mean for subspace selection is studied in this paper. Three criteria are analyzed: 1) maximization of the geometric mean of the KL divergences, 2) maximization of the geometric mean of the normalized KL divergences, and 3) the combination of 1 and 2. Preliminary experimental results based on synthetic data, UCI Machine Learning Repository, and handwriting digits show that the third criterion is a potential discriminative subspace selection method, which significantly reduces the class separation problem in comparing with the linear dimensionality reduction step in FLDA and its several representative extensions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 36,808
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
(2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_5195 · Cited by 19,370
Normalized cuts and image segmentation
Shi, J., & Malik, J. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.868688 · Cited by 15,502
THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS
FISHER, R. A. (1936) · Annals of Eugenics · doi:10.1111/j.1469-1809.1936.tb02137.x · Cited by 15,227
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2005) · doi:10.1002/047174882x · Cited by 13,791
The Elements of Statistical Learning: Data Mining, Inference, and Prediction
John Lu, Z. Q. (2010) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2010.00646_6.x · Cited by 12,390
Introduction to Statistical Pattern Recognition
(1990) · Elsevier eBooks · doi:10.1016/c2009-0-27872-x · Cited by 11,031
UCI Repository of machine learning databases
Blake, C. L. (1998) · Medical Entomology and Zoology · Cited by 10,582
Wiley Series in Probability and Statistics
(2008) · Wiley series in probability and statistics · doi:10.1002/series1345 · Cited by 4,217
Abe, S. (2001) · Springer eBooks · doi:10.1007/978-1-4471-0285-4 · Cited by 3,721
Comparison of Discrimination Methods for the Classification of Tumors Using Gene Expression Data
Dudoit, S., Fridlyand, J., & Speed, T. P. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502753479248 · Cited by 2,672
Discriminant Analysis and Statistical Pattern Recognition.
Hawkins, D. M., & McLachlan, G. J. (1993) · Journal of the American Statistical Association · doi:10.2307/2290355 · Cited by 2,633
Regularized Discriminant Analysis
Friedman, J. H. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478752 · Cited by 2,421
Unsupervised learning of finite mixture models
Figueiredo, M. A. T., & Jain, A. K. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.990138 · Cited by 2,125
Neighbourhood Components Analysis
Goldberger, J., Hinton, G. E., Roweis, S. T., & Salakhutdinov, R. (2004) · Cited by 1,855
Using discriminant eigenfeatures for image retrieval
Swets, D. L., & Weng, J. J. (1996) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.531802 · Cited by 1,620
A direct LDA algorithm for high-dimensional data — with application to face recognition
Yu, H., & Yang, J. (2001) · Pattern Recognition · doi:10.1016/s0031-3203(00)00162-x · Cited by 1,578
Discriminant Analysis and Statistical Pattern Recognition
McLachlan, G. J. (1992) · Wiley Series in Probability and Statistics · doi:10.1002/0471725293 · Cited by 1,267
General Tensor Discriminant Analysis and Gabor Features for Gait Recognition
Tao, D., Li, X., Wu, X., & Maybank, S. J. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1096 · Cited by 1,140
Self-citationThe Utilization of Multiple Measurements in Problems of Biological Classification
Rao, C. R. (1948) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1948.tb00008.x · Cited by 871
Penalized Discriminant Analysis
Hastie, T., Buja, A., & Tibshirani, R. (1995) · The Annals of Statistics · doi:10.1214/aos/1176324456 · Cited by 849
Discriminant adaptive nearest neighbor classification
Hastie, T., & Tibshirani, R. (1996) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.506411 · Cited by 833
UCI Repository of Machine Learning Database
Newman, D. J. (1998) · Medical Entomology and Zoology · Cited by 824
Discriminant Analysis by Gaussian Mixtures
Hastie, T., & Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02073.x · Cited by 813
Face recognition using LDA-based algorithms
Lu, J., Plataniotis, K. N., & Venetsanopoulos, A. N. (2003) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2002.806647 · Cited by 798
Dimensionality Reduction for Supervised Learning With Reproducing Kernel Hilbert Spaces
Fukumizu, K., Bach, F. R., & Jordan, M. I. (2003) · doi:10.21236/ada446572 · Cited by 723
Dimensionality Reduction of Multimodal Labeled Data by Local Fisher Discriminant Analysis
SugiyamaMasashi (2007) · Journal of Machine Learning Research · doi:10.5555/1248659.1248694 · Cited by 703
Feature extraction by non parametric mutual information maximization
Torkkola, K. (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944981 · Cited by 611
Tao, D., Li, X., Hu, W., Maybank, S., & Wu, X. (2006) · Fifth IEEE International Conference on Data Mining (ICDM'05) · doi:10.1109/icdm.2005.139 · Cited by 373
Self-citationTao, D., Li, X., Wu, X., Hu, W., & Maybank, S. J. (2007) · Knowledge and Information Systems · doi:10.1007/s10115-006-0050-6 · Cited by 299
Self-citationLinear dimensionality reduction via a heteroscedastic extension of LDA: the Chernoff criterion
Duin, R. P. W., & Loog, M. (2004) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2004.13 · Cited by 293
Kim, T.-K., & Kittler, J. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.58 · Cited by 290
A two-stage linear discriminant analysis via QR-decomposition
Ye, J., & Li, Q. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.110 · Cited by 286
Expected classification error of the Fisher linear classifier with pseudo-inverse covariance matrix
Raudys, S., & Duin, R. P. W. (1998) · Pattern Recognition Letters · doi:10.1016/s0167-8655(98)00016-6 · Cited by 187
High-Dimensional Discriminant Analysis
Bouveyron, C., Girard, S., & Schmid, C. (2007) · Communication in Statistics- Theory and Methods · doi:10.1080/03610920701271095 · Cited by 121
(2000) · Applied Physics Letters · doi:10.1162/153244303322753742 · Cited by 121
Hierarchical discriminant analysis for image retrieval
Swets, D. L., & Weng, J. (1999) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.765652 · Cited by 104
CANONICAL VARIATE ANALYSIS—A GENERAL MODEL FORMULATION
Campbell, N. A. (1984) · Australian Journal of Statistics · doi:10.1111/j.1467-842x.1984.tb01271.x · Cited by 96
Fast algorithms: A multitape Turing machine implementation
Schönhage, A., Grotefeld, A. F. W., & Vetter, E. (1994) · Medical Entomology and Zoology · Cited by 75
Discriminative Components of Data
Peltonen, J., & Kaski, S. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.836194 · Cited by 54
Multimodal oriented discriminant analysis
la Torre, F. D., & Takeo Kanade, A. (2005) · International Conference on Machine Learning · doi:10.1145/1102351.1102374 · Cited by 48
Cited by
A Fast Single Image Haze Removal Algorithm Using Color Attenuation Prior
Zhu, Q., Mai, J., & Shao, L. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2446191 · Cited by 2,469
Single Image Super-Resolution With Non-Local Means and Steering Kernel Regression
Zhang, K., Gao, X., Tao, D., & Li, X. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2208977 · Cited by 576
Self-citationConstrained Nonnegative Matrix Factorization for Image Representation
Liu, H., Wu, Z., Cai, D., & Huang, T. S. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.217 · Cited by 520
Bregman Divergence-Based Regularization for Transfer Subspace Learning
Si, S., Tao, D., & Geng, B. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.126 · Cited by 477
Self-citationNeNMF: An Optimal Gradient Method for Nonnegative Matrix Factorization
Guan, N., Tao, D., Luo, Z., & Yuan, B. (2012) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2190406 · Cited by 468
Self-citation
Metadata
- Authors
- Tao, D., Li, X., Wu, X., & Maybank, S. J.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2009-02
- Volume
- 31
- Issue
- 2
- Pages
- 260-274
- ISSN
- 0162-8828 (ISSN-L)
- OpenAlex
- W2117513046
- Cited by
- 583
- References
- 43
- FWCI
- 73.29
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.