The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
On Consistency and Sparsity for Principal Components Analysis in High Dimensions
Open accessAbstract
Principal components analysis (PCA) is a classic method for the reduction of dimensionality of data in the form of n observations (or cases) of a vector with p variables. Contemporary datasets often have p comparable with or even much larger than n. Our main assertions, in such settings, are (a) that some initial reduction in dimensionality is desirable before applying any PCA-type search for principal modes, and (b) the initial reduction in dimensionality is best achieved by working in a basis in which the signals have a sparse representation. We describe a simple asymptotic model in which the estimate of the leading principal component vector via standard PCA is consistent if and only if p(n)/n→0. We provide a simple algorithm for selecting a subset of coordinates with largest sample variances, and show that if PCA is done on the selected subset, then consistency is recovered, even if p(n) ⪢ n.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Golub, G. H., & Loan, C. F. V. (1996) · Johns Hopkins University Press eBooks · Cited by 6,027
Large Deviations Techniques and Applications
Schmock, U., Dembo, A., & Zeitouni, O. (2000) · Journal of the American Statistical Association · doi:10.2307/2669805 · Cited by 3,524
Aspects of Multivariate Statistical Theory
Gleser, L. J. (1984) · Technometrics · doi:10.1080/00401706.1984.10487948 · Cited by 3,277
Sparse Principal Component Analysis
Zou, H., Hastie, T., & Tibshirani, R. (2006) · Journal of Computational and Graphical Statistics · doi:10.1198/106186006x113430 · Cited by 3,152
Wavelet Shrinkage: Asymptopia?
Donoho, D. L., Johnstone, I. M., Kerkyacharian, G., & Picard, D. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02032.x · Cited by 1,749
Self-citationMarron, J. S., Ramsey, J. O., & Silverman, B. W. (1998) · Journal of the American Statistical Association · doi:10.2307/2669864 · Cited by 1,403
Asymptotic Theory for Principal Component Analysis
Anderson, T. W. (1963) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177704248 · Cited by 1,150
Muraki, E., Ramsay, J. O., & Silverman, B. W. (1999) · Journal of Educational and Behavioral Statistics · doi:10.2307/1165264 · Cited by 1,013
Estimating the Mean and Covariance Structure Nonparametrically When the Data are Curves
Rice, J. A., & Silverman, B. W. (1991) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1991.tb01821.x · Cited by 859
A Modified Principal Component Technique Based on the LASSO
Jolliffe, I. T., Trendafilov, N. T., & Uddin, M. (2003) · Journal of Computational and Graphical Statistics · doi:10.1198/1061860032148 · Cited by 809
A Direct Formulation for Sparse PCA Using Semidefinite Programming
d'Aspremont, A., El Ghaoui, L., Jordan, M. I., & Lanckriet, G. R. G. (2007) · SIAM Review · doi:10.1137/050645506 · Cited by 678
Deflation Techniques for an Implicitly Restarted Arnoldi Iteration
Lehoucq, R. B., & Sorensen, D. C. (1996) · SIAM Journal on Matrix Analysis and Applications · doi:10.1137/s0895479895281484 · Cited by 618
ASYMPTOTICS OF SAMPLE EIGENSTRUCTURE FOR A LARGE DIMENSIONAL SPIKED COVARIANCE MODEL
Paul, D. (2007) · Cited by 577
Optimal Rates of Convergence for Covariance Matrix Estimation
Cai, T., Zhang, C.-H., Zhou, H. H., et al. (2008) · Cited by 456
Unconditional Bases Are Optimal Bases for Data Compression and for Statistical Estimation
Donoho, D. L. (1993) · Applied and Computational Harmonic Analysis · doi:10.1006/acha.1993.1008 · Cited by 421
A Limit Theorem for the Norm of Random Matrices
Geman, S. (1980) · The Annals of Probability · doi:10.1214/aop/1176994775 · Cited by 419
Cherkassky, V., & Mulier, F. M. (1998) · Cited by 384
Smoothed functional principal components analysis by choice of norm
Silverman, B. W. (1996) · The Annals of Statistics · doi:10.1214/aos/1033066196 · Cited by 360
Onatski, A. (2012) · Journal of Econometrics · doi:10.1016/j.jeconom.2012.01.034 · Cited by 314
FINITE SAMPLE APPROXIMATION RESULTS FOR PRINCIPAL COMPONENT ANALYSIS: A MATRIX PERTURBATION APPROACH
Nadler, B. (2008) · Cited by 295
Wolf, L., & Shashua, A. (2005) · Journal of Machine Learning Research · doi:10.5555/1046920.1194906 · Cited by 239
Finite sample approximation results for principal component analysis: A matrix perturbation approach
Nadler, B. (2008) · The Annals of Statistics · doi:10.1214/08-aos618 · Cited by 210
Human face recognition using PCA on wavelet subband
Yuen, P. C. (2000) · Journal of Electronic Imaging · doi:10.1117/1.482742 · Cited by 175
On restarting the Arnoldi method for large nonsymmetric eigenvalue problems
Morgan, R. (1996) · Mathematics of Computation · doi:10.1090/s0025-5718-96-00745-4 · Cited by 170
Sparse Principal Components Analysis
Johnstone, I. M., & Lu, A. Y. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0901.4392 · Cited by 160
Self-citationLow-Complexity Principal Component Analysis for Hyperspectral Image Compression
Du, Q., & Fowler, J. E. (2008) · The International Journal of High Performance Computing Applications · doi:10.1177/1094342007088380 · Cited by 130
Nadler, B., & Coifman, R. R. (2005) · Journal of Chemometrics · doi:10.1002/cem.915 · Cited by 120
Yata, K., & Aoshima, M. (2010) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2010.04.006 · Cited by 71
Watkin, T. L. H., & Nadal, J. (1994) · Journal of Physics A Mathematical and General · doi:10.1088/0305-4470/27/6/016 · Cited by 69
Statistical mechanics of unsupervised structure recognition
Biehl, M. L., & Mietzner, A. (1994) · Journal of Physics A Mathematical and General · doi:10.1088/0305-4470/27/6/015 · Cited by 48
Life-Cycle Finance and the Design of Pension Plans
Bodie, Z., Detemple, J. B., & Rindisbacher, M. (2009) · Annual Review of Financial Economics · doi:10.1146/annurev.financial.050708.144317 · Cited by 45
A very fast algorithm for matrix factorization
Nikulin, V., Huang, T.-H., Ng, S., Rathnayake, S. I., & McLachlan, G. J. (2011) · Statistics & Probability Letters · doi:10.1016/j.spl.2011.02.001 · Cited by 26
Combining Variable Selection with Dimensionality Reduction
Wolf, L., & Bileschi, S. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2005.103 · Cited by 23
Factor Analysis via Components Analysis
Bentler, P. M., & de Leeuw, J. (2011) · Psychometrika · doi:10.1007/s11336-011-9217-5 · Cited by 20
Cited by
Principal component analysis: A review and recent developments
Jolliffe, I. T., & Cadima, J. (2016) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2015.0202 · Cited by 10,117
Machine learning and the physical sciences
Carleo, G., Cirac, I., Cranmer, K., Daudet, L., Schuld, M., Tishby, N., Vogt-Maranto, L., & Zdeborová, L. (2019) · Reviews of Modern Physics · doi:10.1103/revmodphys.91.045002 · Cited by 2,417
Comprehensive functional genomic resource and integrative model for the human brain
Wang, D., Liu, S., Warrell, J., Won, H., Shi, X., Navarro, F. C. P., Clarke, D., Gu, M., Emani, P., Yang, Y. T., et al. (2018) · Science · doi:10.1126/science.aat8464 · Cited by 965
Large Covariance Estimation by Thresholding Principal Orthogonal Complements
Fan, J., Liao, Y., & Mincheva, M. (2013) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/rssb.12016 · Cited by 909
High-Dimensional Statistics: A Non-Asymptotic Viewpoint
Wainwright, M. J. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108627771 · Cited by 882
Metadata
- Authors
- Johnstone, I. M., & Lu, A. Y.
- Venue
- Journal of the American Statistical Association
- Publisher
- Informa UK Limited
- Published
- 2009-06
- Volume
- 104
- Issue
- 486
- Pages
- 682-693
- ISSN
- 0162-1459 (ISSN-L)
- 1537-274X
- OpenAlex
- W2097714737
- Cited by
- 847
- References
- 34
- FWCI
- 21.86
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.