The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Spectrum estimation for large dimensional covariance matrices using random matrix theory
Open accessAbstract
Estimating the eigenvalues of a population covariance matrix from a sample covariance matrix is a problem of fundamental importance in multivariate statistics; the eigenvalues of covariance matrices play a key role in many widely used techniques, in particular in principal component analysis (PCA). In many modern data analysis problems, statisticians are faced with large datasets where the sample size, n, is of the same order of magnitude as the number of variables p. Random matrix theory predicts that in this context, the eigenvalues of the sample covariance matrix are not good estimators of the eigenvalues of the population covariance. We propose to use a fundamental result in random matrix theory, the Marčenko–Pastur equation, to better estimate the eigenvalues of large dimensional covariance matrices. The Marčenko–Pastur equation holds in very wide generality and under weak assumptions. The estimator we obtain can be thought of as “shrinking” in a nonlinear fashion the eigenvalues of the sample covariance matrix to estimate the population eigenvalues. Inspired by ideas of random matrix theory, we also suggest a change of point of view when thinking about estimation of high-dimensional vectors: we do not try to estimate directly the vectors but rather a probability measure that describes them. We think this is a theoretically more fruitful way to think about these problems. Our estimator gives fast and good or very good results in extended simulations. Our algorithmic approach is based on convex optimization. We also show that the proposed estimator is consistent.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
An Introduction to Multivariate Statistical Analysis
Muirhead, R. J., & Anderson, T. W. (1986) · Journal of Business & Economic Statistics · doi:10.2307/1391399 · Cited by 9,082
Atomic Decomposition by Basis Pursuit
Chen, S. S., Donoho, D. L., & Saunders, M. A. (1998) · SIAM Journal on Scientific Computing · doi:10.1137/s1064827596304010 · Cited by 6,845
The Econometrics of Financial Markets
Campbell, J. Y., Lo, A. W., & MacKinlay, A. C. (2012) · Princeton University Press eBooks · doi:10.2307/j.ctt7skm5 · Cited by 5,875
Atomic Decomposition by Basis Pursuit
Chen, S. S., Donoho, D. L., & Saunders, M. A. (2001) · SIAM Review · doi:10.1137/s003614450037906x · Cited by 5,085
Probability: Theory and Examples.
Prewitt, K., & Durrett, R. (1992) · Journal of the American Statistical Association · doi:10.2307/2290301 · Cited by 3,085
A well-conditioned estimator for large-dimensional covariance matrices
Ledoit, O., & Wolf, M. (2004) · Journal of Multivariate Analysis · doi:10.1016/s0047-259x(03)00096-4 · Cited by 3,046
On the distribution of the largest eigenvalue in principal components analysis
Johnstone, I. M. (2001) · The Annals of Statistics · doi:10.1214/aos/1009210544 · Cited by 1,949
Toeplitz Forms and Their Applications
Grenander, U., Szegö, G., & Kac, M. (1958) · Physics Today · doi:10.1063/1.3062237 · Cited by 1,840
Noise Dressing of Financial Correlation Matrices
Laloux, L., Cizeau, P., Bouchaud, J.-P., & Potters, M. (1999) · Physical Review Letters · doi:10.1103/physrevlett.83.1467 · Cited by 1,241
The Classical Moment Problem and Some Related Questions in Analysis
Akhiezer, N. I. (2020) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9781611976397 · Cited by 1,208
Regularized estimation of large covariance matrices
Bickel, P. J., & Levina, E. (2006) · Cited by 1,166
On Choosing and Bounding Probability Metrics
Gibbs, A. L., & Su, F. E. (2002) · International Statistical Review · doi:10.1111/j.1751-5823.2002.tb00178.x · Cited by 1,163
Asymptotic Theory for Principal Component Analysis
Anderson, T. W. (1963) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177704248 · Cited by 1,150
Toeplitz Forms and Their Applications.
Savage, L. J., Grenander, U., & Szego, G. (1958) · Journal of the American Statistical Association · doi:10.2307/2282065 · Cited by 1,045
Phase transition of the largest eigenvalue for nonnull complex sample covariance matrices
Baik, J., Ben Arous, G., & Péché, S. (2005) · The Annals of Probability · doi:10.1214/009117905000000233 · Cited by 967
Regularized estimation of large covariance matrices
Bickel, P. J., & Levina, E. (2008) · The Annals of Statistics · doi:10.1214/009053607000000758 · Cited by 934
Toeplitz and Circulant Matrices: A Review
Gray, R. M. (2005) · now publishers, Inc. eBooks · doi:10.1561/9781933019680 · Cited by 759
Eigenvalues of large sample covariance matrices of spiked population models
Baik, J., & Silverstein, J. W. (2006) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2005.08.003 · Cited by 701
On the Empirical Distribution of Eigenvalues of a Class of Large Dimensional Random Matrices
Silverstein, J. W., & Bai, Z. D. (1995) · Journal of Multivariate Analysis · doi:10.1006/jmva.1995.1051 · Cited by 697
METHODOLOGIES IN SPECTRAL ANALYSIS OF LARGE DIMENSIONAL RANDOM MATRICES, A REVIEW
Bai, Z. D. (2008) · Advances in Statistics · doi:10.1142/9789812793096_0015 · Cited by 627
ASYMPTOTICS OF SAMPLE EIGENSTRUCTURE FOR A LARGE DIMENSIONAL SPIKED COVARIANCE MODEL
Paul, D. (2007) · Cited by 577
Strong Convergence of the Empirical Distribution of Eigenvalues of Large Dimensional Random Matrices
Silverstein, J. W. (1995) · Journal of Multivariate Analysis · doi:10.1006/jmva.1995.1083 · Cited by 560
Bickel, P. J., & Levina, E. (2004) · Bernoulli · doi:10.3150/bj/1106314847 · Cited by 548
A Limit Theorem for the Norm of Random Matrices
Geman, S. (1980) · The Annals of Probability · doi:10.1214/aop/1176994775 · Cited by 419
Some limit theorems for the eigenvalues of a sample covariance matrix
Jonsson, D. (1982) · Journal of Multivariate Analysis · doi:10.1016/0047-259x(82)90080-x · Cited by 371
On the limit of the largest eigenvalue of the large dimensional sample covariance matrix
Yin, Y. Q., Bai, Z. D., & Krishnaiah, P. R. (1988) · Probability Theory and Related Fields · doi:10.1007/bf00353874 · Cited by 341
The Strong Limits of Random Matrix Spectra for Sample Matrices of Independent Elements
Wachter, K. W. (1978) · The Annals of Probability · doi:10.1214/aop/1176995607 · Cited by 288
Limiting spectral distribution for a class of random matrices
Yin, Y. (1986) · Journal of Multivariate Analysis · doi:10.1016/0047-259x(86)90019-9 · Cited by 200
Tracy–Widom limit for the largest eigenvalue of a large class of complex sample covariance matrices
El Karoui, N. (2007) · The Annals of Probability · doi:10.1214/009117906000000917 · Cited by 168
Self-citation
Cited by
Random Matrix Methods for Wireless Communications
Couillet, R., & Debbah, M. (2011) · Cambridge University Press eBooks · doi:10.1017/cbo9780511994746 · Cited by 966
Covariance regularization by thresholding
Bickel, P. J., & Levina, E. (2008) · The Annals of Statistics · doi:10.1214/08-aos600 · Cited by 893
Nonlinear shrinkage estimation of large-dimensional covariance matrices
Ledoit, O., & Wolf, M. (2012) · The Annals of Statistics · doi:10.1214/12-aos989 · Cited by 456
Large Dynamic Covariance Matrices
Engle, R. F., Ledoit, O., & Wolf, M. (2019) · Journal of Business & Economic Statistics · doi:10.1080/07350015.2017.1345683 · Cited by 271
Metadata
- Authors
- El Karoui, N.
- Venue
- The Annals of Statistics
- Publisher
- Institute of Mathematical Statistics
- Published
- 2008-12-01
- Volume
- 36
- Issue
- 6
- Pages
- 2757-2790
- ISSN
- 0090-5364 (ISSN-L)
- OpenAlex
- W2118800758
- Cited by
- 276
- References
- 31
- FWCI
- 16.76
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.