The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Regularized estimation of large covariance matrices
Open accessAbstract
This paper considers estimating a covariance matrix of p variables from n observations by either banding or tapering the sample covariance matrix, or estimating a banded version of the inverse of the covariance. We show that these estimates are consistent in the operator norm as long as (log p)/n→0, and obtain explicit rates. The results are uniform over some fairly natural well-conditioned families of covariance matrices. We also introduce an analogue of the Gaussian white noise model and show that if the population covariance is embeddable in that model and well-conditioned, then the banded approximations produce consistent estimates of the eigenvalues and associated eigenvectors of the covariance matrix. The results can be extended to smooth versions of banding and to non-Gaussian distributions with sufficiently short tails. A resampling approach is proposed for choosing the banding parameter in practice. This approach is illustrated numerically on both simulated and real data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ridge regression: Biased estimation for nonorthogonal problems
Hoerl, A. E., & Kennard, R. W. (1970) · Technometrics · doi:10.1080/00401706.1970.10488634 · Cited by 9,648
Sparse Principal Component Analysis
Zou, H., Hastie, T., & Tibshirani, R. (2006) · Journal of Computational and Graphical Statistics · doi:10.1198/106186006x113430 · Cited by 3,152
A well-conditioned estimator for large-dimensional covariance matrices
Ledoit, O., & Wolf, M. (2004) · Journal of Multivariate Analysis · doi:10.1016/s0047-259x(03)00096-4 · Cited by 3,046
High-dimensional graphs and variable selection with the Lasso
Meinshausen, N., & Bühlmann, P. (2006) · The Annals of Statistics · doi:10.1214/009053606000000281 · Cited by 2,521
Regularized Discriminant Analysis
Friedman, J. H. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478752 · Cited by 2,421
On the distribution of the largest eigenvalue in principal components analysis
Johnstone, I. M. (2001) · The Annals of Statistics · doi:10.1214/aos/1009210544 · Cited by 1,949
DISTRIBUTION OF EIGENVALUES FOR SOME SETS OF RANDOM MATRICES
Marčenko, V. A., & Pastur, L. A. (1967) · Mathematics of the USSR-Sbornik · doi:10.1070/sm1967v001n04abeh001994 · Cited by 1,713
High dimensional covariance matrix estimation using a factor model
Fan, J., Fan, Y., & Lv, J. (2008) · Journal of Econometrics · doi:10.1016/j.jeconom.2008.09.017 · Cited by 685
Bickel, P. J., & Levina, E. (2004) · Bernoulli · doi:10.3150/bj/1106314847 · Cited by 548
Self-citationLimit of the Smallest Eigenvalue of a Large Dimensional Sample Covariance Matrix
Bai, Z. D., & Yin, Y. Q. (1993) · The Annals of Probability · doi:10.1214/aop/1176989118 · Cited by 519
Cited by
Sure Independence Screening for Ultrahigh Dimensional Feature Space
Fan, J., & Lv, J. (2008) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2008.00674.x · Cited by 2,711
Meinshausen, N., & Bühlmann, P. (2010) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2010.00740.x · Cited by 2,215
Confidence Intervals for Low Dimensional Parameters in High Dimensional Linear Models
Zhang, C.-H., & Zhang, S. S. (2014) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/rssb.12026 · Cited by 993
A Constrained ℓ1Minimization Approach to Sparse Precision Matrix Estimation
Cai, T., Liu, W., & Luo, X. (2011) · Journal of the American Statistical Association · doi:10.1198/jasa.2011.tm10155 · Cited by 973
Covariance regularization by thresholding
Bickel, P. J., & Levina, E. (2008) · The Annals of Statistics · doi:10.1214/08-aos600 · Cited by 893
Self-citationHigh-Dimensional Statistics: A Non-Asymptotic Viewpoint
Wainwright, M. J. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108627771 · Cited by 882
High-dimensional covariance estimation by minimizing ℓ1-penalized log-determinant divergence
Ravikumar, P., Wainwright, M. J., Raskutti, G., & Yu, B. (2011) · Electronic Journal of Statistics · doi:10.1214/11-ejs631 · Cited by 744
Obstacles to High-Dimensional Particle Filtering
Snyder, C., Bengtsson, T., Bickel, P., & Anderson, J. (2008) · Monthly Weather Review · doi:10.1175/2008mwr2529.1 · Cited by 696
Self-citationPartial Correlation Estimation by Joint Sparse Regression Models
Peng, J., Wang, P., Zhou, N., & Zhu, J. (2009) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.0126 · Cited by 688
High dimensional covariance matrix estimation using a factor model
Fan, J., Fan, Y., & Lv, J. (2008) · Journal of Econometrics · doi:10.1016/j.jeconom.2008.09.017 · Cited by 685
Shrinkage Algorithms for MMSE Covariance Estimation
Chen, Y., Wiesel, A., Eldar, Y. C., & Hero, A. O. (2010) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2010.2053029 · Cited by 567
Sparse permutation invariant covariance estimation
Rothman, A. J., Bickel, P. J., Levina, E., & Zhu, J. (2008) · Electronic Journal of Statistics · doi:10.1214/08-ejs176 · Cited by 560
Self-citationEstimation of (near) low-rank matrices with noise and high-dimensional scaling
Negahban, S., & Wainwright, M. J. (2011) · The Annals of Statistics · doi:10.1214/10-aos850 · Cited by 537
Generalized Thresholding of Large Covariance Matrices
Rothman, A. J., Levina, E., & Zhu, J. (2009) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.0101 · Cited by 489
Self-citationModel-based clustering of high-dimensional data: A review
Bouveyron, C., & Brunet-Saumard, C. (2014) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2012.12.008 · Cited by 467
Nonlinear shrinkage estimation of large-dimensional covariance matrices
Ledoit, O., & Wolf, M. (2012) · The Annals of Statistics · doi:10.1214/12-aos989 · Cited by 456
New Weighted Portmanteau Statistics for Time Series Goodness of Fit Testing
Fisher, T. J., & Gallagher, C. M. (2012) · Journal of the American Statistical Association · doi:10.1080/01621459.2012.688465 · Cited by 453
Joint estimation of multiple graphical models
Guo, J., Levina, E., Michailidis, G., & Zhu, J. (2011) · Biometrika · doi:10.1093/biomet/asq060 · Cited by 431
Self-citationSparsistency and rates of convergence in large covariance matrix estimation
Lam, C., & Fan, J. (2009) · The Annals of Statistics · doi:10.1214/09-aos720 · Cited by 418
Sparse Bayesian infinite factor models
Bhattacharya, A., & Dunson, D. B. (2011) · Biometrika · doi:10.1093/biomet/asr013 · Cited by 413
Non-Euclidean statistics for covariance matrices, with applications to diffusion tensor imaging
Dryden, I. L., Koloydenko, A., & Zhou, D. (2009) · The Annals of Applied Statistics · doi:10.1214/09-aoas249 · Cited by 383
Latent variable graphical model selection via convex optimization
Chandrasekaran, V., Parrilo, P. A., & Willsky, A. S. (2012) · The Annals of Statistics · doi:10.1214/11-aos949 · Cited by 377
Forward Regression for Ultra-High Dimensional Variable Screening
Wang, H. (2009) · Journal of the American Statistical Association · doi:10.1198/jasa.2008.tm08516 · Cited by 366
High-dimensional covariance matrix estimation in approximate factor models
Fan, J., Liao, Y., & Mincheva, M. (2011) · The Annals of Statistics · doi:10.1214/11-aos944 · Cited by 358
Estimation of high-dimensional low-rank matrices
Rohde, A., & Tsybakov, A. B. (2011) · The Annals of Statistics · doi:10.1214/10-aos860 · Cited by 330
Feasible generalized least squares for panel data with cross-sectional and serial correlations
Bai, J., Choi, S. H., & Liao, Y. (2021) · Empirical Economics · doi:10.1007/s00181-020-01977-2 · Cited by 320
Optimal rates of convergence for covariance matrix estimation
Cai, T. T., Zhang, C.-H., & Zhou, H. H. (2010) · The Annals of Statistics · doi:10.1214/09-aos752 · Cited by 318
Strong oracle optimality of folded concave penalized estimation
Fan, J., Xue, L., & Zou, H. (2014) · The Annals of Statistics · doi:10.1214/13-aos1198 · Cited by 313
Spectrum estimation for large dimensional covariance matrices using random matrix theory
El Karoui, N. (2008) · The Annals of Statistics · doi:10.1214/07-aos581 · Cited by 276
Robust Shrinkage Estimation of High-Dimensional Covariance Matrices
Chen, Y., Wiesel, A., & Hero, A. O. (2011) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2011.2138698 · Cited by 266
Geometric median and robust estimation in Banach spaces
Minsker, S. (2015) · Bernoulli · doi:10.3150/14-bej645 · Cited by 261
Robust covariance and scatter matrix estimation under Huber’s contamination model
Chen, M., Gao, C., & Ren, Z. (2018) · The Annals of Statistics · doi:10.1214/17-aos1607 · Cited by 146
Bayesian multivariate meta-analysis of multiple factors
Lin, L., & Chu, H. (2018) · Research Synthesis Methods · doi:10.1002/jrsm.1293 · Cited by 19
Metadata
- Authors
- Bickel, P. J., & Levina, E.
- Venue
- The Annals of Statistics
- Publisher
- Institute of Mathematical Statistics
- Published
- 2008-02-01
- Volume
- 36
- Issue
- 1
- Pages
- 199-227
- ISSN
- 0090-5364 (ISSN-L)
- OpenAlex
- W2130351130
- Cited by
- 934
- References
- 18
- FWCI
- 31.05
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.