The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Shrinkage Algorithms for MMSE Covariance Estimation
Open accessAbstract
We address covariance estimation in the sense of minimum mean-squared error (MMSE) when the samples are Gaussian distributed. Specifically, we consider shrinkage methods which are suitable for high dimensional problems with a small number of samples (large p small n). First, we improve on the Ledoit-Wolf (LW) method by conditioning on a sufficient statistic. By the Rao-Blackwell theorem, this yields a new estimator called RBLW, whose mean-squared error dominates that of LW for Gaussian variables. Second, to further reduce the estimation error, we propose an iterative approach which approximates the clairvoyant shrinkage estimator. Convergence of this iterative method is established and a closed form expression for the limit is determined, which is referred to as the oracle approximating shrinkage (OAS) estimator. Both RBLW and OAS estimators have simple expressions and are easily implemented. Although the two methods are developed from different perspectives, their structure is identical up to specified constants. The RBLW estimator provably dominates the LW method for Gaussian samples. Numerical simulations demonstrate that the OAS approach can perform even better than RBLW, especially when n is much less than p . We also demonstrate the performance of these techniques in the context of adaptive beamforming.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Another methods called Oracle Approximating Shrinkage method [56] had been proposed as an improvement of Ledoit-Wolf shrinkage where α is computed under Gaussian distribution assumption on the samples.”
From Signal Estimation and Uncertainties Extraction in Terahertz Time-Domain Spectroscopy (2025) · cites this paper as [56]
Citations
Cites
Detection, Estimation, And Modulation Theory
Trees, H. L. V. (1968) · Cited by 5,969
On the self-similar nature of Ethernet traffic (extended version)
Leland, W. E., Taqqu, M. S., Willinger, W., & Wilson, D. V. (1994) · IEEE/ACM Transactions on Networking · doi:10.1109/90.282603 · Cited by 5,233
Detection, Estimation, and Modulation Theory, Part I
Van Trees, H. L. (2001) · John Wiley & Sons, Inc. eBooks · doi:10.1002/0471221082 · Cited by 3,891
A well-conditioned estimator for large-dimensional covariance matrices
Ledoit, O., & Wolf, M. (2004) · Journal of Multivariate Analysis · doi:10.1016/s0047-259x(03)00096-4 · Cited by 3,046
Spectral Analysis of Signals: The Missing Data Case
Wang, Y., Li, J., & Stoica, P. (2005) · Synthesis Lectures on Signal Processing · doi:10.1007/978-3-031-02525-9 · Cited by 2,890
Analysis of Financial Time Series
(2006) · Technometrics · doi:10.1198/tech.2006.s405 · Cited by 2,348
Estimation with Quadratic Loss
James, W., & Stein, C. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-0919-5_30 · Cited by 2,252
Ledoit, O., & Wolf, M. (2003) · Journal of Empirical Finance · doi:10.1016/s0927-5398(03)00007-0 · Cited by 1,627
Schäfer, J., & Strimmer, K. (2005) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1175 · Cited by 1,561
Capacity of a mobile multiple-antenna communication link in Rayleigh flat fading
Marzetta, T. L., & Hochwald, B. M. (1999) · IEEE Transactions on Information Theory · doi:10.1109/18.746779 · Cited by 1,348
Analysis of Financial Time Series
Tsay, R. S. (2005) · Wiley Series in Probability and Statistics · doi:10.1002/0471746193 · Cited by 1,348
Honey, I Shrunk the Sample Covariance Matrix
Ledoit, O., & Wolf, M. (2004) · The Journal of Portfolio Management · doi:10.3905/jpm.2004.110 · Cited by 1,266
Regularized estimation of large covariance matrices
Bickel, P. J., & Levina, E. (2006) · Cited by 1,166
Regularized estimation of large covariance matrices
Bickel, P. J., & Levina, E. (2008) · The Annals of Statistics · doi:10.1214/009053607000000758 · Cited by 934
Multivariate T-Distributions and Their Applications
Kotz, S., & Nadarajah, S. (2004) · Cambridge University Press eBooks · doi:10.1017/cbo9780511550683 · Cited by 915
Time Series and System Analysis with Applications.
Parzen, E., Pandit, S. M., & Wu, S.-M. (1985) · Journal of the American Statistical Association · doi:10.2307/2288103 · Cited by 678
An Introduction to Multivariate Statistics.
Healy, M. J. R., Srivastava, M. S., & Khatri, C. G. (1980) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2981995 · Cited by 410
Ledoit, O., & Wolf, M. (2002) · The Annals of Statistics · doi:10.1214/aos/1031689018 · Cited by 399
An Introduction to Multivariate Statistics
Streiner, D. L. (1993) · The Canadian Journal of Psychiatry · doi:10.1177/070674379303800104 · Cited by 395
Estimation of a Covariance Matrix Using the Reference Prior
Yang, R., & Berger, J. O. (1994) · The Annals of Statistics · doi:10.1214/aos/1176325625 · Cited by 284
Empirical Bayes Estimation of the Multivariate Normal Covariance Matrix
Haff, L. R. (1980) · The Annals of Statistics · doi:10.1214/aos/1176345010 · Cited by 268
Estimation of a Covariance Matrix under Stein's Loss
Dey, D. K., & Srinivasan, C. (1985) · The Annals of Statistics · doi:10.1214/aos/1176349756 · Cited by 253
On Using a priori Knowledge in Space-Time Adaptive Processing
Stoica, P., Li, J., Zhu, X., & Guerci, J. R. (2008) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2007.914347 · Cited by 240
Honey, I Shrunk the Sample Covariance MatrixPreprint
Ledoit, O., & Wolf, M. (2003) · SSRN Electronic Journal · doi:10.2139/ssrn.433840 · Cited by 223
Hassibi, B., & Marzetta, T. L. (2002) · IEEE Transactions on Information Theory · doi:10.1109/tit.2002.1003835 · Cited by 221
Some optimal multivariate tests
JOHN, S. (1971) · Biometrika · doi:10.1093/biomet/58.1.123 · Cited by 185
Estimation of a covariance matrix
Stein, C. (1975) · Medical Entomology and Zoology · Cited by 182
Singular Wishart and multivariate beta distributions
Srivastava, M. S. (2003) · The Annals of Statistics · doi:10.1214/aos/1065705118 · Cited by 145
On the self-similar nature of Ethernet traffic
Leland, W. E., Willinger, W., Taqqu, M. S., et al. (1995) · ACM SIGCOMM Computer Communication Review · doi:10.1145/205447.205464 · Cited by 145
All Invariant Moments of the Wishart Distribution
Letac, G., & Massam, H. (2004) · Scandinavian Journal of Statistics · doi:10.1111/j.1467-9469.2004.01-043.x · Cited by 87
Sensitivity‐encoded (SENSE) proton echo‐planar spectroscopic imaging (PEPSI) in the human brain
Lin, F., Tsai, S., Otazo, R., et al. (2007) · Magnetic Resonance in Medicine · doi:10.1002/mrm.21119 · Cited by 81
The pseudo-wishart distribution and its application to mimo systems
Mallik, R. K. (2003) · IEEE Transactions on Information Theory · doi:10.1109/tit.2003.817465 · Cited by 80
Modeling the Spatial and Temporal Dependence in fMRI Data
Derado, G., Bowman, F. D., & Kilts, C. D. (2009) · Biometrics · doi:10.1111/j.1541-0420.2009.01355.x · Cited by 73
Asymptotic Freeness Almost Everywhere for Random Matrices
Hiai, F. (1999) · Cited by 71
Properties of the singular, inverse and generalized inverse partitioned Wishart distributions
Bodnar, T., & Okhrin, Y. (2008) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2008.02.024 · Cited by 68
On Spatial Power Spectrum and Signal Estimation Using the Pisarenko Framework
Stoica, P., Li, J., & Tan, X. G. (2008) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2008.928935 · Cited by 60
GLRT-Based Detection-Estimation for Undersampled Training Conditions
Abramovich, Y. I., & Johnson, B. A. (2008) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2008.921736 · Cited by 50
Fully automatic computation of diagonal loading levels for robust adaptive beamforming
Li, J., Du, L., & Stoica, P. (2008) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2008.4518112 · Cited by 34
Enhanced Covariance Matrix Estimators in Adaptive Beamforming
Abrahamsson, R., Selén, Y., & Stoica, P. (2007) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2007.366399 · Cited by 33
Hassibi, B., & Marzetta, T. L. (2002) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit.2001.936204 · Cited by 15
A pre-test like estimator dominating the least-squares method
Eldar, Y. C., & Chernoi, J. S. (2007) · Journal of Statistical Planning and Inference · doi:10.1016/j.jspi.2007.12.002 · Cited by 12
Self-citationA Covariance Shaping Framework for Linear Multiuser Detection
Eldar, Y. C., & Shamai, S. S. (2005) · IEEE Transactions on Information Theory · doi:10.1109/tit.2005.850049 · Cited by 11
Self-citation
Research works printed but not linked: 2
- stoica, 2005, Spectral Analysis of Signals
- stein, 1956, inadmissibility of the usual estimator for the mean of a multivariate distribution, Proc 3rd Berkeley Symp Math Statist Prob 1, 197
Cited by
Patch-Based Near-Optimal Image Denoising
Chatterjee, P., & Milanfar, P. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2172799 · Cited by 296
Is Second-Order Information Helpful for Large-Scale Visual Recognition?
Li, P., Xie, J., Wang, Q., & Zuo, W. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.228 · Cited by 294
Robust Shrinkage Estimation of High-Dimensional Covariance Matrices
Chen, Y., Wiesel, A., & Hero, A. O. (2011) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2011.2138698 · Cited by 266
Self-citationLifelong Machine Learning with Deep Streaming Linear Discriminant Analysis
Hayes, T. L., & Kanan, C. (2019) · arXiv · doi:10.48550/arxiv.1909.01520 · Cited by 150
Mellot, A., Collas, A., Rodrigues, P. L. C., Engemann, D., & Gramfort, A. (2023) · Imaging Neuroscience · doi:10.1162/imag_a_00040 · Cited by 16
Metadata
- Authors
- Chen, Y., Wiesel, A., Eldar, Y. C., & Hero, A. O.
- Affiliations
- University of Michigan (US)
- Hebrew University of Jerusalem (IL)
- Technion – Israel Institute of Technology (IL)
- Venue
- IEEE Transactions on Signal Processing
- Published
- 2010-10
- Volume
- 58
- Issue
- 10
- Pages
- 5016-5029
- ISSN
- 1053-587X (ISSN-L)
- 1941-0476
- OpenAlex
- W2119963163
- Cited by
- 567
- References
- 42
- Citations by year
- 2026: 57 · 2025: 54 · 2024: 41 · 2023: 50 · 2022: 44 · 2021: 47 · 2020: 30 · 2019: 34 · 2018: 53 · 2017: 28 · 2016: 29 · 2015: 29 · 2014: 17 · 2013: 19 · 2012: 20
- FWCI
- 14.35
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE Transactions on Signal Processing (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- Physical Sciences › Computer Science › Signal Processing › Direction-of-Arrival Estimation Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Random Matrices and Applications
- Keywords
- covariance matrix estimation, shrinkage estimation, MMSE estimation, high-dimensional data, Rao-Blackwell theorem, sufficient statistics, mean squared error, adaptive beamforming
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.