The DOI matches its Crossref record; 244 of the 244 references it cites were found in a registry or an index.
High-Dimensional Statistics: A Non-Asymptotic Viewpoint
Abstract
Recent years have witnessed an explosion in the volume and variety of data collected in all scientific disciplines and industrial settings. Such massive data sets present a number of challenges to researchers in statistics and machine learning. This book provides a self-contained introduction to the area of high-dimensional statistics, aimed at the first-year graduate level. It includes chapters that are focused on core methodology and theory - including tail bounds, concentration inequalities, uniform laws and empirical process, and random matrices - as well as chapters devoted to in-depth exploration of particular model classes - including sparse linear models, matrix models with rank constraints, graphical models, and various types of non-parametric models. With hundreds of worked examples and exercises, this text is intended both for courses and for self-study by graduate students and researchers in statistics, machine learning, and related fields who must understand, apply, and adapt modern statistical methods suited to large-scale data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Elements of Information Theory
Cover, T. M., & Thomas, J. A. (2001) · Wiley eBooks · doi:10.1002/0471200611 · Cited by 36,808
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193
Stochastic relaxation, gibbs distributions, and the bayesian restoration of images.
Geman, S., & Geman, D. (1984) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1984.4767596 · Cited by 17,949
Rockafellar, R. T. (1970) · Princeton University Press eBooks · doi:10.1515/9781400873173 · Cited by 10,801
Horn, R. A., & Johnson, C. R. (1985) · Cambridge University Press eBooks · doi:10.1017/cbo9780511810817 · Cited by 10,280
Ridge regression: Biased estimation for nonorthogonal problems
Hoerl, A. E., & Kennard, R. W. (1970) · Technometrics · doi:10.1080/00401706.1970.10488634 · Cited by 9,648
Horn, R. A., & Johnson, C. R. (1991) · Cambridge University Press eBooks · doi:10.1017/cbo9780511840371 · Cited by 9,319
Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Fan, J., & Li, R. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753382273 · Cited by 8,900
Density Estimation for Statistics and Data Analysis
(1986) · Springer eBooks · doi:10.1007/978-1-4899-3324-9 · Cited by 8,525
The adaptive lasso and its oracle properties
Zou, H. (2006) · Journal of the American Statistical Association · doi:10.1198/016214506000000735 · Cited by 7,470
Model Selection and Estimation in Regression with Grouped Variables
Yuan, M., & Lin, Y. (2006) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00532.x · Cited by 7,261
Decoding by Linear Programming
Candes, E. J., & Tao, T. (2005) · IEEE Transactions on Information Theory · doi:10.1109/tit.2005.858979 · Cited by 7,121
Robust principal component analysis?
Candès, E. J., Li, X., Ma, Y., & Wright, J. (2011) · Journal of the ACM · doi:10.1145/1970392.1970395 · Cited by 6,921
Iterative Solution of Nonlinear Equations in Several Variables
Ortega, J. M., & Rheinboldt, W. C. (2000) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9780898719468 · Cited by 6,860
Atomic Decomposition by Basis Pursuit
Chen, S. S., Donoho, D. L., & Saunders, M. A. (1998) · SIAM Journal on Scientific Computing · doi:10.1137/s1064827596304010 · Cited by 6,845
Communication in the presence of noise
Shannon, C. E. (1949) · Proceedings of the IRE · doi:10.1109/jrproc.1949.232969 · Cited by 6,539
Sparse inverse covariance estimation with the graphical lasso
Friedman, J., Hastie, T., & Tibshirani, R. (2008) · Biostatistics · doi:10.1093/biostatistics/kxm045 · Cited by 6,355
Spatial Interaction and the Statistical Analysis of Lattice Systems
Besag, J. (1974) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1974.tb00999.x · Cited by 6,067
Strictly Proper Scoring Rules, Prediction, and Estimation
Gneiting, T., & Raftery, A. E. (2007) · Journal of the American Statistical Association · doi:10.1198/016214506000001437 · Cited by 5,793
Phase retrieval algorithms: a comparison
Fienup, J. R. (1982) · Applied Optics · doi:10.1364/ao.21.002758 · Cited by 5,596
Aronszajn, N. (1950) · Transactions of the American Mathematical Society · doi:10.1090/s0002-9947-1950-0051437-7 · Cited by 5,380
Weak Convergence and Empirical Processes
van der Vaart, A. W., & Wellner, J. A. (1996) · Springer Series in Statistics · doi:10.1007/978-1-4757-2545-2 · Cited by 5,014
Exact Matrix Completion via Convex Optimization
Candès, E. J., & Recht, B. (2009) · Foundations of Computational Mathematics · doi:10.1007/s10208-009-9045-5 · Cited by 4,877
Probability Inequalities for Sums of Bounded Random Variables
Hoeffding, W. (1963) · Journal of the American Statistical Association · doi:10.1080/01621459.1963.10500830 · Cited by 4,852
Causation, Prediction, and Search
Spirtes, P., Glymour, C., & Scheines, R. (2001) · doi:10.7551/mitpress/1754.001.0001 · Cited by 4,521
Beitrag zur Theorie des Ferromagnetismus
Ising, E. (1925) · Zeitschrift für Physik · doi:10.1007/bf02980577 · Cited by 3,871
Nearly unbiased variable selection under minimax concave penalty
Zhang, C.-H. (2010) · The Annals of Statistics · doi:10.1214/09-aos729 · Cited by 3,835
Multivariate Density Estimation: Theory, Practice, and Visualization
Scott, D. W. (1992) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316849 · Cited by 3,696
(2012) · MPG.PuRe (Max Planck Society) · doi:10.5555/2188385.2188410 · Cited by 3,603
A Measure of Asymptotic Efficiency for Tests of a Hypothesis Based on the sum of Observations
Chernoff, H. (1952) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729330 · Cited by 3,550
Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization
Recht, B., Fazel, M., & Parrilo, P. A. (2010) · SIAM Review · doi:10.1137/070697835 · Cited by 3,471
Hastie, T., & Tibshirani, R. (1986) · Statistical Science · doi:10.1214/ss/1177013604 · Cited by 3,409
Lauritzen, S. L. (1996) · doi:10.1093/oso/9780198522195.001.0001 · Cited by 2,976
Sparsity and Smoothness Via the Fused Lasso
Tibshirani, R., Saunders, M., Rosset, S., Zhu, J., & Knight, K. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00490.x · Cited by 2,724
Extensions of Lipschitz mappings into a Hilbert space
Johnson, W. B., & Lindenstrauss, J. (1984) · Contemporary Mathematics · doi:10.1090/conm/026/737400 · Cited by 2,523
High-dimensional graphs and variable selection with the Lasso
Meinshausen, N., & Bühlmann, P. (2006) · The Annals of Statistics · doi:10.1214/009053606000000281 · Cited by 2,521
Donoho, D. L. (2006) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.20132 · Cited by 2,490
Introduction to Nonparametric Estimation
Tsybakov, A. B. (2009) · Springer Series in Statistics · doi:10.1007/b13794 · Cited by 2,486
Simultaneous analysis of Lasso and Dantzig selector
Bickel, P. J., Ritov, Y., & Tsybakov, A. B. (2009) · The Annals of Statistics · doi:10.1214/08-aos620 · Cited by 2,396
Convex Analysis and Minimization Algorithms I
Hiriart-Urruty, J.-B., & Lemaréchal, C. (1993) · Grundlehren der mathematischen Wissenschaften · doi:10.1007/978-3-662-02796-7 · Cited by 2,378
DeVore, R. A., & Lorentz, G. G. (1993) · Grundlehren der mathematischen Wissenschaften · doi:10.1007/978-3-662-02888-9 · Cited by 2,352
Robust Regression: Asymptotics, Conjectures and Monte Carlo
Huber, P. J. (1973) · The Annals of Statistics · doi:10.1214/aos/1176342503 · Cited by 2,328
Richardson, T., & Urbanke, R. (2008) · Cambridge University Press eBooks · doi:10.1017/cbo9780511791338 · Cited by 2,271
Friedman, J. H., & Stuetzle, W. (1981) · Journal of the American Statistical Association · doi:10.1080/01621459.1981.10477729 · Cited by 2,216
Signal estimation from modified short-time Fourier transform
Griffin, D., & Lim, J. (1984) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1984.1164317 · Cited by 2,095
On the distribution of the largest eigenvalue in principal components analysis
Johnstone, I. M. (2001) · The Annals of Statistics · doi:10.1214/aos/1009210544 · Cited by 1,949
Uncertainty principles and ideal atomic decomposition
Donoho, D. L., & Huo, X. (2001) · IEEE Transactions on Information Theory · doi:10.1109/18.959265 · Cited by 1,949
Convergence of Stochastic Processes
Pollard, D. (1984) · Springer Series in Statistics · doi:10.1007/978-1-4612-5254-2 · Cited by 1,841
Concentration Inequalities: A Nonasymptotic Theory of Independence
Boucheron, S., Lugosi, G., & Massart, P. (2013) · doi:10.1093/acprof:oso/9780199535255.001.0001 · Cited by 1,768
Logarithmic Sobolev Inequalities
Gross, L. (1975) · American Journal of Mathematics · doi:10.2307/2373688 · Cited by 1,755
Measurement Error in Nonlinear Models
Carroll, R. J., Ruppert, D., & Stefanski, L. A. (1995) · Springer eBooks · doi:10.1007/978-1-4899-4477-1 · Cited by 1,749
The Dantzig selector: Statistical estimation when p is much larger than n
Candes, E., & Tao, T. (2007) · The Annals of Statistics · doi:10.1214/009053606000001523 · Cited by 1,747
A Distribution-Free Theory of Nonparametric Regression
Györfi, L., Kohler, M., Krzyżak, A., & Walk, H. (2002) · Springer Series in Statistics · doi:10.1007/b97848 · Cited by 1,738
DISTRIBUTION OF EIGENVALUES FOR SOME SETS OF RANDOM MATRICES
Marčenko, V. A., & Pastur, L. A. (1967) · Mathematics of the USSR-Sbornik · doi:10.1070/sm1967v001n04abeh001994 · Cited by 1,713
Candes, E. J., & Plan, Y. (2010) · Proceedings of the IEEE · doi:10.1109/jproc.2009.2035722 · Cited by 1,709
Williams, D. (1991) · Cambridge University Press eBooks · doi:10.1017/cbo9780511813658 · Cited by 1,691
Statistics for High-Dimensional Data: Methods, Theory and Applications
Bühlmann, P., & van de Geer, S. (2011) · Springer Series in Statistics · doi:10.1007/978-3-642-20192-9 · Cited by 1,680
Integrating structured biological data by Kernel Maximum Mean Discrepancy
Borgwardt, K. M., Gretton, A., Rasch, M. J., Kriegel, H.-P., Schölkopf, B., & Smola, A. J. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl242 · Cited by 1,674
Model selection and estimation in the Gaussian graphical model
Yuan, M., & Lin, Y. (2007) · Biometrika · doi:10.1093/biomet/asm018 · Cited by 1,627
Characteristic Vectors of Bordered Matrices With Infinite Dimensions
Wigner, E. P. (1955) · The Annals of Mathematics · doi:10.2307/1970079 · Cited by 1,572
Statistical Analysis of Non-Lattice Data
Besag, J. (1975) · The Statistician · doi:10.2307/2987782 · Cited by 1,559
Reproducing Kernel Hilbert Spaces in Probability and Statistics
Berlinet, A., & Thomas-Agnan, C. (2004) · Springer eBooks · doi:10.1007/978-1-4419-9096-9 · Cited by 1,558
Spectral Analysis of Large Dimensional Random Matrices
Bai, Z., & Silverstein, J. W. (2010) · Springer Series in Statistics · doi:10.1007/978-1-4419-0661-8 · Cited by 1,544
On a measure of the information provided by an experiment
Lindley, D. V. (1956) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177728069 · Cited by 1,509
Optimal Global Rates of Convergence for Nonparametric Regression
Stone, C. J. (1982) · The Annals of Statistics · doi:10.1214/aos/1176345969 · Cited by 1,497
On the Distribution of the Roots of Certain Symmetric Matrices
Wigner, E. P. (1958) · The Annals of Mathematics · doi:10.2307/1970008 · Cited by 1,463
Eigentaste: A Constant Time Collaborative Filtering Algorithm
Goldberg, K., Roeder, T., Gupta, D., & Perkins, C. (2001) · Information Retrieval · doi:10.1023/a:1011419012209 · Cited by 1,438
Just relax: convex programming methods for identifying sparse signals in noise
Tropp, J. A. (2006) · IEEE Transactions on Information Theory · doi:10.1109/tit.2005.864420 · Cited by 1,407
Model-Based Compressive Sensing
Baraniuk, R. G., Cevher, V., Duarte, M. F., & Hegde, C. (2010) · IEEE Transactions on Information Theory · doi:10.1109/tit.2010.2040894 · Cited by 1,308
Huber, P. J. (1985) · The Annals of Statistics · doi:10.1214/aos/1176349519 · Cited by 1,277
Some results on Tchebycheffian spline functions
Kimeldorf, G., & Wahba, G. (1971) · Journal of Mathematical Analysis and Applications · doi:10.1016/0022-247x(71)90184-3 · Cited by 1,254
Probability: Theory and Examples
Durrett, R. (2010) · Cambridge University Press eBooks · doi:10.1017/cbo9780511779398 · Cited by 1,251
Additive Regression and Other Nonparametric Models
Stone, C. J. (1985) · The Annals of Statistics · doi:10.1214/aos/1176349548 · Cited by 1,232
Wainwright, M. J. (2009) · IEEE Transactions on Information Theory · doi:10.1109/tit.2009.2016018 · Cited by 1,198
Self-citationPhaseLift: Exact and Stable Signal Recovery from Magnitude Measurements via Convex Programming
Candès, E. J., Strohmer, T., & Voroninski, V. (2013) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.21432 · Cited by 1,197
Semiparametric least squares (SLS) and weighted SLS estimation of single-index models
Ichimura, H. (1993) · Journal of Econometrics · doi:10.1016/0304-4076(93)90114-k · Cited by 1,192
Ledoux, M., & Talagrand, M. (1991) · doi:10.1007/978-3-642-20212-4 · Cited by 1,160
A unified framework for high-dimensional analysis of M-estimators with decomposable regularizers
Negahban, S. N. (2011) · Cited by 1,099
Weighted sums of certain dependent random variables
Azuma, K. (1967) · Tohoku Mathematical Journal · doi:10.2748/tmj/1178243286 · Cited by 1,084
Statistical theory of superlattices
Bethe, H. A. (1935) · Proceedings of the Royal Society of London. Series A - Mathematical and Physical Sciences · doi:10.1098/rspa.1935.0122 · Cited by 1,069
Nonparametric and Semiparametric Models
Härdle, W., Werwatz, A., Müller, M., & Sperlich, S. (2004) · Springer Series in Statistics · doi:10.1007/978-3-642-17146-8 · Cited by 1,061
Uncertainty Principles and Signal Recovery
Donoho, D. L., & Stark, P. B. (1989) · SIAM Journal on Applied Mathematics · doi:10.1137/0149053 · Cited by 1,054
Modern Multivariate Statistical Techniques
Izenman, A. J. (2008) · Springer Texts in Statistics · doi:10.1007/978-0-387-78189-1 · Cited by 1,038
Cones of Matrices and Set-Functions and 0–1 Optimization
Lovász, L., & Schrijver, A. (1991) · SIAM Journal on Optimization · doi:10.1137/0801013 · Cited by 1,008
Compressed sensing and best 𝑘-term approximation
Cohen, A., Dahmen, W., & DeVore, R. (2008) · Journal of the American Mathematical Society · doi:10.1090/s0894-0347-08-00610-3 · Cited by 1,002
Linear Smoothers and Additive Models
Buja, A., Hastie, T., & Tibshirani, R. (1989) · The Annals of Statistics · doi:10.1214/aos/1176347115 · Cited by 989
Matrix Completion From a Few Entries
Keshavan, R. H., Montanari, A., & Oh, S. (2010) · IEEE Transactions on Information Theory · doi:10.1109/tit.2010.2046205 · Cited by 974
A Constrained ℓ1Minimization Approach to Sparse Precision Matrix Estimation
Cai, T., Liu, W., & Luo, X. (2011) · Journal of the American Statistical Association · doi:10.1198/jasa.2011.tm10155 · Cited by 973
The Volume of Convex Bodies and Banach Space Geometry
Pisier, G. (1989) · Cambridge University Press eBooks · doi:10.1017/cbo9780511662454 · Cited by 967
Dvoretzky, A., Kiefer, J., & Wolfowitz, J. (1956) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177728174 · Cited by 964
Regularized estimation of large covariance matrices
Bickel, P. J., & Levina, E. (2008) · The Annals of Statistics · doi:10.1214/009053607000000758 · Cited by 934
Large Covariance Estimation by Thresholding Principal Orthogonal Complements
Fan, J., Liao, Y., & Mincheva, M. (2013) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/rssb.12016 · Cited by 909
The Brunn-Minkowski inequality
Gardner, R. J. (2002) · Bulletin of the American Mathematical Society · doi:10.1090/s0273-0979-02-00941-2 · Cited by 894
Covariance regularization by thresholding
Bickel, P. J., & Levina, E. (2008) · The Annals of Statistics · doi:10.1214/08-aos600 · Cited by 893
High-dimensional Ising model selection using ℓ1-regularized logistic regression
Ravikumar, P., Wainwright, M. J., & Lafferty, J. D. (2010) · The Annals of Statistics · doi:10.1214/09-aos691 · Cited by 892
Self-citationThe Convex Geometry of Linear Inverse Problems
Chandrasekaran, V., Recht, B., Parrilo, P. A., & Willsky, A. S. (2012) · Foundations of Computational Mathematics · doi:10.1007/s10208-012-9135-7 · Cited by 886
Computational Advertising: Techniques for Targeting Relevant Ads
Woodruff, D. P. (2014) · Foundations and Trends® in Theoretical Computer Science · doi:10.1561/0400000060 · Cited by 866
On Consistency and Sparsity for Principal Components Analysis in High Dimensions
Johnstone, I. M., & Lu, A. Y. (2009) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.0121 · Cited by 847
Group lasso with overlap and graph lasso
Jacob, L., Obozinski, G., & Vert, J.-P. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553431 · Cited by 833
Concentration of measure and isoperimetric inequalities in product spaces
Talagrand, M. (1995) · Publications Mathématiques de l'IHÉS · doi:10.1007/bf02699376 · Cited by 829
A Modified Principal Component Technique Based on the LASSO
Jolliffe, I. T., Trendafilov, N. T., & Uddin, M. (2003) · Journal of Computational and Graphical Statistics · doi:10.1198/1061860032148 · Cited by 809
Uniform Central Limit Theorems
Dudley, R. M. (1999) · Cambridge University Press eBooks · doi:10.1017/cbo9780511665622 · Cited by 785
The One-Sided Barrier Problem for Gaussian Noise
Slepian, D. (1962) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1962.tb02419.x · Cited by 784
Probability Inequalities for the Sum of Independent Random Variables
Bennett, G. (1962) · Journal of the American Statistical Association · doi:10.1080/01621459.1962.10482149 · Cited by 782
High-dimensional covariance estimation by minimizing ℓ1-penalized log-determinant divergence
Ravikumar, P., Wainwright, M. J., Raskutti, G., & Yu, B. (2011) · Electronic Journal of Statistics · doi:10.1214/11-ejs631 · Cited by 744
Self-citationThe Tight Constant in the Dvoretzky-Kiefer-Wolfowitz Inequality
Massart, P. (1990) · The Annals of Probability · doi:10.1214/aop/1176990746 · Cited by 735
n-Widths in Approximation Theory
Pinkus, A. (1985) · Springer eBooks · doi:10.1007/978-3-642-69894-1 · Cited by 732
Optimization with Sparsity-Inducing Penalties
Bach, F., Jenatton, R., Mairal, J., & Obozinski, G. (2025) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000015 · Cited by 730
Linear Inversion of Band-Limited Reflection Seismograms
Santosa, F., & Symes, W. W. (1986) · SIAM Journal on Scientific and Statistical Computing · doi:10.1137/0907087 · Cited by 713
Eigenvalues of large sample covariance matrices of spiked population models
Baik, J., & Silverstein, J. W. (2006) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2005.08.003 · Cited by 701
Rank-Sparsity Incoherence for Matrix Decomposition
Chandrasekaran, V., Sanghavi, S., Parrilo, P. A., & Willsky, A. S. (2011) · SIAM Journal on Optimization · doi:10.1137/090761793 · Cited by 686
On the conditions used to prove oracle results for the Lasso
van de Geer, S. A., & Bühlmann, P. (2009) · Electronic Journal of Statistics · doi:10.1214/09-ejs506 · Cited by 684
One-step sparse estimates in nonconcave penalized likelihood models
Zou, H., & Li, R. (2008) · The Annals of Statistics · doi:10.1214/009053607000000802 · Cited by 683
A Direct Formulation for Sparse PCA Using Semidefinite Programming
d'Aspremont, A., El Ghaoui, L., Jordan, M. I., & Lanckriet, G. R. G. (2007) · SIAM Review · doi:10.1137/050645506 · Cited by 678
A generalized uncertainty principle and sparse representation in pairs of bases
Elad, M., & Bruckstein, A. M. (2002) · IEEE Transactions on Information Theory · doi:10.1109/tit.2002.801410 · Cited by 673
Investigating Smooth Multiple Regression by the Method of Average Derivatives
Härdle, W., & Stoker, T. M. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478863 · Cited by 658
Convex trace functions and the Wigner-Yanase-Dyson conjecture
Lieb, E. H. (1973) · Advances in Mathematics · doi:10.1016/0001-8708(73)90011-x · Cited by 653
Square-root lasso: pivotal recovery of sparse signals via conic programming
Belloni, A., Chernozhukov, V., & Wang, L. (2011) · Biometrika · doi:10.1093/biomet/asr043 · Cited by 635
Donoho, D. L. (2006) · Communications on Pure and Applied Mathematics · doi:10.1002/cpa.20131 · Cited by 634
The composite absolute penalties family for grouped and hierarchical variable selection
Zhao, P., Rocha, G., & Yu, B. (2009) · The Annals of Statistics · doi:10.1214/07-aos584 · Cited by 631
Recovering Low-Rank Matrices From Few Coefficients in Any Basis
Gross, D. (2011) · IEEE Transactions on Information Theory · doi:10.1109/tit.2011.2104999 · Cited by 602
Nuclear-norm penalization and optimal rates for noisy low-rank matrix completion
Koltchinskii, V., Lounici, K., & Tsybakov, A. B. (2011) · The Annals of Statistics · doi:10.1214/11-aos894 · Cited by 598
Reduced-rank regression for the multivariate linear model
Izenman, A. J. (1975) · Journal of Multivariate Analysis · doi:10.1016/0047-259x(75)90042-1 · Cited by 594
Phase recovery, MaxCut and complex semidefinite programming
Waldspurger, I., d’Aspremont, A., & Mallat, S. (2015) · Mathematical Programming · doi:10.1007/s10107-013-0738-9 · Cited by 573
Central Limit Theorems for Empirical Measures
Dudley, R. M. (1978) · The Annals of Probability · doi:10.1214/aop/1176995384 · Cited by 571
Strong Convergence of the Empirical Distribution of Eigenvalues of Large Dimensional Random Matrices
Silverstein, J. W. (1995) · Journal of Multivariate Analysis · doi:10.1006/jmva.1995.1083 · Cited by 560
Sparse permutation invariant covariance estimation
Rothman, A. J., Bickel, P. J., Levina, E., & Zhu, J. (2008) · Electronic Journal of Statistics · doi:10.1214/08-ejs176 · Cited by 560
Information-theoretic determination of minimax rates of convergence
Yang, Y., & Barron, A. (1999) · The Annals of Statistics · doi:10.1214/aos/1017939142 · Cited by 555
Integral Probability Metrics and Their Generating Classes of Functions
Müller, A. (1997) · Advances in Applied Probability · doi:10.1017/s000186780002807x · Cited by 548
Phase-retrieval stagnation problems and solutions
Fienup, J. R., & Wackerman, C. C. (1986) · Journal of the Optical Society of America A · doi:10.1364/josaa.3.001897 · Cited by 538
Estimation of (near) low-rank matrices with noise and high-dimensional scaling
Negahban, S., & Wainwright, M. J. (2011) · The Annals of Statistics · doi:10.1214/10-aos850 · Cited by 537
Self-citationRavikumar, P., Lafferty, J., Liu, H., & Wasserman, L. (2009) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2009.00718.x · Cited by 535
High-dimensional regression with noisy and missing data: Provable guarantees with nonconvexity
Loh, P.-L., & Wainwright, M. J. (2012) · The Annals of Statistics · doi:10.1214/12-aos1018 · Cited by 529
Self-citationHuang, J., & Zhang, T. (2010) · The Annals of Statistics · doi:10.1214/09-aos778 · Cited by 521
High-dimensional semiparametric Gaussian copula graphical models
Liu, H., Han, F., Yuan, M., Lafferty, J., & Wasserman, L. (2012) · The Annals of Statistics · doi:10.1214/12-aos1037 · Cited by 507
Hanson-Wright inequality and sub-gaussian concentration
Rudelson, M., & Vershynin, R. (2013) · Electronic Communications in Probability · doi:10.1214/ecp.v18-2865 · Cited by 502
New concentration inequalities in product spaces
Talagrand, M. (1996) · Inventiones Mathematicae · doi:10.1007/s002220050108 · Cited by 501
Recovery of the acoustic impedance from reflection seismograms
Oldenburg, D. W., Scheuer, T., & Levy, S. (1983) · Geophysics · doi:10.1190/1.1441413 · Cited by 480
Synopses for Massive Data: Samples, Histograms, Wavelets, Sketches
Cormode, G., Garofalakis, M., Haas, P. J., & Jermaine, C. (2011) · Foundations and Trends in Databases · doi:10.1561/1900000004 · Cited by 468
High-dimensional additive modeling
Meier, L., van de Geer, S., & Bühlmann, P. (2009) · The Annals of Statistics · doi:10.1214/09-aos692 · Cited by 458
Minimax Rates of Estimation for High-Dimensional Linear Regression Over $\ell_q$-Balls
Raskutti, G., Wainwright, M. J., & Yu, B. (2011) · IEEE Transactions on Information Theory · doi:10.1109/tit.2011.2165799 · Cited by 455
Self-citationRudin, W. (1990) · Wiley eBooks · doi:10.1002/9781118165621 · Cited by 447
Nonconcave Penalized Likelihood With NP-Dimensionality
Fan, J., & Lv, J. (2011) · IEEE Transactions on Information Theory · doi:10.1109/tit.2011.2158486 · Cited by 427
The sizes of compact subsets of Hilbert space and continuity of Gaussian processes
Dudley, R. M. (1967) · Journal of Functional Analysis · doi:10.1016/0022-1236(67)90017-1 · Cited by 423
Strong converse for identification via quantum channels
Ahlswede, R., & Winter, A. (2002) · IEEE Transactions on Information Theory · doi:10.1109/18.985947 · Cited by 423
Convergence of Estimates Under Dimensionality Restrictions
LeCam, L. (1973) · The Annals of Statistics · doi:10.1214/aos/1193342380 · Cited by 422
Information-Theoretic Limits on Sparsity Recovery in the High-Dimensional and Noisy Setting
Wainwright, M. J. (2009) · IEEE Transactions on Information Theory · doi:10.1109/tit.2009.2032816 · Cited by 420
Self-citationA Limit Theorem for the Norm of Random Matrices
Geman, S. (1980) · The Annals of Probability · doi:10.1214/aop/1176994775 · Cited by 419
Sparsistency and rates of convergence in large covariance matrix estimation
Lam, C., & Fan, J. (2009) · The Annals of Statistics · doi:10.1214/09-aos720 · Cited by 418
Simultaneous Variable Selection
Turlach, B. A., Venables, W. N., & Wright, S. J. (2005) · Technometrics · doi:10.1198/004017005000000139 · Cited by 386
Latent variable graphical model selection via convex optimization
Chandrasekaran, V., Parrilo, P. A., & Willsky, A. S. (2012) · The Annals of Statistics · doi:10.1214/11-aos949 · Cited by 377
Semidefinite relaxation and nonconvex quadratic optimization
Nesterov, Y. (1998) · Optimization Methods and Software · doi:10.1080/10556789808805690 · Cited by 375
A Comparison of the Sherali-Adams, Lovász-Schrijver, and Lasserre Relaxations for 0–1 Programming
Laurent, M. (2003) · Mathematics of Operations Research · doi:10.1287/moor.28.3.470.16391 · Cited by 373
Rademacher penalties and structural risk minimization
Koltchinskii, V. (2001) · IEEE Transactions on Information Theory · doi:10.1109/18.930926 · Cited by 373
Bartlett, P. L., Bousquet, O., & Mendelson, S. (2005) · The Annals of Statistics · doi:10.1214/009053605000000282 · Cited by 372
Random Vectors in the Isotropic Position
Rudelson, M. (1999) · Journal of Functional Analysis · doi:10.1006/jfan.1998.3384 · Cited by 371
Nonparametric Maximum Likelihood Estimation by the Method of Sieves
Geman, S., & Hwang, C.-R. (1982) · The Annals of Statistics · doi:10.1214/aos/1176345782 · Cited by 367
Local Rademacher complexities and oracle inequalities in risk minimization
Koltchinskii, V. I. (2006) · The Annals of Statistics · doi:10.1214/009053606000001019 · Cited by 364
Persistence in high-dimensional linear predictor selection and the virtue of overparametrization
Greenshtein, E., & Ritov, Y. (2004) · Bernoulli · doi:10.3150/bj/1106314846 · Cited by 362
Support union recovery in high-dimensional multivariate regression
Obozinski, G., Wainwright, M. J., & Jordan, M. I. (2011) · The Annals of Statistics · doi:10.1214/09-aos776 · Cited by 350
Self-citationFirst-Order Methods for Sparse Covariance Selection
d'Aspremont, A., Banerjee, O., & El Ghaoui, L. (2008) · SIAM Journal on Matrix Analysis and Applications · doi:10.1137/060670985 · Cited by 343
Oracle inequalities and optimal inference under group sparsity
Lounici, K., Pontil, M., van de Geer, S., & Tsybakov, A. B. (2011) · The Annals of Statistics · doi:10.1214/11-aos896 · Cited by 341
Estimation of high-dimensional low-rank matrices
Rohde, A., & Tsybakov, A. B. (2011) · The Annals of Statistics · doi:10.1214/10-aos860 · Cited by 330
A Bound on Tail Probabilities for Quadratic Forms in Independent Random Variables
Hanson, D. L., & Wright, F. T. (1971) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177693335 · Cited by 326
Talagrand, M. (1996) · The Annals of Probability · doi:10.1214/aop/1042644705 · Cited by 325
Efficiency of pseudolikelihood estimation for simple Gaussian fields
BESAG, J. (1977) · Biometrika · doi:10.1093/biomet/64.3.616 · Cited by 321
Optimal rates of convergence for covariance matrix estimation
Cai, T. T., Zhang, C.-H., & Zhou, H. H. (2010) · The Annals of Statistics · doi:10.1214/09-aos752 · Cited by 318
Nonparametric Roughness Penalties for Probability Densities
Good, I. J., & Gaskins, R. A. (1971) · Biometrika · doi:10.2307/2334515 · Cited by 315
Sparse principal component analysis and iterative thresholding
Ma, Z. (2013) · The Annals of Statistics · doi:10.1214/13-aos1097 · Cited by 313
Strong oracle optimality of folded concave penalized estimation
Fan, J., Xue, L., & Zou, H. (2014) · The Annals of Statistics · doi:10.1214/13-aos1198 · Cited by 313
High-dimensional analysis of semidefinite relaxations for sparse principal components
Amini, A. A., & Wainwright, M. J. (2009) · The Annals of Statistics · doi:10.1214/08-aos664 · Cited by 308
Self-citationOn the spectrum of random matrices
Pastur, L. A. (1972) · Theoretical and Mathematical Physics · doi:10.1007/bf01035768 · Cited by 305
On the Estimation of a Probability Density Function by the Maximum Penalized Likelihood Method
Silverman, B. W. (1982) · The Annals of Statistics · doi:10.1214/aos/1176345872 · Cited by 305
Maximum Likelihood Estimates of Monotone Parameters
Brunk, H. D. (1955) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177728420 · Cited by 300
A General Theory of Concave Regularization for High-Dimensional Sparse Estimation Problems
Zhang, C.-H., & Zhang, T. (2012) · Statistical Science · doi:10.1214/12-sts399 · Cited by 296
The Strong Limits of Random Matrix Spectra for Sample Matrices of Independent Elements
Wachter, K. W. (1978) · The Annals of Probability · doi:10.1214/aop/1176995607 · Cited by 288
Noisy matrix decomposition via convex relaxation: Optimal rates in high dimensions
Agarwal, A., Negahban, S., & Wainwright, M. J. (2012) · The Annals of Statistics · doi:10.1214/12-aos1000 · Cited by 280
Self-citationMultivariate Reduced-Rank Regression
Reinsel, G. C., & Velu, R. P. (1998) · Lecture Notes in Statistics · doi:10.1007/978-1-4757-2853-8 · Cited by 270
Point Estimates of Ordinates of Concave Functions
Hildreth, C. (1954) · Journal of the American Statistical Association · doi:10.1080/01621459.1954.10483523 · Cited by 268
Portnoy, S. (1984) · The Annals of Statistics · doi:10.1214/aos/1176346793 · Cited by 262
Bounding $\bar{d}$-distance by informational divergence: a method to prove measure concentration
Marton, K. (1996) · The Annals of Probability · doi:10.1214/aop/1039639365 · Cited by 261
Levy, S., & Fullagar, P. K. (1981) · Geophysics · doi:10.1190/1.1441261 · Cited by 258
On Talagrand's deviation inequalities for product measures
Ledoux, M. (1997) · ESAIM: Probability and Statistics · doi:10.1051/ps:1997103 · Cited by 255
Sparsity oracle inequalities for the Lasso
Bunea, F., Tsybakov, A., & Wegkamp, M. (2007) · Electronic Journal of Statistics · doi:10.1214/07-ejs008 · Cited by 253
Operator norm consistent estimation of large-dimensional sparse covariance matrices
El Karoui, N. (2008) · The Annals of Statistics · doi:10.1214/07-aos559 · Cited by 244
Some applications of concentration inequalities to statistics
Massart, P. (2000) · Annales de la Faculté des sciences de Toulouse : Mathématiques · doi:10.5802/afst.961 · Cited by 240
Concentration inequalities using the entropy method
Boucheron, S., Lugosi, G., & Massart, P. (2003) · The Annals of Probability · doi:10.1214/aop/1055425791 · Cited by 235
Efficiently Learning Ising Models on Arbitrary Graphs
Bresler, G. (2015) · ACM Symposium on Theory of Computing (STOC) · doi:10.1145/2746539.2746631 · Cited by 232
Duchi, J. C., Jordan, M. I., & Wainwright, M. J. (2014) · Journal of the ACM · doi:10.1145/2666468 · Cited by 231
Self-citationNecessary and Sufficient Conditions for Sparsity Pattern Recovery
Fletcher, A. K., Rangan, S., & Goyal, V. K. (2009) · IEEE Transactions on Information Theory · doi:10.1109/tit.2009.2032726 · Cited by 224
Concentration of measure inequalities for Markov chains and $\Phi$-mixing processes
Samson, P.-M. (2000) · The Annals of Probability · doi:10.1214/aop/1019160125 · Cited by 224
Minimax risk overl p -balls forl p -error
Donoho, D. L., & Johnstone, I. M. (1994) · Probability Theory and Related Fields · doi:10.1007/bf01199026 · Cited by 218
The geometry of proper scoring rules
Dawid, A. P. (2006) · Annals of the Institute of Statistical Mathematics · doi:10.1007/s10463-006-0099-8 · Cited by 218
Maximum Likelihood Estimation of a Multi-Dimensional Log-Concave Density
Cule, M., Samworth, R., & Stewart, M. (2010) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2010.00753.x · Cited by 215
Grimmett, G. R. (1973) · Bulletin of the London Mathematical Society · doi:10.1112/blms/5.1.81 · Cited by 212
Entropy numbers of diagonal operators between symmetric Banach spaces
Schütt, C. (1984) · Journal of Approximation Theory · doi:10.1016/0021-9045(84)90021-2 · Cited by 207
Cited by
An Efficient Framework for Clustered Federated Learning
Ghosh, A., Chung, J., Yin, D., & Ramchandran, K. (2022) · IEEE Transactions on Information Theory · doi:10.1109/tit.2022.3192506 · Cited by 623
On the Sample Complexity of the Linear Quadratic Regulator
Dean, S., Mania, H., Matni, N., Recht, B., & Tu, S. (2020) · Foundations of Computational Mathematics · doi:10.1007/s10208-019-09426-y · Cited by 436
LinDA: linear models for differential abundance analysis of microbiome compositional data
Zhou, H., He, K., Chen, J., & Zhang, X. (2022) · Genome Biology · doi:10.1186/s13059-022-02655-5 · Cited by 414
Policy Learning With Observational Data
Athey, S., & Wager, S. (2021) · Econometrica · doi:10.3982/ecta15732 · Cited by 372
On Mean Absolute Error for Deep Neural Network Based Vector-to-Vector Regression
Qi, J., Du, J., Siniscalchi, S. M., Ma, X., & Lee, C.-H. (2020) · IEEE Signal Processing Letters · doi:10.1109/lsp.2020.3016837 · Cited by 305
Metadata
- Authors
- Wainwright, M. J.
- Venue
- Cambridge University Press eBooks
- Publisher
- Cambridge University Press
- Published
- 2019-02-12
- OpenAlex
- W3157752112
- Cited by
- 882
- References
- 244
- FWCI
- 32.99
- Type
- book
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.