The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
High-dimensional regression with noisy and missing data: Provable guarantees with nonconvexity
Open accessAbstract
Although the standard formulations of prediction problems involve fully-observed and noiseless data drawn in an i.i.d. manner, many applications involve noisy and/or missing data, possibly involving dependence, as well. We study these issues in the context of high-dimensional sparse linear regression, and propose novel estimators for the cases of noisy, missing and/or dependent data. Many standard approaches to noisy or missing data, such as those using the EM algorithm, lead to optimization problems that are inherently nonconvex, and it is difficult to establish theoretical guarantees on practical algorithms. While our approach also involves optimizing nonconvex programs, we are able to both analyze the statistical error associated with any global optimum, and more surprisingly, to prove that a simple algorithm based on projected gradient descent will converge in polynomial time to a small neighborhood of the set of all global minimizers. On the statistical side, we provide nonasymptotic bounds that hold with high probability for the cases of noisy, missing and/or dependent data. On the computational side, we prove that under the same types of conditions required for statistical consistency, the projected gradient descent algorithm is guaranteed to converge at a geometric rate to a near-global minimizer. We illustrate these theoretical predictions with simulations, showing close agreement with the predicted scalings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A full EM approach is not guaranteed to converge to a global minimum in a high-dimensional linear regression problem with noisy and missing data36.”
From Multimodal pooled Perturb-CITE-seq screens in patient models define mechanisms of cancer immune evasion (2021) · cites this paper as [36]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
Atomic Decomposition by Basis Pursuit
Chen, S. S., Donoho, D. L., & Saunders, M. A. (1998) · SIAM Journal on Scientific Computing · doi:10.1137/s1064827596304010 · Cited by 6,845
High dimensional graphs and variable selection with the Lasso
Meinshausen, N., & Bühlmann, P. (2006) · Cited by 2,539
High-dimensional graphs and variable selection with the Lasso
Meinshausen, N., & Bühlmann, P. (2006) · The Annals of Statistics · doi:10.1214/009053606000000281 · Cited by 2,521
Simultaneous analysis of Lasso and Dantzig selector
Bickel, P. J., Ritov, Y., & Tsybakov, A. B. (2009) · The Annals of Statistics · doi:10.1214/08-aos620 · Cited by 2,396
Introduction to the non-asymptotic analysis of random matrices
Vershynin, R. (2012) · Compressed Sensing · doi:10.1017/cbo9780511794308.006 · Cited by 2,150
Measurement Error in Nonlinear Models
Carroll, R. J., Ruppert, D., & Stefanski, L. A. (1995) · Springer eBooks · doi:10.1007/978-1-4899-4477-1 · Cited by 1,749
Efficient projections onto the l1-ball for learning in high dimensions
Duchi, J., Shalev-Shwartz, S., Singer, Y., & Chandra, T. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390191 · Cited by 1,184
Ledoux, M., & Talagrand, M. (1991) · doi:10.1007/978-3-642-20212-4 · Cited by 1,160
Research works printed but not linked: 2
- [9] Loh, P. and Wainwright, M. J. (2012). Supplement to “High-dimensional regression with noisy and missing data: Provable guarantees with nonconvexity.” DOI:10.1214/12-AOS1018SUPP. · DOI
- [12] Negahban, S., Ravikumar, P., Wainwright, M. J. and Yu, B. (2009). A unified framework for the analysis of regularized $M$-estimators. In Advances in Neural Information Processing Systems. Curran Associates, Red Hook, NY.
Cited by
Dixit, A., Parnas, O., Li, B., Chen, J., Fulco, C. P., Jerby-Arnon, L., Marjanovic, N. D., Dionne, D., Burks, T., Raychowdhury, R., et al. (2016) · Cell · doi:10.1016/j.cell.2016.11.038 · Cited by 1,863
Challenges of Big Data analysis
Fan, J., Han, F., & Liu, H. (2014) · National Science Review · doi:10.1093/nsr/nwt032 · Cited by 1,482
High-Dimensional Statistics: A Non-Asymptotic Viewpoint
Wainwright, M. J. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108627771 · Cited by 882
Self-citationRandom forest missing data algorithms
Tang, F., & Ishwaran, H. (2017) · Statistical Analysis and Data Mining: The ASA Data Science Journal · doi:10.1002/sam.11348 · Cited by 777
Compressed Sensing using Generative Models
Bora, A., Jalal, A., Price, E., & Dimakis, A. G. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.03208 · Cited by 269
Metadata
- Authors
- Loh, P.-L., & Wainwright, M. J.
- Affiliations
- University of California, Berkeley (US)
- Venue
- The Annals of Statistics
- Publisher
- Institute of Mathematical Statistics
- Published
- 2012-06-01
- Volume
- 40
- Issue
- 3
- Pages
- 1637-1664
- ISSN
- 0090-5364 (ISSN-L)
- 2168-8966
- OpenAlex
- W2099210013
- Cited by
- 529
- References
- 28
- Citations by year
- 2026: 18 · 2025: 32 · 2024: 25 · 2023: 30 · 2022: 34 · 2021: 49 · 2020: 51 · 2019: 72 · 2018: 36 · 2017: 35 · 2016: 37 · 2015: 26 · 2014: 35 · 2013: 34 · 2012: 12
- FWCI
- 32.71
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- The Annals of Statistics (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- ScholarlyCommons (University of Pennsylvania) (submittedVersion)
- Project Euclid (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (0907632)
- U.S. Department of Defense
- National Defense Science and Engineering Graduate
- Air Force Office of Scientific Research (09NL184)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- Physical Sciences › Computer Science › Signal Processing › Sparse and Compressive Sensing Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Statistical Methods and Models
- Keywords
- missing data, noisy data, correlated data, non-convex optimization, projected gradient descent, global minimizers, non-asymptotic bounds, convergence guarantees, statistical consistency, geometric convergence rate
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: High-dimensional regression with noisy and missing data: Provable guarantees with nonconvexity. https://app.cochat.ai/papers/10.1214/12-aos1018
- The paper
- Loh, P.-L., & Wainwright, M. J. (2012). High-dimensional regression with noisy and missing data: Provable guarantees with nonconvexity. The Annals of Statistics. https://doi.org/10.1214/12-aos1018
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.