The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
The Adaptive Lasso and Its Oracle Properties
Abstract
The lasso is a popular technique for simultaneous estimation and variable selection. Lasso variable selection has been shown to be consistent under certain conditions. In this work we derive a necessary condition for the lasso variable selection to be consistent. Consequently, there exist certain scenarios where the lasso is inconsistent for variable selection. We then propose a new version of the lasso, called the adaptive lasso, where adaptive weights are used for penalizing different coefficients in the ℓ1 penalty. We show that the adaptive lasso enjoys the oracle properties; namely, it performs as well as if the true underlying model were given in advance. Similar to the lasso, the adaptive lasso is shown to be near-minimax optimal. Furthermore, the adaptive lasso can be solved by the same efficient algorithm for solving the lasso. We also discuss the extension of the adaptive lasso in generalized linear models and show that the oracle properties still hold under mild regularity conditions. As a byproduct of our theory, the nonnegative garotte is shown to be consistent for variable selection.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Similarly, multivariate LASSO models (Zou, 2006;Nicolai and Bühlmann Peter, 2010;Mankoo et al., 2011) have been investigated.”
From Using machine learning approaches for multi-omics data analysis: A review (2021) · cites this paper as Zou, 2006
Citations
Cites
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
(2005) · Springer eBooks · doi:10.1007/0-387-27255-0_9 · Cited by 20,333
Efron, B., Hastie, T., Johnstone, I., & Tibshirani, R. (2004) · The Annals of Statistics · doi:10.1214/009053604000000067 · Cited by 9,357
Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
B, J. F. A., & Li, R. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753382273 · Cited by 8,919
Ideal Spatial Adaptation by Wavelet Shrinkage
Donoho, D. L., & Johnstone, I. M. (1994) · Biometrika · doi:10.1093/biomet/81.3.425 · Cited by 8,730
Atomic Decomposition by Basis Pursuit
Chen, S. S., Donoho, D. L., & Saunders, M. A. (2001) · SIAM Review · doi:10.1137/s003614450037906x · Cited by 5,030
Ziegel, E. R., Lehmann, E. L., & Casella, G. (1999) · Technometrics · doi:10.2307/1270597 · Cited by 4,203
Optimally sparse representation in general (nonorthogonal) dictionaries via ℓ 1 minimization
Donoho, D. L., & Elad, M. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0437847100 · Cited by 2,970
Estimation of the Mean of a Multivariate Normal Distribution
Stein, C. M. (1981) · The Annals of Statistics · doi:10.1214/aos/1176345632 · Cited by 2,795
On Model Selection Consistency of Lasso
Zhao, P., & Yu, B. (2006) · doi:10.5555/1248547.1248637 · Cited by 2,314
A Statistical View of Some Chemometrics Regression Tools
Frank, L. E., & Friedman, J. H. (1993) · Technometrics · doi:10.1080/00401706.1993.10485033 · Cited by 2,217
Uncertainty principles and ideal atomic decomposition
Donoho, D. L., & Huo, X. (2001) · IEEE Transactions on Information Theory · doi:10.1109/18.959265 · Cited by 1,907
Wavelet Shrinkage: Asymptopia?
Donoho, D. L., Johnstone, I. M., Kerkyacharian, G., & Picard, D. (1995) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1995.tb02032.x · Cited by 1,752
Generalized linear models. 2nd ed.
McCullagh, P., & Nelder, J. (1993) · Journal of the American Statistical Association · doi:10.2307/2290358 · Cited by 1,581
Asymptotics for lasso-type estimators
Fu, W., & Knight, K. (2000) · The Annals of Statistics · doi:10.1214/aos/1015957397 · Cited by 1,276
Better Subset Regression Using the Nonnegative Garrote
Breiman, L. (1995) · Technometrics · doi:10.2307/1269730 · Cited by 1,045
Nonconcave penalized likelihood with a diverging number of parameters
Fan, J., & Peng, H. (2004) · The Annals of Statistics · doi:10.1214/009053604000000256 · Cited by 995
Variable selection using MM algorithmsPreprint
Hunter, D. R., & Li, R. (2005) · Cited by 375
On the Asymptotics of Constrained $M$-Estimation
Geyer, C. J. (1994) · The Annals of Statistics · doi:10.1214/aos/1176325768 · Cited by 302
A NOTE ON THE LASSO AND RELATED PROCEDURES IN MODEL SELECTION
Leng, C., Lin, Y., & Wahba, G. (2006) · Cited by 261
Shen, X. T., & Ye, J. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502753479356 · Cited by 197
American Statistical Association
Teasdale, K. R. (2022) · The SAGE Encyclopedia of Research Design · doi:10.4135/9781071812082.n20 · Cited by 160
Regularization of Wavelets Approximations
Antoniadis, A., & Fan, J. (2011) · eScholarship (California Digital Library) · Cited by 49
Flagged first, then by citations
Research works printed but not linked: 7
- Science USA, 1005, 2197
- Society, Ser. B, 57, 301
- Statistics, 22, 1993
- The Annals, Statistics, 33, 1617
- The Annals, Statistics, 28, 1356
- Statistical Association, 97, 210
- Ser. B, 58, 267
Cited by
Sorted by citations
Regularization Paths for Generalized Linear Models via Coordinate Descent
Friedman, J., Hastie, T., & Tibshirani, R. (2010) · Journal of Statistical Software · doi:10.18637/jss.v033.i01 · Cited by 19,927
Enhancing Sparsity by Reweighted ℓ 1 Minimization
Candès, E. J., Wakin, M. B., & Boyd, S. (2008) · Journal of Fourier Analysis and Applications · doi:10.1007/s00041-008-9045-x · Cited by 4,878
Nearly unbiased variable selection under minimax concave penalty
Zhang, C. (2010) · The Annals of Statistics · doi:10.1214/09-aos729 · Cited by 3,909
Regression Shrinkage and Selection via The Lasso: A Retrospective
Tibshirani, R. J. (2011) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.1467-9868.2011.00771.x · Cited by 3,601
A tutorial on regularized partial correlation networks
Epskamp, S., & Fried, E. I. (2018) · Psychological Methods · doi:10.1037/met0000167 · Cited by 2,918
Metadata
- Authors
- Zou, H.
- Affiliations
- University of Minnesota (US)
- Corresponding author
- Zou, Hui
- ORCID
- Zou, Hui
- Venue
- Journal of the American Statistical Association
- Publisher
- Informa UK Limited
- Published
- 2006-12-01
- Volume
- 101
- Issue
- 476
- Pages
- 1418-1429
- ISSN
- 0162-1459 (ISSN-L)
- 1537-274X
- OpenAlex
- W2020925091
- Cited by
- 7,470
- References
- 23
- Citations by year
- 2026: 324 · 2025: 476 · 2024: 474 · 2023: 454 · 2022: 567 · 2021: 639 · 2020: 528 · 2019: 548 · 2018: 473 · 2017: 443 · 2016: 416 · 2015: 388 · 2014: 385 · 2013: 361 · 2012: 304
- FWCI
- 76.03
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of the American Statistical Association (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Statistical Methods and Models
- Physical Sciences › Computer Science › Signal Processing › Sparse and Compressive Sensing Techniques
- Keywords
- adaptive LASSO, LASSO, feature selection, oracle property, consistency, adaptive weighting, l1 penalty, generalized linear models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
