The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Penalized regression, standard errors, and Bayesian lassos
Open accessAbstract
Penalized regression methods for simultaneous variable selection and coefficient estimation, especially those based on the lasso of Tibshirani (1996), have received a great deal of attention in recent years, mostly through frequentist models. Properties such as consistency have been studied, and are achieved by different lasso variations. Here we look at a fully Bayesian formulation of the problem, which is flexible enough to encompass most versions of the lasso that have been previously considered. The advantages of the hierarchical Bayesian formulations are many. In addition to the usual ease-of-interpretation of hierarchical models, the Bayesian formulation produces valid standard errors (which can be problematic for the frequentist lasso), and is based on a geometrically ergodic Markov chain. We compare the performance of the Bayesian lassos to their frequentist counterparts using simulations, data sets that previous lasso papers have used, and a difficult modeling problem for predicting the collapse of governments around the world. In terms of prediction mean squared error, the Bayesian lasso performance is similar to and, in some cases, better than, the frequentist lasso.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Bootstrap methods: another look at the jackknife
Efron, B. (1979) · The Annals of Statistics · doi:10.1214/aos/1176344552 · Cited by 17,602
Efron, B., Hastie, T., Johnstone, I., & Tibshirani, R. (2004) · The Annals of Statistics · doi:10.1214/009053604000000067 · Cited by 9,357
Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Fan, J., & Li, R. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753382273 · Cited by 8,900
The adaptive lasso and its oracle properties
Zou, H. (2006) · Journal of the American Statistical Association · doi:10.1198/016214506000000735 · Cited by 7,470
Model Selection and Estimation in Regression with Grouped Variables
Yuan, M., & Lin, Y. (2006) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00532.x · Cited by 7,261
Markov Chains and Stochastic Stability
Meyn, S. P., & Tweedie, R. L. (1993) · Springer eBooks · doi:10.1007/978-1-4471-3267-7 · Cited by 5,041
Ridge Regression: Applications to Nonorthogonal Problems
Hoerl, A. E., & Kennard, R. W. (1970) · Technometrics · doi:10.1080/00401706.1970.10488635 · Cited by 2,956
Park, T., & Casella, G. (2008) · Journal of the American Statistical Association · doi:10.1198/016214508000000337 · Cited by 2,934
Self-citationSparsity and Smoothness Via the Fused Lasso
Tibshirani, R., Saunders, M., Rosset, S., Zhu, J., & Knight, K. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00490.x · Cited by 2,724
A Statistical View of Some Chemometrics Regression Tools
Frank, L. E., & Friedman, J. H. (1993) · Technometrics · doi:10.1080/00401706.1993.10485033 · Cited by 2,213
The Group Lasso for Logistic Regression
Meier, L., Van De Geer, S., & Bühlmann, P. (2008) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2007.00627.x · Cited by 1,674
Asymptotics for lasso-type estimators
Fu, W., & Knight, K. (2000) · The Annals of Statistics · doi:10.1214/aos/1015957397 · Cited by 1,276
Scale Mixtures of Normal Distributions
Andrews, D. F., & Mallows, C. L. (1974) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1974.tb00989.x · Cited by 1,163
Penalized Regressions: The Bridge versus the Lasso
Fu, W. J. (1998) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1998.10474784 · Cited by 1,092
On the “degrees of freedom” of the lasso
Zou, H., Hastie, T., & Tibshirani, R. (2007) · The Annals of Statistics · doi:10.1214/009053607000000127 · Cited by 947
C HARACTERIZING AND M EASURING S USTAINABLE D EVELOPMENT
Parris, T. M., & Kates, R. W. (2003) · Annual Review of Environment and Resources · doi:10.1146/annurev.energy.28.050302.105551 · Cited by 885
Stamey, T. A., Kabalin, J. N., Mcneal, J. E., Johnstone, I. M., Freiha, F., Redwine, E. A., & Yang, N. (1989) · Journal of Urology · doi:10.1016/s0022-5347(17)41175-x · Cited by 871
A new approach to variable selection in least squares problems
Osborne, M. (2000) · IMA Journal of Numerical Analysis · doi:10.1093/imanum/20.3.389 · Cited by 859
L 1-Regularization Path Algorithm for Generalized Linear Models
Park, M. Y., & Hastie, T. (2007) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2007.00607.x · Cited by 838
Large-Scale Bayesian Logistic Regression for Text Categorization
Genkin, A., Lewis, D. D., & Madigan, D. (2007) · Technometrics · doi:10.1198/004017007000000245 · Cited by 808
MODEL SELECTION AND INFERENCE: FACTS AND FICTION
Leeb, H., & Pötscher, B. M. (2005) · Econometric Theory · doi:10.1017/s0266466605050036 · Cited by 701
Osborne, M. R., Presnell, B., & Turlach, B. A. (2000) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2000.10474883 · Cited by 696
LIU, J. S., WONG, W. H., & KONG, A. (1994) · Biometrika · doi:10.1093/biomet/81.1.27 · Cited by 542
Adaptive sparseness for supervised learning
Figueiredo, M. A. T. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1227989 · Cited by 536
A Statistical View of Some Chemometrics Regression Tools
Frank, I. E., & Friedman, J. H. (1993) · Technometrics · doi:10.2307/1269656 · Cited by 395
Improving Forecasts of State Failure
King, G., & Zeng, L. (2001) · World Politics · doi:10.1017/s0043887100019171 · Cited by 271
Gene selection using a two-level hierarchical Bayesian model
Bae, K., & Mallick, B. K. (2004) · Bioinformatics · doi:10.1093/bioinformatics/bth419 · Cited by 172
Empirical Bayes Gibbs sampling
Casella, G. (2001) · Biostatistics · doi:10.1093/biostatistics/2.4.485 · Cited by 151
Self-citationMarkov‐chain monte carlo: Some practical implications of theoretical results
Roberts, G. O., & Rosenthal, J. S. (1998) · Canadian Journal of Statistics · doi:10.2307/3315667 · Cited by 134
Estimated Sampling Distributions: The Bootstrap and Competitors
Beran, R. J. (1982) · The Annals of Statistics · doi:10.1214/aos/1176345704 · Cited by 124
L1 Regularization Path Algorithm for Generalized Linear Models
Jing, Y. (2008) · Journal of Jiamusi University · Cited by 60
Functional Compatibility, Markov Chains, and Gibbs Sampling with Improper Posteriors
Hobert, J. P., & Casella, G. (1998) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1998.10474760 · Cited by 57
Self-citation
Cited by
A guide to Bayesian model selection for ecologists
Hooten, M. B., & Hobbs, N. T. (2015) · Ecological Monographs · doi:10.1890/14-0661.1 · Cited by 891
A practical guide to selecting models for exploration, inference, and prediction in ecology
Tredennick, A. T., Hooker, G., Ellner, S. P., & Adler, P. B. (2021) · Ecology · doi:10.1002/ecy.3336 · Cited by 474
Mathieu, J. A., Hatté, C., Balesdent, J., & Parent, É. (2015) · Global Change Biology · doi:10.1111/gcb.13012 · Cited by 291
Precinct or prejudice? Understanding racial disparities in New York City’s stop-and-frisk policy
Goel, S., Rao, J. M., & Shroff, R. (2016) · The Annals of Applied Statistics · doi:10.1214/15-aoas897 · Cited by 285
Evaluation of the lasso and the elastic net in genome-wide association studies
Waldmann, P., Mészáros, G., Gredler, B., Fuerst, C., & Sölkner, J. (2013) · Frontiers in Genetics · doi:10.3389/fgene.2013.00270 · Cited by 264
Metadata
- Authors
- Casella, G., Ghosh, M., Gill, J., & Kyung, M.
- Venue
- Bayesian Analysis
- Publisher
- Institute of Mathematical Statistics
- Published
- 2010-06-01
- Volume
- 5
- Issue
- 2
- Pages
- 369-411
- ISSN
- 1931-6690 (ISSN-L)
- 1936-0975
- OpenAlex
- W1976365540
- Cited by
- 567
- References
- 34
- FWCI
- 20.74
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.