The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
A Selective Review of Group Selection in High-Dimensional Models
Open accessAbstract
Grouping structures arise naturally in many statistical modeling problems. Several methods have been proposed for variable selection that respect grouping structure in variables. Examples include the group LASSO and several concave group selection methods. In this article, we give a selective review of group selection concerning methodological developments, theoretical properties and computational algorithms. We pay particular attention to group selection methods involving concave penalties. We address both group selection and bi-level selection methods. We describe several applications of these methods in nonparametric additive models, semiparametric regression, seemingly unrelated regressions, genomic data analysis and genome wide association studies. We also highlight some issues that require further study.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1998) · Springer Series in Statistics · doi:10.1007/978-1-4612-1694-0_15 · Cited by 17,781
Efron, B., Hastie, T., Johnstone, I., & Tibshirani, R. (2004) · The Annals of Statistics · doi:10.1214/009053604000000067 · Cited by 9,357
Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Fan, J., & Li, R. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753382273 · Cited by 8,900
Ideal spatial adaptation by wavelet shrinkage
Donoho, D. L., & Johnstone, I. M. (1994) · Biometrika · doi:10.1093/biomet/81.3.425 · Cited by 8,760
An Efficient Method of Estimating Seemingly Unrelated Regressions and Tests for Aggregation Bias
Zellner, A. (1962) · Journal of the American Statistical Association · doi:10.1080/01621459.1962.10480664 · Cited by 8,401
The adaptive lasso and its oracle properties
Zou, H. (2006) · Journal of the American Statistical Association · doi:10.1198/016214506000000735 · Cited by 7,470
Model Selection and Estimation in Regression with Grouped Variables
Yuan, M., & Lin, Y. (2006) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00532.x · Cited by 7,261
Caruana, R. (1997) · Machine Learning · doi:10.1023/a:1007379606734 · Cited by 6,636
Nearly unbiased variable selection under minimax concave penalty
Zhang, C.-H. (2010) · The Annals of Statistics · doi:10.1214/09-aos729 · Cited by 3,835
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-0919-5_38 · Cited by 3,028
High-dimensional graphs and variable selection with the Lasso
Meinshausen, N., & Bühlmann, P. (2006) · The Annals of Statistics · doi:10.1214/009053606000000281 · Cited by 2,521
Simultaneous analysis of Lasso and Dantzig selector
Bickel, P. J., Ritov, Y., & Tsybakov, A. B. (2009) · The Annals of Statistics · doi:10.1214/08-aos620 · Cited by 2,396
Meinshausen, N., & Bühlmann, P. (2010) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2010.00740.x · Cited by 2,215
A Statistical View of Some Chemometrics Regression Tools
Frank, L. E., & Friedman, J. H. (1993) · Technometrics · doi:10.1080/00401706.1993.10485033 · Cited by 2,213
Convergence of a Block Coordinate Descent Method for Nondifferentiable Minimization
Tseng, P. (2001) · Journal of Optimization Theory and Applications · doi:10.1023/a:1017501703105 · Cited by 1,989
Pathwise coordinate optimization
Friedman, J., Hastie, T., Höfling, H., & Tibshirani, R. (2007) · The Annals of Applied Statistics · doi:10.1214/07-aoas131 · Cited by 1,895
Statistics for High-Dimensional Data: Methods, Theory and Applications
Bühlmann, P., & van de Geer, S. (2011) · Springer Series in Statistics · doi:10.1007/978-3-642-20192-9 · Cited by 1,680
The Group Lasso for Logistic Regression
Meier, L., Van De Geer, S., & Bühlmann, P. (2008) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2007.00627.x · Cited by 1,674
Convex multi-task feature learning
Argyriou, A., Evgeniou, T., & Pontil, M. (2008) · Machine Learning · doi:10.1007/s10994-007-5040-8 · Cited by 1,528
Penalized Regressions: The Bridge versus the Lasso
Fu, W. J. (1998) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1998.10474784 · Cited by 1,092
Nonconcave penalized likelihood with a diverging number of parameters
Fan, J., & Peng, H. (2004) · The Annals of Statistics · doi:10.1214/009053604000000256 · Cited by 1,002
Adaptive estimation of a quadratic functional by model selection
Laurent, B., & Massart, P. (2000) · The Annals of Statistics · doi:10.1214/aos/1015957395 · Cited by 995
Semiparametric Estimates of the Relation between Weather and Electricity Sales
Engle, R. F., Granger, C. W. J., Rice, J., & Weiss, A. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478274 · Cited by 988
Group lasso with overlap and graph lasso
Jacob, L., Obozinski, G., & Vert, J.-P. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553431 · Cited by 833
Regularized gene selection in cancer microarray meta-analysis
Ma, S., & Huang, J. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-1 · Cited by 831
Self-citationOptimization Transfer Using Surrogate Objective Functions
Lange, K., Hunter, D. R., & Yang, I. (2000) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2000.10474858 · Cited by 808
On the conditions used to prove oracle results for the Lasso
van de Geer, S. A., & Bühlmann, P. (2009) · Electronic Journal of Statistics · doi:10.1214/09-ejs506 · Cited by 684
One-step sparse estimates in nonconcave penalized likelihood models
Zou, H., & Li, R. (2008) · The Annals of Statistics · doi:10.1214/009053607000000802 · Cited by 683
Breheny, P., & Huang, J. (2011) · The Annals of Applied Statistics · doi:10.1214/10-aoas388 · Cited by 671
Self-citationConsistency of the group Lasso and multiple kernel learning
Bach, F. (2007) · arXiv (Cornell University) · doi:10.48550/arxiv.0707.3390 · Cited by 669
Nonparametric smoothing estimates of time-varying coefficient models with longitudinal data
Hoover, D. (1998) · Biometrika · doi:10.1093/biomet/85.4.809 · Cited by 651
The composite absolute penalties family for grouped and hierarchical variable selection
Zhao, P., Rocha, G., & Yu, B. (2009) · The Annals of Statistics · doi:10.1214/07-aos584 · Cited by 631
Coordinate descent algorithms for lasso penalized regression
Wu, T. T., & Lange, K. (2008) · The Annals of Applied Statistics · doi:10.1214/07-aoas147 · Cited by 563
Component selection and smoothing in multivariate nonparametric regression
Lin, Y., & Zhang, H. H. (2006) · The Annals of Statistics · doi:10.1214/009053606000000722 · Cited by 550
Variable selection in nonparametric additive models
Huang, J., Horowitz, J. L., & Wei, F. (2010) · The Annals of Statistics · doi:10.1214/09-aos781 · Cited by 537
Self-citationRavikumar, P., Lafferty, J., Liu, H., & Wasserman, L. (2009) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2009.00718.x · Cited by 535
Huang, J., & Zhang, T. (2010) · The Annals of Statistics · doi:10.1214/09-aos778 · Cited by 521
Self-citationThe sparsity and bias of the Lasso selection in high-dimensional linear regression
Zhang, C.-H., & Huang, J. (2008) · The Annals of Statistics · doi:10.1214/07-aos520 · Cited by 506
Self-citationRegularization of Wavelet Approximations
Antoniadis, A., & Fan, J. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753208942 · Cited by 498
Asymptotic properties of bridge estimators in sparse high-dimensional regression models
Huang, J., Horowitz, J. L., & Ma, S. (2008) · The Annals of Statistics · doi:10.1214/009053607000000875 · Cited by 482
Self-citationHigh-dimensional additive modeling
Meier, L., van de Geer, S., & Bühlmann, P. (2009) · The Annals of Statistics · doi:10.1214/09-aos692 · Cited by 458
SparseNet: Coordinate Descent With Nonconvex Penalties
Mazumder, R., Friedman, J. H., & Hastie, T. (2011) · Journal of the American Statistical Association · doi:10.1198/jasa.2011.tm09738 · Cited by 449
Analysis of Multi-stage Convex Relaxation for Sparse Regularization
Zhang, T. (2010) · Cited by 444
Support union recovery in high-dimensional multivariate regression
Obozinski, G., Wainwright, M. J., & Jordan, M. I. (2011) · The Annals of Statistics · doi:10.1214/09-aos776 · Cited by 350
Oracle inequalities and optimal inference under group sparsity
Lounici, K., Pontil, M., van de Geer, S., & Tsybakov, A. B. (2011) · The Annals of Statistics · doi:10.1214/11-aos896 · Cited by 341
A group bridge approach for variable selection
Huang, J., Ma, S., Xie, H., & Zhang, C.-H. (2009) · Biometrika · doi:10.1093/biomet/asp020 · Cited by 324
Self-citationA General Theory of Concave Regularization for High-Dimensional Sparse Estimation Problems
Zhang, C.-H., & Zhang, T. (2012) · Statistical Science · doi:10.1214/12-sts399 · Cited by 296
Group SCAD regression analysis for microarray time course gene expression data
Wang, L., Chen, G., & Li, H. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm125 · Cited by 279
Shrinkage Estimation of the Varying Coefficient Model
Wang, H., & Xia, Y. (2009) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.0138 · Cited by 261
Penalized methods for bi-level variable selection
Breheny, P., & Huang, J. (2009) · Statistics and Its Interface · doi:10.4310/sii.2009.v2.n3.a10 · Cited by 247
Self-citationPeng, J., Zhu, J., Bergamaschi, A., Han, W., Noh, D.-Y., Pollack, J. R., & Wang, P. (2010) · The Annals of Applied Statistics · doi:10.1214/09-aoas271 · Cited by 211
Some sharp performance bounds for least squares regression with L1 regularization
Zhang, T. (2009) · The Annals of Statistics · doi:10.1214/08-aos659 · Cited by 200
Adaptive regression and model selection in data mining problems
Bakin, S. (1999) · ANU Open Research (Australian National University) · doi:10.25911/5d78db4c25dbb · Cited by 174
On the asymptotic properties of the group lasso estimator for linear models
Nardi, Y., & Rinaldo, A. (2008) · Electronic Journal of Statistics · doi:10.1214/08-ejs200 · Cited by 173
Linear or Nonlinear? Automatic Structure Discovery for Partially Linear Models
Zhang, H. H., Cheng, G., & Liu, Y. (2011) · Journal of the American Statistical Association · doi:10.1198/jasa.2011.tm10281 · Cited by 165
Association screening of common and rare genetic variants by penalized regression
Zhou, H., Sehl, M. E., Sinsheimer, J. S., & Lange, K. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq448 · Cited by 137 · cited 2×
“Applications of group selection methods to genetic association analysis are discussed in Breheny and Huang (2009) and Zhou et al. (2010).”
BackgroundMethodVariable selection and estimation in high-dimensional varying-coefficient models
Wei, F., Huang, J., & Li, H. (2011) · Statistica Sinica · doi:10.5705/ss.2009.316 · Cited by 124
Self-citationGroup variable selection via a hierarchical lasso and its oracle property
Zhou, N., & Zhu, J. (2010) · Statistics and Its Interface · doi:10.4310/sii.2010.v3.n4.a13 · Cited by 119
Consistent group selection in high-dimensional linear regression
Wei, F., & Huang, J. (2010) · Bernoulli · doi:10.3150/10-bej252 · Cited by 117
Self-citationIncorporating Predictor Network in Penalized Regression with Application to Microarray Data
Pan, W., Xie, B., & Shen, X. (2009) · Biometrics · doi:10.1111/j.1541-0420.2009.01296.x · Cited by 113
Nonparametric pathway-based regression models for analysis of genomic data
Wei, Z., & Li, H. (2006) · Biostatistics · doi:10.1093/biostatistics/kxl007 · Cited by 91
Semiparametric Regression Pursuit
Huang, J., Wei, F., & Ma, S. (2011) · Statistica Sinica · doi:10.5705/ss.2010.298 · Cited by 69
Self-citationCOMPONENT SELECTION AND SMOOTHING FOR NONPARAMETRIC REGRESSION IN EXPONENTIAL FAMILIES
Zhang, H. H., & Lin, Y. (2006) · Statistica Sinica · Cited by 47
Theoretical properties of the overlapping groups lasso
Percival, D. (2012) · Electronic Journal of Statistics · doi:10.1214/12-ejs672 · Cited by 36
Identification of genes associated with multiple cancers via integrative analysis
Ma, S., Huang, J., & Moran, M. S. (2009) · BMC Genomics · doi:10.1186/1471-2164-10-535 · Cited by 19
Self-citation
Cited by
A simple new approach to variable selection in regression, with application to genetic fine mapping
Wang, G., Sarkar, A., Carbonetto, P., & Stephens, M. (2020) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/rssb.12388 · Cited by 1,121
Breheny, P., & Huang, J. (2015) · Statistics and Computing · doi:10.1007/s11222-013-9424-2 · Cited by 282
Self-citation
Metadata
- Authors
- Huang, J., Breheny, P., & Ma, S.
- Venue
- Statistical Science
- Publisher
- Institute of Mathematical Statistics
- Published
- 2012-11-01
- Volume
- 27
- Issue
- 4
- Pages
- 481-499
- ISSN
- 0883-4237 (ISSN-L)
- OpenAlex
- W2005732955
- Cited by
- 300
- References
- 67
- FWCI
- 11.39
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.