The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Nonconcave penalized likelihood with a diverging number of parameters
Open accessAbstract
A class of variable selection procedures for parametric models via nonconcave penalized likelihood was proposed by Fan and Li to simultaneously estimate parameters and select important variables. They demonstrated that this class of procedures has an oracle property when the number of parameters is finite. However, in most model selection problems the number of parameters should be large and grow with the sample size. In this paper some asymptotic properties of the nonconcave penalized likelihood are established for situations in which the number of parameters tends to ∞ as the sample size increases. Under regularity conditions we have established an oracle property and the asymptotic normality of the penalized likelihood estimators. Furthermore, the consistency of the sandwich formula of the covariance matrix is demonstrated. Nonconcave penalized likelihood ratio statistics are discussed, and their asymptotic distributions under the null hypothesis are obtained by imposing some mild conditions on the penalty functions. The asymptotic results are augmented by a simulation study, and the newly developed methodology is illustrated by an analysis of a court case on the sexual discrimination of salary.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
(2005) · Statistics for Biology and Health · doi:10.1007/0-387-27255-0_9 · Cited by 20,133
Stochastic relaxation, gibbs distributions, and the bayesian restoration of images.
Geman, S., & Geman, D. (1984) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1984.4767596 · Cited by 17,949
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1998) · Springer Series in Statistics · doi:10.1007/978-1-4612-1694-0_15 · Cited by 17,781
McCullagh, P., & Nelder, J. A. (1989) · doi:10.1007/978-1-4899-3242-6 · Cited by 16,836
de Boor, C. (1978) · Applied Mathematical Sciences · doi:10.1007/978-1-4612-6333-3 · Cited by 11,944
Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Fan, J., & Li, R. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753382273 · Cited by 8,900
Self-citationIdeal spatial adaptation by wavelet shrinkage
Donoho, D. L., & Johnstone, I. M. (1994) · Biometrika · doi:10.1093/biomet/81.3.425 · Cited by 8,760
Markov Chain Monte Carlo in Practice
(1995) · Chapman & Hall/CRC eBooks · doi:10.1201/b14835 · Cited by 7,757
Cited by
The adaptive lasso and its oracle properties
Zou, H. (2006) · Journal of the American Statistical Association · doi:10.1198/016214506000000735 · Cited by 7,470
Nearly unbiased variable selection under minimax concave penalty
Zhang, C.-H. (2010) · The Annals of Statistics · doi:10.1214/09-aos729 · Cited by 3,835
Sure Independence Screening for Ultrahigh Dimensional Feature Space
Fan, J., & Lv, J. (2008) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2008.00674.x · Cited by 2,711
Self-citationConfidence Intervals for Low Dimensional Parameters in High Dimensional Linear Models
Zhang, C.-H., & Zhang, S. S. (2014) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/rssb.12026 · Cited by 993
On the “degrees of freedom” of the lasso
Zou, H., Hastie, T., & Tibshirani, R. (2007) · The Annals of Statistics · doi:10.1214/009053607000000127 · Cited by 947
On the adaptive elastic-net with a diverging number of parameters
Zou, H., & Zhang, H. H. (2009) · The Annals of Statistics · doi:10.1214/08-aos625 · Cited by 847
Hansen, B. E. (2007) · Econometrica · doi:10.1111/j.1468-0262.2007.00785.x · Cited by 837
Partial Correlation Estimation by Joint Sparse Regression Models
Peng, J., Wang, P., Zhou, N., & Zhu, J. (2009) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.0126 · Cited by 688
High dimensional covariance matrix estimation using a factor model
Fan, J., Fan, Y., & Lv, J. (2008) · Journal of Econometrics · doi:10.1016/j.jeconom.2008.09.017 · Cited by 685
Self-citationOne-step sparse estimates in nonconcave penalized likelihood models
Zou, H., & Li, R. (2008) · The Annals of Statistics · doi:10.1214/009053607000000802 · Cited by 683
Hyperspectral Unmixing via $L_{1/2}$ Sparsity-Constrained Nonnegative Matrix Factorization
Qian, Y., Jia, S., Zhou, J., & Robles-Kelly, A. (2011) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2011.2144605 · Cited by 598
Variable selection in nonparametric additive models
Huang, J., Horowitz, J. L., & Wei, F. (2010) · The Annals of Statistics · doi:10.1214/09-aos781 · Cited by 537
Chapter 76 Large Sample Sieve Estimation of Semi-Nonparametric Models
Chen, X. (2007) · Handbook of Econometrics · doi:10.1016/s1573-4412(07)06076-x · Cited by 535
Science China Information Sciences
(2013) · Science China Information Sciences · doi:10.1007/11432.1869-1919 · Cited by 494
Meinshausen, N. (2007) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2006.12.019 · Cited by 492
Generalized Thresholding of Large Covariance Matrices
Rothman, A. J., Levina, E., & Zhu, J. (2009) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.0101 · Cited by 489
Asymptotic properties of bridge estimators in sparse high-dimensional regression models
Huang, J., Horowitz, J. L., & Ma, S. (2008) · The Annals of Statistics · doi:10.1214/009053607000000875 · Cited by 482
Piecewise linear regularized solution paths
Rosset, S., & Zhu, J. (2007) · The Annals of Statistics · doi:10.1214/009053606000001370 · Cited by 481
Scaled sparse linear regression
Sun, T., & Zhang, C.-H. (2012) · Biometrika · doi:10.1093/biomet/ass043 · Cited by 444
Shrinkage Tuning Parameter Selection with a Diverging number of Parameters
Wang, H., Li, B., & Leng, C. (2009) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2008.00693.x · Cited by 433
Nonconcave Penalized Likelihood With NP-Dimensionality
Fan, J., & Lv, J. (2011) · IEEE Transactions on Information Theory · doi:10.1109/tit.2011.2158486 · Cited by 427
Self-citationXu, Z., Zhang, H., Wang, Y., Chang, X., & Liang, Y. (2010) · Science China Information Sciences · doi:10.1007/s11432-010-0090-0 · Cited by 424
Sparsistency and rates of convergence in large covariance matrix estimation
Lam, C., & Fan, J. (2009) · The Annals of Statistics · doi:10.1214/09-aos720 · Cited by 418
Self-citationStatistical methods with varying coefficient models
Fan, J., & Zhang, W. (2008) · Statistics and Its Interface · doi:10.4310/sii.2008.v1.n1.a15 · Cited by 417
Self-citationNetwork exploration via the adaptive LASSO and SCAD penalties
Fan, J., Feng, Y., & Wu, Y. (2009) · The Annals of Applied Statistics · doi:10.1214/08-aoas215 · Cited by 397
Self-citationAn overview of the estimation of large covariance and precision matrices
Fan, J., Liao, Y., & Liu, H. (2016) · The Econometrics Journal · doi:10.1111/ectj.12061 · Cited by 385
Self-citationRobust Truncated Hinge Loss Support Vector Machines
Wu, Y., & Liu, Y. (2007) · Journal of the American Statistical Association · doi:10.1198/016214507000000617 · Cited by 375
Forward Regression for Ultra-High Dimensional Variable Screening
Wang, H. (2009) · Journal of the American Statistical Association · doi:10.1198/jasa.2008.tm08516 · Cited by 366
VARIABLE SELECTION IN QUANTILE REGRESSION
Wu, Y., & Liu, Y. (2021) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/gccn-qy67 · Cited by 358
Statistical challenges with high dimensionality: feature selection in knowledge discovery
Fan, J., & Li, R. (2007) · Proceedings of the International Congress of Mathematicians Madrid, August 22–30, 2006 · doi:10.4171/022-3/31 · Cited by 348
Self-citationVariable selection using MM algorithms
Hunter, D. R., & Li, R. (2005) · The Annals of Statistics · doi:10.1214/009053605000000200 · Cited by 338
Properties of principal component methods for functional and longitudinal data analysis
Hall, P., Müller, H.-G., & Wang, J.-L. (2006) · The Annals of Statistics · doi:10.1214/009053606000000272 · Cited by 337
A group bridge approach for variable selection
Huang, J., Ma, S., Xie, H., & Zhang, C.-H. (2009) · Biometrika · doi:10.1093/biomet/asp020 · Cited by 324
Quantile Regression for Analyzing Heterogeneity in Ultra-High Dimension
Wang, L., Wu, Y., & Li, R. (2012) · Journal of the American Statistical Association · doi:10.1080/01621459.2012.656014 · Cited by 323
Estimating brain functional connectivity with sparse multivariate autoregression
Valdés-Sosa, P. A., Sánchez-Bornot, J. M., Lage-Castellanos, A., Vega-Hernández, M., Bosch-Bayard, J., Melie-García, L., & Canales-Rodríguez, E. (2005) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2005.1654 · Cited by 323
Strong oracle optimality of folded concave penalized estimation
Fan, J., Xue, L., & Zou, H. (2014) · The Annals of Statistics · doi:10.1214/13-aos1198 · Cited by 313
Self-citationRobust rank correlation based screening
Li, G., Peng, H., Zhang, J., & Zhu, L. (2012) · The Annals of Statistics · doi:10.1214/12-aos1024 · Cited by 307
Self-citationRegression coefficient and autoregressive order shrinkage and selection via the lasso
Wang, H., Li, G., & Tsai, C.-L. (2007) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2007.00577.x · Cited by 304
Variable Selection in Nonparametric Varying-Coefficient Models for Analysis of Repeated Measurements
Wang, L., Li, H., & Huang, J. Z. (2008) · Journal of the American Statistical Association · doi:10.1198/016214508000000788 · Cited by 301
A Selective Review of Group Selection in High-Dimensional Models
Huang, J., Breheny, P., & Ma, S. (2012) · Statistical Science · doi:10.1214/12-sts392 · Cited by 300
A General Theory of Concave Regularization for High-Dimensional Sparse Estimation Problems
Zhang, C.-H., & Zhang, T. (2012) · Statistical Science · doi:10.1214/12-sts399 · Cited by 296
Regularization Parameter Selections via Generalized Information Criterion
Zhang, Y., Li, R., & Tsai, C.-L. (2010) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.tm08013 · Cited by 293
Bootstrapping Lasso Estimators
Chatterjee, A., & Lahiri, S. N. (2011) · Journal of the American Statistical Association · doi:10.1198/jasa.2011.tm10159 · Cited by 293
Smoothly Clipped Absolute Deviation on High Dimensions
Kim, Y., Choi, H., & Oh, H.-S. (2008) · Journal of the American Statistical Association · doi:10.1198/016214508000001066 · Cited by 261
Variance Estimation Using Refitted Cross-Validation in Ultrahigh Dimensional Regression
Fan, J., Guo, S., & Hao, N. (2012) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2011.01005.x · Cited by 259
Self-citationA unified approach to model selection and sparse recovery using regularized least squares
Lv, J., & Fan, Y. (2009) · The Annals of Statistics · doi:10.1214/09-aos683 · Cited by 252
Metadata
- Authors
- Fan, J., & Peng, H.
- Venue
- The Annals of Statistics
- Publisher
- Institute of Mathematical Statistics
- Published
- 2004-06-01
- Volume
- 32
- Issue
- 3
- Pages
- 928-961
- ISSN
- 0090-5364 (ISSN-L)
- OpenAlex
- W2014360396
- Cited by
- 1,002
- References
- 39
- FWCI
- 14.43
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.