The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Variable selection in semiparametric regression modeling
Open accessAbstract
In this paper, we are concerned with how to select significant variables in semiparametric modeling. Variable selection for semiparametric regression models consists of two components: model selection for nonparametric components and select significant variables for parametric portion. Thus, it is much more challenging than that for parametric models such as linear models and generalized linear models because traditional variable selection procedures including stepwise regression and the best subset selection require model selection to nonparametric components for each submodel. This leads to very heavy computational burden. In this paper, we propose a class of variable selection procedures for semiparametric regression models using nonconcave penalized likelihood. The newly proposed procedures are distinguished from the traditional ones in that they delete insignificant variables and estimate the coefficients of significant variables simultaneously. This allows us to establish the sampling properties of the resulting estimate. We first establish the rate of convergence of the resulting estimate. With proper choices of penalty functions and regularization parameters, we then establish the asymptotic normality of the resulting estimate, and further demonstrate that the proposed procedures perform as well as an oracle procedure. Semiparametric generalized likelihood ratio test is proposed to select significant variables in the nonparametric component. We investigate the asymptotic behavior of the proposed test and demonstrate its limiting null distribution follows a chi-squared distribution, which is independent of the nuisance parameters. Extensive Monte Carlo simulation studies are conducted to examine the finite sample performance of the proposed variable selection procedures.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A new look at the statistical model identification
Akaike, H. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100705 · Cited by 51,879
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Fan, J., & Li, R. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753382273 · Cited by 8,900
Self-citationBrown, R. A., Hastie, T. J., & Tibshirani, R. J. (1991) · Biometrics · doi:10.2307/2532174 · Cited by 8,176
Craven, P., & Wahba, G. (1978) · Numerische Mathematik · doi:10.1007/bf01404567 · Cited by 3,388
Local Polynomial Modelling and its Applications
Fan, J., & Gijbels, I. (1994) · Springer eBooks · doi:10.1007/978-1-4899-3150-4 · Cited by 2,849
Root-N-Consistent Semiparametric Regression
Robinson, P. M. (1988) · Econometrica · doi:10.2307/1912705 · Cited by 2,475
A Statistical View of Some Chemometrics Regression Tools
Frank, L. E., & Friedman, J. H. (1993) · Technometrics · doi:10.1080/00401706.1993.10485033 · Cited by 2,213
Mallows, C. L. (1995) · Technometrics · doi:10.1080/00401706.1995.10484370 · Cited by 2,083
Hastie, T., & Tibshirani, R. (1993) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1993.tb01939.x · Cited by 1,902
Generalized additive models for medical research
Hastie, T., & Tibshirani, R. (1995) · Statistical Methods in Medical Research · doi:10.1177/096228029500400302 · Cited by 1,266
Heuristics of instability and stabilization in model selection
Breiman, L. (1996) · The Annals of Statistics · doi:10.1214/aos/1032181158 · Cited by 1,146
Mallows, C. L. (1995) · Technometrics · doi:10.2307/1269729 · Cited by 1,080
Semiparametric Estimates of the Relation between Weather and Electricity Sales
Engle, R. F., Granger, C. W. J., Rice, J., & Weiss, A. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478274 · Cited by 988
Kernel Smoothing in Partial Linear Models
Speckman, P. (1988) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1988.tb01738.x · Cited by 986
Generalized Partially Linear Single-Index Models
Carroll, R. J., Fan, J., Gijbels, I., & Wand, M. P. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10474001 · Cited by 831
An Effective Bandwidth Selector for Local Least Squares Regression
Ruppert, D., Sheather, S. J., & Wand, M. P. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476630 · Cited by 820
Asymptotics for Least Absolute Deviation Regression Estimators
Pollard, D. (1991) · Econometric Theory · doi:10.1017/s0266466600004394 · Cited by 646
A Note on the Efficiency of Sandwich Covariance Matrix Estimation
Kauermann, G., & Carroll, R. J. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753382309 · Cited by 616
The Risk Inflation Criterion for Multiple Regression
Foster, D. P., & George, E. I. (1994) · The Annals of Statistics · doi:10.1214/aos/1176325766 · Cited by 541
Penalized Spline Estimation for Partially Linear Single-Index Models
Yu, Y., & Ruppert, D. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502388618861 · Cited by 522
Regularization of Wavelet Approximations
Antoniadis, A., & Fan, J. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753208942 · Cited by 498
Weak and strong uniform consistency of kernel regression estimates
Mack, Y. P., & Silverman, B. W. (1982) · Zeitschrift f�r Wahrscheinlichkeitstheorie und Verwandte Gebiete · doi:10.1007/bf00539840 · Cited by 474
Spline Smoothing in a Partly Linear Model
Heckman, N. E. (1986) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1986.tb01407.x · Cited by 443
Efficient Estimation and Inferences for Varying-Coefficient Models
Cai, Z., Fan, J., & Li, R. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10474280 · Cited by 426
Self-citationSemiparametric Regression for the Applied Econometrician
Yatchew, A. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511615887 · Cited by 391
Quasi-Likelihood Estimation in Semiparametric Models
Severini, T. A., & Staniswalis, J. G. (1994) · Journal of the American Statistical Association · doi:10.1080/01621459.1994.10476774 · Cited by 378
Local Polynomial Kernel Regression for Generalized Linear Models and Quasi-Likelihood Functions
Fan, J., Heckman, N. E., & Wand, M. P. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476496 · Cited by 375
Variable selection using MM algorithmsPreprint
Hunter, D. R., & Li, R. (2005) · Cited by 375
Self-citationVariable selection using MM algorithms
Hunter, D. R., & Li, R. (2005) · The Annals of Statistics · doi:10.1214/009053605000000200 · Cited by 338
Self-citationConvergence Rates for Parametric Components in a Partly Linear Model
Chen, H. (1988) · The Annals of Statistics · doi:10.1214/aos/1176350695 · Cited by 333
Carroll, R. J., Ruppert, D., & Welsh, A. H. (1998) · Journal of the American Statistical Association · doi:10.1080/01621459.1998.10474103 · Cited by 125
Penalized quasi-likelihood estimation in partial linear models
Mammen, E., & van de Geer, S. (1997) · The Annals of Statistics · doi:10.1214/aos/1069362736 · Cited by 113
Regularization of Wavelets Approximations
Antoniadis, A., & Fan, J. (2011) · eScholarship (California Digital Library) · Cited by 49
Cited by
One-step sparse estimates in nonconcave penalized likelihood models
Zou, H., & Li, R. (2008) · The Annals of Statistics · doi:10.1214/009053607000000802 · Cited by 683
Self-citationStatistical methods with varying coefficient models
Fan, J., & Zhang, W. (2008) · Statistics and Its Interface · doi:10.4310/sii.2008.v1.n1.a15 · Cited by 417
Kai, B., Li, R., & Zou, H. (2011) · The Annals of Statistics · doi:10.1214/10-aos842 · Cited by 301
Self-citationRegularization Parameter Selections via Generalized Information Criterion
Zhang, Y., Li, R., & Tsai, C.-L. (2010) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.tm08013 · Cited by 293
Self-citationShrinkage Estimation of the Varying Coefficient Model
Wang, H., & Xia, Y. (2009) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.0138 · Cited by 261
Metadata
- Authors
- Li, R., & Liang, H.
- Venue
- The Annals of Statistics
- Publisher
- Institute of Mathematical Statistics
- Published
- 2008-02-01
- Volume
- 36
- Issue
- 1
- Pages
- 261-286
- ISSN
- 0090-5364 (ISSN-L)
- OpenAlex
- W2045901075
- Cited by
- 296
- References
- 35
- FWCI
- 20.49
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.