The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Component selection and smoothing in multivariate nonparametric regression
Open accessAbstract
We propose a new method for model selection and model fitting in multivariate nonparametric regression models, in the framework of smoothing spline ANOVA. The “COSSO” is a method of regularization with the penalty functional being the sum of component norms, instead of the squared norm employed in the traditional smoothing spline method. The COSSO provides a unified framework for several recent proposals for model selection in linear models and smoothing spline ANOVA models. Theoretical properties, such as the existence and the rate of convergence of the COSSO estimator, are studied. In the special case of a tensor product design with periodic functions, a detailed analysis reveals that the COSSO does model selection by applying a novel soft thresholding type operation to the function components. We give an equivalent formulation of the COSSO estimator which leads naturally to an iterative algorithm. We compare the COSSO with MARS, a popular method that builds functional ANOVA models, in simulations and real examples. The COSSO method can be extended to classification problems and we compare its performance with those of a number of machine learning algorithms on real datasets. The COSSO gives very competitive performance in these studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Efron, B., Hastie, T., Johnstone, I., & Tibshirani, R. (2004) · The Annals of Statistics · doi:10.1214/009053604000000067 · Cited by 9,357
Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Fan, J., & Li, R. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753382273 · Cited by 8,900
Brown, R. A., Hastie, T. J., & Tibshirani, R. J. (1991) · Biometrics · doi:10.2307/2532174 · Cited by 8,176
Multivariate Adaptive Regression Splines
Friedman, J. H. (1991) · The Annals of Statistics · doi:10.1214/aos/1176347963 · Cited by 8,000
Atomic Decomposition by Basis Pursuit
Chen, S. S., Donoho, D. L., & Saunders, M. A. (1998) · SIAM Journal on Scientific Computing · doi:10.1137/s1064827596304010 · Cited by 6,845
Spline Models for Observational Data.
Muller, H.-G., & Wahba, G. (1991) · Journal of the American Statistical Association · doi:10.2307/2290434 · Cited by 4,928
Lohrli, A. (1985) · Notes and Queries · doi:10.1093/notesj/32.3.377-a · Cited by 4,352
Spline Models for Observational Data
Wahba, G. (1990) · doi:10.1137/1.9781611970128 · Cited by 4,184
Craven, P., & Wahba, G. (1978) · Numerische Mathematik · doi:10.1007/bf01404567 · Cited by 3,388
Hastie, T., & Tibshirani, R. (2014) · Wiley StatsRef: Statistics Reference Online · doi:10.1002/9781118445112.stat03141 · Cited by 3,156
A Statistical View of Some Chemometrics Regression Tools
Frank, L. E., & Friedman, J. H. (1993) · Technometrics · doi:10.1080/00401706.1993.10485033 · Cited by 2,213
Estimating Optimal Transformations for Multiple Regression and Correlation
Breiman, L., & Friedman, J. H. (1985) · Journal of the American Statistical Association · doi:10.1080/01621459.1985.10478157 · Cited by 1,710
Smoothing noisy data with spline functions
Wahba, G. (1975) · Numerische Mathematik · doi:10.1007/bf01437407 · Cited by 1,443
Asymptotics for lasso-type estimators
Fu, W., & Knight, K. (2000) · The Annals of Statistics · doi:10.1214/aos/1015957397 · Cited by 1,276
Better Subset Regression Using the Nonnegative Garrote
Breiman, L. (1995) · Technometrics · doi:10.1080/00401706.1995.10484371 · Cited by 1,043
Linear Smoothers and Additive Models
Buja, A., Hastie, T., & Tibshirani, R. (1989) · The Annals of Statistics · doi:10.1214/aos/1176347115 · Cited by 989
Gu, C. (2013) · Springer Series in Statistics · doi:10.1007/978-1-4614-5369-7 · Cited by 867
Benchmarking Least Squares Support Vector Machine Classifiers
van Gestel, T., Suykens, J. A. K., Baesens, B., Viaene, S., Vanthienen, J., Dedene, G., de Moor, B., & Vandewalle, J. (2004) · Machine Learning · doi:10.1023/b:mach.0000008082.80494.e0 · Cited by 745
Bayesian “Confidence Intervals” for the Cross-Validated Smoothing Spline
Wahba, G. (1983) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1983.tb01239.x · Cited by 637
Empirical Processes in M-Estimation
van de Geer, S. (2000) · Cited by 530
On Measuring and Correcting the Effects of Data Mining and Model Selection
Ye, J. (1998) · Journal of the American Statistical Association · doi:10.1080/01621459.1998.10474094 · Cited by 518
Nonparametric probability density estimation
Tapia, R. A., & Thompson, J. (1978) · Cited by 454
Gu, C. (2002) · Springer Series in Statistics · doi:10.1007/978-1-4757-3683-0 · Cited by 409
A Statistical View of Some Chemometrics Regression Tools
Frank, I. E., & Friedman, J. H. (1993) · Technometrics · doi:10.2307/1269656 · Cited by 395
A completely automatic french curve: fitting spline functions by cross validation
Wahba, G., & Wold, S. (1975) · Communications in Statistics · doi:10.1080/03610927508827223 · Cited by 366
Bayesian Confidence Intervals for Smoothing Splines
Nychka, D. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478711 · Cited by 289
Theory & Methods: Spatially‐adaptive Penalties for Spline Fitting
Ruppert, D., & Carroll, R. J. (2000) · Australian & New Zealand Journal of Statistics · doi:10.1111/1467-842x.00119 · Cited by 245
Wahba, G., Wang, Y., Gu, C., Klein, R., & Klein, B. (1995) · The Annals of Statistics · doi:10.1214/aos/1034713638 · Cited by 235
Shen, X., & Ye, J. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502753479356 · Cited by 196
Adaptive regression and model selection in data mining problems
Bakin, S. (1999) · ANU Open Research (Australian National University) · doi:10.25911/5d78db4c25dbb · Cited by 174
Tensor product space ANOVA models
Lin, Y. (2000) · The Annals of Statistics · doi:10.1214/aos/1015951996 · Cited by 122
Self-citationA GENERALIZED APPROXIMATE CROSS VALIDATION FOR SMOOTHING SPLINES WITH NON-GAUSSIAN DATA
Xiang, D., & Wahba, G. (1996) · Cited by 105
Gao, F., Klein, R., Klein, R., Lin, X., Wahba, G., & Xiang, D. (2000) · The Annals of Statistics · doi:10.1214/aos/1015957471 · Cited by 100
Structural Modelling with Sparse Kernels
Gunn, S. R., & Kandola, J. S. (2002) · Machine Learning · doi:10.1023/a:1013903804720 · Cited by 93
Variable Selection and Model Building via Likelihood Basis Pursuit
Zhang, H. H., Wahba, G., Lin, Y., Voelker, M. M., Ferris, M. C., Klein, R., & Klein, R. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000000593 · Cited by 82
Self-citationNatural spline functions, their associated eigenvalue problem
Utreras, F. I. (1983) · Numerische Mathematik · doi:10.1007/bf01400921 · Cited by 63
Inference After Model Selection
Shen, X., Huang, H., & Ye, J. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000001097 · Cited by 58
Fitting Multivariate Regression Functions by Interaction Spline Models
Chen, Z. (1993) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1993.tb01917.x · Cited by 58
Diagnostics for Nonparametric Regression Models with Additive Terms
Gu, C. (1992) · Journal of the American Statistical Association · doi:10.1080/01621459.1992.10476260 · Cited by 54
Cross-Validating Non-Gaussian Data: Generalized Approximate Cross-Validation Revisited
Gu, C., & Xiang, D. (2001) · Journal of Computational and Graphical Statistics · doi:10.1198/106186001317114992 · Cited by 49
Variable Selection via Penalized Likelihood
B, J. F. A., & Liu, R. (1999) · eScholarship (California Digital Library) · Cited by 49
Interaction Spline Models and Their Convergence Rates
Chen, Z. (1991) · The Annals of Statistics · doi:10.1214/aos/1176348374 · Cited by 32
Cited by
Model Selection and Estimation in Regression with Grouped Variables
Yuan, M., & Lin, Y. (2006) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00532.x · Cited by 7,261
Self-citationInterpretable machine learning: Fundamental principles and 10 grand challenges
Rudin, C., Chen, C., Chen, Z., Huang, H., Semenova, L., & Zhong, C. (2022) · Statistics Surveys · doi:10.1214/21-ss133 · Cited by 958
Practical variable selection for generalized additive models
Marra, G., & Wood, S. N. (2011) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2011.02.004 · Cited by 864
Goldstein, B. A., Navar, A. M., & Carter, R. E. (2016) · European Heart Journal · doi:10.1093/eurheartj/ehw302 · Cited by 543
Nonparametric Independence Screening in Sparse Ultra-High-Dimensional Additive Models
Fan, J., Feng, Y., & Song, R. (2011) · Journal of the American Statistical Association · doi:10.1198/jasa.2011.tm09779 · Cited by 540
Metadata
- Authors
- Lin, Y., & Zhang, H. H.
- Venue
- The Annals of Statistics
- Publisher
- Institute of Mathematical Statistics
- Published
- 2006-10-01
- Volume
- 34
- Issue
- 5
- Pages
- 2272-2297
- ISSN
- 0090-5364 (ISSN-L)
- OpenAlex
- W2080726496
- Cited by
- 550
- References
- 43
- FWCI
- 18.91
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.