The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Consistency of cross validation for comparing regression procedures
Open accessAbstract
Theoretical developments on cross validation (CV) have mainly focused on selecting one among a list of finite-dimensional models (e.g., subset or order selection in linear regression) or selecting a smoothing parameter (e.g., bandwidth for kernel smoothing). However, little is known about consistency of cross validation when applied to compare between parametric and nonparametric methods or within nonparametric methods. We show that under some conditions, with an appropriate choice of data splitting ratio, cross validation is consistent in the sense of selecting the better procedure with probability approaching 1. Our results reveal interesting behavior of cross validation. When comparing two models (procedures) converging at the same nonparametric rate, in contrast to the parametric case, it turns out that the proportion of data used for evaluation in CV does not need to be dominating in size. Furthermore, it can even be of a smaller order than the proportion for estimation while not affecting the consistency property.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Spline Models for Observational Data
Wahba, G. (1990) · doi:10.1137/1.9781611970128 · Cited by 4,184
Craven, P., & Wahba, G. (1978) · Numerische Mathematik · doi:10.1007/bf01404567 · Cited by 3,388
The Predictive Sample Reuse Method with Applications
Geisser, S. (1975) · Journal of the American Statistical Association · doi:10.1080/01621459.1975.10479865 · Cited by 2,748 · cited 4×
“Seymour Geisser passed away in March 2004.”
BackgroundInfluentialThe Relationship Between Variable Selection and Data Agumentation and a Method for Prediction
Allen, D. M. (1974) · Technometrics · doi:10.1080/00401706.1974.10489157 · Cited by 1,469 · cited 1×
“1. Introduction. Cross validation (e.g., Allen [ 2 ], Stone [25] and Geisser [9]) is one of the most commonly used model selection criteria.”
BackgroundModel Selection Via Multifold Cross Validation
Zhang, P. (1993) · The Annals of Statistics · doi:10.1214/aos/1176349027 · Cited by 539
Oracle inequalities for multi-fold cross validation
Vaart, A. W. V. D., Dudoit, S., & Laan, M. J. V. D. (2006) · Statistics & Decisions · doi:10.1524/stnd.2006.24.3.351 · Cited by 156
Cited by
A survey of cross-validation procedures for model selection
Arlot, S., & Celisse, A. (2010) · Statistics Surveys · doi:10.1214/09-ss054 · Cited by 3,522
Estimation of prediction error by using K-fold cross-validation
Fushiki, T. (2011) · Statistics and Computing · doi:10.1007/s11222-009-9153-8 · Cited by 1,470
Sensitivity and specificity of information criteria
(2019) · doi:10.1093/bib/bbz016 · Cited by 718
Multiple predicting K -fold cross-validation for model selection
Jung, Y. (2018) · Journal of Nonparametric Statistics · doi:10.1080/10485252.2017.1404598 · Cited by 499
Cross-Validation: What Does It Estimate and How Well Does It Do It?
Bates, S., Hastie, T., & Tibshirani, R. (2024) · Journal of the American Statistical Association · doi:10.1080/01621459.2023.2197686 · Cited by 442
Metadata
- Authors
- Yang, Y.
- Venue
- The Annals of Statistics
- Publisher
- Institute of Mathematical Statistics
- Published
- 2007-12-01
- Volume
- 35
- Issue
- 6
- Pages
- 2450-2473
- ISSN
- 0090-5364 (ISSN-L)
- OpenAlex
- W2018471882
- Cited by
- 166
- References
- 6
- FWCI
- 7.81
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Consistency of cross validation for comparing regression procedures. https://app.cochat.ai/papers/10.1214/009053607000000514
- The paper
- Yang, Y. (2007). Consistency of cross validation for comparing regression procedures. The Annals of Statistics. https://doi.org/10.1214/009053607000000514
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.