Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.

Linear Model Selection by Cross-validation

Shao, Jun · 1993 · Journal of the American Statistical Association

Abstract

We consider the problem of selecting a model having the best predictive ability among a class of linear models. The popular leave-one-out cross-validation method, which is asymptotically equivalent to many other model selection methods such as the Akaike information criterion (AIC), the C p , and the bootstrap, is asymptotically inconsistent in the sense that the probability of selecting the model with the best predictive ability does not converge to 1 as the total number of observations n → ∞. We show that the inconsistency of the leave-one-out cross-validation can be rectified by using a leave-n v -out cross-validation with n v , the number of observations reserved for validation, satisfying n v /n → 1 as n → ∞. This is a somewhat shocking discovery, because nv/n → 1 is totally opposite to the popular leave-one-out recipe in cross-validation. Motivations, justifications, and discussions of some practical aspects of the use of the leave-n v -out cross-validation method are provided, and results from a simulation study are presented.

Overview

Integrity signals

Registry

Crossref · 10.1080/01621459.1993.10476299

Cites

22 of 22 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 20 references

Research works printed but not linked: 3

  1. Gunst G. F., 1980, Regression Analysis and Its Application
  2. Herzberg G., 1986, Utilitas Mathematics, 29, 209
  3. Shorack G. R., 1986, Empirical Process with Applications to Statistics

Cited by

See all 1,790

Metadata

Authors
Shao, J.
Affiliations
University of Ottawa (CA)
Corresponding author
Shao, Jun
Venue
Journal of the American Statistical Association
Published
1993-06
Volume
88
Issue
422
Pages
486-494
ISSN
  • 0162-1459 (ISSN-L)
  • 1537-274X
OpenAlex
W2033872649
Cited by
1,790
References
20
Citations by year
2026: 32 · 2025: 59 · 2024: 65 · 2023: 59 · 2022: 82 · 2021: 110 · 2020: 99 · 2019: 86 · 2018: 95 · 2017: 87 · 2016: 84 · 2015: 90 · 2014: 66 · 2013: 70 · 2012: 69
FWCI
18.72
Type
journal article
Language
en
Open access
closed
Locations
Journal of the American Statistical Association (publishedVersion)
Topics
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
  • Physical Sciences › Mathematics › Statistics and Probability › Advanced Statistical Methods and Models
Keywords
model selection, leave-one-out cross-validation, predictive power, linear models, Akaike information criterion, bootstrapping, asymptotic consistency

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Linear Model Selection by Cross-validation. https://app.cochat.ai/papers/10.1080/01621459.1993.10476299
The paper
Shao, J. (1993). Linear Model Selection by Cross-validation. Journal of the American Statistical Association. https://doi.org/10.1080/01621459.1993.10476299

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.