Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.

Cross-Validation With Confidence

Lei, Jing · 2020 · Journal of the American Statistical Association

Abstract

Cross-validation is one of the most popular model and tuning parameter selection methods in statistics and machine learning. Despite its wide applicability, traditional cross-validation methods tend to overfit, due to the ignorance of the uncertainty in the testing sample. We develop a novel statistically principled inference tool based on cross-validation that takes into account the uncertainty in the testing sample. This method outputs a set of highly competitive candidate models containing the optimal one with guaranteed probability. As a consequence, our method can achieve consistent variable selection in a classical linear regression setting, for which existing cross-validation methods require unconventional split ratios. When used for tuning parameter selection, the method can provide an alternative trade-off between prediction accuracy and model interpretability than existing variants of cross-validation. We demonstrate the performance of the proposed method in several simulated and real data examples. Supplemental materials for this article can be found online.

Overview

Integrity signals

Registry

Crossref · 10.1080/01621459.2019.1672556

Cites

44 of 44 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Show all 44 references

Research works printed but not linked: 3

  1. Chatterjee S., 2015, arXiv no, 1502, 06291
  2. Chernozhukov V., 2013, arXiv no, 1312, 7614
  3. Chetverikov D., 2016, arXiv no, 1605, 02214

Cited by

See all 93

Metadata

Authors
Lei, J.
Affiliations
Carnegie Mellon University (US)
Corresponding author
Lei, Jing
Venue
Journal of the American Statistical Association
Published
2019-10-31
Volume
115
Issue
532
Pages
1978-1997
ISSN
  • 0162-1459 (ISSN-L)
  • 1537-274X
OpenAlex
W2979632005
Cited by
93
References
44
Citations by year
2026: 15 · 2025: 22 · 2024: 17 · 2023: 12 · 2022: 9 · 2021: 8 · 2020: 9 · 2019: 1
FWCI
5.29
Type
journal article
Language
en
Open access
closed
Locations
  • Journal of the American Statistical Association (publishedVersion)
  • RePEc: Research Papers in Economics (submittedVersion)
Funders
NSF (DMS-1407771, DMS-1553884)
Topics
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
Keywords
cross-validation, overfitting, model selection, feature selection, hyperparameter optimization, linear regression

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Cross-Validation With Confidence. https://app.cochat.ai/papers/10.1080/01621459.2019.1672556
The paper
Lei, J. (2020). Cross-Validation With Confidence. Journal of the American Statistical Association. https://doi.org/10.1080/01621459.2019.1672556

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.