The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Optimal ratio for data splitting
Open accessAbstract
It is common to split a dataset into training and testing sets before fitting a statistical or machine learning model. However, there is no clear guidance on how much data should be used for training and testing. In this article, we show that the optimal training/testing splitting ratio is , where is the number of parameters in a linear regression model that explains the data well.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,387
Regularization Paths for Generalized Linear Models via Coordinate Descent
Friedman, J., Hastie, T., & Tibshirani, R. (2010) · Journal of Statistical Software · doi:10.18637/jss.v033.i01 · Cited by 19,927
Classification and Regression by randomForest
Liaw, A. I., & Wiener, M. C. (2007) · Cited by 18,594
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1998) · Springer Series in Statistics · doi:10.1007/978-1-4612-1694-0_15 · Cited by 17,781
The Elements of Statistical Learning: Data Mining, Inference, and Prediction
John Lu, Z. Q. (2010) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2010.00646_6.x · Cited by 12,390
Bayesian calibration of computer models
Kennedy, M. C., & O'Hagan, A. (2001) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00294 · Cited by 4,222
Computer Aided Design of Experiments
Kennard, R. W., & Stone, L. A. (1969) · Technometrics · doi:10.1080/00401706.1969.10490666 · Cited by 3,648
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-0919-5_38 · Cited by 3,028
Modeling of strength of high-performance concrete using artificial neural networks
Yeh, I.-C. (1998) · Cement and Concrete Research · doi:10.1016/s0008-8846(98)00165-3 · Cited by 1,447
Validation of Regression Models: Methods and Examples
Snee, R. D. (1977) · Technometrics · doi:10.1080/00401706.1977.10489581 · Cited by 1,283
A method for calibration and validation subset partitioning
Galvão, R. K. H., de Araújo, M. C. U., José, G. E., Pontes, M. J. C., Silva, E. C., & Saldanha, T. C. B. (2005) · Talanta · doi:10.1016/j.talanta.2005.03.025 · Cited by 956
Energy statistics: A class of statistics based on distances
Székely, G. J., & Rizzo, M. L. (2013) · Journal of Statistical Planning and Inference · doi:10.1016/j.jspi.2013.03.018 · Cited by 695
Nguyen, Q. H., Ly, H.-B., Ho, L. S., Al-Ansari, N., Le, H. V., Tran, V. Q., Prakash, I., & Pham, B. T. (2021) · Mathematical Problems in Engineering · doi:10.1155/2021/4832864 · Cited by 624
Moody, J. E. (1991) · Cited by 437
Optimally splitting cases for training and testing high dimensional classifiers
Dobbin, K. K., & Simon, R. M. (2011) · BMC Medical Genomics · doi:10.1186/1755-8794-4-31 · Cited by 392
Picard, R. R., & Berk, K. N. (1990) · The American Statistician · doi:10.1080/00031305.1990.10475704 · Cited by 217
laGP: Large-Scale Spatial Modeling via Local Approximate Gaussian Processes in R
Gramacy, R. B. (2016) · Journal of Statistical Software · doi:10.18637/jss.v072.i01 · Cited by 162
Mak, S., & Joseph, V. R. (2018) · The Annals of Statistics · doi:10.1214/17-aos1629 · Cited by 150
Self-citationSPlit: An Optimal Method for Data Splitting
Joseph, V. R., & Vakayil, A. (2021) · Figshare · doi:10.6084/m9.figshare.14501694 · Cited by 150
Self-citationOptimality of training/test size and resampling effectiveness in cross-validation
Afendras, G., & Markatou, M. (2018) · Journal of Statistical Planning and Inference · doi:10.1016/j.jspi.2018.07.005 · Cited by 116
Pham, B. T., Prakash, I., Jaafari, A., & Bui, D. T. (2018) · Journal of the Indian Society of Remote Sensing · doi:10.1007/s12524-018-0791-1 · Cited by 95
Statistical Adjustments to Engineering Models
Joseph, V. R., & Melkote, S. N. (2009) · Journal of Quality Technology · doi:10.1080/00224065.2009.11917791 · Cited by 89
Self-citationOn optimal data split for generalization estimation and model selection
Larsen, J. O., & Goutte, C. (2003) · Machine learning for signal processing ... · doi:10.1109/nnsp.1999.788141 · Cited by 45
Vakayil, A., & Joseph, V. R. (2022) · Statistical Analysis and Data Mining The ASA Data Science Journal · doi:10.1002/sam.11574 · Cited by 27
Self-citation
Cited by
Shintabella, R., Edi Widodo, C., & Wibowo, A. (2024) · International Journal of Innovative Science and Research Technology (IJISRT) · doi:10.38124/ijisrt/ijisrt24mar1125 · Cited by 1,320
Hasan, R., Dattana, V., Mahmood, S., & Hussain, S. (2024) · Information · doi:10.3390/info16010007 · Cited by 44
Triola, M. M., Reinstein, I., Marin, M., Gillespie, C., Abramson, S., Grossman, R. I., & Rivera, R. (2023) · Academic Medicine · doi:10.1097/acm.0000000000005202 · Cited by 29
Lai, D. K.-H., Cheng, E. S.-W., So, B. P.-H., Mao, Y.-J., Cheung, S. M.-Y., Cheung, D. S. K., Wong, D. W.-C., & Cheung, J. C.-W. (2023) · Mathematics · doi:10.3390/math11143081 · Cited by 18
On the Cost of Model-Serving Frameworks: An Experimental Evaluation
De Rosa, P., Bromberg, Y.-D., Felber, P., Mvondo, D., & Schiavoni, V. (2024) · 2024 IEEE International Conference on Cloud Engineering (IC2E) · doi:10.1109/ic2e61754.2024.00032 · Cited by 6
“If considering models fitted with a very high number of parameters, e . g ., neural networks, it is generally smaller in size than the data used for training [55].”
Metadata
- Authors
- Joseph, V. R.
- Venue
- Statistical Analysis and Data Mining: The ASA Data Science Journal
- Publisher
- Wiley
- Published
- 2022-04-04
- Volume
- 15
- Issue
- 4
- Pages
- 531-538
- ISSN
- 1932-1864 (ISSN-L)
- 1932-1872
- OpenAlex
- W4226017353
- Cited by
- 782
- References
- 25
- FWCI
- 114.89
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.