The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Estimating classification error rate: Repeated cross-validation, repeated hold-out and bootstrap
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 20,825
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection
Kohavi, R. (1995) · Zenodo · doi:10.5281/zenodo.19712698 · Cited by 10,909
Classification and regression trees
Praagman, J. (1985) · European Journal of Operational Research · doi:10.1016/0377-2217(85)90321-2 · Cited by 10,053
Estimating the error rate of a prediction rule: improvement on cross-validation
Efron, B. (1983) · Journal of the American Statistical Association · doi:10.1080/01621459.1983.10477973 · Cited by 2,300
Improvements on Cross-Validation: The 632+ Bootstrap Method
Efron, B., & Tibshirani, R. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10474007 · Cited by 1,636
Prediction error estimation: a comparison of resampling methods
Molinaro, A. M., Simon, R., & Pfeiffer, R. M. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti499 · Cited by 1,339
BURMAN, P. (1989) · Biometrika · doi:10.1093/biomet/76.3.503 · Cited by 634
Cited by
Reliable Accuracy Estimates from k-Fold Cross Validation
Wong, T.-T., & Yeh, P.-Y. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2019.2912815 · Cited by 1,074
“Vanwinckelen and Blockeel [5] and Kim [6] also pointed out that repeating k -fold cross validation can stabilize the variability of accuracy estimates.”
BackgroundPredicting Diabetes Mellitus With Machine Learning Techniques
Zou, Q., Qu, K., Luo, Y., Yin, D., Ju, Y., & Tang, H. (2018) · Frontiers in Genetics · doi:10.3389/fgene.2018.00515 · Cited by 920
Khosravi, K., Pham, B. T., Chapi, K., Shirzadi, A., Shahabi, H., Revhaug, I., Prakash, I., & Tien Bui, D. (2018) · Science of The Total Environment · doi:10.1016/j.scitotenv.2018.01.266 · Cited by 792
Model Evaluation, Model Selection, and Algorithm Selection in Machine Learning
Raschka, S. (2018) · arXiv · doi:10.48550/arxiv.1811.12808 · Cited by 735
Abdi, A. M. (2020) · GIScience & Remote Sensing · doi:10.1080/15481603.2019.1650447 · Cited by 633
An Empirical Comparison of Model Validation Techniques for Defect Prediction Models
Tantithamthavorn, C., McIntosh, S., Hassan, A. E., & Matsumoto, K. (2017) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2016.2584050 · Cited by 574
Machine Learning Based Intrusion Detection Systems for IoT Applications
Verma, A., & Ranga, V. (2020) · Wireless Personal Communications · doi:10.1007/s11277-019-06986-8 · Cited by 418
Candidate biomarkers in psychiatric disorders: state of the field
Abi‐Dargham, A., Moeller, S. J., Ali, F., DeLorenzo, C., Domschke, K., Horga, G., Jutla, A., Kotov, R., Paulus, M. P., Rubio, J. M., et al. (2023) · World Psychiatry · doi:10.1002/wps.21078 · Cited by 372
Mean Birds: Detecting Aggression and Bullying on Twitter
Chatzakou, D., Kourtellis, N., Blackburn, J., De Cristofaro, E., Stringhini, G., & Vakali, A. (2017) · Proceedings of the 2017 ACM on Web Science Conference · doi:10.1145/3091478.3091487 · Cited by 369
Alghamdi, M., Al-Mallah, M., Keteyian, S., Brawner, C., Ehrman, J., & Sakr, S. (2017) · PLOS ONE · doi:10.1371/journal.pone.0179805 · Cited by 301
Cabitza, F., Campagner, A., Soares, F., García de Guadiana-Romualdo, L., Challa, F., Sulejmani, A., Seghezzi, M., & Carobene, A. (2021) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2021.106288 · Cited by 284
Tan, T. Z., Miow, Q. H., Huang, R. Y., Wong, M. K., Ye, J., Lau, J. A., Wu, M. C., Bin Abdul Hadi, L. H., Soong, R., Choolani, M., et al. (2013) · EMBO Molecular Medicine · doi:10.1002/emmm.201201823 · Cited by 281
Molecular Diagnosis of Antibody-Mediated Rejection in Human Kidney Transplants
Sellarés, J., Reeve, J., Loupy, A., Mengel, M., Sis, B., Skene, A., de Freitas, D. G., Kreepala, C., Hidalgo, L. G., Famulski, K. S., et al. (2013) · American Journal of Transplantation · doi:10.1111/ajt.12150 · Cited by 280
A Survey on Deep Learning for Human Activity Recognition
Gu, F., Chung, M.-H., Chignell, M., Valaee, S., Zhou, B., & Liu, X. (2022) · ACM Computing Surveys · doi:10.1145/3472290 · Cited by 272
A Distinct Role of the Temporal-Parietal Junction in Predicting Socially Guided Decisions
Carter, R. M., Bowling, D. L., Reeck, C., & Huettel, S. A. (2012) · Science · doi:10.1126/science.1219681 · Cited by 238
Wilimitis, D., & Walsh, C. G. (2023) · JMIR AI · doi:10.2196/49023 · Cited by 185
Guan, Y., Zhang, H., Quang, D., Wang, Z., Parker, S. C. J., Pappas, D. A., Kremer, J. M., & Zhu, F. (2019) · Arthritis & Rheumatology · doi:10.1002/art.41056 · Cited by 137
Let's (not) stick together: pairwise similarity biases cross-validation in activity recognition
Hammerla, N. Y., & Plötz, T. (2015) · Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2750858.2807551 · Cited by 91
Batch Effect Confounding Leads to Strong Bias in Performance Estimates Obtained by Cross-Validation
Soneson, C., Gerster, S., & Delorenzi, M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0100335 · Cited by 84
Flygare, O., Enander, J., Andersson, E., Ljótsson, B., Ivanov, V. Z., Mataix-Cols, D., & Rück, C. (2020) · BMC Psychiatry · doi:10.1186/s12888-020-02655-4 · Cited by 51
Smith-Woolley, E., Selzam, S., & Plomin, R. (2019) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000241 · Cited by 50
Developing and validating a prediction model for lymphedema detection in breast cancer survivors
Wei, X., Lu, Q., Jin, S., Li, F., Zhao, Q., Cui, Y., Jin, S., Cao, Y., & Fu, M. R. (2021) · European Journal of Oncology Nursing · doi:10.1016/j.ejon.2021.102023 · Cited by 49
Kim, H. B., Nguyen, H. T., Jin, Q., Tamby, S., Gelaf Romer, T., Sung, E., Liu, R., Greenstein, J. L., Suarez, J. I., Storm, C., et al. (2022) · Anaesthesia Critical Care & Pain Medicine · doi:10.1016/j.accpm.2021.101015 · Cited by 18
Çubukçu, H. C. (2021) · Turkish Journal of Biochemistry · doi:10.1515/tjb-2021-0199 · Cited by 13
Subtree Replacement in Decision Tree Simplification
Ruggieri, S. (2012) · Proceedings of the 2012 SIAM International Conference on Data Mining · doi:10.1137/1.9781611972825.33 · Cited by 5
Metadata
- Authors
- Kim, J.-H.
- Venue
- Computational Statistics & Data Analysis
- Publisher
- Elsevier BV
- Published
- 2009-09
- Volume
- 53
- Issue
- 11
- Pages
- 3735-3745
- ISSN
- 0167-9473 (ISSN-L)
- OpenAlex
- W2073792037
- Cited by
- 792
- References
- 14
- FWCI
- 12.29
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.