Cited by 409Machine Learning and AlgorithmsMachine Learning and Data ClassificationStochastic Gradient Optimization Techniques

The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.

Algorithmic Stability and Sanity-Check Bounds for Leave-One-Out Cross-Validation

Kearns, Michael, Ron, Dana·1999·Neural Computation

DOI 10.1162/089976699300016304

Open this paper in CoChat — free account

Abstract

In this article we prove sanity-check bounds for the error of the leave-oneout cross-validation estimate of the generalization error: that is, bounds showing that the worst-case error of this estimate is not much worse than that of the training error estimate. The name sanity check refers to the fact that although we often expect the leave-one-out estimate to perform considerably better than the training error estimate, we are here only seeking assurance that its performance will not be considerably worse. Perhaps surprisingly, such assurance has been given only for limited cases in the prior literature on cross-validation. Any nontrivial bound on the error of leave-one-out must rely on some notion of algorithmic stability. Previous bounds relied on the rather strong notion of hypothesis stability, whose application was primarily limited to nearest-neighbor and other local algorithms. Here we introduce the new and weaker notion of error stability and apply it to obtain sanity-check bounds for leave-one-out for other classes of learning algorithms, including training error minimization procedures and Bayesian algorithms. We also provide lower bounds demonstrating the necessity of some form of error stability for proving bounds on the error of the leave-one-out estimate, and the fact that for training error minimization algorithms, in the worst case such bounds must still depend on the Vapnik-Chervonenkis dimension of the hypothesis class.

Integrity signals

Registry

Crossref · 10.1162/089976699300016304

Cites

18 of 18 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Stochastic relaxation, gibbs distributions, and the bayesian restoration of images.
Geman, S., & Geman, D. (1984) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1984.4767596 · Cited by 17,949
Untitled work
(1973) · CERN Document Server (European Organization for Nuclear Research) · Cited by 12,895
A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection
Kohavi, R. (1995) · Zenodo · doi:10.5281/zenodo.19712698 · Cited by 10,909
A Probabilistic Theory of Pattern Recognition
Devroye, L., Györfi, L., & Lugosi, G. (1996) · Stochastic Modelling and Applied Probability · doi:10.1007/978-1-4612-0711-5 · Cited by 3,274
Estimation of Dependences Based on Empirical Data
Vapnik, V. N. (2006) · Information science and statistics · doi:10.1007/0-387-34239-7 · Cited by 2,252
Subset Selection in Regression
Miller, A. J. (2003) · Technometrics · doi:10.1198/tech.2003.s144 · Cited by 1,501
Decision theoretic generalizations of the PAC model for neural net and other learning applications
Haussler, D. H. (1992) · Information and Computation · doi:10.1016/0890-5401(92)90010-d · Cited by 845
Subset Selection in Regression.
RAAB, G. M., & Miller, T. (1991) · Biometrics · doi:10.2307/2532418 · Cited by 547
Statistical mechanics of learning from examples
Seung, H. S., Sompolinsky, H., & Tishby, N. (1992) · Physical Review A · doi:10.1103/physreva.45.6056 · Cited by 532
Toward efficient agnostic learning
Kearns, M. J., Schapire, R. E., & Sellie, L. M. (1992) · Conference on Learning Theory · doi:10.1145/130385.130424 · Cited by 353
Self-citation

Show all 18 references

Sorted by citations

Items 201–300 of 409

Fusion of Spatially Heterogeneous GNSS and InSAR Deformation Data Using a Multiresolution Segmentation Algorithm and Its Application in the Inversion of Slip Distribution
Yan, H., Dai, W., Liu, H., Gao, H., Neely, W. R., & Xu, W. (2022) · Remote Sensing · doi:10.3390/rs14143293 · Cited by 14
Carbon Emission Intensity, Economic Development and Energy Factors in 19 G20 Countries: Empirical Analysis Based on a Heterogeneous Panel from 1990 to 2015
Li, H., Li, F., Shi, D., Yu, X., & Shen, J. (2018) · Sustainability · doi:10.3390/su10072330 · Cited by 14
Automated Expansion of Abbreviations Based on Semantic Relation and Transfer Expansion
Jiang, Y., Liu, H., Jin, J., & Zhang, L. (2020) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2020.2995736 · Cited by 14
Toward Better Generalization Bounds with Locally Elastic StabilityPreprint
Deng, Z., He, H., & Su, W. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.13988 · Cited by 20
Assessment of temporal state-dependent interactions between auditory fMRI responses to desired and undesired acoustic sources
Olulade, O. A., Hu, S., González-Castillo, J., Tamer, G. G., Luh, W.-M., Ulmer, J. L., & Talavage, T. M. (2011) · Hearing Research · doi:10.1016/j.heares.2011.03.008 · Cited by 13
Stability and optimization error of stochastic gradient descent for pairwise learning
Shen, W., Yang, Z., Ying, Y., & Yuan, X. (2019) · Analysis and Applications · doi:10.1142/s0219530519400062 · Cited by 13
Randomized learning and generalization of fair and private classifiers: From PAC-Bayes to stability and differential privacy
Oneto, L., Donini, M., Pontil, M., & Shawe-Taylor, J. S. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.12.137 · Cited by 13
Physics Augmented Correlations and Machine Learning Methods to Accurately Calculate Dead Oil Viscosity Based on the Available Inputs
Sinha, U., Dindoruk, B., & Soliman, M. Y. (2022) · SPE Journal · doi:10.2118/209610-pa · Cited by 13
Improvements of an objective model of compressed breasts undergoing mammography: Generation and characterization of breast shapes
Rodríguez‐Ruiz, A., Feng, S. S. J., van Zelst, J. C. M., Vreemann, S., Mann, J., D’Orsi, C. J., & Sechopoulos, I. (2017) · Medical Physics · doi:10.1002/mp.12186 · Cited by 12
Social impact assessment of scientist from mainstream news and weblogs
Timilsina, M., Khawaja, W., Davis, B., Taylor, M., & Hayes, C. (2017) · Social Network Analysis and Mining · doi:10.1007/s13278-017-0466-x · Cited by 12
Updating the paradigm of official statistics: New quality criteria for integrating new data and methods in official statistics
Broe, S. D., Struijs, P., Daas, P., van Delden, A., Burger, J. M. S., van den Brakel, J., ten Bosch, O., Zeelenberg, K., & Ypma, W. F. H. (2020) · Statistical Journal of the IAOS · doi:10.3233/sji-200711 · Cited by 12
OCReP: An Optimally Conditioned Regularization for pseudoinversion based neural training
Cancelliere, R., Gai, M., Gallinari, P., & Rubini, L. (2015) · Neural Networks · doi:10.1016/j.neunet.2015.07.015 · Cited by 12
A correlation for 1,9-decadiene/water partition coefficients.
Nitsche, J., & Kasting, G. (2013) · Journal of Pharmacy and Science · doi:10.1002/jps.23342 · Cited by 11
Co-expression network analysis of Down's syndrome based on microarray data
Zhao, J., Zhang, Z., Ren, S., Zong, Y., & Kong, X. (2016) · Experimental and Therapeutic Medicine · doi:10.3892/etm.2016.3462 · Cited by 12
Leveraging machine learning techniques for predicting pancreatic neuroendocrine tumor grades using biochemical and tumor markers
Zhou, R., Ji, H., Liu, Q., Zhu, C., & Liu, R. (2019) · World Journal of Clinical Cases · doi:10.12998/wjcc.v7.i13.1611 · Cited by 12
Steganalysis of AMR Speech Based on Multiple Classifiers Combination
Tian, H., Liu, J., Chang, C., Chen, C., & Huang, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2943504 · Cited by 12
Wasserstein-based fairness interpretability framework for machine learning models
Miroshnikov, A., Kotsiopoulos, K., Franks, R., & Kannan, A. R. (2022) · Machine Learning · doi:10.1007/s10994-022-06213-9 · Cited by 11
Structural investigation of isatin-based benzenesulfonamides as carbonic anhydrase isoform IX inhibitors endowed with anticancer activity using molecular modeling approaches
Abdizadeh, R., Samani, K. G., Hadizadeh, F., & Abdizadeh, T. (2020) · Journal of Molecular Structure · doi:10.1016/j.molstruc.2020.129735 · Cited by 11
Optimal granularity selection based on algorithm stability with application to attribute reduction in rough set theory
Gao, Y., Chen, D., & Wang, H. (2023) · Information Sciences · doi:10.1016/j.ins.2023.119845 · Cited by 11
Fast Multispectral Imaging by Spatial Pixel-Binning and Spectral Unmixing
Pan, Z., Shen, H., Li, C., Chen, S., & Xin, J. H. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2576401 · Cited by 11
A generalized stereotype learning approach and its instantiation in trust modeling
Fang, H., Zhang, J., & Şensoy, M. (2018) · Electronic Commerce Research and Applications · doi:10.1016/j.elerap.2018.06.004 · Cited by 11
Retrievals of phytoplankton community structures from in situ fluorescence measurements by HS-6P
Ling, Z., Sun, D., Wang, S., Qiu, Z., Huan, Y., Mao, Z., & He, Y. (2018) · Optics Express · doi:10.1364/oe.26.030556 · Cited by 11
Spatiotemporal interpolation of precipitation across Xinjiang, China using space-time CoKriging
Hu, D., & Shu, H. (2019) · Journal of Central South University · doi:10.1007/s11771-019-4039-1 · Cited by 11
Autonomous adaptive data acquisition for scanning hyperspectral imaging
Holman, E. A., Fang, Y.-S., Chen, L., DeWeese, M. R., Holman, H. N., & Sternberg, P. W. (2020) · Communications Biology · doi:10.1038/s42003-020-01385-3 · Cited by 11
One-button recognizer
Pohl, H., Krause, M., & Rohs, M. (2015) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2750858.2804270 · Cited by 11
Airborne imaging spectroscopy to monitor urban mosquito microhabitats
Thompson, D. R., Juárez, M. D. L. T., Barker, C. M., Holeman, J., Lundeen, S. R., Mulligan, S., Painter, T. H., Podest, E., Seidel, F. C., & Ustinov, E. A. (2013) · Remote Sensing of Environment · doi:10.1016/j.rse.2013.06.015 · Cited by 11
SUPPORT VECTOR MACHINES BASED ON THE ORTHOGONAL PROJECTION KERNEL OF FATHER WAVELET
Zhang, L., Zhou, W., & Jiao, L. (2005) · International Journal of Computational Intelligence and Applications · doi:10.1142/s1469026805001489 · Cited by 11
Graph-Dependent Implicit Regularisation for Distributed Stochastic Subgradient DescentPreprint
Richards, D., & Rebeschini, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.06958 · Cited by 11
Debiasing In-Sample Policy Performance for Small-Data, Large-Scale Optimization
Gupta, V., Huang, M., & Rusmevichientong, P. (2024) · Operations Research · doi:10.1287/opre.2022.2377 · Cited by 10
Fast, Robust and Interpretable Participant Contribution Estimation for Federated Learning
Wang, Y., Li, K., Luo, Y., Li, G., Guo, Y., & Wang, Z. (2024) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde60146.2024.00182 · Cited by 13
Predicting outcome of daycare cognitive behavioural therapy in a naturalistic sample of patients with PTSD: a machine learning approach
Stuke, H., Schoofs, N., Johanßen, H., Bermpohl, F., Ülsmann, D., Schulte‐Herbrüggen, O., & Priebe, K. (2021) · European Journal of Psychotraumatology · doi:10.1080/20008198.2021.1958471 · Cited by 12
Machine Learning Analysis of the Cerebrovascular Thrombi Lipidome in Acute Ischemic Stroke
Martha, S. R., Lévy, S., Federico, E. M., Levitt, M. R., & Walker, M. (2022) · Journal of Neuroscience Nursing · doi:10.1097/jnn.0000000000000682 · Cited by 10
Integrally private model selection for decision trees
Senavirathne, N., & Torra, V. (2019) · Computers & Security · doi:10.1016/j.cose.2019.01.006 · Cited by 10
Sensory-Motor Modulations of EEG Event-Related Potentials Reflect Walking-Related Macro-Affordances
Tosoni, A., Altomare, E. C., Brunetti, M., Croce, P., Zappasodi, F., & Committeri, G. (2021) · Brain Sciences · doi:10.3390/brainsci11111506 · Cited by 11
Estimation of maize plant height in North China by means of backscattering coefficient and depolarization parameters using Sentinel-1 dual-pol SAR data
Wang, Y., Fang, S., Zhao, L., & Huang, X. (2022) · International Journal of Remote Sensing · doi:10.1080/01431161.2022.2054294 · Cited by 10
An approach to guaranteeing generalisation in neural networks
Polhill, G. J., & Weir, M. K. (2001) · Neural Networks · doi:10.1016/s0893-6080(01)00061-2 · Cited by 10
Applying Landscape Metrics to Characterize Potential Habitat of Bonobos (Pan paniscus) in the Maringa-Lopori-Wamba Landscape, Democratic Republic of Congo
Hickey, J. R., Carroll, J. P., & Nibbelink, N. P. (2012) · International Journal of Primatology · doi:10.1007/s10764-012-9581-8 · Cited by 10
Rodent ultrasonic vocalizations as biomarkers of future alcohol use: A predictive analytic approach
Mittal, N., Maddox, W. T., Schallert, T. J., & Duvauchelle, C. L. (2017) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-017-0554-4 · Cited by 10
Leave Zero Out: Towards a No-Cross-Validation Approach for Model SelectionPreprint
Li, W., Geng, C., & Chen, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.13309 · Cited by 10
The Dataset Multiplicity Problem: How Unreliable Data Impacts Predictions
Meyer, A. P., Albarghouthi, A., & D’Antoni, L. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3593988 · Cited by 18
Identification of the optimal phenological periods for summer maize yield prediction using UAV-based multispectral data
Dai, Q. L., Chen, H., Chen, Z., Liu, C., Li, G., Wang, Y., & Hu, X. (2025) · Journal of Integrative Agriculture · doi:10.1016/j.jia.2025.02.026 · Cited by 9
Quantitative Mineralogy of Planetary Silicate Ternary Mixtures Using Raman Spectroscopy
Qi, X., Ling, Z., Liu, P., Chen, J., Cao, H., Liu, C., Wang, X., & Liu, Y. (2023) · Earth and Space Science · doi:10.1029/2023ea002825 · Cited by 9
Molecular Modeling Studies of Anti-Alzheimer Agents by QSAR, Molecular Docking and Molecular Dynamics Simulations Techniques
Abdizadeh, R., Hadizadeh, F., & Abdizadeh, T. (2019) · Medicinal Chemistry · doi:10.2174/1573406415666190806155619 · Cited by 9
A Data Stream Ensemble Assisted Multifactorial Evolutionary Algorithm for Offline Data-Driven Dynamic Optimization
Yang, C., Ding, J., Jin, Y., & Chai, T. (2023) · Evolutionary Computation · doi:10.1162/evco_a_00332 · Cited by 9
Stability and Deviation Optimal Risk Bounds with Convergence Rate $O(1/n)$
Klochkov, Y., & Zhivotovskiy, N. (2021) · Repository for Publications and Research Data (ETH Zurich) · doi:10.3929/ethz-b-000593979 · Cited by 9
Estimating generalization error using out-of-bag estimates
Bylander, T., & Hanzlik, D. (1999) · National Conference on Artificial Intelligence · Cited by 9
Learning finite-state machines: statistical and algorithmic aspects
Pigem, B., & de, B. (2013) · TDX (Tesis Doctorals en Xarxa) · Cited by 9
Phenotypic characterization of glioblastoma identified through shape descriptors
Chaddad, A., Desrosiers, C., & Toews, M. (2016) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2209121 · Cited by 8
Overview of QSAR Modelling in Rational Drug Design
(2012) · BENTHAM SCIENCE PUBLISHERS eBooks · doi:10.2174/978160805379711201010194 · Cited by 8
Kernel selection with spectral perturbation stability of kernel matrix
Liu, Y., & Liao, S. (2014) · Science China Information Sciences · doi:10.1007/s11432-014-5090-z · Cited by 8
Artificial neural networks reveal individual differences in metacognitive monitoring of memory
Zakrzewski, A. C., Wisniewski, M. G., Williams, H. L., & Berry, J. M. (2019) · PLoS ONE · doi:10.1371/journal.pone.0220526 · Cited by 8
Sequential testing in classifier evaluation yields biased estimates of effectiveness
Webber, W., Bagdouri, M., Lewis, D. D., & Oard, D. W. (2013) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/2484028.2484159 · Cited by 8
Slack Channels Ecology in Enterprises: How Employees Collaborate Through Group Chat.Preprint
Wang, D., Wang, H., Yu, M., Ashktorab, Z., & Tan, M. (2019) · arXiv (Cornell University) · Cited by 8
Optimization Attribute Reduction With Fuzzy Rough Sets Based on Algorithm Stability
Gao, Y., Chen, D., Wang, H., & Shi, R. (2023) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2023.3342621 · Cited by 7
Towards effective metamorphic testing by algorithm stability for linear classification programs
Yang, Y., Li, Z., Wang, H., Xu, C., & Ma, X. (2021) · Journal of Systems and Software · doi:10.1016/j.jss.2021.111012 · Cited by 7
Approximation Stability and Boosting
Gao, W., & Zhou, Z. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-16108-7_9 · Cited by 7
Classifying Bacterial Species using Computer Vision and Machine Learning
Vijaykumar, V. (2016) · International Journal of Computer Applications · doi:10.5120/ijca2016911851 · Cited by 7
Hydro-stochastic interpolation coupling with the Budyko approach for prediction of mean annual runoff
Qiu, N., Chen, X., Hu, Q., Liu, J., Huang, R., & Gao, M. K. (2018) · Hydrology and earth system sciences · doi:10.5194/hess-22-2891-2018 · Cited by 7
QSAR Modeling, Molecular Docking and Molecular Dynamics Simulations Studies of Lysine-Specific Demethylase 1 (LSD1) Inhibitors as Anticancer Agents
Abdizadeh, R., Heidarian, E., Hadizadeh, F., & Abdizadeh, T. (2020) · Anti-Cancer Agents in Medicinal Chemistry · doi:10.2174/1871520620666200721134010 · Cited by 7
Stand Volume Growth Modeling with Mixed-Effects Models and Quantile Regressions for Major Forest Types in the Eastern Daxing’an Mountains, Northeast China
Wang, T., Xie, L., Miao, Z., Widagdo, F. R. A., Dong, L., & Li, F. (2021) · Forests · doi:10.3390/f12081111 · Cited by 7
Modeling SQL Statement Correctness with Attention-Based Convolutional Neural Networks
Rivas, P., & Schwartz, D. R. (2021) · International Conference on Computational Science and Computational Intelligence (CSCI) · doi:10.1109/csci54926.2021.00086 · Cited by 7
Learning with kernel machine architectures
Evgeniou, T. (2000) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 7
Generalization Bounds of Regularization Algorithm with Gaussian Kernels
Cao, F., Liu, Y., & Zhang, W. (2013) · Neural Processing Letters · doi:10.1007/s11063-013-9298-5 · Cited by 6
Concentration inequalities of the cross-validation estimator for empirical risk minimizer
Cornec, M. (2017) · Statistics · doi:10.1080/02331888.2016.1261479 · Cited by 6
Discovering combinatorial interactions in survival data
duVerle, D. A., Takeuchi, I., Murakami‐Tonami, Y., Kadomatsu, K., & Tsuda, K. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt532 · Cited by 6
How Predictable Are Human Stratum Corneum Lipid/Water Partition Coefficients? Assessment and Useful Correlations for Dermal Absorption.
Nitsche, J., & Kasting, G. (2018) · Journal of Pharmacy and Science · doi:10.1016/j.xphs.2017.07.026 · Cited by 5
The Development of an Intelligent Monitoring System for Agricultural Inputs Basing on DBN-SOFTMAX
Yang, L., Babu, V. S., Zou, J., Cai, X. C., Wu, T., & Lin, L. (2018) · Journal of Sensors · doi:10.1155/2018/6025381 · Cited by 7
Predicting the Reliability Behavior of HPC Applications
Oliveira, D., Moreira, F. B., Rech, P., & Navaux, P. O. A. (2018) · International Symposium on Computer Architecture and High Performance Computing (SBAC-PAD) · doi:10.1109/cahpc.2018.8645856 · Cited by 7
Kernel Stability for Model Selection in Kernel-Based Algorithms
Liu, Y., Liao, S., Zhang, H., Ren, W., & Wang, W. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2019.2923824 · Cited by 6
Deep Learning Based Heart Rate Estimation Using Smart Shoes Sensor
Baek, S., Eom, H., Hariyani, Y. S., Kim, G. H., Roh, J., Kim, S., & Park, C. (2020) · IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia) · doi:10.1109/icce-asia49877.2020.9277334 · Cited by 6
Temporal pattern of acoustic imaging noise asymmetrically modulates activation in the auditory cortex
Ranaweera, R. D., Kwon, M., Hu, S., Tamer, G. G., Luh, W., & Talavage, T. M. (2015) · Hearing Research · doi:10.1016/j.heares.2015.09.017 · Cited by 6
Information-Theoretic Stability and Generalization
Raginsky, M., Rakhlin, A., & Xu, A. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108616799.011 · Cited by 6
Uniform convergence, stability and learnability for ranking problems
Gao, W., & Zhou, Z. (2013) · Cited by 6
Time series forecasting: model evaluation and selection using nonparametric risk boundsPreprint
McDonald, D. J., Shalizi, C. R., & Schervish, M. J. (2012) · RePEc: Research Papers in Economics · Cited by 6
Debiasing In-Sample Policy Performance for Small-Data, Large-Scale OptimizationPreprint
Gupta, V., Huang, M., & Rusmevichientong, P. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3858984 · Cited by 6
Single-Trial Decoding from Local Field Potential Using Bag of Word Representation
Parto-Dezfouli, M., & Daliri, M. R. (2019) · Brain Topography · doi:10.1007/s10548-019-00726-8 · Cited by 5
Local and whole-network topologies reveal that pulvinar and semantic hub interactions correlate with picture vocabulary
Liu, J., Cui, Z., & Li, L. (2020) · Neuroreport · doi:10.1097/wnr.0000000000001444 · Cited by 5
Heterogeneous Graph Neural Network-Based Software Developer Recommendation
Ye, Z., Feng, Z., Xiao, J., Gao, Y., Fan, G., Zhang, H., & Chen, S. (2022) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-031-24383-7_24 · Cited by 5
Generalization in Unsupervised Learning
Abou–Moustafa, K. T., & Schuurmans, D. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-23528-8_19 · Cited by 5
A finite-sample simulation study of cross validation in tree-based models
Kim, S. B., Huo, X., & Tsui, K. (2009) · Information Technology and Management · doi:10.1007/s10799-009-0052-7 · Cited by 5
Study on the agonists for the human Toll-like receptor-8 by molecular modeling
Deng, F., Ma, S., Xie, M., Zhang, X., Li, P., & Zhai, H. L. (2014) · Molecular BioSystems · doi:10.1039/c4mb00183d · Cited by 5
Generalization Error Bounds for Optimization Algorithms via Stability
Meng, Q., Wang, Y., Chen, W., Wang, T., Ma, Z.-M., & Liu, T. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10919 · Cited by 5
In silico studies of novel scaffold of thiazolidin-4-one derivatives as anti-Toxoplasma gondii agents by 2D/3D-QSAR, molecular docking, and molecular dynamics simulations
Abdizadeh, R., Hadizadeh, F., & Abdizadeh, T. (2020) · Structural Chemistry · doi:10.1007/s11224-019-01458-y · Cited by 5
CO2 Adsorptions on d-Block-Metal-Doped Nickel Nanoparticles: Unexpected Adsorption Configurations Predicted by Machine Intelligence
Lin, S., Teng, C., & Bao, J. L. (2021) · The Journal of Physical Chemistry C · doi:10.1021/acs.jpcc.1c07133 · Cited by 5
Learning distance functions for exemplar-based object recognition
Malik, J., & Frome, A. (2007) · Cited by 5
Bias-variance tradeoffs in program analysis
Sharma, R., Nori, A. V., & Aiken, A. (2014) · ACM SIGPLAN Notices · doi:10.1145/2578855.2535853 · Cited by 5
Secure Learning and Learning for Security: Research in the Intersection
Rubinstein, B. I. P. (2010) · eScholarship (California Digital Library) · Cited by 5
Similarity space projection for web image search and annotation
Liu, Y., Qin, T., Liu, T., Zhang, L., & Ma, W. (2005) · doi:10.1145/1101826.1101837 · Cited by 5
Probabilistic and on-line methods in machine learning
Kalai, A. T., & Blum, A. L. (2001) · Cited by 5
Study on the antagonists for the orphan G protein-coupled receptor GPR55 by quantitative structure–activity relationship
Deng, F., Xie, M., Li, P., Tian, Y., Zhang, X., & Zhai, H. L. (2014) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2013.12.006 · Cited by 4
Black-box tests for algorithmic stability
Kim, B., & Barber, R. F. (2023) · Information and Inference A Journal of the IMA · doi:10.1093/imaiai/iaad039 · Cited by 4
Combination of multiple methods and views for recognition, transportation, and structure-guided modification of lysine-specific demethylase phenylcyclopropylamine inhibitor
Liu, X., Zhang, Z., She, N., Zhai, J., Zhao, Y., & Wang, C. (2022) · Physical Chemistry Chemical Physics · doi:10.1039/d2cp01197b · Cited by 4
Fabrication of a Human Skin Mockup with a Multilayered Concentration Map of Pigment Components Using a UV Printer
Nagasawa, K., Yamamoto, S., Arai, W., Hakkaku, K., Koopipat, C., Hirai, K., & Tsumura, N. (2022) · Journal of Imaging · doi:10.3390/jimaging8030073 · Cited by 4
Non-contact fluorescent detection of pesticide residues based on segment prediction using PLS and a curve fitting algorithm
Cai, Y., & Bian, H. (2022) · Applied Optics · doi:10.1364/ao.456735 · Cited by 4
Cross-validation on extreme regions
Aghbalou, A., Bertail, P., Portier, F., & Sabourin, A. (2022) · Extremes · doi:10.1007/s10687-024-00495-z · Cited by 7
A Unified Information Extraction System Based on Role Recognition and Combination
Zhang, Y., & Lan, M. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-88483-3_36 · Cited by 4
Stability analysis for ranking with stationary φ -mixing samples
He, F., Zuo, L., & Chen, H. (2015) · Neurocomputing · doi:10.1016/j.neucom.2015.07.088 · Cited by 4
Penalized Likelihood Phenotyping: Unifying Voxelwise Analyses and Multi-Voxel Pattern Analyses in Neuroimaging
Adluru, N., Hanlon, B. M., Antoine Lutz, A., Lainhart, J. E., Alexander, A. L., & Davidson, R. J. (2013) · Neuroinformatics · doi:10.1007/s12021-012-9175-9 · Cited by 4
Research on motion recognition algorithm based on bag-of-words model
Huang, T., Ru, S.-R., Zeng, Z., & Zhang, L. (2019) · Microsystem Technologies · doi:10.1007/s00542-019-04462-8 · Cited by 4
Finger vein recognition algorithm under reduced field of view
Jin, J., Di, S., Li, W., Sun, X., & Wang, X. (2020) · IET Image Processing · doi:10.1049/ipr2.12075 · Cited by 4

Authors: Kearns, M., & Ron, D.
Affiliations: AT&T (United States) (US)
Tel Aviv University (IL)
ORCID: Kearns, Michael
Ron, Dana
Venue: Neural Computation
Publisher: MIT Press - Journals
Published: 1999-08-01
Volume: 11
Issue: 6
Pages: 1427-1453
ISSN: 0899-7667 (ISSN-L)
1530-888X
DOI: 10.1162/089976699300016304
OpenAlex: W2138263042
Cited by: 407
References: 18
Citations by year: 2026: 4 · 2025: 7 · 2024: 11 · 2023: 18 · 2022: 22 · 2021: 26 · 2020: 35 · 2019: 46 · 2018: 23 · 2017: 22 · 2016: 27 · 2015: 18 · 2014: 17 · 2013: 24 · 2012: 14
FWCI: 4.55
Type: journal article
Language: en
Open access: closed
Locations: Neural Computation (publishedVersion)
PubMed (publishedVersion)
Funders: National Science Foundation
Office of Naval Research
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
Keywords: leave-one-out cross-validation, generalization error estimation, algorithm stability, VC dimension, lower bounds
MeSH terms: Algorithms, Neural Networks, Computer

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Algorithmic Stability and Sanity-Check Bounds for Leave-One-Out Cross-Validation

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks