Overfitting problem and the over-training in the era of data: Particularly for Artificial Neural Networks
Abstract
When we try to classify a set of data or to create a model to a cloud of points, different techniques can be used. Among them, Artificial Neural Networks are nowadays reinvented with the peak of the Machine Learning, Big Data, etc. In the process to find the best classification and be sure on it, one of the biggest concerns that we can come up against is the problem of overfitting. In this paper, we analyze it and set out a case study.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Cascade R-CNN has proven capable of overcoming challenges including overtraining problems and false alarm distribution caused by the patches' proposal stage.
“This framework has proven its capability in overcoming some of the main challenges of object detection, including overtraining problems [5, 6] and false alarm distribution caused by the patches’ proposal stage.”
From A survey on deep multimodal learning for computer vision: advances, trends, applications, and datasets (2022) · cites this paper as [6]
Cites
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333 · see citing works
(2014) · Cited by 33,419 · see citing works
A Review on Multi-Label Learning Algorithms
Zhang, M.-L., & Zhou, Z. (2013) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2013.39 · Cited by 3,336 · see citing works
Fei-Fei, L., Fergus, R., & Perona, P. (2007) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2005.09.012 · Cited by 2,359 · see citing works
Tsoumakas, G., Katakis, I., & Vlahavas, I. P. (2009) · Springer eBooks · doi:10.1007/978-0-387-09823-4_34 · Cited by 1,466 · see citing works
Knowledge Discovery in Multi-label Phenotype Data
Clare, A. J., & King, R. D. (2001) · Lecture notes in computer science · doi:10.1007/3-540-44794-6_4 · Cited by 734 · see citing works
Theory of Classification: a Survey of Some Recent Advances
Boucheron, S., Bousquet, O., & Lugosi, G. (2005) · ESAIM Probability and Statistics · doi:10.1051/ps:2005018 · Cited by 442 · see citing works
Artificial Neural Networks for Modelling and Control of Non-Linear Systems
Suykens, J. A. K., Vandewalle, J. P. L., & Moor, B. L. R. D. (1996) · Springer eBooks · doi:10.1007/978-1-4757-2493-6 · Cited by 413 · see citing works
Tree ensembles for predicting structured outputs
Kocev, D., Vens, C., Struyf, J., & Džeroski, S. (2012) · Pattern Recognition · doi:10.1016/j.patcog.2012.09.023 · Cited by 279 · see citing works
A Framework for Decision Fusion in Image Forensics Based on Dempster–Shafer Theory of Evidence
Fontani, M., Bianchi, T., Rosa, A. D., Piva, A., & Barni, M. (2013) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2013.2248727 · Cited by 124 · see citing works
Multi-label classification with Bayesian network-based chain classifiers
Sucar, L. E., Bielza, C., Morales, E. F., et al. (2013) · Pattern Recognition Letters · doi:10.1016/j.patrec.2013.11.007 · Cited by 102 · see citing works
Baghaee, H. R., Mirsalim, M., Gharehpetian, G. B., & Talebi, H. A. (2016) · Simulation Modelling Practice and Theory · doi:10.1016/j.simpat.2016.12.006 · Cited by 102 · see citing works
Multi-label classification via multi-target regression on data streams
Osojnik, A., Panov, P., & Džeroski, S. (2016) · Machine Learning · doi:10.1007/s10994-016-5613-5 · Cited by 76 · see citing works
Editing training data for multi-label classification with the k-nearest neighbor rule
Kanj, S., Abdallah, F., Denœux, T., et al. (2015) · Pattern Analysis and Applications · doi:10.1007/s10044-015-0452-8 · Cited by 63 · see citing works
Overfitting Reduction of Text Classification Based on AdaBELM
Feng, X., Liang, Y., Shi, X., Xu, D. H., Wang, X., & Guan, R. (2017) · Entropy · doi:10.3390/e19070330 · Cited by 32 · see citing works
Cerri, R., Pappa, G. L., de Carvalho, A. C. P. L. F., & Freitas, A. A. (2013) · Computational Intelligence · doi:10.1111/coin.12011 · Cited by 31 · see citing works
Towards a method for automatically selecting and configuring multi-label classification algorithms
de Sá, A. G. C., Pappa, G. L., & Freitas, A. A. (2017) · Genetic and Evolutionary Computation Conference Companion (GECCO Companion) · doi:10.1145/3067695.3082053 · Cited by 21 · see citing works
Load Flow Analysis of Distribution System Using Artificial Neural Networks
Suresh, M., Sirish, T. S., Subhashini, T. V., et al. (2017) · Advances in intelligent systems and computing · doi:10.1007/978-981-10-3153-3_51 · Cited by 8 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Bayoudh, K., Knani, R., Hamdaoui, F., & Mtibaa, A. (2022) · The Visual Computer · doi:10.1007/s00371-021-02166-7 · Cited by 456 · see citing works
Toward Reliable Compact Modeling of Multilevel 1T-1R RRAM Devices for Neuromorphic Systems
Pérez-Bosch Quesada, E., Romero-Zaliz, R., Pérez, E., Kalishettyhalli Mahadevaiah, M., Reuben, J., Schubert, M. A., Jiménez-Molinos, F., Roldán, J. B., & Wenger, C. (2021) · Electronics · doi:10.3390/electronics10060645 · Cited by 54 · see citing works
- Authors
- Bilbao, I., & Bilbao, J.
- Affiliations
- University of the Basque Country (ES)
- Venue
- 2017 Eighth International Conference on Intelligent Computing and Information Systems (ICICIS)
- Publisher
- IEEE
- Published
- 2017-12
- Pages
- 173-177
- OpenAlex
- W2782730293
- Cited by
- 109
- References
- 18
- Citations by year
- 2026: 2 · 2025: 14 · 2024: 7 · 2023: 31 · 2022: 14 · 2021: 21 · 2020: 13 · 2019: 6 · 2018: 1
- FWCI
- 2.49
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Intelligent Computing and Information Systems (ICICIS) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Keywords
- overfitting, overtraining, artificial neural networks, big data, classification, model generalization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review