Overfitting and neural networks: conjugate gradient and backpropagation

Advances in neural information processing systems 7

(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,759

Neural Networks and the Bias/Variance Dilemma

Geman, S., Bienenstock, E., & Doursat, R. (1992) · Neural Computation · doi:10.1162/neco.1992.4.1.1 · Cited by 3,578

Untitled work

(1989) · Cited by 3,214

Advances in Neural Information Processing Systems 37

Touretzky, D. S. (2024) · doi:10.52202/079017 · Cited by 2,874

Advances in Neural Information Processing Systems 5

Zemel, R. S., Williams, C. K. I., & Mozer, M. C. (1993) · Cited by 1,896

What Size Net Gives Valid Generalization?

Baum, E. B., & Haussler, D. H. (1989) · Neural Computation · doi:10.1162/neco.1989.1.1.151 · Cited by 1,549

Untitled work

(1992) · Cited by 1,405

The Effective Number of Parameters: An Analysis of Generalization and Regularization in Nonlinear Learning Systems

Moody, J. E. (1991) · Cited by 437

For Valid Generalization the Size of the Weights is More Important than the Size of the Network

Bartlett, P. L. (1996) · Cited by 213

Note on Learning Rate Schedules for Stochastic Optimization

Darken, C. J., & Moody, J. E. (1990) · neural information processing systems · Cited by 133

Comparison of Land Use Land Cover Classification Using Sentinel-2 Images with Different Deep Learning Approaches

Jamadar, S., Agrawal, S., Sawant, S. T., Metha, A., & Joshi, A. D. (2025) · Advances in geographic information science · doi:10.1007/978-3-031-84698-4_13 · Cited by 1

Contrastive Forward-Forward: A training algorithm of vision transformer

Aghagolzadeh, H., & Ezoji, M. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107867 · Cited by 7

DeepFakesUG: Detecting Counterfeit Ugandan Banknotes Using Deep Learning

Azamuke, D., Bamwesigye, C. K., Katarahweire, M., Kamurasi, A. J., Businge, J. M., Ssozi, I., Mukisa, J. P., Lule, E., & Bainomugisha, E. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-05063-2_7 · Cited by 1

Physics-augmented neural networks for predicting nonlinear vibration energy harvesters

Barros, C. L. M. I., Barbosa, A., Teloli, R. D. O., Kacem, N., Bouhaddi, N., & Varoto, P. S. (2026) · Journal of the Brazilian Society of Mechanical Sciences and Engineering · doi:10.1007/s40430-026-06383-w · Cited by 1

Neural networks for the calibration of voltammetric data

Bessant, C., & Richards, E. C. M. (2003) · Data handling in science and technology · doi:10.1016/s0922-3487(03)23009-4 · Cited by 1

The feasibility of retrieving vertical temperature profiles from satellite nadir UV observations: A sensitivity analysis and an inversion experiment with neural network algorithms

Sellitto, P., & Frate, F. D. (2014) · Journal of Quantitative Spectroscopy and Radiative Transfer · doi:10.1016/j.jqsrt.2014.02.023 · Cited by 1

The FL-SMIA Network: A Novel Architecture for Time Series Prediction

Mahdi, A., Weyde, T., & Al‐Jumeily, D. (2017) · International Conference on Developments in eSystems Engineering (DeSE) · doi:10.1109/dese.2017.42 · Cited by 1

A Hybrid Approach to Mining Conditions

Gallego, F. O., & Corchuelo, R. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-92639-1_22 · Cited by 1

Uncertainty Quantification of the Metallic Microstructures with Analytical and Machine Learning Based Approaches

Hasan, M. M., & Acar, P. (2021) · AIAA SciTech Forum · doi:10.2514/6.2021-1360 · Cited by 1

Speech2Stroke: Generate Chinese Character Strokes Directly from Speech

Zhang, Y., Xi, W., Yang, Z., Men, S., Jiang, R., Yang, Y., & Zhao, J. (2021) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-030-67537-0_6 · Cited by 1

Machine Learning MOSA Monitoring System

Manjunath, A. G., Vrtagić, S., Doğan, F., Đorđević, M., Žarković, M., Kevrić, J., & Dobrić, G. (2021) · Instrumentation Mesure Métrologie · doi:10.18280/i2m.200404 · Cited by 1

Strawberries Maturity Level Detection Using Convolutional Neural Network (CNN) and Ensemble Method

Daşkın, Z. D., Khan, M. U., İrfanoğlu, B., & Alam, M. S. (2023) · Algorithms for intelligent systems · doi:10.1007/978-981-99-3754-7_10 · Cited by 1

Introducing Convolutional Channel-wise Goodness in Forward-Forward Learning

Papachristodoulou, A., Kyrkou, C., Timotheou, S., & Theocharides, T. (2023) · European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN) · doi:10.14428/esann/2023.es2023-121 · Cited by 1

Deep insight: Navigating the horizons of deep learning in applications, challenges, and future frontiers

Roshan, R., Rishi, O. P., & Sridevi, M. (2023) · Computing and artificial intelligence. · doi:10.59400/cai.v1i1.419 · Cited by 2

Optimal Training Positive Sample Size Determination for Deep Learning with a Validation on CBCT Image Caries Recognition

Wang, Y., Li, G., Zhang, X., Wang, Y., Zhang, Z., Li, J., Ma, J., & Wang, L. (2024) · Diagnostics · doi:10.3390/diagnostics14182080 · Cited by 1

BERT and Broad Learning for Textual Emotion Classification

Peng, S., & Cao, L. (2024) · Socio-affective computing · doi:10.1007/978-3-031-67718-2_2 · Cited by 1

Multilayer Feed-Forward Artificial Neural Network Integrated with Sensitivity Based Connection Pruning Method

Urolagin, S., Prema, K. V., Jayakrishna, R., & Reddy, N. V. S. (2012) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-642-35615-5_10 · Cited by 1

Character Feature Learning for Named Entity Recognition

Ping, Z. E. N. G., Tan, Q., Zhang, H., Meng, X., Zhang, Z. D., Xu, J., & Lei, Y. (2018) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2017kbl0001 · Cited by 1

ЗГОРТКОВА НЕЙРОМЕРЕЖА ДЛЯ ВИЯВЛЕННЯ ШАХРАЙСЬКИХ ОПЕРАЦІЙ З КРЕДИТНИМИ КАРТКАМИ

Корнієнко, О. В., & Субботин, С. А. (2019) · Automation technological and business processes · doi:10.15673/atbp.v11i3.1503 · Cited by 1

CAEN: A Deep Learning Approach to Mobile App Traffic Identification

Ding, L., Zhu, Y., Lin, W. Y., & Chen, Y. (2019) · International Conference on Computational Science and Computational Intelligence (CSCI) · doi:10.1109/csci49370.2019.00206 · Cited by 1

Federated Learning-Based IDS Against Poisoning Attacks

Xu, M., & Li, X. (2022) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-030-96791-8_25 · Cited by 1

Blockchain and Machine Learning as Deep Reinforcement

Mahdi, H. S. (2023) · Wasit Journal of Computer and Mathematics Science · doi:10.31185/wjcm.103 · Cited by 1

A Car-Steering Model Based on an Adaptive Neuro-Fuzzy Controller

Amor, M. A. B., Oda, T., & Watanabe, S. (2004) · IEEJ Transactions on Electronics Information and Systems · doi:10.1541/ieejeiss.124.2344 · Cited by 1

Applications of neural networks in market risk

Mostafa, F. (2011) · eSpace (Curtin University) · Cited by 1

Deep Recurrent Neural Network and Point Process Filter Approaches in Multidimensional Neural Decoding ProblemsPreprint

Rezaei, M. R., Nazari, B., Sadri, S., & Yousefi, A. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.08.10.244368 · Cited by 1

A Fast MLP-based Learning Method and its Application to Mine Countermeasure Missions

Shao, H. (2012) · uO Research (University of Ottawa) · doi:10.20381/ruor-6204

Towards the Learning Behaviour and Performance of Artificial Neural Networks in Production Control

Scholz‐Reiter, B., & Harjes, F. (2013) · Lecture notes in logistics · doi:10.1007/978-3-642-35966-8_39

Problem Decomposition and Adaptation in Cooperative Neuro-Evolution

Chandra, R. (2012) · doi:10.26686/wgtn.16996780 · Cited by 5

Elastic Learning Rate on Error Backpropagation of Online Update

Lee, T., & Choi, H.-J. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-28633-2_30

Single-Layer Neural Net Competes with Multi-layer Neural Net

Yang, Z. R. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-88906-9_65

Breast Lesions Segmentation in Dynamic Contrast-Enhanced MR Images

Bouchefra, H. (2015) · Utrecht University Repository (Utrecht University)

A Generic Artificial Neural Network Model for Short Term Predictions of Algal Blooms in Lakes and Reservoirs

Wilson, H., & Recknagel, F. (2003) · Springer eBooks · doi:10.1007/978-3-662-05150-4_14

On Interference of Signals and Generalization in Feedforward Neural NetworksPreprint

Rataj, A. (2003) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0310009

Improved version of hybrid neural-genetic algorithm to increase the efficiency of neural network

Garg, B. R., & Beriwal, N. (2010) · International Conference & Workshop on Emerging Trends in Technology · doi:10.1145/1741906.1742030

Outlier Treatment for SLFNs in Classification

Huynh, H. T., Nguyen, H.-T., Hoang, M.-T. T., & Won, Y. (2007) · International Conference on Computational Science and Its Applications · doi:10.1109/iccsa.2007.52

Using the optimization layer-by-layer learning algorithm on local-recurrent-global-feedforward networks in financial time series predictions

Lu, J. F., & Ohta, H. (2002) · International Journal of Systems Science · doi:10.1080/0020772021000046298

Correlation with the hermite series using artific ial neural network technology

Mackenzie, M. R. (2004) · Research Online (University of Wollongong)

Optimization of Usability on an Authentication System Built from Voice and Neural Networks

Lee, T., & Hwang, B.-W. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-24767-8_40

Electromagnetic non‐destructive evaluation by vector finite‐element neural networks

Salameh, M. S. H. A., & Taha, S. I. (2010) · International Journal of Numerical Modelling Electronic Networks Devices and Fields · doi:10.1002/jnm.766

$1HZ(DUO\6WRSSLQJ$OJRULWKPIRU,PSURYLQJ1HXUDO1HWZRUN *HQHUDOL)DWLRQ

Wu, X., & Liu, J. (2009)

COMPUTER SCIENCE | RESEARCH ARTICLE The performance of immune-based neural network with financial time series prediction

Al‐Jumeily, D., & Hussain, A. J. (2015)

Adaptive Multi-agent-based Alert System for Diseases’ Detection

Selmi, I., Kabachi, N., Lamine, S. B. A. B., Ghedira-Guegan, C., & Zghal, H. B. (2020) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-44041-1_65

Comparing Unsupervised Layers in Neural Networks for Financial Time Series Prediction

Mahdi, A., Weyde, T., & Al‐Jumeily, D. (2019) · International Conference on Developments in eSystems Engineering (DeSE) · doi:10.1109/dese.2019.00034

Short-Term Load Forecasting Using Long Short-Term Memory Based on EVN NLDC Data

Tuyen, N.-D., Nguyen‐Duc, H., Nguyen-Thi, N.-A., Trinh-Tuan, T., Le-Hai, T., & Son, H. V. X. (2020) · Journal of Measurement Control and Automation

Epsilon Consistent Mixup: Structural regularization with an adaptive consistency‐interpolation trade‐off

Pisztora, V., Ou, Y., Huang, X., Chiaromonte, F., & Li, J. (2021) · Stat · doi:10.1002/sta4.425

Fusing Part‐of‐Speech Information in Low‐Resource Neural Paraphrase Generation

Chi, X., & Xiang, Y. (2021) · Computational Intelligence and Neuroscience · doi:10.1155/2021/9022193

Analysis of fat mass value, clinical and metabolic data and interleukin-6 in HIV-positive males using regression analyses and artificial neural network

Shamsuddin, N. F., Mohktar, M. S., Rajasuriar, R., Zaman, S. W. K., Ibrahim, F., & Kamarulzaman, A. (2022) · Acta Scientiarum. Technology/Acta scientiarum. Technology · doi:10.4025/actascitechnol.v44i1.57634

A landmark building detection and recognition based on improved Faster R-RDN algorithm

Wu, J., Yan, K., Huang, Z., Tan, H., Tu, X., & Zhu, C. (2022) · International Conference on Algorithms, Microchips, and Network Applications (AMNA) · doi:10.1117/12.2636502

Peer Review #1 of "3D texture-based face recognition system using fine-tuned deep residual networks (v0.1)"

(2019) · PeerJ Computer Science · doi:10.7287/peerj-cs.236v0.1/reviews/1

Peer Review #2 of "3D texture-based face recognition system using fine-tuned deep residual networks (v0.1)"

(2019) · PeerJ Computer Science · doi:10.7287/peerj-cs.236v0.1/reviews/2

Re-configurable, expandable, and cost-effective heterogeneous FPGA cluster approach for resource-constrained data analysis

Rupanetti, D., SALAMY, H. A., Min, C.-H., & Nepal, K. (2022) · International Journal of Parallel Emergent and Distributed Systems · doi:10.1080/17445760.2022.2085703

Transformer-Based Medical Abbreviation Disambiguation—A Comparative Study

Pałczyński, K., Czyżewska, M., Gackowska, M., Ledziński, D., & Andrysiak, T. (2023) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-981-99-1767-9_66

Application of Artificial Intelligence to Identify Electric Meter Tariffs

Đurić, A., & Selakov, A. (2023) · doi:10.1109/powertech55446.2023.10202718

Introduction

Yan, W. Q. (2023) · Texts in computer science · doi:10.1007/978-981-99-4823-9_1

RESEARCH ON THE APPLICATION OF ARTIFICIAL INTELLIGENCE TECHNIQUES IN PRICE FORECASTING OF SOME COMMODITIES

Son, N. T. (2023) · Vinh University Journal of Science · doi:10.56824/vujs.2023a082

Comparative Analysis of Life Expectancy Prediction for IGBT with Neural Network and Noise Data

Shterev, V. A., Dimitrov, K. L., & Nenova, M. (2023) · Junior Conference on Lighting (Lighting) · doi:10.1109/lighting59819.2023.10299415

Вплив зменшення розмірів нейронної мережі на її здатність до узагальнення

Паладієв, О., & Лісовиченко, О. (2023) · Адаптивні системи автоматичного управління · doi:10.20535/1560-8956.43.2023.292262

Dự báo hoạt động ngân hàng bằng thuật toán rừng ngẫu nhiên

Quang, H. Đ. (2024) · Tạp chí Kinh tế và Phát triển · doi:10.33301/jed.vi.1426

Intelligent Fault Detection Scheme for Rolling Bearing Based on Generative Adversarial Network and AutoEncoders Using Convolutional Neural Network

Rathore, M. S., & Harsha, S. P. (2024) · Mechanisms and machine science · doi:10.1007/978-981-99-8986-7_9

Effect of PolyLoss Function on Steel Defect Detection

Aşar, E., & Özgür, A. (2024) · Engineering materials · doi:10.1007/978-3-031-57468-9_8

Integração de dados transcriptômicos e metabolômicos de cana-de-açúcar (Saccharum spp.) por métodos de machine learning para predição fenotípica

Patrício, A. L. (2024) · doi:10.11606/d.11.2024.tde-02082024-092421

Fast Prediction of Backscattering Coefficient for Cement Ground Based on Multi-Strategy Optimized PSO-LSSVR Model

Liu, Y., Dong, C., Meng, X., & Guo, L. (2024) · IEEE International Geoscience and Remote Sensing Symposium (IGARSS) · doi:10.1109/igarss53475.2024.10642262

CNN-based automatic classification of stuttering: Detection of repetitions and prolongations in stuttered speech

Park, J., & Lee, C. G. (2024) · Phonetics and Speech Sciences · doi:10.13064/ksss.2024.16.4.063

VoteGAN: Generalized Membership Inference Attack Against Generative Models by Multiple Discriminators

Lim, G., Oh, W., & Hur, J. (2025) · Lecture notes in computer science · doi:10.1007/978-981-96-1624-4_6

Robustness and generalisation study of a new regression-based neural network method for capacitors in power electronics

Vorobev, C., Vahle, D., & Staudt, V. (2025) · e-Prime - Advances in Electrical Engineering Electronics and Energy · doi:10.1016/j.prime.2025.100956

High-Precision Method to Reduce Overfitting in ANNs Using Highly Uniform Chaotic Sequences

Shirzadeh, S., Ferens, K., & Kinsner, W. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-85628-0_1

CTr2L: A Novel Carbon Trading Transfer Learning Framework for the Price Volatility Forecasting

Hao, J., Bao, X., Guan, S., & Jiang, G. (2025) · Journal of Systems Science and Systems Engineering · doi:10.1007/s11518-025-5668-6

Symmetry-Aware Sequential Recommendation with Dual-Domain Filtering Networks

Li, L., Du, Y., & Wang, Y. (2025) · Symmetry · doi:10.3390/sym17060813

Enhancing Image Style Transfer with PAIN-GAN: A Dual-Stream Encoder Incorporating GAN

Sethi, A., Singh, R., Neha, Pardhi, K., Saini, K., Tiwari, A., Saurav, S., & Singh, S. K. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-6975-2_11

Multimodal Osteoporosis Image Classification Algorithm Based on Textual Prompts

Yang, P., Chen, Y., Liang, J., & Nie, R. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-9949-0_5

Effective Denoising in Music-Present Pubs with Efficient Channel Attention

Ha, S., Wu, Y., & Li, W. (2025) · Lecture notes in electrical engineering · doi:10.1007/978-981-96-4783-5_7

BeautyClicker : Modeling Viewers’ Click Intent of the Cover Image to Support Drafts of Beauty Product Promotion Posts

Lin, X., Chen, X., & Peng, Z. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2531291

Enhancing Training Efficiency of Physics-Informed Neural Networks for CFD Simulations

Pham, P., Spandan, V., Servadei, L., & Wille, R. (2025) · Lecture notes in networks and systems · doi:10.1007/978-3-031-94892-3_1

179Injecting uniform chaotic sequences into an ANN’s learning fabric to reduce overfitting

Shirzadeh, S., Ferens, K., & Kinsner, W. (2025) · De Gruyter eBooks · doi:10.1515/9783111436548-008

A New Pseudo-Hierarchical Neural Network for Pattern Classification

Murugesan, S., & Ginige, A. (2002)

Testing the Generalization of Feedforward Neural Networks with Median Neuron Input Function

Rusiecki, A. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-38658-9_16

Dealing with Bias and Variance

Islam, T. (2025) · Springer eBooks · doi:10.1007/978-3-032-00488-8_4

3SD: Rotational symmetry single‐shot denoising in fluorescence microscopy

de Wolf, T. H., Engbers, P. A. M., Perrin, J., Nonnekens, J., & Smal, I. (2026) · Journal of Microscopy · doi:10.1111/jmi.70062

A multi-directional extreme wind speeds model based on multi-site temporal correlations

Zhang, M., Wang, H., Zhuang, S., Yan, T., & Zhang, J. (2026) · Probabilistic Engineering Mechanics · doi:10.1016/j.probengmech.2026.103897

HelBERT: A BERT-Based Pretraining Model for Public Procurement Tasks in Portuguese

Lima, W. E. M., Silva, V. R. D., da Silva, J. C., Rabêlo, R. A. L., & de Paiva, A. C. (2026) · Journal of the Brazilian Computer Society · doi:10.5753/jbcs.2026.5511

Influence of Graphical Representation Type on Tessellated Geometry Classification

Majchrzak, M., Marciniak-Łukasiak, K., Jakubowski, M., & Łukasiak, P. (2026) · Foundations of Computing and Decision Sciences · doi:10.2478/fcds-2026-0004

Détection, anticipation, action face aux risques dans les bâtiments connectés

Legrand, A. (2019) · theses.fr (ABES) · doi:10.70675/d82beb9bzd72fz444cz96c6z1e2ebbb7b347

RRAM co-integration with OTS-based back-end selector : from devices to applications

Lopez, J. M. (2022) · theses.fr (ABES) · doi:10.70675/197a0071z4b82z48fdzad97zce487a71c1af

Suivi de la naissance et de l'évolution du contenu myélinique dans les lésions de Sclérose En Plaques à l’aide d’approches d’apprentissage profond avec aprioris biomédicaux et des techniques d'imagerie avancée

Soulier, T. (2024) · theses.fr (ABES) · doi:10.70675/355d9298z744bz4514zaed4z3848351f921c

Robust watermarking for neural networks in multimedia tasks

Trias, C. D. S. (2025) · theses.fr (ABES) · doi:10.70675/875f9c2bz2068z460ez907bzdbe2b7d8453f

Chilli Plant Disease Detection Using Convolutional Neural Network with EfficientNet in Deep Learning

Ankitha, P. S., Kranthi, S., Nasaraiah, P., & Sowjanya, P. (2026) · Smart innovation, systems and technologies · doi:10.1007/978-3-032-18849-6_41

GruMambaRec: a sequential recommendation system combining GRU and Mamba

Huang, Y., Mo, X., Zhang, X., Xie, C., Liu, J., & Gao, Z. (2026) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-026-03244-9

Data Augmentation of Semiconductor Defect Images for SEM-ADC

KONDO, N., Harada, M., & Miyamoto, A. (2026) · Journal of the Japan Society for Precision Engineering · doi:10.2493/jjspe.92.654

Channel learning and enhanced adaptive reconstruction for robust image transmission over complex time varying wireless channels

Pan, H., Zu, T., Wang, L., Wu, S., & He, X. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-02499-z

Robust Complex Signal Classification for Advanced Software-Defined Radio and Sensing

Joojili, N. N., Ndedi, J. Y. M., Li, Q., YAGOUB, M. C. E., & Huang, J. S. (2026) · Lecture notes in networks and systems · doi:10.1007/978-3-032-34564-6_4

Lessons in neural network training: overfitting may be harder than expected

Lawrence, S., Giles, C. L., & Tsoi, A. C. (1997) · Cited by 242

Overfitting in Neural Nets: Backpropagation, Conjugate Gradient, and Early Stopping

Caruana, R., Lawrence, S., & Giles, C. L. (2000) · Cited by 906

A study of the generalization capability versus training in backpropagation neural networks

Dalianis, P. J., Tzafestaş, S. G., & Anthopoulos, G. (2002) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.1993.390760 · Cited by 10

An analysis of underfitting in MLP networks

Narayan, S., & Tagliarini, G. A. (2006) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2005.1555986 · Cited by 20

Comparison of Backpropagation and Conjugate Gradient Algorithms for Efficient Training of Multilayer Perceptron Networks

Miao, G. (2002) · SHAREOK (University of Oklahoma; Oklahoma State University; Central Oklahoma University)