The DOI matches its Crossref record; 193 of the 193 references it cites were found in a registry or an index.
A systematic review on overfitting control in shallow and deep neural networks
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
(2014) · Cited by 33,419
(2008) · Journal of Machine Learning Research · Cited by 33,051
MobileNetV2: Inverted Residuals and Linear Bottlenecks
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00474 · Cited by 28,755
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Labaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Nonlinear Dimensionality Reduction by Locally Linear Embedding
Roweis, S. T., & Saul, L. K. (2000) · Science · doi:10.1126/science.290.5500.2323 · Cited by 14,965
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
(2010) · Cited by 14,134
(2010) · International Conference on Machine Learning · Cited by 13,995
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Conditional Generative Adversarial Nets
Mirza, M., & Osindero, S. (2014) · arXiv · doi:10.48550/arxiv.1411.1784 · Cited by 8,863
Learning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542
(2012) · Cited by 8,009
Laplacian Eigenmaps for Dimensionality Reduction and Data Representation
Belkin, M., & Niyogi, P. (2003) · Neural Computation · doi:10.1162/089976603321780317 · Cited by 7,621
Zagoruyko, S., & Komodakis, N. (2016) · Procedings of the British Machine Vision Conference 2016 · doi:10.5244/c.30.87 · Cited by 7,244
Practical Bayesian Optimization of Machine Learning Algorithms
Snoek, J., Larochelle, H., & Adams, R. P. (2012) · arXiv · doi:10.48550/arxiv.1206.2944 · Cited by 6,691
Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation
Powers, D. M. W. (2020) · arXiv · doi:10.48550/arxiv.2010.16061 · Cited by 5,440
An overview of gradient descent optimization algorithms
Ruder, S. (2016) · arXiv · doi:10.48550/arxiv.1609.04747 · Cited by 4,962
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)
Clevert, D.-A., Unterthiner, T., & Hochreiter, S. (2015) · arXiv · doi:10.48550/arxiv.1511.07289 · Cited by 4,513 · cited 2×
“For online learning, the methods proposed in Clevert et al. (2016), Ba et al. (2016), Ioffe and Szegedy (2015), Bejani and Ghatee (2020b), Bejani and Ghatee (2020a) are useful.”
MethodLaplacian Eigenmaps and Spectral Techniques for Embedding and Clustering
Belkin, M., & Niyogi, P. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0080 · Cited by 4,412
Neural Architecture Search with Reinforcement Learning
Zoph, B., & Le, Q. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01578 · Cited by 3,974
(2006) · Cited by 3,624
Random Erasing Data Augmentation
Zhong, Z., Zheng, L., Kang, G., Li, S., & Yang, Y. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.7000 · Cited by 3,617
Random Erasing Data Augmentation
Zhong, Z., Zheng, L., Kang, G., Li, S., & Yang, Y. (2017) · arXiv · doi:10.48550/arxiv.1708.04896 · Cited by 3,617 · cited 1×
“…approach, the weights of Taylor and Nitschke (2018) Using geometric and photometric techniques to transform the shapes and shifting their pixels Zhong et al. (2020) Exchanging a random region of the input with some noise Cubuk et al. (2019) Using the reinforcement learning to learn the…”
MethodWu, Y., & He, K. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01198-w · Cited by 3,601
Neural Networks and the Bias/Variance Dilemma
Geman, S., Bienenstock, E., & Doursat, R. (1992) · Neural Computation · doi:10.1162/neco.1992.4.1.1 · Cited by 3,578
5th International Conference on Learning Representations (ICLR 17)
Havrylov, S., & Titov, I. (2017) · Cited by 3,503
Spectral Normalization for Generative Adversarial Networks
Miyato, T., Kataoka, T., Koyama, M., & Yoshida, Y. (2018) · arXiv · doi:10.48550/arxiv.1802.05957 · Cited by 3,438
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 3,416
Evolving Neural Networks through Augmenting Topologies
Stanley, K. O., & Miikkulainen, R. (2002) · Evolutionary Computation · doi:10.1162/106365602320169811 · Cited by 3,258
A survey of deep neural network architectures and their applications
Liu, W., Wang, Z., Liu, X., Zeng, N., Liu, Y., & Alsaadi, F. E. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.12.038 · Cited by 3,239
(1989) · Cited by 3,214
On the Uniform Convergence of Relative Frequencies of Events to Their Probabilities
Vapnik, V. N., & Chervonenkis, A. Y. (2015) · Measures of Complexity · doi:10.1007/978-3-319-21852-6_3 · Cited by 3,105
Long short-term memory recurrent neural network architectures for large scale acoustic modeling
Sak, H., Senior, A., & Beaufays, F. (2014) · Interspeech 2014 · doi:10.21437/interspeech.2014-80 · Cited by 2,973
Convergence Results for Neural Networks via Electrodynamics
Panigrahy, R., Rahimi, A., Sachdeva, S., & Zhang, Q. (2018) · Leibniz international proceedings in informatics · doi:10.4230/lipics.itcs.2018.22 · Cited by 2,761
AutoAugment: Learning Augmentation Strategies From Data
Cubuk, E. D., Zoph, B., Mané, D., Vasudevan, V., & Le, Q. V. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00020 · Cited by 2,733
Channel Pruning for Accelerating Very Deep Neural Networks
He, Y., Zhang, X., & Sun, J. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.155 · Cited by 2,647 · cited 1×
“Meanwhile, to construct a network, a subset of network parameters can be optimized, but it is an NP-hard problem (He et al. 2017).”
BackgroundWhy Does Unsupervised Pre-training Help Deep Learning?
Erhan, D., Bengio, Y., Courville, A. C., Manzagol, P.-A., Vincent, P., & Samy Bengio, A. (2010) · Journal of Machine Learning Research · Cited by 2,631
Hawkins, D. M. (2004) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci0342472 · Cited by 2,522
The Effectiveness of Data Augmentation in Image Classification using Deep Learning
Perez, L., & Wang, J. (2017) · arXiv · doi:10.48550/arxiv.1712.04621 · Cited by 2,499
Acquiring linear subspaces for face recognition under variable lighting
Lee, K.-C., Ho, J., & Kriegman, D. J. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.92 · Cited by 2,391
The Cascade-Correlation learning architecture
Fahlman, S. E., & Lebiere, C. J. (2018) · doi:10.1184/r1/6610403 · Cited by 2,372
Empirical Evaluation of Rectified Activations in Convolutional Network
Xu, B., Wang, N., Chen, T., & Li, M. (2015) · arXiv · doi:10.48550/arxiv.1505.00853 · Cited by 2,264 · cited 1×
“The extensions of this activation function have been also used for regularization, see (Clevert et al. 2016; Xu et al. 2015; He et al. 2015; Jie et al. 2020).”
MethodEstimation of Dependences Based on Empirical Data
Vapnik, V. (2006) · Information Science and Statistics · doi:10.1007/0-387-34239-7 · Cited by 2,238
(2013) · Cited by 2,056
(2010) · doi:10.5555/1756006.1859921 · Cited by 1,924
ThiNet: A Filter Level Pruning Method for Deep Neural Network Compression
Luo, J.-H., Wu, J., & Lin, W. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.541 · Cited by 1,832
Data-Driven Intelligent Transportation Systems: A Survey
Zhang, J., Wang, F.-Y., Wang, K., Lin, W.-H., Xu, X., & Chen, C. (2011) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2011.2158001 · Cited by 1,817
Boosting for transfer learning
Dai, W., Yang, Q., Xue, G.-R., & Yu, Y. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273521 · Cited by 1,724
Reed, R. (1993) · IEEE Transactions on Neural Networks · doi:10.1109/72.248452 · Cited by 1,708
Data augmentation for improving deep learning in image classification problem
Mikolajczyk, A., & Grochowski, M. (2018) · 2018 International Interdisciplinary PhD Workshop (IIPhDW) · doi:10.1109/iiphdw.2018.8388338 · Cited by 1,697
Advances in Neural Information Processing Systems 19 (NIPS 2006)
Simonotto, E., Whalley, H. C., Lawrie, S. M., Murray, L. M., McGonigle, D. J., & Storkey, A. (2006) · Cited by 1,651
Road crack detection using deep convolutional neural network
Zhang, L., Yang, F., Daniel Zhang, Y., & Zhu, Y. J. (2016) · 2016 IEEE International Conference on Image Processing (ICIP) · doi:10.1109/icip.2016.7533052 · Cited by 1,496
Feurer, M., & Hutter, F. (2019) · The Springer Series on Challenges in Machine Learning · doi:10.1007/978-3-030-05318-5_1 · Cited by 1,414
Ma, X., Dai, Z., He, Z., Ma, J., Wang, Y., & Wang, Y. (2017) · Sensors · doi:10.3390/s17040818 · Cited by 1,409
Deep Convolutional Neural Networks and Data Augmentation for Environmental Sound Classification
Salamon, J., & Bello, J. P. (2017) · IEEE Signal Processing Letters · doi:10.1109/lsp.2017.2657381 · Cited by 1,364
Regularization Theory and Neural Networks Architectures
Girosi, F., Jones, M., & Poggio, T. (1995) · Neural Computation · doi:10.1162/neco.1995.7.2.219 · Cited by 1,349
Training with Noise is Equivalent to Tikhonov Regularization
Bishop, C. M. (1995) · Neural Computation · doi:10.1162/neco.1995.7.1.108 · Cited by 1,325
LeCun, Y. A., Bottou, L., Orr, G. B., & Müller, K.-R. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_3 · Cited by 1,264
A survey on deep learning for big data
Zhang, Q., Yang, L. T., Chen, Z., & Li, P. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.10.006 · Cited by 1,226
Tikhonov Regularization and Total Least Squares
Golub, G. H., Hansen, P. C., & O'Leary, D. P. (1999) · SIAM Journal on Matrix Analysis and Applications · doi:10.1137/s0895479897326432 · Cited by 1,029
Learning Spatial-Temporal Regularized Correlation Filters for Visual Tracking
Li, F., Tian, C., Zuo, W., Zhang, L., & Yang, M.-H. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00515 · Cited by 935
Overfitting in Neural Nets: Backpropagation, Conjugate Gradient, and Early Stopping
Caruana, R., Lawrence, S., & Giles, C. L. (2000) · Cited by 906
Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks
Salimans, T., & Kingma, D. P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.07868 · Cited by 883
Cheng, Y., Wang, D., Zhou, P., & Zhang, T. (2018) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2765695 · Cited by 817
Improving Deep Learning with Generic Data Augmentation
Taylor, L., & Nitschke, G. (2018) · 2018 IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci.2018.8628742 · Cited by 796
NISP: Pruning Networks Using Neuron Importance Score Propagation
Yu, R., Li, A., Chen, C.-F., Lai, J.-H., Morariu, V. I., Han, X., Gao, M., Lin, C.-Y., & Davis, L. S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00958 · Cited by 794
Overfitting and undercomputing in machine learning
Dietterich, T. (1995) · ACM Computing Surveys · doi:10.1145/212094.212114 · Cited by 757
Lippi, M., Bertini, M., & Frasconi, P. (2013) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2013.2247040 · Cited by 747
Data Augmentation Generative Adversarial Networks
Antoniou, A., Storkey, A., & Edwards, H. S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.04340 · Cited by 747
Learning to Reweight Examples for Robust Deep Learning
Ren, M., Zeng, W., Yang, B., & Urtasun, R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.09050 · Cited by 740
Complexity measures of supervised classification problems
Ho, T. K., & Basu, M. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.990132 · Cited by 734
Recent Progress on Generative Adversarial Networks (GANs): A Survey
Pan, Z., Yu, W., Yi, X., Khan, A., Yuan, F., & Zheng, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2905015 · Cited by 701
Structured Pruning of Deep Convolutional Neural Networks
Anwar, S., Hwang, K., & Sung, W. (2017) · ACM Journal on Emerging Technologies in Computing Systems · doi:10.1145/3005348 · Cited by 698
Network Trimming: A Data-Driven Neuron Pruning Approach towards Efficient Deep Architectures
Hu, H., Peng, R., Tai, Y., & Tang, C. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.03250 · Cited by 668
Learning Sparse Neural Networks through $L_0$ Regularization
Louizos, C., Welling, M., & Kingma, D. P. (2017) · arXiv · doi:10.48550/arxiv.1712.01312 · Cited by 628
Tikhonov regularization and prior information in electrical impedance tomography
Vauhkonen, M. J., Vadasz, D., Karjalainen, P. A., et al. (1998) · IEEE Transactions on Medical Imaging · doi:10.1109/42.700740 · Cited by 614
Optimal Brain Surgeon and general network pruning
Hassibi, B., Stork, D. G., & Wolff, G. J. (2002) · IEEE International Conference on Neural Networks · doi:10.1109/icnn.1993.298572 · Cited by 597
Simplifying Neural Networks by Soft Weight-Sharing
Nowlan, S. J., & Hinton, G. E. (1992) · Neural Computation · doi:10.1162/neco.1992.4.4.473 · Cited by 595
FractalNet: Ultra-Deep Neural Networks without Residuals
Larsson, G., Maire, M., & Shakhnarovich, G. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.07648 · Cited by 586
Combinations of genetic algorithms and neural networks: a survey of the state of the art
Schaffer, J. D., Whitley, D., & Eshelman, L. J. (2003) · [Proceedings] COGANN-92: International Workshop on Combinations of Genetic Algorithms and Neural Networks · doi:10.1109/cogann.1992.273950 · Cited by 570
DeepSaliency: Multi-Task Deep Neural Network Model for Salient Object Detection
Li, X., Zhao, L., Wei, L., Yang, M.-H., Wu, F., Zhuang, Y., Ling, H., & Wang, J. (2016) · IEEE Transactions on Image Processing · doi:10.1109/tip.2016.2579306 · Cited by 538
Overfitting and neural networks: conjugate gradient and backpropagation
Lawrence, S., & Giles, C. L. (2000) · Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium · doi:10.1109/ijcnn.2000.857823 · Cited by 491
A genetic programming approach to designing convolutional neural network architectures
Suganuma, M., Shirakawa, S., & Nagao, T. (2017) · Proceedings of the Genetic and Evolutionary Computation Conference · doi:10.1145/3071178.3071229 · Cited by 491
Quantum Machine Learning: What Quantum Computing Means to Data Mining
Wittek, P. (2014) · Cited by 482
Gradient-Based Optimization of Hyperparameters
Bengio, Y. (2000) · Neural Computation · doi:10.1162/089976600300015187 · Cited by 466
Advances in Neural Information Processing Systems 26 (NIPS 2013)
Cseke, B., Opper, M., & Sanguinetti, G. (2013) · Cited by 424
Manifold Mixup: Better Representations by Interpolating Hidden States
Verma, V., Lamb, A., Beckham, C., Najafi, A., Mitliagkas, I., Courville, A. C., López-Paz, D., & Bengio, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.05236 · Cited by 421
Evolutionary artificial neural networks: a review
Ding, S., Li, H., Su, C., Yu, J., & Jin, F. (2013) · Artificial Intelligence Review · doi:10.1007/s10462-011-9270-6 · Cited by 412
Inferring transportation modes from GPS trajectories using a convolutional neural network
Dabiri, S., & Heaslip, K. (2018) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2017.11.021 · Cited by 405
Batch Renormalization: Towards Reducing Minibatch Dependence in Batch-Normalized Models
Ioffe, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.03275 · Cited by 367
Adaptive regularization of weight vectors
Crammer, K., Kulesza, A., & Dredze, M. (2013) · Machine Learning · doi:10.1007/s10994-013-5327-x · Cited by 337
Methods of Solving Ill-Posed ProblemsPreprint
Srinivasamurthy, S. B. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1205.5323 · Cited by 330
Regularized Evolution for Image Classifier Architecture Search
Real, E., Aggarwal, A., Huang, Y., & Le, Q. V. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33014780 · Cited by 328
Matrix Methods in Data Mining and Pattern Recognition
Eldén, L. (2007) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9780898718867 · Cited by 327
Overfitting Mechanism and Avoidance in Deep Neural NetworksPreprint
Salman, S., & Liu, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.06566 · Cited by 310
FractalNet: Ultra-Deep Neural Networks without Residuals.
Larsson, G., Maire, M., & Shakhnarovich, G. (2017) · International Conference on Learning Representations · Cited by 305
Jahangiri, A., & Rakha, H. A. (2015) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2015.2405759 · Cited by 292
Bus Arrival Time Prediction Using Support Vector Machines
Bin, Y., Zhongzhen, Y., & Baozhen, Y. (2006) · Journal of Intelligent Transportation Systems · doi:10.1080/15472450600981009 · Cited by 268
(2017) · arXiv (Cornell University) · Cited by 261
Lessons in neural network training: overfitting may be harder than expected
Lawrence, S., Giles, C. L., & Tsoi, A. C. (1997) · Cited by 242
TROP-ELM: A double-regularized ELM using LARS and Tikhonov regularization
Miche, Y., van Heeswijk, M., Bas, P., Simula, O., & Lendasse, A. (2011) · Neurocomputing · doi:10.1016/j.neucom.2010.12.042 · Cited by 224
Preventing Over-Fitting during Model Selection via Bayesian Regularisation of the Hyper-Parameters
Cawley, G. C., & Talbot, N. L. C. (2007) · UEA Digital Repository (University of East Anglia) · doi:10.5555/1248659.1248690 · Cited by 224
Towards Understanding Regularization in Batch NormalizationPreprint
Luo, P., Wang, X., Shao, W., & Peng, Z. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.00846 · Cited by 214
A weight initialization method for improving training speed in feedforward neural network
Yam, J. Y. F., & Chow, T. W. S. (2000) · Neurocomputing · doi:10.1016/s0925-2312(99)00127-7 · Cited by 207
Overfitting in making comparisons between variable selection methods
ReunanenJuha (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944978 · Cited by 205
A survey of swarm and evolutionary computing approaches for deep learning
Darwish, A., Hassanien, A. E., & Das, S. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-019-09719-2 · Cited by 200
A new pruning heuristic based on variance analysis of sensitivity information
Engelbrecht, A. P. (2001) · IEEE Transactions on Neural Networks · doi:10.1109/72.963775 · Cited by 198
A Penalty-Function Approach for Pruning Feedforward Neural Networks
Setiono, R. (1997) · Neural Computation · doi:10.1162/neco.1997.9.1.185 · Cited by 192
Wang, S., Li, D., Song, X., Wei, Y., & Li, H. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.01.077 · Cited by 191
Reinforcement learning for neural architecture search: A review
Jaafra, Y., Luc Laurent, J., Deruyver, A., & Saber Naceur, M. (2019) · Image and Vision Computing · doi:10.1016/j.imavis.2019.06.005 · Cited by 183
Hofleitner, A., Herring, R., & Bayen, A. (2012) · Transportation Research Part B: Methodological · doi:10.1016/j.trb.2012.03.006 · Cited by 175
Yu, Y., Gong, Z., Zhong, P., & Shan, J. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-71589-6_9 · Cited by 162
Regularization of deep neural networks with spectral dropout
Khan, S. H., Hayat, M., & Porikli, F. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.09.009 · Cited by 160
Forecasting Transportation Network Speed Using Deep Capsule Networks With Nested LSTM Models
Ma, X., Zhong, H., Li, Y., Ma, J., Cui, Z., & Wang, Y. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.2984813 · Cited by 156
Regularized Negative Correlation Learning for Neural Network Ensembles
Chen, H., & Yao, X. (2009) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2009.2034144 · Cited by 155
Transformed ℓ1 regularization for learning sparse deep neural networks
Ma, R., Miao, J., Niu, L., & Zhang, P. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.08.015 · Cited by 150
Two Strategies to Avoid Overfitting in Feedforward Networks
Schittenkopf, C., Deco, G., & Brauer, W. (1997) · Neural Networks · doi:10.1016/s0893-6080(96)00086-x · Cited by 138
Bejani, M. M., & Ghatee, M. (2018) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2018.02.009 · Cited by 136
Self-citationArpit, D., Zhou, Y., Kota, B. U., & Govindaraju, V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.01431 · Cited by 130
Feedforward Neural Network Construction Using Cross Validation
Setiono, R. (2001) · Neural Computation · doi:10.1162/089976601317098565 · Cited by 125
On the Solution of the Tikhonov Regularization of the Total Least Squares Problem
Beck, A., & Ben‐Tal, A. (2006) · SIAM Journal on Optimization · doi:10.1137/050624418 · Cited by 117
A review of modularization techniques in artificial neural networks
Amer, M., & Maul, T. (2019) · Artificial Intelligence Review · doi:10.1007/s10462-019-09706-7 · Cited by 117
Physics-Driven Regularization of Deep Neural Networks for Enhanced Engineering Design and Analysis
Nabian, M. A., & Meidani, H. (2019) · Journal of Computing and Information Science in Engineering · doi:10.1115/1.4044507 · Cited by 113
Regularizing Deep Neural Networks by Enhancing Diversity in Feature Extraction
Ayinde, B. O., Inanc, T., & Żurada, J. M. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2885972 · Cited by 112
Yang, H., Tang, M., Wen, W., Yan, F., Hu, D., Li, A., Li, H., & Chen, Y. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00347 · Cited by 101
Batch gradient method with smoothing regularization for training of feedforward neural networks
Wu, W. H., Fan, Q., Żurada, J. M., et al. (2013) · Neural Networks · doi:10.1016/j.neunet.2013.11.006 · Cited by 97
Convolutional Neural Network With Adaptive Regularization to Classify Driving Styles on Smartphones
Bejani, M. M., & Ghatee, M. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2896672 · Cited by 90
Self-citationResearch and development of neural network ensembles: a survey
Li, H., Wang, X., & Ding, S. (2017) · Artificial Intelligence Review · doi:10.1007/s10462-016-9535-1 · Cited by 76
Eftekhari, H. R., & Ghatee, M. (2018) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2018.06.044 · Cited by 76
Self-citationLossless Compression of Deep Neural Networks
Serra, T., Kumar, A., & Ramalingam, S. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58942-4_27 · Cited by 75
Robust Convolutional Neural Networks under Adversarial NoisePreprint
Jin, J., Dündar, A., & Culurciello, E. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06306 · Cited by 74
A neural network training algorithm utilizing multiple sets of linear equations
Chen, H.-H., MANRY, M. T., & Chandrasekaran, H. (1999) · Neurocomputing · doi:10.1016/s0925-2312(98)00109-x · Cited by 72
Optimizing the Hyper-parameters for SVM by Combining Evolution Strategies with a Grid Search
Liu, R., Liu, E., Yang, J., Li, M., & Wang, F. (2006) · Springer eBooks · doi:10.1007/11816492_87 · Cited by 71
On the nonlinearity of pattern classifiers
Hoekstra, A., & Duin, R. P. W. (1996) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.1996.547429 · Cited by 69
Local Overfitting Control via Leverages
Monari, G., & Dreyfus, G. (2002) · Neural Computation · doi:10.1162/089976602753713025 · Cited by 69
Hand gesture recognition using an adapted convolutional neural network with data augmentation
Alani, A. A., Cosma, G., Taherkhani, A., & McGinnity, T. M. (2018) · International Conference on Information Management · doi:10.1109/infoman.2018.8392660 · Cited by 69
An integrated growing-pruning method for feedforward network training
Narasimha, P. L., Delashmit, W. H., MANRY, M. T., Li, J., & Maldonado, F. (2007) · Neurocomputing · doi:10.1016/j.neucom.2007.08.026 · Cited by 67
Unimodal regularized neuron stick-breaking for ordinal classification
Liu, X., Fan, F., Kong, L., Diao, Z., Xie, W., Lu, J., & You, J. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.01.025 · Cited by 67
Design and regularization of neural networks: the optimal use of a validation set
Larsen, J. O., Hansen, L. K., Svarer, C., & Ohlsson, M. (2002) · Machine learning for signal processing ... · doi:10.1109/nnsp.1996.548336 · Cited by 65
Shakeout: A New Approach to Regularized Deep Neural Network Training
Kang, G., Li, J., & Tao, D. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2701831 · Cited by 64
Uncooperative gait recognition by learning to rank
Martín-Félez, R., & Xiang, T. (2014) · Pattern Recognition · doi:10.1016/j.patcog.2014.06.010 · Cited by 63
Data-Driven Color Augmentation Techniques for Deep Skin Image AnalysisPreprint
Galdrán, A., Álvarez-Gila, A., Meyer, M. I., Saratxaga, C. L., Araújo, T., Garrote, E., Aresta, G., Costa, P., Mendonça, A. M., & Campilho, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.03702 · Cited by 60
How Meta-heuristic Algorithms Contribute to Deep Learning in the Hype of Big Data Analytics
Fong, S. J., Deb, S., & Yang, X. (2017) · Advances in intelligent systems and computing · doi:10.1007/978-981-10-3373-5_1 · Cited by 60
Adaptive Regularization in Neural Network Modeling
Larsen, J. O., Svarer, C., Andersen, L. N., & Hansen, L. K. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-35289-8_8 · Cited by 58
Pashaei, A., Ghatee, M., & Sajedi, H. (2019) · Journal of Real-Time Image Processing · doi:10.1007/s11554-019-00852-3 · Cited by 58
Self-citationThe dependence identification neural network construction algorithm
Moody, J. O., & Antsaklis, P. J. (1996) · IEEE Transactions on Neural Networks · doi:10.1109/72.478388 · Cited by 57
Improving Deep Neural Network Sparsity through Decorrelation Regularization
Zhu, X., Zhou, W., & Li, H. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/453 · Cited by 56
Multiple wavelet regularized deep residual networks for fault diagnosis
Zhao, M., Tang, B., Deng, L., & PECHT, M. G. (2019) · Measurement · doi:10.1016/j.measurement.2019.107331 · Cited by 53
GradAug: A New Regularization Method for Deep Neural NetworksPreprint
Yang, T., Zhu, S., & Chen, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.07989 · Cited by 47
Manifold regularized deep neural networks
Tomar, V. S., & Rose, R. C. (2014) · Interspeech (USB) · doi:10.21437/interspeech.2014-82 · Cited by 42
GraphMix: Regularized Training of Graph Neural Networks for Semi-Supervised Learning
Verma, V., Qu, M., Lamb, A., Bengio, Y., Kannala, J., & Tang, J. G. (2019) · Cited by 42
Rao, D. M. R. N., Prasad, V. V. R., Teja, P. S. R., et al. (2018) · International Journal of Engineering & Technology · doi:10.14419/ijet.v7i2.32.15399 · Cited by 37
On the overtraining phenomenon of backpropagation neural networks
Tzafestaş, S. G., Dalianis, P. J., & Anthopoulos, G. (1996) · Mathematics and Computers in Simulation · doi:10.1016/0378-4754(95)00003-8 · Cited by 36
Kwasigroch, A., Mikołajczyk, A., & Grochowski, M. (2017) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-60699-6_81 · Cited by 34
Theory of adaptive SVD regularization for deep neural networks
Bejani, M. M., & Ghatee, M. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.04.021 · Cited by 34
Self-citationManifold Regularized Reinforcement Learning
Li, H., Liu, D., & Wang, D. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2650943 · Cited by 31
Abpeikar, S., Ghatee, M., & Zare, H. (2018) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2018.08.015 · Cited by 31
Self-citationLiu, Y., Wu, W. H., Fan, Q., Yang, D., & Wang, J. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.01.041 · Cited by 30
Implementation of deep neural networks (DNN) with batch normalization for batik pattern recognition
Nurhaida, I., Ayumi, V., Fitrianah, D., Zen, R. A. M., Noprisson, H., & Wei, H. (2020) · International Journal of Electrical and Computer Engineering (IJECE) · doi:10.11591/ijece.v10i2.pp2045-2053 · Cited by 29
Pruning deep neural networks by optimal brain damage
Liu, C., Zhang, Z., & Wang, D. (2014) · Interspeech (USB) · doi:10.21437/interspeech.2014-281 · Cited by 27
Neuron Segmentation Based on CNN with Semi-Supervised Regularization
Xu, K., Su, H., Zhu, J., Guan, J., & Zhang, B. (2016) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.167 · Cited by 25
Learning Neural Networks with Adaptive RegularizationPreprint
Zhao, H., Tsai, Y.-H. H., Salakhutdinov, R., & Gordon, G. J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.06288 · Cited by 25
A regularized root–quartic mixture of experts for complex classification problems
Abbasi, E., Shiri, M. E., & Ghatee, M. (2016) · Knowledge-Based Systems · doi:10.1016/j.knosys.2016.07.018 · Cited by 23
Self-citationGroup variable selection via ℓp,0 regularization and application to optimal scoring
Phan, D. N., & Thi, H. A. L. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.05.011 · Cited by 22
FRAN and RBF-PSO as two components of a hyper framework to recognize protein folds
Abbasi, E., Ghatee, M., & Shiri, M. E. (2013) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2013.05.017 · Cited by 21
Self-citationAbpeikar, S., & Ghatee, M. (2018) · Neural Computing and Applications · doi:10.1007/s00521-018-3543-9 · Cited by 21
Self-citationRDEC: Integrating Regularization into Deep Embedded Clustering for Imbalanced DatasetsPreprint
Tao, Y., Takagi, K., & Nakata, K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.02293 · Cited by 20
Animal species classification using deep neural networks with noise labels
Ahmed, A., Yousif, H. A., Kays, R., & He, Z. (2020) · Ecological Informatics · doi:10.1016/j.ecoinf.2020.101063 · Cited by 18
Bridgeout: Stochastic Bridge Regularization for Deep Neural Networks
Khan, N. U., Shah, J. A., & Stavness, I. (2018) · IEEE Access · doi:10.1109/access.2018.2863606 · Cited by 17
Regularized Deep Networks in Intelligent Transportation Systems: A Taxonomy and a Case StudyPreprint
Bejani, M. M., & Ghatee, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.03010 · Cited by 17
Self-citationTian, Y., & Pan, G. (2020) · Applied Sciences · doi:10.3390/app10082870 · Cited by 16
Hierarchical Group Sparse Regularization for Deep Convolutional Neural Networks
Mitsuno, K., Miyao, J., & Kurita, T. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207531 · Cited by 15
Data Augmentation Using Part Analysis for Shape Classification
Patel, V., Mujumdar, N., Balasubramanian, P., Marvaniya, S., & Mittal, A. (2019) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2019.00135 · Cited by 9
How Not to Give a FLOP: Combining Regularization and Pruning for Efficient InferencePreprint
Vu, T., Wen, E., & Nehoran, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.13593 · Cited by 9
Nannen, V. (2003) · Cited by 8
Dropout with Tabu Strategy for Regularizing Deep Neural Networks
Ma, Z., Sattar, A., Zhou, J. W., Chen, Q., & Su, K. (2019) · The Computer Journal · doi:10.1093/comjnl/bxz062 · Cited by 8
Fiedler Regularization: Learning Neural Networks with Graph SparsityPreprint
Tam, E., & Dunson, D. B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.00992 · Cited by 7
Gradient based adaptive regularization
Eigenmann, R., & Nossek, J. A. (2003) · doi:10.1109/nnsp.1999.788126 · Cited by 6
Bejani, M. M., & Ghatee, M. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.01.106 · Cited by 5
Self-citationHeidari, M., Ghatee, M., Nickabadi, A., & Nezhad, A. P. (2022) · Concurrency and Computation Practice and Experience · doi:10.1002/cpe.6866 · Cited by 5
Self-citationApproximate policy iteration with unsupervised feature learning based on manifold regularization
Li, H., Liu, D., & Wang, D. (2015) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2015.7280311 · Cited by 3
Chen, T., Wang, Z., Li, L., Li, D., Li, Z., Chang, X., Bian, P., Liang, G., Wang, Q., & Xie, T. (2025) · Schloss Dagstuhl – Leibniz-Zentrum für Informatik · doi:10.4230/lipics.ecoop.2025.6
Cited by
Alzubaidi, L., Bai, J., Al-Sabaawi, A., Santamaría, J., Albahri, A. S., Al-dabbagh, B. S. N., Fadhel, M. A., Manoufali, M., Zhang, J., Al-Timemy, A. H., et al. (2023) · Journal of Big Data · doi:10.1186/s40537-023-00727-2 · Cited by 907
Benti, N. E., Chaka, M. D., & Semie, A. G. (2023) · Sustainability · doi:10.3390/su15097087 · Cited by 378
Sharma, P., Said, Z., Kumar, A., Nižetić, S., Pandey, A., Hoang, A. T., Huang, Z., Afzal, A., Li, C., Le, A. T., et al. (2022) · Energy & Fuels · doi:10.1021/acs.energyfuels.2c01006 · Cited by 318
Faroughi, S. A., Pawar, N. M., Fernandes, C., Raissi, M., Das, S., Kalantari, N. K., & Kourosh Mahjour, S. (2024) · Journal of Computing and Information Science in Engineering · doi:10.1115/1.4064449 · Cited by 257
Survey of Deep Learning Accelerators for Edge and Emerging Computing
Alam, S., Yakopcic, C., Wu, Q., Barnell, M., Khan, S., & Taha, T. M. (2024) · Electronics · doi:10.3390/electronics13152988 · Cited by 38
Metadata
- Authors
- Bejani, M. M., & Ghatee, M.
- Venue
- Artificial Intelligence Review
- Published
- 2021-03-03
- Volume
- 54
- Issue
- 8
- Pages
- 6391-6438
- ISSN
- 0269-2821 (ISSN-L)
- 1573-7462
- OpenAlex
- W3134811368
- Cited by
- 573
- References
- 193
- FWCI
- 7.20
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.