The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Particle swarm optimization of deep neural networks architectures for image classification
Open accessAbstract
Abstract Deep neural networks have been shown to outperform classical machine learning algorithms in solving real-world problems. However, the most successful deep neural networks were handcrafted from scratch taking the problem domain knowledge into consideration. This approach often consumes very significant time and computational resources. In this work, we propose a novel algorithm based on particle swarm optimization (PSO), capable of fast convergence when compared with others evolutionary approaches, to automatically search for meaningful deep convolutional neural networks (CNNs) architectures for image classification tasks, named psoCNN. A novel directly encoding strategy and a velocity operator were devised allowing the optimization use of PSO with CNNs. Our experimental results show that psoCNN can quickly find good CNN architectures that achieve quality performance comparable to the state-of-the-art designs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · doi:10.1109/cvpr.1993 · Cited by 17,667
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
(2010) · Cited by 14,134
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
Backpropagation Applied to Handwritten Zip Code Recognition
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.541 · Cited by 11,891
(2016) · Cited by 11,679
Proceedings of the 24th international conference on Machine learning
(2007) · doi:10.1145/1273496 · Cited by 11,630
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
Xiao, H., Rasul, K., & Vollgraf, R. (2017) · arXiv · doi:10.48550/arxiv.1708.07747 · Cited by 6,108
2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
(2015) · doi:10.1109/cvpr31182.2015 · Cited by 3,737
Striving for Simplicity: The All Convolutional Net
Springenberg, J. T., Dosovitskiy, A., Brox, T., & Riedmiller, M. (2014) · arXiv · doi:10.48550/arxiv.1412.6806 · Cited by 3,447
Evolving Neural Networks through Augmenting Topologies
Stanley, K. O., & Miikkulainen, R. (2002) · Evolutionary Computation · doi:10.1162/106365602320169811 · Cited by 3,258
(2013) · Cited by 2,056
Contractive Auto-Encoders: Explicit Invariance During Feature Extraction
Rifai, S., Vincent, P., Muller, X., Glorot, X., & Bengio, Y. (2011) · International Conference on Machine Learning · Cited by 1,600
2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
(2016) · doi:10.1109/cvpr33180.2016 · Cited by 1,534
PCANet: A Simple Deep Learning Baseline for Image Classification?
Chan, T.-H., Jia, K., Gao, S., Lu, J., Zeng, Z., & Ma, Y. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2475625 · Cited by 1,362
2015 IEEE International Conference on Computer Vision (ICCV)
(2015) · doi:10.1109/iccv33071.2015 · Cited by 1,253
An empirical evaluation of deep architectures on problems with many factors of variation
Larochelle, H., Erhan, D., Courville, A., Bergstra, J., & Bengio, Y. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273556 · Cited by 992
Recurrent convolutional neural network for object recognition
Liang, M., & Hu, X. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298958 · Cited by 976
A Hypercube-Based Encoding for Evolving Large-Scale Neural Networks
Stanley, K. O., D'Ambrosio, D. B., & Gauci, J. (2009) · Artificial Life · doi:10.1162/artl.2009.15.2.15202 · Cited by 780
Evolving Deep Convolutional Neural Networks for Image Classification
Sun, Y., Xue, B., Zhang, M., & Yen, G. G. (2020) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2019.2916183 · Cited by 775
Self-citationZhang, J.-R., Zhang, J., Lok, T.-M., & Lyu, M. R. (2007) · Applied Mathematics and Computation · doi:10.1016/j.amc.2006.07.025 · Cited by 706
2018 IEEE Congress on Evolutionary Computation (CEC)
(2018) · doi:10.1109/cec40672.2018 · Cited by 555
Gudise, V. G., & Venayagamoorthy, G. K. (2004) · Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706) · doi:10.1109/sis.2003.1202255 · Cited by 425
Adaptive Multiobjective Particle Swarm Optimization Based on Parallel Cell Coordinate System
Hu, W., & Yen, G. G. (2015) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2013.2296151 · Cited by 273
Self-citationEvolutionary artificial neural networks by multi-dimensional particle swarm optimization
Kiranyaz, S., Ince, T., Yildirim, A., & Gabbouj, M. (2009) · Neural Networks · doi:10.1016/j.neunet.2009.05.013 · Cited by 257
Hierarchical Representations for Efficient Architecture Search
Liu, H., Simonyan, K., Vinyals, O., Fernando, C., & Kavukcuoglu, K. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.00436 · Cited by 194
A Particle Swarm Optimization-Based Flexible Convolutional Autoencoder for Image Classification
Sun, Y., Xue, B., Zhang, M., & Yen, G. G. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2881143 · Cited by 179
Self-citationWang, B., Sun, Y., Xue, B., & Zhang, M. (2018) · 2018 IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2018.8477735 · Cited by 179
Evolving Unsupervised Deep Neural Networks for Learning Meaningful Representations
Sun, Y., Yen, G. G., & Zhang, Y. (2018) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2018.2808689 · Cited by 173
Self-citationParameters optimization of deep learning models using Particle swarm optimization
Qolomany, B., Maabreh, M., Al‐Fuqaha, A., Gupta, A. K., & Benhaddou, D. (2017) · International Wireless Communications and Mobile Computing Conference (IWCMC) · doi:10.1109/iwcmc.2017.7986470 · Cited by 144
Empirical studies on the speed of convergence of neural network training using genetic algorithms
Kitano, H. (1990) · National Conference on Artificial Intelligence · Cited by 142
(1994) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/icec.1994.350053 · Cited by 107
Using genetic search to exploit the emergent behavior of neural networks
Schaffer, J. D., Caruana, R. A., & Eshelman, L. J. (1990) · Physica D Nonlinear Phenomena · doi:10.1016/0167-2789(90)90078-4 · Cited by 91
Particle Swarm Optimization of Neural Network Architectures andWeights
Carvalho, M. S., & Ludermir, T. B. (2007) · International Conference on Hybrid Intelligent Systems (HIS) · doi:10.1109/his.2007.45 · Cited by 87
Evolutionary reinforcement learning of artificial neural networks
Siebel, N. T., & Sommer, G. (2007) · International Journal of Hybrid Intelligent Systems · doi:10.3233/his-2007-4304 · Cited by 78
Fast Convergence Particle Swarm Optimization for Functions Optimization
Sahu, A., Panigrahi, S. K., & Pattnaik, S. (2012) · Procedia Technology · doi:10.1016/j.protcy.2012.05.048 · Cited by 71
Efficient Neural Architecture Search with Network MorphismPreprint
Jin, H., Song, Q., & Hu, X. (2018) · arXiv (Cornell University) · Cited by 61
Generative NeuroEvolution for Deep LearningPreprint
Verbancsics, P., & Harguess, J. D. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1312.5355 · Cited by 48
Particle Swarm Optimization of Feed-Forward Neural Networks with Weight Decay
Carvalho, M., & Ludermir, T. B. (2006) · International Conference on Hybrid Intelligent Systems (HIS) · doi:10.1109/his.2006.264888 · Cited by 44
Neuro-genetic truck backer-upper controller
Schoenauer, M., & Ronald, E. M. A. (2002) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/icec.1994.349969 · Cited by 40
A Study on Pre-training Deep Neural Networks Using Particle Swarm Optimisation
Kenny, A., & Li, X. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-68759-9_30 · Cited by 10
Cited by
A Survey on Evolutionary Neural Architecture Search
Liu, Y., Sun, Y., Xue, B., Zhang, M., Yen, G. G., & Tan, K. C. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3100554 · Cited by 644
Self-citationKaveh, M., & Mesgari, M. S. (2023) · Neural Processing Letters · doi:10.1007/s11063-022-11055-6 · Cited by 292
A systematic review of hyperparameter optimization techniques in Convolutional Neural Networks
Raiaan, M. A. K., Sakib, S., Fahad, N. M., Mamun, A. A., Rahman, M. A., Shatabda, S., & Mukta, M. S. H. (2024) · Decision Analytics Journal · doi:10.1016/j.dajour.2024.100470 · Cited by 254
Recent trends in computational intelligence for educational big data analysis
Ikegwu, A. C., Nweke, H. F., & Anikwe, C. V. (2024) · Iran Journal of Computer Science · doi:10.1007/s42044-023-00158-5 · Cited by 53
Metadata
- Authors
- Fernandes Junior, F. E., & Yen, G. G.
- Venue
- Swarm and Evolutionary Computation
- Publisher
- Elsevier BV
- Published
- 2019-09
- Volume
- 49
- Pages
- 62-74
- ISSN
- 2210-6502 (ISSN-L)
- OpenAlex
- W2947137917
- Cited by
- 393
- References
- 55
- FWCI
- 22.33
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.