The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Completely Automated CNN Architecture Design Based on Blocks
Abstract
The performance of convolutional neural networks (CNNs) highly relies on their architectures. In order to design a CNN with promising performance, extensive expertise in both CNNs and the investigated problem domain is required, which is not necessarily available to every interested user. To address this problem, we propose to automatically evolve CNN architectures by using a genetic algorithm (GA) based on ResNet and DenseNet blocks. The proposed algorithm is completely automatic in designing CNN architectures. In particular, neither preprocessing before it starts nor postprocessing in terms of CNNs is needed. Furthermore, the proposed algorithm does not require users with domain knowledge on CNNs, the investigated problem, or even GAs. The proposed algorithm is evaluated on the CIFAR10 and CIFAR100 benchmark data sets against 18 state-of-the-art peer competitors. Experimental results show that the proposed algorithm outperforms the state-of-the-art CNNs hand-crafted and the CNNs designed by automatic peer competitors in terms of the classification performance and achieves a competitive classification accuracy against semiautomatic peer competitors. In addition, the proposed algorithm consumes much less computational resource than most peer competitors in finding the best CNN architectures.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
A fast and elitist multiobjective genetic algorithm: NSGA-II
Deb, K., Pratap, A., Agarwal, S., & Meyarivan, T. (2002) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.996017 · Cited by 50,053
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Holland, J. H. (1992) · The MIT Press eBooks · doi:10.7551/mitpress/1090.001.0001 · Cited by 47,002
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
(2014) · Cited by 33,419
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
(2010) · Cited by 14,134
Ant system: optimization by a colony of cooperating agents
Dorigo, M., Maniezzo, V., & Colorni, A. (1996) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/3477.484436 · Cited by 12,067
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
Genetic Algorithms + Data Structures = Evolution Programs
Michalewicz, Z. (1992) · Artificial Intelligence · doi:10.1007/978-3-662-02830-8 · Cited by 11,553
An Introduction to Genetic Algorithms
Mitchell, M. (1996) · doi:10.7551/mitpress/3927.001.0001 · Cited by 11,340
(2012) · Cited by 8,009
Handbook of Genetic Algorithms
Davis, L. D. (1991) · Cumulative Index of Computer Aided Architectural Design · Cited by 7,330
Bäck, T. (1996) · Oxford University Press eBooks · doi:10.1093/oso/9780195099713.001.0001 · Cited by 5,113
Genetic Algorithms + Data Structures = Evolution Programs
Michalewicz, Z. (1996) · Springer eBooks · doi:10.1007/978-3-662-03315-9 · Cited by 5,095
Neural Architecture Search with Reinforcement Learning
Zoph, B., & Le, Q. V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01578 · Cited by 3,974
(2011) · Cited by 3,939
Striving for Simplicity: The All Convolutional Net
Springenberg, J. T., Dosovitskiy, A., Brox, T., & Riedmiller, M. (2014) · arXiv · doi:10.48550/arxiv.1412.6806 · Cited by 3,447
Evolving Neural Networks through Augmenting Topologies
Stanley, K. O., & Miikkulainen, R. (2002) · Evolutionary Computation · doi:10.1162/106365602320169811 · Cited by 3,258
Genetic Algorithms and Machine Learning
Goldberg, D. E., & Holland, J. H. (1988) · Machine Learning · doi:10.1023/a:1022602019183 · Cited by 3,193
Sequential Model-Based Optimization for General Algorithm Configuration
Hutter, F., Hoos, H. H., & Leyton-Brown, K. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-25566-3_40 · Cited by 2,469
(2010) · doi:10.5555/1756006.1859921 · Cited by 1,924
Srivastava, R. K., Greff, K., & Schmidhuber, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.06228 · Cited by 1,246
Deep convolutional neural networks for LVCSR
Sainath, T. N., Mohamed, A.-R., Kingsbury, B., & Ramabhadran, B. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639347 · Cited by 1,053
Genetic Programming: An Introduction
Banzhaf, W., Keller, R. E., & Nordin, P. C. (1997) · Cited by 1,052
Genetic Algorithms, Tournament Selection, and the Effects of Noise.
Miller, B. L., & Goldberg, D. E. (1995) · Cited by 962
(2014) · arXiv (Cornell University) · Cited by 942
Srivastava, R. K., Greff, K., & Schmidhuber, J. (2015) · arXiv · doi:10.48550/arxiv.1505.00387 · Cited by 912
Banzhaf, W., Fogarty, T. C., Schoenauer, M., & Poli, R. (1998) · Lecture notes in computer science · doi:10.1007/bfb0055923 · Cited by 825
Evolving Deep Convolutional Neural Networks for Image Classification
Sun, Y., Xue, B., Zhang, M., & Yen, G. G. (2020) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2019.2916183 · Cited by 775
Self-citationXie, L., & Yuille, A. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.154 · Cited by 740
THE EVOLUTIONARY STRATEGY OF THE EQUIDAE AND THE ORIGINS OF RUMEN AND CECAL DIGESTION
Janis, C. (1976) · Evolution · doi:10.1111/j.1558-5646.1976.tb00957.x · Cited by 593
FractalNet: Ultra-Deep Neural Networks without Residuals
Larsson, G., Maire, M., & Shakhnarovich, G. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.07648 · Cited by 586
Efficient Architecture Search by Network Transformation
Cai, H., Chen, T., Zhang, W., Yu, Y., & Wang, J. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11709 · Cited by 557
Practical Block-Wise Neural Network Architecture Generation
Zhong, Z., Yan, J., Wu, W., Shao, J., & Liu, C.-L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00257 · Cited by 522
IGD Indicator-Based Evolutionary Algorithm for Many-Objective Optimization Problems
Sun, Y., Yen, G. G., & Yi, Z. (2019) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2018.2791283 · Cited by 519
Self-citationSchmitt, L. M. (2001) · Theoretical Computer Science · doi:10.1016/s0304-3975(00)00406-0 · Cited by 512
A genetic programming approach to designing convolutional neural network architectures
Suganuma, M., Shirakawa, S., & Nagao, T. (2017) · Proceedings of the Genetic and Evolutionary Computation Conference · doi:10.1145/3071178.3071229 · Cited by 491
Large-Scale Evolution of Image Classifiers
Real, E., Moore, S., Selle, A. P., Saxena, S., Suematsu, Y. I. L., Tan, J., Le, Q. V., & Kurakin, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.01041 · Cited by 466
On Bayesian Methods for Seeking the Extremum
Močkus, J. (1975) · Optimization Techniques IFIP Technical Conference · doi:10.1007/978-3-662-38527-2_55 · Cited by 402
Xie, L., & Yuille, A. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · Cited by 377
Designing Neural Network Architectures using Reinforcement Learning
Baker, B., Gupta, O., Naik, N., & Raskar, R. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.02167 · Cited by 372
FractalNet: Ultra-Deep Neural Networks without Residuals.
Larsson, G., Maire, M., & Shakhnarovich, G. (2017) · International Conference on Learning Representations · Cited by 305
Skip Connections Eliminate SingularitiesPreprint
Orhan, A. E., & Pitkow, X. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.09175 · Cited by 249
(2017) · Interval Analysis · doi:10.1515/9783110499469-009 · Cited by 235
Evolving Unsupervised Deep Neural Networks for Learning Meaningful Representations
Sun, Y., Yen, G. G., & Zhang, Y. (2018) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2018.2808689 · Cited by 173
Self-citationTraining Deep Convolutional Neural Networks to Play Go
Clark, C., & Storkey, A. (2015) · Cited by 131
Practical Network Blocks Design with Q-Learning.Preprint
Zhong, Z., Yan, J., & Liu, C. (2017) · arXiv (Cornell University) · Cited by 90
An Experimental Study on Hyper-parameter Optimization for Stacked Auto-Encoders
Sun, Y., Xue, B., Zhang, M., & Yen, G. G. (2018) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2018.8477921 · Cited by 49
Self-citationImproved Regularity Model-Based EDA for Many-Objective Optimization
Sun, Y., Yen, G. G., & Yi, Z. (2018) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2018.2794319 · Cited by 39
Self-citationA novel genetic algorithm and its application to digital filter design
Zhang, G., Gu, Y., Hu, L., et al. (2004) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc.2003.1252754 · Cited by 29
Reference line-based Estimation of Distribution Algorithm for many-objective optimization
Sun, Y., Yen, G. G., & Zhang, Y. (2017) · Knowledge-Based Systems · doi:10.1016/j.knosys.2017.06.021 · Cited by 26
Self-citation
Cited by
A Survey on Evolutionary Neural Architecture Search
Liu, Y., Sun, Y., Xue, B., Zhang, M., Yen, G. G., & Tan, K. C. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3100554 · Cited by 644
Self-citationSun, Y., Wang, H., Xue, B., Jin, Y., Yen, G. G., & Zhang, M. (2020) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2019.2924461 · Cited by 290
Self-citationNeural Architecture Search Benchmarks: Insights and Survey
Chitty-Venkata, K. T., Emani, M., Vishwanath, V., & Somani, A. K. (2023) · IEEE Access · doi:10.1109/access.2023.3253818 · Cited by 64
Metadata
- Authors
- Sun, Y., Xue, B., Zhang, M., & Yen, G. G.
- Venue
- IEEE Transactions on Neural Networks and Learning Systems
- Published
- 2020-04
- Volume
- 31
- Issue
- 4
- Pages
- 1242-1254
- ISSN
- 2162-237X (ISSN-L)
- 2162-2388
- OpenAlex
- W2953308748
- Cited by
- 338
- References
- 61
- FWCI
- 15.64
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.