The DOI matches its DataCite record; 35 of the 36 references it cites were found in a registry or an index.
SNAS: Stochastic Neural Architecture Search
Open accessAbstract
We propose Stochastic Neural Architecture Search (SNAS), an economical end-to-end solution to Neural Architecture Search (NAS) that trains neural operation parameters and architecture distribution parameters in same round of back-propagation, while maintaining the completeness and differentiability of the NAS pipeline. In this work, NAS is reformulated as an optimization problem on parameters of a joint distribution for the search space in a cell. To leverage the gradient information in generic differentiable loss for architecture search, a novel search gradient is proposed. We prove that this search gradient optimizes the same objective as reinforcement-learning-based NAS, but assigns credits to structural decisions more efficiently. This credit assignment is further augmented with locally decomposable reward to enforce a resource-efficient constraint. In experiments on CIFAR-10, SNAS takes less epochs to find a cell architecture with state-of-the-art accuracy than non-differentiable evolution-based and reinforcement-learning-based NAS, which is also transferable to ImageNet. It is also shown that child networks of SNAS can maintain the validation accuracy in searching, with which attention-based NAS requires parameter retraining to compete, exhibiting potentials to stride towards efficient NAS on big datasets. We have released our implementation at https://github.com/SNAS-Series/SNAS-Series.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“fully decentralized variants of SGD and other optimization algorithms have recently been considered in machine learning both for improved scalability in datacenters [29] as well as for decentralized networks of devices [127, 459, 443, 59, 278, 291, 173].”
From Advances and Open Problems in Federated Learning (2021) · cites this paper as [173]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,889
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00716 · Cited by 9,982
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 8,608
ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design
Ma, N., Zhang, X., Zheng, H.-T., & Sun, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01264-9_8 · Cited by 7,356
Self-citationLearning Transferable Architectures for Scalable Image Recognition
Zoph, B., Vasudevan, V., Shlens, J., & Le, Q. V. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00907 · Cited by 6,875
Factor graphs and the sum-product algorithm
Kschischang, F. R., Frey, B. J., & Loeliger, H.-A. (2001) · IEEE Transactions on Information Theory · doi:10.1109/18.910572 · Cited by 6,486 · cited 2×
“f the global cost, consistent with the credit assignment principle in SNAS. In SNAS, p (Z) is fully factorizable, making it possible to calculate E Z˘p [C(Z)] analytically with sum-product algorithm (Kschischang et al., 2001). Unfortunately, this expectation is non-trivial to calculate, we optimize the Monte Carlo est…”
Method
Research works printed but not linked: 1
- Bowen Baker, Otkrist Gupta, Ramesh Raskar, and Nikhil Naik. Accelerating neural architecture search using performance prediction. arXiv preprint arXiv:1705.10823 , 2017. · arXiv
Cited by
Sorted by citations
Items 301–400 of 729
Smooth Variational Graph Embeddings for Efficient Neural Architecture Search
Lukasik, J., Friede, D., Zela, A., Hutter, F., & Keuper, M. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9534092 · Cited by 24
Landmark Regularization: Ranking Guided Super-Net Training in Neural Architecture Search
Yu, K., Ranftl, R., & Salzmann, M. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01351 · Cited by 17
Fitting the Search Space of Weight-sharing NAS with Graph Convolutional Networks
Chen, X., Xie, L., Wu, J. H., Wei, L., Xu, Y., & Tian, Q. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i8.16869 · Cited by 17
Performance-Aware Mutual Knowledge Distillation for Improving Neural Architecture Search
Xie, P., & Du, X. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01162 · Cited by 20
Meng, R., Chen, W., Yang, S., Song, J., Lin, L., Xie, D., Pu, S., Wang, X., Song, M., & Zhuang, Y. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00700 · Cited by 17
Self-citationMulti-Criterion Evolutionary Design of Deep Convolutional Neural Networks.Preprint
Lu, Z., Whalen, I., Dhebar, Y., Deb, K., Goodman, E. D., Banzhaf, W., & Boddeti, V. N. (2019) · arXiv (Cornell University) · Cited by 17
HardCoRe-NAS: Hard Constrained diffeRentiable Neural Architecture SearchPreprint
Nayman, N., Aflalo, Y., Noy, A., & Zelnik‐Manor, L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.11646 · Cited by 21
Neural Architecture Search Using Covariance Matrix Adaptation Evolution Strategy
Sinha, N., & Chen, K. (2023) · Evolutionary Computation · doi:10.1162/evco_a_00331 · Cited by 16
Automatic Mixed-Precision Quantization Search of BERT
Zhao, C., Hua, T., Shen, Y., Lou, Q., & Jin, H. (2021) · Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/472 · Cited by 16
Neural Architecture Search via Proxy Validation
Li, Y., Dong, M., Wang, Y., & Xu, C. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3217648 · Cited by 16
Automatic Modelling for Interactive Action Assessment
Gao, J., Pan, J., Zhang, S., & Zheng, W. (2022) · International Journal of Computer Vision · doi:10.1007/s11263-022-01695-5 · Cited by 16
Li, J., Chen, R., Huang, X., & Qu, Y. (2022) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2022.3219476 · Cited by 16
Improving Differentiable Architecture Search via self-distillation
Zhu, X., Li, J., Liu, Y., & Wang, W. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.08.062 · Cited by 20
PLiNIO: A User-Friendly Library of Gradient-Based Methods for Complexity-Aware DNN Optimization
Pagliari, D. J., Risso, M., Motetti, B. A., & Burrello, A. (2023) · Forum on specification and Design Languages · doi:10.1109/fdl59689.2023.10272045 · Cited by 18
Evolving Energy Efficient Convolutional Neural Networks
Young, S. R., Devineni, P., Parsa, M., Johnston, J., Kay, B., Patton, R. M., Schuman, C. D., Rose, D. C., & Potok, T. E. (2019) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata47090.2019.9006239 · Cited by 16
Efficient Evolutionary Architecture Search for CNN Optimization on GTSRB
Marco, J. F., & Wassner, J. (2019) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2019.00018 · Cited by 16
AutoHash: Learning Higher-order Feature Interactions for Deep CTR Prediction
Xue, N., Liu, B., Guo, H., Tang, R., Zhou, F., Zafeiriou, S. P., Zhang, Y., Wang, J., & Li, Z. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3016482 · Cited by 16
Quantum-Inspired Evolutionary Algorithm for Convolutional Neural Networks Architecture Search
Ye, W., Liu, R., Li, Y., & Jiao, L. (2020) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec48606.2020.9185727 · Cited by 18
Joint Learning of Neural Transfer and Architecture Adaptation for Image Recognition
Wang, G., Lin, L., Chen, R., Wang, G., & Zhang, J. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3070605 · Cited by 16
Self-citationZhang, S., Zheng, X., Li, G., Yang, C., Li, Y., Wang, Y., Chao, F., Wang, M., Li, S., & Ji, R. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128140 · Cited by 23
Neuro-Symbolic Program Search for Autonomous Driving Decision Module Design.
Sun, J., Sun, H., Han, T., & Zhou, B. (2020) · Conference on Robot Learning · Cited by 16
Memory-efficient Embedding for Recommendations
Zhao, X., Liu, H., Liu, H., Tang, J., Guo, W., Shi, J., Wang, S., Gao, H., & Long, B. (2020) · arXiv · doi:10.48550/arxiv.2006.14827 · Cited by 16
Designing Efficient DNNs via Hardware-Aware Neural Architecture Search and Beyond
Luo, X., Liu, D., Huai, S., Kong, H., Chen, H., & Liu, W. (2021) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2021.3100249 · Cited by 17
Nested Architecture Search for Point Cloud Semantic Segmentation
Yang, F., Li, X. S., & Shen, J. (2022) · IEEE Transactions on Image Processing · doi:10.1109/tip.2022.3147983 · Cited by 15
EPC-DARTS: Efficient partial channel connection for differentiable architecture search
Cai, Z., Chen, L., & Liu, H. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.07.029 · Cited by 15
Searching to Exploit Memorization Effect in Deep Learning With Noisy Labels
Yang, H., Yao, Q., Han, B., & Kwok, J. T.-Y. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3394552 · Cited by 16
NASGEM: Neural Architecture Search via Graph Embedding Method
Cheng, H.-P., Zhang, T., Zhang, Y., Li, S., Liang, F., Feng, Y., Li, M., Chandra, V., Li, H. H., & Chen, Y. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i8.16872 · Cited by 15
Repnas: Searching for Efficient Re-Parameterizing Blocks
Zhang, M., Yu, X., Rong, J., & Ou, L. (2023) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme55011.2023.00054 · Cited by 15
Elastic-InfoGAN: Unsupervised Disentangled Representation Learning in Class-Imbalanced DataPreprint
Ojha, U., Singh, K. K., Hsieh, C., & Lee, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.01112 · Cited by 16
Multi-population evolutionary neural architecture search with stacked generalization
Song, C., Ma, Y., Yang, X., & Chen, H. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127664 · Cited by 14
VNAS: Variational Neural Architecture Search
Ma, B., Zhang, J., Xia, Y., & Tao, D. (2024) · International Journal of Computer Vision · doi:10.1007/s11263-024-02014-w · Cited by 14
Neural architecture search via similarity adaptive guidance
Xue, Y., Zha, J., Wahib, M., Ouyang, T., & Wang, X. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.111821 · Cited by 14
A Meta-Heuristic Automatic CNN Architecture Design Approach Based on Ensemble Learning
Ahmed, A. A., & Darwish, S. M. (2021) · IEEE Access · doi:10.1109/access.2021.3054117 · Cited by 14
Designing Convolutional Neural Network Architectures Using Cartesian Genetic Programming
Suganuma, M., Shirakawa, S., & Nagao, T. (2020) · Natural computing series · doi:10.1007/978-981-15-3685-4_7 · Cited by 14
One-Shot Neural Architecture Search via Compressive SensingPreprint
Cho, M., Soltani, M., & Hegde, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.02869 · Cited by 14
Optimal Transport Kernels for Sequential and Parallel Neural Architecture SearchPreprint
Nguyen, V., Le, T., Yamada, M., & Osborne, M. A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.07593 · Cited by 14
IDARTS: Interactive Differentiable Architecture Search
Song, X., Wang, R., Zhang, B., Wang, T., Guo, G., & Doermann, D. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00120 · Cited by 14
Stacked BNAS: Rethinking Broad Convolutional Neural Network for Neural Architecture Search
Ding, Z., Chen, Y., Li, N., Zhao, D., & Chen, C. L. P. (2023) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2023.3275128 · Cited by 13
Hassantabar, S., Dai, X., & Jha, N. K. (2022) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2022.3148202 · Cited by 15
Dynamic Embedding Size Search with Minimum Regret for Streaming Recommender System
He, B., He, X. D., Zhang, R., Zhang, Y., Tang, R., & Ma, C. (2023) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3583780.3615135 · Cited by 13
Extensible and Efficient Proxy for Neural Architecture Search
Li, Y., Li, J., Hao, C., Li, P., Xiong, J., & Chen, D. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00570 · Cited by 14
Efficient multi-objective neural architecture search framework via policy gradient algorithm
Lyu, B., Yang, Y., Cao, Y., Wang, P., Zhu, J., Chang, J., & Wen, S. (2024) · Information Sciences · doi:10.1016/j.ins.2024.120186 · Cited by 13
Bandit-NAS: Bandit sampling and training method for Neural Architecture Search
Lin, Y., Endo, Y., Lee, J., & Kamijo, S. (2023) · Neurocomputing · doi:10.1016/j.neucom.2024.127684 · Cited by 14
Real-Time Semantic Segmentation via Auto Depth, Downsampling Joint Decision and Feature Aggregation
Sun, P., Wu, J., Li, S., Lin, P., Huang, J., & Li, X. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01433-3 · Cited by 14
Wei, H., Lee, F., Hu, C., & Chen, Q. (2022) · IEEE Access · doi:10.1109/access.2022.3148323 · Cited by 14
Luo, X., Liu, D., Kong, H., Huai, S., Chen, H., & Liu, W. (2022) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/3489517.3530488 · Cited by 13
Khan, S., Rizwan, A., Khan, A. N., Ali, M., Ahmed, R., & Kim, D. H. (2023) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2023.108867 · Cited by 13
Searching for Efficient Architecture for Instrument Segmentation in Robotic Surgery
Pakhomov, D., & Navab, N. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-59716-0_62 · Cited by 13
Pose Neural Fabrics SearchPreprint
Yang, S., Yang, W., & Cui, Z. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.07068 · Cited by 13
Differentially-private Federated Neural Architecture SearchPreprint
Singh, I., Zhou, H., Yang, K., Ding, M., Lin, B., & Xie, P. (2020) · doi:10.36227/techrxiv.12503420.v1 · Cited by 13
Network Architecture Search for Domain AdaptationPreprint
Li, Y., & Peng, X. (2020) · arXiv.org · doi:10.48550/arxiv.2008.05706 · Cited by 15
Finding Fast Transformers: One-Shot Neural Architecture Search by Component CompositionPreprint
Tsai, H., Ooi, J., Ferng, C.-S., Chung, H. W., & Riesa, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.06808 · Cited by 23
DE-DARTS: Neural architecture search with dynamic exploration
Mun, J., Ha, S., & Lee, J. (2022) · ICT Express · doi:10.1016/j.icte.2022.04.005 · Cited by 12
LRNAS: Differentiable Searching for Adversarially Robust Lightweight Neural Architecture
Feng, Y., Lv, Z., Chen, H., Gao, S., An, F., & Sun, Y. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3382724 · Cited by 12
Understanding the Effects of Pre-Training for Object Detectors via Eigenspectrum
Shinya, Y., Simo‐Serra, E., & Suzuki, T. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00242 · Cited by 12
Wang, Y., Liu, Y., Dai, W., Li, C., Zou, J., & Xiong, H. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01209 · Cited by 12
Zhang, J., Zhang, L., Li, D., & Wang, L. (2023) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2023.3274177 · Cited by 12
Efficient Evolution for Neural Architecture Search
Chen, Z., & Li, B. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207545 · Cited by 12
Semantic Bottlenecks: Quantifying and Improving Inspectability of Deep Representations
Losch, M., Fritz, M., & Schiele, B. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01498-0 · Cited by 13
Black Box Search Space Profiling for Accelerator-Aware Neural Architecture Search
Zeng, S., Sun, H., Xing, Y., Ning, X., Shan, Y., Chen, X., Wang, Y., & Yang, H. (2020) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/asp-dac47756.2020.9045179 · Cited by 12
Fine-Grained Neural Architecture SearchPreprint
Kim, H., Hong, S., Han, B., Myeong, H., & Lee, K. M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.07478 · Cited by 14
Efficient Differentiable Neural Architecture Search with Meta KernelsPreprint
Chen, S., Chen, Y., Yan, S., & Feng, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.04749 · Cited by 16
To Share or Not To Share: A Comprehensive Appraisal of Weight-SharingPreprint
Pourchot, A., Ducarouge, A., & Sigaud, O. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.04289 · Cited by 12
AutoPose: Searching Multi-Scale Branch Aggregation for Pose EstimationPreprint
Gong, X., Chen, W., Jiang, Y., Yuan, Y., Liu, X., Zhang, Q., Li, Y., & Wang, Z. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.07018 · Cited by 14
Lower Bounds and Accelerated Algorithms for Bilevel OptimizationPreprint
Ji, K., & Liang, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.03926 · Cited by 12
Core-set Sampling for Efficient Neural Architecture SearchPreprint
Shim, J.-H., Kong, K., & Kang, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.06869 · Cited by 12
Dynamic High-Resolution Network for Semantic Segmentation in Remote-Sensing Images
Guo, S., Yang, Q., Xiang, S., Wang, P., & Wang, X. (2023) · Remote Sensing · doi:10.3390/rs15092293 · Cited by 11
Lightweight Surface Litter Detection Algorithm Based on Improved YOLOv5s
Chen, Z., Huang, C., Duan, L., & Tan, B. (2023) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2023.039451 · Cited by 11
A Fast Evolutionary Knowledge Transfer Search for Multiscale Deep Neural Architecture
Zhang, R., Jiao, L., Wang, D., Liu, F., Liu, X., & Yang, S. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3304291 · Cited by 11
Spiking Spatiotemporal Neural Architecture Search for EEG-Based Emotion Recognition
Li, W., Zhu, Z., Shao, S., Lu, Y., & Song, A. (2024) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2024.3472838 · Cited by 11
Hu, M., Li, J., Dong, Y., Zhang, Z., Liu, W., Zhang, P., Ping, Y., Jiang, L., & Yu, Z. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.128338 · Cited by 11
Survey on Automated End-to-End Data Science?
Bouneffouf, D., Aggarwal, C. C., Hoang, T., Khurana, U., Samulowitz, H., Buesser, B., Liu, S., Pedapati, T., Ram, P., Rawat, A., et al. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207453 · Cited by 11
An Analysis of Super-Net Heuristics in Weight-Sharing NAS
Yu, K., Ranftl, R., & Salzmann, M. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3108480 · Cited by 36
Universal Binary Neural Networks Design by Improved Differentiable Neural Architecture Search
Tan, M., Gao, W., Li, H., Xie, J. F., & Gong, M. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3398691 · Cited by 11
Memory-Efficient Differentiable Transformer Architecture Search
Zhao, Y., Li, D., Shen, Y., Zhang, Z., Wei, F., & Chen, W. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.372 · Cited by 11
Zhu, W., & Wang, X. (2021) · Springer eBooks · doi:10.1007/978-3-030-88132-0_1 · Cited by 11
Understanding and Improving One-shot Neural Architecture Optimization.Preprint
Luo, R., Qin, T., & Chen, E. (2019) · arXiv (Cornell University) · Cited by 11
How can AI Automate End-to-End Data Science?Preprint
Aggarwal, C. C., Bouneffouf, D., Samulowitz, H., Buesser, B., Hoang, T., Khurana, U., Liu, S., Pedapati, T., Ram, P., Rawat, A., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.14436 · Cited by 17
Self-supervised Neural Architecture SearchPreprint
Kaplan, S., & Giryes, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.01500 · Cited by 11
HKNAS: Classification of Hyperspectral Imagery Based on Hyper Kernel Neural Architecture Search
Wang, D., Du, B., Zhang, L., & Tao, D. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3270369 · Cited by 10
ATNAS: Automatic Termination for Neural Architecture Search
Sakamoto, K., Ishibashi, H., Sato, R., Shirakawa, S., Akimoto, Y., & Hino, H. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.07.011 · Cited by 10
OCT Image Segmentation Using Neural Architecture Search and SRGAN
Dehzangi, O., Gheshlaghi, S. H., Amireskandari, A., Nasrabadi, N. M., & Rezai, A. R. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412818 · Cited by 10
Fast Evolutionary Neural Architecture Search Based on Bayesian Surrogate Model
Shi, R., Luo, J., & Liu, Q. (2021) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec45853.2021.9504999 · Cited by 10
Reconsidering CO2 emissions from Computer Vision
Fu, A., Hosseini, M. S., & Plataniotis, K. N. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00262 · Cited by 12
Population-Based Hyperparameter Tuning With Multitask Collaboration
Li, W., Wang, T., & Ng, W. W. Y. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3130896 · Cited by 11
Differentiable Architecture Search with Ensemble Gumbel-SoftmaxPreprint
Chang, J., Zhang, X., Guo, Y., Meng, G., Xiang, S., & Pan, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.01786 · Cited by 10
AstroNet: When Astrocyte Meets Artificial Neural Network
Han, M., Pan, L., & Liu, X. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01940 · Cited by 9
Zhong, R., Xu, Y., Zhang, C., & Yu, J. (2024) · Alexandria Engineering Journal · doi:10.1016/j.aej.2024.11.035 · Cited by 9
On neural architecture search and hyperparameter optimization: A max-flow based approach
Xue, C., Li, J., Wang, X., Zhan, Y., Yan, J., & Li, C.-G. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.107507 · Cited by 9
A neural architecture generator for efficient search space
Jing, K., Xu, J., & Zhang, Z. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.10.118 · Cited by 9
LPI Radar Waveform Recognition Based on Neural Architecture Search
Ma, Z., Yu, W., Zhang, P., Huang, Z. G., Lin, A., & Xia, Y. (2022) · Computational Intelligence and Neuroscience · doi:10.1155/2022/4628481 · Cited by 9
Learning to Learn by Jointly Optimizing Neural Architecture and Weights
Ding, Y., Wu, Y., Huang, C., Tang, S., Yang, Y., Wei, L., Zhuang, Y., & Tian, Q. C. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00023 · Cited by 9
Divide-and-conquer the NAS puzzle in resource-constrained federated learning systems
Venkatesha, Y., Kim, Y., Park, H., & Panda, P. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.10.006 · Cited by 9
A Survey on One-shot Neural Architecture Search
Yao, X. L., Qiu, Y., & Li, X. (2020) · IOP Conference Series Materials Science and Engineering · doi:10.1088/1757-899x/750/1/012223 · Cited by 9
Off-Policy Reinforcement Learning for Efficient and Effective GAN Architecture Search
Tian, Y., Wang, Q., Huang, Z., Li, W., Dai, D., Yang, M., Wang, Y.-X., & Fink, O. (2020) · ePrints Soton (University of Southampton) · doi:10.3929/ethz-b-000450035 · Cited by 9
LC-NAS: Latency Constrained Neural Architecture Search for Point Cloud Networks
Li, G., Xu, M., Giancola, S., Thabet, A., & Ghanem, B. (2022) · International Conference on 3D Vision (3DV) · doi:10.1109/3dv57658.2022.00018 · Cited by 12
Rakhshani, H., Idoumghar, L., Ghambari, S., Lepagnot, J., & Brévilliers, M. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2021.107596 · Cited by 9
Generative Adversarial Neural Architecture Search
Rezaei, S. S. C., Han, F. X., Niu, D., Salameh, M., Mills, K. G., Lian, S., Lu, W., & Jui, S. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/307 · Cited by 9
Chen, L. (2021) · Cognitive intelligence and robotics · doi:10.1007/978-981-16-2233-5_11 · Cited by 10
EC-DARTS: Inducing Equalized and Consistent Optimization into DARTS
Zhou, Q., Zheng, X., Cao, L., Zhong, B., Xi, T., Zhang, G., Ding, E., Xu, M., & Ji, R. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01177 · Cited by 9
Metadata
- Authors
- Xie, S., Zheng, H., Liu, C., & Lin, L.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1812.09926
- OpenAlex
- W2905672847
- Cited by
- 731
- References
- 36
- Citations by year
- 2025: 30 · 2024: 51 · 2023: 93 · 2022: 91 · 2021: 224 · 2020: 170 · 2019: 70 · 2018: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Canadian Institute for Advanced Research
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Physical Sciences › Computer Science › Artificial Intelligence › Evolutionary Algorithms and Applications
- Keywords
- neural architecture search, differentiable architecture search, credit assignment, search space optimization, end-to-end learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
