The DOI matches its DataCite record; 35 of the 36 references it cites were found in a registry or an index.
SNAS: Stochastic Neural Architecture Search
Open accessAbstract
We propose Stochastic Neural Architecture Search (SNAS), an economical end-to-end solution to Neural Architecture Search (NAS) that trains neural operation parameters and architecture distribution parameters in same round of back-propagation, while maintaining the completeness and differentiability of the NAS pipeline. In this work, NAS is reformulated as an optimization problem on parameters of a joint distribution for the search space in a cell. To leverage the gradient information in generic differentiable loss for architecture search, a novel search gradient is proposed. We prove that this search gradient optimizes the same objective as reinforcement-learning-based NAS, but assigns credits to structural decisions more efficiently. This credit assignment is further augmented with locally decomposable reward to enforce a resource-efficient constraint. In experiments on CIFAR-10, SNAS takes less epochs to find a cell architecture with state-of-the-art accuracy than non-differentiable evolution-based and reinforcement-learning-based NAS, which is also transferable to ImageNet. It is also shown that child networks of SNAS can maintain the validation accuracy in searching, with which attention-based NAS requires parameter retraining to compete, exhibiting potentials to stride towards efficient NAS on big datasets. We have released our implementation at https://github.com/SNAS-Series/SNAS-Series.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“fully decentralized variants of SGD and other optimization algorithms have recently been considered in machine learning both for improved scalability in datacenters [29] as well as for decentralized networks of devices [127, 459, 443, 59, 278, 291, 173].”
From Advances and Open Problems in Federated Learning (2021) · cites this paper as [173]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,889
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00716 · Cited by 9,982
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 8,608
ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design
Ma, N., Zhang, X., Zheng, H.-T., & Sun, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01264-9_8 · Cited by 7,356
Self-citationLearning Transferable Architectures for Scalable Image Recognition
Zoph, B., Vasudevan, V., Shlens, J., & Le, Q. V. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00907 · Cited by 6,875
Factor graphs and the sum-product algorithm
Kschischang, F. R., Frey, B. J., & Loeliger, H.-A. (2001) · IEEE Transactions on Information Theory · doi:10.1109/18.910572 · Cited by 6,486 · cited 2×
“f the global cost, consistent with the credit assignment principle in SNAS. In SNAS, p (Z) is fully factorizable, making it possible to calculate E Z˘p [C(Z)] analytically with sum-product algorithm (Kschischang et al., 2001). Unfortunately, this expectation is non-trivial to calculate, we optimize the Monte Carlo est…”
Method
Research works printed but not linked: 1
- Bowen Baker, Otkrist Gupta, Ramesh Raskar, and Nikhil Naik. Accelerating neural architecture search using performance prediction. arXiv preprint arXiv:1705.10823 , 2017. · arXiv
Cited by
Sorted by citations
Items 101–200 of 729
DrNAS: Dirichlet Neural Architecture SearchPreprint
Chen, X., Wang, R., Cheng, M., Tang, X., & Hsieh, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10355 · Cited by 79
Evolutionary neural architecture search for remaining useful life prediction
Mo, H., Custode, L. L., & Iacca, G. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2021.107474 · Cited by 67
Probabilistic Neural Architecture SearchPreprint
Casale, F. P., Gordon, J. A. R., & Fusi, N. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.05116 · Cited by 71
GraphNAS: Graph Neural Architecture Search with Reinforcement LearningPreprint
Gao, Y., Yang, H. T., Zhang, P., Zhou, C. D., & Hu, Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.09981 · Cited by 67
Mixed Precision Neural Architecture Search for Energy Efficient Deep Learning
Gong, C., Jiang, Z., Wang, D., Lin, Y., Liu, Q., & Pan, D. Z. (2019) · doi:10.1109/iccad45719.2019.8942147 · Cited by 68
Automated Machine Learning on Graphs: A Survey
Zhang, Z., Wang, X., & Zhu, W. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/637 · Cited by 89
AutoEmb: Automated Embedding Dimensionality Search in Streaming Recommendations
Zhaok, X., Liu, H., Fan, W., Liu, H., Tang, J., Wang, C., Chen, M., Zheng, X., Liu, X., & Yang, X. (2021) · Proceedings · doi:10.1109/icdm51629.2021.00101 · Cited by 67
A Semi-Supervised Assessor of Neural Architectures
Tang, Y., Wang, Y., Xu, Y., Chen, H., Shi, B., Xu, C., Xu, C., Tian, Q. C., & Xu, C. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00188 · Cited by 71
HR-NAS: Searching Efficient High-Resolution Neural Architectures with Lightweight Transformers
Ding, M., Lian, X., Yang, L., Wang, P., Jin, X., Lu, Z., & Luo, P. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00300 · Cited by 67
Hybrid Message Passing with Performance-Driven Structures for Facial Action Unit Detection
Song, T., Cui, Z., Zheng, W., & Ji, Q. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00620 · Cited by 67
Neural Architecture Search With a Lightweight Transformer for Text-to-Image Synthesis
Li, W., Wen, S., Shi, K., Yang, Y., & Huang, T. (2022) · IEEE Transactions on Network Science and Engineering · doi:10.1109/tnse.2022.3147787 · Cited by 67
Shapley-NAS: Discovering Operation Contribution for Neural Architecture Search
Xiao, H., Wang, Z., Zhu, Z., Zhou, J., & Lu, J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01159 · Cited by 69
Domain Generalization in Vision: A SurveyPreprint
Zhou, K., Liu, Z., Qiao, Y., Xiang, T., & Loy, C. C. (2021) · arXiv (Cornell University) · Cited by 65
Searching for Low-Bit Weights in Quantized Neural Networks
Yang, Z., Wang, Y., Han, K., Xu, C., Xu, C., Tao, D., & Xu, C. (2020) · arXiv · doi:10.48550/arxiv.2009.08695 · Cited by 64
Dong, H., Zou, B., Zhang, L., & Zhang, S. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2976694 · Cited by 63
Cyclic Differentiable Architecture Search
Yu, H., Peng, H., Huang, Y., Fu, J., Du, H., Wang, L., & Ling, H. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3153065 · Cited by 63
BATS: Binary ArchitecTure Search
Bulat, A., Martínez, B., & Tzimiropoulos, G. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58592-1_19 · Cited by 64
FP-DARTS: Fast parallel differentiable neural architecture search for image classification
Wang, W., Zhang, X., Cui, H., Yin, H., & Zhang, Y. (2022) · Pattern Recognition · doi:10.1016/j.patcog.2022.109193 · Cited by 61
Semi-Supervised Neural Architecture SearchPreprint
Luo, R., Tan, X., Wang, R., Qin, T., Chen, E., & Liu, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.10389 · Cited by 64
DOTS: Decoupling Operation and Topology in Differentiable Architecture Search
Gu, Y., Wang, L., Liu, Y., Yang, Y., Wu, Y.-H., Lu, S.-P., & Cheng, M. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01213 · Cited by 61
A Gradient-Guided Evolutionary Neural Architecture Search
Xue, Y., Han, X., Neri, F., Qin, J., & Pelusi, D. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3371432 · Cited by 58
GP-NAS: Gaussian Process Based Neural Architecture Search
Li, Z., Xi, T., Deng, J., Zhang, G., Wen, S., & He, R. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01195 · Cited by 59
Evolving Deep Convolutional Variational Autoencoders for Image Classification
Chen, X., Sun, Y., Zhang, M., & Peng, D. (2020) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2020.3047220 · Cited by 59
DropNAS: Grouped Operation Dropout for Differentiable Architecture Search
Hong, W., Li, G., Zhang, W., Tang, R., Wang, Y., Li, Z., & Yu, Y. J. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/322 · Cited by 56
Baldeon-Calisto, M., & Lai-Yuen, S. K. (2021) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2021.102154 · Cited by 54
Evolutionary Search for Complete Neural Network Architectures With Partial Weight Sharing
Zhang, H., Jin, Y., & Hao, K. (2022) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2022.3140855 · Cited by 56
Improving One-Shot NAS with Shrinking-and-Expanding Supernet
Hu, Y., Wang, X., Li, L., & Gu, Q. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.108025 · Cited by 52
Benchmarking lightweight face architectures on specific face recognition scenarios
Martínez-Díaz, Y., Nicolás-Díaz, M., Méndez-Vázquez, H., Luévano, L. S., Chang, L., González-Mendoza, M., & Sucar, L. E. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-021-09974-2 · Cited by 57
Cheung, T.-H., & Yeung, D. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3282258 · Cited by 59
Searching for CNN Architectures for Remote Sensing Scene Classification
Broni-Bediako, C., Murata, Y., Mormille, L. H., & Atsumi, M. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3097938 · Cited by 55
AdvRush: Searching for Adversarially Robust Neural Architectures
Mok, J., Na, B., Choe, H., & Yoon, S. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01210 · Cited by 54
Zero-Shot Neural Architecture Search: Challenges, Solutions, and Opportunities
Li, G., Hoang, D., Bhardwaj, K., Lin, M., Wang, Z., & Mărculescu, R. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3395423 · Cited by 62
PADS: Policy-Adapted Sampling for Visual Similarity Learning
Roth, K., Milbich, T., & Ommer, B. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00660 · Cited by 51
Fine-Tuning DARTS for Image Classification
Tanveer, M., Khan, M. U. K., & Kyung, C. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9412221 · Cited by 54
Yang, Y., You, S., Li, H., Wang, F., Qian, C., & Lin, Z. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00660 · Cited by 48
Neural Architecture Search and Hardware Accelerator Co-Search: A Survey
Sekanina, L. (2021) · IEEE Access · doi:10.1109/access.2021.3126685 · Cited by 50
Split-Level Evolutionary Neural Architecture Search With Elite Weight Inheritance
Huang, J., Xue, B., Sun, Y., Zhang, M., & Yen, G. G. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3269816 · Cited by 49
DANCE: Differentiable Accelerator/Network Co-Exploration
Choi, K., Hong, D., Yoon, H., Yu, J., Kim, Y., & Lee, J. (2021) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac18074.2021.9586121 · Cited by 48
RelativeNAS: Relative Neural Architecture Search via Slow-Fast Learning
Tan, H. X., Cheng, R., Huang, S., He, C., Qiu, C., Yang, F., & Luo, P. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3096658 · Cited by 51
MIGO-NAS: Towards Fast and Generalizable Neural Architecture Search
Zheng, X., Ji, R., Chen, Y., Wang, Q., Zhang, B., Chen, J., Ye, Q., Huang, F., & Tian, Y. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3065138 · Cited by 50
DSRNA: Differentiable Search of Robust Neural Architectures
Hosseini, R., Yang, X., & Xie, P. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00613 · Cited by 50
Gradient Descent Effects on Differential Neural Architecture Search: A Survey
Santra, S., Hsieh, J.-W., & Lin, C. (2021) · IEEE Access · doi:10.1109/access.2021.3090918 · Cited by 53
Learning Implicitly Recurrent CNNs Through Parameter SharingPreprint
Savarese, P., & Maire, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.09701 · Cited by 66
HGNAS++: Efficient Architecture Search for Heterogeneous Graph Neural Networks
Gao, Y., Zhang, P., Zhou, C. D., Yang, H. B., Li, Z., Hu, Y., & Yu, P. S. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3239842 · Cited by 47
Does Unsupervised Architecture Representation Learning Help Neural Architecture Search?Preprint
Shen, Y., Zheng, Y., Ao, W., Zeng, X., & Zhang, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.06936 · Cited by 49
Cai, S., Shu, Y., & Wang, W. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00363 · Cited by 46
DAIS: Automatic Channel Pruning via Differentiable Annealing Indicator Search
Guan, Y., Liu, N., Zhao, P., Che, Z., Bian, K., Wang, Y., & Tang, J. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3161284 · Cited by 46
Neural Architecture Search for GNN-Based Graph Classification
Wei, L., Zhao, H., He, Z., & Yao, Q. (2023) · ACM Transactions on Information Systems · doi:10.1145/3584945 · Cited by 45
Malleable 2.5D Convolution: Learning Receptive Fields Along the Depth-Axis for RGB-D Scene Parsing
Xing, Y., Wang, J., & Zeng, G. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58529-7_33 · Cited by 45
DADA: Differentiable Automatic Data AugmentationPreprint
Li, Y., Hu, G., Wang, Y., Hospedales, T. M., Robertson, N. M., & Yang, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.03780 · Cited by 45
DeepMAD: Mathematical Architecture Design for Deep Convolutional Neural Network
Shen, X., Wang, Y., Lin, M. V., Huang, Y., Tang, H., Sun, X., & Wang, Y. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00597 · Cited by 45
MedNAS: Multiscale Training-Free Neural Architecture Search for Medical Image Analysis
Wang, Y., Zhen, L., Zhang, J., Li, M., Zhang, L., Wang, Z., Feng, Y., Xue, Y., Wang, X., Chen, Z., et al. (2024) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2024.3352641 · Cited by 45
Towards Accurate and Compact Architectures via Neural Architecture Transformer
Guo, Y. F., Zheng, Y., Tan, M., Chen, Q., Li, Z., Chen, J., Zhao, P., & Huang, J. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3086914 · Cited by 106
Advances in Pruning and Quantization for Natural Language Processing
Bibi, U., Mazhar, M., Sabir, D., Butt, M. F. U., Hassan, A., Ghazanfar, M. A., Khan, A. A., & Abdul, W. (2024) · IEEE Access · doi:10.1109/access.2024.3465631 · Cited by 47
MergeNAS: Merge Operations into One for Differentiable Architecture Search
Wang, X., Xue, C., Yan, J., Yang, X., Hu, Y., & Sun, K. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/424 · Cited by 43
Stabilizing DARTS with Amended Gradient Estimation on Architectural ParametersPreprint
Bi, K., Hu, C., Xie, L., Chen, X., Wei, L., & Tian, Q. C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.11831 · Cited by 55
Improved Differentiable Architecture Search With Multi-Stage Progressive Partial Channel Connections
Xue, Y., Lu, C., Neri, F., & Qin, J. (2023) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2023.3301395 · Cited by 42
Advances in neural architecture search
Wang, X. Y., & Zhu, W. (2024) · National Science Review · doi:10.1093/nsr/nwae282 · Cited by 42
Learning Architectures for Binary Networks
Kim, D., Singh, K. P., & Choi, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58610-2_34 · Cited by 42
Multi-modal spatio-temporal meteorological forecasting with deep neural network
Zhang, X., Jin, Q., Yu, T., Xiang, S., Kuang, Q., Prinet, V., & Pan, C. (2022) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2022.03.007 · Cited by 42
Dynamic Heterogeneous Graph Attention Neural Architecture Search
Zhang, Z., Zhang, Z., Wang, X. Y., Qin, Y., Qin, Z., & Zhu, W. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i9.26338 · Cited by 41
Neural Architecture Search for Keyword Spotting
Mo, T., Yu, Y., Salameh, M., Niu, D., & Jui, S. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-3132 · Cited by 39
Effective Sparsification of Neural Networks with Global Sparsity Constraint
Zhou, X. Y., Zhang, W., Xu, H., & Zhang, T. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00360 · Cited by 45
Interpretable Neural Architecture Search via Bayesian Optimisation with Weisfeiler-Lehman KernelsPreprint
Ru, B., Wan, X., Dong, X., & Osborne, M. A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.07556 · Cited by 41
GraphNAS++: Distributed Architecture Search for Graph Neural Networks
Gao, Y., Zhang, P., Yang, H., Zhou, C., Hu, Y., Tian, Z., Li, Z., & Zhou, J.-R. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3178153 · Cited by 39
Differentiable Feature Aggregation Search for Knowledge Distillation
Guan, Y., Zhao, P., Wang, B., Zhang, Y., Yao, C., Bian, K., & Tang, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58520-4_28 · Cited by 42
Exploiting Operation Importance for Differentiable Neural Architecture Search
Zhou, Y., Xie, X., & Kung, S. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3072950 · Cited by 43
Automated design of error-resilient and hardware-efficient deep neural networks
Schorn, C., Elsken, T., Vogel, S., Runge, A., Guntoro, A., & Ascheid, G. (2020) · Neural Computing and Applications · doi:10.1007/s00521-020-04969-6 · Cited by 41
Direct Differentiable Augmentation Search
Liu, A., Huang, Z., Huang, Z., & Wang, N. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01200 · Cited by 44
Cheng, P., Li, Y., Shang, R., & Jiao, L. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3192169 · Cited by 40
Yu, Z., Lee, F., & Chen, Q. (2023) · Applied Intelligence · doi:10.1007/s10489-023-04570-z · Cited by 38
Differentiable Learning-to-Group Channels via Groupable Convolutional Neural Networks
Zhang, Z., Li, J., Shao, W., Peng, Z., Zhang, R., Wang, X., & Luo, P. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00364 · Cited by 38
Designing the Topology of Graph Neural Networks: A Novel Feature Fusion Perspective
Wei, L., Zhao, H., & He, Z. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3512185 · Cited by 39
Accelerating Evolutionary Neural Architecture Search via Multifidelity Evaluation
Yang, S., Tian, Y., Xiang, X., Peng, S., & Zhang, X. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2022.3179482 · Cited by 39
Toward Evolutionary Multitask Convolutional Neural Architecture Search
Zhou, X., Wang, Z., Feng, L., Liu, S., Wong, K., & Tan, K. C. (2023) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2023.3348475 · Cited by 36
A NAS-Based TinyML for Secure Authentication Detection on SAGVN-Enabled Consumer Edge Devices
Chen, X., Zhang, S., Li, Q., Zhu, F., Feng, A., Nkenyereye, L., & Rani, S. (2024) · IEEE Transactions on Consumer Electronics · doi:10.1109/tce.2024.3513331 · Cited by 36
Searching to Sparsify Tensor Decomposition for N-ary Relational Data
Di, S., Yao, Q., & Chen, L. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3449853 · Cited by 37
UNAS: Differentiable Architecture Search Meets Reinforcement Learning
Vahdat, A., Mallya, A., Liu, M.-Y., & Kautz, J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01128 · Cited by 35
A New Deep Neural Architecture Search Pipeline for Face Recognition
Zhu, N., Yu, Z., & Kou, C. (2020) · IEEE Access · doi:10.1109/access.2020.2994207 · Cited by 37
Khawar, F., Hang, X., Tang, R., Liu, B., Li, Z., & He, X. (2020) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3340531.3411912 · Cited by 35
Nguyen, N., & Chang, J. M. (2021) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2021.3121663 · Cited by 36
Auto-FSL: Searching the Attribute Consistent Network for Few-Shot Learning
Zhang, L., Wang, S., Chang, X., Liu, J., Ge, Z., & Zheng, Q. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3076523 · Cited by 35
Discretization-aware architecture search
Tian, Y., Liu, C., Xie, L., Jiao, J., & Ye, Q. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.108186 · Cited by 34
Self-citationAutomated Search for Resource-Efficient Branched Multi-Task Networks
Brüggemann, D., Kanakis, M., Georgoulis, S., & Gool, L. V. (2020) · British Machine Vision Conference (BMVC) · doi:10.5244/c.34.93 · Cited by 34
Fang, Z., Ren, J., Marshall, S., Zhao, H., Wang, S., & Li, X. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107608 · Cited by 34
A Cell-Based Fast Memetic Algorithm for Automated Convolutional Neural Architecture Design
Dong, J., Hou, B., Feng, L., Tang, H., Tan, K. C., & Ong, Y.-S. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3155230 · Cited by 36
An architecture entropy regularizer for differentiable neural architecture search
Jing, K., Chen, L., & Xu, J. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.11.015 · Cited by 33
Rethinking Performance Estimation in Neural Architecture Search
Zheng, X., Ji, R., Wang, Q., Ye, Q., Li, Z., Tian, Y., & Tian, Q. C. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01137 · Cited by 32
DARTS-ASR: Differentiable Architecture Search for Multilingual Speech Recognition and Adaptation
Chen, Y., Hsu, J.-Y., Lee, C., & Lee, H.-Y. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1315 · Cited by 34
Object Detection Deployed on UAVs for Oblique Images by Fusing IMU Information
Shen, H., Lin, D., & Song, T. (2022) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2022.3141109 · Cited by 33
Deeper Insights into Weight Sharing in Neural Architecture SearchPreprint
Zhang, Y., Lin, Z., Jiang, J., Zhang, Q., Wang, Y., Xue, H., Zhang, C., & Yang, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.01431 · Cited by 48
Single-Path Mobile AutoML: Efficient ConvNet Design and NAS Hyperparameter Optimization
Stamoulis, D. S., Ding, R., Wang, D., Lymberopoulos, D., Priyantha, N. B., Liu, J., & Marculescu, D. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2971421 · Cited by 35
GOLD-NAS: Gradual, One-Level, DifferentiablePreprint
Bi, K., Xie, L., Chen, X., Wei, L., & Tian, Q. C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.03331 · Cited by 44
Stronger NAS with Weaker PredictorsPreprint
Wu, J., Dai, X., Chen, D., Chen, Y., Liu, M., Yu, Y., Wang, Z., Liu, Z., Chen, M., & Yuan, L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.10490 · Cited by 33
Training Data Subset Search With Ensemble Active Learning
Chitta, K., Álvarez, J. M., Haußmann, E., & Farabet, C. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3133268 · Cited by 45
Self-Supervised Representation Learning for Evolutionary Neural Architecture Search
Wei, C., Tang, Y., Niu, C., Hu, H., Wang, Y., & Liang, J. (2021) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2021.3084415 · Cited by 36
BN-NAS: Neural Architecture Search with Batch Normalization
Chen, B., Li, P., Li, B., Chen, L., Li, C., Sun, M., Yan, J., & Ouyang, W. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00037 · Cited by 34
Geometry-Aware Gradient Algorithms for Neural Architecture SearchPreprint
Li, L., Khodak, M., Balcan, M.-F., & Talwalkar, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.07802 · Cited by 38
2D and 3D Palmprint and Palm Vein Recognition Based on Neural Architecture Search
Jia, W., Xia, W., Zhao, Y., Min, H., & Chen, Y. (2021) · Machine Intelligence Research · doi:10.1007/s11633-021-1292-1 · Cited by 31
Toward Tailored Models on Private AIoT Devices: Federated Direct Neural Architecture Search
Zhang, C., Yuan, X., Zhang, Q., Zhu, G., Cheng, L., & Zhang, N. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3154605 · Cited by 34
Metadata
- Authors
- Xie, S., Zheng, H., Liu, C., & Lin, L.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1812.09926
- OpenAlex
- W2905672847
- Cited by
- 731
- References
- 36
- Citations by year
- 2025: 30 · 2024: 51 · 2023: 93 · 2022: 91 · 2021: 224 · 2020: 170 · 2019: 70 · 2018: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Canadian Institute for Advanced Research
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Physical Sciences › Computer Science › Artificial Intelligence › Evolutionary Algorithms and Applications
- Keywords
- neural architecture search, differentiable architecture search, credit assignment, search space optimization, end-to-end learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
