The DOI matches its DataCite record; 35 of the 36 references it cites were found in a registry or an index.
SNAS: Stochastic Neural Architecture Search
Open accessAbstract
We propose Stochastic Neural Architecture Search (SNAS), an economical end-to-end solution to Neural Architecture Search (NAS) that trains neural operation parameters and architecture distribution parameters in same round of back-propagation, while maintaining the completeness and differentiability of the NAS pipeline. In this work, NAS is reformulated as an optimization problem on parameters of a joint distribution for the search space in a cell. To leverage the gradient information in generic differentiable loss for architecture search, a novel search gradient is proposed. We prove that this search gradient optimizes the same objective as reinforcement-learning-based NAS, but assigns credits to structural decisions more efficiently. This credit assignment is further augmented with locally decomposable reward to enforce a resource-efficient constraint. In experiments on CIFAR-10, SNAS takes less epochs to find a cell architecture with state-of-the-art accuracy than non-differentiable evolution-based and reinforcement-learning-based NAS, which is also transferable to ImageNet. It is also shown that child networks of SNAS can maintain the validation accuracy in searching, with which attention-based NAS requires parameter retraining to compete, exhibiting potentials to stride towards efficient NAS on big datasets. We have released our implementation at https://github.com/SNAS-Series/SNAS-Series.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“fully decentralized variants of SGD and other optimization algorithms have recently been considered in machine learning both for improved scalability in datacenters [29] as well as for decentralized networks of devices [127, 459, 443, 59, 278, 291, 173].”
From Advances and Open Problems in Federated Learning (2021) · cites this paper as [173]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,889
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00716 · Cited by 9,982
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 8,608
ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design
Ma, N., Zhang, X., Zheng, H.-T., & Sun, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01264-9_8 · Cited by 7,356
Self-citationLearning Transferable Architectures for Scalable Image Recognition
Zoph, B., Vasudevan, V., Shlens, J., & Le, Q. V. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00907 · Cited by 6,875
Factor graphs and the sum-product algorithm
Kschischang, F. R., Frey, B. J., & Loeliger, H.-A. (2001) · IEEE Transactions on Information Theory · doi:10.1109/18.910572 · Cited by 6,486 · cited 2×
“f the global cost, consistent with the credit assignment principle in SNAS. In SNAS, p (Z) is fully factorizable, making it possible to calculate E Z˘p [C(Z)] analytically with sum-product algorithm (Kschischang et al., 2001). Unfortunately, this expectation is non-trivial to calculate, we optimize the Monte Carlo est…”
Method
Research works printed but not linked: 1
- Bowen Baker, Otkrist Gupta, Ramesh Raskar, and Nikhil Naik. Accelerating neural architecture search using performance prediction. arXiv preprint arXiv:1705.10823 , 2017. · arXiv
Cited by
Sorted by citations
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772
Neural Architecture Search: A Survey
Elsken, T., Metzen, J. H., & Hutter, F. (2018) · arXiv · doi:10.48550/arxiv.1808.05377 · Cited by 1,763
AutoML: A survey of the state-of-the-art
He, X. J., Zhao, K., & Chu, X. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106622 · Cited by 1,912
Dynamic Convolution: Attention Over Convolution Kernels
Chen, Y., Dai, X., Liu, M., Chen, D., Yuan, L., & Liu, Z. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01104 · Cited by 1,633
FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Search
Wu, B., Keutzer, K., Dai, X., Zhang, P., Wang, Y., Sun, F., Wu, Y., Tian, Y., Vajda, P., & Jia, Y. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01099 · Cited by 1,349
Auto-Keras: An Efficient Neural Architecture Search System
Jin, H., Song, Q., & Hu, X. (2019) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3292500.3330648 · Cited by 1,040
Federated Learning for Internet of Things: Recent Advances, Taxonomy, and Open Challenges
Khan, L. U., Saad, W., Han, Z., Hossain, E., & Hong, C. S. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3090430 · Cited by 892
Meta-Learning in Neural Networks: A Survey
Hospedales, T. M., Antoniou, A., Micaelli, P., & Storkey, A. J. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3079209 · Cited by 886
Raschka, S., Patterson, J. M., & Nolet, C. (2020) · Information · doi:10.3390/info11040193 · Cited by 928
Progressive Differentiable Architecture Search: Bridging the Depth Gap Between Search and Evaluation
Chen, X., Xie, L., Wu, J. H., & Tian, Q. C. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00138 · Cited by 731
Searching for a Robust Neural Architecture in Four GPU Hours
Dong, X., & Yang, Y. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00186 · Cited by 675
Random Search and Reproducibility for Neural Architecture SearchPreprint
Li, L., & Talwalkar, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.07638 · Cited by 582
PC-DARTS: Partial Channel Connections for Memory-Efficient Architecture SearchPreprint
Xu, Y., Xie, L., Zhang, X., Chen, X., Qi, G.-J., Tian, Q. C., & Xiong, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.05737 · Cited by 617
Learning Generalisable Omni-Scale Representations for Person Re-Identification
Zhou, K., Yang, Y., Cavallaro, A., & Xiang, T. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3069237 · Cited by 373
Exploring Randomly Wired Neural Networks for Image Recognition
Xie, S., Kirillov, A., Girshick, R., & He, K. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00137 · Cited by 370
Self-citationFair DARTS: Eliminating Unfair Advantages in Differentiable Architecture Search
Chu, X., Zhou, T., Zhang, B., & Li, J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58555-6_28 · Cited by 356
Rai, R., & Sahu, C. K. (2020) · IEEE Access · doi:10.1109/access.2020.2987324 · Cited by 349
FBNetV2: Differentiable Neural Architecture Search for Spatial and Channel Dimensions
Wan, A., Dai, X., Zhang, P., He, Z., Tian, Y., Xie, S., Wu, B., Yu, M., Xu, T., Chen, K., et al. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01298 · Cited by 309
Self-citationCARS: Continuous Evolution for Efficient Neural Architecture Search
Yang, Z., Wang, Y., Chen, X., Shi, B., Xu, C., Xu, C., Tian, Q. C., & Xu, C. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00190 · Cited by 298
BANANAS: Bayesian Optimization with Neural Architectures for Neural Architecture Search
White, C., Neiswanger, W., & Savani, Y. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17233 · Cited by 287
Understanding and Robustifying Differentiable Architecture SearchPreprint
Zela, A., Elsken, T., Saikia, T., Marrakchi, Y., Brox, T., & Hutter, F. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.09656 · Cited by 279
Neural Architecture Search without TrainingPreprint
Mellor, J., Turner, J., Storkey, A., & Crowley, E. J. (2020) · Edinburgh Research Explorer (University of Edinburgh) · doi:10.48550/arxiv.2006.04647 · Cited by 293
DARTS+: Improved Differentiable Architecture Search with Early StoppingPreprint
Liang, H., Zhang, S., Sun, J., He, X., Huang, W., Zhuang, K., & Li, Z. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.06035 · Cited by 349
CurveLane-NAS: Unifying Lane-Sensitive Architecture Search and Adaptive Point Blending
Xu, H., Wang, S., Cai, X., Zhang, W., Liang, X., & Li, Z. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58555-6_41 · Cited by 249
Auto-FPN: Automatic Network Architecture Adaptation for Object Detection Beyond Classification
Xu, A., Yao, A., Li, A., Liang, A., & Zhang, A. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00675 · Cited by 228
Single-Path NAS: Designing Hardware-Efficient ConvNets in Less Than 4 Hours
Stamoulis, D. S., Ding, R., Wang, D., Lymberopoulos, D., Priyantha, N. B., Liu, J., & Marculescu, D. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-46147-8_29 · Cited by 229
A Survey on Neural Architecture SearchPreprint
Wistuba, M., Rawat, A., & Pedapati, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.01392 · Cited by 358
DetNAS: Backbone Search for Object Detection
Chen, Y., Yang, T., Zhang, X., Meng, G., Xiao, X., & Sun, J. (2019) · arXiv · doi:10.48550/arxiv.1903.10979 · Cited by 205
One-Shot Neural Architecture Search via Self-Evaluated Template Network
Dong, X., & Yang, Y. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00378 · Cited by 202
SGAS: Sequential Greedy Architecture Search
Li, G., Qian, G., Delgadillo, I. C., Muller, M., Thabet, A., & Ghanem, B. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00169 · Cited by 206
Multiobjective Evolutionary Design of Deep Convolutional Neural Networks for Image Classification
Lu, Z., Whalen, I., Dhebar, Y., Deb, K., Goodman, E. D., Banzhaf, W., & Boddeti, V. N. (2020) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2020.3024708 · Cited by 221
A Comprehensive Survey of Neural Architecture Search: Challenges and SolutionsPreprint
Ren, P., Xiao, Y., Chang, X., Huang, P.-Y., Li, Z., Chen, X., & Wang, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.02903 · Cited by 193
Neuroevolution in Deep Neural Networks: Current Trends and Future Challenges
Galván, E., & Mooney, P. (2021) · IEEE Transactions on Artificial Intelligence · doi:10.1109/tai.2021.3067574 · Cited by 209
Reinforcement learning for neural architecture search: A review
Jaafra, Y., Laurent, J. L., Deruyver, A., & Naceur, M. S. (2019) · Image and Vision Computing · doi:10.1016/j.imavis.2019.06.005 · Cited by 207
From federated learning to federated neural architecture search: a survey
Zhu, H., Zhang, H., & Jin, Y. (2021) · Complex & Intelligent Systems · doi:10.1007/s40747-020-00247-z · Cited by 184
Meta-Learning of Neural Architectures for Few-Shot Learning
Elsken, T., Staffler, B., Metzen, J. H., & Hutter, F. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01238 · Cited by 179
Graph Neural Architecture Search
Gao, Y., Yang, H., Zhang, P., Zhou, C., & Hu, Y. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/195 · Cited by 226
A comprehensive survey on optimizing deep learning models by metaheuristics
Akay, B., Karaboğa, D., & Akay, R. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-021-09992-0 · Cited by 182
Zen-NAS: A Zero-Shot NAS for High-Performance Image Recognition
Lin, M., Wang, P., Sun, Z., Chen, H., Sun, X., Qian, Q., Li, H., & Jin, R. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00040 · Cited by 195
AdaShare: Learning What To Share For Efficient Deep Multi-Task Learning
Sun, X., Panda, R., Feris, R., & Saenko, K. (2019) · arXiv · doi:10.48550/arxiv.1911.12423 · Cited by 169
Differentiable quantum architecture search
Zhang, S., Hsieh, C., Zhang, S., & Yao, H. (2022) · Quantum Science and Technology · doi:10.1088/2058-9565/ac87cd · Cited by 206
Liu, R., Gao, J., Zhang, J., Meng, D., & Lin, Z. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3132674 · Cited by 190
Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired PerspectivePreprint
Chen, W., Gong, X., & Wang, Z. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.11535 · Cited by 203
BlockQNN: Efficient Block-Wise Neural Network Architecture Generation
Zhong, Z., Yang, Z., Deng, B., Yan, J., Wu, W., Shao, J., & Liu, C. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2969193 · Cited by 148
Self-citationDSNAS: Direct Neural Architecture Search Without Parameter Retraining
Hu, S., Xie, S., Zheng, H., Liu, C., Shi, J., Liu, X., & Lin, D. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01210 · Cited by 136
Self-citationAdaBits: Neural Network Quantization With Adaptive Bit-Widths
Jin, Q., Yang, L., & Liao, Z. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00222 · Cited by 139
MiLeNAS: Efficient Neural Architecture Search via Mixed-Level Reformulation
He, C., Ye, H., Shen, L., & Zhang, T. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01201 · Cited by 130
NAS evaluation is frustratingly hardPreprint
Yang, A., Esperança, P. M., & Carlucci, F. M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.12522 · Cited by 153
NPENAS: Neural Predictor Guided Evolution for Neural Architecture Search
Wei, C., Niu, C., Tang, Y., Wang, Y., Hu, H., & Liang, J. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3151160 · Cited by 137
Stabilizing Differentiable Architecture Search via Perturbation-based Regularization
Chen, X., & Hsieh, C.-J. (2020) · arXiv · doi:10.48550/arxiv.2002.05283 · Cited by 126
FBNetV3: Joint Architecture-Recipe Search using Predictor Pretraining
Dai, X., Wan, A., Zhang, P., Wu, B., He, Z., Wei, Z., Chen, K., Tian, Y., Yu, M., Vajda, P., et al. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01601 · Cited by 139
DARTS-: Robustly Stepping out of Performance Collapse Without IndicatorsPreprint
Chu, X., Wang, X., Zhang, B., Lu, S., Wei, X. K., & Yan, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.01027 · Cited by 145
Multinomial Distribution Learning for Effective Neural Architecture Search
Zheng, X., Ji, R., Tang, L., Zhang, B., Liu, J., & Tian, Q. C. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00139 · Cited by 123
EcoNAS: Finding Proxies for Economical Neural Architecture Search
Zhou, D., Zhou, X., Zhang, W., Loy, C. C., Yi, S., Zhang, X., & Ouyang, W. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01141 · Cited by 117
Neural Architecture Search Based on a Multi-Objective Evolutionary Algorithm With Probability Stack
Xue, Y., Chen, C., & Słowik, A. (2023) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2023.3252612 · Cited by 120
$\beta$-DARTS: Beta-Decay Regularization for Differentiable Architecture Search
Ye, P., Li, B., Li, Y., Chen, T., Fan, J., & Ouyang, W. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01060 · Cited by 140
Path-Restore: Learning Network Path Selection for Image Restoration
Yu, K., Wang, X., Dong, C., Tang, X., & Loy, C. C. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3096255 · Cited by 119
AdversarialNAS: Adversarial Neural Architecture Search for GANs
Gao, C., Chen, Y., Liu, S., Tan, Z., & Yan, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00572 · Cited by 111
Can Weight Sharing Outperform Random Architecture Search? An Investigation With TuNAS
Bender, G., Liu, H., Chen, B., Chu, G., Cheng, S., Kindermans, P.-J., & Le, Q. V. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01433 · Cited by 110
DCNAS: Densely Connected Neural Architecture Search for Semantic Image Segmentation
Zhang, X., Xu, H., Mo, H., Tan, J., Yang, C., Wang, L., & Ren, W. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01374 · Cited by 122
Hit-Detector: Hierarchical Trinity Architecture Search for Object Detection
Guo, J., Han, K., Wang, Y., Zhang, C., Yang, Z., Wu, H., Chen, X., & Xu, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01142 · Cited by 110
Graph-Guided Architecture Search for Real-Time Semantic Segmentation
Lin, P., Sun, P., Cheng, G., Xie, S., Li, X., & Shi, J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00426 · Cited by 108
Self-citationRethinking Architecture Selection in Differentiable NASPreprint
Wang, R., Cheng, M., Chen, X., Tang, X., & Hsieh, C. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.04392 · Cited by 106
Differentiable Automatic Data Augmentation
Li, Y., Hu, G., Wang, Y., Hospedales, T. M., Robertson, N. M., & Yang, Y. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58542-6_35 · Cited by 171
Xue, Y., Jiang, P., Neri, F., & Liang, J. (2021) · International Journal of Neural Systems · doi:10.1142/s0129065721500350 · Cited by 103
Learning to Branch for Multi-Task LearningPreprint
Guo, P., Lee, C., & Ulbricht, D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.01895 · Cited by 99
Improved Differentiable Architecture Search for Language Modeling and Named Entity Recognition
Jiang, Y., Hu, C., Xiao, T., Zhang, C., & Zhu, J. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1367 · Cited by 101
Neural Input Search for Large Scale Recommendation Models
Joglekar, M., Li, C., Chen, M., Xu, T., Wang, X., Adams, J. K., Khaitan, P., Liu, J., & Le, Q. V. (2020) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3394486.3403288 · Cited by 98
Efficient Neural Architecture Search via Proximal Iterations
Yao, Q., Xu, J., Tu, W.-W., & Zhu, Z. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6143 · Cited by 104
Progressive DARTS: Bridging the Optimization Gap for NAS in the Wild
Chen, X., Xie, L., Wu, J. H., & Tian, Q. C. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-020-01396-x · Cited by 103
Zhang, T., Lei, C., Zhang, Z., Meng, X.-B., & Chen, C. L. P. (2021) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2021.3061466 · Cited by 96
Recent Progress in the CUHK Dysarthric Speech Recognition System
Liu, S., Geng, M., Hu, S., Xie, X., Cui, M., Yu, J., Liu, X., & Meng, H. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2021.3091805 · Cited by 96
Search to aggregate neighborhood for graph neural network
Zhao, H., Yao, Q., & Tu, W.-W. (2021) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde51399.2021.00054 · Cited by 102
Neural predictor based quantum architecture search
Zhang, S.-X., Hsieh, C.-Y., Zhang, S., & Yao, H. (2021) · Machine Learning: Science and Technology · doi:10.1088/2632-2153/ac28dd · Cited by 88
Partial Connection Based on Channel Attention for Differentiable Neural Architecture Search
Xue, Y., & Qin, J. (2022) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2022.3184700 · Cited by 87
Zhang, H., Jin, Y., Cheng, R., & Hao, K. (2020) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2020.3040272 · Cited by 97
Exploring Relational Context for Multi-Task Dense Prediction
Brüggemann, D., Kanakis, M., Obukhov, A., Georgoulis, S., & Gool, L. V. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01557 · Cited by 90
Overcoming Multi-Model Forgetting in One-Shot NAS With Diversity Maximization
Zhang, M., Li, H., Pan, S., Chang, X., & Su, S. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00783 · Cited by 83
AdaBERT: Task-Adaptive BERT Compression with Differentiable Neural Architecture Search
Chen, D., Li, Y., Qiu, M., Wang, Z., Li, B., Ding, B., Deng, H., Huang, J., Lin, W., & Zhou, J. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/341 · Cited by 109
You Only Search Once: Single Shot Neural Architecture Search via Direct Sparse Optimization
Zhang, X., Huang, Z., Wang, N., Xiang, S., & Pan, C. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3020300 · Cited by 94
Chen, Z., Qiu, G., Li, P., Zhu, L., Yang, X., & Sheng, B. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3293885 · Cited by 84
MTL-NAS: Task-Agnostic Neural Architecture Search Towards General-Purpose Multi-Task Learning
Gao, Y., Bai, H., Jie, Z., Ma, J., Jia, K., & Liu, W. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01156 · Cited by 83
A Review of the Gumbel-max Trick and its Extensions for Discrete Stochasticity in Machine Learning
Huijben, I. A. M., Kool, W., Paulus, M. B., & van Sloun, R. J. G. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3157042 · Cited by 106
Particle Swarm Optimization for Compact Neural Architecture Search for Image Classification
Huang, J., Xue, B., Sun, Y., Zhang, M., & Yen, G. G. (2022) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2022.3217290 · Cited by 85
One-Shot Neural Architecture Search: Maximising Diversity to Overcome Catastrophic Forgetting
Zhang, M., Li, H., Pan, S., Chang, X., Zhou, C. D., Ge, Z., & Su, S. W. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3035351 · Cited by 81
Partially-Connected Neural Architecture Search for Reduced Computational Redundancy
Xu, Y., Xie, L., Dai, W., Zhang, X., Chen, X., Qi, G.-J., Xiong, H., & Tian, Q. C. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3059510 · Cited by 81
AutoDispNet: Improving Disparity Estimation With AutoML
Saikia, T., Marrakchi, Y., Zela, A., Hutter, F., & Brox, T. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00190 · Cited by 78
ASAP: Architecture Search, Anneal and PrunePreprint
Noy, A., Nayman, N., Ridnik, T., Zamir, N., Doveh, S., Friedman, I., Giryes, R., & Zelnik‐Manor, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.04123 · Cited by 83
Bridging the Gap between Sample-based and One-shot Neural Architecture Search with BONASPreprint
Han, S., Pi, R., Xu, H., Li, Z., Kwok, J. T.-Y., & Zhang, T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.09336 · Cited by 91
Improving One-Shot NAS by Suppressing the Posterior Fading
Li, X., Chen, L., Li, C., Sun, M., Wu, W., Yan, J., & Ouyang, W. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01385 · Cited by 73
SqueezeNAS: Fast Neural Architecture Search for Faster Semantic Segmentation
Shaw, A., Daniel, H., Landola, F., & Sidhu, S. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00251 · Cited by 81
FracBits: Mixed Precision Quantization via Fractional Bit-Widths
Yang, L., & Jin, Q. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17269 · Cited by 76
DetNAS: Neural Architecture Search on Object Detection.Preprint
Chen, Y., Yang, T., Zhang, X., Meng, G., Pan, C., & Sun, J. (2019) · arXiv (Cornell University) · Cited by 75
XNAS: Neural Architecture Search with Expert AdvicePreprint
Nayman, N., Noy, A., Ridnik, T., Friedman, I., Jin, R., & Zelnik‐Manor, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.08031 · Cited by 75
NAS-Bench-1Shot1: Benchmarking and Dissecting One-shot Neural Architecture SearchPreprint
Zela, A., Siems, J., & Hutter, F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.10422 · Cited by 74
SP-NAS: Serial-to-Parallel Backbone Search for Object Detection
Jiang, C., Xu, H., Zhang, W., Liang, X., & Li, Z. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01188 · Cited by 67
DiffMG: Differentiable Meta Graph Search for Heterogeneous Graph Neural Networks
Ding, Y., Yao, Q., Zhao, H., & Zhang, T. (2021) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3447548.3467447 · Cited by 70
Li, J., Cao, X., Chen, R., Zhang, X., Huang, X., & Qu, Y. (2023) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2023.110701 · Cited by 70
Understanding Architectures Learnt by Cell-based Neural Architecture SearchPreprint
Shu, Y., Wang, W., & Cai, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.09569 · Cited by 70
EEEA-Net: An Early Exit Evolutionary Neural Architecture Search
Termritthikun, C., Jamtsho, Y., Ieamsaard, J., Muneesawang, P., & Lee, I. (2021) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2021.104397 · Cited by 68
Metadata
- Authors
- Xie, S., Zheng, H., Liu, C., & Lin, L.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1812.09926
- OpenAlex
- W2905672847
- Cited by
- 731
- References
- 36
- Citations by year
- 2025: 30 · 2024: 51 · 2023: 93 · 2022: 91 · 2021: 224 · 2020: 170 · 2019: 70 · 2018: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Canadian Institute for Advanced Research
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Physical Sciences › Computer Science › Artificial Intelligence › Evolutionary Algorithms and Applications
- Keywords
- neural architecture search, differentiable architecture search, credit assignment, search space optimization, end-to-end learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
