The DOI matches its DataCite record; 35 of the 36 references it cites were found in a registry or an index.
SNAS: Stochastic Neural Architecture Search
Open accessAbstract
We propose Stochastic Neural Architecture Search (SNAS), an economical end-to-end solution to Neural Architecture Search (NAS) that trains neural operation parameters and architecture distribution parameters in same round of back-propagation, while maintaining the completeness and differentiability of the NAS pipeline. In this work, NAS is reformulated as an optimization problem on parameters of a joint distribution for the search space in a cell. To leverage the gradient information in generic differentiable loss for architecture search, a novel search gradient is proposed. We prove that this search gradient optimizes the same objective as reinforcement-learning-based NAS, but assigns credits to structural decisions more efficiently. This credit assignment is further augmented with locally decomposable reward to enforce a resource-efficient constraint. In experiments on CIFAR-10, SNAS takes less epochs to find a cell architecture with state-of-the-art accuracy than non-differentiable evolution-based and reinforcement-learning-based NAS, which is also transferable to ImageNet. It is also shown that child networks of SNAS can maintain the validation accuracy in searching, with which attention-based NAS requires parameter retraining to compete, exhibiting potentials to stride towards efficient NAS on big datasets. We have released our implementation at https://github.com/SNAS-Series/SNAS-Series.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“fully decentralized variants of SGD and other optimization algorithms have recently been considered in machine learning both for improved scalability in datacenters [29] as well as for decentralized networks of devices [127, 459, 443, 59, 278, 291, 173].”
From Advances and Open Problems in Federated Learning (2021) · cites this paper as [173]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,889
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015
Proximal Policy Optimization Algorithms
Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017) · arXiv · doi:10.48550/arxiv.1707.06347 · Cited by 10,625
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00716 · Cited by 9,982
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 8,608
ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design
Ma, N., Zhang, X., Zheng, H.-T., & Sun, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01264-9_8 · Cited by 7,356
Self-citationLearning Transferable Architectures for Scalable Image Recognition
Zoph, B., Vasudevan, V., Shlens, J., & Le, Q. V. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00907 · Cited by 6,875
Factor graphs and the sum-product algorithm
Kschischang, F. R., Frey, B. J., & Loeliger, H.-A. (2001) · IEEE Transactions on Information Theory · doi:10.1109/18.910572 · Cited by 6,486 · cited 2×
“f the global cost, consistent with the credit assignment principle in SNAS. In SNAS, p (Z) is fully factorizable, making it possible to calculate E Z˘p [C(Z)] analytically with sum-product algorithm (Kschischang et al., 2001). Unfortunately, this expectation is non-trivial to calculate, we optimize the Monte Carlo est…”
Method
Research works printed but not linked: 1
- Bowen Baker, Otkrist Gupta, Ramesh Raskar, and Nikhil Naik. Accelerating neural architecture search using performance prediction. arXiv preprint arXiv:1705.10823 , 2017. · arXiv
Cited by
Sorted by citations
Items 201–300 of 729
LightNAS: On Lightweight and Scalable Neural Architecture Search for Embedded Platforms
Luo, X., Liu, D., Kong, H., Huai, S., Chen, H., & Liu, W. (2022) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2022.3208187 · Cited by 32
Manas: multi-agent neural architecture search
Lopes, V., Carlucci, F. M., Esperança, P. M., Singh, M., Yang, A., Gabillon, V., Xu, H., Chen, Z., & Wang, J. (2023) · Machine Learning · doi:10.1007/s10994-023-06379-w · Cited by 38
Auto-Prox: Training-Free Vision Transformer Architecture Search via Automatic Proxy Discovery
Wei, Z., Dong, P., Hui, Z., Li, A., Li, L., Lu, M., Pan, H., & Li, D. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i14.29511 · Cited by 30
Bayesian Differentiable Architecture Search for Efficient Domain Matching Fault Diagnosis
Zhou, Z., Li, T., Zhang, Z., Zhao, Z., Sun, C., Yan, R., & Chen, X. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3076575 · Cited by 30
Bayesian Neural Network Language Modeling for Speech Recognition
Xue, B., Hu, S., Xu, J., Geng, M., Liu, X., & Meng, H. M. L. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3203891 · Cited by 30
Wan, Y., Zhong, Y., Ma, A., Wang, J., & Zhang, L. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3220699 · Cited by 32
Burrello, A., Risso, M., Motetti, B. A., Macii, E., Luca Benini, C., & Pagliari, D. J. (2023) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2023.3322033 · Cited by 30
Differentiable Neural Architecture Search in Equivalent Space with Exploration Enhancement
Zhang, M., Li, H., Pan, S., Chang, X., Ge, Z., & Su, S. W. (2020) · Monash University Research Portal (Monash University) · Cited by 29
NAS-OoD: Neural Architecture Search for Out-of-Distribution Generalization
Bai, H., Zhou, F., Hong, L., Ye, N., Chan, S.-H. G., & Li, Z. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00821 · Cited by 29
MixPath: A Unified Approach for One-shot Neural Architecture Search
Chu, X., Lu, S., Li, X., & Zhang, B. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00549 · Cited by 33
AutoHAS: Efficient Hyperparameter and Architecture SearchPreprint
Dong, X., Tan, M., Yu, A. W., Peng, D., Gabryś, B., & Le, Q. V. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.03656 · Cited by 49
Revisiting Parameter Sharing for Automatic Neural Channel Number Search
Wang, J., Bai, H., Wu, J., Shi, X., Huang, J., King, I., Lyu, M. R.-T., & Cheng, J. (2020) · neural information processing systems · Cited by 27
Software/Hardware Co-design for Multi-modal Multi-task Learning in Autonomous Systems
Hao, C., & Chen, D. (2021) · IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS) · doi:10.1109/aicas51828.2021.9458577 · Cited by 27
Layer-wise Searching for 1-bit Detectors
Xu, S. H., Zhao, J., Lü, J., Zhang, B., Han, S., & Doermann, D. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00563 · Cited by 27
Ye, F., Lin, B., Yue, Z., Zhang, Y., & Tsang, I. W.-H. (2024) · Artificial Intelligence · doi:10.1016/j.artint.2024.104184 · Cited by 27
Chen, W., Gong, X., Wu, J., Wei, Y., Shi, H., Yan, Z., Yang, Y., & Wang, Z. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3328347 · Cited by 28
Latency-Aware Differentiable Neural Architecture SearchPreprint
Xu, Y., Xie, L., Zhang, X., Chen, X., Shi, B., Tian, Q. C., & Xiong, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.06392 · Cited by 38
Multiagent Reinforcement Learning for Hyperparameter Optimization of Convolutional Neural Networks
Iranfar, A., Zapater, M., & Atienza, D. (2021) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2021.3077193 · Cited by 29
iDARTS: Improving DARTS by Node Normalization and Decorrelation Discretization
Wang, H., Yang, R., Huang, D., & Wang, Y. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3105698 · Cited by 30
Search to Pass Messages for Temporal Knowledge Graph Completion
Wang, Z., Du, H., Yao, Q., & Li, X. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.458 · Cited by 26
Differentiable Architecture Search with Random Features
Zhang, X., Li, Y., Zhang, X., Wang, Y., & Sun, J. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01541 · Cited by 26
xLightFM: Extremely Memory-Efficient Factorization Machine
Jiang, G., Wang, H., Chen, J., Wang, H., Lian, D., & Chen, E. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462941 · Cited by 25
Neural Graph Embedding for Neural Architecture Search
Li, W., Gong, S., & Zhu, X. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5903 · Cited by 25
Theory-Inspired Path-Regularized Differential Network Architecture SearchPreprint
Zhou, P., Xiong, C., Socher, R., & Hoi, S. C. H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.16537 · Cited by 26
Kampezidou, S. I., Ray, A. T., Bhat, A. P., Fischer, O. J. P., & Mavris, D. N. (2024) · Eng—Advances in Engineering · doi:10.3390/eng5010021 · Cited by 25
Binarized Neural Architecture Search
Chen, H., Zhuo, L., Zhang, B., Zheng, X., Liu, J., Doermann, D., & Ji, R. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6624 · Cited by 24
Rethinking Bi-Level Optimization in Neural Architecture Search: A Gibbs Sampling Perspective
Xue, C., Wang, X., Yan, J., Hu, Y., Yang, X., & Sun, K. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17262 · Cited by 24
Exploring more diverse network architectures for single image super-resolution
Cheng, G., Matsune, A., Du, H., Liu, X., & Zhan, S. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107648 · Cited by 24
Wei, W., Chen, Y., Lin, Q., Ji, J., Wong, K., & Li, J. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110216 · Cited by 24
Dynamic Structure Pruning for Compressing CNNs
Park, J.-H., Kim, Y., Kim, J., Choi, J., & Lee, S. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i8.26127 · Cited by 25
How to Train Your Super-Net: An Analysis of Training Heuristics in Weight-Sharing NASPreprint
Yu, K., Ranftl, R., & Salzmann, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.04276 · Cited by 24
HM-NAS: Efficient Neural Architecture Search via Hierarchical Masking
Shen, Y., Fang, B., Zhang, F., Zheng, Y., Zeng, X., Zhang, M., & Xu, H. F. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00243 · Cited by 23
Disturbance-immune weight sharing for neural architecture search
Niu, S., Wu, J., Zhang, Y., Guo, Y. F., Zhao, P., Huang, J., & Tan, M. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.09.002 · Cited by 23
Learning Sparse Interaction Graphs of Partially Detected Pedestrians for Trajectory Prediction
Huang, Z., Li, R., Shin, K., & Driggs-Campbell, K. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3138547 · Cited by 37
BaLeNAS: Differentiable Architecture Search via the Bayesian Learning Rule
Zhang, M., Pan, S., Chang, X., Su, S. W., Hu, J., Haffari, G., & Yang, B. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01157 · Cited by 23
PINAT: A Permutation INvariance Augmented Transformer for NAS Predictor
Lu, S., Hu, Y. H., Wang, P., Han, Y., Tan, J., Li, J., Yang, S., & Liu, J. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i7.26076 · Cited by 23
IS-DARTS: Stabilizing DARTS through Precise Measurement on Candidate Importance
He, H., Liu, L., Zhang, H., & Zheng, N. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i11.29128 · Cited by 23
An Introduction to Neural Architecture Search for Convolutional NetworksPreprint
Kyriakides, G., & Margaritis, K. G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.11074 · Cited by 34
Neural Architecture Search with GBDT.Preprint
Luo, R., Tan, X., Wang, R., Qin, T., Chen, E., & Liu, T. (2020) · arXiv (Cornell University) · Cited by 23
Ma, L., Zhou, Y., Ma, Y., Yu, G., Li, Q., He, Q., & Pei, Y. (2025) · IEEE Transactions on Computers · doi:10.1109/tc.2025.3540650 · Cited by 22
A technical view on neural architecture search
Hu, Y.-Q., & Yang, Y. (2020) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-020-01062-1 · Cited by 23
AutoDet: Pyramid Network Architecture Search for Object Detection
Li, Z., Xi, T., Zhang, G., Liu, J., & He, R. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-020-01415-x · Cited by 22
Neural architecture search of echocardiography view classifiers
Azarmehr, N., Zolgharni, M., Ye, X., Howard, J. P., Lane, E. S., Labs, R. B., Shun-Shin, M. J., Cole, G., Bidaut, L. M., & Francis, D. P. (2021) · Journal of medical imaging · doi:10.1117/1.jmi.8.3.034002 · Cited by 24
Joint Multi-Dimension Pruning via Numerical Gradient Update
Liu, Z., Zhang, X., Shen, Z., Wei, Y., Cheng, K.-T. T., & Sun, J. (2021) · IEEE Transactions on Image Processing · doi:10.1109/tip.2021.3112041 · Cited by 28
BNAS-v2: Memory-Efficient and Performance-Collapse-Prevented Broad Neural Architecture Search
Ding, Z., Chen, Y., Li, N., & Zhao, D. (2022) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2022.3143201 · Cited by 22
SurgeNAS: A Comprehensive Surgery on Hardware-Aware Differentiable Neural Architecture Search
Luo, X., Liu, D., Kong, H., Huai, S., Chen, H., & Liu, W. (2022) · IEEE Transactions on Computers · doi:10.1109/tc.2022.3188175 · Cited by 23
EMT-NAS: Transferring architectural knowledge between tasks from different datasets
Liao, P., Jin, Y., & Du, W. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00355 · Cited by 25
Attention Round for post-training quantization
Diao, H., Li, G., Xu, S., Kong, C., & Wang, W. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.127012 · Cited by 23
Architecture Search of Dynamic Cells for Semantic Video Segmentation
Nekrasov, V., Chen, H., Shen, C., & Reid, I. D. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093531 · Cited by 22
MetAdapt: Meta-learned task-adaptive architecture for few-shot classification
Doveh, S., Schwartz, E., Xue, C., Feris, R., Bronstein, A. M., Giryes, R., & Karlinsky, L. (2021) · Pattern Recognition Letters · doi:10.1016/j.patrec.2021.05.010 · Cited by 22
Neural Architecture Search for LF-MMI Trained Time Delay Neural Networks
Hu, S., Xie, X., Cui, M., Deng, J., Liu, S., Yu, J., Geng, M., Liu, X., & Meng, H. M. L. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3153253 · Cited by 25
Evolutionary-Neural Hybrid Agents for Architecture SearchPreprint
Maziarz, K., Tan, M., Khorlin, A., Georgiev, M., & Gesmundo, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.09828 · Cited by 29
Efficient Forward Architecture SearchPreprint
Hu, H., Langford, J. C., Caruana, R., Mukherjee, S., Horvitz, E., & Dey, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.13360 · Cited by 22
Probabilistic Dual Network Architecture Search on GraphsPreprint
Zhao, Y., Wang, D., Gao, X., Mullins, R., Lió, P., & Jamnik, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.09676 · Cited by 29
Weight-Sharing Neural Architecture Search: A Battle to Shrink the Optimization GapPreprint
Xie, L., Chen, X., Bi, K., Wei, L., Xu, Y., Chen, Z., Wang, L., Xiao, A., Chang, J., Zhang, X., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.01475 · Cited by 29
U-DARTS: Uniform-space differentiable architecture search
Huang, L., Sun, S., Zeng, J., Wang, W., Pang, W., & Wang, K. (2023) · Information Sciences · doi:10.1016/j.ins.2023.01.129 · Cited by 21
EBNAS: Efficient binary network design for image classification via neural architecture search
Shi, C., Hao, Y., Li, G., & Xu, S. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.105845 · Cited by 22
Architectural Backdoors in Neural Networks
Bober-Irizar, M., Shumailov, I., Zhao, Y., Mullins, R., & Papernot, N. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02356 · Cited by 32
Pan, Z., Cai, J., & Zhuang, B. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01545 · Cited by 21
Chen, Y., Wang, J., Wang, C., & Zou, Q. (2024) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1011851 · Cited by 21
EG-NAS: Neural Architecture Search with Fast Evolutionary Exploration
Cai, Z., Chen, L., Liu, P., Ling, T., & Lai, Y. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i10.28993 · Cited by 21
One-Shot Neural Architecture Search via Novelty Driven Sampling
Zhang, M., Li, H., Pan, S., Liu, T., & Su, S. W. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/441 · Cited by 21
AutoEmb: Automated Embedding Dimensionality Search in Streaming RecommendationsPreprint
Zhao, X., Wang, C., Chen, M., Zheng, X., Liu, X., & Tang, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.11252 · Cited by 32
Analyzing and Mitigating Interference in Neural Architecture SearchPreprint
Xu, J., Tan, X., Song, K., Luo, R., Leng, Y., Qin, T., Liu, T., & Li, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.12821 · Cited by 22
Differentially-private Federated Neural Architecture SearchPreprint
Singh, I., Zhou, H., Yang, K., Ding, M., Lin, B., & Xie, P. (2020) · doi:10.36227/techrxiv.12503420 · Cited by 21
DA-NAS: Data Adapted Pruning for Efficient Neural Architecture Search
Dai, X., Chen, D., Liu, M., Chen, Y., & Yuan, L. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58583-9_35 · Cited by 19
HourNAS: Extremely Fast Neural Architecture Search Through an Hourglass Lens
Yang, Z., Wang, Y., Chen, X., Guo, J., Zhang, W., Xu, C., Xu, C., Tao, D., & Xu, C. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01075 · Cited by 22
TNASP: A Transformer-based NAS Predictor with a Self-evolution Framework
Lu, S., Li, J., Tan, J., Yang, S., & Liu, J. Y. (2021) · neural information processing systems · Cited by 20
Search to Capture Long-range Dependency with Stacking GNNs for Graph Classification
Wei, L., He, Z., Zhao, H., & Yao, Q. (2023) · International World Wide Web Conference (WWW) · doi:10.1145/3543507.3583486 · Cited by 20
Li, D., Ru, Y., Chen, Z., Dong, C., Dong, Y., & Liu, J. (2023) · APL Machine Learning · doi:10.1063/5.0131067 · Cited by 22
Yan, X., Huang, H. P., Jin, Y., Chen, L., Liang, Z., & Hao, Z. (2023) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2023.3301774 · Cited by 25
Att-DARTS: Differentiable Neural Architecture Search for Attention
Nakai, K., Matsubara, T., & Uehara, K. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207447 · Cited by 20
Neural Architecture Search as Sparse Supernet
Wu, Y. X., Liu, A., Huang, Z., Zhang, S., & Gool, L. V. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i12.17243 · Cited by 20
STEERAGE: Synthesis of Neural Networks Using Architecture Search and Grow-and-Prune MethodsPreprint
Hassantabar, S., Dai, X., & Jha, N. K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.05831 · Cited by 29
DCNAS: Densely Connected Neural Architecture Search for Semantic Image SegmentationPreprint
Zhang, X., Xu, H., Mo, H., Tan, J., Yang, C., Wang, L., & Ren, W. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.11883 · Cited by 20
SparseBERT: Rethinking the Importance Analysis in Self-attentionPreprint
Han, S., Gao, J., Ren, X., Xu, H., Liang, X., Li, Z., & Kwok, J. T.-Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.12871 · Cited by 24
PSViT: Better Vision Transformer via Token Pooling and Attention SharingPreprint
Chen, B., Li, P., Li, B., Li, C., Bai, L., Chen, L., Sun, M., Yan, J., & Ouyang, W. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.03428 · Cited by 39
Neural Architecture Search for Dense Prediction Tasks in Computer Vision
Mohan, R., Elsken, T., Zela, A., Metzen, J. H., Staffler, B., Brox, T., Valada, A., & Hutter, F. (2023) · International Journal of Computer Vision · doi:10.1007/s11263-023-01785-y · Cited by 25
Zheng, H., An, K., & Ou, Z. (2021) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383527 · Cited by 19
Self-citationRL-DARTS: Differentiable neural architecture search via reinforcement-learning-based meta-optimizer
Pang, D., Le, X., & Guan, X. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107585 · Cited by 17
A gradient-based automatic optimization CNN framework for EEG state recognition
Wang, H., Zhu, X., Chen, P., Yang, Y., Ma, C., & Gao, Z. (2021) · Journal of Neural Engineering · doi:10.1088/1741-2552/ac41ac · Cited by 19
EAT-NAS: elastic architecture transfer for accelerating large-scale neural architecture search
Fang, J., Chen, Y., Zhang, X., Zhang, Q., Huang, C., Meng, G., Liu, W., & Wang, X. (2021) · Science China Information Sciences · doi:10.1007/s11432-020-3112-8 · Cited by 22
Splitting Steepest Descent for Growing Neural ArchitecturesPreprint
Liu, Q., Wu, L., & Wang, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.02366 · Cited by 19
Differentiable Neural Input Search for Recommender SystemsPreprint
Cheng, W., Shen, Y., & Huang, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.04466 · Cited by 19
AutoHAS: Differentiable Hyper-parameter and Architecture Search.Preprint
Dong, X., Tan, M., Yu, A. W., Peng, D., Gabryś, B., & Le, Q. V. (2020) · arXiv (Cornell University) · Cited by 18
Speedy Performance Estimation for Neural Architecture SearchPreprint
Ru, B., Lyle, C., Schut, L., Fil, M., van der Wilk, M., & Gal, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.04492 · Cited by 19
Mixed Precision Low-Bit Quantization of Neural Network Language Models for Speech Recognition
Xu, J., Yu, J., Hu, S., Liu, X., & Meng, H. M. L. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3129357 · Cited by 20
Fast and Effective: A Novel Sequential Single-Path Search for Mixed-Precision-Quantized Networks
Sun, Q., Li, X., Jiao, L., Ren, Y. X., Shang, F., & Liu, F. (2022) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2022.3164285 · Cited by 27
Neural Architecture Search with Representation Mutual Information
Zheng, X., Fei, X., Zhang, L., Wu, C., Chao, F., Liu, J., Zeng, W., Tian, Y., & Ji, R. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01161 · Cited by 18
Ke, S., Pan, Z., He, T., Liang, Y., Zhang, J., & Zheng, Y. (2023) · Artificial Intelligence · doi:10.1016/j.artint.2023.103899 · Cited by 20
EST-NAS: An evolutionary strategy with gradient descent for neural architecture search
Cai, Z., Chen, L., Zeng, S., Lai, Y., & Liu, H. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110624 · Cited by 19
NeuralScale: Efficient Scaling of Neurons for Resource-Constrained Deep Neural Networks
Lee, E., & Lee, C. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00155 · Cited by 18
DATA: Differentiable ArchiTecture Approximation With Distribution Guided Sampling
Zhang, X., Chang, J., Guo, Y., Meng, G., Xiang, S., Lin, Z., & Pan, C. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3020315 · Cited by 19
Fan, Y., Tang, X., Zhou, G., & Shen, J. (2020) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2020.3040796 · Cited by 18
Generic Neural Architecture Search via RegressionPreprint
Li, Y., Hao, C., Li, P., Xiong, J., & Chen, D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.01899 · Cited by 19
NASI: Label- and Data-agnostic Neural Architecture Search at InitializationPreprint
Shu, Y., Cai, S., Dai, Z., Ooi, B. C., & Low, B. K. H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.00817 · Cited by 25
Action Command Encoding for Surrogate-Assisted Neural Architecture Search
Tian, Y., Peng, S., Yang, S., Zhang, X., Tan, K. C., & Jin, Y. (2021) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2021.3107555 · Cited by 17
PA&DA: Jointly Sampling PAth and DAta for Consistent NAS
Lu, S., Hu, Y. H., Yang, L., Sun, Z., Mei, J., Tan, J., & Song, C. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.01149 · Cited by 17
OStr-DARTS: Differentiable Neural Architecture Search Based on Operation Strength
Yang, L., Zheng, Z., Han, Y., Song, S., Huang, G. M., & Li, F. (2024) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2024.3455760 · Cited by 18
Efficient Oct Image Segmentation Using Neural Architecture Search
Gheshlaghi, S. H., Dehzangi, O., Dabouei, A., Amireskandari, A., Rezai, A. R., & Nasrabadi, N. M. (2020) · Proceedings - International Conference on Image Processing · doi:10.1109/icip40778.2020.9190753 · Cited by 17
Metadata
- Authors
- Xie, S., Zheng, H., Liu, C., & Lin, L.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2018
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1812.09926
- OpenAlex
- W2905672847
- Cited by
- 731
- References
- 36
- Citations by year
- 2025: 30 · 2024: 51 · 2023: 93 · 2022: 91 · 2021: 224 · 2020: 170 · 2019: 70 · 2018: 2
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Canadian Institute for Advanced Research
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Physical Sciences › Computer Science › Artificial Intelligence › Evolutionary Algorithms and Applications
- Keywords
- neural architecture search, differentiable architecture search, credit assignment, search space optimization, end-to-end learning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
