The DOI matches its DataCite record; 51 of the 53 references it cites were found in a registry or an index.
Compressing Neural Networks with the Hashing Trick
Open accessAbstract
As deep nets are increasingly used in applications suited for mobile devices, a fundamental dilemma becomes apparent: the trend in deep learning is to grow models to absorb ever-increasing data set sizes; however mobile devices are designed with very little memory and cannot store such large models. We present a novel network architecture, HashedNets, that exploits inherent redundancy in neural networks to achieve drastic reductions in model sizes. HashedNets uses a low-cost hash function to randomly group connection weights into hash buckets, and all connections within the same hash bucket share a single parameter value. These parameters are tuned to adjust to the HashedNets weight sharing architecture with standard backprop during training. Our hashing procedure introduces no additional memory overhead, and we demonstrate on several benchmark data sets that HashedNets shrink the storage requirements of neural networks substantially while mostly preserving generalization performance.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In addition, structured update, sketched update can help enhance the communication efficiency when clients uploading updates to the server as well.”
From Convergence of Edge Computing and Deep Learning: A Comprehensive Survey (2020) · cites this paper as [202]
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
(2014) · Cited by 33,419
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Neural networks for pattern recognition
Bishop, C. (1994) · Choice Reviews Online · doi:10.5860/choice.31-5500 · Cited by 18,537
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
(2010) · International Conference on Machine Learning · Cited by 13,995
Term-Weighting Approaches in Automatic Text Retrieval
Salton, G., & Buckley, C. (1988) · Information Processing & Management · doi:10.1016/0306-4573(88)90021-0 · Cited by 11,421
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Cited by
Sorted by citations
Items 101–200 of 973
Edge Intelligence: Architectures, Challenges, and ApplicationsPreprint
Xu, D., Li, T., Li, Y., Su, X., Tarkoma, S., Jiang, T., Crowcroft, J., & Hui, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.12172 · Cited by 204
Focus: Querying Large Video Datasets with Low Latency and Low CostPreprint
Hsieh, K., Ananthanarayanan, G., Bodík, P., Venkataraman, S., Bahl, P., Philipose, M., Gibbons, P. B., & Mutlu, O. (2018) · USENIX Symposium on Operating Systems Design and Implementation · doi:10.48550/arxiv.1801.03493 · Cited by 313
Quantized CNN: A Unified Approach to Accelerate and Compress Convolutional Networks
Cheng, J., Wu, J., Leng, C., Wang, Y., & Hu, Q. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2774288 · Cited by 126
Wide Compression: Tensor Ring Nets
Aggarwal, V., Wang, W., Eriksson, B., Sun, Y., & Wang, W. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00972 · Cited by 153
Deep Model Compression: Distilling Knowledge from Noisy Teachers
Sau, B. B., & Balasubramanian, V. N. (2016) · Research Archive of Indian Institute of Technology Hyderabad (Indian Institute of Technology Hyderabad) · doi:10.48550/arxiv.1610.09650 · Cited by 192
Deep Neural Network Compression With Single and Multiple Level Quantization
Xu, Y., Wang, Y., Zhou, A., Lin, W., & Xiong, H. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11663 · Cited by 127
DSConv: Efficient Convolution Operator
do Nascimento, M. G., Prisacariu, V. A., & Fawcett, R. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00525 · Cited by 163
Binarized-BLSTM-RNN based Human Activity Recognition
Edel, M., & Köppe, E. (2016) · International Conference on Indoor Positioning and Indoor Navigation · doi:10.1109/ipin.2016.7743581 · Cited by 117
The Power of Sparsity in Convolutional Neural NetworksPreprint
Changpinyo, S., Sandler, M., & Zhmoginov, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1702.06257 · Cited by 143
Learning Student Networks via Feature Embedding
Chen, H., Wang, Y., Xu, C., Xu, C., & Tao, D. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2970494 · Cited by 116
Márquez, E. Q. M., Hare, J. S., & Niranjan, M. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2805098 · Cited by 120
A survey on deploying mobile deep learning applications: A systemic and technical perspective
Wang, Y., Wang, J., Zhang, W., Zhan, Y., Guo, S., Zheng, Q., & Wang, X. (2021) · Digital Communications and Networks · doi:10.1016/j.dcan.2021.06.001 · Cited by 120
Redundant feature pruning for accelerated inference in deep neural networks
Ayinde, B. O., Inanc, T., & Żurada, J. M. (2019) · Neural Networks · doi:10.1016/j.neunet.2019.04.021 · Cited by 108
Next Point-of-Interest Recommendation on Resource-Constrained Mobile Devices
Wang, Q., Yin, H., Chen, T., Huang, Z. H., Wang, H., Zhao, Y., & Nguyen, Q. V. H. (2020) · International World Wide Web Conference (WWW) · doi:10.1145/3366423.3380170 · Cited by 106
CDFI: Compression-Driven Network Design for Frame Interpolation
Ding, T., Liang, L., Zhu, Z., & Zharkov, I. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00791 · Cited by 107
Learning Filter Basis for Convolutional Neural Network Compression
Li, Y., Gu, S., Gool, L. V., & Timofte, R. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00572 · Cited by 104
A Survey of Methods for Low-Power Deep Learning and Computer Vision
Goel, A., Tung, C., Lu, Y.-H., & Thiruvathukal, G. K. (2020) · IEEE World Forum on Internet of Things (WF-IoT) · doi:10.1109/wf-iot48130.2020.9221198 · Cited by 116
Compression of Deep Learning Models for Text: A Survey
Gupta, M., & Agrawal, P. (2022) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3487045 · Cited by 128
Kang, D. D., Bailis, P. D., & Zaharia, M. (2019) · Proceedings of the VLDB Endowment · doi:10.14778/3372716.3372725 · Cited by 175
Turay, T., & Vladimirova, T. (2022) · IEEE Access · doi:10.1109/access.2022.3147495 · Cited by 114
Compressing Word Embeddings via Deep Compositional Code LearningPreprint
Shu, R., & Nakayama, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.01068 · Cited by 101
DeepRebirth: Accelerating Deep Neural Network Execution on Mobile Devices
Li, D., Wang, X., & Kong, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11876 · Cited by 98
Projection Convolutional Neural Networks for 1-bit CNNs via Discrete Back Propagation
Gu, J., Li, C., Zhang, B., Han, J., Cao, X., Liu, J., & Doermann, D. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33018344 · Cited by 101
Scalable and Sustainable Deep Learning via Randomized Hashing
Spring, R., & Shrivastava, A. (2017) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3097983.3098035 · Cited by 98
Grow and Prune Compact, Fast, and Accurate LSTMs
Dai, X., Yin, H., & Jha, N. K. (2019) · IEEE Transactions on Computers · doi:10.1109/tc.2019.2954495 · Cited by 103
Prabhavalkar, R., Alsharif, O., Bruguier, A., & McGraw, L. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472823 · Cited by 97
From Hashing to CNNs: Training Binary Weight Networks via Hashing
Hu, Q., Wang, P., & Cheng, J. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11660 · Cited by 96
Zhao, W., Zhang, J., Xie, D., Qian, Y., Jia, R., & Li, P. (2019) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3357384.3358045 · Cited by 96
Dynamical Channel Pruning by Conditional Accuracy Change for Deep Neural Networks
Chen, Z., Xu, T.-B., Du, C., Liu, C., & He, H. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2979517 · Cited by 99
Adaptive deep learning model selection on embedded systems
Taylor, B., Marco, V. S., Wolff, W., Elkhatib, Y., & Wang, Z. (2018) · Proceedings of the 19th ACM SIGPLAN/SIGBED International Conference on Languages, Compilers, and Tools for Embedded Systems · doi:10.1145/3211332.3211336 · Cited by 90
Fast YOLO: A Fast You Only Look Once System for Real-time Embedded Object Detection in VideoPreprint
Shafiee, M., Chywl, B., Li, F., & Wong, A. (2017) · arXiv.org · doi:10.48550/arxiv.1709.05943 · Cited by 403
López, O. L. A., Rosabal, O. M., Ruiz-Guirola, D. E., Raghuwanshi, P., Mikhaylov, K., Lovén, L., & Iyer, S. (2023) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2023.3323832 · Cited by 113
An Empirical Evaluation of Deep Learning for Network Anomaly Detection
Malaiya, R. K., Kwon, D., Suh, S. C., Kim, H., Kim, I., & Kim, J. (2019) · IEEE Access · doi:10.1109/access.2019.2943249 · Cited by 99
A Systematic Review on Model Watermarking for Neural Networks
Boenisch, F. (2021) · Frontiers in Big Data · doi:10.3389/fdata.2021.729663 · Cited by 114
MeDNN: A distributed mobile system with enhanced partition and deployment for large-scale DNNs
Mao, J., Yang, Z., Wen, W., Wu, C., Song, L., Nixon, K. W., Chen, X., Li, H., & Chen, Y. (2017) · 2017 IEEE/ACM International Conference on Computer-Aided Design (ICCAD) · doi:10.1109/iccad.2017.8203852 · Cited by 97
Self-citationWu, J., Wang, Y., Wu, Z., Wang, Z., Veeraraghavan, A., & Lin, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.09228 · Cited by 93
Big-Little Net: An Efficient Multi-Scale Feature Representation for Visual and Speech RecognitionPreprint
Chen, C.-F., Fan, Q., Mallinar, N., Sercu, T., & Feris, R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.03848 · Cited by 100
Packing Convolutional Neural Networks in the Frequency Domain
Wang, Y., Xu, C., Xu, C., & Tao, D. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2857824 · Cited by 88
Clustering Convolutional Kernels to Compress Deep Neural Networks
Son, S., Nah, S., & Lee, K. M. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01237-3_14 · Cited by 86
Dynamic Sampling Networks for Efficient Action Recognition in Videos
Zheng, Y.-D., Liu, Z., Lü, T., & Wang, L. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3007826 · Cited by 88
Fully Learnable Group Convolution for Acceleration of Deep Neural Networks
Wang, X., Kan, M., Shan, S., & Chen, X. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00926 · Cited by 87
Balanced Quantization: An Effective and Efficient Approach to Quantized Neural Networks
Zhou, S., Wang, Y., Wen, H., He, Q., & Zou, Y. (2017) · Journal of Computer Science and Technology · doi:10.1007/s11390-017-1750-y · Cited by 85
Deep Transfer Hashing for Image Retrieval
Zhai, H., Lai, S., Jin, H., Qian, X., & Mei, T. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.2991171 · Cited by 83
TAPAS : tricks to accelerate (encrypted) prediction as a servicePreprint
Sanyal, A., Kusner, M. J., Gascón, A., & Kanade, V. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.03461 · Cited by 95
Learning compact recurrent neural networks
Lu, Z., Sindhwani, V., & Sainath, T. N. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472821 · Cited by 89
Learning Deep Parsimonious Representations
Liao, R., Schwing, A. G., Zemel, R. S., & Urtasun, R. (2016) · neural information processing systems · Cited by 85
Attentive Linear Transformation for Image Captioning
Ye, S., Han, J., & Liu, N. (2018) · IEEE Transactions on Image Processing · doi:10.1109/tip.2018.2855406 · Cited by 81
ChannelNets: Compact and Efficient Convolutional Neural Networks via Channel-Wise Convolutions
Gao, H., Wang, Z., Cai, L., & Ji, S. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2975796 · Cited by 81
DyNet: Dynamic Convolution for Accelerating Convolutional Neural NetworksPreprint
Zhang, Y., Zhang, J., Wang, Q., & Zhong, Z. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.10694 · Cited by 100
Discrete Deep Learning for Fast Content-Aware Recommendation
Zhang, Y., Yin, H., Huang, Z., Du, X.-Z., Yang, G., & Lian, D.-F. (2018) · Web Search and Data Mining · doi:10.1145/3159652.3159688 · Cited by 80
Highlight Every Step: Knowledge Distillation via Collaborative Teaching
Zhao, H., Sun, X., Dong, J., Chen, C., & Dong, Z. (2020) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.3007506 · Cited by 82
Training Small Networks for Scene Classification of Remote Sensing Images via Knowledge Distillation
Chen, G., Zhang, X., Tan, X., Cheng, Y., Dai, F., Zhu, K., Gong, Y., & Wang, Q. (2018) · Remote Sensing · doi:10.3390/rs10050719 · Cited by 82
Deep Model Compression and Architecture Optimization for Embedded Systems: A Survey
Berthelier, A., Château, T., Duffner, S., García, C., & Blanc, C. (2020) · Journal of Signal Processing Systems · doi:10.1007/s11265-020-01596-1 · Cited by 86
Accelerating Neural Network Inference on FPGA-Based Platforms—A Survey
Wu, R., Guo, X., Du, J., & Li, J. (2021) · Electronics · doi:10.3390/electronics10091025 · Cited by 79
LCNN: Lookup-Based Convolutional Neural Network
Bagherinezhad, H., Rastegari, M., & Farhadi, A. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.98 · Cited by 79
Multigrid Neural Architectures
Ke, T.-W., Maire, M., & Yu, S. X. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.433 · Cited by 85
Jin, S., Di, S., Liang, X., Tian, J., Tao, D., & Cappello, F. (2019) · ACM International Symposium on High-Performance Parallel and Distributed Computing (HPDC) · doi:10.1145/3307681.3326608 · Cited by 82
Network Decoupling: From Regular to Depthwise Separable ConvolutionsPreprint
Guo, J., Li, Y., Lin, W., Chen, Y., & Li, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.05517 · Cited by 85
Self-citationMainstream: dynamic stem-sharing for multi-tenant video processing
Jiang, A. H., Wong, D., Canel, C., Tang, L., Misra, I., Kaminsky, M., Kozuch, M. A., Pillai, P. S., Andersen, D. G., & Ganger, G. R. (2018) · USENIX Annual Technical Conference · Cited by 73
Network pruning using sparse learning and genetic algorithm
Wang, Z., Li, F., Shi, G., Xie, X., & Wang, F. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.03.082 · Cited by 74
Provable Filter Pruning for Efficient Neural NetworksPreprint
Liebenwein, L., Baykal, C., Lang, H., Feldman, D., & Rus, D. L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.07412 · Cited by 99
Distilling Portable Generative Adversarial Networks for Image Translation
Chen, H., Wang, Y., Shu, H., Wen, C., Xu, C., Shi, B., Xu, C., & Xu, C. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5765 · Cited by 72
TRP: Trained Rank Pruning for Efficient Deep Neural Networks
Xu, Y., Li, Y., Zhang, S., Wen, W., Wang, B., Qi, Y., Chen, Y., Lin, W., & Xiong, H. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/136 · Cited by 82
Self-citationBinary Volumetric Convolutional Neural Networks for 3-D Object Recognition
Ma, C., Guo, Y., Lei, Y., & An, W. (2018) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2018.2840598 · Cited by 71
A novel channel pruning method for deep neural network compressionPreprint
Hu, Y., Sun, S., Li, J., Wang, X., & Gu, Q. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.11394 · Cited by 70
Wide Compression: Tensor Ring NetsPreprint
Wang, W., Sun, Y., Eriksson, B., Wang, W., & Aggarwal, V. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.09052 · Cited by 69
AddNet: Deep Neural Networks Using FPGA-Optimized Multipliers
Faraone, J., Kumm, M., Hardieck, M., Zipf, P., Liu, X., Boland, D., & Leong, P. H. W. (2020) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2019.2939429 · Cited by 66
Georgiev, P., Bhattacharya, S., Lane, N. D., & Mascolo, C. (2017) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3131895 · Cited by 67
Sun, J., Zhang, X., & Wang, J. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105662 · Cited by 68
Accelerate CNN via Recursive Bayesian Pruning
Zhou, Y., Zhang, Y., Wang, Y., & Tian, Q. C. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00340 · Cited by 63
Zheng, S., Chen, S., Yang, L., Zhu, J., Luo, Z., Hu, J., & Yang, X. (2018) · IEEE Access · doi:10.1109/access.2018.2872769 · Cited by 66
An Improved Deep Computation Model Based on Canonical Polyadic Decomposition
Zhang, Q., Yang, L. T., Chen, Z., & Li, P. (2017) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2017.2701797 · Cited by 64
Kutia, S., Chauhdary, S. H., Iwendi, C., Liu, L., Wang, Y., & Bashir, A. K. (2019) · IEEE Access · doi:10.1109/access.2019.2924584 · Cited by 66
The cascading neural network: building the Internet of Smart Things
Leroux, S., Bohez, S., De Coninck, E., Verbelen, T., Vankeirsbilck, B., Simoens, P., & Dhoedt, B. (2017) · Knowledge and Information Systems · doi:10.1007/s10115-017-1029-1 · Cited by 59
Sparsely Aggregated Convolutional Networks
Zhu, L., Deng, R., Maire, M., Deng, Z., Mori, G., & Tan, P. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01258-8_12 · Cited by 65
Shakeout: A New Approach to Regularized Deep Neural Network Training
Kang, G., Li, J., & Tao, D. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2701831 · Cited by 64
Automated Pruning for Deep Neural Network Compression
Manessi, F., Rozza, A., Bianco, S., Napoletano, P., & Schettini, R. (2018) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2018.8546129 · Cited by 65
An Empirical Evaluation of Deep Learning for Network Anomaly Detection
Malaiya, R. K., Kwon, D., Kim, J., Suh, S. C., Kim, H., & Kim, I. (2018) · 2018 International Conference on Computing, Networking and Communications (ICNC) · doi:10.1109/iccnc.2018.8390278 · Cited by 62
Xu, T.-B., Yang, P., Zhang, X.-Y., & Liu, C. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.10.029 · Cited by 63
Building efficient CNN architecture for offline handwritten Chinese character recognition
Li, Z., Teng, N., Jin, M., & Lu, H. (2018) · International Journal on Document Analysis and Recognition (IJDAR) · doi:10.1007/s10032-018-0311-4 · Cited by 62
Adversarial Learning of Portable Student Networks
Wang, Y., Xu, C., Xu, C., & Tao, D. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11667 · Cited by 64
An efficient convolutional neural network for small traffic sign detection
Song, S., Que, Z., Hou, J., Du, S., & Song, Y. (2019) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2019.01.012 · Cited by 61
Adversarial Network Compression
Belagiannis, V., Farshad, A., & Galasso, F. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-11018-5_37 · Cited by 63
Low-Memory Neural Network Training: A Technical ReportPreprint
Sohoni, N. S., Aberger, C. R., Leszczynski, M., Zhang, J., & Ré, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.10631 · Cited by 102
Kadam, K. D., Ahirrao, S., & Kotecha, K. (2022) · Computational Intelligence and Neuroscience · doi:10.1155/2022/6845326 · Cited by 59
RetractedA Tensor-Train Deep Computation Model for Industry Informatics Big Data Feature Learning
Zhang, Q., Yang, L. T., Chen, Z., & Li, P. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2791423 · Cited by 59
Exploiting Errors for Efficiency
Stanley‐Marbell, P., Alaghi, A., Carbin, M., Darulová, E., Dolecek, L., Gerstlauer, A., Gillani, G. A., Jevdjic, D., Moreau, T., Cacciotti, M., et al. (2020) · ACM Computing Surveys · doi:10.1145/3394898 · Cited by 91
Learning a Wavelet-Like Auto-Encoder to Accelerate Deep Neural Networks
Chen, T., Lin, L., Zuo, W., Luo, X., & Lei Zhang, A. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12282 · Cited by 58
Lightweight Modules for Efficient Deep Learning Based Image Restoration
Lahiri, A., Bairagya, S., Bera, S., Haldar, S., & Biswas, P. K. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.3007723 · Cited by 57
Effective Quantization Methods for Recurrent Neural NetworksPreprint
He, Q., Wen, H., Zhou, S., Wu, Y., Yao, C., Zhou, X., & Zou, Y. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.10176 · Cited by 80
ACDC: A Structured Efficient Linear LayerPreprint
Moczulski, M., Denil, M., Appleyard, J., & de Freitas, N. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.05946 · Cited by 90
Diversity Networks: Neural Network Compression Using Determinantal Point ProcessesPreprint
Mariet, Z., & Sra, S. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.05077 · Cited by 81
Hanif, M. A., Hafiz, R., & Shafique, M. (2018) · Design, Automation, and Test in Europe · doi:10.23919/date.2018.8342139 · Cited by 55
A Tucker Deep Computation Model for Mobile Multimedia Feature Learning
Zhang, Q., Yang, L. T., Liu, X., Chen, Z., & Li, P. (2017) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3063593 · Cited by 54
ProjectionNet: Learning Efficient On-Device Deep Networks Using Neural ProjectionsPreprint
Ravi, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.00630 · Cited by 54
Structured Probabilistic Pruning for Convolutional Neural Network AccelerationPreprint
Wang, H., Zhang, Q., Wang, Y., & Hu, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.06994 · Cited by 54
Nkurlu, B. M., Shen, C., Asante‐Okyere, S., Mulashani, A. K., Chungu, J., & Wang, L. (2020) · Energies · doi:10.3390/en13030551 · Cited by 52
Nasif, A., Othman, Z. A., & Sani, N. S. (2021) · Sensors · doi:10.3390/s21124223 · Cited by 52
Resource-Efficient Neural Networks for Embedded SystemsPreprint
Roth, W., Schindler, G., Klein, B., Peharz, R., Tschiatschek, S., Fröning, H., Pernkopf, F., & Ghahramani, Z. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.03048 · Cited by 67
Customizing Neural Networks for Efficient FPGA Implementation
Samragh, M., Ghasemzadeh, M., & Koushanfar, F. (2017) · IEEE International Symposium on Field-Programmable Custom Computing Machines (FCCM) · doi:10.1109/fccm.2017.43 · Cited by 51
Metadata
- Authors
- Chen, W., Wilson, J. T., Tyree, S., Weinberger, K. Q., & Chen, Y.
- Affiliations
- Washington University in St. Louis (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2015
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1504.04788
- OpenAlex
- W2172166488
- Cited by
- 974
- References
- 53
- Citations by year
- 2026: 2 · 2025: 9 · 2024: 29 · 2023: 59 · 2022: 69 · 2021: 118 · 2020: 167 · 2019: 159 · 2018: 184 · 2017: 114 · 2016: 44 · 2015: 19
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- neural network compression, parameter sharing, model size reduction, memory-efficient deep learning, mobile devices, parameter redundancy, hash functions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
