The DOI matches its DataCite record; 51 of the 53 references it cites were found in a registry or an index.
Compressing Neural Networks with the Hashing Trick
Open accessAbstract
As deep nets are increasingly used in applications suited for mobile devices, a fundamental dilemma becomes apparent: the trend in deep learning is to grow models to absorb ever-increasing data set sizes; however mobile devices are designed with very little memory and cannot store such large models. We present a novel network architecture, HashedNets, that exploits inherent redundancy in neural networks to achieve drastic reductions in model sizes. HashedNets uses a low-cost hash function to randomly group connection weights into hash buckets, and all connections within the same hash bucket share a single parameter value. These parameters are tuned to adjust to the HashedNets weight sharing architecture with standard backprop during training. Our hashing procedure introduces no additional memory overhead, and we demonstrate on several benchmark data sets that HashedNets shrink the storage requirements of neural networks substantially while mostly preserving generalization performance.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In addition, structured update, sketched update can help enhance the communication efficiency when clients uploading updates to the server as well.”
From Convergence of Edge Computing and Deep Learning: A Comprehensive Survey (2020) · cites this paper as [202]
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
(2014) · Cited by 33,419
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Neural networks for pattern recognition
Bishop, C. (1994) · Choice Reviews Online · doi:10.5860/choice.31-5500 · Cited by 18,537
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
(2010) · International Conference on Machine Learning · Cited by 13,995
Term-Weighting Approaches in Automatic Text Retrieval
Salton, G., & Buckley, C. (1988) · Information Processing & Management · doi:10.1016/0306-4573(88)90021-0 · Cited by 11,421
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Cited by
Sorted by citations
Items 201–300 of 973
Bridge the Gap between Neural Networks and Neuromorphic Hardware with a Neural Network Compiler
Ji, Y., Zhang, Y., Chen, W., & Xie, Y. (2018) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3173162.3173205 · Cited by 52
Self-citationDeep Expander Networks: Efficient Deep Networks from Graph Theory
Prabhu, A., Varma, G., & Namboodiri, A. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01261-8_2 · Cited by 52
Privacy-Preserving Machine Learning Based Data Analytics on Edge Devices
Zhao, J., Mortier, R., Crowcroft, J., & Wang, L. (2018) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3278721.3278778 · Cited by 50
Stochastic Computing for Hardware Implementation of Binarized Neural Networks
Hirtzlin, T., Penkovsky, B., Bocquet, M., Klein, J., Portal, J., & Querlioz, D. (2019) · IEEE Access · doi:10.1109/access.2019.2921104 · Cited by 52
EDR-Net: Lightweight Deep Neural Network Architecture for Detecting Referable Diabetic Retinopathy
Aujih, A. B., Shapiai, M. I., Mériaudeau, F., & Tang, T. B. (2022) · IEEE Transactions on Biomedical Circuits and Systems · doi:10.1109/tbcas.2022.3182907 · Cited by 49
Qiu, Y., Liu, Y., Li, S., & Xu, J. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3230821 · Cited by 52
Applying Deep Learning to Individual and Community Health Monitoring Data: A Survey
Yao, Z., Bi, J., & Chen, Y. (2018) · Machine Intelligence Research · doi:10.1007/s11633-018-1136-9 · Cited by 51
Self-citationDSConv: Efficient Convolution OperatorPreprint
Gennari, M., Fawcett, R., & Prisacariu, V. A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.01928 · Cited by 47
NoScope: Optimizing Neural Network Queries over Video at ScalePreprint
Kang, D. D., Emmons, J., Abuzaid, F., Bailis, P. D., & Zaharia, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.02529 · Cited by 47
Liu, Q., Liu, T., Liu, Z., Wang, Y., Jin, Y., & Wen, W. (2018) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/aspdac.2018.8297407 · Cited by 46
Deep Neural Network Acceleration Based on Low-Rank Approximated Channel Pruning
Chen, Z., Chen, Z., Lin, J., Liu, S., & Li, W. (2020) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2019.2958937 · Cited by 46
SubFlow: A Dynamic Induced-Subgraph Strategy Toward Real-Time DNN Inference and Training
Lee, S., & Nirjon, S. (2020) · IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS) · doi:10.1109/rtas48715.2020.00-20 · Cited by 49
Data-Dependent Coresets for Compressing Neural Networks with Applications to Generalization BoundsPreprint
Baykal, C., Liebenwein, L., Gilitschenski, I., Feldman, D., & Rus, D. L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.05345 · Cited by 56
RAPIDNN: In-Memory Deep Neural Network Acceleration FrameworkPreprint
Imani, M., Samragh, M., Kim, Y., Gupta, S., Koushanfar, F., & Rosing, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.05794 · Cited by 50
Efficient Processing of Deep Neural Networks: A Tutorial and SurveyPreprint
Sze, V., Chen, Y., Yang, T.-J., & Emer, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.09039 · Cited by 45
Self-citationAggarwal, C. C. (2018) · Springer eBooks · doi:10.1007/978-3-319-94463-0_3 · Cited by 47
Fast and scalable in-memory deep multitask learning via neural weight virtualization
Lee, S., & Nirjon, S. (2020) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/3386901.3388947 · Cited by 45
Training Compact CNNs for Image Classification Using Dynamic-Coded Filter Fusion
Lin, M., Chen, B., Chao, F., & Ji, R. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3259402 · Cited by 45
Structured Pruning for Efficient ConvNets via Incremental Regularization
Wang, H., Zhang, Q., Wang, Y., Yu, L., & Hu, H. R. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852463 · Cited by 43
A Coarse-to-Fine Framework for Resource Efficient Video Recognition
Wu, Z., Li, H., Zheng, Y., Xiong, C., Jiang, Y., & Davis, L. S. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01508-1 · Cited by 44
Towards convolutional neural networks compression via global error reconstruction
Lin, S., Ji, R., Guo, X., & Li, X. (2016) · Institutional Repository of Xi'an Institute of Optics and Fine Mechanics, Chinese Academy of Sciences (Xian Institute of Optics and Precision Mechanics) · Cited by 41
Deep feature extraction in the DCT domain
Ghosh, A., & Chellappa, R. (2016) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2016.7900182 · Cited by 42
Are Existing Knowledge Transfer Techniques Effective for Deep Learning with Edge Devices?
Sharma, R., Biookaghazadeh, S., Li, B., & Zhao, M. X. (2018) · IEEE International Conference on Edge Computing and Communications (EDGE) · doi:10.1109/edge.2018.00013 · Cited by 41
Zhuang, M., Zhong, X., Gu, D., Feng, L., Zhong, X., & Hu, H. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.07.019 · Cited by 40
DCFNet: Deep Neural Network with Decomposed Convolutional FiltersPreprint
Qiu, Q., Cheng, X., Calderbank, R., & Sapiro, G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.04145 · Cited by 41
Review of Algorithms for Artificial Intelligence on Low Memory Devices
Radanliev, P., & Roure, D. D. (2021) · IEEE Access · doi:10.1109/access.2021.3101579 · Cited by 42
MEADE: Towards a Malicious Email Attachment Detection Engine
Rudd, E. M., Harang, R., & Saxe, J. (2018) · IEEE Conference on Technologies for Homeland Security (HST) · doi:10.1109/ths.2018.8574202 · Cited by 40
Towards Evolutionary Compression
Wang, Y., Xu, C., Qiu, J., Xu, C., & Tao, D. (2018) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3219819.3219970 · Cited by 54
EBPC: Extended Bit-Plane Compression for Deep Neural Network Inference and Training Accelerators
Cavigelli, L., Rutishauser, G., & Luca Benini, C. (2019) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2019.2950093 · Cited by 41
Voghoei, S., Tonekaboni, N. H., Wallace, J. G., & Arabnia, H. R. (2018) · International Conference on Computational Science and Computational Intelligence (CSCI) · doi:10.1109/csci46756.2018.00177 · Cited by 45
Differential Evolution Based Layer-Wise Weight Pruning for Compressing Deep Neural Networks
Wu, T., Li, X., Zhou, D., Li, N., & Shi, J. (2021) · Sensors · doi:10.3390/s21030880 · Cited by 41
Deep Learning with Darwin: Evolutionary Synthesis of Deep Neural Networks
Shafiee, M. J., Mishra, A. K., & Wong, A. M. (2017) · Neural Processing Letters · doi:10.1007/s11063-017-9733-0 · Cited by 42
Serrà, J., & Karatzoglou, A. (2017) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3109859.3109876 · Cited by 43
Streaming Architecture for Large-Scale Quantized Neural Networks on an FPGA-Based Dataflow Platform
Baskin, C., Liss, N., Zheltonozhskii, E., Bronstein, A. M., & Mendelson, A. (2018) · IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum · doi:10.1109/ipdpsw.2018.00032 · Cited by 39
Massively Parallel Video Networks
Carreira, J., Pătrăucean, V., Mazaré, L., Zisserman, A., & Osindero, S. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01225-0_40 · Cited by 39
Deep Neural Network Self-Distillation Exploiting Data Representation Invariance
Xu, T.-B., & Liu, C. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3027634 · Cited by 39
PredJoule: A Timing-Predictable Energy Optimization Framework for Deep Neural Networks
Bateni, S., Zhou, H., Zhu, Y., & Liu, C. (2018) · IEEE Real-Time Systems Symposium (RTSS) · doi:10.1109/rtss.2018.00020 · Cited by 40
Compressing CNN-DBLSTM models for OCR with teacher-student learning and Tucker decomposition
Ding, H., Chen, K., & Huo, Q. (2019) · Pattern Recognition · doi:10.1016/j.patcog.2019.07.002 · Cited by 38
Robust Student Network Learning
Guo, T., Xu, C., He, S., Shi, B., Xu, C., & Tao, D. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2929114 · Cited by 38
Heartbeat classification by using a convolutional neural network trained with Walsh functions
Dokur, Z., & Ölmez, T. (2020) · Neural Computing and Applications · doi:10.1007/s00521-020-04709-w · Cited by 40
FsNet: Feature Selection Network on High-dimensional Biological Data
Singh, D., Climente-González, H., Petrovich, M., Kawakami, E., & Yamada, M. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191985 · Cited by 38
Literature Review of Deep Network Compression
Alqahtani, A., Xie, X., & Jones, M. W. (2021) · Informatics · doi:10.3390/informatics8040077 · Cited by 42
Chen, Y., Wen, X., Zhang, Y., & He, Q. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107876 · Cited by 39
Self-citationMeasles Rash Identification Using Transfer Learning and Deep Convolutional Neural Networks
Glock, K., Napier, C., Gary, T., Gupta, V., Gigante, J., Schaffner, W., & Wang, Q. (2021) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata52589.2021.9671333 · Cited by 38
Neural Networks in Video-Based Age and Gender Recognition on Mobile Platforms
Сергеевна, Х. А., & Savchenko, A. (2018) · Optical Memory and Neural Networks · doi:10.3103/s1060992x18040021 · Cited by 39
Characterising Across-Stack Optimisations for Deep Convolutional Neural Networks
Turner, J., Cano, J., Radu, V., Crowley, E. J., O’boyle, M. F. P., & Storkey, A. (2018) · IEEE International Symposium on Workload Characterization · doi:10.1109/iiswc.2018.8573503 · Cited by 37
Structured Pruning of Convolutional Neural Networks via L1 Regularization
Yang, C., Yang, Z., Khattak, A. M., Liu, Y., Zhang, W., Gao, W., & Wang, M. (2019) · IEEE Access · doi:10.1109/access.2019.2933032 · Cited by 38
Yang, J., Kong, Y., Zhang, Z., Liu, Z., Zhou, J. L., Wang, Y., Liu, Y., Guo, C., Hu, T., Li, C., et al. (2021) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2021.3095232 · Cited by 39
Deep neural network compression by Tucker decomposition with nonlinear response
Liu, Y., & Ng, M. K. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108171 · Cited by 36
Deep Learning Acceleration with Neuron-to-Memory Transformation
Imani, M., Samragh, M., Kim, Y., Gupta, S., Koushanfar, F., & Rosing, T. (2020) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca47549.2020.00011 · Cited by 36
Ensemble-Compression: A New Method for Parallel Training of Deep Neural Networks
Sun, S., Chen, W., Bian, J., Liu, X., & Liu, T. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-71249-9_12 · Cited by 32
Self-citationResch, S., Khatamifard, S. K., Chowdhury, Z. I., Zabihi, M., Zhao, Z., Wang, J., Sapatnekar, S. S., & Karpuzcu, U. R. (2019) · ACM Transactions on Architecture and Code Optimization · doi:10.1145/3357250 · Cited by 35
Rotation Invariant Local Binary Convolution Neural Networks
Zhang, X., Liu, L., Xie, Y., Chen, J., Wu, L., & Pietikäinen, M. (2017) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2017.146 · Cited by 33
Optimization-Based Post-Training Quantization With Bit-Split and Stitching
Wang, P., Chen, W., He, X., Chen, Q., Liu, Q., & Cheng, J. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3159369 · Cited by 33
Self-citationDeep learning hashing for mobile visual search
Liu, W., Ma, H., Qi, H., Zhao, D. Y., & Chen, Z. (2017) · EURASIP Journal on Image and Video Processing · doi:10.1186/s13640-017-0167-4 · Cited by 34
LEARNING TO SHARE: SIMULTANEOUS PARAMETER TYING AND SPARSIFICATION IN DEEP LEARNING
Zhang, D., Wang, H., Figueiredo, M. A. T., & Balzano, L. (2018) · International Conference on Learning Representations · Cited by 33
Bayesian Neural Networks with Weight Sharing Using Dirichlet Processes
Roth, W., & Pernkopf, F. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2884905 · Cited by 34
Multi-teacher knowledge distillation for compressed video action recognition based on deep learning
Wu, M.-C., & Chiu, C. (2019) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2019.101695 · Cited by 34
Structured Pruning for Efficient Convolutional Neural Networks via Incremental Regularization
Wang, H., Hu, X., Zhang, Q., Wang, Y., Yu, L., & Hu, H. R. (2019) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2019.2961233 · Cited by 33
Low-Memory CNNs Enabling Real-Time Ultrasound Segmentation Towards Mobile Deployment
Vaze, S., Xie, W., & Namburete, A. I. L. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2019.2961264 · Cited by 33
RMNv2: Reduced Mobilenet V2 for CIFAR10
Ayi, M., & El‐Sharkawy, M. (2020) · IEEE Annual Computing and Communication Workshop and Conference (CCWC) · doi:10.1109/ccwc47524.2020.9031131 · Cited by 33
Trained Rank Pruning for Efficient Deep Neural Networks
Xu, Y., Li, Y., Zhang, S., Wen, W., Wang, B., Dai, W., Qi, Y., Chen, Y., Lin, W., & Xiong, H. (2019) · Workshop on Energy Efficient Machine Learning and Cognitive Computing for Embedded Applications (EMC2) · doi:10.1109/emc2-nips53020.2019.00011 · Cited by 42
Self-citationAccelerating Neural ODEs Using Model Order Reduction
Lehtimäki, M., Paunonen, L., & Linne, M. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3175757 · Cited by 33
Efficient Layer Compression Without Pruning
Wu, J., Zhu, D., Fang, L., Deng, Y. C., & Zhong, Z. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3302519 · Cited by 34
Weightless: Lossy Weight Encoding For Deep Neural Network CompressionPreprint
Reagen, B., Gupta, U., Adolf, R., Mitzenmacher, M., Rush, A. M., Wei, G.-Y., & Brooks, D. M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.04686 · Cited by 40
Fast Branch Convolutional Neural Network for Traffic Sign Recognition
Hu, W., Zhuo, Q., Zhang, C., & Li, J. (2017) · IEEE Intelligent Transportation Systems Magazine · doi:10.1109/mits.2017.2709780 · Cited by 32
Cascaded Projection: End-To-End Network Compression and Acceleration
Minnehan, B., & Savakis, A. E. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.01097 · Cited by 33
Simplifying deep neural networks for neuromorphic architectures
Chung, J., & Shin, T. (2016) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/2897937.2898092 · Cited by 31
Intelligent Classification of Tungsten Inert Gas Welding Defects: A Transfer Learning Approach
Sekhar, R., Sharma, D. K., & Shah, P. (2022) · Frontiers in Mechanical Engineering · doi:10.3389/fmech.2022.824038 · Cited by 31
An Overview of Neural Network CompressionPreprint
O’Neill, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.03669 · Cited by 149
LTNN: A Layerwise Tensorized Compression of Multilayer Neural Network
Huang, H., & Yu, H. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2869974 · Cited by 29
NTIRE 2020 Challenge on Image and Video Deblurring
Nah, S., Son, S., Timofte, R., Lee, K. M., Tseng, Y., Xu, Y.-S., Chiang, C.-M., Tsai, Y.-M., Brehm, S., Scherer, S., et al. (2020) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw50498.2020.00216 · Cited by 31
Block-term tensor neural networks
Ye, J., Li, G., Chen, D., Yang, H., Zhe, S., & Xu, Z. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.05.034 · Cited by 32
Optimizing Neural Networks for Efficient FPGA Implementation: A Survey
Ayachi, R., Said, Y., & Abdelali, A. B. (2021) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-021-09530-9 · Cited by 30
Practically Deploying Heavyweight Adaptive Bitrate Algorithms With Teacher-Student Learning
Meng, Z., Guo, Y., Shen, Y., Chen, J., Zhou, C., Wang, M., Zhang, J., Xu, M., Sun, C., & Hu, H. (2021) · IEEE/ACM Transactions on Networking · doi:10.1109/tnet.2020.3048666 · Cited by 30
Extremely Small BERT Models from Mixed-Vocabulary Training
Zhao, S., Gupta, R., Song, Y., & Zhou, D. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.238 · Cited by 41
Compressing Convolutional Neural NetworksPreprint
Chen, W., Wilson, J. T., Tyree, S., Weinberger, K. Q., & Chen, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.04449 · Cited by 36
Self-citationPruning Convolutional Neural Networks with Self-SupervisionPreprint
Caron, M., Morcos, A. S., Bojanowski, P., Mairal, J., & Joulin, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.03554 · Cited by 32
Leveraging Filter Correlations for Deep Model Compression
Singh, P. P., Verma, V. K., Rai, P., & Namboodiri, V. P. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093331 · Cited by 32
HetConv: Heterogeneous Kernel-Based Convolutions for Deep CNNs
Singh, P. P., Verma, V. K., Rai, P., & Namboodiri, V. P. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00497 · Cited by 37
Quantisation and Pruning for Neural Network Compression and Regularisation
Paupamah, K., James, S. D., & Klein, R. (2020) · 2020 International SAUPEC/RobMech/PRASA Conference · doi:10.1109/saupec/robmech/prasa48453.2020.9041096 · Cited by 31
AKECP: Adaptive Knowledge Extraction from Feature Maps for Fast and Efficient Channel Pruning
Zhang, H., Liu, L., Zhou, H., Hou, W., Sun, H., & Zheng, N. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475228 · Cited by 29
Learning Compression from Limited Unlabeled Data
He, X., & Cheng, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01246-5_46 · Cited by 29
Adaptive Neural Networks for Fast Test-Time Prediction.Preprint
Bolukbasi, T., Wang, J., Dekel, O., & Saligrama, V. (2017) · arXiv (Cornell University) · Cited by 29
Scalable Model Compression by Entropy Penalized ReparameterizationPreprint
Oktay, D., Ballé, J., Singh, S., & Shrivastava, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.06624 · Cited by 38
Pre-Defined Sparse Neural Networks With Hardware Acceleration
Dey, S., Huang, K.-W., Beerel, P. A., & Chugg, K. M. (2019) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2019.2910864 · Cited by 27
Meng, Z., Chen, J., Guo, Y., Sun, C., Hu, H., & Xu, M. (2019) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3343031.3350866 · Cited by 28
Kang, J., & Gwak, J. (2020) · Mathematics · doi:10.3390/math8101652 · Cited by 29
Kang, D. D., Bailis, P. D., & Zaharia, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.01046 · Cited by 28
Li, W., Hacid, H., Almazrouei, E., & Debbah, M. A. (2023) · AI · doi:10.3390/ai4030039 · Cited by 37
Guo, S., Zhang, L., Zheng, X., Wang, Y., Li, Y., Chao, F., Wu, C., Zhang, S., & Ji, R. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01601 · Cited by 30
Channel Compression: Rethinking Information Redundancy Among Channels in CNN Architecture
Liang, J., Zhang, T., & Feng, G. (2020) · IEEE Access · doi:10.1109/access.2020.3015714 · Cited by 27
Vita, F. D., Nocera, G., Bruneo, D., Tomaselli, V., Giacalone, D., & Das, S. K. (2021) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2021.101437 · Cited by 32
COP: customized correlation-based Filter level pruning method for deep CNN compression
Wang, W., Yu, Z., Fu, C., Cai, D., & He, X. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.08.098 · Cited by 27
Fast Convex Pruning of Deep Neural Networks
Aghasi, A., Abdi, A., & Romberg, J. (2020) · SIAM Journal on Mathematics of Data Science · doi:10.1137/19m1246468 · Cited by 29
Exploiting Local Structures with the Kronecker Layer in Convolutional NetworksPreprint
Zhou, S., Wu, J., Wu, Y., & Zhou, X. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.09194 · Cited by 28
Max-Plus Operators Applied to Filter Selection and Model Pruning in Neural Networks
Zhang, Y., Blusseau, S., Velasco-Forero, S., Isabelle Bloch, A., & Angulo, J. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-20867-7_24 · Cited by 28
HetConv: Beyond Homogeneous Convolution Kernels for Deep CNNs
Singh, P. P., Verma, V. K., Rai, P., & Namboodiri, V. P. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01264-3 · Cited by 25
Charles Rajesh Kumar., J., Vinod Kumar, D., Baskar, D., Mary Arunsi., B., Jenova, R., & Majid, M. A. (2019) · Procedia Computer Science · doi:10.1016/j.procs.2019.12.145 · Cited by 26
Acceleration of Deep Convolutional Neural Networks Using Adaptive Filter Pruning
Singh, P. P., Verma, V. K., Rai, P., & Namboodiri, V. P. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2992390 · Cited by 29
Metadata
- Authors
- Chen, W., Wilson, J. T., Tyree, S., Weinberger, K. Q., & Chen, Y.
- Affiliations
- Washington University in St. Louis (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2015
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1504.04788
- OpenAlex
- W2172166488
- Cited by
- 974
- References
- 53
- Citations by year
- 2026: 2 · 2025: 9 · 2024: 29 · 2023: 59 · 2022: 69 · 2021: 118 · 2020: 167 · 2019: 159 · 2018: 184 · 2017: 114 · 2016: 44 · 2015: 19
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- neural network compression, parameter sharing, model size reduction, memory-efficient deep learning, mobile devices, parameter redundancy, hash functions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review