The DOI matches its DataCite record; 51 of the 53 references it cites were found in a registry or an index.
Compressing Neural Networks with the Hashing Trick
Open accessAbstract
As deep nets are increasingly used in applications suited for mobile devices, a fundamental dilemma becomes apparent: the trend in deep learning is to grow models to absorb ever-increasing data set sizes; however mobile devices are designed with very little memory and cannot store such large models. We present a novel network architecture, HashedNets, that exploits inherent redundancy in neural networks to achieve drastic reductions in model sizes. HashedNets uses a low-cost hash function to randomly group connection weights into hash buckets, and all connections within the same hash bucket share a single parameter value. These parameters are tuned to adjust to the HashedNets weight sharing architecture with standard backprop during training. Our hashing procedure introduces no additional memory overhead, and we demonstrate on several benchmark data sets that HashedNets shrink the storage requirements of neural networks substantially while mostly preserving generalization performance.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In addition, structured update, sketched update can help enhance the communication efficiency when clients uploading updates to the server as well.”
From Convergence of Edge Computing and Deep Learning: A Comprehensive Survey (2020) · cites this paper as [202]
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
(2014) · Cited by 33,419
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Neural networks for pattern recognition
Bishop, C. (1994) · Choice Reviews Online · doi:10.5860/choice.31-5500 · Cited by 18,537
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
(2010) · International Conference on Machine Learning · Cited by 13,995
Term-Weighting Approaches in Automatic Text Retrieval
Salton, G., & Buckley, C. (1988) · Information Processing & Management · doi:10.1016/0306-4573(88)90021-0 · Cited by 11,421
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Cited by
Sorted by citations
Items 401–500 of 973
Visual-Saliency-Guided Channel Pruning for Deep Visual Detectors in Autonomous Driving
Choi, J. I., & Tian, Q. (2023) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv55152.2023.10186819 · Cited by 15
Towards Better Structured Pruning Saliency by Reorganizing Convolution
Sun, X., & Shi, H. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00220 · Cited by 16
Optimization and evaluation of deep architectures for ambient awareness on a sidewalk
Ahmed, F., & Yeasin, M. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966186 · Cited by 15
Training Discrete-Valued Neural Networks with Sign Activations Using Weight Distributions
Roth, W., Schindler, G., Fröning, H., & Pernkopf, F. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-46147-8_23 · Cited by 16
Online knowledge distillation with elastic peer
Tan, C., & Liu, J. (2021) · Information Sciences · doi:10.1016/j.ins.2021.10.043 · Cited by 15
Learning Compressed Transforms with Low Displacement Rank
Thomas, A., Gu, A., Dao, T., Atri Rudra, B., & Ré, C. (2018) · PubMed · doi:10.48550/arxiv.1810.02309 · Cited by 15
Reliable identification of redundant kernels for convolutional neural network compression
Wang, W., Zhu, L., & Guo, B. (2019) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2019.102582 · Cited by 14
Intelligent Crater Detection on Planetary Surface Using Convolutional Neural Network
Wu, Y., Wan, G., Liu, L., Wei, Z., & Wang, S. (2021) · IEEE Advanced Information Technology, Electronic and Automation Control Conference (IAEAC) · doi:10.1109/iaeac50856.2021.9391002 · Cited by 15
Exploiting Errors for Efficiency: A Survey from Circuits to AlgorithmsPreprint
Stanley‐Marbell, P., Alaghi, A., Carbin, M., Darulová, E., Dolecek, L., Gerstlauer, A., Gillani, G., Jevdjic, D., Moreau, T., Cacciotti, M., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.05859 · Cited by 15
Distributed Machine Learning on Mobile Devices: A Survey.Preprint
Gu, R., Yang, S., & Wu, F. (2019) · arXiv (Cornell University) · Cited by 15
Full deep neural network training on a pruned weight budgetPreprint
Golub, M., Lemieux, G. G. F., & Lis, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.06949 · Cited by 23
Design and Prototyping of Neural Network Compression for Non-Orthogonal IoT Signals
Xu, T., & Darwazeh, I. (2019) · IEEE Wireless Communications and Networking Conference · doi:10.1109/wcnc.2019.8885830 · Cited by 14
RFPruning: A retraining-free pruning method for accelerating convolutional neural networks
Wang, Z., Xie, X., & Shi, G. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2021.107860 · Cited by 14
Heterogeneous Acceleration Pipeline for Recommendation System Training
Adnan, M., Maboud, Y. E., Mahajan, D., & Nair, P. J. (2024) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1109/isca59077.2024.00081 · Cited by 20
Ujiie, T., Hiromoto, M., & Sato, T. G. (2016) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.113 · Cited by 14
Exploiting Domain Knowledge via Grouped Weight Sharing with Application to Text Categorization
Zhang, Y., Lease, M., & Wallace, B. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-2024 · Cited by 16
DCT-Conv: Coding filters in convolutional networks with Discrete Cosine Transform
Cheinski, K., & Wawrzyński, P. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207103 · Cited by 14
Exploiting prunability for person re-identification
Masson, H., Bhuiyan, A., Nguyen-Meidine, L. T., Javan, M., Siva, P., Ayed, I. B., & Granger, É. (2021) · EURASIP Journal on Image and Video Processing · doi:10.1186/s13640-021-00562-6 · Cited by 22
Cohen, N., Sharir, O., & Shashua, A. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.517 · Cited by 14
UAVNet: An Efficient Obstacel Detection Model for UAV with Autonomous Flight
Chen, P.-H., & Lee, C. (2018) · Intelligent Autonomous Systems · doi:10.1109/icoias.2018.8494201 · Cited by 14
Multi-fidelity deep neural networks for adaptive inference in the internet of multimedia things
Leroux, S., Bohez, S., Coninck, E. D., Molle, P. V., Vankeirsbilck, B., Verbelen, T., Simoens, P., & Dhoedt, B. (2019) · Future Generation Computer Systems · doi:10.1016/j.future.2019.03.001 · Cited by 14
Compression of Deep Neural Networks by Combining Pruning and Low Rank Decomposition
Goyal, S., Choudhury, A. R., & Sharma, V. K. (2019) · IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum · doi:10.1109/ipdpsw.2019.00162 · Cited by 14
Is Pruning Compression?: Investigating Pruning Via Network Layer Similarity
Blakeney, C., Yan, Y., & Zong, Z. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093318 · Cited by 15
Addressing Irregularity in Sparse Neural Networks through a Cooperative Software/Hardware Approach
Zeng, X., Zhou, X., Li, L., Chen, T., Sun, N., Chen, Y., Zhi, T., Zhou, X., Du, Z., Guo, Q., et al. (2020) · IEEE Transactions on Computers · doi:10.1109/tc.2020.2978475 · Cited by 14
Self-citationFast ConvNets Using Group-wise Brain DamagePreprint
Lebedev, V., & Lempitsky, V. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.02515 · Cited by 27
Teacher-Student Compression with Generative Adversarial NetworksPreprint
Liu, R., Fusi, N., & Mackey, L. W. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.02271 · Cited by 22
A Highly Parallel FPGA Implementation of Sparse Neural Network Training
Dey, S., Chen, D., Li, Z., Kundu, S., Huang, K.-W., Chugg, K. M., & Beerel, P. A. (2018) · International Conference on ReConFigurable Computing and FPGAs (ReConFig) · doi:10.1109/reconfig.2018.8641739 · Cited by 13
A Lightweight Automatic Wildlife Recognition Model Design Method Mitigating Shortcut Learning
Zhong, Y., Li, X., Xie, J., & Zhang, J. (2023) · Animals · doi:10.3390/ani13050838 · Cited by 13
CFDP: Common Frequency Domain Pruning
Khaki, S., & Luo, W. (2023) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw59228.2023.00499 · Cited by 13
Euclidean and Hamming Embedding for Image Patch Description with Convolutional Networks
Liu, Z., Li, Z., Zhang, J., & Liu, L. (2016) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.146 · Cited by 13
Real-Time Embedded Motion Detection via Neural Response Mixture Modeling
Shafiee, M. J., Siva, P., Fieguth, P., & Wong, A. K. C. (2017) · Journal of Signal Processing Systems · doi:10.1007/s11265-017-1265-3 · Cited by 11
Intra-layer nonuniform quantization of convolutional neural network
Sun, F., Lin, J. T., & Wang, Z. (2016) · International Conference on Wireless Communications and Signal Processing (WCSP) · doi:10.1109/wcsp.2016.7752720 · Cited by 13
A Quantized CNN-Based Microfluidic Lensless-Sensing Mobile Blood-Acquisition and Analysis System
Liao, Y., Yu, N., Tian, D., Li, S., & Li, Z. (2019) · Sensors · doi:10.3390/s19235103 · Cited by 13
Model Compression Hardens Deep Neural Networks: A New Perspective to Prevent Adversarial Attacks
Liu, Q., & Wen, W. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3089128 · Cited by 16
Filter Clustering for Compressing CNN Model With Better Feature Diversity
Wang, Z., Xie, X., Zhao, Q., & Shi, G. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3216101 · Cited by 14
Universal Source Coding of Deep Neural Networks
Basu, S., & Varshney, L. R. (2017) · DCC · doi:10.1109/dcc.2017.60 · Cited by 13
Reducing parameter number in residual networks by sharing weights
Boulch, A. (2018) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.01.006 · Cited by 42
DeepRT: predictable deep learning inference for cyber-physical systems
Kang, W., & Chung, J. (2018) · Real-Time Systems · doi:10.1007/s11241-018-9314-y · Cited by 13
A streaming architecture for Convolutional Neural Networks based on layer operations chaining
Arredondo-Velázquez, M., Díaz-Carmona, J., Torres-Huitzil, C., Padilla-Medina, J. A., & Prado-Olivarez, J. (2020) · Journal of Real-Time Image Processing · doi:10.1007/s11554-019-00938-y · Cited by 13
Deep Fried ConvnetsPreprint
Yang, Z., Moczulski, M., Denil, M., de Freitas, N., Smola, A. J., Song, L., & Wang, Z. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.7149 · Cited by 13
Layer Pruning via Fusible Residual Convolutional Block for Deep Neural NetworksPreprint
Xu, P., Cao, J., Shang, F., Sun, W., & Li, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.14356 · Cited by 13
Torque based Structured Pruning for Deep Neural Network
Gupta, A., Bau, T. C., Kim, J., Zhu, Z., Jha, S., & Garud, H. (2024) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv57701.2024.00269 · Cited by 12
Wang, S., Li, K., Huang, Z., Siniscalchi, S. M., & Lee, C. (2017) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2017.7953223 · Cited by 12
Hybrid Binary Networks: Optimizing for Accuracy, Efficiency and Memory
Prabhu, A., Batchu, V., Gajawada, R., Munagala, S. A., & Namboodiri, A. (2018) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv.2018.00095 · Cited by 12
Structured Multi-Hashing for Model Compression
Eban, E., Movshovitz-Attias, Y., Wu, H., Sandler, M., Poon, A., Idelbayev, Y., & Carreira-Perpiñán, M. Á. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01192 · Cited by 12
Revisiting Deep Learning Parallelism: Fine-Grained Inference Engine Utilizing Online Arithmetic
Abdelhadi, A., & Shannon, L. (2019) · International Conference on Field-Programmable Technology (FPT) · doi:10.1109/icfpt47387.2019.00073 · Cited by 12
Constrained Learned Feature Extraction for Acoustic Scene Classification
Zhang, T., & Wu, J. Y. (2019) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2019.2913091 · Cited by 12
512KiB RAM Is Enough! Live Camera Face Recognition DNN on MCU
Zemlyanikin, M., Smorkalov, A., Khanova, T., Petrovicheva, A., & Serebryakov, G. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00305 · Cited by 12
Real-time adversarial GAN-based abnormal crowd behavior detection
Han, Q., Wang, H., Yang, L., Wu, M., Kou, J., Du, Q., & Li, N. (2020) · Journal of Real-Time Image Processing · doi:10.1007/s11554-020-01029-z · Cited by 12
Evolution in Groups: A deeper look at synaptic cluster driven evolution of deep neural networksPreprint
Shafiee, M. J., Barshan, E., & Wong, A. K. C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.02081 · Cited by 12
On the energy landscape of deep networksPreprint
Chaudhari, P., & Soatto, S. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06485 · Cited by 24
Spectral-Pruning: Compressing deep neural network via spectral analysisPreprint
Suzuki, T., Abe, H., Murata, T., Horiuchi, S., Ito, K., Wachi, T., Hirai, S., Yukishima, M., & Nishimura, T. (2018) · arXiv (Cornell University) · Cited by 12
CodeX: Bit-Flexible Encoding for Streaming-based FPGA Acceleration of DNNsPreprint
Samragh, M., Javaheripi, M., & Koushanfar, F. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.05582 · Cited by 12
Intermittent Learning: On-Device Machine Learning on Intermittently Powered SystemPreprint
Lee, S., Islam, B., Luo, Y., & Nirjon, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.09644 · Cited by 12
Distilling Word Embeddings: An Encoding ApproachPreprint
Mou, L., Jia, R., Xu, Y., Li, G., Zhang, L., & Jin, Z. G. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.04488 · Cited by 12
ApproxNet: Content and Contention Aware Video Analytics System for the Edge.Preprint
Xu, R., Koo, J., Kumar, R., Bai, P., Mitra, S., Maghanath, G., & Bagchi, S. (2019) · arXiv (Cornell University) · Cited by 12
Connectivity Matters: Neural Network Pruning Through the Lens of Effective SparsityPreprint
Vysogorets, A., & Kempe, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.02306 · Cited by 15
Ou, X., Chen, Z., Zhu, C., & Liu, Y. (2023) · Journal of Systems Engineering and Electronics · doi:10.23919/jsee.2023.000159 · Cited by 13
Viterbi-based Pruning for Sparse Matrix with Fixed and High Index Compression Ratio
Lee, D., Ahn, D., Kim, T., Chuang, P., & Kim, J. (2018) · Open Access System for Information Sharing (Pohang University of Science and Technology) · Cited by 11
Xu, J., Xie, C., Hu, S., Yu, J., Liu, X., & Meng, H. M. L. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053483 · Cited by 11
Goal driven network pruning for object recognition
Kaplan, C., & Bülbül, A. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107468 · Cited by 12
Modulated Convolutional Networks
Zhang, B., Wang, R., Wang, X., Han, J., & Ji, R. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3060830 · Cited by 12
Convolutional neural network feature maps selection based on LDA
Rui, T., Zou, J., Zhou, Y., Fei, J., & Yang, C. (2017) · Multimedia Tools and Applications · doi:10.1007/s11042-017-4684-z · Cited by 11
Towards optimal quantization of neural networks
Chatterjee, A., & Varshney, L. R. (2017) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit.2017.8006711 · Cited by 11
Tang, Y., & Verma, N. (2018) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2018.2808104 · Cited by 11
Network Approximation using Tensor Sketching
Kasiviswanathan, S. P., Narodytska, N., & Jin, H. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/321 · Cited by 11
Data Analytics Service Composition and Deployment on Edge Devices
Zhao, J., Tiplea, T., Mortier, R., Crowcroft, J., & Wang, L. (2018) · doi:10.1145/3229607.3229615 · Cited by 11
Nonlinear Asymmetric Multi-Valued Hashing
Da, C., Meng, G., Xiang, S., Ding, K., Xu, S., Yang, Q., & Pan, C. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2867866 · Cited by 10
A Channel-level Pruning Strategy for Convolutional Layers in CNNs
Song, F., Wang, Y., Guo, Y., Zhu, C., Liu, J., & Jin, M. (2018) · IEEE International Conference on Network Infrastructure and Digital Content (IC-NIDC) · doi:10.1109/icnidc.2018.8525815 · Cited by 11
Power- and Time-Aware Deep Learning Inference for Mobile Embedded Devices
Kang, W., & Chung, J. (2018) · IEEE Access · doi:10.1109/access.2018.2887099 · Cited by 11
Towards Efficient Front-End Visual Sensing for Digital Retina: A Model-Centric Paradigm
Lou, Y., Duan, L., Luo, Y., Chen, Z., Liu, T., Wang, S., & Gao, W. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.2966885 · Cited by 11
Nazir, A., Mir, R. N., & Qureshi, S. (2020) · International Journal of Intelligent Computing and Cybernetics · doi:10.1108/ijicc-04-2020-0038 · Cited by 12
Convolution without multiplication: A general speed up strategy for CNNs
Cai, G., Yang, S., Du, J., Wang, Z., Huang, B., Guan, Y., Su, S., Su, S., & Su, S. (2021) · Science China Technological Sciences · doi:10.1007/s11431-021-1936-2 · Cited by 11
Interpretable Relative Squeezing bottleneck design for compact convolutional neural networks model
Zhao, Q., Liu, J., Zhang, B., Lyu, S., Raoof, N., & Feng, W. (2019) · Image and Vision Computing · doi:10.1016/j.imavis.2019.06.006 · Cited by 11
Trained Rank Pruning for Efficient Deep Neural NetworksPreprint
Xu, Y., Li, Y., Zhang, S., Wen, W., Wang, B., Dai, W., Qi, Y., Chen, Y., Lin, W., & Xiong, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1910.04576 · Cited by 11
Self-citationAll Word Embeddings from One EmbeddingPreprint
Takase, S., & Kobayashi, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.12073 · Cited by 11
ApproxNet: Content and Contention-Aware Video Analytics System for Embedded ClientsPreprint
Xu, R., Kumar, R., Wang, P., Bai, P., Meghanath, G., Chaterji, S., Mitra, S., & Bagchi, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.02068 · Cited by 11
Deep CNNs for Peripheral Blood Cell ClassificationPreprint
Gavas, E., & Olpadkar, K. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.09508 · Cited by 11
DenseKD: Dense Knowledge Distillation by Exploiting Region and Sample Importance
Zhang, H., Liu, L., Zhang, Y., Lei, X., Hui, F., & Wen, B. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2025.3525737 · Cited by 10
A Survey of Sparse-Learning Methods for Deep Neural Networks
Ma, R., & Niu, L. (2018) · IEEE/WIC/ACM International Conference on Web Intelligence · doi:10.1109/wi.2018.00-20 · Cited by 12
One-shot pruning of gated recurrent unit neural network by sensitivity for time-series prediction
Tang, H., Ling, X., Li, L., Xiong, L., Yao, Y., & Huang, X. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.09.026 · Cited by 10
FitCNN: A cloud-assisted lightweight convolutional neural network framework for mobile devices
Li, S., Liu, D., Xiang, C., Liu, J., Ling, Y., Liao, T., & Liang, L. (2017) · IEEE International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA) · doi:10.1109/rtcsa.2017.8046337 · Cited by 9
Characterizing Sparse Connectivity Patterns in Neural Networks
Dey, S., Huang, K.-W., Beerel, P. A., & Chugg, K. M. (2018) · Information Theory and Applications Workshop (ITA) · doi:10.1109/ita.2018.8502950 · Cited by 10
Priority Neuron: A Resource-Aware Neural Network for Cyber-Physical Systems
Amir, M., & Givargis, T. D. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2018.2857319 · Cited by 10
Minimizing Classification Energy of Binarized Neural Network Inference for Wearable Devices
Hosseini, M., Paneliya, H., Kallakuri, U., Khatwani, M., & Mohsenin, T. (2019) · International Symposium on Quality Electronic Design (ISQED) · doi:10.1109/isqed.2019.8697574 · Cited by 10
Flexible Fashion Product Retrieval Using Multimodality-Based Deep Learning
Jo, Y., Wi, J., Kim, M., & Lee, J. Y. (2020) · Applied Sciences · doi:10.3390/app10051569 · Cited by 11
Compact Speaker Embedding: lrx-Vector
Georges, M., Huang, J., & Bocklet, T. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-2106 · Cited by 10
COSINE: Compressive Network Embedding on Large-Scale Information Networks
Zhang, Z., Yang, C. H., Liu, Z., Sun, M., Fang, Z., Zhang, B., & Lin, L. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3030539 · Cited by 10
Deep-Like Hashing-in-Hash for Visual Retrieval: An Embarrassingly Simple Method
Zhang, L., Liu, J., Huang, F., Yang, Y., & Zhang, D. D. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2020.3011796 · Cited by 10
Structured Convolution Matrices for Energy-efficient Deep learningPreprint
Appuswamy, R., Nayak, T. K., Arthur, J. V., Esser, S. K., Merolla, P. A., McKinstry, J. L., Melano, T., Flickner, M., & Modha, D. S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.02407 · Cited by 13
Optimizing Deep CNN-Based Queries over Video Streams at ScalePreprint
Kang, D. D., Emmons, J., Abuzaid, F., Bailis, P. D., & Zaharia, M. (2017) · arXiv (Cornell University) · Cited by 10
Learning K-way D-dimensional Discrete Code For Compact Embedding RepresentationsPreprint
Chen, T., Min, M. R., & Sun, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.03067 · Cited by 12
BT-Nets: Simplifying Deep Neural Networks via Block Term DecompositionPreprint
Li, G., Ye, J., Yang, H., Chen, D., Yan, S., & Xu, Z. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.05689 · Cited by 11
Rethinking Class-Discrimination Based CNN Channel PruningPreprint
Liu, Y., Wentzlaff, D., & Kung, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.14492 · Cited by 11
AR-Net: Adaptive Frame Resolution for Efficient Action RecognitionPreprint
Meng, Y., Lin, C.-C., Panda, R., Sattigeri, P., Karlinsky, L., Oliva, A., Saenko, K., & Feris, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.15796 · Cited by 10
Lv, Z., Li, Y., Qian, S., Wu, L., & Yang, Y. (2024) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-023-02317-8 · Cited by 9
Deep learning neural networks optimization using hardware cost penalty
Doshi, R., Hung, K.-W., Liang, L., & Chiu, K. H. (2016) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2016.7538957 · Cited by 9
Improving Network Slimming With Nonconvex Regularization
Bui, K., Park, F., Zhang, S., Qi, Y., & Xin, J. X. (2021) · IEEE Access · doi:10.1109/access.2021.3105366 · Cited by 9
CMD: controllable matrix decomposition with global optimization for deep neural network compression
Zhang, H., Liu, L., Zhou, H., Sun, H., & Zheng, N. (2022) · Machine Learning · doi:10.1007/s10994-021-06077-5 · Cited by 9
Deep neural network compression via knowledge distillation for embedded applications
Jaiswal, B., & Gajjar, N. (2017) · Nirma University International Conference on Engineering · doi:10.1109/nuicone.2017.8325620 · Cited by 9
Metadata
- Authors
- Chen, W., Wilson, J. T., Tyree, S., Weinberger, K. Q., & Chen, Y.
- Affiliations
- Washington University in St. Louis (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2015
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1504.04788
- OpenAlex
- W2172166488
- Cited by
- 974
- References
- 53
- Citations by year
- 2026: 2 · 2025: 9 · 2024: 29 · 2023: 59 · 2022: 69 · 2021: 118 · 2020: 167 · 2019: 159 · 2018: 184 · 2017: 114 · 2016: 44 · 2015: 19
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- neural network compression, parameter sharing, model size reduction, memory-efficient deep learning, mobile devices, parameter redundancy, hash functions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review