The DOI matches its DataCite record; 51 of the 53 references it cites were found in a registry or an index.
Compressing Neural Networks with the Hashing Trick
Open accessAbstract
As deep nets are increasingly used in applications suited for mobile devices, a fundamental dilemma becomes apparent: the trend in deep learning is to grow models to absorb ever-increasing data set sizes; however mobile devices are designed with very little memory and cannot store such large models. We present a novel network architecture, HashedNets, that exploits inherent redundancy in neural networks to achieve drastic reductions in model sizes. HashedNets uses a low-cost hash function to randomly group connection weights into hash buckets, and all connections within the same hash bucket share a single parameter value. These parameters are tuned to adjust to the HashedNets weight sharing architecture with standard backprop during training. Our hashing procedure introduces no additional memory overhead, and we demonstrate on several benchmark data sets that HashedNets shrink the storage requirements of neural networks substantially while mostly preserving generalization performance.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In addition, structured update, sketched update can help enhance the communication efficiency when clients uploading updates to the server as well.”
From Convergence of Edge Computing and Deep Learning: A Comprehensive Survey (2020) · cites this paper as [202]
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
(2014) · Cited by 33,419
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Neural networks for pattern recognition
Bishop, C. (1994) · Choice Reviews Online · doi:10.5860/choice.31-5500 · Cited by 18,537
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
(2010) · International Conference on Machine Learning · Cited by 13,995
Term-Weighting Approaches in Automatic Text Retrieval
Salton, G., & Buckley, C. (1988) · Information Processing & Management · doi:10.1016/0306-4573(88)90021-0 · Cited by 11,421
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Cited by
Sorted by citations
Items 301–400 of 973
Data-free quantization via mixed-precision compensation without fine-tuning
Chen, J., Bai, S., Huang, T., Wang, M., Tian, G., & Liu, Y. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.109780 · Cited by 26
On Correlation of Features Extracted by Deep Neural Networks
Ayinde, B. O., Inanc, T., & Żurada, J. M. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852296 · Cited by 26
From Algorithm to Hardware: A Survey on Efficient and Safe Deployment of Deep Neural Networks
Geng, X., Wang, Z., Chen, C., Xu, Q., Xu, K., Jin, C., Gupta, M., Yang, X., Chen, Z., Sabry Aly, M. M., et al. (2025) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3394494 · Cited by 26
Automatic DenseNet Sparsification
Li, T., Jiao, W., Wang, L., & Zhong, G. (2020) · IEEE Access · doi:10.1109/access.2020.2984130 · Cited by 25
On the Automatic Exploration of Weight Sharing for Deep Neural Network Compression
Dupuis, E., Novo, D., O’Connor, I., & Bosio, A. (2020) · Design, Automation, and Test in Europe · doi:10.23919/date48585.2020.9116350 · Cited by 27
Fast Walsh-Hadamard Transform and Smooth-Thresholding Based Binary Layers in Deep Neural Networks
Pan, H., Badawi, D., & Çetin, A. E. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00523 · Cited by 25
Exploration and Estimation for Model Compression
Zhang, Y., Gao, S., & Huang, H. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00054 · Cited by 26
ADA-Tucker: Compressing deep neural networks via adaptive dimension adjustment tucker decomposition
Zhong, Z., Wei, F., Lin, Z., & Zhang, C. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.10.016 · Cited by 27
Efficient Quantization for Neural Networks with Binary Weights and Low Bitwidth Activations
Huang, K., Ni, B., & Yang, X. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33013854 · Cited by 25
RotDCF: Decomposition of Convolutional Filters for Rotation-Equivariant Deep NetworksPreprint
Cheng, X., Qiu, Q., Calderbank, R., & Sapiro, G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.06846 · Cited by 25
FitCNN: A cloud-assisted and low-cost framework for updating CNNs on IoT devices
Liu, D., Yang, C., Li, S., Chen, X., Ren, J., Liu, R., Duan, M., Tan, Y., & Liang, L. (2018) · Future Generation Computer Systems · doi:10.1016/j.future.2018.09.020 · Cited by 25
Compact Convolutional Recurrent Neural Networks via Binarization for Speech Emotion Recognition
Zhao, H., Xiao, Y., Han, J., & Zhang, Z. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8683389 · Cited by 26
Bateni, S., & Liu, C. (2020) · Cited by 24
DiSparse: Disentangled Sparsification for Multitask Model Compression
Sun, X., Hassani, A., Wang, Z., Huang, G. M., & Shi, H. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01206 · Cited by 24
MB-CNN: Memristive Binary Convolutional Neural Networks for Embedded Mobile Devices
Chowdhury, A. P., Kulkarni, P., & Bojnordi, M. N. (2018) · Journal of Low Power Electronics and Applications · doi:10.3390/jlpea8040038 · Cited by 24
Iterative Deep Neural Network Quantization With Lipschitz Constraint
Xu, Y., Dai, W., Qi, Y., Zou, J., & Xiong, H. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2019.2949857 · Cited by 24
Binary embeddings with structured hashed projectionsPreprint
Choromanska, A., Choromański, K., Bojarski, M., Jebara, T., Kumar, S., & LeCun, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.05212 · Cited by 25
Carreira-Perpiñán, M. Á. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.01209 · Cited by 24
FALF ConvNets: Fatuous auxiliary loss based filter-pruning for efficient deep CNNs
Singh, P. P., Kadi, V. S. R., & Namboodiri, V. P. (2019) · Image and Vision Computing · doi:10.1016/j.imavis.2019.103857 · Cited by 23
Deep Model Compression based on the Training History
Basha, S. H. S., Farazuddin, M., Pulabaigari, V., Dubey, S. R., & Mukherjee, S. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127257 · Cited by 25
ApproxNet: Content and Contention-Aware Video Object Classification System for Embedded Clients
Xu, R., Kumar, R., Wang, P., Bai, P., Meghanath, G., Chaterji, S., Mitra, S., & Bagchi, S. (2021) · ACM Transactions on Sensor Networks · doi:10.1145/3463530 · Cited by 37
Knowledge distillation-based deep learning classification network for peripheral blood leukocytes
Leng, B., Leng, M., Ge, M., & Dong, W. (2022) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2022.103590 · Cited by 25
Inference-aware convolutional neural network pruning
Choudhary, T., Mishra, V. K., Goswami, A., & Jagannathan, S. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2022.04.031 · Cited by 23
Improvement of Min-Entropy Evaluation Based on Pruning and Quantized Deep Neural Network
Li, H., Zhang, J., Li, Z., Liu, J., & Wang, Y. (2023) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2023.3240859 · Cited by 26
Adaptive and Resilient Model-Distributed Inference in Edge Computing Systems
Li, P., Koyuncu, E., & Seferoğlu, H. (2023) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2023.3280174 · Cited by 26
Slim Embedding Layers for Recurrent Neural Language Models
Li, Z., Kulhanek, R., Wang, S., Zhao, Y., & Wu, S. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12000 · Cited by 23
Training binary neural networks with knowledge transfer
Leroux, S., Vankeirsbilck, B., Verbelen, T., Simoens, P., & Dhoedt, B. (2019) · Neurocomputing · doi:10.1016/j.neucom.2018.09.103 · Cited by 23
Improved Knowledge Distillation for Training Fast Low Resolution Face Recognition Model
Wang, M., Liu, R., Nada, H., Abe, N., Uchida, H., & Matsunami, T. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00324 · Cited by 23
Effective and efficient multitask learning for brain tumor segmentation
Cheng, G., Cheng, J., Luo, M., He, L., Tian, Y. T., & Wang, R. (2020) · Journal of Real-Time Image Processing · doi:10.1007/s11554-020-00961-4 · Cited by 23
Word2Bits - Quantized Word VectorsPreprint
Lam, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.05651 · Cited by 23
Embedding deep networks into visual explanations
Qi, Z., Khorram, S., & Li, F. (2020) · Artificial Intelligence · doi:10.1016/j.artint.2020.103435 · Cited by 26
Zhu, G., Wang, J., Wang, P., Wu, Y., & Lu, H. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2017.2776977 · Cited by 21
PruNet: Class-Blind Pruning Method For Deep Neural Networks
Marchisio, A., Hanif, M. A., Martina, M., & Shafique, M. (2018) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489764 · Cited by 21
GQNA: Generic Quantized DNN Accelerator With Weight-Repetition-Aware Activation Aggregating
Yang, J., Tu, F., Li, Y., Wang, Y., Liu, L., Wei, S., & Yin, S. (2022) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2022.3188899 · Cited by 22
ESPACE: Accelerating Convolutional Neural Networks via Eliminating Spatial and Channel Redundancy
Lin, S., Ji, R., Chen, C., & Huang, F. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10756 · Cited by 22
Mou, L., Jia, R., Xu, Y., Li, G., Zhang, L., & Jin, Z. G. (2016) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2983323.2983888 · Cited by 22
Rate Distortion For Model Compression: From Theory To PracticePreprint
Gao, W., Liu, Y.-H., Wang, C., & Oh, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.06401 · Cited by 20
Liu, Q., Liu, T., Liu, Z., Wang, Y., Jin, Y., & Wen, W. (2018) · arXiv (Cornell University) · doi:10.5555/3201607.3201772 · Cited by 25
Weight-Sharing Neural Architecture Search: A Battle to Shrink the Optimization GapPreprint
Xie, L., Chen, X., Bi, K., Wei, L., Xu, Y., Chen, Z., Wang, L., Xiao, A., Chang, J., Zhang, X., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.01475 · Cited by 29
A Channel Pruning Algorithm Based on Depth-Wise Separable Convolution Unit
Zhang, K., Cheng, K., Li, J., & Peng, Y. (2019) · IEEE Access · doi:10.1109/access.2019.2956976 · Cited by 21
Filter pruning via separation of sparsity search and model training
Lian, Y., Peng, P., & Xu, W. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.07.083 · Cited by 21
Jointly Training and Pruning CNNs via Learnable Agent Guidance and Alignment
Ganjdanesh, A., Gao, S., & Huang, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01520 · Cited by 22
Wang, Z., Deng, Z., & Wang, S. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46484-8_32 · Cited by 22
Blalock, D. W., & Guttag, J. V. (2017) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3097983.3098195 · Cited by 21
DANoC: An Efficient Algorithm and Hardware Codesign of Deep Neural Networks on Chip
Zhou, X., Li, S., Tang, F., Hu, S., Lin, Z. W., & Zhang, L. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2717442 · Cited by 21
Loroch, D. M., Pfreundt, F., Wehn, N., & Keuper, J. (2017) · doi:10.1145/3146347.3146348 · Cited by 23
Lightweight residual densely connected convolutional neural network
Fooladgar, F., & Kasaei, S. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-09223-8 · Cited by 21
A Model Compression Method With Matrix Product Operators for Speech Enhancement
Sun, X., Gao, Z.-F., Lu, Z.-Y., Li, J., & Yan, Y. (2020) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2020.3030495 · Cited by 21
Kronecker Recurrent UnitsPreprint
Jose, C., Cisse, M., & Fleuret, F. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.10142 · Cited by 21
Saliency and location aware pruning of deep visual detectors for autonomous driving
Choi, J. I., & Tian, Q. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128656 · Cited by 21
BilevelPruning: Unified Dynamic and Static Channel Pruning for Convolutional Neural Networks
Gao, S., Zhang, Y., Huang, F., & Huang, H. (2024) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52733.2024.01523 · Cited by 21
Cohen, N., Sharir, O., & Shashua, A. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · Cited by 20
Accuracy to Throughput Trade-Offs for Reduced Precision Neural Networks on Reconfigurable Logic
Su, J., Fraser, N. J., Gambardella, G., Blott, M., Durelli, G. C., Thomas, D. B., Leong, P. H. W., & Cheung, P. Y. K. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-78890-6_3 · Cited by 20
Compression of fully-connected layer in neural network by Kronecker product
Wu, J. (2016) · International Conference on Advanced Computational Intelligence (ICACI) · doi:10.1109/icaci.2016.7449822 · Cited by 22
Optimizing Weight Value Quantization for CNN Inference
Nogami, W., Ikegami, T., O’uchi, S., Takano, R., & Kudoh, T. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852331 · Cited by 20
Exploiting the Redundancy in Convolutional Filters for Parameter Reduction
Kahatapitiya, K., & Rodrigo, R. P. (2021) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv48630.2021.00145 · Cited by 21
Sensitivity Analysis and Compression Opportunities in DNNs Using Weight Sharing
Dupuis, E., Novo, D., O’Connor, I., & Bosio, A. (2020) · IEEE International Symposium on Design and Diagnostics of Electronic Circuits & Systems (DDECS) · doi:10.1109/ddecs50862.2020.9095658 · Cited by 21
Compressing Neural Networks: Towards Determining the Optimal Layer-wise DecompositionPreprint
Liebenwein, L., Maalouf, A., Oren, G., Feldman, D., & Rus, D. L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.11442 · Cited by 20
On-Device Neural Language Model Based Word Prediction
Yu, S., Kulkarni, N. V., Lee, H., & Kim, J. (2018) · International Conference on Computational Linguistics · Cited by 19
Efficient Visual Recognition: A Survey on Recent Advances and Brain-inspired Methodologies
Wu, Y., Wang, D., Lu, X., Yang, F., Yao, M., Dong, W., Shi, J., & Li, G. (2022) · Machine Intelligence Research · doi:10.1007/s11633-022-1340-5 · Cited by 22
Zhang, H., Liu, L., Zhou, H., Si, L., Sun, H., & Zheng, N. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3170620 · Cited by 19
The Possibility of Combining and Implementing Deep Neural Network Compression Methods
Predić, B., Vukić, U., Saracevic, M. H., Karabašević, D., & Stanujkić, D. (2022) · Axioms · doi:10.3390/axioms11050229 · Cited by 19
Single-shot pruning and quantization for hardware-friendly neural network acceleration
Jiang, B., Chen, J., & Liu, Y. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.106816 · Cited by 24
Approximate Computing and Its Application to Hardware Security
Liu, W., Gu, C., Qu, G., & O'Neill, M. P. (2018) · Springer eBooks · doi:10.1007/978-3-319-98935-8_3 · Cited by 19
Exploring the capabilities of mobile devices in supporting deep learning
Chen, Y., Biookaghazadeh, S., & Zhao, M. X. (2019) · ACM/IEEE Symposium on Edge Computing (SEC) · doi:10.1145/3318216.3363316 · Cited by 19
Self-citationSateesan, A., Sinha, S., Smitha, K. G., & Vinod, A. P. (2021) · Neural Processing Letters · doi:10.1007/s11063-021-10458-1 · Cited by 21
Binarized Neural Networks on the ImageNet Classification TaskPreprint
Wu, X., Wu, Y., & Zhao, Y. H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1604.03058 · Cited by 19
Sparse Persistent RNNs: Squeezing Large Recurrent Networks On-ChipPreprint
Zhu, F., Pool, J., Andersch, M., Appleyard, J., & Xie, F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.10223 · Cited by 22
TrojanNet: Embedding Hidden Trojan Horse Models in Neural Networks.Preprint
Guo, C., Wu, R., & Weinberger, K. Q. (2020) · arXiv (Cornell University) · Cited by 19
Self-citationA triple semantic-aware knowledge distillation network for industrial defect detection
Wen, Z., Liu, J., Zhao, H., & Wang, Q. (2025) · Computers in Industry · doi:10.1016/j.compind.2025.104252 · Cited by 20
Filter Pruning Without Damaging Networks Capacity
Zuo, Y., Chen, B., Shi, T., & Sun, M. (2020) · IEEE Access · doi:10.1109/access.2020.2993932 · Cited by 18
Weight-Dependent Gates for Network Pruning
Li, Y., Liu, Z., Wu, W., Yao, H., Zhang, X., Zhang, C., & Yin, B. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2022.3175762 · Cited by 18
Nekooei, A., & Safari, S. (2022) · Neural Networks · doi:10.1016/j.neunet.2022.02.024 · Cited by 19
Improving Knowledge Distillation With a Customized Teacher
Tan, C., & Liu, J. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3189680 · Cited by 18
A Dynamic Pruning Method on Multiple Sparse Structures in Deep Neural Networks
Hu, J., Lin, P., Zhang, H., Lan, Z., Chen, W., Xie, K., Chen, S., Wang, H., & Chang, S. (2023) · IEEE Access · doi:10.1109/access.2023.3267469 · Cited by 19
Self-citationSurvey on Neural Networks in Networking: Applications and Advancements
Ayad, J. (2024) · Babylonian Journal of Networking · doi:10.58496/bjn/2024/014 · Cited by 18
Morse Code Datasets for Machine Learning
Dey, S., Chugg, K. M., & Beerel, P. A. (2018) · International Conference on Computing, Communication and Networking Technologies (ICCCNT) · doi:10.1109/icccnt.2018.8494011 · Cited by 18
Extended Bit-Plane Compression for Convolutional Neural Network Accelerators
Cavigelli, L., & Luca Benini, C. (2019) · IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS) · doi:10.1109/aicas.2019.8771562 · Cited by 18
Model slicing for supporting complex analytics with elastic inference cost and resource constraints
Cai, S., Chen, G., Ooi, B. C., & Gao, J. (2019) · Proceedings of the VLDB Endowment · doi:10.14778/3364324.3364325 · Cited by 19
FPGA based neural network accelerators
Kim, J.-Y. (2020) · Advances in computers · doi:10.1016/bs.adcom.2020.11.002 · Cited by 18
Evolutionary Synthesis of Deep Neural Networks via Synaptic Cluster-driven Genetic EncodingPreprint
Shafiee, M. J., & Wong, A. K. C. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.01360 · Cited by 21
Distilled Binary Neural Network for Monaural Speech Separation
Chen, X., Liu, G., Shi, J., Xu, J., & Xu, B. (2018) · 2018 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489456 · Cited by 23
NoScope: Optimizing Deep CNN-Based Queries over Video Streams at Scale.
Kang, D. D., Emmons, J., Abuzaid, F., Bailis, P. D., & Zaharia, M. (2017) · Very Large Data Bases · Cited by 19
Prune Deep Neural Networks With the Modified $L_{1/2}$ Penalty
Chang, J., & Jin, S. (2018) · IEEE Access · doi:10.1109/access.2018.2886876 · Cited by 15
Filter-based Deep-Compression with Global Average Pooling for Convolutional Networks
Hsiao, T.-Y., Chang, Y.-C., & Chiu, C. (2018) · SiPS ... design and implementation - IEEE Workshop on Signal Processing Systems · doi:10.1109/sips.2018.8598453 · Cited by 17
Deep Sparse Band Selection for Hyperspectral Face Recognition
Taherkhani, F., Dawson, J. M., & Nasrabadi, N. M. (2020) · Advances in computer vision and pattern recognition · doi:10.1007/978-3-030-38617-7_11 · Cited by 17
Using Feature Entropy to Guide Filter Pruning for Efficient Convolutional Networks
Li, Y., Wang, L., Peng, S., Kumar, A., & Yin, B. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-30484-3_22 · Cited by 17
Symmetric $k$-Means for Deep Neural Network Compression and Hardware Acceleration on FPGAs
Jain, A., Goel, P., Aggarwal, S., Fell, A., & Anand, S. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2968810 · Cited by 17
Learning Sparse Neural Networks Using Non-Convex Regularization
Pandit, M. K., Naaz, R., & Chishti, M. A. (2021) · IEEE Transactions on Emerging Topics in Computational Intelligence · doi:10.1109/tetci.2021.3058672 · Cited by 16
A Hardware-Friendly Low-Bit Power-of-Two Quantization Method for CNNs and Its FPGA Implementation
Sui, X., Lv, Q., Bai, Y., Zhu, B., Zhi, L., Yang, Y., & Tan, Z. (2022) · Sensors · doi:10.3390/s22176618 · Cited by 18
Knowledge Distillation for End-to-End Person SearchPreprint
Munjal, B., Galasso, F., & Amin, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.01058 · Cited by 17
DeepCompNet: A Novel Neural Net Model Compression Architecture
Rani, M. M. S., Chitra, P., Lakshmanan, S., Devi, M. K., Sangeetha, R., & Nithya, S. (2022) · Computational Intelligence and Neuroscience · doi:10.1155/2022/2213273 · Cited by 16
RetractedExploiting Sparsity to Accelerate Fully Connected Layers of CNN-Based Applications on Mobile SoCs
Xie, X., Du, D., Li, Q., Liang, Y. E., Tang, W. T., Ong, Z., Lu, M., Huynh, H. P., & Goh, R. S. M. (2017) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3122788 · Cited by 16
AutoHash: Learning Higher-order Feature Interactions for Deep CTR Prediction
Xue, N., Liu, B., Guo, H., Tang, R., Zhou, F., Zafeiriou, S. P., Zhang, Y., Wang, J., & Li, Z. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3016482 · Cited by 16
Lee, S., Kim, H., Jeong, B., & Yoon, J. (2021) · Applied Sciences · doi:10.3390/app11020643 · Cited by 16
Continual 3D Convolutional Neural Networks for Real-time Processing of Videos
Hedegaard, L., & Iosifidis, A. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19772-7_22 · Cited by 18
Collaborative Learning for Extremely Low Bit Asymmetric Hashing
Luo, Y., Huang, Z. H., Li, Y., Shen, F., Yang, Y., & Cui, P. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.2977633 · Cited by 16
Review of prominent strategies for mapping CNNs onto embedded systems
Arredondo-Velázquez, M., Díaz-Carmona, J., Gutiérrez, A. I. B., & Torres-Huitzil, C. (2020) · IEEE Latin America Transactions · doi:10.1109/tla.2020.9082927 · Cited by 16
Iteratively Training Look-Up Tables for Network Quantization
Cardinaux, F., Uhlich, S., Yoshiyama, K., García, J. A., Mauch, L., Tiedemann, S., Kemp, T., & Nakamura, A. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.3005030 · Cited by 15
Benchmarking Quantized Neural Networks on FPGAs with FINNPreprint
Ducasse, Q., Cotret, P., Lagadec, L., & Stewart, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.01341 · Cited by 16
Metadata
- Authors
- Chen, W., Wilson, J. T., Tyree, S., Weinberger, K. Q., & Chen, Y.
- Affiliations
- Washington University in St. Louis (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2015
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1504.04788
- OpenAlex
- W2172166488
- Cited by
- 974
- References
- 53
- Citations by year
- 2026: 2 · 2025: 9 · 2024: 29 · 2023: 59 · 2022: 69 · 2021: 118 · 2020: 167 · 2019: 159 · 2018: 184 · 2017: 114 · 2016: 44 · 2015: 19
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- neural network compression, parameter sharing, model size reduction, memory-efficient deep learning, mobile devices, parameter redundancy, hash functions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review