The DOI matches its DataCite record; 51 of the 53 references it cites were found in a registry or an index.
Compressing Neural Networks with the Hashing Trick
Open accessAbstract
As deep nets are increasingly used in applications suited for mobile devices, a fundamental dilemma becomes apparent: the trend in deep learning is to grow models to absorb ever-increasing data set sizes; however mobile devices are designed with very little memory and cannot store such large models. We present a novel network architecture, HashedNets, that exploits inherent redundancy in neural networks to achieve drastic reductions in model sizes. HashedNets uses a low-cost hash function to randomly group connection weights into hash buckets, and all connections within the same hash bucket share a single parameter value. These parameters are tuned to adjust to the HashedNets weight sharing architecture with standard backprop during training. Our hashing procedure introduces no additional memory overhead, and we demonstrate on several benchmark data sets that HashedNets shrink the storage requirements of neural networks substantially while mostly preserving generalization performance.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In addition, structured update, sketched update can help enhance the communication efficiency when clients uploading updates to the server as well.”
From Convergence of Edge Computing and Deep Learning: A Comprehensive Survey (2020) · cites this paper as [202]
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
(2014) · Cited by 33,419
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Neural networks for pattern recognition
Bishop, C. (1994) · Choice Reviews Online · doi:10.5860/choice.31-5500 · Cited by 18,537
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
(2010) · International Conference on Machine Learning · Cited by 13,995
Term-Weighting Approaches in Automatic Text Retrieval
Salton, G., & Buckley, C. (1988) · Information Processing & Management · doi:10.1016/0306-4573(88)90021-0 · Cited by 11,421
Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260
Cited by
Sorted by citations
Items 801–900 of 973
The Space Complexity of Inner Product Filters
Pagh, R., & Sivertsen, J. (2019) · IT University Of Copenhagen (IT University of Copenhagen) · doi:10.4230/lipics.icdt.2020.22 · Cited by 1
AutoML for DenseNet Compression
Jiao, W., Li, T., Zhong, G., & Wang, L. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-36718-3_13 · Cited by 1
A Graph Network Model for Distributed Learning with Limited Bandwidth Links and Privacy Constraints
Parras, J., & Zazo, S. (2020) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp40776.2020.9053067 · Cited by 1
Gator: Customizable Channel Pruning of Neural Networks with Gating
Passov, E., David, E. O., & Netanyahu, N. S. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86380-7_5 · Cited by 1
Progress of neural network quantization algorithm
Wang, Z., Yao, Y., & Zhou, Y. (2021) · International Conference on Electronic Information Engineering and Computer Science (EIECS) · doi:10.1109/eiecs53707.2021.9588007 · Cited by 1
Class-Discriminative CNN Compression
Liu, Y., Wentzlaff, D., & Kung, S. (2022) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr56361.2022.9956066 · Cited by 3
AutoDistiller: An Automatic Compression Method for Multi-task Language Models
Wang, H., Xiao, G., & Liang, Y. (2022) · Chinese Control Conference (CCC) · doi:10.23919/ccc55666.2022.9901868 · Cited by 1
Towards Understanding the Behaviors of Pretrained Compressed Convolutional Models
Zee, T., Lakshmana, M., & Nwogu, I. (2022) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr56361.2022.9956037 · Cited by 1
Flocking Birds of a Feather Together: Dual-step GAN Distillation via Realer-Fake Samples
Ye, J., Feng, Z., & Wang, X. (2022) · IEEE International Conference on Visual Communications and Image Processing (VCIP) · doi:10.1109/vcip56404.2022.10008799 · Cited by 1
Removing Zero Variance Units of Deep Models for COVID-19 Detection
García-Ramírez, J., Ramírez, B. E., & Olveres, J. (2023) · IEEE Access · doi:10.1109/access.2023.3255834 · Cited by 2
Hybrid Binary Neural Networks: A Tutorial Review
Çetin, A. E., & Pan, H. (2023) · IEEE VLSI Test Symposium (VTS) · doi:10.1109/vts56346.2023.10139963 · Cited by 1
Personalized Semantic Matching for Web Search
Jing, K.-L., Hao, F., Zhang, X.-Z., & Zhou, Y. (2023) · 2023 IEEE 39th International Conference on Data Engineering Workshops (ICDEW) · doi:10.1109/icdew58674.2023.00037
Towards Fairer and More Efficient Federated Learning via Multidimensional Personalized Edge Models
Wang, Y., Guo, J., Zhang, J., Guo, S., Zhang, W., & Zheng, Q. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191956 · Cited by 1
Segmentation Based on 1-Shot Learning
Kumar, A., Mehra, R., Kumar, P., Hemelatha, S., Vijay, S. A. A., & Rege, P. R. (2023) · International Conference on Contemporary Computing and Informatics (IC3I) · doi:10.1109/ic3i59117.2023.10397849 · Cited by 1
Efficient ConvNet Optimization through Width Modification Guided with Gaussian Processes
Siddiqui, B., Alaeddini, A., & Zhu, D. K. (2023) · IEEE International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/icpads60453.2023.00235 · Cited by 1
A low functional redundancy-based network slimming method for accelerating deep neural networks
Fang, Z. N., & Yin, B. (2025) · Alexandria Engineering Journal · doi:10.1016/j.aej.2024.12.118 · Cited by 1
Bit-Regularized Optimization of Neural Nets
Amer, M., Raghavan, A., Taylor, G. W., & Chai, S. M. (2018) · Cited by 2
Fast FFT-Based Inference in 3D Convolutional Neural Networks
Xie, B., Zhang, G., Shen, Y., Liu, S., & Ge, Y. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-93554-6_40 · Cited by 1
Sparse Deep Neural Networks for Embedded Intelligence
Bi, J., & Gunn, S. R. (2018) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai.2018.00016 · Cited by 1
Efficient ConvNet for Surface Object Recognition
Lin, W., Chen, Q., Qi, X., Wu, B., Ke, X., Yang, D., Wang, Y., & Ma, J. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-27532-7_28 · Cited by 1
Visual Question Answering with Dynamic Parameter Prediction using Functional Hashing
Li, C., & Zhou, Z. (2019) · International Conference on Robotics, Intelligent Control and Artificial Intelligence (RICAI) · doi:10.1145/3366194.3366252 · Cited by 1
Bawa, V. S., & Kumar, V. (2019) · Future Generation Computer Systems · doi:10.1016/j.future.2019.11.020 · Cited by 1
Deep Residual Networks with Pyramid Depthwise Separable Convolution
Hoang, V.-T., Shahbaz, A., & Jo, K.-H. (2019) · Annual Conference of the IEEE Industrial Electronics Society (IECON) · doi:10.1109/iecon.2019.8927491 · Cited by 1
Emerging Hardware Technologies for IoT Data Processing
Bojnordi, M. N., & Behnam, P. (2020) · Springer eBooks · doi:10.1007/978-3-030-30367-9_9 · Cited by 1
Transfer Learning by Weighting Convolution
Ayache, S., Sicre, R., & Artières, T. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9206896 · Cited by 1
Compact Mixed-Signal Convolutional Neural Network Using a Single Modular Neuron
Chang, D.-J., Nam, B., & Ryu, S. (2020) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2020.3007447 · Cited by 1
Compress Polyphone Pronunciation Prediction Model with Shared Labels
Chen, P., Wang, L., Di, H., Ouchi, K., & Wang, L. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-63031-7_29 · Cited by 1
Embedded Object Detection System Based on Deep Neural Network
Luo, H., Li, W., Wang, L., Li, F., Chen, J., & Yuan, X. (2020) · International Congress on Image and Signal Processing (CISP) · doi:10.1109/cisp-bmei51763.2020.9263648 · Cited by 1
Channel Pruning for Accelerating Convolutional Neural Networks via Wasserstein Metric
Duan, H., & Li, H. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-69535-4_30 · Cited by 1
Lightweight Network for Vietnamese Landmark Recognition based on Knowledge Distillation
Tran, V. T., Le, N. H., Nguyen, P. T., & Doan, T. N. (2020) · NAFOSTED Conference on Information and Computer Science (NICS) · doi:10.1109/nics51282.2020.9335881 · Cited by 1
Xu, H. (2020) · International Conference on Information Technologies and Electrical Engineering (ICITEE) · doi:10.1145/3452940.3452950 · Cited by 1
Compressing Deep CNNs Using Basis Representation and Spectral Fine-Tuning
Tayyab, M. A., Khan, F. A., & Mahalanobis, A. (2021) · Proceedings - International Conference on Image Processing · doi:10.1109/icip42928.2021.9506128 · Cited by 1
ES-ENAS: Controller-Based Architecture Search for Evolutionary Reinforcement Learning
Song, X., Choromański, K., Parker-Holder, J., Tang, Y., Peng, D., Jain, D., Gao, W., Pacchiano, A., Sarlós, T., & Yang, Y. (2021) · Cited by 2
Xie, H., Qian, L., Xiang, X., & Liu, N. (2021) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme51207.2021.9428149 · Cited by 1
Learning a Neural Diff for Speech Models
Macoskey, J. J., Strimel, G. P., & Rastrow, A. (2021) · Interspeech (USB) · doi:10.21437/interspeech.2021-1575 · Cited by 1
Kim, H., & Choi, D.-W. (2021) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3448016.3457326 · Cited by 1
Model compression for on-device inference
Shi, Y., Yang, K., Yang, Z., & Zhou, Y. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-823817-2.00015-2 · Cited by 2
Research on Network Layer Recursive Reduction Model Compression for Image Recognition
Ling, H., Zhang, W., Tao, Y., & Zhou, M. (2021) · Scientific Programming · doi:10.1155/2021/4054435 · Cited by 1
RetractedDP-Nets: Dynamic programming assisted quantization schemes for DNN compression and acceleration
Yang, D., Yu, W., Ding, X., Zhou, A., & Wang, X. (2021) · Integration · doi:10.1016/j.vlsi.2021.10.002 · Cited by 1
Jiao, Y., Li, S., Luo, P., Huo, X., & Li, Y. K. (2021) · IEEE Global Conference on Artificial Intelligence and Internet of Things (GCAIoT) · doi:10.1109/gcaiot53516.2021.9693045 · Cited by 1
DNN Training Optimization with Pipelined Parallel Based on Feature Maps Encoding
Shen, L., Mao, Y., Wang, Z., Nie, H., & Huang, J. (2022) · International Conference on Advanced Cloud and Big Data · doi:10.1109/cbd58033.2022.00016 · Cited by 1
Learning and enforcing diversity with Determinantal Point Processes
Mariet, Z. (2016) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 1
Compressing Deep Neural Networks: A New Hashing Pipeline Using Kac's Random Walk MatricesPreprint
Parker-Holder, J., & Gass, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.02764 · Cited by 1
FeTa: A DCA Pruning Algorithm with Generalization Error GuaranteesPreprint
Pitas, K., Davies, M. E., & Vandergheynst, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.04239 · Cited by 1
PBGen: Partial Binarization of Deconvolution-Based Generators for Edge IntelligencePreprint
Liu, J., Zhang, J., Ding, Y., Xu, X., Jiang, M., & Shi, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.09153 · Cited by 1
Efficient and Robust Machine Learning for Real-World SystemsPreprint
Pernkopf, F., Roth, W., Zoehrer, M., Pfeifenberger, L., Schindler, G., Froening, H., Tschiatschek, S., Peharz, R., Mattina, M., & Ghahramani, Z. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.02240 · Cited by 3
Hybrid Cosine Based Convolutional Neural NetworksPreprint
Ciurana, A., Mosella-Montoro, A., & Ruiz‐Hidalgo, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.01987 · Cited by 1
Deep Learning Acceleration Techniques for Real Time Mobile Vision ApplicationsPreprint
Teyou, G. K. D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.03418 · Cited by 1
Revisiting hard thresholding for DNN pruningPreprint
Pitas, K., Davies, M. E., & Vandergheynst, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.08793 · Cited by 1
Reinforcement Learning with Chromatic NetworksPreprint
Song, X., Choromański, K., Parker-Holder, J., Tang, Y., Gao, W., Pacchiano, A., Sarlós, T., Jain, D., & Yang, Y. (2019) · arXiv (Cornell University) · Cited by 1
Learning SMaLL PredictorsPreprint
Garg, V., Dekel, O., & Xiao, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.02388 · Cited by 1
NeuroFabric: Identifying Ideal Topologies for Training A Priori Sparse NetworksPreprint
Isakov, M., & Kinsy, M. A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.08339 · Cited by 1
DP-Net: Dynamic Programming Guided Deep Neural Network CompressionPreprint
Yang, D., Yu, W., Zhou, A., Mu, H., Yao, G., & Wang, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.09615 · Cited by 1
Blind Adversarial Pruning: Balance Accuracy, Efficiency and RobustnessPreprint
Xie, H., Qian, L., Xiang, X., & Liu, N. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.05913 · Cited by 2
Convolutional neural networks compression with low rank and sparse tensor decompositionsPreprint
Kaloshin, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.06443 · Cited by 1
FedOCR: Communication-Efficient Federated Learning for Scene Text RecognitionPreprint
Zhang, W., Qiu, Y., Bai, S., Zhang, R., Wei, X. K., & Bai, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.11462 · Cited by 1
Disentangling Neural Architectures and Weights: A Case Study in Supervised ClassificationPreprint
Colombo, N., & Gao, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.05346 · Cited by 1
Improving Network Slimming with Nonconvex RegularizationPreprint
Bui, K., Park, F., Zhang, S., Qi, Y., & Xin, J. X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.01242 · Cited by 1
Differentiable Architecture Pruning for Transfer LearningPreprint
Colombo, N., & Gao, Y. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.03375 · Cited by 2
Adaptive Effort Classifiers: A System Design For Partitioned Edge/Cloud Inference
Sankar, D. (2020) · CUNY Academic Works (City University of New York) · Cited by 1
A Survey on GAN Acceleration Using Memory Compression TechniquePreprint
Tantawy, D., Zahran, M., & Wassal, A. G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.06626 · Cited by 1
Building Compact and Robust Deep Neural Networks with Toeplitz MatricesPreprint
Araujo, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.00959 · Cited by 1
Improved COVID-19 detection using data augmentation Deep Convolution GAN and classifier DenseNet.Preprint
Ghosh, D. (2021) · doi:10.21203/rs.3.rs-235624/v1 · Cited by 2
Evolving Transferable Pruning FunctionsPreprint
Liu, Y., Kung, S., & Wentzlaff, D. (2021) · arXiv (Cornell University) · Cited by 1
AI at the Edge: Challenges, Applications, and Directions
Joshi, D., Desai, N. V., Chowdhury, S. P., Lee, W., Bathen, L. A. D., Wang, S., & Verma, D. C. (2022) · Wiley eBooks · doi:10.1002/9781119892199.ch9 · Cited by 1
Membership Encoding for Deep Learning
Song, C., & Shokri, R. (2020) · ACM Asia Conference on Computer and Communications Security (ASIA CCS) · doi:10.1145/3320269.3384731 · Cited by 4
StochasticNet in StochasticNet
Shafiee, M. J., Fieguth, P., & Wong, A. (2016) · Journal of Computational Vision and Imaging Systems · doi:10.15353/vsnl.v2i1.106
Streaming Binary Sketching based on Subspace Tracking and Diagonal UniformizationPreprint
Morvan, A., Souloumiac, A., Gouy‐Pailler, C., & Jamal Atif, C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.07661
An Embedded Deep Learning based Word PredictionPreprint
Yu, S., Kulkarni, N. V., Lee, H., & Kim, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.01662
HFH: Homologically Functional Hashing for Compressing Deep Neural Networks
Shi, L., Feng, S., & Zhu, Z. (2017)
Dynamic and Adaptive Threshold for DNN Compression from Scratch
Jiang, C., Li, G., & Qian, C. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-68759-9_70
Hashing for Multimedia Similarity Modeling and Large-Scale Retrieval
Li, K. (2017) · Journal of International Crisis and Risk Communication Research
An Efficient Binary Search Based Neuron Pruning Method for ConvNet Condensation
Zhang, B., Qin, A. K., & Chan, J. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-70096-0_20
User-centric Composable Services: A New Generation of Personal Data AnalyticsPreprint
Zhao, J., Mortier, R., Crowcroft, J., & Wang, L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.09027
Efficient Learning Algorithm Using Compact Data Representation in Neural Networks
Kibune, M., & Lee, M. G. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-70096-0_33
Homomorphic Parameter Compression for Distributed Deep Learning TrainingPreprint
Jang, J., Na, B., & Yoon, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.10123 · Cited by 1
Rate-Accuracy Optimization of Deep Convolutional Neural Network Models
Filini, A., Ascenso, J., & Leonardi, R. (2017) · IEEE International Symposium on Multimedia (ISM) · doi:10.1109/ism.2017.121
A novel HashedNets model based on the efficient hyperparameter optimization
Qin, F., Chen, J., Ma, Z., Li, C., Zhang, J., Chen, Y., & Lv, Q. (2017) · International Conference on Systems and Informatics (ICSAI) · doi:10.1109/icsai.2017.8248458
Self-citationAcoustic Model Compression with Knowledge Transfer
Yi, J., Tao, J., Wen, Z., Li, Y., & Ni, H. (2018) · Communications in computer and information science · doi:10.1007/978-981-10-8111-8_9
Improving Efficiency in Deep Learning for Large Scale Visual Recognition
Liu, B. (2016) · Journal of International Crisis and Risk Communication Research
Deep Neural Network Compression via Knowledge Distillation for Embedded Vision Applications
Jaiswal, B., & Gajjar, N. (2019) · Springer eBooks · doi:10.1007/978-981-13-6347-4_13
Obstacle Detection System in Dashcams using Convolutional Neural Networks
Sathvik, K., Bhat, K. A., Mahanth, M. V., & Nagavarshini (2018) · doi:10.21467/proceedings.1.53
Optimization on parametric model
Huang, F., & Yao, W. (2018) · IEEE/IFIP Network Operations and Management Symposium (NOMS) · doi:10.1109/noms.2018.8406287
An Overview of Datatype Quantization Techniques for Convolutional Neural NetworksPreprint
Athar, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.07530 · Cited by 3
Matsuno, T., Hayashi, K., Ishihara, T., Manabe, H., & Matsumoto, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.08307
Optimal Low Rank Tensor Factorization for Deep Learning
Purohit, A., Abhishek, Rakesh, & Verma, S. (2018) · Communications in computer and information science · doi:10.1007/978-981-13-2372-0_42
Fundamentals and Literature Review
Huang, H., & Yu, H. (2018) · Computer architecture and design methodologies · doi:10.1007/978-981-13-3323-1_2
Tensor-Solver for Deep Neural Network
Huang, H., & Yu, H. (2018) · Computer architecture and design methodologies · doi:10.1007/978-981-13-3323-1_4
Exploiting Processing in Non-Volatile Memory for Binary Neural Network Accelerators.Preprint
Resch, S., Khatamifard, S. K., Chowdhury, Z. I., Zabihi, M., Zhao, Z., Wang, J., Sapatnekar, S. S., & Karpuzcu, U. R. (2018) · arXiv (Cornell University)
Fast Learning for Accurate Object Recognition Using a Pre-trained Deep Neural Network
Ríos, V. L., Tenorio-González, A. C., & Morales, E. F. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-02837-4_4
Ahn, B., & Kim, T. (2018) · IEEE International System-on-Chip Conference (SOCC) · doi:10.1109/socc.2018.8618552
Exploring Resource-Aware Deep Neural Network Accelerator and Architecture Design
Li, B., Liu, L., Liang, J., Sun, H., Geng, L., & Zheng, N. (2018) · IEEE International Conference on Digital Signal Processing (DSP) · doi:10.1109/icdsp.2018.8631853
Learning the Group Structure of Deep Neural Networks with an Expectation Maximization Method
Yi, S., & Choi, J. (2018) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw.2018.00106
Predictable GPGPU Computing in DNN-Driven Autonomous Systems
Zhou, H. (2018)
Succinct Source Coding of Deep Neural Networks
Basu, S., & Varshney, L. R. (2018)
Stochastic Computing for Hardware Implementation of Binarized Neural NetworksPreprint
Hirtzlin, T., Penkovsky, B., Bocquet, M., Klein, J., Portal, J., & Querlioz, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.00915
Training compact deep learning models for video classification using circulant matricesPreprint
Araujo, A., Négrevergne, B., Chevaleyre, Y., & Jamal Atif, C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.01140
Compression Methods of Deep Learning Models Based on Student-Teacher Method
Stetsenko, I. V. (2019) · Control Systems and Computers · doi:10.15407/usim.2019.02.025
Metadata
- Authors
- Chen, W., Wilson, J. T., Tyree, S., Weinberger, K. Q., & Chen, Y.
- Affiliations
- Washington University in St. Louis (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2015
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1504.04788
- OpenAlex
- W2172166488
- Cited by
- 974
- References
- 53
- Citations by year
- 2026: 2 · 2025: 9 · 2024: 29 · 2023: 59 · 2022: 69 · 2021: 118 · 2020: 167 · 2019: 159 · 2018: 184 · 2017: 114 · 2016: 44 · 2015: 19
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- neural network compression, parameter sharing, model size reduction, memory-efficient deep learning, mobile devices, parameter redundancy, hash functions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review