Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding
Open accessAbstract
Neural networks are both computationally intensive and memory intensive, making them difficult to deploy on embedded systems with limited hardware resources. To address this limitation, we introduce "deep compression", a three stage pipeline: pruning, trained quantization and Huffman coding, that work together to reduce the storage requirement of neural networks by 35x to 49x without affecting their accuracy. Our method first prunes the network by learning only the important connections. Next, we quantize the weights to enforce weight sharing, finally, we apply Huffman coding. After the first two steps we retrain the network to fine tune the remaining connections and the quantized centroids. Pruning, reduces the number of connections by 9x to 13x; Quantization then reduces the number of bits that represent each connection from 32 to 5. On the ImageNet dataset, our method reduced the storage required by AlexNet by 35x, from 240MB to 6.9MB, without loss of accuracy. Our method reduced the size of VGG-16 by 49x from 552MB to 11.3MB, again with no loss of accuracy. This allows fitting the model into on-chip SRAM cache rather than off-chip DRAM memory. Our compression method also facilitates the use of complex neural networks in mobile applications where application size and download bandwidth are constrained. Benchmarked on CPU, GPU and mobile GPU, compressed network has 3x to 4x layerwise speedup and 3x to 7x better energy efficiency.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Low-rank factorization offers an alternative compression strategy that may be more resilient than pruning, especially under high compression regimes.
“This offers an alternative compression strategy that may be more resilient than pruning, especially under high compression regimes [20].”
From LittleBit: Ultra Low-Bit Quantization via Latent Factorization (2025) · cites this paper as [20]
Section 6.1 (p. 7) describes SVD as having a poor compression rate, rather than being more resilient at high compression. The comparison in Section 6.4 (pp. 10–11) reports greater accuracy loss for SVD at 5× compression than for pruning at 9× compression. (LLM, conf=0.89)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredLevel 2 ZSQ+QAT usually gives higher accuracy because finetuning helps recover degradation, especially at ultra-low bit precision.
“However, Level 2 usually results in higher accuracy, as finetuning helps the quantized model to recover the accuracy degradation, particularly in ultra-low bit precision settings [85].”
From A Survey of Quantization Methods for Efficient Neural Network Inference (2022) · cites this paper as [85]
Section 3 (p. 3) describes fine-tuning shared weights after quantization and reports no accuracy loss for pruned AlexNet at 8-bit convolutional and 5-bit fully connected precision. But the paper does not compare this method with ZSQ without fine-tuning or establish that fine-tuning usually yields higher accuracy, particularly at ultra-low precision; Table 6 (p. 10) reports accuracy loss at 4/2 bits. (LLM, conf=0.85)
Experimental — accuracy not yet measuredRecent network pruning methods usually take an iterative training and pruning process, removing only a small group of unimportant weights after each stage of training and repeating those operations.
“The recent network pruning methods usually take an iterative training and pruning process, i.e., to remove only a small group of unimportant weights after each stage of training, and to repeat those operations [130].”
From Object Detection in 20 Years: A Survey (2023) · cites this paper as [130]
Section 2, “Network Pruning” (p. 2), describes training a network, removing connections with weights below a threshold, and retraining it. It does not say that pruning and training are repeated in multiple stages, that only a small group is removed at each stage, or that recent methods usually follow that pattern. (LLM, conf=0.86)
Experimental — accuracy not yet measuredQuantization reduces the computational and memory footprint of DNNs without significantly compromising model accuracy.
“This process enables efficient inference on resource-constrained hardware, such as edge devices and embedded systems, without significantly compromising model accuracy [36-38].”
From Fine-Grained Fault Sensitivity Analysis of Vision Transformers Under Soft Errors (2025) · cites this paper as [36]
The Trained Quantization and Weight Sharing section (p. 3) reports reduced bits per weight without accuracy loss, and the Abstract (p. 1) reports faster, more energy-efficient inference for the compressed network. Those inference gains are reported for a pipeline combining pruning, quantization, and Huffman coding, not for quantization alone. (LLM, conf=0.82)
Experimental — accuracy not yet measuredQuantization approaches can address scalability and computational demands by shifting toward quantized versions of existing models using curated, domain-specific data rather than pretraining from scratch.
“In addition, quantization approaches can address the scalability and computational demands by shifting toward quantized versions of existing models using curated, domain-specific data rather than pretraining from scratch [159].”
From Multimodal Large Language Models in Health Care: Applications, Challenges, and Future Outlook. (2024) · cites this paper as [159]
The Abstract (p. 1) and Introduction (p. 2) describe compressing existing networks to reduce storage and energy demands, and Section 3 (p. 3) describes quantizing and fine-tuning their weights. The paper does not describe using curated, domain-specific data or propose that strategy as an alternative to pretraining from scratch. (LLM, conf=0.88)
Experimental — accuracy not yet measured
Threshold pruning methods ranging from LMP [14] to dynamic weight selection via spatial correlation [21], and the recent random initialization-based pruning method [25], have achieved good results.
“Threshold pruning methods ranging from LMP [14] to dynamic weight selection via spatial correlation [21], and the recent random initializationbased pruning method [25] (performed to further sparsity the network) have achieved good results.”
From A survey of model compression strategies for object detection (2023) · cites this paper as [14]
Section 2 (p. 2) describes successful threshold-based pruning: it removes small-weight connections and reports substantial parameter reductions without loss of accuracy. But the paper starts pruning after normal network training; its discussion of random initialization concerns quantization centroids, not a random-initialization-based pruning method (Section 3.2, p. 4). (LLM, conf=0.87)
Experimental — accuracy not yet measuredThe methods for reducing transformers' size, latency and energy consumption include pruning, quantization, knowledge distillation and neural architecture search.
“The methods include pruning [40, 41], Quantization [42-44], Knowledge Distillation [45] and Neural Architecture Search [46].”
From A Survey of Techniques for Optimizing Transformer Inference (2023) · cites this paper as [41]
The Abstract (p. 1) identifies pruning and trained quantization as compression methods and reports reduced storage, layerwise speedup, and improved energy efficiency. The experiments concern AlexNet, VGG-16, and other neural networks, not transformers, so the transformer-specific application is not established by this source. The sentence assigns separate citations to knowledge distillation and neural architecture search; those methods are not attributed to this source here. (LLM, conf=0.85)
Experimental — accuracy not yet measuredResearchers have proposed techniques for reducing transformers' size, latency and energy consumption for efficient inference for a wide range of applications.
“These challenges have motivated researchers to propose techniques for reducing transformers' size, latency and energy consumption for efficient inference for a wide range of applications.”
From A Survey of Techniques for Optimizing Transformer Inference (2023) · cites this paper as [41]
The Abstract (p. 1) reports reduced model storage, faster inference and better energy efficiency, and the Introduction (p. 2) describes deployment in mobile applications. But the paper studies neural networks such as AlexNet and VGG-16, not transformers, so it does not establish those benefits for transformers across a wide range of applications. (LLM, conf=0.88)
Experimental — accuracy not yet measuredThe authors' approach enables greater compression of the teacher model compared to previous methods that relied on pruning, knowledge distillation, or both.
“Our approach provides a clear advantage by enabling a greater compression of the teacher model compared to the previous methods that relied on pruning [10-15], knowledge distillation (KD) [1,3,5,7,8], and the combination of both [16-20].”
From Efficient and Controllable Model Compression through Sequential Knowledge Distillation and Pruning (2023) · cites this paper as [10]
Weight pruning and quantization is a model compression technique that has received attention as one of the most efficient options to reduce intensive computation and memory usage without compromising accuracy.
“Weight pruning and quantization [20] is a model compression technique that has received attention as one of the most efficient options to reduce the intensive computation and memory usage without compromising accuracy.”
From Optimized Convolutional Neural Network at the IoT edge for image detection using pruning and quantization (2024) · cites this paper as [20]
Synthetic data that ignores internal statistics may not represent the real data distribution well.
“Synthetic data which does not take the internal statistics into account may not properly represent the real data distribution [85].”
From A Survey of Quantization Methods for Efficient Neural Network Inference (2022) · cites this paper as [85]
Section 3.2 (p. 4) discusses how centroid initialization represents the distribution of network weights, not how synthetic data represents real data. Searches for synthetic data, internal statistics, and generated samples found no passage addressing the claim. (LLM, conf=0.76)
Experimental — accuracy not yet measuredRecent work has explored differential privacy as a defense against data poisoning, including in federated learning.
“Recent work has explored differential privacy as a defense against data poisoning [326], and in particular in the federated learning context [199].”
From Advances and Open Problems in Federated Learning (2021) · cites this paper as [199]
The cited paper’s Experiments section (p. 5) concerns pruning, quantization, and Huffman coding; its Related Work section (p. 11) likewise discusses neural-network compression. Searches for differential privacy, data poisoning, and federated learning found no passage addressing their use as a defense. The federated-learning clause is separately cited to [199]. (LLM, conf=0.78)
Experimental — accuracy not yet measuredThe proposed method (zero-centered + iterative retraining) achieves an accuracy drop of 0.1% on VGG-7/CIFAR-10, which is less than Enderich et al. [25] (-0.15%, 2/32) and SYMOG [38] (-0.19%, 2/32), despite using two more weight bits but 1/8 activation bits.
“Compared to Enderich et al. [25] and SYMOG [38], where only the weights are quantized with a xed-point format, although the proposed method used two more bits for the weight parameters, the bits used for activation parameters are signi cantly reduced to 1/8, and the accuracy degradation is also less than both of them.”
From Zero-Centered Fixed-Point Quantization With Iterative Retraining for Deep Convolutional Neural Network-Based Object Detectors (2021) · cites this paper as [38]
Split into 2 atoms — 0 confirmed, 0 partially supported, 0 disputed, 0 misattributed, 2 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measuredWith network slicing, customized and optimized resources can be provided for Edge DL services, helping reduce latency caused by access networks and support dense access to these services.
“With network slicing, customized and optimized resources can be provided for Edge DL services, which can help reduce latency caused by access networks and support dense access to these services [77].”
From Convergence of Edge Computing and Deep Learning: A Comprehensive Survey (2020) · cites this paper as [77]
The Introduction (p. 2) discusses compressing neural networks for mobile devices, and Future Work (p. 12) discusses customized hardware for those compressed models. Neither addresses network slicing, access-network latency, or dense access to Edge DL services; searches for those terms and close paraphrases found no relevant passage. (LLM, conf=0.78)
Experimental — accuracy not yet measuredFedCS allows the centralized server to aggregate as many client updates as possible and to accelerate performance improvement in ML models.
“In particular, an update aggregation protocol named FedCS is developed to allow the centralized server to aggregate as many client updates as possible and to accelerate performance improvement in ML models.”
From Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing (2019) · cites this paper as [52]
The Introduction (p. 2) describes pruning, quantization, and Huffman coding, while §6.3 (pp. 9–10) discusses inference speedups from compression. Searches for FedCS, client-update aggregation, and federated client selection found no passage addressing the claimed protocol or its effect on model improvement. (LLM, conf=0.76)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 74,248 · see citing works
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · see citing works
Fast R-CNNPreprint
Girshick, R. B. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.08083 · Cited by 29,416 · see citing works
Caffe: Convolutional Architecture for Fast Feature EmbeddingPreprint
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1408.5093 · Cited by 4,748 · see citing works
(1989) · Cited by 3,214 · see citing works
Going Deeper with Convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2014) · arXiv · doi:10.48550/arxiv.1409.4842 · Cited by 1,461 · see citing works
Exploiting Linear Structure Within Convolutional Networks for Efficient Evaluation
Denton, R., Zaremba, W., Bruna, J., LeCun, Y., & Fergus, R. (2014) · arXiv · doi:10.48550/arxiv.1404.0736 · Cited by 1,414 · see citing works
EIE: Efficient Inference Engine on Compressed Deep Neural Network
Han, S., Liu, X., Mao, H., Pu, J., Pedram, A., Horowitz, M. A., & Dally, W. J. (2016) · 2016 ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca.2016.30 · Cited by 1,077 · see citing works
Self-citationCompressing Deep Convolutional Networks using Vector QuantizationPreprint
Gong, Y., Liu, L., Yang, M., & Bourdev, L. D. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.6115 · Cited by 1,047 · see citing works
Compressing Neural Networks with the Hashing Trick
Chen, W., Wilson, J. T., Tyree, S., Weinberger, K. Q., & Chen, Y. (2015) · arXiv · doi:10.48550/arxiv.1504.04788 · Cited by 974 · see citing works
Predicting Parameters in Deep Learning
Denil, M., Shakibi, B., Dinh, L., Ranzato, M., & de Freitas, N. (2013) · arXiv · doi:10.48550/arxiv.1306.0543 · Cited by 853 · see citing works
Improving the speed of neural networks on CPUs
Vanhoucke, V., Senior, A., & Mao, M. (2011) · Cited by 662 · see citing works
Comparing Biases for Minimal Network Construction with Back-Propagation
Hanson, S. J., & Pratt, L. (1988) · neural information processing systems · Cited by 468 · see citing works
Fixed-point feedforward deep neural network design using weights +1, 0, and −1
Hwang, K., & Sung, W. (2014) · SiPS ... design and implementation - IEEE Workshop on Signal Processing Systems · doi:10.1109/sips.2014.6986082 · Cited by 258 · see citing works
Provable Bounds for Learning Some Deep RepresentationsPreprint
Arora, S., Bhaskara, A., Ge, R., & Ma, T. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1310.6343 · Cited by 251 · see citing works
Fixed point optimization of deep convolutional neural networks for object recognition
Anwar, S., Hwang, K., & Sung, W. (2015) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2015.7178146 · Cited by 246 · see citing works
Memory Bounded Deep Convolutional NetworksPreprint
Collins, M. D., & Kohli, P. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.1442 · Cited by 137 · see citing works
Cross-Domain Synthesis of Medical Images Using Efficient Location-Sensitive Deep Network
Nguyen, H. V., Zhou, K., & Vemulapalli, R. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24553-9_83 · Cited by 130 · see citing works
On the Construction of Huffman Trees.
Leeuwen, J. V. (1976) · International Colloquium on Automata, Languages and Programming · Cited by 116 · see citing works
Deep Fried ConvnetsPreprint
Yang, Z., Moczulski, M., Denil, M., de Freitas, N., Smola, A. J., Song, L., & Wang, Z. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.7149 · Cited by 13 · see citing works
Flagged first, then by citations
Research works printed but not linked: 5
- Han, Song, Pool, Jeff, Tran, John, and Dally, William J. Learning both weights and connections for efficient neural networks. In Advances in Neural Information Processing Systems , 2015.
- Hassibi, Babak, Stork, David G, et al. Second order derivatives for network pruning: Optimal brain surgeon. Advances in neural information processing systems , pp. 164-164, 1993.
- Krizhevsky, Alex, Sutskever, Ilya, and Hinton, Geoffrey E. Imagenet classification with deep convolutional neural networks. In NIPS , pp. 1097-1105, 2012.
- Lin, Min, Chen, Qiang, and Yan, Shuicheng. Network in network. arXiv:1312.4400 , 2013. · arXiv
- Str¨ om, Nikko. Phoneme probability estimation with dynamic sparsely connected artificial neural networks. The Free Speech Journal , 1(5):1-41, 1997.
Cited by
Sorted by citations
Review of deep learning: concepts, CNN architectures, challenges, applications, future directions
Alzubaidi, L., Zhang, J., Humaidi, A. J., Al-Dujaili, A., Duan, Y., Al-Shamma, O., Santamaría, J., Fadhel, M. A., Al-Amidie, M., & Farhan, L. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00444-8 · Cited by 7,906 · see citing works
Advances and Open Problems in Federated Learning
Kairouz, P., & McMahan, H. B. (2021) · Foundations and Trends in Machine Learning · doi:10.1561/2200000083 · Cited by 7,772 · see citing works
A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects
Li, Z., Liu, F., Yang, W., Peng, S., & Zhou, J. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3084827 · Cited by 5,273 · see citing works
“[166] proposed deep pruning for CNN to prune networks by learning essential connections.”
BackgroundPyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions
Wang, W., Xie, E., Li, X., Fan, D.-P., Song, K., Liang, D., Lu, T., Luo, P., & Shao, L. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00061 · Cited by 5,259 · see citing works
“, ResNet, ResNeXt), there are still some specific modules and operations designed for CNNs and not considered in this work, such as SE [22], SK [35], dilated convolution [73], model pruning [19], and NAS [60].”
MethodGhostNet: More Features From Cheap Operations
Han, K., Wang, Y., Tian, Q., Guo, J., Xu, C., & Xu, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00165 · Cited by 5,222 · see citing works
Efficient Processing of Deep Neural Networks: A Tutorial and Survey
Sze, V., Chen, Y.-H., Yang, T.-J., & Emer, J. S. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2761740 · Cited by 4,215 · see citing works
Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference
Jacob, B., Kligys, S., Chen, B., Zhu, M., Tang, M., Howard, A., Adam, H., & Kalenichenko, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00286 · Cited by 4,114 · see citing works
Billion-scale similarity search with GPUs
Johnson, J., Douze, M., & Jegou, H. (2021) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2019.2921572 · Cited by 4,228 · see citing works
MnasNet: Platform-Aware Neural Architecture Search for Mobile
Tan, M., Chen, B., Pang, R., Vasudevan, V., Sandler, M., Howard, A., & Le, Q. V. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00293 · Cited by 3,416 · see citing works
Object Detection in 20 Years: A Survey
Zou, Z., Chen, K., Shi, Z., Guo, Y., & Ye, J. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2023.3238524 · Cited by 3,689 · see citing works
“, to remove only a small group of unimportant weights after each stage of training, and to repeat those operations [130].”
Deep Learning for Generic Object Detection: A Survey
Liu, L., Ouyang, W., Wang, X., Fieguth, P., Chen, J., Liu, X., & Pietikäinen, M. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01247-4 · Cited by 2,965 · see citing works
Federated Learning in Mobile Edge Networks: A Comprehensive Survey
Lim, W. Y. B., Luong, N. C., Hoang, D. T., Jiao, Y., Liang, Y.-C., Yang, Q., Niyato, D., & Miao, C. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2986024 · Cited by 2,565 · see citing works
Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing
Zhou, Z., Chen, X., Li, E., Zeng, L., Luo, K., & Zhang, J. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2918951 · Cited by 2,455 · see citing works
“The follow-up work deep compression [71], which blends the advantages of pruning, weight sharing, and Huffman coding to compress DNNs, further pushes the compression ratio to 35–49×.”
BackgroundMethodDeep Learning With Edge Computing: A Review
Chen, J., & Ran, X. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2921977 · Cited by 1,540 · see citing works
Federated Learning for Healthcare Informatics
Xu, J., Glicksberg, B. S., Su, C., Walker, P., Bian, J., & Wang, F. (2021) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-020-00082-4 · Cited by 1,542 · see citing works
“, sparse, low-rank [58], or more specifically, pruning the least useful connections in a network [37, 113], weight quantization [17, 89], and model distillation [43].”
BackgroundConvergence of Edge Computing and Deep Learning: A Comprehensive Survey
Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498 · see citing works
“all commonly used DL structures [146], [151], [152]; 4) specializes DL models to contexts and shares resources across multiple simultaneously executing DL mod-”
MethodFeng, D., Haase-Schutz, C., Rosenbaum, L., Hertlein, H., Glaser, C., Timm, F., Wiesbeck, W., & Dietmayer, K. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.2972974 · Cited by 1,425 · see citing works
AMC: AutoML for Model Compression and Acceleration on Mobile Devices
He, Y., Lin, J., Liu, Z., Wang, H., Li, L.-J., & Han, S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_48 · Cited by 1,400 · see citing works
Self-citationBranchyNet: Fast inference via early exiting from deep neural networks
Teerapittayanon, S., McDanel, B., & Kung, H. T. (2016) · 2016 23rd International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr.2016.7900006 · Cited by 1,326 · see citing works
A Survey of Quantization Methods for Efficient Neural Network Inference
Gholami, A., Kim, S., Dong, Z., Yao, Z., Mahoney, M. W., & Keutzer, K. (2022) · Low-Power Computer Vision · doi:10.1201/9781003162810-13 · Cited by 1,219 · see citing works
Improved Knowledge Distillation via Teacher Assistant
Mirzadeh, S. I., Farajtabar, M., Li, A., Levine, N., Matsukawa, A., & Ghasemzadeh, H. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5963 · Cited by 101 · see citing works
Federated Learning via Over-the-Air Computation
Yang, K., Jiang, T., Shi, Y., & Ding, Z. (2020) · IEEE Transactions on Wireless Communications · doi:10.1109/twc.2019.2961673 · Cited by 1,084 · see citing works
“To address this issue, there is a growing body of recent works to reduce the storage overhead, time and power consumption in the inference process using the model compression methods via hardware and software co-design [7], [8].”
MethodFINN: A Framework for Fast, Scalable Binarized Neural Network Inference
Umuroglu, Y., Fraser, N. J., Gambardella, G., Blott, M., Leong, P., Jahre, M., & Vissers, K. (2017) · Proceedings of the 2017 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/3020078.3021744 · Cited by 1,189 · see citing works
Recent advances in deep learning for object detection
Wu, X., Sahoo, D., & Hoi, S. C. H. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.01.085 · Cited by 1,047 · see citing works
Machine learning with big data: challenges and approaches.
L'Heureux, A., Grolinger, K., Elyamany, H. F., & Capretz, M. A. M. (2017) · IEEE Access · doi:10.1109/access.2017.2696365 · Cited by 1,023 · see citing works
Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networks
Liu, K., Dolan-Gavitt, B., & Garg, S. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00470-5_13 · Cited by 1,055 · see citing works
Sequence-Level Knowledge Distillation
Kim, Y., & Rush, A. M. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1139 · Cited by 836 · see citing works
Machine Learning Operations (MLOps): Overview, Definition, and Architecture
Kreuzberger, D., Kühl, N., & Hirschl, S. (2023) · IEEE Access · doi:10.1109/access.2023.3262138 · Cited by 766 · see citing works
Designing Energy-Efficient Convolutional Neural Networks Using Energy-Aware Pruning
Yang, T.-J., Chen, Y.-H., & Sze, V. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.643 · Cited by 732 · see citing works
Li, F., Liu, B., Wang, X., Zhang, B., & Yan, J. (2016) · arXiv · doi:10.48550/arxiv.1605.04711 · Cited by 732 · see citing works
ESE: Efficient Speech Recognition Engine with Sparse LSTM on FPGA
Han, S., Kang, J., Mao, H., Hu, Y., Li, X., Li, Y., Xie, D., Luo, H., Yao, S., Wang, Y., et al. (2017) · Proceedings of the 2017 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/3020078.3021745 · Cited by 591 · see citing works
Self-citationYOLO-LITE: A Real-Time Object Detection Algorithm Optimized for Non-GPU Computers
Huang, R., Pedoeem, J., & Chen, C. (2018) · 2018 IEEE International Conference on Big Data (Big Data) · doi:10.1109/bigdata.2018.8621865 · Cited by 622 · see citing works
Applied Machine Learning at Facebook: A Datacenter Infrastructure Perspective
Hazelwood, K., Bird, S., Brooks, D., Chintala, S., Diril, U., Dzhulgakov, D., Fawzy, M., Jia, B., Jia, Y., Kalro, A., et al. (2018) · 2018 IEEE International Symposium on High Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2018.00059 · Cited by 590 · see citing works
The Computational Limits of Deep Learning
Thompson, N. C., Greenewald, K., Lee, K., & Manso, G. F. (2020) · arXiv · doi:10.48550/arxiv.2007.05558 · Cited by 538 · see citing works
HAWQ: Hessian AWare Quantization of Neural Networks With Mixed-Precision
Dong, Z., Yao, Z., Gholami, A., Mahoney, M., & Keutzer, K. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00038 · Cited by 492 · see citing works
Machine Learning Models that Remember Too Much
Song, C., Ristenpart, T., & Shmatikov, V. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3134077 · Cited by 526 · see citing works
Communication-efficient edge ai: algorithms and systems
Shi, Y., Yang, K., Jiang, T., Zhang, J., & Letaief, K. B. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3007787 · Cited by 488 · see citing works
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
Dao, T., Fu, D. Y., Ermon, S., Rudra, A., & Ré, C. (2022) · arXiv · doi:10.48550/arxiv.2205.14135 · Cited by 1,214 · see citing works
“[37] Song Han, Huizi Mao, and William J Dally.”
BackgroundMethodEfficient Acceleration of Deep Learning Inference on Resource-Constrained Edge Devices: A Review
Shuvo, M. M. H., Islam, S. K., Cheng, J., & Morshed, B. I. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2022.3226481 · Cited by 436 · see citing works
“Sparse weight compression is an effective technique that results in 20%–30% memory access reduction [157].”
BackgroundMethodInfluentialZeroQ: A Novel Zero Shot Quantization Framework
Cai, Y., Yao, Z., Dong, Z., Gholami, A., Mahoney, M. W., & Keutzer, K. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.01318 · Cited by 381 · see citing works
Learning to Quantize Deep Networks by Optimizing Quantization Intervals With Task Loss
Jung, S., Son, C., Lee, S., Son, J., Han, J.-J., Kwak, Y., Hwang, S. J., & Choi, C. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00448 · Cited by 385 · see citing works
Biscotti: A blockchain system for private and secure federated learning
Shayan, M., Fung, C., Yoon, C. J. M., & Beschastnikh, I. (2021) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2020.3044223 · Cited by 354 · see citing works
Multimodal Large Language Models in Health Care: Applications, Challenges, and Future Outlook.
AlSaad, R., Abd-alrazaq, A., Boughorbel, S., Ahmed, A., Renault, M.-A., Damseh, R., & Sheikh, J. (2024) · Journal of medical Internet research · doi:10.2196/59505 · Cited by 349 · see citing works
“In addition, quantization approaches can address the scalability and computational demands by shifting toward quantized versions of existing models using curated, domain-specific data rather than pretraining from scratch [159].”
A comprehensive review on deep learning-based methods for video anomaly detection
Nayak, R., Pati, U. C., & Das, S. K. (2021) · Image and Vision Computing · doi:10.1016/j.imavis.2020.104078 · Cited by 324 · see citing works
EfficientViT: Lightweight Multi-Scale Attention for High-Resolution Dense Prediction
Cai, H., Li, J., Hu, M., Gan, C., & Han, S. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01587 · Cited by 356 · see citing works
Self-citationDeep Learning for Sensor-based Human Activity Recognition: Overview, Challenges and Opportunities
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2020) · arXiv · doi:10.48550/arxiv.2001.07416 · Cited by 314 · see citing works
ChamNet: Towards Efficient Network Design Through Platform-Aware Model Adaptation
Dai, X., Zhang, P., Wu, B., Yin, H., Sun, F., Wang, Y., Dukhan, M., Hu, Y., Wu, Y., Jia, Y., et al. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01166 · Cited by 279 · see citing works
LightTrack: Finding Lightweight Neural Networks for Object Tracking via One-Shot Architecture Search
Yan, B., Peng, H., Wu, K., Wang, D., Fu, J., & Lu, H. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01493 · Cited by 277 · see citing works
NestDNN: Resource-Aware Multi-Tenant On-Device Deep Learning for Continuous Mobile Vision
Fang, B., Zeng, X., & Zhang, M. (2018) · Proceedings of the 24th Annual International Conference on Mobile Computing and Networking · doi:10.1145/3241539.3241559 · Cited by 291 · see citing works
Learning Filter Pruning Criteria for Deep Convolutional Neural Networks Acceleration
He, Y., Ding, Y., Liu, P., Zhu, L., Zhang, H., & Yang, Y. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00208 · Cited by 262 · see citing works
YodaNN: An Architecture for Ultralow Power Binary-Weight CNN Acceleration
Andri, R., Cavigelli, L., Rossi, D., & Benini, L. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2017.2682138 · Cited by 247 · see citing works
Parameter-Efficient Transfer Learning with Diff Pruning
Guo, D., Rush, A., & Kim, Y. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.378 · Cited by 220 · see citing works
Perspective: A review on memristive hardware for neuromorphic computation
Sung, C., Hwang, H., & Yoo, I. K. (2018) · Journal of Applied Physics · doi:10.1063/1.5037835 · Cited by 217 · see citing works
Perception-Aware Multi-Sensor Fusion for 3D LiDAR Semantic Segmentation
Zhuang, Z., Li, R., Jia, K., Wang, Q., Li, Y., & Tan, M. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01597 · Cited by 216 · see citing works
Patch Slimming for Efficient Vision Transformers
Tang, Y., Han, K., Wang, Y., Xu, C., Guo, J., Xu, C., & Tao, D. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01185 · Cited by 201 · see citing works
AdderNet: Do We Really Need Multiplications in Deep Learning?
Chen, H., Wang, Y., Xu, C., Shi, B., Xu, C., Tian, Q., & Xu, C. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00154 · Cited by 199 · see citing works
Yao, S., Zhao, Y., Zhang, A., Su, L., & Abdelzaher, T. (2017) · Proceedings of the 15th ACM Conference on Embedded Network Sensor Systems · doi:10.1145/3131672.3131675 · Cited by 188 · see citing works
Ahmad, S., Shakeel, I., Mehfuz, S., & Ahmad, J. (2023) · Computer Science Review · doi:10.1016/j.cosrev.2023.100568 · Cited by 197 · see citing works
Design and Analysis of Uplink and Downlink Communications for Federated Learning
Zheng, S., Shen, C., & Chen, X. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2020.3041388 · Cited by 191 · see citing works
Filter-based deep-compression with global average pooling for convolutional networks
Hsiao, T.-Y., Chang, Y.-C., Chou, H.-H., & Chiu, C.-T. (2019) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2019.02.008 · Cited by 190 · see citing works
Rasch, M. J., Mackin, C., Le Gallo, M., Chen, A., Fasoli, A., Odermatt, F., Li, N., Nandakumar, S. R., Narayanan, P., Tsai, H., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-40770-4 · Cited by 178 · see citing works
FQ-ViT: Post-Training Quantization for Fully Quantized Vision Transformer
Lin, Y., Zhang, T., Sun, P., Li, Z., & Zhou, S. (2022) · Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2022/164 · Cited by 198 · see citing works
A Study of BFLOAT16 for Deep Learning Training
Kalamkar, D., Mudigere, D., Mellempudi, N., Das, D., Banerjee, K., Avancha, S., Vooturi, D. T., Jammalamadaka, N., Huang, J., Yuen, H., et al. (2019) · arXiv · doi:10.48550/arxiv.1905.12322 · Cited by 169 · see citing works
“Inference has witnessed a proliferation of mixed precision compute [19, 33, 27, 25] where different operations execute at different precision, all the way from binary/ternary operands to 16b floating point.”
BackgroundPanwar, M., Biswas, D., Bajaj, H., Jobges, M., Turk, R., Maharatna, K., & Acharyya, A. (2019) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2019.2899927 · Cited by 158 · see citing works
TinyOL: TinyML with Online-Learning on Microcontrollers
Ren, H., Anicic, D., & Runkler, T. A. (2021) · 2021 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533927 · Cited by 185 · see citing works
JALAD: Joint Accuracy-And Latency-Aware Deep Structure Decoupling for Edge-Cloud Execution
Li, H., Hu, C., Jiang, J., Wang, Z., Wen, Y., & Zhu, W. (2018) · 2018 IEEE 24th International Conference on Parallel and Distributed Systems (ICPADS) · doi:10.1109/padsw.2018.8645013 · Cited by 160 · see citing works
SwapAdvisor: Pushing Deep Learning Beyond the GPU Memory Limit via Smart Swapping
Huang, C.-C., Jin, G., & Li, J. (2020) · Proceedings of the Twenty-Fifth International Conference on Architectural Support for Programming Languages and Operating Systems · doi:10.1145/3373376.3378530 · Cited by 158 · see citing works
A Survey of Techniques for Optimizing Transformer Inference
Chitty-Venkata, K. T., Mittal, S., Emani, M., Vishwanath, V., & Somani, A. K. (2023) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2023.102990 · Cited by 154 · see citing works
Binary Ensemble Neural Network: More Bits per Network or More Networks per Bit?
Zhu, S., Dong, X., & Su, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00506 · Cited by 153 · see citing works
Challenges, Applications and Design Aspects of Federated Learning: A Survey
Rahman, K. M. J., Ahmed, F., Akhter, N., Hasan, M., Amin, R., Aziz, K. E., Islam, A. K. M. M., Mukta, M. S. H., & Islam, A. K. M. N. (2021) · IEEE Access · doi:10.1109/access.2021.3111118 · Cited by 147 · see citing works
IONN: Incremental Offloading of Neural Network Computations from Mobile Devices to Edge Servers
Jeong, H.-J., Lee, H.-J., Shin, C. H., & Moon, S.-M. (2018) · Proceedings of the ACM Symposium on Cloud Computing · doi:10.1145/3267809.3267828 · Cited by 143 · see citing works
OpenEI: An Open Framework for Edge Intelligence
Zhang, X., Wang, Y., Lu, S., Liu, L., xu, L., & Shi, W. (2019) · 2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2019.00182 · Cited by 139 · see citing works
“1) Compression: Compression techniques are roughly categorized into three groups: Parameter sharing and pruning methods, low-rank approximation methods, and knowledge transfer methods [18], [19].”
MethodA survey on optimization techniques for edge artificial intelligence (ai)
Surianarayanan, C., Lawrence, J. J., Chelliah, P. R., Prakash, E., & Hewage, C. (2023) · Sensors · doi:10.3390/s23031279 · Cited by 131 · see citing works
Shallow Convolutional Neural Networks for Human Activity Recognition Using Wearable Sensors
Huang, W., Zhang, L., Gao, W., Min, F., & He, J. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3091990 · Cited by 129 · see citing works
Accelerating Deep Convolutional Networks using low-precision and sparsity
Venkatesh, G., Nurvitadhi, E., & Marr, D. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7952679 · Cited by 123 · see citing works
Neuroinspired unsupervised learning and pruning with subquantum CBRAM arrays
Shi, Y., Nguyen, L., Oh, S., Liu, X., Koushan, F., Jameson, J. R., & Kuzum, D. (2018) · Nature Communications · doi:10.1038/s41467-018-07682-0 · Cited by 106 · see citing works
ModelOps: Cloud-Based Lifecycle Management for Reliable and Trusted AI
Hummer, W., Muthusamy, V., Rausch, T., Dube, P., El Maghraoui, K., Murthi, A., & Oum, P. (2019) · 2019 IEEE International Conference on Cloud Engineering (IC2E) · doi:10.1109/ic2e.2019.00025 · Cited by 105 · see citing works
A Review of Privacy-Preserving Federated Learning for the Internet-of-Things
Briggs, C., Fan, Z., & Andras, P. (2021) · Studies in Computational Intelligence · doi:10.1007/978-3-030-70604-3_2 · Cited by 101 · see citing works
Li, D., Tasci, S., Ghosh, S., Zhu, J., Zhang, J., & Heck, L. (2019) · Proceedings of the 4th ACM/IEEE Symposium on Edge Computing · doi:10.1145/3318216.3363317 · Cited by 94 · see citing works
Online Fall Detection Using Recurrent Neural Networks on Smart Wearable Devices
Musci, M., De Martini, D., Blago, N., Facchinetti, T., & Piastra, M. (2021) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2020.3027454 · Cited by 128 · see citing works
LEARN Codes: Inventing Low-Latency Codes via Recurrent Neural Networks
Jiang, Y., Kim, H., Asnani, H., Kannan, S., Oh, S., & Viswanath, P. (2020) · IEEE Journal on Selected Areas in Information Theory · doi:10.1109/jsait.2020.2988577 · Cited by 87
A Compact Convolutional Neural Network for Surface Defect Inspection
Huang, Y., Qiu, C., Wang, X., Wang, S., & Yuan, K. (2020) · Sensors · doi:10.3390/s20071974 · Cited by 85 · see citing works
ChannelNets: Compact and Efficient Convolutional Neural Networks via Channel-Wise Convolutions
Gao, H., Wang, Z., Cai, L., & Ji, S. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.2975796 · Cited by 81 · see citing works
On the Accuracy of Analog Neural Network Inference Accelerators
Xiao, T. P., Feinberg, B., Bennett, C. H., Prabhakar, V., Saxena, P., Agrawal, V., Agarwal, S., & Marinella, M. J. (2022) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2022.3214409 · Cited by 76 · see citing works
Jain, S., Tsai, H., Chen, C.-T., Muralidhar, R., Boybat, I., Frank, M. M., Woźniak, S., Stanisavljevic, M., Adusumilli, P., Narayanan, P., et al. (2023) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2022.3221390 · Cited by 76 · see citing works
DeepPayload: Black-box Backdoor Attack on Deep Learning Models through Neural Payload Injection
Li, Y., Hua, J., Wang, H., Chen, C., & Liu, Y. (2021) · 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE) · doi:10.1109/icse43902.2021.00035 · Cited by 75 · see citing works
Kim, S., & Kim, H. (2021) · IEEE Access · doi:10.1109/access.2021.3054879 · Cited by 69 · see citing works
“For the weight quantization techniques that have been most actively studied, the value of the weight is expressed in a single-precision floating-point format ( i.e. , 32-bit), and the number of weight parameter types used in the network is reduced through quantization [21]–[23].”
BackgroundAddNet: Deep Neural Networks Using FPGA-Optimized Multipliers
Faraone, J., Kumm, M., Hardieck, M., Zipf, P., Liu, X., Boland, D., & Leong, P. H. W. (2020) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2019.2939429 · Cited by 66 · see citing works
Zhu, B., Shin, U., & Shoaran, M. (2021) · IEEE Transactions on Biomedical Circuits and Systems · doi:10.1109/tbcas.2021.3112756 · Cited by 67 · see citing works
MobileDA: Toward Edge-Domain Adaptation
Yang, J., Zou, H., Cao, S., Chen, Z., & Xie, L. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2976762 · Cited by 67 · see citing works
A survey of model compression strategies for object detection
Lyu, Z., Yu, T., Pan, F., Zhang, Y., Luo, J., Zhang, D., Chen, Y., Zhang, B., & Li, G. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-17192-x · Cited by 65 · see citing works
NoisyQuant: Noisy Bias-Enhanced Post-Training Activation Quantization for Vision Transformers
Liu, Y., Yang, H., Dong, Z., Keutzer, K., Du, L., & Zhang, S. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01946 · Cited by 60 · see citing works
Towards Energy-Efficient and Secure Edge AI: A Cross-Layer Framework ICCAD Special Session Paper
Shafique, M., Marchisio, A., Wicaksana Putra, R. V., & Hanif, M. A. (2021) · 2021 IEEE/ACM International Conference On Computer Aided Design (ICCAD) · doi:10.1109/iccad51958.2021.9643539 · Cited by 58 · see citing works
EasiEdge: A Novel Global Deep Neural Networks Pruning Method for Efficient Edge Computing
Yu, F., Cui, L., Wang, P., Han, C., Huang, R., & Huang, X. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.3034925 · Cited by 58 · see citing works
FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performance
Chen, L., Zaharia, M., & Zou, J. (2023) · arXiv · doi:10.48550/arxiv.2305.05176 · Cited by 51 · see citing works
Falaschetti, L., Manoni, L., Rivera, R. C. F., Pau, D., Romanazzi, G., Silvestroni, O., Tomaselli, V., & Turchetti, C. (2021) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2021.3098454 · Cited by 45 · see citing works
ECRT: An Edge Computing System for Real-Time Image-based Object Tracking
Zhao, Z., Jiang, Z., Ling, N., Shuai, X., & Xing, G. (2018) · Proceedings of the 16th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/3274783.3275199 · Cited by 39 · see citing works
Random sketch learning for deep neural networks in edge computing
Li, B., Chen, P., Liu, H., Guo, W., Cao, X., Du, J., Zhao, C., & Zhang, J. (2021) · Nature Computational Science · doi:10.1038/s43588-021-00039-6 · Cited by 40 · see citing works
A Novel Lightweight IoT Intrusion Detection Model Based on Self-Knowledge Distillation
Wang, Z., Zhou, R., Yang, S., He, D., & Chan, S. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3533092 · Cited by 38 · see citing works
Compressed Deep Learning to Classify Arrhythmia in an Embedded Wearable Device
Lee, K.-S., Park, H.-J., Kim, J. E., Kim, H. J., Chon, S., Kim, S., Jang, J., Kim, J.-K., Jang, S., Gil, Y., et al. (2022) · Sensors · doi:10.3390/s22051776 · Cited by 36 · see citing works
- Authors
- Han, S., Mao, H., & Dally, W. J.
- Affiliations
- Stanford University (US)
- Tsinghua University (CN)
- Nvidia (United Kingdom) (GB)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2015
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1510.00149
- OpenAlex
- W2119144962
- Cited by
- 4,662
- References
- 20
- Citations by year
- 2026: 35 · 2025: 270 · 2024: 497 · 2023: 593 · 2022: 621 · 2021: 736 · 2020: 701 · 2019: 581 · 2018: 394 · 2017: 186 · 2016: 40 · 2015: 3 · 2012: 3
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- International Conference on Learning Representations
- Funders
- National Science Foundation (2312006)
- Washington State University
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Data Compression Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- neural network compression, neural network pruning, Huffman coding, weight quantization, storage reduction, embedded systems, mobile application, energy efficiency, AlexNet, VGG16, on-chip SRAM
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
