The DOI matches its Crossref record; 243 of the 243 references it cites were found in a registry or an index.
A comprehensive review of model compression techniques in machine learning
Open accessAbstract
This paper critically examines model compression techniques within the machine learning (ML) domain, emphasizing their role in enhancing model efficiency for deployment in resource-constrained environments, such as mobile devices, edge computing, and Internet of Things (IoT) systems. By systematically exploring compression techniques and lightweight design architectures, it is provided a comprehensive understanding of their operational contexts and effectiveness. The synthesis of these strategies reveals a dynamic interplay between model performance and computational demand, highlighting the balance required for optimal application. As machine learning (ML) models grow increasingly complex and data-intensive, the demand for computational resources and memory has surged accordingly. This escalation presents significant challenges for the deployment of artificial intelligence (AI) systems in real-world applications, particularly where hardware capabilities are limited. Therefore, model compression techniques are not merely advantageous but essential for ensuring that these models can be utilized across various domains, maintaining high performance without prohibitive resource requirements. Furthermore, this review underscores the importance of model compression in sustainable artificial intelligence (AI) development. The introduction of hybrid methods, which combine multiple compression techniques, promises to deliver superior performance and efficiency. Additionally, the development of intelligent frameworks capable of selecting the most appropriate compression strategy based on specific application needs is crucial for advancing the field. The practical examples and engineering applications discussed demonstrate the real-world impact of these techniques. By optimizing the balance between model complexity and computational efficiency, model compression ensures that the advancements in AI technology remain sustainable and widely applicable. This comprehensive review thus contributes to the academic discourse and guides innovative solutions for efficient and responsible machine learning practices, paving the way for future advancements in the field. Graphical abstract:
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
MobileNetV2: Inverted Residuals and Linear Bottlenecks
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L.-C. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00474 · Cited by 28,755
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387 · cited 1×
“This comparison should clarify the unique attributes and trade-offs of each model compression technique, offering a more refined understanding of their individual and comparative impacts [51–55].”
Raissi, M., Perdikaris, P., & Karniadakis, G. E. (2019) · Journal of Computational Physics · doi:10.1016/j.jcp.2018.10.045 · Cited by 20,384
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015
Generative adversarial networks
Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2020) · Communications of the ACM · doi:10.1145/3422622 · Cited by 18,384
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Tan, M., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1905.11946 · Cited by 17,072
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Distilling the Knowledge in a Neural Network
Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204
The perceptron: A probabilistic model for information storage and organization in the brain.
Rosenblatt, F. (1958) · Psychological Review · doi:10.1037/h0042519 · Cited by 12,280 · cited 1×
“The perceptron, developed in 1958 [1], laid the early groundwork for deep neural networks (DNNs) in pattern recognition.”
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00716 · Cited by 9,982
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices
Zhang, X., Zhou, X., Lin, M., & Sun, J. (2017) · arXiv · doi:10.48550/arxiv.1707.01083 · Cited by 9,982
Howard, A., Sandler, M., Chen, B., Wang, W., Chen, L.-C., Tan, M., Chu, G., Vasudevan, V., Zhu, Y., Pang, R., et al. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00140 · Cited by 9,708
ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design
Ma, N., Zhang, X., Zheng, H.-T., & Sun, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01264-9_8 · Cited by 7,356
The random subspace method for constructing decision forests
Ho, T. K. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.709601 · Cited by 6,842
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
Iandola, F. N., Han, S., Moskewicz, M. W., Ashraf, K., Dally, W. J., & Keutzer, K. (2016) · arXiv · doi:10.48550/arxiv.1602.07360 · Cited by 6,201 · cited 5×
“SqueezeNet, a CNN architecture [96], achieves AlexNet-level performance on the ImageNet database with 50 × fewer parameters.”
InfluentialHow transferable are features in deep neural networks?
Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014) · arXiv · doi:10.48550/arxiv.1411.1792 · Cited by 6,061
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
Wu, Y., Schuster, M., Chen, Z., Le, Q. V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., Macherey, K., et al. (2016) · arXiv · doi:10.48550/arxiv.1609.08144 · Cited by 5,319 · cited 1×
“Anexam-ple of this is Google’s use of pruning in its neural machine translation system, which resulted in a 92% reduction in model size while maintaining translation quality [253].”
Ho, T. K. (2002) · Proceedings of 3rd International Conference on Document Analysis and Recognition · doi:10.1109/icdar.1995.598994 · Cited by 5,054
Multimodal Machine Learning: A Survey and Taxonomy
Baltrusaitis, T., Ahuja, C., & Morency, L.-P. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2798607 · Cited by 5,018
Dwivedi, Y. K., Hughes, L., Ismagilova, E., Aarts, G., Coombs, C., Crick, T., Duan, Y., Dwivedi, R., Edwards, J., Eirug, A., et al. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2019.08.002 · Cited by 4,611
Efficient Processing of Deep Neural Networks: A Tutorial and Survey
Sze, V., Chen, Y.-H., Yang, T.-J., & Emer, J. S. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2761740 · Cited by 4,215 · cited 2×
“Neural Architecture [74, 119, 151, 153–156, 172, 173, 205, 206, 233, 236, 263, 268, 289, 290] Optimization [15, 124, 184, 222, 228, 230, 261, 277] Recurrent neural networks [38, 39, 159, 267, 291] Miscellaneous [3, 5, 6, 16, 18, 28, 31, 32, 34, 41, 46–48,50,51,53,54,61,68,73,76,…”
MnasNet: Platform-Aware Neural Architecture Search for Mobile
Tan, M., Chen, B., Pang, R., Vasudevan, V., Sandler, M., Howard, A., & Le, Q. V. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00293 · Cited by 3,416
Deep learning and its applications to machine health monitoring
Zhao, R., Yan, R., Chen, Z., Mao, K., Wang, P., & Gao, R. X. (2019) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2018.05.050 · Cited by 2,894
Duan, Y., Edwards, J. S., & Dwivedi, Y. K. (2019) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2019.01.021 · Cited by 2,628
Llama 2: Open Foundation and Fine-Tuned Chat Models
Touvron, H., Martin, L., Stone, K., Albert, P., Almahairi, A., Babaei, Y., Bashlykov, N., Batra, S., Bhargava, P., Bhosale, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2307.09288 · Cited by 2,604
ResNeSt: Split-Attention Networks
Zhang, H., Wu, C., Zhang, Z., Zhu, Y., Lin, H., Zhang, Z., Sun, Y., He, T., Mueller, J., Manmatha, R., et al. (2020) · arXiv · doi:10.48550/arxiv.2004.08955 · Cited by 1,809
AutoML: A survey of the state-of-the-art
He, X., Zhao, K., & Chu, X. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106622 · Cited by 1,691
ResNeSt: Split-Attention Networks
Zhang, H., Wu, C., Zhang, Z., Zhu, Y., Lin, H., Zhang, Z., Sun, Y., He, T., Mueller, J., Manmatha, R., et al. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw56347.2022.00309 · Cited by 1,648
Enabling technologies and tools for digital twin
Qi, Q., Tao, F., Hu, T., Anwer, N., Liu, A., Wei, Y., Wang, L., & Nee, A. Y. C. (2021) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2019.10.001 · Cited by 1,579 · cited 1×
“…188,193,194,197–201,204,207,210,211,214–216,223–227,229, 237,239–241,245,246,256–259,262,265,266,271–273,275,279– 281,292,293] This table provides a comprehensive overview of the key publications that have been referenced throughout the study, offering insights into…”
Explainable AI (XAI): Core Ideas, Techniques, and Solutions
Dwivedi, R., Dave, D., Naik, H., Singhal, S., Omer, R., Patel, P., Qian, B., Wen, Z., Shah, T., Morgan, G., et al. (2023) · ACM Computing Surveys · doi:10.1145/3561048 · Cited by 1,386
EfficientNetV2: Smaller Models and Faster Training
Tan, M., & Le, Q. V. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.00298 · Cited by 1,098
Model Compression and Hardware Acceleration for Neural Networks: A Comprehensive Survey
Deng, B. L., Li, G., Han, S., Shi, L., & Xie, Y. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2020.2976475 · Cited by 996 · cited 5×
“Recent studies have contributed to the field by proposing novel approaches [69, 193, 194], exploring various compression techniques for DNNs, including compact models, tensor decomposition [131, 195], data quantization [122, 196], and network sparsification [197, 198].”
InfluentialRight for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference
McCoy, R. T., Pavlick, E., & Linzen, T. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1334 · Cited by 944
(2020) · doi:10.1109/sc41405.2020.00024 · Cited by 928
A Survey of Model Compression and Acceleration for Deep Neural Networks
Cheng, Y., Wang, D., Zhou, P., & Zhang, T. (2017) · arXiv · doi:10.48550/arxiv.1710.09282 · Cited by 857 · cited 1×
“This highlights the potential of iterative pruning to maintain high performance even with significant compression [255].”
Rasley, J., Rajbhandari, S., Ruwase, O., & He, Y. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3406703 · Cited by 823 · cited 2×
“Neural Architecture [74, 119, 151, 153–156, 172, 173, 205, 206, 233, 236, 263, 268, 289, 290] Optimization [15, 124, 184, 222, 228, 230, 261, 277] Recurrent neural networks [38, 39, 159, 267, 291] Miscellaneous [3, 5, 6, 16, 18, 28, 31, 32, 34, 41, 46–48,50,51,53,54,61,68,73,76,…”
Cheng, Y., Wang, D., Zhou, P., & Zhang, T. (2018) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2765695 · Cited by 817
Li, W., Huang, R., Li, J., Liao, Y., Chen, Z., He, G., Yan, R., & Gryllias, K. (2022) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2021.108487 · Cited by 816
Energy and Policy Considerations for Modern Deep Learning Research
Strubell, E., Ganesh, A., & McCallum, A. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i09.7123 · Cited by 774 · cited 1×
“These energy-efficient compression methods, which are crucial for lowering operational expenses and fulfilling sustainability objectives, will necessitate innovations that optimize computational pathways and minimize energy-intensive processes [274].”
DeepTrust^RT: Confidential Deep Neural Inference Meets Real-Time!
Babar, M. F., & Hasan, M. (2024) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.ecrts.2024.13 · Cited by 708
A Study of CNN and Transfer Learning in Medical Imaging: Advantages, Challenges, Future Scope
Salehi, A. W., Khan, S., Gupta, G., Alabduallah, B. I., Almjally, A., Alsolai, H., Siddiqui, T., & Mellit, A. (2023) · Sustainability · doi:10.3390/su15075930 · Cited by 570
Digital twin-driven intelligent assessment of gear surface degradation
Feng, K., Ji, J. C., Zhang, Y., Ni, Q., Liu, Z., & Beer, M. (2023) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2022.109896 · Cited by 542
A comprehensive survey on model compression and acceleration
Choudhary, T., Mishra, V., Goswami, A., & Sarangapani, J. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-020-09816-7 · Cited by 513
Imambi, S., Prakash, K. B., & Kanagachidambaresan, G. R. (2021) · EAI/Springer Innovations in Communication and Computing · doi:10.1007/978-3-030-57077-4_10 · Cited by 489
Compressed residual-VGG16 CNN model for big data places image recognition
Qassim, H., Verma, A., & Feinzimer, D. (2018) · 2018 IEEE 8th Annual Computing and Communication Workshop and Conference (CCWC) · doi:10.1109/ccwc.2018.8301729 · Cited by 486
Paymode, A. S., & Malode, V. B. (2022) · Artificial Intelligence in Agriculture · doi:10.1016/j.aiia.2021.12.002 · Cited by 432
On Compressing Deep Models by Low Rank and Sparse Decomposition
Yu, X., Liu, T., Wang, X., & Tao, D. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.15 · Cited by 403
Developers, T. (2021) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.4724125 · Cited by 384
Transfer learning techniques for medical image analysis: A review
Kora, P., Ooi, C. P., Faust, O., Raghavendra, U., Gudigar, A., Chan, W. Y., Meenakshi, K., Swaraja, K., Plawiak, P., & Rajendra Acharya, U. (2022) · Biocybernetics and Biomedical Engineering · doi:10.1016/j.bbe.2021.11.004 · Cited by 367
Compute Trends Across Three Eras of Machine Learning
Sevilla, J., Heim, L., Ho, A., Besiroglu, T., Hobbhahn, M., & Villalobos, P. (2022) · 2022 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9891914 · Cited by 363 · cited 2×
“[14, 15].”
A review on reinforcement learning algorithms and applications in supply chain management
Rolf, B., Jackson, I., Müller, M., Lang, S., Reggelin, T., & Ivanov, D. (2023) · International Journal of Production Research · doi:10.1080/00207543.2022.2140221 · Cited by 355
SqueezeNext: Hardware-Aware Neural Network Design
Gholami, A., Kwon, K., Wu, B., Tai, Z., Yue, X., Jin, P., Zhao, S., & Keutzer, K. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00215 · Cited by 350
Physics-Informed Residual Network (PIResNet) for rolling element bearing fault diagnostics
Ni, Q., Ji, J. C., Halkon, B., Feng, K., & Nandi, A. K. (2023) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2023.110544 · Cited by 335
Design, Modeling and Implementation of Digital Twins
Segovia, M., & Garcia-Alfaro, J. (2022) · Sensors · doi:10.3390/s22145396 · Cited by 332
Deep reinforcement learning in smart manufacturing: A review and prospects
Li, C., Zheng, P., Yin, Y., Wang, B., & Wang, L. (2023) · CIRP Journal of Manufacturing Science and Technology · doi:10.1016/j.cirpj.2022.11.003 · Cited by 327
A Deep Learning Model for Smart Manufacturing Using Convolutional LSTM Neural Network Autoencoders
Essien, A., & Giannetti, C. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.2967556 · Cited by 318
A Survey on Digital Twin for Industrial Internet of Things: Applications, Technologies and Tools
Xu, H., Wu, J., Pan, Q., Guan, X., & Guizani, M. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3297395 · Cited by 304
Model Compression for Deep Neural Networks: A Survey
Li, Z., Li, H., & Meng, L. (2023) · Computers · doi:10.3390/computers12030060 · Cited by 296
Language model compression with weighted low-rank factorizationPreprint
Hsu, Y.-C., Hua, T., Chang, S., Lou, Q., Shen, Y., & Jin, H. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2207.00112 · Cited by 265
Pruning by explaining: A novel criterion for deep neural network pruning
Yeom, S.-K., Seegerer, P., Lapuschkin, S., Binder, A., Wiedemann, S., Müller, K.-R., & Samek, W. (2021) · Pattern Recognition · doi:10.1016/j.patcog.2021.107899 · Cited by 263
(2021) · doi:10.1145/3458817.3476205 · Cited by 257
Transfer learning-based deep ensemble neural network for plant leaf disease detection
Vallabhajosyula, S., Sistla, V., & Kolli, V. K. K. (2022) · Journal of Plant Diseases and Protection · doi:10.1007/s41348-021-00465-8 · Cited by 253
Fields, J., Chovanec, K., & Madiraju, P. (2024) · IEEE Access · doi:10.1109/access.2024.3349952 · Cited by 246
An explainable AI (XAI) model for landslide susceptibility modeling
Pradhan, B., Dikshit, A., Lee, S., & Kim, H. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2023.110324 · Cited by 224
Methods for Pruning Deep Neural Networks
Vadera, S., & Ameen, S. (2022) · IEEE Access · doi:10.1109/access.2022.3182659 · Cited by 223
A systematic review of data-driven approaches to fault diagnosis and early warning
Jieyang, P., Kimmig, A., Dongkun, W., Niu, Z., Zhi, F., Jiahai, W., Liu, X., & Ovtcharova, J. (2023) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-022-02020-0 · Cited by 220
Exploring the Regularity of Sparse Structure in Convolutional Neural Networks
Mao, H., Han, S., Pool, J., Li, W., Liu, X., Wang, Y., & Dally, W. J. (2017) · arXiv · doi:10.48550/arxiv.1705.08922 · Cited by 219
Yan, Y., Chow, A. H. F., Ho, C. P., Kuo, Y.-H., Wu, Q., & Ying, C. (2022) · Transportation Research Part E: Logistics and Transportation Review · doi:10.1016/j.tre.2022.102712 · Cited by 214
Multilayer Sparsity-Based Tensor Decomposition for Low-Rank Tensor Completion
Xue, J., Zhao, Y., Huang, S., Liao, W., Chan, J. C.-W., & Kong, S. G. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3083931 · Cited by 210
Point-to-Voxel Knowledge Distillation for LiDAR Semantic Segmentation
Hou, Y., Zhu, X., Ma, Y., Loy, C. C., & Li, Y. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.00829 · Cited by 201
Residual-based attention in physics-informed neural networks
Anagnostopoulos, S., Toscano, J. D., Stergiopulos, N., & Karniadakis, G. E. (2024) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2024.116805 · Cited by 200
Discrimination-aware Network Pruning for Deep Model Compression
Liu, J., Zhuang, B., Zhuang, Z., Guo, Y. F., Huang, J., Zhu, J., & Tan, M. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3066410 · Cited by 196
Reinforced Multi-Teacher Selection for Knowledge Distillation
Yuan, F., Shou, L., Pei, J., Lin, W., Gong, M., Fu, Y. H., & Jiang, D. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i16.17680 · Cited by 187
When Object Detection Meets Knowledge Distillation: A Survey
Li, Z., Xu, P., Chang, X., Yang, L., Zhang, Y., Yao, L., & Chen, X. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2023.3257546 · Cited by 185
Reinforcement learning applied to production planning and control
Esteso, A., Peidro, D., Mula, J., & Díaz‐Madroñero, M. (2022) · International Journal of Production Research · doi:10.1080/00207543.2022.2104180 · Cited by 180
A Transfer‐Learning Approach for Accelerated MRI Using Deep Neural Networks
Dar, S. U. H., Özbey, M., Çatlı, A. B., & Çukur, T. (2020) · Magnetic Resonance in Medicine · doi:10.1002/mrm.28148 · Cited by 178
Compression of Deep Learning Models for Text: A Survey
Gupta, M., & Agrawal, P. (2022) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3487045 · Cited by 175
Show, Attend and Distill: Knowledge Distillation via Attention-based Feature Matching
Ji, M., Heo, B., & Park, S. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i9.16969 · Cited by 174
An Effective Approach to Detect and Identify Brain Tumors Using Transfer Learning
Ullah, N., Khan, J. A., Khan, M. S., Khan, W., Hassan, I., Obayya, M., Negm, N., & Salama, A. S. (2022) · Applied Sciences · doi:10.3390/app12115645 · Cited by 174
Virtual-Reality Interpromotion Technology for Metaverse: A Survey
Wu, D., Yang, Z., Zhang, P., Wang, R., Yang, B., & Ma, X. (2023) · IEEE Internet of Things Journal · doi:10.1109/jiot.2023.3265848 · Cited by 169
Non-Structured DNN Weight Pruning—Is It Beneficial in Any Platform?
Ma, X., Lin, S., Ye, S., He, Z., Zhang, L., Yuan, G., Tan, S. H., Li, Z., Fan, D., Qian, X., et al. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3063265 · Cited by 167
Holistic CNN Compression via Low-Rank Decomposition with Knowledge Transfer
Lin, S., Ji, R., Chen, C., Tao, D., & Luo, J. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2873305 · Cited by 164
Using a Deep Neural Network and Transfer Learning to Bridge Scales for Seismic Phase Picking
Chai, C., Maceira, M., Santos-Villalobos, H., Venkatakrishnan, S. V., Schoenball, M., Zhu, W., Beroza, G. C., Thurber, C. H., & EGS Collab Team (2020) · Geophysical Research Letters · doi:10.1029/2020gl088651 · Cited by 160
Deep Learning on Mobile and Embedded Devices: State-of-the-art, Challenges, and Future Directions
Chen, Y., Zheng, B., Zhang, Z., Wang, Q., Shen, C., & Zhang, Q. (2021) · ACM Computing Surveys · doi:10.1145/3398209 · Cited by 159 · cited 2×
“Model deployment on edge devices [67, 71, 72] Balances model complexity and deployment feasibility on devices with limited resources.”
Ni, Q., Ji, J., Feng, K., Zhang, Y., Lin, D., & Zheng, J. (2023) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2023.109753 · Cited by 157
Compressing Convolutional Neural Networks in the Frequency Domain
Chen, W., Wilson, J. T., Tyree, S., Weinberger, K. Q., & Chen, Y. (2016) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2939672.2939839 · Cited by 156
Zhao, L., Bi, Z., Hawbani, A., Yu, K., Zhang, Y., & Guizani, M. (2022) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2022.3179254 · Cited by 146
Alzubaidi, L., Al-Shamma, O., Fadhel, M. A., Farhan, L., Zhang, J., & Duan, Y. (2020) · Electronics · doi:10.3390/electronics9030445 · Cited by 143
Towards Efficient Tensor Decomposition-Based DNN Model Compression with Optimization Framework
Yin, M., Sui, Y., Liao, S., & Yuan, B. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01053 · Cited by 126
Low Rank Regularization: A review
Hu, Z., Nie, F., Wang, R., & Li, X. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.09.021 · Cited by 116
Prakash, P., Ding, J., Chen, R., Qin, X., Shu, M., Cui, Q., Guo, Y., & Pan, M. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3145865 · Cited by 112
A Survey on BERT and Its Applications
Aftan, S., & Shah, H. (2023) · Learning and Technology Conference (L&T) · doi:10.1109/lt58159.2023.10092289 · Cited by 112
Model Order Reduction a Key Technology for Digital Twins
Hartmann, D., Herz, M., & Wever, U. (2018) · Springer eBooks · doi:10.1007/978-3-319-75319-5_8 · Cited by 107
Ji, M., Peng, G., Li, S., Cheng, F., Chen, Z., Li, Z., & Du, H. (2022) · Applied Soft Computing · doi:10.1016/j.asoc.2022.109331 · Cited by 102
A comprehensive deep learning benchmark for IoT IDS
Ahmad, R., Alsmadi, I. M., Al-Hamdani, W. A., & Tawalbeh, L. (2021) · Computers & Security · doi:10.1016/j.cose.2021.102588 · Cited by 100
A Survey on Deep-Learning-Based Real-Time SAR Ship Detection
Li, J., Chen, J., Cheng, P., Yu, Z., Yu, L., & Chi, C. (2023) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2023.3244616 · Cited by 98
Nordal, H., & El‐Thalji, I. (2020) · Systems Engineering · doi:10.1002/sys.21565 · Cited by 93
OPQ: Compressing Deep Neural Networks with One-shot Pruning-Quantization
Hu, P., Peng, X., Zhu, H., Aly, M. M. S., & Lin, J. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i9.16950 · Cited by 93
A Predictive Maintenance Model for Flexible Manufacturing in the Context of Industry 4.0
Sang, G. M., Xu, L., & de Vrieze, P. T. (2021) · Frontiers in Big Data · doi:10.3389/fdata.2021.663466 · Cited by 87
Digital Twin-Driven Intelligent Task Offloading for Collaborative Mobile Edge Computing
Zhang, Y., Hu, J. W., & Min, G. (2023) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2023.3310058 · Cited by 86
PQK: Model Compression via Pruning, Quantization, and Knowledge Distillation
Kim, J., Chang, S., & Kwak, N. (2021) · Interspeech 2021 · doi:10.21437/interspeech.2021-248 · Cited by 85 · cited 3×
“For instance, while pruning and quantization effectively reduce model size and accelerate inference times, they may introduce artifacts or errors that could degrade model performance [19, 59, 116].”
Libano, F., Wilson, B., Wirthlin, M., Rech, P., & Brunhaver, J. S. (2020) · IEEE Transactions on Nuclear Science · doi:10.1109/tns.2020.2983662 · Cited by 82
Eager pruning: algorithm and architecture support for fast training of deep neural networks
Zhang, J., Chen, X., Song, M., & Li, T. (2019) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1145/3307650.3322263 · Cited by 80
Adaptive Supply Chain: Demand–Supply Synchronization Using Deep Reinforcement Learning
Kegenbekov, Z., & Jackson, I. (2021) · Algorithms · doi:10.3390/a14080240 · Cited by 78
VecQ: Minimal Loss DNN Model Compression With Vectorized Weight Quantization
Gong, C., Chen, Y., Lu, Y., Li, T., Hao, C., & Chen, D. (2020) · IEEE Transactions on Computers · doi:10.1109/tc.2020.2995593 · Cited by 76
Benchmarking in classification and regression
Frank Hoffmann, B., Bertram, T., Mikut, R., Reischl, M., & Nelles, O. (2019) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1318 · Cited by 74
Automatic Searching and Pruning of Deep Neural Networks for Medical Imaging Diagnostic
Fernandes, F. E., & Yen, G. G. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3027308 · Cited by 73
Predictive Maintenance for Smart Industrial Systems: A Roadmap
Hafsi, M., Nora, H., & Ouchani, S. (2023) · Procedia Computer Science · doi:10.1016/j.procs.2023.03.082 · Cited by 71
Quantization Backdoors to Deep Learning Commercial Frameworks
Ma, H., Qiu, H., Gao, Y., Zhang, Z., Abuadbba, A., Xue, M., Fu, A., Zhang, J., Al-Sarawi, S. F., & Abbott, D. (2023) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2023.3271956 · Cited by 71
Predictive Maintenance in IoT Devices using Time Series Analysis and Deep Learning
Raparthi, E. A. M. (2023) · Dandao Xuebao/Journal of Ballistics · doi:10.52783/dxjb.v35.113 · Cited by 71
Filter Distillation for Network Compression
Suau, X., Zappella, L., & Apostoloff, N. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093546 · Cited by 70
Automated Pruning for Deep Neural Network Compression
Manessi, F., Rozza, A., Bianco, S., Napoletano, P., & Schettini, R. (2018) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2018.8546129 · Cited by 67
A survey of model compression strategies for object detection
Lyu, Z., Yu, T., Pan, F., Zhang, Y., Luo, J., Zhang, D., Chen, Y., Zhang, B., & Li, G. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-17192-x · Cited by 65
A Generic Network Compression Framework for Sequential Recommender Systems
Sun, Y., Yuan, F., Yang, M., Wei, G., Zhao, Z., & Liu, D. (2020) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3397271.3401125 · Cited by 64
A survey of self‐healing systems frameworks
Schneider, C., Barker, A., & Dobson, S. (2014) · Software Practice and Experience · doi:10.1002/spe.2250 · Cited by 62
Iunusova, E., Gonzalez, M. K., Szipka, K., & Archenti, A. (2023) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-023-02151-y · Cited by 62
Meng, J., Yang, L., Peng, X., Yu, S., Fan, D., & Seo, J.-S. (2021) · IEEE Transactions on Circuits & Systems II Express Briefs · doi:10.1109/tcsii.2021.3069011 · Cited by 58
Physics-Informed Supervised Residual Learning for Electromagnetic Modeling
Shan, T., Zeng, J., Song, X., Guo, R., Li, M., Yang, F., & Xu, S. (2023) · IEEE Transactions on Antennas and Propagation · doi:10.1109/tap.2023.3245281 · Cited by 58
Network Pruning for Remote Sensing Images Classification Based on Interpretable CNNs
Guo, X., Hou, B., Ren, B., Ren, Z., & Jiao, L. (2021) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3077062 · Cited by 55
Beyond Preserved Accuracy: Evaluating Loyalty and Robustness of BERT Compression
Xu, C., Zhou, W., Ge, T., Xu, K., McAuley, J., & Wei, F. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.832 · Cited by 53
AD-KD: Attribution-Driven Knowledge Distillation for Language Model Compression
Wu, S., Chen, H., Quan, X., Wang, Q., & Wang, R. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.471 · Cited by 53
From model to FPGA: Software-hardware co-design for efficient neural network acceleration
Guo, K., Sui, L., Qiu, J., Yao, S., Han, S., Wang, Y., & Yang, H. (2016) · IEEE Hot Chips Symposium · doi:10.1109/hotchips.2016.7936208 · Cited by 52
Memory- and Communication-Aware Model Compression for Distributed Deep Learning Inference on IoT
Bhardwaj, K., Lin, C., Sartor, A. L., & Mărculescu, R. (2019) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3358205 · Cited by 52
Matrix Factorization in Recommender Systems: Algorithms, Applications, and Peculiar Challenges
Isinkaye, F. O. (2021) · IETE Journal of Research · doi:10.1080/03772063.2021.1997357 · Cited by 48
Ai, C., Yang, H., Ding, Y., Tang, J., & Guo, F. (2023) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2023.3274587 · Cited by 48
Real-Time Encrypted Traffic Classification via Lightweight Neural Networks
Cheng, J., He, R., Yuepeng, E., Wu, Y., You, J., & Li, T. (2020) · Globecom · doi:10.1109/globecom42002.2020.9322309 · Cited by 47
Jin, H., Wu, D., Zhang, S., Zou, X., Jin, S., Tao, D., Liao, Q., & Xia, W. (2023) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2022.3230840 · Cited by 45
WFA-GPU: gap-affine pairwise read-alignment using GPUs
Aguado-Puig, Q., Doblas, M., Matzoros, C., Espinosa, A., Moure, J. C., Marco‐Sola, S., & Moretó, M. (2023) · Bioinformatics · doi:10.1093/bioinformatics/btad701 · Cited by 44
Structural Watermarking to Deep Neural Networks via Network Channel Pruning
Zhao, X., Yao, Y., Wu, H., & Zhang, X. (2021) · IEEE International Workshop on Information Forensics and Security · doi:10.1109/wifs53200.2021.9648376 · Cited by 41
Deep Neural Network Self-Distillation Exploiting Data Representation Invariance
Xu, T.-B., & Liu, C. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3027634 · Cited by 40
Wang, Z., Du, L., & Li, Y. (2021) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2021.3104267 · Cited by 39
Improving the accuracy of pruned network using knowledge distillation
Prakosa, S. W., Leu, J., & Chen, Z.-H. (2020) · Pattern Analysis and Applications · doi:10.1007/s10044-020-00940-2 · Cited by 38
Pruning by Training: A Novel Deep Neural Network Compression Framework for Image Processing
Tian, G., Chen, J., Zeng, X., & Liu, Y. (2021) · IEEE Signal Processing Letters · doi:10.1109/lsp.2021.3054315 · Cited by 38
A Hardware-Friendly High-Precision CNN Pruning Method and Its FPGA Implementation
Sui, X., Lv, Q., Zhi, L., Zhu, B., Yang, Y., Zhang, Y., & Tan, Z. (2023) · Sensors · doi:10.3390/s23020824 · Cited by 37
Deep neural networks optimization for resource-constrained environments: techniques and models
Careem, R., Johar, M. G. M., & Khatibi, A. (2024) · Indonesian Journal of Electrical Engineering and Computer Science · doi:10.11591/ijeecs.v33.i3.pp1843-1854 · Cited by 36
Yang, J., Wang, Y., Zhao, H., & Gui, G. (2022) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2022.3184994 · Cited by 35
Ishaque, S., Khan, N., & Krishnan, S. (2022) · Machine Learning with Applications · doi:10.1016/j.mlwa.2022.100395 · Cited by 35
Feng, T., & Narayanan, S. (2023) · 2023 11th International Conference on Affective Computing and Intelligent Interaction (ACII) · doi:10.1109/acii59096.2023.10388152 · Cited by 34 · cited 2×
“…[3, 5, 6, 16, 18, 28, 31, 32, 34, 41, 46–48,50,51,53,54,61,68,73,76, 77,79,80,87,88,103,113,115–118,126,130,132,133,135,136, 138,146,147,160,161,168,175,175,177–179,182,183,185,186, 188,193,194,197–201,204,207,210,211,214–216,223–227,229,…”
Abbas, Q., Daadaa, Y., Rashid, U., & Ibrahim, M. E. A. (2023) · Diagnostics · doi:10.3390/diagnostics13152531 · Cited by 32
Near-Sensor Distributed DNN Processing for Augmented and Virtual Reality
Pinkham, R., Berkovich, A., & Zhang, Z. (2021) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2021.3121259 · Cited by 31
Leaf Classification for Plant Recognition Using EfficientNet Architecture
Arun, Y., & Viknesh, G. S. (2022) · doi:10.1109/icaecc54045.2022.9716637 · Cited by 31
Short-term wave forecasts using gated recurrent unit model
Yevnin, Y., Chorev, S., Dukan, I., & Toledo, Y. (2022) · Ocean Engineering · doi:10.1016/j.oceaneng.2022.113389 · Cited by 31
Pruning Depthwise Separable Convolutions for MobileNet Compression
Tu, C.-H., Lee, J.-H., Chan, Y.-M., & Chen, C.-S. (2020) · IEEE International Joint Conference on Neural Network · doi:10.1109/ijcnn48605.2020.9207259 · Cited by 30
Chen, X., Zhu, J., Jiang, J., & Tsui, C.-Y. (2022) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2022.3178047 · Cited by 30
SAGE: A Split-Architecture Methodology for Efficient End-to-End Autonomous Vehicle Control
Malawade, A. V., Odema, M., Lajeunesse-degroot, S., & Faruque, M. A. A. (2021) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3477006 · Cited by 30
Learning and Compressing: Low-Rank Matrix Factorization for Deep Neural Network Compression
Cai, G., Li, J., Liu, X., Chen, Z., & Zhang, H. (2023) · Applied Sciences · doi:10.3390/app13042704 · Cited by 29
Impact of image compression on deep learning-based mammogram classification
Jo, Y., Choi, Y. S., Park, H. W., Lee, J. H., Jung, H., Hyo-Eun, K., Ko, K., Lee, C. W., Cha, H. S., & Hwangbo, Y. (2021) · Scientific Reports · doi:10.1038/s41598-021-86726-w · Cited by 28
Thinning of convolutional neural network with mixed pruning
Yang, W., Lilei, J., Wang, S., Cu, Z., Chen, X., & Chen, L. (2019) · IET Image Processing · doi:10.1049/iet-ipr.2018.6191 · Cited by 27
On the Automatic Exploration of Weight Sharing for Deep Neural Network Compression
Dupuis, E., Novo, D., O’Connor, I., & Bosio, A. (2020) · Design, Automation, and Test in Europe · doi:10.23919/date48585.2020.9116350 · Cited by 27
DNN Model Compression for IoT Domain-Specific Hardware Accelerators
Russo, E., Palesi, M., Monteleone, S., Patti, D., Mineo, A., Ascia, G., & Catania, V. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3111723 · Cited by 27
Efficient evolutionary neural architecture search by modular inheritable crossover
He, C., Tan, H., Huang, S.-H., & Cheng, R. (2021) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2021.100894 · Cited by 26
Neural Pruning Search for Real-Time Object Detection of Autonomous Vehicles
Zhao, P., Yuan, G., Cai, Y., Niu, W., Liu, Q., Wen, W., Ren, B., Wang, Y., & Lin, X. (2021) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac18074.2021.9586163 · Cited by 26
ROSITA: Refined BERT cOmpreSsion with InTegrAted techniques
Liu, Y., Lin, Z., & Yuan, F. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i10.17056 · Cited by 25
Lioutas, V., Rashid, A., Kumar, K., Haidar, M. A., & Rezagholizadeh, M. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.250 · Cited by 24
Cloud–Edge Collaborative Inference with Network Pruning
Li, M., Zhang, X., Guo, J., & Li, F. (2023) · Electronics · doi:10.3390/electronics12173598 · Cited by 24
MetaLR: Meta-tuning of Learning Rates for Transfer Learning in Medical Imaging
Chen, Y., Liu, L., Li, J., Jiang, H., Ding, C. H. Q., & Zhou, Z. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-43907-0_67 · Cited by 23
Sensitivity Analysis and Compression Opportunities in DNNs Using Weight Sharing
Dupuis, E., Novo, D., O’Connor, I., & Bosio, A. (2020) · IEEE International Symposium on Design and Diagnostics of Electronic Circuits & Systems (DDECS) · doi:10.1109/ddecs50862.2020.9095658 · Cited by 22
Unsupervised Network Quantization via Fixed-Point Factorization
Wang, P., He, X., Chen, Q., Cheng, A., Liu, Q., & Cheng, J. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3007749 · Cited by 22
Xu, Q. Y., Wu, M., Li, X., Mao, K., & Chen, Z. (2023) · IEEE Transactions on Industrial Cyber-Physical Systems · doi:10.1109/ticps.2023.3320630 · Cited by 22
Enhanced Transfer Learning for Autonomous Driving with Systematic Accident Simulation
Akhauri, S., Zheng, L., & Lin, M. C. (2020) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341538 · Cited by 21
Machine Learning Robustness, Fairness, and their Convergence
Lee, J.-G., Roh, Y., Song, H., & Whang, S. E. (2021) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3447548.3470799 · Cited by 21
Shfl-BW: accelerating deep neural network inference with tensor-core aware weight pruning
Huang, G., Li, H., Qin, M., Sun, F., Ding, Y., & Xie, Y. (2022) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/3489517.3530588 · Cited by 21
Zhou, H., Liu, A., Cui, H., et al. (2023) · IEEE Sensors Letters · doi:10.1109/lsens.2023.3239343 · Cited by 19
Summary of Convolutional Neural Network Compression Technology
Zhang, Y., Ding, W., & Liu, C. (2019) · IEEE International Conference on Unmanned Systems (ICUS) · doi:10.1109/icus48101.2019.8995969 · Cited by 18
Li, Y., Hu, F. Y., Liu, Y., Ryan, M. J., & Wang, R. (2023) · International Journal of Production Research · doi:10.1080/00207543.2022.2160501 · Cited by 17
Energy-Aware Task Scheduling for Digital Twin Edge Networks in 6G
Bozkaya, E., Bilen, T., Erel-Özçevik, M., & Özçevik, Y. (2023) · International Conference on Smart Applications, Communications and Networking (SmartNets) · doi:10.1109/smartnets58706.2023.10215892 · Cited by 17
Demidovskij, A. V., & Smirnov, E. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207281 · Cited by 16
Communication-Efficient Federated Learning for Connected Vehicles with Constrained Resources
Shen, S., Yu, C., Zhang, K., Chen, X., Chen, H., & Ci, S. (2021) · International Wireless Communications and Mobile Computing Conference (IWCMC) · doi:10.1109/iwcmc51323.2021.9498677 · Cited by 16
Feasibility Analysis of Machine Learning Optimization on GPU-based Low-cost Edges
Suo, J., Zhang, X., Zhang, S., Zhou, W., & Shi, W. (2021) · IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI) · doi:10.1109/swc50871.2021.00022 · Cited by 16
ISOP+: Machine Learning-Assisted Inverse Stack-Up Optimization for Advanced Package Design
Chae, H., Zhu, K., Mutnury, B., et al. (2023) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2023.3305934 · Cited by 16
Denseflex: A Low Rank Factorization Methodology for Adaptable Dense Layers in DNNs
Kokhazadeh, M., Κεραμίδας, Γ., Kelefouras, V. I., & Stamoulis, I. (2024) · ACM International Conference on Computing Frontiers (CF) · doi:10.1145/3649153.3649183 · Cited by 16
Compression of Deep Neural Networks by Combining Pruning and Low Rank Decomposition
Goyal, S., Choudhury, A. R., & Sharma, V. K. (2019) · IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum · doi:10.1109/ipdpsw.2019.00162 · Cited by 15
Memorization Capacity of Deep Neural Networks under Parameter Quantization
Boo, Y., Shin, S., & Sung, W. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682462 · Cited by 15
Learning to Co-Generate Object Proposals with a Deep Structured Network
Hayder, Z., He, X., & Salzmann, M. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.281 · Cited by 14
Shang, F., Lai, J., Chen, J., Xia, W., & Liu, H. (2021) · International Conference on Cloud Computing and Big Data Analytics (ICCCBDA) · doi:10.1109/icccbda51879.2021.9442600 · Cited by 14
SQuAT: Sharpness- and Quantization-Aware Training for BERTPreprint
Wang, Z., Li, J. B., Qu, S., Metze, F., & Strubell, E. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2210.07171 · Cited by 14
Quantum Computing and Quantum Machine Learning Classification – A Survey
Kuppusamy, P., Kumar, N. Y., Dontireddy, J., & Iwendi, C. (2022) · IEEE International Conference on Cybernetics, Cognition and Machine Learning Applications (ICCCMLA) · doi:10.1109/icccmla56841.2022.9989137 · Cited by 14
HiCD: Change Detection in Quality-Varied Images via Hierarchical Correlation Distillation
Pang, C., Weng, X., Wu, J., Wang, Q., & Xia, G.-S. (2024) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2024.3367778 · Cited by 14
A Transfer Learning method for Brain Tumor Classification using EfficientNet-B3 model
Mantha, T., & Reddy, B. E. (2021) · International Conference on Computation System and Information Technology for Sustainable Solutions (CSITSS) · doi:10.1109/csitss54238.2021.9683036 · Cited by 13
Quantum Machine Learning and Quantum Communication Networks: The 2030s and the Future
Jain, S., Gandhi, A., Singla, S., Garg, L., & Mehla, S. (2022) · International Conference on Computational Modelling, Simulation and Optimization (ICCMSO) · doi:10.1109/iccmso58359.2022.00025 · Cited by 13
Image Classification by Transfer Learning using Pre-Trained CNN Models
Dewan, J. H., Das, R. K. K., Thepade, S. D., et al. (2023) · International Conference on Recent Advances in Electrical, Electronics, Ubiquitous Communication, and Computational Intelligence (RAEEUCCI) · doi:10.1109/raeeucci57140.2023.10134069 · Cited by 13
Algorithms and Applications to Weighted Rank-one Binary Matrix Factorization
Lu, H., Chen, X., Shi, J., Vaidya, J. S., Atluri, V., Hong, Y., & Huang, W. X. (2020) · ACM Transactions on Management Information Systems · doi:10.1145/3386599 · Cited by 12
An Efficient Method for Model Pruning Using Knowledge Distillation with Few Samples
Zhou, Z., Zhou, Y., Jiang, Z., Men, A., & Wang, H. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746024 · Cited by 12
Ding, Y., & Chen, D. (2023) · Mathematics · doi:10.3390/math11153311 · Cited by 12
Optimizing the IoT Performance: A Case Study on Pruning a Distributed CNN
Saqib, E., Leal, I. S., Shallari, I., Jantsch, A., Krug, S., & O’Nils, M. (2023) · IEEE Sensors Applications Symposium (SAS) · doi:10.1109/sas58821.2023.10254054 · Cited by 12
Resource-Constrained Multisource Instance-Based Transfer Learning
Askarizadeh, M., Morsali, A., & Nguyen, K. K. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3327248 · Cited by 12
Exploring Gradient Flow Based Saliency for DNN Model Compression
Liu, X., Li, B., Chen, Z., & Yuan, Y. (2021) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3474085.3475474 · Cited by 11
Dependent Scalar Quantization For Neural Network Compression
Haase, P., Schwarz, H., Kirchhoffer, H., Wiedemann, S. M., Marinč, T., Marbán, A., Müller, K., Samek, W., Marpe, D., & Wiegand, T. (2020) · Proceedings - International Conference on Image Processing · doi:10.1109/icip40778.2020.9190955 · Cited by 10
A survey on GAN acceleration using memory compression techniques
Tantawy, D., Zahran, M., & Wassal, A. G. (2021) · Journal of Engineering and Applied Science · doi:10.1186/s44147-021-00045-5 · Cited by 10
Model Compression for Data Compression: Neural Network Based Lossless Compressor Made Practical
Qin, L., & Sun, J. (2023) · DCC · doi:10.1109/dcc55655.2023.00013 · Cited by 10
Emerging VLSI Technologies for High performance AI and ML Applications
Nagar, P., Boruah, S., Bhoi, A. K., Patel, A., Sarda, J. S., & Darji, P. G. (2024) · International Conference on Advancements in Smart, Secure and Intelligent Computing (ASSIC) · doi:10.1109/assic60049.2024.10507954 · Cited by 10
MnasNet Based Lightweight CNN for Facial Expression Recognition
Aghera, S., Gajera, H., & Mitra, S. K. (2020) · IEEE International Symposium on Sustainable Energy, Signal Processing and Cyber Security (iSSSC) · doi:10.1109/isssc50941.2020.9358903 · Cited by 9
Super-Resolution Model Quantized in Multi-Precision
Liu, J., Wang, Q., Zhang, D., & Shen, L. (2021) · Electronics · doi:10.3390/electronics10172176 · Cited by 9
A Novel Deep-Learning Model Compression Based on Filter-Stripe Group Pruning and Its IoT Application
Zhao, M., Tong, X., Wu, W., Wang, Z., Zhou, B., & Huang, X. (2022) · Sensors · doi:10.3390/s22155623 · Cited by 9
Cited by
Alahmari, S., & Alghamdi, I. (2025) · Results in Engineering · doi:10.1016/j.rineng.2025.107849 · Cited by 21
Metadata
- Authors
- Dantas, P. V., Sabino da Silva, W., Cordeiro, L. C., & Carvalho, C. B.
- Venue
- Applied Intelligence
- Published
- 2024-09-02
- Volume
- 54
- Issue
- 22
- Pages
- 11804-11844
- ISSN
- 0924-669X (ISSN-L)
- 1573-7497
- OpenAlex
- W4402137675
- Cited by
- 261
- References
- 243
- FWCI
- 36.87
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.