Compressing Neural Networks with the Hashing Trick

ImageNet classification with deep convolutional neural networks

Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · see citing works

Untitled work

(2014) · Cited by 33,419 · see citing works

Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation

Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684 · see citing works

Distributed Representations of Words and Phrases and their Compositionality

Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533 · see citing works

Neural networks for pattern recognition

Bishop, C. (1994) · Choice Reviews Online · doi:10.5860/choice.31-5500 · Cited by 18,537 · see citing works

Visualizing and understanding convolutional networks

Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839 · see citing works

Distilling the Knowledge in a Neural Network

Hinton, G., Vinyals, O., & Dean, J. (2015) · arXiv · doi:10.48550/arxiv.1503.02531 · Cited by 14,204 · see citing works

Untitled work

(2010) · International Conference on Machine Learning · Cited by 13,995 · see citing works

Term-Weighting Approaches in Automatic Text Retrieval

Salton, G., & Buckley, C. (1988) · Information Processing & Management · doi:10.1016/0306-4573(88)90021-0 · Cited by 11,421 · see citing works

Deep neural networks for acoustic modeling in speech recognition: the shared views of four research groups

Hinton, G., Deng, L., Yu, D., Dahl, G., Mohamed, A.-R., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T., et al. (2012) · IEEE Signal Processing Magazine · doi:10.1109/msp.2012.2205597 · Cited by 10,260 · see citing works

Speech recognition with deep recurrent neural networks

Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893 · see citing works

Untitled work

(2011) · Cited by 6,993 · see citing works

Practical Bayesian Optimization of Machine Learning Algorithms

Snoek, J., Larochelle, H., & Adams, R. P. (2012) · arXiv · doi:10.48550/arxiv.1206.2944 · Cited by 6,691 · see citing works

Show and tell: A neural image caption generator

Vinyals, O., Toshev, A., Bengio, S., & Erhan, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298935 · Cited by 6,318 · see citing works

Deep visual-semantic alignments for generating image descriptions

Karpathy, A., & Fei-Fei, L. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298932 · Cited by 4,902 · see citing works

CNN Features Off-the-Shelf: An Astounding Baseline for Recognition

Razavian, A. S., Azizpour, H., Sullivan, J., & Carlsson, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.131 · Cited by 4,451 · see citing works

DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition

Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., & Darrell, T. (2013) · arXiv · doi:10.48550/arxiv.1310.1531 · Cited by 4,019 · see citing works

Untitled work

(1989) · Cited by 3,214 · see citing works

Best practices for convolutional neural networks applied to visual document analysis

Simard, P., Steinkraus, D., & Platt, J. C. (2005) · Proceedings of the International Conference on Document Analysis and Recognition · doi:10.1109/icdar.2003.1227801 · Cited by 2,805 · see citing works

An analysis of single-layer networks in unsupervised feature learning

Coates, A., Ng, A. Y., & Lee, H. (2011) · Cited by 2,760 · see citing works

Model compression

Buciluǎ, C., Caruana, R., & Niculescu-Mizil, A. (2006) · Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1150402.1150464 · Cited by 2,068 · see citing works

Building high-level features using large scale unsupervised learning

Le, Q. V. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639343 · Cited by 1,695 · see citing works

Do Deep Nets Really Need to be Deep?Preprint

Ba, J. L., & Caruana, R. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1312.6184 · Cited by 1,592 · see citing works

Domain Adaptation for Large-Scale Sentiment Classification: A Deep Learning Approach

Glorot, X., Bordes, A., & Bengio, Y. (2011) · Cited by 1,569 · see citing works

Exploiting Linear Structure Within Convolutional Networks for Efficient Evaluation

Denton, R., Zaremba, W., Bruna, J., LeCun, Y., & Fergus, R. (2014) · arXiv · doi:10.48550/arxiv.1404.0736 · Cited by 1,414 · see citing works

Efficient BackProp

LeCun, Y., Bottou, L., Orr, G., & Müller, K. (1998) · neural information processing systems · Cited by 1,333 · see citing works

Torch7: A Matlab-like Environment for Machine Learning

Collobert, R., Kavukcuoglu, K., & Farabet, C. (2011) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 1,241 · see citing works

An empirical evaluation of deep architectures on problems with many factors of variation

Larochelle, H., Erhan, D., Courville, A. C., Bergstra, J., & Bengio, Y. (2007) · International Conference on Machine Learning · doi:10.1145/1273496.1273556 · Cited by 1,024 · see citing works

Generalization of back-propagation to recurrent neural networks

Pineda, F. J. (1987) · Physical Review Letters · doi:10.1103/physrevlett.59.2229 · Cited by 931 · see citing works

Feature hashing for large scale multitask learning

Weinberger, K. Q., Dasgupta, A., Langford, J. C., Smola, A. J., & Attenberg, J. (2009) · International Conference on Machine Learning · doi:10.1145/1553374.1553516 · Cited by 928 · see citing works

Stochastic Pooling for Regularization of Deep Convolutional Neural NetworksPreprint

Zeiler, M. D., & Fergus, R. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.3557 · Cited by 782 · see citing works

Sparse Feature Learning for Deep Belief Networks

Ranzato, M., Boureau, Y.-L., & LeCun, Y. (2007) · neural information processing systems · Cited by 752 · see citing works

Deep Learning with Limited Numerical Precision

Gupta, S., Agrawal, A., Gopalakrishnan, K., & Narayanan, P. (2015) · Cited by 707 · see citing works

Untitled work

(2013) · Cited by 651 · see citing works

Simplifying Neural Networks by Soft Weight-Sharing

Nowlan, S. J., & Hinton, G. E. (1992) · Neural Computation · doi:10.1162/neco.1992.4.4.473 · Cited by 595 · see citing works

Predicting Parameters in Deep Learning

Shakibi, B. (2014) · University of British Columbia · doi:10.14288/1.0165555 · Cited by 462 · see citing works

Augmented smartphone applications through clone cloud execution

Chun, B.-G., & Maniatis, P. (2009) · Cited by 422 · see citing works

Bayesian Optimization with Inequality Constraints

Gardner, J. R., Kusner, M. J., Zhixiang, Weinberger, K. Q., & Cunningham, J. P. (2014) · PolyPublie (École Polytechnique de Montréal) · Cited by 356 · see citing works

Deep Belief Networks using discriminative features for phone recognition

Mohamed, A., Sainath, T. N., Dahl, G. E., Ramabhadran, B., Hinton, G. E., & Picheny, M. (2011) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2011.5947494 · Cited by 290 · see citing works

A Reliable Effective Terascale Linear Learning SystemPreprint

Agarwal, A., Chapelle, O., Dudı́k, M., & Langford, J. C. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1110.4198 · Cited by 280 · see citing works

High-Performance Neural Networks for Visual Object ClassificationPreprint

Ciresan, D. C., Meier, U., Masci, J., Gambardella, L. M., & Schmidhuber, J. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1102.0183 · Cited by 268 · see citing works

Hash Kernels for Structured Data

Shi, Q., PettersonJames, Dror, G., Langford, J. C., & Smola, A. J. (2009) · ANU Open Research (Australian National University) · doi:10.5555/1577069.1755873 · Cited by 207 · see citing works

Do Deep Nets Really Need to be DeepPreprint

Ba, L. J., & Caruana, R. (2013) · arXiv (Cornell University) · Cited by 140 · see citing works

Low precision storage for deep learningPreprint

Courbariaux, M., Bengio, Y., & David, J. (2014) · arXiv (Cornell University) · Cited by 120 · see citing works

Marginalized Denoising Auto-encoders for Nonlinear Representations

Chen, M., Weinberger, K. Q., Sha, F., & Bengio, Y. (2014) · Cited by 113 · see citing works

Low precision arithmetic for deep learningPreprint

Courbariaux, M., Bengio, Y., & David, J. (2014) · arXiv (Cornell University) · Cited by 84 · see citing works

Small Statistical Models by Random Feature Mixing

Ganchev, K., & Dredze, M. H. (2008) · Cited by 62 · see citing works

Learning Ordered Representations with Nested DropoutPreprint

Rippel, O., Gelbart, M. A., & Adams, R. P. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1402.0915 · Cited by 55 · see citing works

Speech Recognition for Mobile Devices at Google

Schuster, M. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15246-7_3 · Cited by 53 · see citing works

Fast flux discriminant for large-scale sparse nonlinear classification

Chen, W., Chen, Y., & Weinberger, K. Q. (2014) · Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2623330.2623627 · Cited by 12 · see citing works

Compressed Support Vector MachinesPreprint

Xu, Z., Gardner, J. R., Tyree, S., & Weinberger, K. Q. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1501.06478 · Cited by 7 · see citing works

Rethinking the Inception Architecture for Computer Vision

Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138 · see citing works

MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications

Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017) · arXiv · doi:10.48550/arxiv.1704.04861 · Cited by 19,015 · see citing works

Recent advances in convolutional neural networks

Gu, J., Wang, Z., Kuen, J., Ma, L., Shahroudy, A., Shuai, B., Liu, T., Wang, X., Wang, G., Cai, J., et al. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.10.013 · Cited by 6,576 · see citing works

Dropout as a bayesian approximation: Representing model uncertainty in deep learning

Gal, Y., & Ghahramani, Z. (2015) · arXiv · doi:10.48550/arxiv.1506.02142 · Cited by 6,471 · see citing works

Efficient Processing of Deep Neural Networks: A Tutorial and Survey

Sze, V., Chen, Y.-H., Yang, T.-J., & Emer, J. S. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2761740 · Cited by 4,215 · see citing works

Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference

Jacob, B., Kligys, S., Chen, B., Zhu, M., Tang, M., Howard, A., Adam, H., & Kalenichenko, D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00286 · Cited by 4,114 · see citing works

Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding

Han, S., Mao, H., & Dally, W. J. (2015) · arXiv · doi:10.48550/arxiv.1510.00149 · Cited by 4,662 · see citing works

Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review

Rawat, W., & Wang, Z. (2017) · Neural Computation · doi:10.1162/neco_a_00990 · Cited by 3,503 · see citing works

Learning Efficient Convolutional Networks through Network Slimming

Liu, Z., Li, J., Shen, Z., Huang, G., Yan, S., & Zhang, C. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.298 · Cited by 2,761 · see citing works

Opportunities and obstacles for deep learning in biology and medicine

Ching, T., Himmelstein, D. S., Beaulieu-Jones, B. K., Kalinin, A. A., Do, B. T., Way, G. P., Ferrero, E., Agapow, P.-M., Zietz, M., Hoffman, M. M., et al. (2018) · Journal of The Royal Society Interface · doi:10.1098/rsif.2017.0387 · Cited by 2,310 · see citing works

ThiNet: A Filter Level Pruning Method for Deep Neural Network Compression

Luo, J.-H., Wu, J., & Lin, W. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.541 · Cited by 1,889 · see citing works

Quantized Neural Networks: Training Neural Networks with Low Precision Weights and ActivationsPreprint

Hubara, I., Courbariaux, M., Soudry, D., El-Yaniv, R., & Bengio, Y. (2016) · Journal of machine learning research · doi:10.48550/arxiv.1609.07061 · Cited by 2,196 · see citing works

Convergence of Edge Computing and Deep Learning: A Comprehensive Survey

Wang, X., Han, Y., Leung, V. C. M., Niyato, D., Yan, X., & Chen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2970550 · Cited by 1,498 · see citing works

Learning both Weights and Connections for Efficient Neural Networks

Han, S., Pool, J., Tran, J., & Dally, W. J. (2015) · arXiv · doi:10.48550/arxiv.1506.02626 · Cited by 1,481 · see citing works

Deep Learning for IoT Big Data and Streaming Analytics: A Survey

Mohammadi, M., Al-Fuqaha, A., Sorour, S., & Guizani, M. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2844341 · Cited by 1,471 · see citing works

Quantized Convolutional Neural Networks for Mobile Devices

Wu, J., Leng, C., Wang, Y., Hu, Q., & Cheng, J. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.521 · Cited by 1,244 · see citing works

A survey on deep learning for big data

Zhang, Q., Yang, L. T., Chen, Z., & Li, P. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.10.006 · Cited by 1,226 · see citing works

ESPNet: Efficient Spatial Pyramid of Dilated Convolutions for Semantic Segmentation

Mehta, S., Rastegari, M., Caspi, A., Shapiro, L., & Hajishirzi, H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01249-6_34 · Cited by 1,029 · see citing works

Pruning and quantization for deep neural network acceleration: A survey

Liang, T., Glossner, J., Wang, L., Shi, S., & Zhang, X. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.07.045 · Cited by 969 · see citing works

HRank: Filter Pruning Using High-Rank Feature Map

Lin, M., Ji, R., Wang, Y., Zhang, Y., Zhang, B., Tian, Y., & Shao, L. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00160 · Cited by 918 · see citing works

CondenseNet: An Efficient DenseNet Using Learned Group Convolutions

Huang, G., Liu, S., Maaten, L. V. D., & Weinberger, K. Q. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00291 · Cited by 904 · see citing works

A Survey of Model Compression and Acceleration for Deep Neural Networks

Cheng, Y., Wang, D., Zhou, P., & Zhang, T. (2017) · arXiv · doi:10.48550/arxiv.1710.09282 · Cited by 857 · see citing works

One-Shot Learning for Semantic Segmentation

Shaban, A., Bansal, S., Liu, Z., Essa, I. A., & Boots, B. (2017) · British Machine Vision Conference (BMVC) · doi:10.5244/c.31.167 · Cited by 851 · see citing works

Sequence-Level Knowledge Distillation

Kim, Y., & Rush, A. M. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1139 · Cited by 836 · see citing works

NISP: Pruning Networks Using Neuron Importance Score Propagation

Yu, R., Li, A., Chen, C.-F., Lai, J.-H., Morariu, V. I., Han, X., Gao, M., Lin, C., & Davis, L. S. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00958 · Cited by 825 · see citing works

Model Compression and Acceleration for Deep Neural Networks: The Principles, Progress, and Challenges

Cheng, Y., Wang, D., Zhou, P., & Zhang, T. (2018) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2765695 · Cited by 817 · see citing works

Dynamic Network Surgery for Efficient DNNsPreprint

Guo, Y., Yao, A., & Chen, Y. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1608.04493 · Cited by 804 · see citing works

Beyond Transmitting Bits: Context, Semantics, and Task-Oriented Communications

Gündüz, D., Qin, Z., Aguerri, I. E., Dhillon, H. S., Yang, Z., Yener, A., Wong, K., & Chae, C. (2022) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2022.3223408 · Cited by 801 · see citing works

Compression of Deep Convolutional Neural Networks for Fast and Low Power Mobile ApplicationsPreprint

Kim, Y., Park, E., Yoo, S., Choi, T., Lu, Y., & Shin, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06530 · Cited by 736 · see citing works

LQ-Nets: Learned Quantization for Highly Accurate and Compact Deep Neural Networks

Zhang, D., Yang, J., Ye, D., & Hua, G. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01237-3_23 · Cited by 714 · see citing works

Fixed Point Quantization of Deep Convolutional Networks

Lin, D. D., Talathi, S. S., & Annapureddy, V. S. (2015) · arXiv · doi:10.48550/arxiv.1511.06393 · Cited by 684 · see citing works

Tensorizing Neural NetworksPreprint

Novikov, A., Podoprikhin, D., Osokin, A., & Vetrov, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1509.06569 · Cited by 656 · see citing works

Distributed Learning in Wireless Networks: Recent Progress and Future Challenges

Chen, M., Gündüz, D., Huang, K., Saad, W., Bennis, M., Feljan, A. V., & Poor, H. V. (2021) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2021.3118346 · Cited by 558 · see citing works

Learning to Hash for Indexing Big Data—A Survey

Wang, J., Liu, W., Kumar, S., & Chang, S. (2015) · Proceedings of the IEEE · doi:10.1109/jproc.2015.2487976 · Cited by 524 · see citing works

A comprehensive survey on model compression and acceleration

Choudhary, T., Mishra, V. K., Goswami, A., & Jagannathan, S. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-020-09816-7 · Cited by 519 · see citing works

Deep Learning with Low Precision by Half-Wave Gaussian Quantization

Cai, Z., He, X., Sun, J., & Vasconcelos, N. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.574 · Cited by 498 · see citing works

A Systematic DNN Weight Pruning Framework Using Alternating Direction Method of Multipliers

Zhang, T., Ye, S., Zhang, K., Tang, J., Wen, W., Fardad, M., & Wang, Y. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01237-3_12 · Cited by 483 · see citing works

Communication-efficient edge ai: algorithms and systems

Shi, Y., Yang, K., Jiang, T., Zhang, J., & Letaief, K. B. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.3007787 · Cited by 488 · see citing works

BlockDrop: Dynamic Inference Paths in Residual Networks

Wu, Z., Nagarajan, T., Kumar, A., Rennie, S., Davis, L. S., Grauman, K., & Feris, R. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00919 · Cited by 465 · see citing works

Can FPGAs Beat GPUs in Accelerating Next-Generation Deep Neural Networks?

Nurvitadhi, E., Venkatesh, G., Sim, J., Marr, D., Huang, R., Ong Gee Hock, J., Liew, Y. T., Srivatsan, K., Moss, D., Subhaschandra, S., et al. (2017) · Proceedings of the 2017 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays · doi:10.1145/3020078.3021740 · Cited by 467 · see citing works

Group sparse regularization for deep neural networks

Scardapane, S., Comminiello, D., Hussain, A., & Uncini, A. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.02.029 · Cited by 455 · see citing works

Lednet: A Lightweight Encoder-Decoder Network for Real-Time Semantic Segmentation

Wang, Y., Zhou, Q., Liu, J., Xiong, J., Gao, G., Wu, X., & Latecki, L. J. (2019) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2019.8803154 · Cited by 451 · see citing works

Quantization Networks

Yang, J., Shen, X., Xing, J., Tian, X., Li, H., Deng, B., Huang, J., & Hua, X. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00748 · Cited by 421 · see citing works

On Compressing Deep Models by Low Rank and Sparse Decomposition

Yu, X., Liu, T., Wang, X., & Tao, D. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.15 · Cited by 419 · see citing works

Efficient Acceleration of Deep Learning Inference on Resource-Constrained Edge Devices: A Review

Shuvo, M. M. H., Islam, S. K., Cheng, J., & Morshed, B. I. (2023) · Proceedings of the IEEE · doi:10.1109/jproc.2022.3226481 · Cited by 436 · see citing works

Learning from Multiple Teacher Networks

You, S., Xu, C., Xu, C., & Tao, D. (2017) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3097983.3098135 · Cited by 413 · see citing works

Fast ConvNets Using Group-Wise Brain Damage

Lebedev, V., & Lempitsky, V. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.280 · Cited by 397 · see citing works

Variational Convolutional Neural Network Pruning

Zhao, C., Ni, B., Zhang, J., Zhao, Q., Zhang, W., & Tian, Q. C. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00289 · Cited by 374 · see citing works

Think Locally, Act Globally: Federated Learning with Local and Global RepresentationsPreprint

Liang, P. P., Liu, T., Ziyin, L., Allen, N. B., Auerbach, R. P., Brent, D., Salakhutdinov, R., & Morency, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.01523 · Cited by 375 · see citing works

Fast YOLO: A Fast You Only Look Once System for Real-time Embedded Object Detection in Video

Shaifee, M. J., Chywl, B., Li, F., & Wong, A. M. (2017) · Journal of Computational Vision and Imaging Systems · doi:10.15353/vsnl.v3i1.171 · Cited by 370 · see citing works

MCDNN

Han, S., Shen, H., Philipose, M., Agarwal, S., Wolman, A., & Krishnamurthy, A. (2016) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/2906388.2906396 · Cited by 375 · see citing works

NoScope: optimizing neural network queries over video at scale

Kang, D., Emmons, J., Abuzaid, F., Bailis, P., & Zaharia, M. (2017) · Proceedings of the VLDB Endowment · doi:10.14778/3137628.3137664 · Cited by 367 · see citing works

Data-Free Learning of Student Networks

Chen, H., Wang, Y., Xu, C., Yang, Z., Liu, C., Shi, B., Xu, C., Xu, C., & Tian, Q. C. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00361 · Cited by 372 · see citing works

MobileNetV2 Model for Image Classification

Dong, K., Zhou, C., Ruan, Y., & Li, Y. (2020) · International Conference on Information Technology and Computer Application (ITCA) · doi:10.1109/itca52113.2020.00106 · Cited by 379 · see citing works

Image Question Answering Using Convolutional Neural Network with Dynamic Parameter Prediction

Noh, H., Seo, P. H., & Han, B. (2016) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2016.11 · Cited by 353 · see citing works

Learning Affective Features With a Hybrid Deep Model for Audio–Visual Emotion Recognition

Zhang, S., Zhang, S., Huang, T., Gao, W., & Tian, Q. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2017.2719043 · Cited by 346 · see citing works

MoDNN: Local distributed mobile computing system for Deep Neural Network

Mao, J., Chen, X., Nixon, K. W., Krieger, C., & Chen, Y. (2017) · Design, Automation & Test in Europe Conference & Exhibition (DATE), 2017 · doi:10.23919/date.2017.7927211 · Cited by 331 · see citing works

Deep Learning Advances in Computer Vision with 3D Data

Ioannidou, A., Chatzilari, E., Nikolopoulos, S., & Kompatsiaris, I. Y. (2017) · ACM Computing Surveys · doi:10.1145/3042064 · Cited by 324 · see citing works

Deep Roots: Improving CNN Efficiency with Hierarchical Filter Groups

Ioannou, Y., Robertson, D., Cipolla, R., & Criminisi, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.633 · Cited by 321 · see citing works

Local Binary Convolutional Neural Networks

Juefei-Xu, F., Boddeti, V. N., & Savvides, M. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.456 · Cited by 297 · see citing works

Web AR: A Promising Future for Mobile Augmented Reality—State of the Art, Challenges, and Insights

Qiao, X., Ren, P., Dustdar, S., Liu, L., Ma, H., & Chen, J. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2895105 · Cited by 302 · see citing works

Edge Intelligence: Empowering Intelligence to the Edge of Network

Xu, D., Li, T., Li, Y., Su, X. J., Tarkoma, S., Jiang, T., Crowcroft, J., & Hui, P. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3119950 · Cited by 281 · see citing works

ThiNet: Pruning CNN Filters for a Thinner Net

Luo, J.-H., Zhang, H., Zhou, H.-Y., Xie, C.-W., Wu, J., & Lin, W. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2858232 · Cited by 261 · see citing works

Adaptive Neural Networks for Efficient Inference

Bolukbasi, T., Wang, J., Dekel, O., & Saligrama, V. (2017) · arXiv · doi:10.48550/arxiv.1702.07811 · Cited by 251 · see citing works

End-Edge-Cloud Collaborative Computing for Deep Learning: A Comprehensive Survey

Wang, Y., Yang, C., Lan, S.-L., Zhu, L.-H., & Zhang, Y. (2024) · IEEE Communications Surveys and Tutorials · doi:10.1109/comst.2024.3393230 · Cited by 255 · see citing works

A survey of application research based on blockchain smart contract

Lin, S., Zhang, L., Li, J., Ji, L.-L., & Sun, Y. (2022) · Wireless Networks · doi:10.1007/s11276-021-02874-x · Cited by 258 · see citing works

Methods for Pruning Deep Neural Networks

Vadera, S., & Ameen, S. (2022) · IEEE Access · doi:10.1109/access.2022.3182659 · Cited by 229 · see citing works

Cambricon-S: Addressing Irregularity in Sparse Neural Networks through A Cooperative Software/Hardware Approach

Zhou, X., Du, Z., Guo, Q., Liu, S., Liu, C., Wang, C., Zhou, X., Li, L., Chen, T., & Chen, Y. (2018) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2018.00011 · Cited by 225 · see citing works

AutoPruner: An end-to-end trainable filter pruning method for efficient deep model inference

Luo, J.-H., & Wu, J. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107461 · Cited by 221 · see citing works

Convolutional Neural Network Pruning with Structural Redundancy Reduction

Wang, Z., Li, C., & Wang, X. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01467 · Cited by 221 · see citing works

Exploring Sparsity in Recurrent Neural NetworksPreprint

Narang, S., Elsen, E., Diamos, G., & Sengupta, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.05119 · Cited by 218 · see citing works

Crafting a Toolchain for Image Restoration by Deep Reinforcement Learning

Yu, K., Dong, C., Lin, L., & Loy, C. C. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00259 · Cited by 213 · see citing works

Deep Fried Convnets

Yang, Z., Moczulski, M., Denil, M., De Freitas, N., Song, L., & Wang, Z. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.173 · Cited by 215 · see citing works

Structured Transforms for Small-Footprint Deep LearningPreprint

Sindhwani, V., Sainath, T. N., & Kumar, S. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1510.01722 · Cited by 200 · see citing works

"Learning-Compression" Algorithms for Neural Net Pruning

Carreira-Perpiñán, M. Á., & Idelbayev, Y. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00890 · Cited by 198 · see citing works

Boost Precision Agriculture with Unmanned Aerial Vehicle Remote Sensing and Edge Intelligence: A Survey

Liu, J. B., Xiang, J., Jin, Y., Liu, R., Yan, J., & Wang, L. (2021) · Remote Sensing · doi:10.3390/rs13214387 · Cited by 202 · see citing works

Filter-based deep-compression with global average pooling for convolutional networks

Hsiao, T.-Y., Chang, Y.-C., Chou, H.-H., & Chiu, C.-T. (2019) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2019.02.008 · Cited by 190 · see citing works

Data-Distortion Guided Self-Distillation for Deep Neural Networks

Xu, T.-B., & Liu, C. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33015565 · Cited by 184 · see citing works

Compression of Neural Machine Translation Models via Pruning

See, A., Luong, M.-T., & Manning, C. D. (2016) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k16-1029 · Cited by 185 · see citing works

Breast cancer histopathology image classification through assembling multiple compact CNNs

Zhu, C., Song, F., Wang, Y., Dong, H., Guo, Y., & Liu, J. (2019) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-019-0913-x · Cited by 184 · see citing works

Pruning filters with L1-norm and capped L1-norm for CNN compression

Kumar, A., Shaikh, A. M., Li, Y., Bilal, H., & Yin, B. (2020) · Applied Intelligence · doi:10.1007/s10489-020-01894-y · Cited by 171 · see citing works

Measuring the Intrinsic Dimension of Objective LandscapesPreprint

Li, C.-Y., Farkhoor, H., Liu, R., & Yosinski, J. (2018) · International Conference on Learning Representations · doi:10.48550/arxiv.1804.08838 · Cited by 607 · see citing works

Curriculum Learning by Transfer Learning: Theory and Experiments with Deep NetworksPreprint

Weinshall, D., Cohen, G., & Amir, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.03796 · Cited by 172 · see citing works

Deep Neural Network Approximation for Custom Hardware

Wang, E., Davis, J. J., Zhao, R., Ng, H.-C., Niu, X., Luk, W. W., Cheung, P. Y. K., & Constantinides, G. A. (2019) · ACM Computing Surveys · doi:10.1145/3309551 · Cited by 166 · see citing works

Building fast and compact convolutional neural networks for offline handwritten Chinese character recognition

Xiao, X., Jin, L., Yang, Y., Yang, W., Sun, J., & Chang, T. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.06.032 · Cited by 165 · see citing works

Holistic CNN Compression via Low-Rank Decomposition with Knowledge Transfer

Lin, S., Ji, R., Chen, C., Tao, D., & Luo, J. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2873305 · Cited by 165 · see citing works

CNNpack: packing convolutional neural networks in the frequency domain

Wang, Y., Xu, C., You, S., Tao, D., & Xu, C. (2016) · neural information processing systems · Cited by 156 · see citing works

AR-Net: Adaptive Frame Resolution for Efficient Action Recognition

Meng, Y., Lin, C.-C., Panda, R., Sattigeri, P., Karlinsky, L., Oliva, A., Saenko, K., & Feris, R. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58571-6_6 · Cited by 156 · see citing works

An Entropy-based Pruning Method for CNN CompressionPreprint

Luo, J.-H., & Wu, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.05791 · Cited by 147 · see citing works

A Survey of FPGA-Based Neural Network AcceleratorPreprint

Guo, K., Zeng, S., Yu, J., Wang, Y., & Yang, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.08934 · Cited by 147 · see citing works

Ultimate tensorization: compressing convolutional and FC layers alikePreprint

Garipov, T., Podoprikhin, D., Novikov, A., & Vetrov, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.03214 · Cited by 141 · see citing works

OpenEI: An Open Framework for Edge Intelligence

Zhang, X., Wang, Y., Lu, S., Liu, L., xu, L., & Shi, W. (2019) · 2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2019.00182 · Cited by 139 · see citing works

MiniSeg: An Extremely Minimum Network for Efficient COVID-19 Segmentation

Qiu, Y., Liu, Y., Li, S., & Xu, J. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i6.16617 · Cited by 135 · see citing works

Deep Learning for Mobile Multimedia: A Survey

Ota, K., Dao, M. S., Mezaris, V., & Natale, F. G. B. D. (2017) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/3092831 · Cited by 135 · see citing works

SYQ: Learning Symmetric Quantization for Efficient Deep Neural Networks

Faraone, J., Fraser, N., Blott, M., & Leong, P. H. W. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00452 · Cited by 134 · see citing works

Compressing Convolutional Neural Networks in the Frequency Domain

Chen, W., Wilson, J. T., Tyree, S., Weinberger, K. Q., & Chen, Y. (2016) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2939672.2939839 · Cited by 130 · see citing works

Regularization of deep neural networks with spectral dropout

Khan, S. H., Hayat, M., & Porikli, F. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.09.009 · Cited by 131 · see citing works

AGLNet: Towards real-time semantic segmentation of self-driving images via attention-guided lightweight network

Zhou, Q., Wang, Y., Fan, Y., Wu, X., Zhang, S., Kang, B., & Latecki, L. J. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106682 · Cited by 133 · see citing works

Network Pruning via Performance Maximization

Gao, S., Huang, F., Cai, W., & Huang, H. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.00915 · Cited by 131 · see citing works

A survey on optimization techniques for edge artificial intelligence (ai)

Surianarayanan, C., Lawrence, J. J., Chelliah, P. R., Prakash, E., & Hewage, C. (2023) · Sensors · doi:10.3390/s23031279 · Cited by 131 · see citing works

Functional Hashing for Compressing Neural NetworksPreprint

Shi, L., Feng, S., & Zhu, Z. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.06560 · Cited by 1 · see citing works

Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding

Han, S., Mao, H., & Dally, W. J. (2015) · arXiv · doi:10.48550/arxiv.1510.00149 · Cited by 4,662 · see citing works

Compressing Convolutional Neural NetworksPreprint

Chen, W., Wilson, J. T., Tyree, S., Weinberger, K. Q., & Chen, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.04449 · Cited by 30 · see citing works

A Deep Neural Network Compression Pipeline: Pruning, Quantization, Huffman EncodingPreprint

Han, S., Mao, H., & Dally, W. J. (2015) · arXiv (Cornell University) · Cited by 33 · see citing works

Towards a Theoretical Understanding of Hashing-Based Neural NetsPreprint

Lin, Y., Song, Z., & Yang, L. F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.10244 · Cited by 4 · see citing works