The DOI matches its DataCite record; 25 of the 26 references it cites were found in a registry or an index.
Fixed Point Quantization of Deep Convolutional Networks
Open accessAbstract
In recent years increasingly complex architectures for deep convolution networks (DCNs) have been proposed to boost the performance on image recognition tasks. However, the gains in performance have come at a cost of substantial increase in computation and model storage resources. Fixed point implementation of DCNs has the potential to alleviate some of these complexities and facilitate potential deployment on embedded hardware. In this paper, we propose a quantizer design for fixed point implementation of DCNs. We formulate and solve an optimization problem to identify optimal fixed point bit-width allocation across DCN layers. Our experiments show that in comparison to equal bit-width settings, the fixed point DCNs with optimized bit width allocation offer >20% reduction in the model size without any loss in accuracy on CIFAR-10 benchmark. We also demonstrate that fine-tuning can further enhance the accuracy of fixed point DCNs beyond that of the original floating point model. In doing so, we report a new state-of-the-art fixed point performance of 6.78% error-rate on CIFAR-10 benchmark.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Lin et al. [26] use the signal-to-quantization-noise ratio (SQNR) to ensure that the error resulting from the xed-point quantization is minimized and mathematically assign the bits to each layer for the xed-point quantization. However, mathematically minimizing errors does not necessarily lead to an accuracy reduction.”
From Zero-Centered Fixed-Point Quantization With Iterative Retraining for Deep Convolutional Neural Network-Based Object Detectors (2021) · cites this paper as Lin et al. [26]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate ShiftPreprint
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 15,273
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks
Rastegari, M., Ordonez, V., Redmon, J., & Farhadi, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_32 · Cited by 4,408
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1512.03385 · Cited by 4,196
Return of the Devil in the Details: Delving Deep into Convolutional Nets
Chatfield, K., Simonyan, K., Vedaldi, A., & Zisserman, A. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.6 · Cited by 3,335
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_23 · Cited by 3,034
OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks
Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., & LeCun, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.6229 · Cited by 2,680
Research works printed but not linked: 2
- Courbariaux, M., Bengio, Y., and David, J. Low precision arithmetic for deep learning. arXiv:1412.7024 , 2014. · arXiv
- Hinton, G., Vinyals, O., and Dean, J. Distilling knowledge in a neural network. In Proc. Deep Learning and Representation Learning NIPS Workshop , 2014.
Cited by
Sorted by citations
Items 101–200 of 681
Everything Leaves Footprints: Hardware Accelerated Intermittent Deep Inference
Kang, C.-K., Mendis, H. R., Lin, C., Chen⋆, M.-S., & Hsiu, P.-C. (2020) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2020.3012217 · Cited by 53
The Effects of Approximate Multiplication on Convolutional Neural Networks
Kim, M. S., Barrio, A. A. D., Kim, H., & Bagherzadeh, N. (2022) · eScholarship (California Digital Library) · Cited by 53
Automated Multi-Stage Compression of Neural Networks
Gusak, J., Kholiavchenko, M., Ponomarev, E., Markeeva, L., Blagoveschensky, P., Cichocki, A. S., & Oseledets, I. V. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00306 · Cited by 52
ResOT: Resource-Efficient Oblique Trees for Neural Signal Classification
Zhu, B., Farivar, M., & Shoaran, M. (2020) · IEEE Transactions on Biomedical Circuits and Systems · doi:10.1109/tbcas.2020.3004544 · Cited by 50
Resource-Efficient Neural Networks for Embedded SystemsPreprint
Roth, W., Schindler, G., Klein, B., Peharz, R., Tschiatschek, S., Fröning, H., Pernkopf, F., & Ghahramani, Z. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.03048 · Cited by 67
Jagannath, A., & Jagannath, J. (2022) · Physical Communication · doi:10.1016/j.phycom.2022.101793 · Cited by 54
Customizing Neural Networks for Efficient FPGA Implementation
Samragh, M., Ghasemzadeh, M., & Koushanfar, F. (2017) · IEEE International Symposium on Field-Programmable Custom Computing Machines (FCCM) · doi:10.1109/fccm.2017.43 · Cited by 51
Double MAC on a DSP: Boosting the Performance of Convolutional Neural Networks on FPGAs
Lee, S., Kim, D. W., Nguyen, D. T., & Lee, J. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2018.2824280 · Cited by 50
Enabling deep learning at the IoT edge
Lai, L., & Suda, N. (2018) · Proceedings of the International Conference on Computer-Aided Design · doi:10.1145/3240765.3243473 · Cited by 49
A Precision-Scalable Energy-Efficient Convolutional Neural Network Accelerator
Liu, W., Lin, J. T., & Wang, Z. (2020) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2020.2993051 · Cited by 52
Hammad, I., Li, L., El‐Sankary, K., & Snelgrove, W. M. (2021) · IEEE Access · doi:10.1109/access.2021.3049299 · Cited by 51
Mixed Precision Quantization for ReRAM-based DNN Inference Accelerators
Huang, S., Ankit, A., Silveira, P., Antunes, R., Chalamalasetti, S. R., Hajj, I. E., Kim, D. E., Aguiar, G., Bruel, P., Serebryakov, S., et al. (2021) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1145/3394885.3431554 · Cited by 49
SGQuant: Squeezing the Last Bit on Graph Neural Networks with Specialized Quantization
Feng, B., Wang, Y., Li, X., Yang, S., Peng, X., & Ding, Y. (2020) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai50040.2020.00198 · Cited by 48
Evaluating Fault Resiliency of Compressed Deep Neural Networks
Sabbagh, M., Gongye, C., Fei, Y., & Wang, Y. (2019) · International Conference on Embedded Software and Systems · doi:10.1109/icess.2019.8782505 · Cited by 48
Quantized deep neural networks for energy efficient hardware-based inference
Ding, R., Liu, Z., Blanton, R. D., & Marculescu, D. (2018) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/aspdac.2018.8297274 · Cited by 48
The Heterogeneous Deep Neural Network Processor With a Non-von Neumann Architecture
Shin, D., & Yoo, H. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2897076 · Cited by 48
StructADMM: Achieving Ultrahigh Efficiency in Structured Pruning for DNNs
Zhang, T., Ye, S., Feng, X., Ma, X., Zhang, K., Li, Z., Tang, J., Liu, S., Lin, X., Liu, Y., et al. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3045153 · Cited by 49
Adding New Tasks to a Single Network with Weight Transformations Using Binary Masks
Mancini, M., Ricci, E., Barbara Caputo, B., & Bulò, S. R. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-11012-3_14 · Cited by 45
Holmes, C., Mawhirter, D., He, Y., Yan, F., & Wu, B. (2019) · European Conference on Computer Systems · doi:10.1145/3302424.3303949 · Cited by 45
A Practical Convolutional Neural Network as Loop Filter for Intra Frame
Song, X., Yao, J., Zhou, L., Wang, L., Wu, X., Xie, D., & Pu, S. (2018) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2018.8451589 · Cited by 45
How Much Deep Learning does Neural Style Transfer Really Need? An Ablation Study
Du, L. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093537 · Cited by 45
An SMT-Based Approach for Verifying Binarized Neural Networks
Amir, G., Wu, H.-Z., Barrett, C. W., & Katz, G. (2020) · International Conference on Tools and Algorithms for Construction and Analysis of Systems · doi:10.1007/978-3-030-72013-1_11 · Cited by 67
General Bitwidth Assignment for Efficient Deep Convolutional Neural Network Quantization
Fei, W., Dai, W., Li, C., Zou, J., & Xiong, H. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3069886 · Cited by 49
Monitoring Illegal Tree Cutting through Ultra-Low-Power Smart IoT Devices
Andreadis, A., Giambene, G., & Zambon, R. (2021) · Sensors · doi:10.3390/s21227593 · Cited by 47
Wang, Y., Ding, C., Li, Z., Yuan, G., Liao, S., Ma, X., Yuan, B., Qian, X., Tang, J., Qiu, Q., et al. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11653 · Cited by 42
QKD: Quantization-aware Knowledge Distillation
Kim, J., Bhalgat, Y., Lee, J., Patel, C., & Kwak, N. (2019) · arXiv · doi:10.48550/arxiv.1911.12491 · Cited by 44
Deep Learning Video Analytics Through Edge Computing and Neural Processing Units on Mobile Devices
Tan, T., & Cao, G. (2021) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2021.3105953 · Cited by 43
Enabling Spike-based Backpropagation in State-of-the-art Deep Neural Network ArchitecturesPreprint
Lee, C., Sarwar, S. S., & Roy, K. (2019) · arXiv (Cornell University) · Cited by 43
BinaryDuo: Reducing Gradient Mismatch in Binary Activation Network by Coupling Binary ActivationsPreprint
Kim, H., Kim, K., Kim, J., & Kim, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.06517 · Cited by 50
A depthwise separable convolutional neural network for keyword spotting on an embedded system
Sørensen, P. M., Epp, B., & May, T. (2020) · EURASIP Journal on Audio Speech and Music Processing · doi:10.1186/s13636-020-00176-2 · Cited by 42
Chen, Z., Wen, Z., Wan, W., Pakala, A., Zou, Y., Wei, W.-C., Li, Z., Chen, Y., & Yang, K. (2024) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2024.3422826 · Cited by 41
Fixed-Point Factorized Networks
Wang, P., & Cheng, J. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.422 · Cited by 41
Bit Error Tolerance of a CIFAR-10 Binarized Convolutional Neural Network Processor
Yang, L., Bankman, D. J., Moons, B., Verhelst, M., & Murmann, B. (2018) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2018.8351255 · Cited by 41
Sun, H., Zhu, Z., Cai, Y., Chen, X., Wang, Y., & Yang, H. (2020) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/asp-dac47756.2020.9045192 · Cited by 41
Fixed-Point Back-Propagation Training
Zhang, X., Liu, S., Zhang, R., Liu, C., Huang, D., Zhou, S., Guo, J., Guo, Q., Du, Z., Zhi, T., et al. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00240 · Cited by 43
Liao, J.-X., Wei, S.-L., Xie, C.-L., Zeng, T., Sun, J., Zhang, S., Zhang, X., & Fan, F. (2023) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2023.3346517 · Cited by 43
Voghoei, S., Tonekaboni, N. H., Wallace, J. G., & Arabnia, H. R. (2018) · International Conference on Computational Science and Computational Intelligence (CSCI) · doi:10.1109/csci46756.2018.00177 · Cited by 45
Automated design of error-resilient and hardware-efficient deep neural networks
Schorn, C., Elsken, T., Vogel, S., Runge, A., Guntoro, A., & Ascheid, G. (2020) · Neural Computing and Applications · doi:10.1007/s00521-020-04969-6 · Cited by 41
DAQ: Channel-Wise Distribution-Aware Quantization for Deep Image Super-Resolution Networks
Hong, C., Kim, H., Baik, S., Oh, J., & Lee, K. M. (2022) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv51458.2022.00099 · Cited by 39
FlexBlock: A Flexible DNN Training Accelerator With Multi-Mode Block Floating Point Support
Noh, S.-H., Koo, J., Lee, S., Park, J., & Kung, J. (2023) · IEEE Transactions on Computers · doi:10.1109/tc.2023.3253050 · Cited by 42
Weighted Quantization-Regularization in DNNs for Weight Memory Minimization Toward HW Implementation
Wess, M., Dinakarrao, S. M. P., & Jantsch, A. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2018.2857080 · Cited by 38
Ye, S., Feng, X., Zhang, T., Ma, X., Lin, S., Li, Z., Xu, K., Wen, W., Liu, S., Tang, J., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.09769 · Cited by 38
Hardware-Software Co-Design for an Analog-Digital Accelerator for Machine Learning
Ambrosi, J., Ankit, A., Antunes, R., Chalamalasetti, S. R., Chatterjee, S., Hajj, I. E., Fachini, G. J. D. A., Faraboschi, P., Foltín, M., Huang, S., et al. (2018) · IEEE International Conference on Rebooting Computing (ICRC) · doi:10.1109/icrc.2018.8638612 · Cited by 37
Yang, J., Kong, Y., Zhang, Z., Liu, Z., Zhou, J. L., Wang, Y., Liu, Y., Guo, C., Hu, T., Li, C., et al. (2021) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2021.3095232 · Cited by 39
Improving efficiency in convolutional neural networks with multilinear filters
Tran, D. T., Iosifidis, A., & Gabbouj, M. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.05.017 · Cited by 38
Hierarchical Binary CNNs for Landmark Localization with Limited Resources
Bulat, A., & Tzimiropoulos, G. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2866051 · Cited by 36
Towards Certificated Model Robustness Against Weight Perturbations
Weng, T.-W., Zhao, P., Liu, S., Chen, P., Lin, X., & Daniel, L. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.6105 · Cited by 36
Watermarking Neural Network with Compensation Mechanism
Feng, L., & Zhang, X. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-55393-7_33 · Cited by 36
Neris, R., Rodríguez-Molina, A., Guerra, R., López, S., & Sarmiento, R. (2022) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2022.3169330 · Cited by 41
It's All In the Teacher: Zero-Shot Quantization Brought Closer to the Teacher
Choi, K., Lee, H. Y., Hong, D., Yu, J., Park, N., Kim, Y., & Lee, J. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.00813 · Cited by 38
Overcoming Challenges in Fixed Point Training of Deep Convolutional NetworksPreprint
Lin, D. D., & Talathi, S. S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.02241 · Cited by 36
Self-citationFaraone, A., & Delgado-Gonzalo, R. (2020) · 2020 2nd IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS) · doi:10.1109/aicas48895.2020.9073950 · Cited by 36
Photonic Integrated Reconfigurable Linear Processors as Neural Network Accelerators
Marinis, L. D., Cococcioni, M., Liboiron-Ladouceur, O., Contestabile, G., Castoldi, P., & Andriolli, N. (2021) · Applied Sciences · doi:10.3390/app11136232 · Cited by 35
Single-Path Mobile AutoML: Efficient ConvNet Design and NAS Hyperparameter Optimization
Stamoulis, D. S., Ding, R., Wang, D., Lymberopoulos, D., Priyantha, N. B., Liu, J., & Marculescu, D. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2971421 · Cited by 35
DeltaCNN: End-to-End CNN Inference of Sparse Frame Differences in Videos
Parger, M., Tang, C., Twigg, C. D., Keskin, C., Wang, R. Y., & Steinberger, M. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01217 · Cited by 37
Improved training of binary networks for human pose estimation and image recognition
Bulat, A., Tzimiropoulos, G., Kossaifi, J., & Pantic, M. (2019) · arXiv · doi:10.48550/arxiv.1904.05868 · Cited by 34
Distribution-aware Adaptive Multi-bit Quantization
Zhao, S., Yue, T., & Hu, X. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00916 · Cited by 33
Optimization-Based Post-Training Quantization With Bit-Split and Stitching
Wang, P., Chen, W., He, X., Chen, Q., Liu, Q., & Cheng, J. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3159369 · Cited by 33
FeatherCNN: Fast Inference Computation with TensorGEMM on ARM Architectures
Lan, H., Meng, J., Hundt, C., Schmidt, B., Deng, M., Wang, X., Liu, W., Qiao, Y., & Feng, S. (2019) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2019.2939785 · Cited by 33
Lascorz, A. D., Sharify, S., Edo, I., Stuart, D. M., Awad, O. M., Judd, P., Mahmoud, M., Nikolić, M., Siu, K., Poulos, Z., et al. (2019) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1145/3352460.3358295 · Cited by 38
ExPAN(N)D: Exploring Posits for Efficient Artificial Neural Network Design in FPGA-Based Systems
Nambi, S., Ullah, S., Sahoo, S. S., Lohana, A., Merchant, F., & Kumar, A. S. (2021) · IEEE Access · doi:10.1109/access.2021.3098730 · Cited by 33
Fixed-point optimization of deep neural networks with adaptive step size retraining
Shin, S., Boo, Y., & Sung, W. (2017) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2017.7952347 · Cited by 33
Encrypted Speech Recognition Using Deep Polynomial Networks
Zhang, S., Gong, Y., & Yu, D. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8683721 · Cited by 32
Low-Power Neural Networks for Semantic Segmentation of Satellite Images
Bahl, G., Daniel, L., Moretti, M., & Lafarge, F. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00302 · Cited by 36
Self-Supervised Quantization of Pre-Trained Neural Networks for Multiplierless Acceleration
Vogel, S., Springer, J., Guntoro, A., & Ascheid, G. (2019) · Design, Automation, and Test in Europe · doi:10.23919/date.2019.8714901 · Cited by 31
EvoQ: Mixed Precision Quantization of DNNs via Sensitivity Guided Evolutionary Search
Yuan, Y., Chen, C., Hu, X., & Peng, S. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207413 · Cited by 31
An Overview of Neural Network CompressionPreprint
O’Neill, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.03669 · Cited by 149
Check-N-Run: A Checkpointing System for Training Deep Learning Recommendation ModelsPreprint
Eisenman, A., Matam, K. K., Ingram, S., Mudigere, D., Krishnamoorthi, R., Nair, K., Smelyanskiy, M., & Annavaram, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.08679 · Cited by 31
Deep Neural Network Quantization via Layer-Wise Optimization Using Limited Training Data
Chen, S., Wang, W., & Pan, S. J. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33013329 · Cited by 36
S2DNAS: Transforming Static CNN Model for Dynamic Inference via Neural Architecture Search
Yuan, Z., Wu, B., Sun, G., Liang, Z., Zhao, S., & Bi, W. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58536-5_11 · Cited by 28
Why TanH is a Hardware Friendly Activation Function for CNNs
Abdelouahab, K., Pelcat, M., & Berry, F. (2017) · International Conference on Distributed Smart Cameras · doi:10.1145/3131885.3131937 · Cited by 32
Neural Network Distillation on IoT Platforms for Sound Event Detection
Cerutti, G., Prasad, R., Brutti, A., & Farella, E. (2019) · Interspeech (USB) · doi:10.21437/interspeech.2019-2394 · Cited by 30
Joint Pruning and Channel-Wise Mixed-Precision Quantization for Efficient Deep Neural Networks
Motetti, B. A., Risso, M., Burrello, A., Macii, E., Poncino, M., & Pagliari, D. J. (2024) · IEEE Transactions on Computers · doi:10.1109/tc.2024.3449084 · Cited by 37
Na, T., & Mukhopadhyay, S. (2016) · International Symposium on Low Power Electronics and Design (ISLPED) · doi:10.1145/2934583.2934625 · Cited by 30
An Analytical Method to Determine Minimum Per-Layer Precision of Deep Neural Networks
Sakr, C., & Shanbhag, N. R. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8461702 · Cited by 29
A Reconfigurable Approximate Multiplier for Quantized CNN Applications
Guo, C., Zhang, L., Zhou, X., Qian, W., & Zhuo, C. (2020) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/asp-dac47756.2020.9045176 · Cited by 29
Sim, H., Kenzhegulov, S., & Lee, J. (2018) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1145/3195970.3196028 · Cited by 40
moDNN: Memory optimal DNN training on GPUs
Chen, X., Chen, D. Z., & Hu, X. S. (2018) · Design, Automation, and Test in Europe · doi:10.23919/date.2018.8341972 · Cited by 28
COP: customized correlation-based Filter level pruning method for deep CNN compression
Wang, W., Yu, Z., Fu, C., Cai, D., & He, X. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.08.098 · Cited by 27
Sub-mW Keyword Spotting on an MCU: Analog Binary Feature Extraction and Binary Neural Networks
Cerutti, G., Cavigelli, L., Andri, R., Magno, M., Farella, E., & Luca Benini, C. (2022) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2022.3142525 · Cited by 27
Maestro: A Memory-on-Logic Architecture for Coordinated Parallel Use of Many Systolic Arrays
Kung, H. T., McDanel, B., Zhang, S. Q., Dong, X., & Chen, C. C. (2019) · IEEE International Conference on Application-specific Systems, Architectures and Processors (ASAP) · doi:10.1109/asap.2019.00-31 · Cited by 29
Per-Tensor Fixed-Point Quantization of the Back-Propagation AlgorithmPreprint
Sakr, C., & Shanbhag, N. R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.11732 · Cited by 34
Acceleration of Convolutional Neural Network Using FFT-Based Split ConvolutionsPreprint
Chitsaz, K., Hajabdollahi, M., Karimi, N., Samavi, S., & Shirani, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.12621 · Cited by 31
Liu, Y., Cao, K., Wang, R., Tian, M., & Xie, Y. (2022) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2022.3172410 · Cited by 26
Huang, C., Liu, P., & Fang, L. (2021) · Applied Intelligence · doi:10.1007/s10489-020-02109-0 · Cited by 27
An Efficient Learning Algorithm for Direct Training Deep Spiking Neural Networks
Zhu, X., Zhao, B., Ma, D., & Tang, H. (2021) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2021.3073846 · Cited by 25
FATNN: Fast and Accurate Ternary Neural Networks
Chen, P., Zhuang, B., & Shen, C. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00517 · Cited by 26
Liu, Y., Cao, K., Li, R., Zhang, H., & Zhou, L. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3207098 · Cited by 25
Learning Low Precision Deep Neural Networks through Regularization.Preprint
Choi, Y., El‐Khamy, M., & Lee, J. (2018) · arXiv (Cornell University) · Cited by 25
Knowledge Distillation for Recurrent Neural Network Language Modeling with Trust Regularization
Shi, Y., Hwang, M.-Y., Lei, X., & Sheng, H. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8683533 · Cited by 24
Feature Map Transform Coding for Energy-Efficient CNN Inference
Chmiel, B., Baskin, C., Zheltonozhskii, E., Banner, R., Yermolin, Y., Karbachevsky, A., Bronstein, A. M., & Mendelson, A. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9206968 · Cited by 26
Al-Hami, M. A., Pietroń, M., Casas, R. A., & Wielgosz, M. (2019) · Neural Processing Letters · doi:10.1007/s11063-019-10076-y · Cited by 24
Knowledge Graph Embedding Compression
Sachan, M. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.238 · Cited by 27
Romaszkan, W., Li, T., Melton, T., Pamarti, S., & Gupta, P. (2020) · Design, Automation, and Test in Europe · doi:10.23919/date48585.2020.9116289 · Cited by 24
A portable, automatic data qantizer for deep neural networks
Oh, Y. H., Quan, Q., Kim, D.-Y., Kim, S., Heo, J., Jung, S., Jang, J.-Y., & Lee, J. W. (2018) · International Conference on Parallel Architectures and Compilation Techniques (PACT) · doi:10.1145/3243176.3243180 · Cited by 24
Energy Efficient Fixed-point Inference System of Convolutional Neural Network
Lo, C. Y., & Sham, C. (2020) · IEEE International Midwest Symposium on Circuits and Systems (MWSCAS) · doi:10.1109/mwscas48704.2020.9184436 · Cited by 24
E2bird: Enhanced Elastic Batch for Improving Responsiveness and Throughput of Deep Learning Services
Cui, W., Chen, Q., Zhao, H., Wei, M., Tang, X., & Guo, M. (2020) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2020.3047638 · Cited by 24
Hardware accelerator systems for artificial intelligence and machine learning
(2020) · Advances in computers · doi:10.1016/bs.adcom.2020.11.005 · Cited by 24
Lee, J., Yu, M., Kwon, Y., & Kim, T. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2022.02.005 · Cited by 24
One-bit Flip is All You Need: When Bit-flip Attack Meets Model Training
Dong, J., Qiu, H., Li, Y., Zhang, T., Li, Y., Lai, Z., Zhang, C., & Xia, S. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00432 · Cited by 23
Metadata
- Authors
- Lin, D. D., Talathi, S. S., & Annapureddy, V. S.
- Affiliations
- Qualcomm (United States) (US)
- ORCID
- Talathi, Sachin S.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2015
- Pages
- 2849-2858
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1511.06393
- OpenAlex
- W2286365479
- Cited by
- 684
- References
- 26
- Citations by year
- 2026: 1 · 2025: 21 · 2024: 36 · 2023: 48 · 2022: 71 · 2021: 109 · 2020: 141 · 2019: 130 · 2018: 86 · 2017: 31 · 2016: 10
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- International Conference on Machine Learning
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Numerical Methods and Algorithms
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- fixed-point quantization, deep convolutional neural networks, bit-width allocation, quantizer design, model size reduction, fine-tuning, CIFAR-10, image classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
