The DOI matches its DataCite record; 25 of the 26 references it cites were found in a registry or an index.
Fixed Point Quantization of Deep Convolutional Networks
Open accessAbstract
In recent years increasingly complex architectures for deep convolution networks (DCNs) have been proposed to boost the performance on image recognition tasks. However, the gains in performance have come at a cost of substantial increase in computation and model storage resources. Fixed point implementation of DCNs has the potential to alleviate some of these complexities and facilitate potential deployment on embedded hardware. In this paper, we propose a quantizer design for fixed point implementation of DCNs. We formulate and solve an optimization problem to identify optimal fixed point bit-width allocation across DCN layers. Our experiments show that in comparison to equal bit-width settings, the fixed point DCNs with optimized bit width allocation offer >20% reduction in the model size without any loss in accuracy on CIFAR-10 benchmark. We also demonstrate that fine-tuning can further enhance the accuracy of fixed point DCNs beyond that of the original floating point model. In doing so, we report a new state-of-the-art fixed point performance of 6.78% error-rate on CIFAR-10 benchmark.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Lin et al. [26] use the signal-to-quantization-noise ratio (SQNR) to ensure that the error resulting from the xed-point quantization is minimized and mathematically assign the bits to each layer for the xed-point quantization. However, mathematically minimizing errors does not necessarily lead to an accuracy reduction.”
From Zero-Centered Fixed-Point Quantization With Iterative Retraining for Deep Convolutional Neural Network-Based Object Detectors (2021) · cites this paper as Lin et al. [26]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation
Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.81 · Cited by 32,684
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate ShiftPreprint
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 15,273
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks
Rastegari, M., Ordonez, V., Redmon, J., & Farhadi, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_32 · Cited by 4,408
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1512.03385 · Cited by 4,196
Return of the Devil in the Details: Delving Deep into Convolutional Nets
Chatfield, K., Simonyan, K., Vedaldi, A., & Zisserman, A. (2014) · Proceedings of the British Machine Vision Conference 2014 · doi:10.5244/c.28.6 · Cited by 3,335
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9_23 · Cited by 3,034
OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks
Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., & LeCun, Y. (2013) · arXiv · doi:10.48550/arxiv.1312.6229 · Cited by 2,680
Research works printed but not linked: 2
- Courbariaux, M., Bengio, Y., and David, J. Low precision arithmetic for deep learning. arXiv:1412.7024 , 2014. · arXiv
- Hinton, G., Vinyals, O., and Dean, J. Distilling knowledge in a neural network. In Proc. Deep Learning and Representation Learning NIPS Workshop , 2014.
Cited by
Sorted by citations
Items 201–300 of 681
True Gradient-Based Training of Deep Binary Activated Neural Networks Via Continuous Binarization
Sakr, C., Choi, J., Wang, Z., Gopalakrishnan, K., & Shanbhag, N. R. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8461456 · Cited by 23
A Fixed-Point Quantization Technique for Convolutional Neural Networks Based on Weight Scaling
Mitschke, N., Heizmann, M., Noffz, K.-H., & Wittmann, R. (2019) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2019.8803490 · Cited by 23
ApproxHPVM: a portable compiler IR for accuracy-aware optimizations
Sharif, H., Srivastava, P., Huzaifa, M., Kotsifakou, M., Joshi, K., Sarita, Y., Zhao, N., Adve, V., Misailovíc, S., & Adve, S. V. (2019) · Proceedings of the ACM on Programming Languages · doi:10.1145/3360612 · Cited by 23
PruNet: Class-Blind Pruning Method For Deep Neural Networks
Marchisio, A., Hanif, M. A., Martina, M., & Shafique, M. (2018) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489764 · Cited by 21
Kim, Y., Kim, H., Yadav, N., Li, S., & Choi, K. K. (2020) · Electronics · doi:10.3390/electronics9030478 · Cited by 22
An Embedded CNN Implementation for On-Device ECG Analysis
Burger, A., Qian, C., Schiele, G., & Helms, D. (2020) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomworkshops48775.2020.9156260 · Cited by 22
Li, A., Mo, H., Zhu, W., Qiang, L., Yin, S., Wei, S., & Liu, L. (2022) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2022.3146202 · Cited by 24
GQNA: Generic Quantized DNN Accelerator With Weight-Repetition-Aware Activation Aggregating
Yang, J., Tu, F., Li, Y., Wang, Y., Liu, L., Wei, S., & Yin, S. (2022) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2022.3188899 · Cited by 22
Attention Round for post-training quantization
Diao, H., Li, G., Xu, S., Kong, C., & Wang, W. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.127012 · Cited by 23
Mao, R., Tang, L., Yuan, X., Ye, L., & Zhou, J. (2024) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca57654.2024.00023 · Cited by 22
A Case of On-Chip Memory Subsystem Design for Low-Power CNN Accelerators
Wang, Y., Li, H., & Li, X. (2017) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2017.2778060 · Cited by 22
A Low-Power Transprecision Floating-Point Cluster for Efficient Near-Sensor Data Analytics
Montagna, F., Mach, S., Benatti, S., Garofalo, A., Ottavi, G., Luca Benini, C., Rossi, D., & Tagliavini, G. (2021) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2021.3101764 · Cited by 22
Learned Threshold PruningPreprint
Azarian, K., Bhalgat, Y. S., Lee, J., & Blankevoort, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.00075 · Cited by 22
Goyal, R., Vanschoren, J., van Acht, V., & Nijssen, S. (2021) · TU/e Research Portal · doi:10.48550/arxiv.2102.02147 · Cited by 31
Random and Adversarial Bit Error Robustness: Energy-Efficient and Secure DNN Accelerators
Stutz, D., Chandramoorthy, N., Hein, M., & Schiele, B. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3181972 · Cited by 22
Lin, X., Cheng, H., Lu, Y. H., Luo, H., Li, H., Qian, Y., Zhou, L., Zhang, L., & Wang, M. (2022) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2022.103765 · Cited by 21
Bayesian asymmetric quantized neural networks
Chien, J., & Chang, S.-T. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.109463 · Cited by 21
Counterexample Guided Neural Network Quantization Refinement
Matos, J. B. P., Filho, E. B. D. L., de Bessa, I. V., Manino, E., Song, X., & Cordeiro, L. C. (2023) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2023.3335313 · Cited by 23
Loroch, D. M., Pfreundt, F., Wehn, N., & Keuper, J. (2017) · doi:10.1145/3146347.3146348 · Cited by 23
Stochastic Quantization for Learning Accurate Low-Bit Deep Neural Networks
Dong, Y., Ni, R., Li, J., Chen, Y., Su, H., & Zhu, J. (2019) · International Journal of Computer Vision · doi:10.1007/s11263-019-01168-2 · Cited by 22
Q-CapsNets: A Specialized Framework for Quantizing Capsule Networks
Marchisio, A., Bussolino, B., Colucci, A., Martina, M., Masera, G., & Shafique, M. (2020) · ACM/IEEE Design Automation Conference (DAC) · doi:10.1109/dac18072.2020.9218746 · Cited by 21
Emotion Recognition on Edge Devices: Training and Deployment
Pandelea, V., Ragusa, E., Apicella, T., Gastaldo, P., & Cambria, E. (2021) · Sensors · doi:10.3390/s21134496 · Cited by 21
The Accuracy and Efficiency of Posit Arithmetic
Ciocîrlan, Ș.-D., Loghin, D., Ramapantulu, L., Ţăpuş, N., & Teo, Y. M. (2021) · IEEE International Conference on Computer Design: VLSI in Computers and Processors (ICCD) · doi:10.1109/iccd53106.2021.00024 · Cited by 20
Rethinking Data-Free Quantization as a Zero-Sum Game
Qian, B., Wang, Y., Hong, R., & Wang, M. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i8.26136 · Cited by 24
A novel data format for approximate arithmetic computing
Gao, M., Wang, Q., Kankanhalli-Nagendra, A. S., & Qu, G. (2017) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/aspdac.2017.7858354 · Cited by 20
Minimum precision requirements for the SVM-SGD learning algorithm
Sakr, C., Patil, A. D., Zhang, S., Kim, Y., & Shanbhag, N. R. (2017) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2017.7952334 · Cited by 21
Energy Efficiency Enhancement for CNN-based Deep Mobile Sensing
Xie, R., Jia, X., Wang, L., & Wu, K. (2019) · IEEE Wireless Communications · doi:10.1109/mwc.2019.1800321 · Cited by 20
Optimizing Weight Value Quantization for CNN Inference
Nogami, W., Ikegami, T., O’uchi, S., Takano, R., & Kudoh, T. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852331 · Cited by 20
AdaptivFloat: A Floating-point based Data Type for Resilient Deep Learning InferencePreprint
Tambe, T., Yang, E.-Y., Wan, Z., Deng, Y., Reddi, V. J., Rush, A. M., Brooks, D. M., & Wei, G.-Y. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.13271 · Cited by 20
Precision Gating: Improving Neural Network Efficiency with Dynamic Dual-Precision ActivationsPreprint
Zhang, Y., Zhao, R., Hua, W., Xu, N., Suh, G. E., & Zhang, Z. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.07136 · Cited by 22
FLightNNs: Lightweight Quantized Deep Neural Networks for Fast and Accurate Inference
Ding, R., Liu, Z., Chin, T.-W., Marculescu, D., & Blanton, R. D. (. (2019) · Proceedings of the 56th Annual Design Automation Conference 2019 · doi:10.1145/3316781.3317828 · Cited by 19
Adaptative Inference Cost With Convolutional Neural Mixture Models
Ruiz, A., & Verbeek, J. J. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00196 · Cited by 18
Energy Efficient Implementation of Machine Learning Algorithms on Hardware Platforms
Osta, M., Alameh, M., Younes, H., Ibrahim, A., & Valle, M. (2019) · IEEE International Conference on Electronics, Circuits and Systems (ICECS) · doi:10.1109/icecs46596.2019.8965157 · Cited by 19
Training Multi-Bit Quantized and Binarized Networks with a Learnable Symmetric Quantizer
Pham, P., Abraham, J. A., & Chung, J. (2021) · IEEE Access · doi:10.1109/access.2021.3067889 · Cited by 21
Floating Point and Fixed Point 32-bits Quantizers for Quantization of Weights of Neural Networks
Perić, Z., Savić, M. S., Dincic, M. R., Vučić, N., Djosic, D. B., & Milosavljević, S. (2021) · International Symposium on Advanced Topics in Electrical Engineering · doi:10.1109/atee52255.2021.9425265 · Cited by 19
Sub-bit Neural Networks: Learning to Compress and Accelerate Binary Neural Networks
Wang, Y., Yang, Y., Sun, F., & Yao, A. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00531 · Cited by 19
Zhu, Y., Zhang, W., Chen, M., Chen, H., Cheng, X., Zhang, W., & Chen, H. (2022) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3488560.3498437 · Cited by 21
Wang, P., Hu, Q., Fang, Z., Zhao, C., & Cheng, J. (2017) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3152127 · Cited by 19
An FPU design template to optimize the accuracy-efficiency-area trade-off
Zoni, D., Galimberti, A., & Fornaciari, W. (2020) · Sustainable Computing Informatics and Systems · doi:10.1016/j.suscom.2020.100450 · Cited by 21
Niu, W., Li, Z., Ma, X., Dong, P., Zhou, G., Qian, X., Lin, X., Wang, Y., & Ren, B. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3089687 · Cited by 23
Eo, M., Kang, S., & Rhee, W. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.01.024 · Cited by 18
Design of High-Throughput Mixed-Precision CNN Accelerators on FPGA
Latotzke, C., Ciesielski, T., & Gemmeke, T. (2022) · International Conference on Field Programmable Logic and Applications (FPL) · doi:10.1109/fpl57034.2022.00061 · Cited by 19
Training Binary Weight Networks via Semi-Binary Decomposition
Hu, Q., Li, G., Wang, P., Zhang, Y., & Cheng, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01261-8_39 · Cited by 18
moDNN: Memory Optimal Deep Neural Network Training on Graphics Processing Units
Chen, X., Chen, D. Z., Han, Y., & Hu, X. S. (2018) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2018.2866582 · Cited by 18
Neshatpour, K., Behnia, F., Homayoun, H., & Sasan, A. (2019) · International Symposium on Quality Electronic Design (ISQED) · doi:10.1109/isqed.2019.8697497 · Cited by 18
Stochastic Computing for Low-Power and High-Speed Deep Learning on FPGA
Lammie, C., & Azghadi, M. R. (2019) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2019.8702248 · Cited by 18
FPAP: A Folded Architecture for Energy-Quality Scalable Convolutional Neural Networks
Wang, Y., Lin, J. T., & Wang, Z. (2018) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2018.2856624 · Cited by 18
Localization Convolutional Neural Networks Using Angle of Arrival Images
Comiter, M. Z., & Kung, H. T. (2018) · Globecom · doi:10.1109/glocom.2018.8647687 · Cited by 18
Efficient Execution of Quantized Deep Learning Models: A Compiler ApproachPreprint
Jain, A., Bhattacharya, S., Masuda, M., Sharma, V., & Wang, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10226 · Cited by 36
Quantization of deep neural networks for accumulator-constrained processors
de Bruin, B., Živković, Z., & Corporaal, H. (2019) · Microprocessors and Microsystems · doi:10.1016/j.micpro.2019.102872 · Cited by 17
Symmetric $k$-Means for Deep Neural Network Compression and Hardware Acceleration on FPGAs
Jain, A., Goel, P., Aggarwal, S., Fell, A., & Anand, S. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2968810 · Cited by 17
Simplification of neural networks for skin lesion image segmentation using color channel pruning
Hajabdollahi, M., Esfandiarpoor, R., Khadivi, P., Soroushmehr, S. M. R., Karimi, N., & Samavi, S. (2020) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2020.101729 · Cited by 17
Quantized Deep Residual Convolutional Neural Network for Image-Based Dietary Assessment
Tan, R. Z., Chew, X., & Khaw, K. W. (2020) · IEEE Access · doi:10.1109/access.2020.3003518 · Cited by 17
Unsupervised Network Quantization via Fixed-Point Factorization
Wang, P., He, X., Chen, Q., Cheng, A., Liu, Q., & Cheng, J. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3007749 · Cited by 17
Mocerino, L., & Calimera, A. (2020) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2020.3039116 · Cited by 19
Hanif, M. A., & Shafique, M. (2021) · Design, Automation, and Test in Europe · doi:10.23919/date51398.2021.9473943 · Cited by 17
Compressing Deep Neural Networks Using Toeplitz Matrix: Algorithm Design and Fpga Implementation
Liao, S., Samiee, A., Deng, C., Bai, Y. D., & Yuan, B. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8683556 · Cited by 17
ALigN: A Highly Accurate Adaptive Layerwise Log_2_Lead Quantization of Pre-Trained Neural Networks
Gupta, S., Ullah, S., Ahuja, K., Tiwari, A., & Kumar, A. (2020) · IEEE Access · doi:10.1109/access.2020.3005286 · Cited by 15
Post-training Quantization Methods for Deep Learning Models
Kluska, P., & Zięba, M. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-41964-6_40 · Cited by 17
Patch-wise Mixed-Precision Quantization of Vision Transformer
Xiao, J., Li, Z., Yang, L., & Gu, Q. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191205 · Cited by 22
An SMT Theory of Fixed-Point Arithmetic
Baranowski, M. S., He, S., Lechner, M., Nguyen, T. S., & Rakamarić, Z. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-51074-9_2 · Cited by 17
DC-LSTM: Deep Compressed LSTM with Low Bit-Width and Structured Matrices
Nan, G., Wang, C., Liu, W., & Lombardi, F. (2020) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas45731.2020.9180869 · Cited by 16
Alps: Adaptive Quantization of Deep Neural Networks with GeneraLized PositS
Langroudi, H. F., Karia, V., Carmichael, Z., Zyarah, A. M., Pandit, T., Gustafson, J. L., & Kudithipudi, D. (2021) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00346 · Cited by 15
Zhao, Y., Shumailov, I., Mullins, R., & Anderson, R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.00208 · Cited by 16
An LSTM-Based Neural Network Wearable System for Blood Glucose Prediction in People With Diabetes
Tena, F., Garnica, Ó., Lanchares, J., & Hidalgo, J. I. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3300511 · Cited by 16
Selective Deep Convolutional Neural Network for Low Cost Distorted Image Classification
Ha, M., Byun, Y., Kim, J., Lee, J., Lee, Y., & Lee, S. (2019) · IEEE Access · doi:10.1109/access.2019.2939781 · Cited by 16
Cost-Efficient Classification for Neurological Disease Detection
Zhu, B., Taghavi, M., & Shoaran, M. (2019) · IEEE Biomedical Circuits and Systems Conference (BioCAS) · doi:10.1109/biocas.2019.8918702 · Cited by 15
Niu, Y., Kannan, R., Srivastava, A., & Prasanna, V. K. (2020) · ACM/SIGDA International Symposium on Field-Programmable Gate Arrays (FPGA) · doi:10.1145/3373087.3375302 · Cited by 15
Merged Logic and Memory Fabrics for Accelerating Machine Learning Workloads
Crafton, B., Spetalnick, S. D., Fang, Y., & Raychowdhury, A. (2020) · IEEE Design and Test · doi:10.1109/mdat.2020.3016587 · Cited by 15
Train Me If You Can: Decentralized Learning on the Deep Edge
Costa, D. C., Costa, M., & Pinto, S. (2022) · Applied Sciences · doi:10.3390/app12094653 · Cited by 16
Widespread Underestimation of Sensitivity in Differentially Private Libraries and How to Fix It
Casacuberta, S., Shoemate, M., Vadhan, S., & Wagaman, C. (2022) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3548606.3560708 · Cited by 15
CNN-based Human Activity Recognition on Edge Computing Devices
Singh, A., Margaria, T., & Demrozi, F. (2023) · IEEE International Conference on Omni-layer Intelligent Systems (COINS) · doi:10.1109/coins57856.2023.10189270 · Cited by 15
Approximating trigonometric functions for posits using the CORDIC method
Lim, J. P., Shachnai, M., & Nagarakatte, S. (2020) · ACM International Conference on Computing Frontiers (CF) · doi:10.1145/3387902.3392632 · Cited by 15
Zhang, H., Li, J. Z., Kara, K., Alistarh, D., Liu, J., & Zhang, C. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.05402 · Cited by 15
Confounding Tradeoffs for Neural Network QuantizationPreprint
Garg, S., Jain, A., Lou, J., & Nahmias, M. A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.06366 · Cited by 21
Efficient Machine Learning on Edge Computing Through Data Compression Techniques
Larrakoetxea, N. G., Eskubi-Astobiza, J., Pastor-López, I., Sanz, B., García-Barruetabeña, J., & Rego, A. Z. (2023) · IEEE Access · doi:10.1109/access.2023.3263391 · Cited by 14
CANNA: neural network acceleration using configurable approximation on GPGPU
Imani, M., Masich, M., Peroni, D., Wang, P., & Rosing, T. (2018) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.5555/3201607.3201764 · Cited by 14
Short floating-point representation for convolutional neural network inference
Kang, H. (2018) · IEICE Electronics Express · doi:10.1587/elex.15.20180909 · Cited by 14
Lin, P., Sun, M.-K., Kung, C., & Chiueh, T. (2019) · IEEE Journal on Emerging and Selected Topics in Circuits and Systems · doi:10.1109/jetcas.2019.2911999 · Cited by 15
Demidovskij, A. V., & Smirnov, E. (2020) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn48605.2020.9207281 · Cited by 14
Closed-Loop Neural Interfaces with Embedded Machine Learning
Zhu, B., Shin, U., & Shoaran, M. (2020) · IEEE International Conference on Electronics, Circuits and Systems (ICECS) · doi:10.1109/icecs49266.2020.9294844 · Cited by 14
Nan, G., Wang, Z., Wang, C., Wu, B., Wang, Z., Liu, W., & Lombardi, F. (2021) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2021.3091318 · Cited by 14
A TensorFlow Extension Framework for Optimized Generation of Hardware CNN Inference Engines
Leon, V., Mouselinos, S., Koliogeorgi, K., Xydis, S., Soudris, D., & Pekmestzi, K. (2020) · Technologies · doi:10.3390/technologies8010006 · Cited by 16
CANNA: Neural network acceleration using configurable approximation on GPGPU
Imani, M., Masich, M., Peroni, D., Wang, P., & Rosing, T. (2018) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/aspdac.2018.8297401 · Cited by 19
Deep Learning as a Mixed Convex-Combinatorial Optimization Problem
Friesen, A. L., & Domingos, P. (2017) · arXiv · doi:10.48550/arxiv.1710.11573 · Cited by 14
Weather classification method based on spiking neural network
Tian, M., Chen, X., Zhang, H., Zhang, P., Cao, K., & Wang, R. (2021) · International Conference on Digital Society and Intelligent Systems (DSInS) · doi:10.1109/dsins54396.2021.9670557 · Cited by 15
Feature Distillation Siamese Networks for Object Tracking
Huang, H., Liu, G., Zhang, Y., & Xiong, R. (2022) · Applied Soft Computing · doi:10.1016/j.asoc.2022.109912 · Cited by 13
Entity-Agnostic Representation Learning for Parameter-Efficient Knowledge Graph Embedding
Chen, M., Zhang, W., Yao, Z., Zhu, Y., Gao, Y., Pan, J. Z., & Chen, H. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i4.25535 · Cited by 15
DACAPO: Accelerating Continuous Learning in Autonomous Systems for Video Analytics
Kim, Y., Oh, C., Hwang, J., Kim, W., Oh, S., Lee, Y., Sharma, H., Yazdanbakhsh, A., & Park, J. (2024) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1109/isca59077.2024.00093 · Cited by 20
Quantized Memory-Augmented Neural Networks
Park, S., Kim, S., Lee, S.-I., Bae, H., & Yoon, S. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11704 · Cited by 14
Deep neural network acceleration framework under hardware uncertainty
Imani, M., Wang, P., & Rosing, T. (2018) · International Symposium on Quality Electronic Design (ISQED) · doi:10.1109/isqed.2018.8357318 · Cited by 13
IFQ-Net: Integrated Fixed-Point Quantization Networks for Embedded Vision
Gao, H., Tao, W., Wen, D., Chen, T.-W., Osa, K., & Kato, M. (2018) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2018.00103 · Cited by 13
DSC: Dense-Sparse Convolution for Vectorized Inference of Convolutional Neural Networks
Frickenstein, A., Vemparala, M. R., Unger, C., Ayar, F., & Stechele, W. (2019) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00175 · Cited by 13
Intra-layer nonuniform quantization of convolutional neural network
Sun, F., Lin, J. T., & Wang, Z. (2016) · International Conference on Wireless Communications and Signal Processing (WCSP) · doi:10.1109/wcsp.2016.7752720 · Cited by 13
Quantized Neural Networks: Characterization and Holistic Optimization
Boo, Y., Shin, S., & Sung, W. (2020) · SiPS ... design and implementation - IEEE Workshop on Signal Processing Systems · doi:10.1109/sips50750.2020.9195245 · Cited by 13
How RL Agents Behave When Their Actions Are Modified
Langlois, E. D., & Everitt, T. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i13.17378 · Cited by 5
A framework for designing power-efficient inference accelerators in tree-based learning applications
de Abreu, B. A., Grellert, M., & Bampi, S. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2021.104638 · Cited by 13
Hardware Acceleration of a Generalized Fast 2-D Convolution Method for Deep Neural Networks
Ansari, A., & Ogunfunmi, T. (2022) · IEEE Access · doi:10.1109/access.2022.3149505 · Cited by 14
Mapping YOLOv4-Tiny on FPGA-Based DNN Accelerator by Using Dynamic Fixed-Point Method
Li, P., & Che, C. (2021) · International Symposium on Parallel Architectures, Algorithms and Programming · doi:10.1109/paap54281.2021.9720468 · Cited by 13
GBC: An Energy-Efficient LSTM Accelerator With Gating Units Level Balanced Compression Strategy
Wu, B., Wang, Z., Chen, K., Yan, C., & Liu, W. (2022) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2022.3181975 · Cited by 13
Metadata
- Authors
- Lin, D. D., Talathi, S. S., & Annapureddy, V. S.
- Affiliations
- Qualcomm (United States) (US)
- ORCID
- Talathi, Sachin S.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2015
- Pages
- 2849-2858
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1511.06393
- OpenAlex
- W2286365479
- Cited by
- 684
- References
- 26
- Citations by year
- 2026: 1 · 2025: 21 · 2024: 36 · 2023: 48 · 2022: 71 · 2021: 109 · 2020: 141 · 2019: 130 · 2018: 86 · 2017: 31 · 2016: 10
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- International Conference on Machine Learning
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Numerical Methods and Algorithms
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Keywords
- fixed-point quantization, deep convolutional neural networks, bit-width allocation, quantizer design, model size reduction, fine-tuning, CIFAR-10, image classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review