Deep Convolutional Neural Network Inference with Floating-point Weights and Fixed-point Activations
Open accessAbstract
Deep convolutional neural network (CNN) inference requires significant amount of memory and computation, which limits its deployment on embedded devices. To alleviate these problems to some extent, prior research utilize low precision fixed-point numbers to represent the CNN weights and activations. However, the minimum required data precision of fixed-point weights varies across different networks and also across different layers of the same network. In this work, we propose using floating-point numbers for representing the weights and fixed-point numbers for representing the activations. We show that using floating-point representation for weights is more efficient than fixed-point representation for the same bit-width and demonstrate it on popular large-scale CNNs such as AlexNet, SqueezeNet, GoogLeNet and VGG-16. We also show that such a representation scheme enables compact hardware multiply-and-accumulate (MAC) unit design. Experimental results show that the proposed scheme reduces the weight storage by up to 36% and power consumption of the hardware multiplier by up to 50%.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In hardware implementation, the ReLU function is used more widely than leaky ReLU to express more numbers by removing the sign bit.
“Usually, in HW implementation, the Relu function is used more widely than leaky Relu to express more numbers by removing the sign bit [37].”
From Zero-Centered Fixed-Point Quantization With Iterative Retraining for Deep Convolutional Neural Network-Based Object Detectors (2021) · cites this paper as [37]
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126 · see citing works
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 74,248 · see citing works
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562 · see citing works
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
Iandola, F. N., Han, S., Moskewicz, M. W., Ashraf, K., Dally, W. J., & Keutzer, K. (2016) · arXiv · doi:10.48550/arxiv.1602.07360 · Cited by 6,201 · see citing works
Caffe: Convolutional Architecture for Fast Feature EmbeddingPreprint
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., & Darrell, T. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1408.5093 · Cited by 4,749 · see citing works
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks
Rastegari, M., Ordonez, V., Redmon, J., & Farhadi, A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_32 · Cited by 4,408 · see citing works
Courbariaux, M., Hubara, I., Soudry, D., El-Yaniv, R., & Bengio, Y. (2016) · arXiv · doi:10.48550/arxiv.1602.02830 · Cited by 2,106 · see citing works
DoReFa-Net: Training Low Bitwidth Convolutional Neural Networks with Low Bitwidth Gradients
Zhou, S., Wu, Y., Ni, Z., Zhou, X., Wen, H., & Zou, Y. (2016) · arXiv · doi:10.48550/arxiv.1606.06160 · Cited by 1,690 · see citing works
Deep Learning with Limited Numerical Precision
Gupta, S., Agrawal, A., Gopalakrishnan, K., & Narayanan, P. (2015) · arXiv · doi:10.48550/arxiv.1502.02551 · Cited by 1,364 · see citing works
Going Deeper with Embedded FPGA Platform for Convolutional Neural Network
Qiu, J., Wang, J., Yao, S., Guo, K., Li, B., Zhou, E., Yu, J., Tang, T., Xu, N., Song, S., et al. (2016) · ACM/SIGDA International Symposium on Field-Programmable Gate Arrays (FPGA) · doi:10.1145/2847263.2847265 · Cited by 1,268 · see citing works
BinaryNet: Training Deep Neural Networks with Weights and Activations Constrained to +1 or -1Preprint
Courbariaux, M., & Bengio, Y. (2016) · arXiv (Cornell University) · Cited by 484 · see citing works
Hardware-oriented Approximation of Convolutional Neural Networks
Gysel, P., Motamedi, M., & Ghiasi, S. (2016) · arXiv · doi:10.48550/arxiv.1604.03168 · Cited by 287 · see citing works
Cavigelli, L., Gschwend, D., Mayer, C., Willi, S., Muheim, B., & Luca Benini, C. (2015) · ACM Great Lakes Symposium on VLSI (GLSVLSI) · doi:10.1145/2742060.2743766 · Cited by 156 · see citing works
Accelerating Deep Convolutional Networks using low-precision and sparsity
Venkatesh, G., Nurvitadhi, E., & Marr, D. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7952679 · Cited by 123 · see citing works
Low precision storage for deep learningPreprint
Courbariaux, M., Bengio, Y., & David, J. (2014) · arXiv (Cornell University) · Cited by 120 · see citing works
Ristretto: Hardware-Oriented Approximation of Convolutional Neural NetworksPreprint
Gysel, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.06402 · Cited by 114 · see citing works
Reduced-Precision Strategies for Bounded Memory in Deep Neural NetsPreprint
Judd, P., Albericio, J., Hetherington, T., Aamodt, T. M., Jerger, N. E., Urtasun, R., & Moshovos, A. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.05236 · Cited by 88 · see citing works
The Microsoft 2016 Conversational Speech Recognition SystemPreprint
Xiong, W., Jasha, D., Huang, X., Seide, F. T. B., Seltzer, M., Stolcke, A., Yu, D., & Zweig, G. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.03528 · Cited by 14 · see citing works
Flagged first, then by citations
1 of the 20 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Hello Edge: Keyword Spotting on MicrocontrollersPreprint
Zhang, Y., Suda, N., Lai, L., & Chandra, V. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.07128 · Cited by 356 · see citing works
Self-citationUNPU: An Energy-Efficient Deep Neural Network Accelerator With Fully Variable Weight Bit Precision
Lee, J., Kim, C., Kang, S., Shin, D., Kim, S., & Yoo, H.-J. (2019) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2018.2865489 · Cited by 335 · see citing works
CMSIS-NN: Efficient Neural Network Kernels for Arm Cortex-M CPUsPreprint
Lai, L., Suda, N., & Chandra, V. (2018) · arXiv (Cornell University) · doi:10.4230/oasics.ng-res.2025.4 · Cited by 304 · see citing works
Self-citationDeep Neural Network Approximation for Custom Hardware
Wang, E., Davis, J. J., Zhao, R., Ng, H.-C., Niu, X., Luk, W. W., Cheung, P. Y. K., & Constantinides, G. A. (2019) · ACM Computing Surveys · doi:10.1145/3309551 · Cited by 166 · see citing works
Effnet: An Efficient Structure for Convolutional Neural Networks
Freeman, I., Roese-Koerner, L., & Kummert, A. (2018) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2018.8451339 · Cited by 128 · see citing works
A Survey and Taxonomy of FPGA-based Deep Learning Accelerators
Blaiech, A. G., Ben Khalifa, K., Valderrama, C., Fernandes, M. A. C., & Bedoui, M. H. (2019) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2019.01.007 · Cited by 88 · see citing works
The Effects of Approximate Multiplication on Convolutional Neural Networks
Kim, M. S., Barrio, A. A. D., Kim, H., & Bagherzadeh, N. (2021) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2021.3050989 · Cited by 80 · see citing works
Liu, C., Ding, W., Xia, X., Zhang, B., Gu, J., Liu, J., Ji, R., & Doermann, D. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00280 · Cited by 80 · see citing works
Kim, S., & Kim, H. (2021) · IEEE Access · doi:10.1109/access.2021.3054879 · Cited by 69 · see citing works
“Usually, in HW implementation, the Relu function is used more widely than leaky Relu to express more numbers by removing the sign bit [37].”
MethodRelaxed Quantization for Discretized Neural Networks
Louizos, C., Reisser, M., Blankevoort, T., Gavves, E., & Welling, M. (2018) · UvA-DARE (University of Amsterdam) · doi:10.48550/arxiv.1810.01875 · Cited by 64 · see citing works
A Power-Efficient Optimizing Framework FPGA Accelerator Based on Winograd for YOLO
Bao, C., Xie, T., Feng, W., Chang, L., & Yu, C. (2020) · IEEE Access · doi:10.1109/access.2020.2995330 · Cited by 60 · see citing works
Zhang, H., Chen, D., & Ko, S. (2019) · IEEE Transactions on Computers · doi:10.1109/tc.2019.2936192 · Cited by 58 · see citing works
Shafique, M., Hafiz, R., Javed, M. U., Abbas, S., Sekanina, L., Vašíček, Z., & Mrázek, V. (2017) · IEEE Computer Society Annual Symposium on VLSI · doi:10.1109/isvlsi.2017.124 · Cited by 55 · see citing works
Memory- and Communication-Aware Model Compression for Distributed Deep Learning Inference on IoT
Bhardwaj, K., Lin, C., Sartor, A. L., & Mărculescu, R. (2019) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3358205 · Cited by 50 · see citing works
The Effects of Approximate Multiplication on Convolutional Neural Networks
Kim, M. S., Barrio, A. A. D., Kim, H., & Bagherzadeh, N. (2022) · eScholarship (California Digital Library) · Cited by 53 · see citing works
On-Device Learning Systems for Edge Intelligence: A Software and Hardware Synergy Perspective
Zhou, Q., Qu, Z., Guo, S., Luo, B., Guo, J., Xu, Z., & Akerkar, R. A. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3063147 · Cited by 50 · see citing works
The Heterogeneous Deep Neural Network Processor With a Non-von Neumann Architecture
Shin, D., & Yoo, H. (2019) · Proceedings of the IEEE · doi:10.1109/jproc.2019.2897076 · Cited by 45 · see citing works
Trading-Off Accuracy and Energy of Deep Inference on Embedded Systems: A Co-Design Approach
Jayakodi, N. K., Chatterjee, A., Choi, W., Doppa, J. R., & Pande, P. P. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2018.2857338 · Cited by 36 · see citing works
Dedicated FPGA Implementation of the Gaussian TinyYOLOv3 Accelerator
Ki, S., Park, J., & Kim, H. (2023) · IEEE Transactions on Circuits & Systems II Express Briefs · doi:10.1109/tcsii.2023.3289514 · Cited by 33 · see citing works
IF-CNN: Image-Aware Inference Framework for CNN With the Collaboration of Mobile Devices and Cloud
Shu, G., Liu, W., Zheng, X., & Li, J. (2018) · IEEE Access · doi:10.1109/access.2018.2880196 · Cited by 30 · see citing works
Lee, J., Lee, J., Han, D., Lee, J., Park, G., & Yoo, H. (2019) · IEEE Solid-State Circuits Letters · doi:10.1109/lssc.2019.2937440 · Cited by 28 · see citing works
Convolution Neural Networks: A Comparative Study for Image Classification
Darapaneni, N., Krishnamurthy, B., & Paduri, A. R. (2020) · IEEE International Conference on Industrial and Information Systems (ICIIS) · doi:10.1109/iciis51140.2020.9342667 · Cited by 26 · see citing works
Hardware accelerator systems for artificial intelligence and machine learning
(2020) · Advances in computers · doi:10.1016/bs.adcom.2020.11.005 · Cited by 23 · see citing works
Variable-Precision Approximate Floating-Point Multiplier for Efficient Deep Learning Computation
Zhang, H., & Ko, S. (2022) · IEEE Transactions on Circuits & Systems II Express Briefs · doi:10.1109/tcsii.2022.3161005 · Cited by 23 · see citing works
Li, Z., Kim, S., Im, D., Han, D., & Yoo, H. (2022) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2022.3224964 · Cited by 23 · see citing works
FPGAN: An FPGA Accelerator for Graph Attention Networks With Software and Hardware Co-Optimization
Yan, W., Tong, W., & Zhi, X. (2020) · IEEE Access · doi:10.1109/access.2020.3023946 · Cited by 22 · see citing works
A Review of FPGA‐Based Custom Computing Architecture for Convolutional Neural Network Inference
Xiyuan, P., Yu, J., Yao, B., Liansheng, L., & Peng, Y. (2021) · Chinese Journal of Electronics · doi:10.1049/cje.2020.11.002 · Cited by 22 · see citing works
Modified distributed arithmetic based low complexity CNN architecture design methodology
Panwar, M., Padmini, J., Venkatasubrahmanian, Acharyya, A., & Biswas, D. (2017) · European Conference on Circuit Theory and Design · doi:10.1109/ecctd.2017.8093254 · Cited by 21 · see citing works
The Development of Silicon for AI: Different Design Approaches
Lee, K. J., Lee, J., Choi, S., & Yoo, H. (2020) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2020.2996625 · Cited by 21 · see citing works
End-to-End Keyword Spotting Using Neural Architecture Search and Quantization
Peter, D., Roth, W., & Pernkopf, F. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746535 · Cited by 20 · see citing works
Sateesan, A., Sinha, S., Smitha, K. G., & Vinod, A. P. (2021) · Neural Processing Letters · doi:10.1007/s11063-021-10458-1 · Cited by 19 · see citing works
Stochastic Computing for Low-Power and High-Speed Deep Learning on FPGA
Lammie, C., & Azghadi, M. R. (2019) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2019.8702248 · Cited by 18 · see citing works
Quantization of deep neural networks for accumulator-constrained processors
de Bruin, B., Živković, Z., & Corporaal, H. (2019) · Microprocessors and Microsystems · doi:10.1016/j.micpro.2019.102872 · Cited by 17 · see citing works
Zhou, X., Li, Z., Guo, C., Yin, X., & Zhuo, C. (2020) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas45731.2020.9180844 · Cited by 16 · see citing works
Short floating-point representation for convolutional neural network inference
Kang, H. (2018) · IEICE Electronics Express · doi:10.1587/elex.15.20180909 · Cited by 14 · see citing works
Shivapakash, S., Jain, H., Hellwich, O., & Gerfers, F. (2021) · IEEE Open Journal of Circuits and Systems · doi:10.1109/ojcas.2020.3047225 · Cited by 14 · see citing works
Efficient spiking neural network training and inference with reduced precision memory and computing
Wang, Y., Shahbazi, K., Zhang, H., Oh, K., Lee, J., & Ko, S. (2019) · IET Computers & Digital Techniques · doi:10.1049/iet-cdt.2019.0115 · Cited by 11 · see citing works
Gweon, S., Kang, S., Kim, K., & Yoo, H. (2022) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2022.3182699 · Cited by 11 · see citing works
Tang, S.-N. (2023) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2023.3235776 · Cited by 11 · see citing works
TF2FPGA: A Framework for Projecting and Accelerating Tensorflow CNNs on FPGA Platforms
Mouselinos, S., Leon, V., Xydis, S., Soudris, D., & Pekmestzi, K. (2019) · International Conference on Modern Circuits and Systems Technologies · doi:10.1109/mocast.2019.8741940 · Cited by 11 · see citing works
A Novel Optimized Deep Learning Model for Canola Crop Yield Prediction on Edge Devices
Valarezo-Plaza, S., Torres-Tello, J. W., Singh, K. D., Shirtliffe, S. J., Deivalakshmi, S., & Ko, S. (2024) · IEEE Transactions on AgriFood Electronics · doi:10.1109/tafe.2024.3414953 · Cited by 10 · see citing works
Deep Neural Networks-Based Weight Approximation and Computation Reuse for 2-D Image Classification
Tolba, M. F., Tesfai, H., Saleh, H. H., Mohammad, B. S., & Al‐Qutayri, M. (2022) · IEEE Access · doi:10.1109/access.2022.3161738 · Cited by 10 · see citing works
Performance Analysis of Single-Precision Floating-Point MAC for Deep Learning
Jha, G., & John, E. B. (2018) · IEEE International Midwest Symposium on Circuits and Systems (MWSCAS) · doi:10.1109/mwscas.2018.8624019 · Cited by 9 · see citing works
Energy-Efficient Convolutional Neural Networks via Recurrent Data Reuse
Mocerino, L., Tenace, V., & Calimera, A. (2019) · Design, Automation, and Test in Europe · doi:10.23919/date.2019.8714880 · Cited by 9 · see citing works
Deepika, S., & Arunachalam, V. (2021) · IEEE Transactions on Computers · doi:10.1109/tc.2021.3051627 · Cited by 9 · see citing works
CNN Sensor Analytics With Hybrid-Float6 Quantization on Low-Power Embedded FPGAs
Nevarez, Y., Beering, A., Najafi, A., Najafi, A., Yu, W., Chen, Y., Krieger, K.-L., & García-Ortiz, A. (2023) · IEEE Access · doi:10.1109/access.2023.3235866 · Cited by 9 · see citing works
Rethinking Machine Learning Development and Deployment for Edge DevicesPreprint
Lai, L., & Suda, N. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.07846 · Cited by 9 · see citing works
Self-citationDeepika, S., & Arunachalam, V. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.106953 · Cited by 7 · see citing works
Manikandan, N. (2020) · International Journal of Advanced Trends in Computer Science and Engineering · doi:10.30534/ijatcse/2020/202932020 · Cited by 7 · see citing works
Towards Efficient Motor Imagery EEG-based BCI Systems using DCNN
Al-Saegh, A., Dawwd, S. A., & Abdul-Jabbar, J. M. (2024) · Arab ICT Conference (AICTC) · doi:10.1109/aictc58357.2024.10735028 · Cited by 6 · see citing works
Quantization of Constrained Processor Data Paths Applied to Convolutional Neural Networks
de Bruin, B., Živković, Z., & Corporaal, H. (2018) · Euromicro Conference on Digital System Design (DSD) · doi:10.1109/dsd.2018.00069 · Cited by 5 · see citing works
Wu, C., Wang, M., Li, X., Lu, J., Wang, K., & He, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.02628 · Cited by 5 · see citing works
Reddy, D. V., Rao, M. V. N., Satyanarayana, T. V. V., Babu, T. A., & Reddy, K. V. V. (2025) · Integration · doi:10.1016/j.vlsi.2025.102443 · Cited by 4 · see citing works
Deepika, S., Arunachalam, V., & Raj, A. N. J. (2025) · Microprocessors and Microsystems · doi:10.1016/j.micpro.2025.105146 · Cited by 4 · see citing works
Circulant Binary Convolutional Networks for Object Recognition
Liu, C., Ding, W., Hu, Y. C., Xia, X., Zhang, B., Liu, J., & Doermann, D. (2020) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2020.2969516 · Cited by 4 · see citing works
Resource-Efficient DNNs for Keyword Spotting using Neural Architecture Search and Quantization
Peter, D., Roth, W., & Pernkopf, F. (2021) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr48806.2021.9413191 · Cited by 4 · see citing works
Deploying Customized Data Representation and Approximate Computing in Machine Learning Applications
Nazemi, M., & Pedram, M. (2018) · International Symposium on Low Power Electronics and Design (ISLPED) · doi:10.1145/3218603.3218612 · Cited by 5 · see citing works
A Survey and Comparative Analysis of Number Systems for Deep Neural Networks
Alsuhli, G., Sakellariou, V., Saleh, H., Al-Qutayri, M., Mohammad, B., & Stouraitis, T. (2025) · Proceedings of the IEEE · doi:10.1109/jproc.2025.3578756 · Cited by 5 · see citing works
Wu, J.-S., Wang, C.-E., & Liu, R.-S. (2021) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1145/3394885.3431540 · Cited by 3 · see citing works
Gao, S., Wang, R., Jiang, L., & Zhang, B. (2021) · IEEE Conference on Industrial Electronics and Applications (ICIEA) · doi:10.1109/iciea51954.2021.9516334 · Cited by 3 · see citing works
Hardware accelerator for training with integer backpropagation and probabilistic weight update
Park, H., & Kim, S. (2020) · Advances in computers · doi:10.1016/bs.adcom.2020.11.006 · Cited by 3 · see citing works
Digital Neuron: A Hardware Inference Accelerator for Convolutional Deep Neural NetworksPreprint
Park, H., Kim, D., & Kim, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.07517 · Cited by 3 · see citing works
Multi-Task Network Pruning and Embedded Optimization for Real-time Deployment in ADASPreprint
Dellinger, F., Boulay, T., Barrenechea, D. M., El-Hachimi, S., Leang, I., & Bürger, F. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.07831 · Cited by 3 · see citing works
Enabling Efficient Deep Learning on MCU With Transient Redundancy Elimination
Liu, J., Zhang, F., Guan, J., Sung, H.-H., Guo, X., Long, S., Du, X., & Shen, X. (2024) · IEEE Transactions on Computers · doi:10.1109/tc.2024.3449102 · Cited by 2 · see citing works
Combining Weight Approximation, Sharing and Retraining for Neural Network Model Compression
Kashikar, P., Sentieys, O., & Sinha, S. (2024) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3687466 · Cited by 1 · see citing works
Video Restoration Using Convolutional Neural Networks for Low-Level FPGAs
Hung, K.-W., Qiu, C., & Jiang, J. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-99247-1_22 · Cited by 1 · see citing works
FIXED-POINT ANALYSIS OF MOBILENETS ON KEYWORD SPOTTING
AVRAM, A.-M., Coca, M., & Arseni, Ş.-C. (2019) · International Conference on Informatics in Economy · doi:10.12948/ie2019.01.02
PODALA: Power-Efficient Object Detection Accelerator With Customized Layer Fusion Engine
Yue, T., Chang, L., Xu, H., Wang, C., Lin, S., & Zhou, J. (2024) · Integrated Circuits and Systems · doi:10.23919/ics.2024.3506511 · Cited by 1 · see citing works
How Does Topology of Neural Architectures Impact Gradient Propagation and Model PerformancePreprint
Bhardwaj, K., Li, G., & Mărculescu, R. (2019) · arXiv (Cornell University) · Cited by 1 · see citing works
Enabling Binary Neural Network Training on the EdgePreprint
Wang, E., Davis, J. J., Moro, D., Zieliński, P., Lim, J. J., Coelho, C., Chatterjee, S., Cheung, P. Y. K., & Constantinides, G. A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.04270 · Cited by 1 · see citing works
KML: Using Machine Learning to Improve Storage SystemsPreprint
Akgun, I. U., Aydin, A. S., Burford, A., McNeill, M., Arkhangelskiy, M., Shaikh, A., Velikov, L., & Zadok, E. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.11554 · Cited by 1 · see citing works
A Variable Precision Approach for Deep Neural Networks
Tran, X.-T., Nguyen, D.-A., Bui, D.-H., & Tran, X. (2019) · International Conference on Advanced Technologies for Communications · doi:10.1109/atc.2019.8924549
CloudifierNet - Deep Vision Models for Artificial Image Processing
Damian, A. I., Piciu, L., Purdila, A., & Ţăpuş, N. (2019) · Procedia Computer Science · doi:10.1016/j.procs.2019.12.043
Low Precision Floating-point Arithmetic for High Performance FPGA-based CNN AccelerationPreprint
Wu, C. H., Wang, M., Chu, X., Wang, K., & He, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.03852
Neural Network Pruning for ECG Arrhythmia Classification
Labarge, I. E. (2020) · doi:10.15368/theses.2020.76
Applicability of Minifloats for Efficient Calculations in Neural Networks
Kondrat’ev, A. Y., & Goncharenko, A. (2020) · Optoelectronics Instrumentation and Data Processing · doi:10.3103/s8756699020010100
Activation Distribution-based Layer-wise Quantization for Convolutional Neural Networks
Ki, S., & Kim, H. (2022) · International Conference on Electronics, Information, and Communication (ICEIC) · doi:10.1109/iceic54506.2022.9748745
A Multi-mode Low Energy Consumption System Control and Reliability Evaluation Method
Zhang, Y., Zhao, Y., Lv, Z., Wang, S., & Yang, B. (2023) · International Conference on Smart Electrical Grid and Renewable Energy (SEGRE) · doi:10.1109/segre58867.2023.00077
Vijay, V. A. A., Abhishek, S., & Arunkumar, K. (2024) · International Conference on Innovative Practices in Technology and Management (ICIPTM) · doi:10.1109/iciptm59628.2024.10563484
Calculation of the Sigmoid Activation Function in FPGA Using Rational Fractions
Serhiienko, P. A., Sergiyenko, A., Telenyk, S., & Nowakowski, G. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-63778-0_11
Pham, K. V., Le, L., & Thi, T.-K. T. (2025) · Technical Education Science/Giáo dục Kỹ thuật · doi:10.54644/jte.2025.1537
- Authors
- Lai, L., Suda, N., & Chandra, V.
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2017
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1703.03073
- OpenAlex
- W2595614461
- Cited by
- 81
- References
- 20
- Citations by year
- 2025: 4 · 2024: 7 · 2023: 5 · 2022: 7 · 2021: 13 · 2020: 13 · 2019: 16 · 2018: 13 · 2017: 3
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Low-power high-performance VLSI design
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Numerical Methods and Algorithms
- Keywords
- mixed precision, low-precision arithmetic, embedded devices, power consumption, hardware accelerator design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review