The DOI matches its DataCite record; 18 of the 18 references it cites were found in a registry or an index.
Training deep neural networks with low precision multiplications
Open accessAbstract
Multipliers are the most space and power-hungry arithmetic operators of the digital implementation of deep neural networks. We train a set of state-of-the-art neural networks (Maxout networks) on three benchmark datasets: MNIST, CIFAR-10 and SVHN. They are trained with three distinct formats: floating point, fixed point and dynamic fixed point. For each of those datasets and for each of those formats, we assess the impact of the precision of the multiplications on the final error after training. We find that very low precision is sufficient not just for running trained networks but also for training them. For example, it is possible to train Maxout networks with 10 bits multiplications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Performing the backward pass with floating point is important, as accumulating the gradients in quantized precision can result in zerogradient or gradients that have high error, especially in low-precision [42,80,81,107,159,186,204,231].”
From A Survey of Quantization Methods for Efficient Neural Network Inference (2022) · cites this paper as [42]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“An important work here is BinaryConnect [42] which constrains the weights to either +1 or -1.”
From A Survey of Quantization Methods for Efficient Neural Network Inference (2022) · cites this paper as [42]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Self-citationLearning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,889
Improving neural networks by preventing co-adaptation of feature detectors
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382
Reading digits in natural images with unsupervised feature learning
Netzer, Y. (2024) · doi:10.57702/e7wwo0zk · Cited by 4,261
Large Scale Distributed Deep Networks
Dean, J. B., Corrado, G. S., Monga, R., Chen, K., Devin, M., Mao, M., Ranzato, M., Senior, A., Tucker, P. A., Yang, K., et al. (2012) · Cited by 3,202
What is the best multi-stage architecture for object recognition?
Jarrett, K., Kavukcuoglu, K., Ranzato, M. A., & LeCun, Y. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459469 · Cited by 2,153
DaDianNao: A Machine-Learning Supercomputer
Chen, Y., Luo, T., Liu, S., Zhang, S., He, L., Wang, J., Li, L., Chen, T., Xu, Z., Sun, N., et al. (2014) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2014.58 · Cited by 1,547
Stochastic Pooling for Regularization of Deep Convolutional Neural NetworksPreprint
Zeiler, M. D., & Fergus, R. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.3557 · Cited by 1,010
Deep Learning with Limited Numerical Precision
Gupta, S., Agrawal, A., Gopalakrishnan, K., & Narayanan, P. (2015) · Cited by 757
(2011) · Cited by 713
Research works printed but not linked: 13
- Bastien, F., Lamblin, P., Pascanu, R., Bergstra, J., Goodfellow, I. J., Bergeron, A., Bouchard, N., and Bengio, Y. (2012). Theano: new features and speed improvements. Deep Learning and Unsupervised Feature Learning NIPS 2012 Workshop.
- Bergstra, J., Breuleux, O., Bastien, F., Lamblin, P., Pascanu, R., Desjardins, G., Turian, J., WardeFarley, D., and Bengio, Y. (2010). Theano: a CPU and GPU math expression compiler. In Proceedings of the Python for Scientific Computing Conference (SciPy) . Oral Presentation.
- Chen, T., Du, Z., Sun, N., Wang, J., Wu, C., Chen, Y., and Temam, O. (2014a). Diannao: A smallfootprint high-throughput accelerator for ubiquitous machine-learning. In Proceedings of the 19th international conference on Architectural support for programming languages and operating systems , pages 269-284. ACM.
- Farabet, C., Martini, B., Corda, B., Akselrod, P., Culurciello, E., and LeCun, Y. (2011). Neuflow: A runtime reconfigurable dataflow processor for vision. In Computer Vision and Pattern Recognition Workshops (CVPRW), 2011 IEEE Computer Society Conference on , pages 109-116. IEEE.
- Glorot, X., Bordes, A., and Bengio, Y. (2011). Deep sparse rectifier neural networks. In AISTATS'2011 .
- Goodfellow, I. J., Warde-Farley, D., Mirza, M., Courville, A., and Bengio, Y. (2013a). Maxout networks. Technical Report Arxiv report 1302.4389, Universit´ e de Montr´ eal.
- Goodfellow, I. J., Warde-Farley, D., Lamblin, P., Dumoulin, V., Mirza, M., Pascanu, R., Bergstra, J., Bastien, F., and Bengio, Y. (2013b). Pylearn2: a machine learning research library. arXiv preprint arXiv:1308.4214 . · arXiv
- Holt, J. L. and Baker, T. E. (1991). Back propagation simulations using limited precision calculations. In Neural Networks, 1991., IJCNN-91-Seattle International Joint Conference on , volume 2, pages 121-126. IEEE.
- Krizhevsky, A., Sutskever, I., and Hinton, G. (2012a). ImageNet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems 25 (NIPS'2012) .
- Krizhevsky, A., Sutskever, I., and Hinton, G. (2012b). ImageNet classification with deep convolutional neural networks. In NIPS'2012 .
- Nair, V. and Hinton, G. (2010). Rectified linear units improve restricted Boltzmann machines. In ICML'2010 .
- Pham, P.-H., Jelaca, D., Farabet, C., Martini, B., LeCun, Y., and Culurciello, E. (2012). Neuflow: dataflow vision processing system-on-a-chip. In Circuits and Systems (MWSCAS), 2012 IEEE 55th International Midwest Symposium on , pages 1044-1047. IEEE.
- Williamson, D. (1991//). Dynamically scaled fixed point arithmetic. pages 315 - 18, New York, NY, USA. dynamic scaling;iteration stages;digital filters;overflow probability;fixed point arithmetic;fixed-point filter;.
Cited by
Sorted by citations
Items 201–300 of 410
Fast Compression and Optimization of Deep Learning Models for Natural Language Processing
Pietroń, M., Karwatowski, M., Wielgosz, M., & Duda, J. (2019) · International Symposium on Computing and Networking Workshops (CANDARW) · doi:10.1109/candarw.2019.00036 · Cited by 10
Niknia, F., Wang, Z., Liu, S., Reviriego, P., Louri, A., & Lombardi, F. (2024) · IEEE Transactions on Nanotechnology · doi:10.1109/tnano.2024.3367916 · Cited by 10
Learning Sparse Filters in Deep Convolutional Neural Networks with a $$l_1/l_2$$ Pseudo-Norm
Berthelier, A., Yan, Y., Château, T., Blanc, C., Duffner, S., & García, C. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-68763-2_50 · Cited by 11
Managing the Performance/Error Tradeoff of Floating-point Intensive Applications
Medhat, R., Lam, M. O., Rountree, B., Bonakdarpour, B., & Fischmeister, S. (2017) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3126519 · Cited by 9
Characterizing the Execution of Deep Neural Networks on Collaborative Robots and Edge Devices
Merck, M. L., Wang, B., Liu, L., Jia, C., Siqueira, A., Huang, Q., Saraha, A., Lim, D., Cao, J., Hadidi, R., et al. (2019) · Practice and Experience in Advanced Research Computing · doi:10.1145/3332186.3333049 · Cited by 9
FPCAS: In-Memory Floating Point Computations for Autonomous Systems
Ensan, S. S., & Ghosh, S. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852109 · Cited by 9
Reduced-Order Modeling of Deep Neural Networks
Gusak, J., Daulbaev, T., Ponomarev, E., Cichocki, A. S., & Oseledets, I. V. (2021) · Computational Mathematics and Mathematical Physics · doi:10.1134/s0965542521050109 · Cited by 9
An Efficient Binary Convolutional Neural Network With Numerous Skip Connections for Fog Computing
Wu, L., Lin, X., Chen, Z., Huang, J., Liu, H., & Yang, Y. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3052105 · Cited by 9
MASCOT: A Quantization Framework for Efficient Matrix Factorization in Recommender Systems
Ko, Y., Yu, J.-S., Bae, H.-K., Park, Y., Lee, D., & Kim, S. (2021) · Proceedings · doi:10.1109/icdm51629.2021.00039 · Cited by 9
Bird Sound Detection Based on Binarized Convolutional Neural Networks
Song, J., & Li, S. (2019) · Lecture notes in electrical engineering · doi:10.1007/978-981-13-8707-4_6 · Cited by 9
Fooling a Complete Neural Network Verifier
Zombori, D., Bánhelyi, B., Csendes, T., Megyeri, I., & Jelasity, M. (2021) · SZTE Publicatio Repozitórium (University of Szeged) · Cited by 9
Running sparse and low-precision neural network: when algorithm meets hardware
Li, B., Wen, W., Mao, J., Li, S., Chen, Y., & Li, H. H. (2018) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.5555/3201607.3201733 · Cited by 8
Training Neural Networks with Low Precision Dynamic Fixed-Point
Jo, S., Park, H., Lee, G., & Choi, K. (2018) · IEEE International Conference on Computer Design: VLSI in Computers and Processors (ICCD) · doi:10.1109/iccd.2018.00067 · Cited by 9
NeuroPilot: A Cross-Platform Framework for Edge-AI
Chen, T.-C., Wang, W., Kao, K., Yu, C.-L., Lin, C., Chang, S.-H., & Tsung, P.-K. (2019) · IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS) · doi:10.1109/aicas.2019.8771536 · Cited by 8
Organ segmentation from full-size CT images using memory-efficient FCN
Wang, C., Oda, M., & Mori, K. (2020) · SPIE Medical Imaging: Computer-Aided Diagnosis · doi:10.1117/12.2551024 · Cited by 8
Euler, H.-C. R., Alegre-Ibarra, U., van de Ven, B., Broersma, H. J., Bobbert, P. A., & van der Wiel, W. G. (2021) · Neuromorphic Computing and Engineering · doi:10.1088/2634-4386/ac1a7f · Cited by 11
E2BNet: MAC-free yet accurate 2-level binarized neural network accelerator for embedded systems
Mirsalari, S. A., Nazari, N., Ansarmohammadi, S. A., Salehi, M. E., & Ghiasi, S. (2021) · Journal of Real-Time Image Processing · doi:10.1007/s11554-021-01148-1 · Cited by 8
Model Pruning Techniques for Boosting the Inference Efficiency on Embedded Systems
Zhang, Z. (2021) · 2021 2nd International Conference on Computing and Data Science (CDS) · doi:10.1109/cds52072.2021.00027 · Cited by 8
Rotation Invariant Local Binary Convolution Neural Networks
Zhang, X., Xie, Y., Chen, J., Wu, L., Ye, Q., & Liu, L. (2018) · IEEE Access · doi:10.1109/access.2018.2818887 · Cited by 9
Malik, A. M., Lu, M., Wang, N., Lin, Y., & Yoo, S. (2018) · New York Scientific Data Summit (NYSDS) · doi:10.1109/nysds.2018.8538946 · Cited by 9
A Resource-Efficient Embedded Iris Recognition System Using Fully Convolutional Networks
Tann, H., Zhao, H., & Reda, S. (2019) · ACM Journal on Emerging Technologies in Computing Systems · doi:10.1145/3357796 · Cited by 8
The Efficient Implementation of Face Mask Detection Using MobileNet
Zhou, Y. (2022) · Journal of Physics Conference Series · doi:10.1088/1742-6596/2181/1/012022 · Cited by 8
Matrix and tensor decompositions for training binary neural networksPreprint
Bulat, A., Kossaifi, J., Tzimiropoulos, G., & Pantić, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.07852 · Cited by 12
Term Revealing: Furthering Quantization at Run Time on Quantized DNNsPreprint
Kung, H. T., McDanel, B., & Zhang, S. Q. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.06389 · Cited by 12
Revisiting BFloat16 TrainingPreprint
Zamirai, P., Zhang, J., Aberger, C. R., & De, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.06192 · Cited by 39
On-Device Deep Learning: Survey on Techniques Improving Energy Efficiency of DNNs
Boumendil, A., Bechkit, W., & Benatchba, K. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3430028 · Cited by 9
Biswas, S., Mamun, A. A., Islam, M. S., & Bappy, M. M. (2025) · Manufacturing Letters · doi:10.1016/j.mfglet.2025.06.015 · Cited by 8
Park, H., & Choi, K. (2019) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1145/3287624.3287721 · Cited by 6
Mixed-Precision Quantization of U-Net for Medical Image Segmentation
Guo, L., Fei, W., Dai, W., Li, C., Zou, J., & Xiong, H. (2022) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas48785.2022.9937283 · Cited by 7
A dynamic fixed-point representation for neuromorphic computing systems
Kang, Y.-S., & Chung, J. (2017) · International SoC Design Conference · doi:10.1109/isocc.2017.8368819 · Cited by 7
West: Word Encoded Sequence Transducers
Variani, E., Suresh, A. T., & Weintraub, M. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8683694 · Cited by 7
Energy-Efficient Design of Advanced Machine Learning Hardware
Hanif, M. A., Hafiz, R., Javed, M. U., Rehman, S., & Shafique, M. (2019) · Springer eBooks · doi:10.1007/978-3-030-04666-8_21 · Cited by 7
Shallow SqueezeNext: An Efficient & Shallow DNN
Duggal, J. K., & El‐Sharkawy, M. (2019) · IEEE International Conference on Vehicular Electronics and Safety (ICVES) · doi:10.1109/icves.2019.8906416 · Cited by 7
Multiple-Precision BLAS Library for Graphics Processing Units
Исупов, К. С., & Сергеевич, К. В. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-64616-5_4 · Cited by 7
Weak-MAC: Arithmetic Relaxation for Dynamic Energy-Accuracy Scaling in ConvNets
Peluso, V., & Calimera, A. (2018) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2018.8351494 · Cited by 7
ClosNets: Batchless DNN Training with On-Chip a Priori Sparse Neural Topologies
Isakov, M., Ehret, A., & Kinsy, M. A. (2018) · International Conference on Field Programmable Logic and Applications (FPL) · doi:10.1109/fpl.2018.00017 · Cited by 7
Haghi, P., Kamal, M., Afzali‐Kusha, A., & Pedram, M. (2020) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2020.2986350 · Cited by 7
Integrating Deep Learning in Domain Sciences at Exascale
Archibald, R. K., Chow, E., D'Azevedo, E. F., Dongarra, J. J., Eisenbach, M., Febbo, R., Lopez, F., Nichols, D., Tomov, S. Z., Wong, K. L., et al. (2020) · Communications in computer and information science · doi:10.1007/978-3-030-63393-6_3 · Cited by 7
Zhu, J., Qian, Z., & Tsui, C.-Y. (2017) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/aspdac.2017.7858404 · Cited by 6
FixCaffe: Training CNN with Low Precision Arithmetic Operations by Fixed Point Caffe
Guo, S., Wang, L., Chen, B., Dou, Q., Tang, Y., & Li, Z. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-67952-5_4 · Cited by 7
Quad-multiplier packing based on customized floating point for convolutional neural networks on FPGA
Zhang, Z., Zhou, D., Wang, S., & Kimura, S. (2018) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/aspdac.2018.8297303 · Cited by 7
Evaluating performance of AI operators using roofline model
Chen, Z., Zheng, F., Yu, Q., Sun, R., Guo, F., & Chen, Z. (2021) · Applied Intelligence · doi:10.1007/s10489-021-02794-5 · Cited by 6
Adaptive Semantic Token Selection for AI-native Goal-oriented Communications
Devoto, A., Pomponi, J., Petruzzi, S., Lorenzo, P. D., & Scardapane, S. (2024) · IEEE Globecom Workshops (GC Wkshps) · doi:10.1109/gcwkshp64532.2024.11100347 · Cited by 9
A Decomposable Winograd Method for N–D Convolution Acceleration in Video Analysis
Huang, D., Zhang, R., Zhang, X., Wu, F., Wang, X., Jin, P., Liu, S., Li, L., & Chen, Y. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01500-9 · Cited by 6
Ghosh, R. (2021) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-021-00518-2 · Cited by 7
Reminding forgetful organic neuromorphic device networks
Felder, D., Muche, K., Linkhorst, J., & Wessling, M. (2022) · Neuromorph. Comput. Eng. · doi:10.1088/2634-4386/ac9c8a · Cited by 6
Highly-Efficient Binary Neural Networks for Visual Place Recognition
Ferrarini, B., Milford, M. J., McDonald-Maier, K. D., & Ehsan, S. (2022) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros47612.2022.9981978 · Cited by 6
Multi-Scale Dynamic Fixed-Point Quantization and Training for Deep Neural Networks
Chen, P., Lin, H.-C., & Guo, J.-I. (2023) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas46773.2023.10181358 · Cited by 6
Adam, S. P., Magoulas, G. D., Karras, D. A., & Vrahatis, M. N. (2016) · BIROn (Birkbeck, University of London) · Cited by 6
Low cost and power CNN/deep learning solution for automated driving
Mody, M., Desappan, K., Swami, P., Mathew, M., & Nagori, S. (2018) · International Symposium on Quality Electronic Design (ISQED) · doi:10.1109/isqed.2018.8357325 · Cited by 6
Heterogeneous Computing for Edge AI
Tsung, P.-K., Chen, T.-C., Lin, C., Chang, C., & Hsu, J.-M. (2019) · International Symposium on VLSI Design, Automation and Test · doi:10.1109/vlsi-dat.2019.8741613 · Cited by 8
Automated Synthesis of Energy-Efficient Reconfigurable-Precision Circuits
Pagliari, D. J., Macii, E., & Poncino, M. (2019) · IEEE Access · doi:10.1109/access.2019.2956679 · Cited by 7
Fine-Grained Exploitation of Mixed Precision for Faster CNN Training
Johnston, J., Young, S. R., Schuman, C. D., Chae, J., March, D. D., Patton, R. M., & Potok, T. E. (2019) · Workshop on Machine Learning in HPC Environments · doi:10.1109/mlhpc49564.2019.00007 · Cited by 6
Towards Deep Learning on Resource-Constrained Robots: A Crowdsourcing Approach with Model Partition
Huai, Z., Ding, B., Wang, H., Geng, M., & Zhang, L. (2019) · IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI) · doi:10.1109/smartworld-uic-atc-scalcom-iop-sci.2019.00194 · Cited by 6
IVS-Caffe—Hardware-Oriented Neural Network Model Development
Tsai, C., & Guo, J.-I. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3072145 · Cited by 6
CNN Inference: Dynamic and Predictive Quantization
Desappan, K., Mody, M., Mathew, M., Swami, P., & Eppa, P. (2018) · IEEE International Conference on Consumer Electronics - Berlin (ICCE-Berlin) · doi:10.1109/icce-berlin.2018.8576251 · Cited by 6
Rios, J. H. O., Armejach, A., Khattak, G. R., Petit, E., Vallecorsa, S., & Casas, M. (2020) · International Conference on Machine Learning and Applications · doi:10.1109/icmla51294.2020.00017 · Cited by 7
Fast Adjustable Threshold For Uniform Neural Network Quantization (Winning solution of LPIRC-II)Preprint
Goncharenko, A., Denisov, A., Alyamkin, S. A., & Terentev, E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.07872 · Cited by 6
Hypercolumn Sparsification for Low-Power Convolutional Neural Networks
Pilly, P. K., Stepp, N. D., Liapis, Y., Payton, D. W., & Srinivasa, N. (2019) · ACM Journal on Emerging Technologies in Computing Systems · doi:10.1145/3304104 · Cited by 5
Accelerating winograd convolutions using symbolic computation and meta-programming
Mazaheri, A., Beringer, T., Moskewicz, M. W., Wolf, F., & Jannesari, A. (2020) · European Conference on Computer Systems · doi:10.1145/3342195.3387549 · Cited by 5
DivNet: Efficient Convolutional Neural Network via Multilevel Hierarchical Architecture Design
Kaddar, B., Fizazi, H., Hernández-Cabronero, M., Sánchez, V., & Serra-Sagrista, J. S. (2021) · IEEE Access · doi:10.1109/access.2021.3099952 · Cited by 5
A review of in-memory computing for machine learning: architectures, options
Snåšel, V., Dang, T. K., Kueng, J., & Kong, L. (2023) · International Journal of Web Information Systems · doi:10.1108/ijwis-08-2023-0131 · Cited by 6
QBitOpt: Fast and Accurate Bitwidth Reallocation during Training
Peters, J. W. T., Fournarakis, M., Nagel, M., van Baalen, M., & Blankevoort, T. (2023) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw60793.2023.00138 · Cited by 6
Adaptive Precision Cellular Nonlinear Network
Kung, J., Kim, D.-H., & Mukhopadhyay, S. (2018) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2018.2794498 · Cited by 6
Energy-Driven Precision Scaling for Fixed-Point ConvNets
Peluso, V., & Calimera, A. (2018) · IFIP/IEEE International Conference on Very Large Scale Integration · doi:10.1109/vlsi-soc.2018.8644902 · Cited by 5
Visual Confusion Label Tree for Image Classification
Liu, Y., Dou, Y., Jin, R., & Li, R. (2018) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2018.8486612 · Cited by 5
Quantization of Constrained Processor Data Paths Applied to Convolutional Neural Networks
de Bruin, B., Živković, Z., & Corporaal, H. (2018) · Euromicro Conference on Digital System Design (DSD) · doi:10.1109/dsd.2018.00069 · Cited by 5
Instant Quantization of Neural Networks using Monte Carlo Methods
Mordido, G., Keirsbilck, M. V., & Keller, A. (2019) · Workshop on Energy Efficient Machine Learning and Cognitive Computing for Embedded Applications (EMC2) · doi:10.1109/emc2-nips53020.2019.00014 · Cited by 7
Evaluation of End-to-End Learning for Autonomous Driving: The Good, the Bad and the Ugly
Varisteas, G., Frank, R., Sajadi-Alamdari, S. A., Voos, H., & State, R. (2019) · Intelligent Autonomous Systems · doi:10.1109/icoias.2019.00026 · Cited by 5
Wu, C., Wang, M., Li, X., Lu, J., Wang, K., & He, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.02628 · Cited by 5
Hadidi, R., Asgari, B., Cao, J., Bae, Y., Shim, D. E., Kim, H., Lim, S. K., Ryoo, M. S., & Kim, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.06464 · Cited by 6
FPGA Acceleration of Dynamic Neural Networks: Challenges and Advancements
Dimitriou, A., Biggs, B., Hare, J. S., & Merrett, G. V. (2024) · IEEE International Conference on Omni-layer Intelligent Systems (COINS) · doi:10.1109/coins61597.2024.10622127 · Cited by 4
Emergent Quantized Communication
Carmeli, B., Meir, R., & Belinkov, Y. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i10.26363 · Cited by 11
Ding, J., Wu, J., & Wu, H. (2017) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai.2017.00021 · Cited by 4
Resource Efficient Deep Eigenvector Beamforming
Zöhrer, M., Pfeifenberger, L., Schindler, G., Fröning, H., & Pernkopf, F. (2018) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2018.8462503 · Cited by 4
Torres, V. F., & Torres, F. S. (2019) · IET Computers & Digital Techniques · doi:10.1049/iet-cdt.2019.0036 · Cited by 4
Runtime Long-Term Reliability Management Using Stochastic Computing in Deep Neural Networks
Liu, Y., Yu, S., Peng, S., & Tan, S. X.-D. (2021) · International Symposium on Quality Electronic Design (ISQED) · doi:10.1109/isqed51717.2021.9424285 · Cited by 4
A tile-fusion method for accelerating Winograd convolutions
Ji, Z., Zhang, X., Wei, Z., Li, J., & Wei, J. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.06.003 · Cited by 4
Zhou, X., Liu, K., Shi, C., Liu, H., & Liu, J. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i4.16474 · Cited by 4
Mozafari, S. H., Clark, J. J., Gross, W. J., & Meyer, B. H. (2021) · IEEE Open Journal of Circuits and Systems · doi:10.1109/ojcas.2021.3123899 · Cited by 4
Efficient hardware acceleration for approximate inference of bitwise deep neural networks
Vogel, S., Guntoro, A., & Ascheid, G. (2017) · Conference on Design and Architectures for Signal and Image Processing · doi:10.1109/dasip.2017.8122127 · Cited by 4
Energy and Error Reduction using Variable Bit-width Optimization on Dynamic Fixed Point Format
Gao, M., Wang, Q., & Qu, G. (2019) · IEEE Computer Society Annual Symposium on VLSI · doi:10.1109/isvlsi.2019.00036 · Cited by 4
Deep learning based defect inspetion in TFT-LCD rib depth detection
Ho, C.-C., Wang, H.-P., & Chiao, Y.-C. (2021) · Measurement Sensors · doi:10.1016/j.measen.2021.100198 · Cited by 4
Computational Cost Reduction in Learned Transform ClassificationsPreprint
Machado, E. L., Miosso, C. J., von Borries, R. F., Coutinho, M., Berger, P. D. A., Marques, T., & Jacobi, R. P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.06779 · Cited by 6
Training for 'Unstable' CNN Accelerator:A Case Study on FPGAPreprint
Xing, K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.01689 · Cited by 4
A Survey and Comparative Analysis of Number Systems for Deep Neural Networks
Alsuhli, G., Sakellariou, V., Saleh, H., Al-Qutayri, M., Mohammad, B., & Stouraitis, T. (2025) · Proceedings of the IEEE · doi:10.1109/jproc.2025.3578756 · Cited by 5
Semantic Labeling Using a Low-Power Neuromorphic Platform
Tang, J., Mashford, B. S., & Yepes, A. J. (2018) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2018.2834522 · Cited by 3
Arias-García, J., de Souza, A. C., Gade, L., Yudi, J., Coelho, F. G. F., de Castro, C. L., Torres, L. C. B., & Braga, A. P. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3183236 · Cited by 3
AMANet: An Adaptive Memory Attention Network for video cloud detection
Luo, C., Feng, S., Quan, Y., Ye, Y., Xu, Y. D., Li, X., & Zhang, B. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110616 · Cited by 3
Exploring FPGA designs for MX and beyond
Samson, E., Mellempudi, N., Luk, W. W., & Constantinides, G. A. (2024) · International Conference on Field Programmable Logic and Applications (FPL) · doi:10.1109/fpl64840.2024.00049 · Cited by 3
Quantization of Weights of Trained Neural Network by Correlation Maximization Method
Pushkareva, M. M., & Karandashev, I. (2020) · Studies in computational intelligence · doi:10.1007/978-3-030-60577-3_43 · Cited by 3
Lower Precision calculation for option pricing
Ścibisz-Mordelska, K. (2017) · Computer Science · doi:10.7494/csci.2017.18.4.2361 · Cited by 3
Rivas-Gomez, S., Fanfarillo, A., Narasimhamurthy, S., & Markidis, S. (2019) · European MPI Users' Group Meeting (EuroMPI) · doi:10.1145/3343211.3343214 · Cited by 3
Auto-Precision Scaling for Distributed Deep Learning
Han, R., Demmel, J. W., & You, Y. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-78713-4_5 · Cited by 5
Multiple-precision matrix-vector multiplication on graphics processing units
Исупов, К. С., & Сергеевич, К. В. (2020) · Program systems theory and applications · doi:10.25209/2079-3316-2020-11-3-61-84 · Cited by 3
Foumani, S. N. A., Guo, C., & Luk, W. W. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.02784 · Cited by 3
Numerical influence of ReLU'(0) on backpropagationPreprint
Bertoin, D., Bolte, J., Gerchinovitz, S., & Pauwels, E. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.12915 · Cited by 5
BitTrain: Sparse Bitmap Compression for Memory-Efficient Training on the EdgePreprint
Hosny, A., Neseem, M., & Reda, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.15362 · Cited by 4
Modulation Recognition Based on Lightweight Residual Network via Binary Quantization
Ji, H., Xu, W., Gan, L., & Xu, Z. (2021) · IEEE International Conference on Computer and Communications (ICCC) · doi:10.1109/iccc54389.2021.9674598 · Cited by 2
Optimizing machine learning logic circuits with constant signal propagation
Berndt, A., Meinhardt, C., Reis, A. I., & Butzen, P. F. (2022) · Integration · doi:10.1016/j.vlsi.2022.08.004 · Cited by 2
Metadata
- Authors
- Courbariaux, M., Bengio, Y., & David, J.-P.
- Affiliations
- Polytechnique Montréal (CA)
- Université de Montréal (CA)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2014
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1412.7024
- OpenAlex
- W1825672851
- Cited by
- 407
- References
- 18
- Citations by year
- 2025: 12 · 2024: 17 · 2023: 23 · 2022: 30 · 2021: 65 · 2020: 64 · 2019: 80 · 2018: 62 · 2017: 36 · 2016: 15 · 2015: 2 · 2014: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- PolyPublie (École Polytechnique de Montréal) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Canadian Institute for Advanced Research
- Compute Canada
- Canada Research Chairs
- Natural Sciences and Engineering Research Council of Canada
- Topics
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Numerical Methods and Algorithms
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Low-power high-performance VLSI design
- Keywords
- low-precision arithmetic, deep neural network training, fixed-point arithmetic, floating-point precision, energy-efficient neural networks, MNIST, CIFAR-10, SVHN
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
