The DOI matches its DataCite record; 18 of the 18 references it cites were found in a registry or an index.
Training deep neural networks with low precision multiplications
Open accessAbstract
Multipliers are the most space and power-hungry arithmetic operators of the digital implementation of deep neural networks. We train a set of state-of-the-art neural networks (Maxout networks) on three benchmark datasets: MNIST, CIFAR-10 and SVHN. They are trained with three distinct formats: floating point, fixed point and dynamic fixed point. For each of those datasets and for each of those formats, we assess the impact of the precision of the multiplications on the final error after training. We find that very low precision is sufficient not just for running trained networks but also for training them. For example, it is possible to train Maxout networks with 10 bits multiplications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Performing the backward pass with floating point is important, as accumulating the gradients in quantized precision can result in zerogradient or gradients that have high error, especially in low-precision [42,80,81,107,159,186,204,231].”
From A Survey of Quantization Methods for Efficient Neural Network Inference (2022) · cites this paper as [42]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“An important work here is BinaryConnect [42] which constrains the weights to either +1 or -1.”
From A Survey of Quantization Methods for Efficient Neural Network Inference (2022) · cites this paper as [42]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Self-citationLearning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,889
Improving neural networks by preventing co-adaptation of feature detectors
Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. R. (2012) · arXiv · doi:10.48550/arxiv.1207.0580 · Cited by 6,382
Reading digits in natural images with unsupervised feature learning
Netzer, Y. (2024) · doi:10.57702/e7wwo0zk · Cited by 4,261
Large Scale Distributed Deep Networks
Dean, J. B., Corrado, G. S., Monga, R., Chen, K., Devin, M., Mao, M., Ranzato, M., Senior, A., Tucker, P. A., Yang, K., et al. (2012) · Cited by 3,202
What is the best multi-stage architecture for object recognition?
Jarrett, K., Kavukcuoglu, K., Ranzato, M. A., & LeCun, Y. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459469 · Cited by 2,153
DaDianNao: A Machine-Learning Supercomputer
Chen, Y., Luo, T., Liu, S., Zhang, S., He, L., Wang, J., Li, L., Chen, T., Xu, Z., Sun, N., et al. (2014) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro.2014.58 · Cited by 1,547
Stochastic Pooling for Regularization of Deep Convolutional Neural NetworksPreprint
Zeiler, M. D., & Fergus, R. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.3557 · Cited by 1,010
Deep Learning with Limited Numerical Precision
Gupta, S., Agrawal, A., Gopalakrishnan, K., & Narayanan, P. (2015) · Cited by 757
(2011) · Cited by 713
Research works printed but not linked: 13
- Bastien, F., Lamblin, P., Pascanu, R., Bergstra, J., Goodfellow, I. J., Bergeron, A., Bouchard, N., and Bengio, Y. (2012). Theano: new features and speed improvements. Deep Learning and Unsupervised Feature Learning NIPS 2012 Workshop.
- Bergstra, J., Breuleux, O., Bastien, F., Lamblin, P., Pascanu, R., Desjardins, G., Turian, J., WardeFarley, D., and Bengio, Y. (2010). Theano: a CPU and GPU math expression compiler. In Proceedings of the Python for Scientific Computing Conference (SciPy) . Oral Presentation.
- Chen, T., Du, Z., Sun, N., Wang, J., Wu, C., Chen, Y., and Temam, O. (2014a). Diannao: A smallfootprint high-throughput accelerator for ubiquitous machine-learning. In Proceedings of the 19th international conference on Architectural support for programming languages and operating systems , pages 269-284. ACM.
- Farabet, C., Martini, B., Corda, B., Akselrod, P., Culurciello, E., and LeCun, Y. (2011). Neuflow: A runtime reconfigurable dataflow processor for vision. In Computer Vision and Pattern Recognition Workshops (CVPRW), 2011 IEEE Computer Society Conference on , pages 109-116. IEEE.
- Glorot, X., Bordes, A., and Bengio, Y. (2011). Deep sparse rectifier neural networks. In AISTATS'2011 .
- Goodfellow, I. J., Warde-Farley, D., Mirza, M., Courville, A., and Bengio, Y. (2013a). Maxout networks. Technical Report Arxiv report 1302.4389, Universit´ e de Montr´ eal.
- Goodfellow, I. J., Warde-Farley, D., Lamblin, P., Dumoulin, V., Mirza, M., Pascanu, R., Bergstra, J., Bastien, F., and Bengio, Y. (2013b). Pylearn2: a machine learning research library. arXiv preprint arXiv:1308.4214 . · arXiv
- Holt, J. L. and Baker, T. E. (1991). Back propagation simulations using limited precision calculations. In Neural Networks, 1991., IJCNN-91-Seattle International Joint Conference on , volume 2, pages 121-126. IEEE.
- Krizhevsky, A., Sutskever, I., and Hinton, G. (2012a). ImageNet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems 25 (NIPS'2012) .
- Krizhevsky, A., Sutskever, I., and Hinton, G. (2012b). ImageNet classification with deep convolutional neural networks. In NIPS'2012 .
- Nair, V. and Hinton, G. (2010). Rectified linear units improve restricted Boltzmann machines. In ICML'2010 .
- Pham, P.-H., Jelaca, D., Farabet, C., Martini, B., LeCun, Y., and Culurciello, E. (2012). Neuflow: dataflow vision processing system-on-a-chip. In Circuits and Systems (MWSCAS), 2012 IEEE 55th International Midwest Symposium on , pages 1044-1047. IEEE.
- Williamson, D. (1991//). Dynamically scaled fixed point arithmetic. pages 315 - 18, New York, NY, USA. dynamic scaling;iteration stages;digital filters;overflow probability;fixed point arithmetic;fixed-point filter;.
Cited by
Sorted by citations
Items 301–400 of 410
Effect of Weight Quantization on Learning Models by Typical Case Analysis
Kashiwamura, S., Sakata, A., & Imaizumi, M. (2024) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit57864.2024.10619223 · Cited by 2
Accelerating Position-Aware Top-k ListNet for Ranking Under Custom Precision Regimes
Li, Q., Wang, E., Fleming, S. T., Thomas, D. B., & Cheung, P. Y. K. (2019) · International Conference on Field Programmable Logic and Applications (FPL) · doi:10.1109/fpl.2019.00022 · Cited by 2
Monte Carlo method based precision analysis of deep convolution nets
Krutsch, R., & Sharath, N. (2016) · Conference on Design and Architectures for Signal and Image Processing · doi:10.1109/dasip.2016.7853814 · Cited by 2
Minati, L., Movsisyan, V., McCormick, M. M., Gyozalyan, K., Papazyan, T., Makaryan, H., Aldrigo, S., Harutyunyan, T., Ghaltaghchyan, H., Mccormick, C., et al. (2019) · IEEE Access · doi:10.1109/access.2019.2934715 · Cited by 4
On Practical Approach to Uniform Quantization of Non-redundant Neural Networks
Goncharenko, A., Denisov, A., Alyamkin, S. A., & Terentev, E. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-30484-3_29 · Cited by 2
Recurrent Neural Network Compression Based on Low-Rank Tensor Representation
Tjandra, A., Sakti, S., & Nakamura, S. (2020) · IEICE Transactions on Information and Systems · doi:10.1587/transinf.2019edp7040 · Cited by 2
Trainable Thresholds for Neural Network Quantization
Goncharenko, A., Denisov, A., Alyamkin, S. A., & Terentev, E. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-20518-8_26 · Cited by 2
Efficient Residual Network Compression for Optimizing the Accuracy-Complexity Tradeoff
Luo, A., Huang, B., Li, Y., Lu, C. H., Wang, R., Huang, Z., & Zhou, Y. (2021) · International Symposium on Computer Engineering and Intelligent Communications (ISCEIC) · doi:10.1109/isceic53685.2021.00022 · Cited by 2
Quantization and Pipelined Hardware Implementation of Deep Neural Network Models
Tourad, E. H. C., & Eleuldj, M. (2022) · Journal of Computer Science · doi:10.3844/jcssp.2022.1021.1029 · Cited by 2
Design and Implementation of Reconfigurable Neural Network Accelerator
Shenoy, M. S., & Kini, M. R. (2022) · IEEE International Conference on Recent Advances and Innovations in Engineering (ICRAIE) · doi:10.1109/icraie56454.2022.10054301 · Cited by 2
Iterative eigensolver using fixed-point photonic primitive
Klein, A. B., Zhu, Z., Saiham, D., Li, G., & Pang, S. (2023) · Optics Letters · doi:10.1364/ol.506704 · Cited by 2
NaviSplit: Dynamic Multi-Branch Split DNNs for Efficient Distributed Autonomous Navigation
Johnsen, T. K., Harshbarger, I. A., Xia, Z., & Levorato, M. (2024) · IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks (WoWMoM) · doi:10.1109/wowmom60985.2024.00041 · Cited by 2
Margin-Aware Binarized Weight Networks for Image Classification
Xu, T.-B., Yang, P., Zhang, X.-Y., & Liu, C. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-71607-7_52 · Cited by 3
DNN Feature Map Compression using Learned Representation over GF(2)Preprint
Gudovskiy, D., Hodgkinson, A., & Rigazio, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.05285 · Cited by 2
Deep Grassmann Manifold Optimization for Computer Vision
Minnehan, B. (2019) · RIT Scholar Works (Rochester Institute of Technology) · Cited by 2
Automatic Generation of Multi-precision Multi-arithmetic CNN Accelerators for FPGAsPreprint
Zhao, Y., Gao, X., Guo, X., Liu, J., Wang, E., Mullins, R., Cheung, P. Y. K., Constantinides, G. A., & Xu, C. (2019) · arXiv (Cornell University) · doi:10.17863/cam.46508 · Cited by 2
Deep Learning in Memristive Nanowire NetworksPreprint
Kendall, J. D., Pantone, R. D., & Nino, J. C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.02642 · Cited by 3
Generative Design of Hardware-aware DNNsPreprint
Kao, S.-C., Ramamurthy, A., & Krishna, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.03968 · Cited by 2
A Very Compact Embedded CNN Processor Design Based on Logarithmic ComputingPreprint
Lu, T.-Y., Chin, H.-H., Wu, H., & Tsay, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.11686 · Cited by 3
How Low Can We Go: Trading Memory for Error in Low-Precision TrainingPreprint
Yang, C., Wu, Z., Chee, J., De, C., & Udell, M. R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.09686 · Cited by 3
VeriDL: Integrity Verification of Outsourced Deep Learning Services (Extended Version)Preprint
Dong, B., Zhang, B., Hui, H., & Wang (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.00495 · Cited by 2
Masked LARk: Masked Learning, Aggregation and Reporting worKflowPreprint
Pfeiffer, J. J., Charles, D. X., Gilton, D., Jung, Y. H., Parsana, M., & Anderson, E. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.14794 · Cited by 7
Finding the SWEET Spot: Analysis and Improvement of Adaptive Inference in Low Resource Settings
Rotem, D., Hassid, M., Mamou, J., & Schwartz, R. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.829 · Cited by 6
SENNA: Unified Hardware/Software Space Exploration for Parametrizable Neural Network Accelerators
Kwon, J., Min, H., & Egger, B. (2024) · ACM Transactions on Embedded Computing Systems · doi:10.1145/3705731 · Cited by 1
Hybrid spiking-stochastic Deep Neural Network
Kim, H., Yu, J., & Choi, K. (2017) · International Symposium on VLSI Design, Automation and Test · doi:10.1109/vlsi-dat.2017.7939642 · Cited by 1
Three-Means Ternary Quantization
Ding, J., Wu, J., & Wu, H. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-70096-0_25 · Cited by 1
Balancing Convolutional Neural Networks Pipeline in FPGAs
de Sousa, M. C. F., de Sousa, M. A. D. A., & Del-Moral-Hernandez, E. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01418-6_17 · Cited by 1
A Novel Binary Neural Network with Enhanced Dense Connection
Bai, Y., Bie, H., & Yang, Y. (2018) · International Conference on Algorithms, Computing and Artificial Intelligence (ACAI) · doi:10.1145/3302425.3302454 · Cited by 1
A Comparative Study of Classification Algorithms Over Images Using Machine Learning and TensorFlow
Kompella, S., Vishal, B. L., & Sivalaya, G. (2021) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-981-16-1866-6_20 · Cited by 1
A 15-Gbps BiCMOS XNOR gate for fast recognition of COVID-19 in binarized neural networks
Marar, R. W., & Marar, H. W. (2021) · International Journal of Power Electronics and Drive Systems/International Journal of Electrical and Computer Engineering · doi:10.11591/ijece.v12i1.pp997-1002 · Cited by 1
A Fine-grained Optimization to Winograd Convolution Based on Micro-architectural Features of CPU
Chen, X., Chen, Z., Lu, Y., & Huang, D. (2021) · IEEE International Symposium on Parallel and Distributed Processing with Applications (ISPA) · doi:10.1109/ispa-bdcloud-socialcom-sustaincom52081.2021.00165 · Cited by 1
An Embedded CNN Design for Edge Devices Based on Logarithmic Computing
Lu, C.-Y., Tsay, R., & Chang, W. (2022) · International Symposium on VLSI Design, Automation and Test · doi:10.1109/vlsi-dat54769.2022.9768052 · Cited by 1
Research on Acceleration Technologies and Recent Advances of Data Center GPUs
Cui, C., Wu, D., Du, J., Guo, J., & Liu, Z. (2023) · International Conference on Intelligent Computing and Signal Processing (ICSP) · doi:10.1109/icsp58490.2023.10248611 · Cited by 1
A Hardware-friendly Quantization and Model Fine Tuning with STEBC for Object Detection
Tsai, C. (2023) · IEEE International Midwest Symposium on Circuits and Systems (MWSCAS) · doi:10.1109/mwscas57524.2023.10405997 · Cited by 1
Padiyal, A., Yamada, A., Misawa, N., Matsui, C., & Takeuchi, K. (2024) · Japanese Journal of Applied Physics · doi:10.35848/1347-4065/ad2e45 · Cited by 1
Deep Quantization of Graph Neural Networks with Run-Time Hardware-Aware Training
Hansson, O., Grailoo, M., Gustafsson, O., & Nunez-Yanez, J. L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-55673-9_3 · Cited by 2
Difficulty, Diversity, and Plausibility: Dynamic Data-Free Quantization
Hong, C., Baik, S., Oh, J., & Lee, K. M. (2025) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv61041.2025.00733 · Cited by 2
Kneusel, R. T. (2015) · Springer eBooks · doi:10.1007/978-3-319-17260-6_5 · Cited by 1
Belyaev, A. A., Kuzmina, V. V., Bychkov, A. A., Yanakova, E. S., & Khamukhin, A. V. (2018) · IEEE Conference of Russian Young Researchers in Electrical and Electronic Engineering · doi:10.1109/eiconrus.2018.8317465 · Cited by 1
Stainton, S., Barney, S., Catt, M., & Dlay, S. S. (2018) · International Symposium on Communication Systems, Networks and Digital Signal Processing (CSNDSP) · doi:10.1109/csndsp.2018.8471792 · Cited by 1
Adaptive-precision framework for SGD using deep Q-learning
Zhang, W., Huang, H., Zhang, J., Jiang, M. F., & Luo, G. (2018) · doi:10.1145/3240765.3240774 · Cited by 1
Hardware Oriented Vision System of Logistics Robotics
Liang, F., & Zhang, C. (2018) · IEEE International Conference on Anti-counterfeiting, Security, and Identification (ASID) · doi:10.1109/icasid.2018.8693116 · Cited by 1
Ultra-Compact NLU: Neuronal Network Binarization as Regularization
Georges, M., Czarnowski, K., & Bocklet, T. (2019) · Interspeech (USB) · doi:10.21437/interspeech.2019-2591 · Cited by 1
Neuromorphic Systems Design by Matching Inductive Biases to Hardware Constraints
Müller, L. K., Stark, P., Offrein, B. J., & Abel, S. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.00437 · Cited by 1
Multiple-precision matrix-vector multiplication on graphics processing units
Исупов, К. С., & Сергеевич, К. В. (2020) · Program systems theory and applications · doi:10.25209/2079-3316-2020-11-3-33-59 · Cited by 1
Analysis of floating-point round-off error in linear algebra routines for graph clustering
Yang, L. M., & Fox, A. (2020) · IEEE High Performance Extreme Computing Conference · doi:10.1109/hpec43674.2020.9286190 · Cited by 1
Performance improvement methods
Takano, S. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-818279-6.00016-5 · Cited by 1
Training Deep Neural Networks in 8-bit Fixed Point with Dynamic Shared Exponent Management
Yamaguchi, H., Ito, M., Yoda, K., & Ike, A. (2021) · Design, Automation, and Test in Europe · doi:10.23919/date51398.2021.9473997 · Cited by 1
Russian Supercomputing Days: Proceedings of the International Conference. September 21–22, 2020
(2020) · LLC MAKS Press eBooks · doi:10.29003/m1406.russianscdays-2020 · Cited by 1
AEP: An error-bearing neural network accelerator for energy efficiency and model protection
Zhao, L., Zhang, Y., & Yang, J. (2017) · International Conference on Computer Aided Design · doi:10.1109/iccad.2017.8203854 · Cited by 1
Filter sharing: Efficient learning of parameters for volumetric convolutionsPreprint
Venkataramani, R., Thiruvenkadam, S. R., Sudhakar, P., Ravishankar, H., & Vaidya, V. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.02575 · Cited by 1
Efficient and Robust Machine Learning for Real-World SystemsPreprint
Pernkopf, F., Roth, W., Zoehrer, M., Pfeifenberger, L., Schindler, G., Froening, H., Tschiatschek, S., Peharz, R., Mattina, M., & Ghahramani, Z. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.02240 · Cited by 3
Deep Learning Acceleration Techniques for Real Time Mobile Vision ApplicationsPreprint
Teyou, G. K. D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.03418 · Cited by 1
Learning In Practice: Reasoning About QuantizationPreprint
Cherkaev, A., Tai, W., Phillips, J. M., & Srikumar, V. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.11478 · Cited by 1
Quantization Loss Re-Learning MethodPreprint
Li, K. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.13568 · Cited by 1
Método para execução de redes neurais convolucionais em FPGA.
de Sousa, M. C. F. (2019) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.3.2019.tde-14082019-110912 · Cited by 1
Reducing Inference Latency with Concurrent Architectures for Image RecognitionPreprint
Hadidi, R., Cao, J., Ryoo, M. S., & Kim, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.07092 · Cited by 1
Robust error bounds for quantised and pruned neural networksPreprint
Li, J., Drummond, R., & Duncan, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.00138 · Cited by 1
Survey and Benchmarking of Precision-Scalable MAC Arrays for Embedded DNN Processing.Preprint
Ibrahim, E. M., Mei, L., & Verhelst, M. (2021) · arXiv (Cornell University) · Cited by 1
Multiple-Precision BLAS Library for Graphics Processing UnitsPreprint
Исупов, К. С., & Сергеевич, К. В. (2020) · doi:10.36227/techrxiv.12580301.v1 · Cited by 1
Optimization Technology of CNN Based on DSP
Cai, Y., Chen, L., Tang, Z., & Li, H. (2017) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-67071-3_9
Dynamic Fixed-Point Design of Neuromorphic Computing Systems
Kang, Y.-S., & Chung, J. (2018) · IEICE Transactions on Electronics · doi:10.1587/transele.e101.c.840
Chameleon: A Generalized Reconfigurable Open-Source Architecture for Deep Neural Network Training
Isakov, M., Ehret, A., & Kinsy, M. A. (2018) · IEEE High Performance Extreme Computing Conference · doi:10.1109/hpec.2018.8547537
Applying BinaryWeights in Neural Networks for Sequential Text Recognition
Wang, Z., Yang, C. H., & Yin, X.-C. (2017) · Asian Conference on Pattern Recognition · doi:10.1109/acpr.2017.118
Reconfigurable Multi-Input Adder Design for Deep Neural Network Accelerators
Moradian, H., Jo, S., & Choi, K. (2018) · International SoC Design Conference · doi:10.1109/isocc.2018.8649943
Progressive Stochastic Binarization of Deep Networks
Hartmann, D., & Wand, M. (2019) · Workshop on Energy Efficient Machine Learning and Cognitive Computing for Embedded Applications (EMC2) · doi:10.1109/emc2-nips53020.2019.00015
Winning Solution on LPIRC-ll Competition.
Goncharenko, A., Alyamkin, S. A., Denisov, A., & Terentev, E. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
Chen, X., Jiang, J., Zhu, J., & Tsui, C.-Y. (2019) · Integration · doi:10.1016/j.vlsi.2019.09.001
Optymalizacja treningu i wnioskowania sieci neuronowych
Blok, M., & Pietrołaj, M. (2019) · Przegląd Telekomunikacyjny + Wiadomości Telekomunikacyjne · doi:10.15199/59.2019.12.6
Bayesian Sparsification Methods for Deep Complex-valued NetworksPreprint
Nazarov, I., & Burnaev, E. V. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.11413
Beyond Base-2 Logarithmic Number Systems (WiP Paper)
Alam, S. A., & Gregg, D. (2020) · doi:10.1145/3372799.3394368
Conditional Neural Architecture SearchPreprint
Kao, S.-C., Ramamurthy, A., Williams, R., & Krishna, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.03969
Resource-Efficient Speech Mask Estimation for Multi-Channel Speech EnhancementPreprint
Pfeifenberger, L., Zöhrer, M., Schindler, G., Roth, W., Fröning, H., & Pernkopf, F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.11477 · Cited by 2
Pushkareva, M. M., & Karandashev, I. (2020) · Optical Memory and Neural Networks · doi:10.3103/s1060992x20030042
Not Half Bad: Exploring Half-Precision in Graph Convolutional Neural Networks
Brennan, J., Bonner, S., Atapour–Abarghouei, A., Jackson, P. T., Obara, B., & McGough, A. S. (2020) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata50022.2020.9378263
Deep Neural Network Training without MultiplicationsPreprint
Mogami, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.03458 · Cited by 1
Creating Robust Deep Neural Networks With Coded Distributed Computing for IoT SystemsPreprint
Hadidi, R., Cao, J., & Kim, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.04447
Deep neural network compression : from sufficient to scarce data
Chen, S. (2021) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/146245
Failure Characteristics of FPGA-Based Convolutional Neural Networks under RF Interference
Lin, X., Mo, Y., & Su, T. (2021) · International Conference on Electronics Technology (ICET) · doi:10.1109/icet51757.2021.9451133
Mapping, Implementing, and Programming Spiking Neural Networks
Olin-Ammentorp, W. (2019) · SUNY Digital Repository Support (State University of New York System)
Efficient Non-linear CalculatorsPreprint
Wuraola, A., & Patel, N. D. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2109.12686
Edge-Cloud Polarization and Collaboration: A Comprehensive SurveyPreprint
Yao, J., Zhang, S., Yang, Y., Wang, F., Ma, J., Zhang, J., Chu, Y., Ji, L., Jia, K., Shen, T., et al. (2021) · arXiv (Cornell University)
Toward Compact Parameter Representations for Architecture-Agnostic Neural Network CompressionPreprint
Sun, Y., Zhao, W., Zhang, L., Liu, X., Guan, H., & Zaharia, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.10320
Xu, J., Chen, X., Hu, S., Yu, J., Liu, X., & Meng, H. M. L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.14836
EVALUATION OF NEURAL NETWORK COMPRESSION METHODS ON THE RESPIRATORY SOUND DATASET
Pál1, T., Molnár, B., & Martin, Á. T. A. C. L. (2020) · Web Based Communities · doi:10.33965/eh2021_202106l015
(2021) · Elsevier eBooks · doi:10.1016/b978-0-12-818279-6.00025-6
(2021) · Elsevier eBooks · doi:10.1016/b978-0-12-818279-6.00005-0
Multiple-Precision BLAS Library for Graphics Processing UnitsPreprint
Исупов, К. С., & Сергеевич, К. В. (2020) · doi:10.36227/techrxiv.12580301
Systematic analysis of deep neural networks
Docena, A. N. B. (2020) · doi:10.17760/d20361343
Kneusel, R. T. (2017) · Springer eBooks · doi:10.1007/978-3-319-50508-4_6
Accelerating Deep Learning based Identification of Chromatin Accessibility from noisy ATAC-seq Data
Chaudhary, N., Misra, S., Kalamkar, D. D., Heinecke, A., Georganas, E., Ziv, B., Adelman, M., & Kaul, B. (2022) · IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum · doi:10.1109/ipdpsw55747.2022.00042
A review of data representation formats for intelligent computing with emphasis on POSITs
Balasubramani, S., & Jagadeesan, U. (2023) · AIP conference proceedings · doi:10.1063/5.0126236
Floating-Point Formats and Arithmetic for Highly Accurate Multi-Layer Perceptrons
Niknia, F., Wang, Z., Liu, S., Reviriego, P., Louri, A., & Lombardi, F. (2023) · IEEE International Conference on Nanotechnology (IEEE-NANO) · doi:10.1109/nano58406.2023.10231201
Power efficient VLSI architecture based logistic regression for classification of breast cancer
Guturu, S., Vuppalapati, S. J., Boggavarapu, P. S., Shivakumar, V., Uppugunduru, A. K., & Ahmed, S. E. (2023) · International Conference on Computer, Electronics & Electrical Engineering & their Applications (IC2E3) · doi:10.1109/ic2e357697.2023.10262479
Brain Floating Point Precision for Object Detector
Turk, A., & Kim, H. (2023) · 2023 IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia) · doi:10.1109/icce-asia59966.2023.10326414
Adapting floating-point precision to accelerate deep neural network training
Ríos, J. H. O. (2023) · UPCommons institutional repository (Universitat Politècnica de Catalunya) · doi:10.5821/dissertation-2117-404063 · Cited by 1
Spike-Based Learning with Multi-compartment Model
Yang, S., & Chen, B. (2024) · Synthesis lectures on engineering, science, and technology · doi:10.1007/978-3-031-57873-1_2
Metadata
- Authors
- Courbariaux, M., Bengio, Y., & David, J.-P.
- Affiliations
- Polytechnique Montréal (CA)
- Université de Montréal (CA)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2014
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1412.7024
- OpenAlex
- W1825672851
- Cited by
- 407
- References
- 18
- Citations by year
- 2025: 12 · 2024: 17 · 2023: 23 · 2022: 30 · 2021: 65 · 2020: 64 · 2019: 80 · 2018: 62 · 2017: 36 · 2016: 15 · 2015: 2 · 2014: 1
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- PolyPublie (École Polytechnique de Montréal) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Canadian Institute for Advanced Research
- Compute Canada
- Canada Research Chairs
- Natural Sciences and Engineering Research Council of Canada
- Topics
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Numerical Methods and Algorithms
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Low-power high-performance VLSI design
- Keywords
- low-precision arithmetic, deep neural network training, fixed-point arithmetic, floating-point precision, energy-efficient neural networks, MNIST, CIFAR-10, SVHN
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
