The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
The Promise and Challenge of Stochastic Computing
Abstract
Stochastic computing (SC) is an unconventional method of computation that treats data as probabilities. Typically, each bit of an N-bit stochastic number (SN) Xis randomly chosen to be 1 with some probability pX, and X is generated and processed by conventional logic circuits. For instance, a single AND gate performs multiplication. The value X of an SN is measured by the density of 1 s in it, an information-coding scheme also found in biological neural systems. SC has uses in massively parallel systems and is very tolerant of soft errors. Its drawbacks include low accuracy, slow processing, and complex design needs. Its ability to efficiently perform tasks like communication decoding and neural network inference has rekindled interest in the field. Many challenges remain to be overcome, however, before SC becomes widespread. In this paper, we discuss the evolution of SC, mostly focusing on recent developments. We highlight the main challenges and discuss potential methods of overcoming them.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
(1988) · Cited by 16,582
The Art of Computer Programming
Knuth, D. E. (1968) · Cited by 16,337
The Art of Computer Programming
Whitesides, G. E. (1970) · Nuclear Science and Engineering · doi:10.13182/nse70-a19705 · Cited by 6,008
Artificial neural networks: a tutorial
Jain, A. K., Mao, J., & Mohiuddin, K. M. (1996) · Computer · doi:10.1109/2.485891 · Cited by 4,946
Digital Image Processing: PIKS Inside
Pratt, W. K. (2002) · Wiley eBooks · doi:10.1002/0471221325 · Cited by 4,340
Spiking Neuron Models: Single Neurons, Populations, Plasticity
Gerstner, W., & Kistler, W. M. (2002) · Cambridge University Press eBooks · doi:10.1017/cbo9780511815706 · Cited by 3,080
The capacity of low-density parity-check codes under message-passing decoding
Richardson, T. J., & Urbanke, R. L. (2001) · IEEE Transactions on Information Theory · doi:10.1109/18.910577 · Cited by 3,065
Adaptive document image binarization
Sauvola, J., & Pietikäinen, M. (2000) · Pattern Recognition · doi:10.1016/s0031-3203(99)00055-2 · Cited by 2,339
BinaryConnect: Training Deep Neural Networks with binary weights during propagations
Courbariaux, M., Bengio, Y., & David, J.-P. (2015) · arXiv · doi:10.48550/arxiv.1511.00363 · Cited by 2,180
Digital image processing (2nd ed.)
(1992) · CVGIP: Image Understanding · doi:10.1016/1049-9660(92)90019-y · Cited by 1,780
Cattermole, K. W. (1968) · Electronics and Power · doi:10.1049/ep.1968.0141 · Cited by 1,319
Gerstner, W. (2009) · Encyclopedia of Neuroscience · doi:10.1016/b978-008045046-9.01405-4 · Cited by 1,199
(1998) · The MIT Press eBooks · doi:10.7551/mitpress/5704.001.0001 · Cited by 1,114
Über Potenzreihen, die im Innern des Einheitskreises beschränkt sind.
Schur, J. (1917) · crll · doi:10.1515/crll.1917.147.205 · Cited by 1,035
A Survey of Binary Similarity and Distance Measures
Choi, S.-S., Cha, S.-H., & Tappert, C. C. (2010) · Cited by 843
Gaines, B. R. (1969) · Advances in Information Systems Science · doi:10.1007/978-1-4899-5841-9_2 · Cited by 745
Survey of Stochastic Computing
Alaghi, A., & Hayes, J. P. (2013) · ACM Transactions on Embedded Computing Systems · doi:10.1145/2465787.2465794 · Cited by 591
Self-citationStochastic neural computation. I. Computational elements
Brown, B. D., & Card, H. C. (2001) · IEEE Transactions on Computers · doi:10.1109/12.954505 · Cited by 555
Mandyam N, A. (2021) · Mapana Journal of Sciences · doi:10.12723/mjs.56.5 · Cited by 357
Stochastic circuits for real-time image-processing applications
Alaghi, A., Li, C., & Hayes, J. P. (2013) · Proceedings of the 50th Annual Design Automation Conference · doi:10.1145/2463209.2488901 · Cited by 257
Self-citationGaines, B. R. (1967) · Proceedings of the April 18-20, 1967, spring joint computer conference on - AFIPS '67 (Spring) · doi:10.1145/1465482.1465505 · Cited by 256
VLSI Implementation of Deep Neural Network Using Integral Stochastic Computing
Ardakani, A., Leduc-Primeau, F., Onizawa, N., Hanyu, T., & Gross, W. J. (2017) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2017.2654298 · Cited by 254
Architecture exploration for ambient energy harvesting nonvolatile processors
Ma, K., Zheng, Y., Li, S., Swaminathan, K., Li, X., Liu, Y., Sampson, J., Xie, Y., & Narayanan, V. (2015) · 2015 IEEE 21st International Symposium on High Performance Computer Architecture (HPCA) · doi:10.1109/hpca.2015.7056060 · Cited by 251
Fully Parallel Stochastic LDPC Decoders
Sharifi Tehrani, S., Mannor, S., & Gross, W. J. (2008) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2008.929671 · Cited by 204
Iterative decoding using stochastic computation
Gaudet, V. C., & Rapley, A. C. (2003) · Electronics Letters · doi:10.1049/el:20030217 · Cited by 198
Exploiting correlation in stochastic circuit design
Alaghi, A., & Hayes, J. P. (2013) · 2013 IEEE 31st International Conference on Computer Design (ICCD) · doi:10.1109/iccd.2013.6657023 · Cited by 196
Self-citationDynamic energy-accuracy trade-off using stochastic computing in deep neural networks
Kim, K., Kim, J., Yu, J., Seo, J., Lee, J., & Choi, K. (2016) · Proceedings of the 53rd Annual Design Automation Conference · doi:10.1145/2897937.2898011 · Cited by 188
SC-DCNN: Highly-Scalable Deep Convolutional Neural Network using Stochastic Computing
Ren, A., Li, Z., Ding, C., Qiu, Q., Wang, Y., Li, J., Qian, X., & Yuan, B. (2017) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3037697.3037746 · Cited by 156
Energy-efficient hybrid stochastic-binary neural networks for near-sensor computing
Lee, V. T., Alaghi, A., Hayes, J. P., Sathe, V., & Ceze, L. (2017) · Design, Automation, and Test in Europe · doi:10.23919/date.2017.7926951 · Cited by 147
Self-citationA Stochastic Computational Approach for Accurate and Efficient Reliability Evaluation
Han, J., Chen, H., Liang, J., Zhu, P., Yang, Z., & Lombardi, F. (2012) · IEEE Transactions on Computers · doi:10.1109/tc.2012.276 · Cited by 144
Majority-Based Tracking Forecast Memories for Stochastic LDPC Decoding
Tehrani, S. S., Naderi, A., Kamendje, G.-A., Hemati, S., Mannor, S., & Gross, W. J. (2010) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2010.2051434 · Cited by 143
A New Stochastic Computing Methodology for Efficient Neural Network Implementation
Canals, V., Morro, A., Oliver, A., Alomar, M. L., & Rosselló, J. L. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2413754 · Cited by 116
FPGA-based stochastic neural networks-implementation
Bade, S. L., & Hutchings, B. L. (2002) · IEEE International Symposium on Field-Programmable Custom Computing Machines (FCCM) · doi:10.1109/fpga.1994.315612 · Cited by 115
Stochastic computing elements and systems
Poppelbaum, W. J., Afuso, C., & Esch, J. W. (1967) · Proceedings of the November 14-16, 1967, fall joint computer conference on - AFIPS '67 (Fall) · doi:10.1145/1465611.1465696 · Cited by 114
A Native Stochastic Computing Architecture Enabled by Memristors
Knag, P. C., Lu, W. D., & Zhang, Z. (2014) · IEEE Transactions on Nanotechnology · doi:10.1109/tnano.2014.2300342 · Cited by 110
A digital architecture employing stochasticism for the simulation of Hopfield neural nets
den Bout, D. E. V., & Miller, T. K., III (1989) · IEEE Transactions on Circuits and Systems · doi:10.1109/31.31321 · Cited by 89
Stochastic pulse coded arithmetic
Toral, S. L., Quero, J. M., & Franquelo, L. G. (2000) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.2000.857166 · Cited by 79
Binary multiplication with PN sequences
Gupta, P., & Kumaresan, R. (1988) · IEEE Transactions on Acoustics Speech and Signal Processing · doi:10.1109/29.1564 · Cited by 77
Time-Encoded Values for Highly Efficient Stochastic Circuits
Najafi, M. H., Jamali-Zavareh, S., Lilja, D. J., Riedel, M. D., Bazargan, K., & Harjani, R. (2017) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2016.2645902 · Cited by 76
Li, B., Najafi, M. H., & Lilja, D. J. (2016) · ACM/SIGDA International Symposium on Field-Programmable Gate Arrays (FPGA) · doi:10.1145/2847263.2847340 · Cited by 64
A spectral transform approach to stochastic circuits
Alaghi, A., & Hayes, J. P. (2012) · IEEE International Conference on Computer Design: VLSI in Computers and Processors (ICCD) · doi:10.1109/iccd.2012.6378658 · Cited by 54
Self-citationSTRAUSS: Spectral Transform Use in Stochastic Circuit Synthesis
Alaghi, A., & Hayes, J. P. (2015) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2015.2432138 · Cited by 53
Self-citationAccumulative parallel counters
Parhami, B., & Yeh, C. (2002) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/acssc.1995.540843 · Cited by 50
Stochastic Decoding of Turbo Codes
Dong, Q. T., Arzel, M., Jégo, C., & Gross, W. J. (2010) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2010.2072924 · Cited by 46
Chippa, V. K., Venkataramani, S., Roy, K., & Raghunathan, A. (2014) · International Symposium on Low Power Electronics and Design (ISLPED) · doi:10.1145/2627369.2627645 · Cited by 27
Stochastic-Based Deep Convolutional Networks with Reconfigurable Logic Fabric
Alawad, M., & Lin, M. (2016) · IEEE Transactions on Multi-Scale Computing Systems · doi:10.1109/tmscs.2016.2601326 · Cited by 26
Comparing Stochastic and Deterministic Computing
Manohar, R. (2015) · IEEE Computer Architecture Letters · doi:10.1109/lca.2015.2412553 · Cited by 25
Exploring the viability of stochastic computing
de Aguiar, J. M., & Khatri, S. P. (2015) · IEEE International Conference on Computer Design: VLSI in Computers and Processors (ICCD) · doi:10.1109/iccd.2015.7357131 · Cited by 22
High-speed stochastic circuits using synchronous analog pulses
Najafi, M. H., & Lilja, D. J. (2017) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/aspdac.2017.7858369 · Cited by 21
Polysynchronous stochastic circuits
Najafi, M. H., Lilja, D. J., Riedel, M. D., & Bazargan, K. (2016) · Asia and South Pacific Design Automation Conference (ASP-DAC) · doi:10.1109/aspdac.2016.7428060 · Cited by 17
A study on the stochastic computation using the ratio of one pulses and zero pulses
Min, S.-J., Lee, E.-W., & Chae, S. (2002) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas.1994.409628 · Cited by 16
Metadata
- Authors
- Alaghi, A., Qian, W., & Hayes, J. P.
- Venue
- IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
- Published
- 2018-08
- Volume
- 37
- Issue
- 8
- Pages
- 1515-1531
- ISSN
- 0278-0070 (ISSN-L)
- 1937-4151
- OpenAlex
- W2770265919
- Cited by
- 276
- References
- 52
- FWCI
- 8.17
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.