The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Stochastic neural computation. I. Computational elements
Abstract
This paper examines a number of stochastic computational elements employed in artificial neural networks, several of which are introduced for the first time, together with an analysis of their operation. We briefly include multiplication, squaring, addition, subtraction, and division circuits in both unipolar and bipolar formats, the principles of which are well-known, at least for unipolar signals. We have introduced several modifications to improve the speed of the division operation. The primary contribution of this paper, however, is in introducing several state machine-based computational elements for performing sigmoid nonlinearity mappings, linear gain, and exponentiation functions. We also describe an efficient method for the generation of, and conversion between, stochastic and deterministic binary signals. The validity of the present approach is demonstrated in a companion paper through a sample application, the recognition of noisy optical characters using soft competitive learning. Network generalization capabilities of the stochastic network maintain a squared error within 10 percent of that of a floating-point implementation for a wide range of noise levels. While the accuracy of stochastic computation may not compare favorably with more conventional binary radix-based computation, the low circuit area, power, and speed characteristics may, in certain situations, make them attractive for VLSI implementation of artificial neural networks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neural networks for pattern recognition
(1994) · Choice Reviews Online · doi:10.5860/choice.31-5500 · Cited by 18,538
Neural Networks for Pattern Recognition
Bishop, C. M. (1995) · doi:10.1093/oso/9780198538493.001.0001 · Cited by 12,287
Introduction to the theory of neural computation
(1994) · Neural Networks · doi:10.1016/0893-6080(94)90014-0 · Cited by 6,401
Introduction to the Theory of Neural Computation
Hertz, J., Krogh, A., Palmer, R., & Jensen, R. V. (1994) · American Journal of Physics · doi:10.1119/1.17491 · Cited by 1,276
(1998) · The MIT Press eBooks · doi:10.7551/mitpress/5704.001.0001 · Cited by 1,114
Introduction to the Theory of Neural Computation
Hertz, J., Krogh, A., Palmer, R. G., & Horner, H. (1991) · Physics Today · doi:10.1063/1.2810360 · Cited by 1,079
The "Wake-Sleep" Algorithm for Unsupervised Neural Networks
Hinton, G. E., Dayan, P., Frey, B. J., & Neal, R. M. (1995) · Science · doi:10.1126/science.7761831 · Cited by 1,070
Learning and relearning in Boltzmann machines
Hinton, G. E., & Sejnowski, T. J. (2001) · Graphical Models · doi:10.7551/mitpress/3349.003.0005 · Cited by 1,037
Gaines, B. R. (1969) · Advances in Information Systems Science · doi:10.1007/978-1-4899-5841-9_2 · Cited by 745
Fast Sigmoidal Networks via Spiking Neurons
Maass, W. (1997) · Neural Computation · doi:10.1162/neco.1997.9.2.279 · Cited by 226
Parallel random number generation for VLSI systems using cellular automata
Hortensius, P. D., McLeod, R. D., & Card, H. C. (1989) · IEEE Transactions on Computers · doi:10.1109/12.35843 · Cited by 225
Self-citationGómez-Uribe, C. A., & Verghese, G. C. (2007) · The Journal of Chemical Physics · doi:10.1063/1.2408422 · Cited by 209
Pulse-stream VLSI neural networks mixing analog and digital techniques
Murray, A. F., Del Corso, D., & Tarassenko, L. (1991) · IEEE Transactions on Neural Networks · doi:10.1109/72.80329 · Cited by 201
A Pulse-Coded Communications Infrastructure for Neuromorphic Systems
Deiss, S. R., Douglas, R. J., & Whatley, A. M. (1998) · Pulsed Neural Networks · doi:10.7551/mitpress/5704.003.0011 · Cited by 168
Asynchronous VLSI neural networks using pulse-stream arithmetic
Murray, A. F., & Smith, A. V. W. (1988) · IEEE Journal of Solid-State Circuits · doi:10.1109/4.307 · Cited by 154
A digital neural network architecture for VLSI
Jr. Tomlinson, M. S., Walker, D. J., & Sivilotti, M. A. (1990) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.1990.137764 · Cited by 86
A digital architecture employing stochasticism for the simulation of Hopfield neural nets
den Bout, D. E. V., & Miller, T. K., III (1989) · IEEE Transactions on Circuits and Systems · doi:10.1109/31.31321 · Cited by 84
Functional abilities of a stochastic logic neural network
Kondo, Y., & Sawada, Y. (1992) · IEEE Transactions on Neural Networks · doi:10.1109/72.129416 · Cited by 84
Programmable impulse neural circuits
Meador, J. L., Wu, A., Cole, C., Nintunze, N., & Chintrakulchai, P. (1991) · IEEE Transactions on Neural Networks · doi:10.1109/72.80295 · Cited by 77
Melton, M., Phan, T. T. T., Reeves, D. S., & den Bout, D. E. V. (1992) · IEEE Transactions on Neural Networks · doi:10.1109/72.129410 · Cited by 58
Learning probabilistic RAM nets using VLSI structures
Clarkson, T. G., Gorse, D., Taylor, J. G., & Ng, C. K. (1992) · IEEE Transactions on Computers · doi:10.1109/12.214663 · Cited by 53
Pulse-Based Computation in VLSI Neural Networks
Murray, A. F. (1998) · The MIT Press eBooks · doi:10.7551/mitpress/5704.003.0007 · Cited by 18
Generalization in probabilistic RAM nets
Clarkson, T. G., Guan, Y., Taylor, J. G., & Gorse, D. (1993) · IEEE Transactions on Neural Networks · doi:10.1109/72.207603 · Cited by 17
Cited by
Approximate computing: An emerging paradigm for energy-efficient design
Han, J., & Orshansky, M. (2013) · 2013 18TH IEEE EUROPEAN TEST SYMPOSIUM (ETS) · doi:10.1109/ets.2013.6569370 · Cited by 1,098
Survey of Stochastic Computing
Alaghi, A., & Hayes, J. P. (2013) · ACM Transactions on Embedded Computing Systems · doi:10.1145/2465787.2465794 · Cited by 591
Recent advances in convolutional neural network acceleration
Zhang, Q., Zhang, M., Chen, T., Sun, Z., Ma, Y., & Yu, B. (2019) · Neurocomputing · doi:10.1016/j.neucom.2018.09.038 · Cited by 434
The Promise and Challenge of Stochastic Computing
Alaghi, A., Qian, W., & Hayes, J. P. (2018) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2017.2778107 · Cited by 276
VLSI Implementation of Deep Neural Network Using Integral Stochastic Computing
Ardakani, A., Leduc-Primeau, F., Onizawa, N., Hanyu, T., & Gross, W. J. (2017) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2017.2654298 · Cited by 254
Metadata
- Authors
- Brown, B. D., & Card, H. C.
- Venue
- IEEE Transactions on Computers
- Published
- 2001
- Volume
- 50
- Issue
- 9
- Pages
- 891-905
- ISSN
- 0018-9340 (ISSN-L)
- OpenAlex
- W2151770284
- Cited by
- 555
- References
- 23
- FWCI
- 7.14
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.