The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
Review of Neural Networks for Speech Recognition
Abstract
The performance of current speech recognition systems is far below that of humans. Neural nets offer the potential of providing massive parallelism, adaptation, and new algorithmic approaches to problems in speech recognition. Initial studies have demonstrated that multilayer networks with time delays can provide excellent discrimination between small sets of pre-segmented difficult-to-discriminate words, consonants, and vowels. Performance for these small vocabularies has often exceeded that of more conventional approaches. Physiological front ends have provided improved recognition accuracy in noise and a cochlea filter-bank that could be used in these front ends has been implemented using micro-power analog VLSI techniques. Techniques have been developed to scale networks up in size to handle larger vocabularies, to reduce training time, and to train nets with recurrent connections. Multilayer perceptron classifiers are being integrated into conventional continuous-speech recognizers. Neural net architectures have been developed to perform the computations required by vector quantizers, static pattern classifiers, and the Viterbi decoding algorithm. Further work is necessary for large-vocabulary continuous-speech problems, to develop training algorithms that progressively build internal word models, and to develop compact VLSI neural net hardware.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Optimization by Simulated Annealing
Kirkpatrick, S., Gelatt, C. D., & Vecchi, M. P. (1983) · Science · doi:10.1126/science.220.4598.671 · Cited by 45,134
Neural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270 · cited 2×
“These nets extend past work on associative memories by Hopfield and Little (Hopfield 1982; Little 1974) to the case where pattern sequences instead of static patterns can be restored.”
BackgroundLearning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,172
(1973) · CERN Document Server (European Organization for Nuclear Research) · Cited by 12,895
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
Introduction to Statistical Pattern Recognition
(1990) · Elsevier eBooks · doi:10.1016/c2009-0-27872-x · Cited by 11,031
Self-Organization and Associative Memory
Kohonen, T. (1989) · Springer Series in Information Sciences · doi:10.1007/978-3-642-88163-3 · Cited by 8,740
An introduction to computing with neural nets
Lippmann, R. (1987) · IEEE ASSP Magazine · doi:10.1109/massp.1987.1165576 · Cited by 7,825
Self-citationAn introduction to hidden Markov models
Rabiner, L., & Juang, B. (1986) · IEEE ASSP Magazine · doi:10.1109/massp.1986.1165342 · Cited by 4,775
Radial Basis Functions, Multi-Variable Functional Interpolation and Adaptive Networks
Broomhead, D. S., & Lowe, D. (1988) · OpenGrey (Institut de l'Information Scientifique et Technique) · Cited by 3,443
A learning algorithm for Boltzmann machines
Ackley, D. H., Hinton, G. E., & Sejnowski, T. J. (1985) · Cognitive Science · doi:10.1207/s15516709cog0901_7 · Cited by 3,402
Control Methods Used in a Study of the Vowels
Peterson, G. E., & Barney, H. L. (1952) · The Journal of the Acoustical Society of America · doi:10.1121/1.1906875 · Cited by 2,837
Phoneme recognition using time-delay neural networks
Waibel, A., Hanazawa, T., Hinton, G., Shikano, K., & Lang, K. J. (1989) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/29.21701 · Cited by 2,643
Proceedings IEEE International Conference on Acoustics Speech and Signal Processing
Zheng, F., McLaughlin, S., & Mulgrew, B. (1991) · Cited by 1,905
Functional parallelism in spoken word-recognition
Marslen-Wilson, W. D. (1987) · Cognition · doi:10.1016/0010-0277(87)90005-9 · Cited by 1,752
Nonlinear neural networks: Principles, mechanisms, and architectures
Grossberg, S. (1988) · Neural Networks · doi:10.1016/0893-6080(88)90021-4 · Cited by 1,623
Connectionist learning procedures
Hinton, G. E. (1989) · Artificial Intelligence · doi:10.1016/0004-3702(89)90049-0 · Cited by 1,430
Neural networks and principal component analysis: Learning from examples without local minima
Baldi, P., & Hornik, K. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90014-2 · Cited by 1,383
Auto-association by multilayer perceptrons and singular value decomposition
Bourlard, H., & Kamp, Y. (1988) · Biological Cybernetics · doi:10.1007/bf00332918 · Cited by 1,345
Serial Order: A Parallel Distributed Processing Approach
Jordan, M. I. (1997) · Advances in Psychology · doi:10.1016/s0166-4115(97)80111-2 · Cited by 1,242
An introduction to neural computing
Kohonen, T. (1988) · Neural Networks · doi:10.1016/0893-6080(88)90020-2 · Cited by 1,202
Generalization of back-propagation to recurrent neural networks
Pineda, F. J. (1987) · Physical Review Letters · doi:10.1103/physrevlett.59.2229 · Cited by 931 · cited 2×
“More recent studies have focused on modified back-propagation training algorithms described in (Almeida 1987; Jordan 1986; Pineda 1987; Rohwer and Forrest 1987; Rumelhart et al. 1986a; Watrous 1988) Prager, Harrison, and Fallside (Prager et al. 1986) performed one of the first experiments to…”
BackgroundPattern classification using neural networks
Lippmann, R. P. (1989) · IEEE Communications Magazine · doi:10.1109/35.41401 · Cited by 811
Self-citationThe existence of persistent states in the brain
Little, W. A. (1974) · Mathematical Biosciences · doi:10.1016/0025-5564(74)90031-5 · Cited by 657
Temporal Association in Asymmetric Neural Networks
Sompolinsky, H., & Kanter, I. (1986) · Physical Review Letters · doi:10.1103/physrevlett.57.2861 · Cited by 547
Androgens Prevent Normally Occurring Cell Death in a Sexually Dimorphic Spinal Nucleus
Nordeen, E. J., Nordeen, K. W., Sengelaub, D. R., & Arnold, A. P. (1985) · Science · doi:10.1126/science.4023706 · Cited by 464
The Organization of Perception and Action
MacKay, D. G. (1987) · Cognitive Science Series · doi:10.1007/978-1-4612-4754-8 · Cited by 424
Lyon, R. F., & Mead, C. (1988) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/29.1639 · Cited by 419
Statistical pattern recognition with neural networks: benchmarking studies.
Kohonen, T., Barna, G., & Chrisley, R. (1988) · Cited by 409
The DARPA 1000-word resource management database for continuous speech recognition
Price, P., Fisher, W. M., Bernstein, J., & Pallett, D. S. (2003) · ICASSP-88., International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1988.196669 · Cited by 341
Parsons, T. W. (1986) · Medical Entomology and Zoology · Cited by 337
The Existence of Persistent States in the Brain
Little, W. A. (1974) · From High-Temperature Superconductivity to Microminiature Refrigeration · doi:10.1007/978-1-4613-0411-1_12 · Cited by 317
Sequential state generation by model neural networks.
Kleinfeld, D. (1986) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.83.24.9469 · Cited by 315
Lapedes, A., & Farber, R. (1989) · Evolution, Learning and Cognition · doi:10.1142/9789814434102_0012 · Cited by 292
A joint synchrony/mean-rate model of auditory speech processing
Seneff, S. (1988) · Journal of Phonetics · doi:10.1016/s0095-4470(19)30466-8 · Cited by 286
A learning rule for asynchronous perceptrons with feedback in a combinatorial environment
Almeida, L. B. (1990) · IEEE Press eBooks · Cited by 280
Learning the hidden structure of speech
Elman, J. L., & Zipser, D. (1988) · The Journal of the Acoustical Society of America · doi:10.1121/1.395916 · Cited by 268
Neural networks that learn temporal sequences by selection.
Dehaene, S., Changeux, J. P., & Nadal, J. P. (1987) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.84.9.2727 · Cited by 266
Experiments on neural net recognition of spoken and written text
Burr, D. J. (1988) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/29.1643 · Cited by 263
Learning Algorithms for Connectionist Networks: Applied Gradient Methods of Nonlinear Optimization
Watrous, R. L. (1988) · ScholarlyCommons (University of Pennsylvania) · Cited by 242
Integration of acoustic and visual speech signals using neural networks
Yuhas, B. P., Goldstein, M. H., & Sejnowski, T. J. (1989) · IEEE Communications Magazine · doi:10.1109/35.41402 · Cited by 209
Learning Sequential Structure in Simple Recurrent Networks
Servan‐Schreiber, D., Cleeremans, A., & McClelland, J. L. (1988) · Dépôt institutionnel de l'Université libre de Bruxelles (Université Libre de Bruxelles) · Cited by 175
Doddington, G. R., & Schalk, T. B. (1981) · IEEE Spectrum · doi:10.1109/mspec.1981.6369809 · Cited by 161
Modularity and scaling in large phonemic neural networks
Waibel, A. H., Sawai, H., & Shikano, K. (1989) · IEEE Transactions on Acoustics Speech and Signal Processing · doi:10.1109/29.45535 · Cited by 156
Efficient Algorithms with Neural Network Behavior.
Omohundro, S. M. (1987) · Complex Systems · Cited by 153
Neural Net and Traditional Classifiers
Huang, W. Y. C., & Lippmann, R. P. (1987) · neural information processing systems · Cited by 144
Self-citationDiagnosis using backpropagation neural networks—analysis and criticism
Kramer, M. A., & Leonard, J. A. (1990) · Computers & Chemical Engineering · doi:10.1016/0098-1354(90)80015-4 · Cited by 138
Interactive processes in speech perception: the TRACE model
McClelland, J. L., & Elman, J. L. (1986) · The MIT Press eBooks · Cited by 137
Cohen, M. A., & Grossberg, S. (1987) · Applied Optics · doi:10.1364/ao.26.001866 · Cited by 127
Neural networks and radial basis functions in classifying static speech patterns
Niranjan, M., & Fallside, F. (1990) · Computer Speech & Language · doi:10.1016/0885-2308(90)90009-u · Cited by 101
Large-vocabulary speaker-independent continuous speech recognition using HMM
Lee, K.-F., & Hon, H.-W. (2003) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1988.196527 · Cited by 95
A composite auditory model for processing speech sounds
Deng, L., & Geisler, C. D. (1987) · The Journal of the Acoustical Society of America · doi:10.1121/1.395644 · Cited by 94
A Comparison of Hamming and Hopfield Neural Nets for Pattern Classification
Lippmann, R. P., Gold, B., & Malpass, M. L. (1987) · Cited by 93
Self-citationExperiments with the Tangora 20,000 word speech recognizer
Averbuch, A. Z., Bahl, L. R., Bakis, R., Brown, P., Daggett, G., Das, S. K., Davies, K. E., Gennaro, S. D., de Souza, P., Epstein, E. A., et al. (2005) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1987.1169870 · Cited by 89
Speech pattern discrimination and multilayer perceptrons
Bourlard, H., & Wellekens, C. J. (1989) · Computer Speech & Language · doi:10.1016/0885-2308(89)90011-9 · Cited by 89
Noise-Driven Temporal Association in Neural Networks
Buhmann, J. M., & Schulten, K. J. (1987) · Europhysics Letters (EPL) · doi:10.1209/0295-5075/4/10/021 · Cited by 89
Boltzmann machines for speech recognition
Prager, R. W., Harrison, T. D., & Fallside, F. (1986) · Computer Speech & Language · doi:10.1016/s0885-2308(86)80008-0 · Cited by 86
Discrete utterance speech recognition without time alignment
Shore, J. E., & Burton, D. (1983) · IEEE Transactions on Information Theory · doi:10.1109/tit.1983.1056716 · Cited by 84
Static and Dynamic Error Propagation Networks with Application to Speech Coding
Robinson, A. J., & Fallside, F. (1987) · Cited by 79
Neural networks counting chimes.
Amit, D. J. (1988) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.85.7.2141 · Cited by 72
Neurogammon Wins Computer Olympiad
Tesauro, G. J. (1989) · Neural Computation · doi:10.1162/neco.1989.1.3.321 · Cited by 71
Nearest matched filter classification of spatiotemporal patterns
Hecht-Nielsen, R. (1987) · Applied Optics · doi:10.1364/ao.26.001892 · Cited by 59
Atlas, L., Homma, T., & Marks, R. J. (1987) · neural information processing systems · Cited by 57
Isolated-word speech recognition using multisection vector quantization codebooks
Burton, D., Shore, J. E., & Buck, J. (1985) · IEEE Transactions on Acoustics Speech and Signal Processing · doi:10.1109/tassp.1985.1164650 · Cited by 56
A speaker-stress resistant HMM isolated word recognizer
Paul, D. B. (2005) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1987.1169551 · Cited by 53
A Dynamical Approach to Temporal Pattern Processing
Stornetta, W. S., Hogg, T., & Huberman, B. A. (1987) · neural information processing systems · Cited by 52
Speaker dependent and independent speech recognition experiments with an auditory model
Hunt, M. J., & Lefebvre, C. (2003) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1988.196552 · Cited by 41
Links Between Markov Models and Multilayer Perceptrons
Bourlard, H. A., & Wellekens, C. J. (1988) · neural information processing systems · Cited by 36
Auditory neural feedback as a basis for speech processing
Chitza, O. (2003) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1988.196518 · Cited by 25
Nonlinear dynamics of feedback multilayer perceptrons
Bauer, H.-U., & Geisel, T. (1990) · Physical Review A · doi:10.1103/physreva.42.2401 · Cited by 13
Use of neural networks for the recognition of place of articulation
Bengio, Y., & Mori, R. D. (2003) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1988.196522 · Cited by 12
A connectionist model for consonant-vowel syllable recognition
Rossen, M. L., Niles, L. T., Tajchman, G. N., et al. (2003) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1988.196509 · Cited by 6
Prager, R. W., & Fallside, F. (1987) · Computer Speech & Language · doi:10.1016/0885-2308(87)90007-6 · Cited by 5
Cited by
Neural Networks and the Bias/Variance Dilemma
Geman, S., Bienenstock, E., & Doursat, R. (1992) · Neural Computation · doi:10.1162/neco.1992.4.1.1 · Cited by 3,578
Neural networks for classification: a survey
Zhang, G. P. (2000) · IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/5326.897072 · Cited by 1,667
Phantom auditory perception (tinnitus): mechanisms of generation and perception
Jastreboff, P. J. (1990) · Neuroscience Research · doi:10.1016/0168-0102(90)90031-9 · Cited by 1,576
Regularization Theory and Neural Networks Architectures
Girosi, F., Jones, M., & Poggio, T. (1995) · Neural Computation · doi:10.1162/neco.1995.7.2.219 · Cited by 1,349
End-to-end attention-based large vocabulary speech recognition
Bahdanau, D., Chorowski, J., Serdyuk, D., Brakel, P., & Bengio, Y. (2016) · 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2016.7472618 · Cited by 1,096
Metadata
- Authors
- Lippmann, R. P.
- Venue
- Neural Computation
- Publisher
- MIT Press - Journals
- Published
- 1989-03
- Volume
- 1
- Issue
- 1
- Pages
- 1-38
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2169415433
- Cited by
- 477
- References
- 73
- FWCI
- 24.67
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.