Supervised Sequence Labelling with Recurrent Neural Networks
The DOI matches its Crossref record; 138 of the 138 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 4×
“The approach favoured by this book is the Long Short-Term Memory (LSTM) architecture (Hochreiter and Schmidhuber, 1997).”
BackgroundMethodInfluentialGradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743 · cited 3×
“However, we will frequently refer to the well-known generative method hidden Markov models (Rabiner, 1989; Bengio, 1999).”
BackgroundMethodBook Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
Multilayer feedforward networks are universal approximators
Hornik, K., Stinchcombe, M., & White, H. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90020-8 · Cited by 21,728 · cited 1×
“Indeed it has been proven (Hornik et al., 1989) that an MLP with a single hidden layer containing a sufficient number of nonlinear units can approximate any continuous function on a compact input domain to arbitrary precision.”
BackgroundNeural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270 · cited 1×
“Well known examples of FNNs include perceptrons (Rosenblatt, 1958), radial basis function networks (Broomhead and Lowe, 1988), Kohonen maps (Kohonen, 1989) and Hopfield nets (Hopfield, 1982).”
BackgroundA logical calculus of the ideas immanent in nervous activity
McCulloch, W. S., & Pitts, W. (1943) · The Bulletin of Mathematical Biophysics · doi:10.1007/bf02478259 · Cited by 18,566
Neural networks for pattern recognition
(1994) · Choice Reviews Online · doi:10.5860/choice.31-5500 · Cited by 18,538
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Learning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,172
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
The perceptron: A probabilistic model for information storage and organization in the brain.
Rosenblatt, F. (1958) · Psychological Review · doi:10.1037/h0042519 · Cited by 12,280
Welch, P. (1967) · IEEE Transactions on Audio and Electroacoustics · doi:10.1109/tau.1967.1161901 · Cited by 12,277
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
Bidirectional recurrent neural networks
Schuster, M., & Paliwal, K. K. (1997) · IEEE Transactions on Signal Processing · doi:10.1109/78.650093 · Cited by 10,172 · cited 3×
“Derived from feedforward neural networks, RNNs can use their internal state (memory) to process variable length sequences of inputs.”
BackgroundMethodLearning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542 · cited 1×
“The two components in a the hybrid can be trained independently, but many authors have proposed methods for combined optimisation (Bengio et al., 1992; Bourlard et al., 1996; Hennebert et al., 1997; Trentin and Gori, 2003) which typically yields improved results.”
BackgroundMethods of conjugate gradients for solving linear systems
Hestenes, M. R., & Stiefel, E. (1952) · Journal of Research of the National Bureau of Standards · doi:10.6028/jres.049.044 · Cited by 8,132
A Limited Memory Algorithm for Bound Constrained Optimization
Byrd, R. H., Lu, P., Nocedal, J., & Zhu, C. (1995) · SIAM Journal on Scientific Computing · doi:10.1137/0916069 · Cited by 6,221
Graves, A., Fernández, S., Gomez, F., & Schmidhuber, J. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143891 · Cited by 5,370
Self-citationBackpropagation through time: what it does and how to do it
Werbos, P. J. (1990) · Proceedings of the IEEE · doi:10.1109/5.58337 · Cited by 4,879 · cited 1×
“Two well-known algorithms have been devised to efficiently calculate weight derivatives for RNNs: real time recurrent learning (RTRL; Robinson and Fallside, 1987) and backpropagation through time (BPTT; Williams and Zipser, 1995; Werbos, 1990).”
MethodGreedy layer-wise training of deep networks
Bengio, Y., Lamblin, P., Popovici, D., & Larochelle, H. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0024 · Cited by 4,841 · cited 1×
“It has been repeatedly noted that training neural networks with many layers using gradient descent is difficult (Hinton et al., 2006; Bengio et al., 2007).”
BackgroundLearning to forget: Continual prediction with LSTM
Gers, F. A., Schmidhuber, J., & Cummins, F. (2000) · Neural Computation · doi:10.1162/089976600300015015 · Cited by 4,823
Bayesian Learning for Neural Networks
Neal, R. M. (1996) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-0745-0 · Cited by 4,276
A direct adaptive method for faster backpropagation learning: the RPROP algorithm
Riedmiller, M., & Braun, H. (2002) · IEEE International Conference on Neural Networks · doi:10.1109/icnn.1993.298623 · Cited by 3,917
Hierarchical models of object recognition in cortex
Riesenhuber, M., & Poggio, T. (1999) · Nature Neuroscience · doi:10.1038/14819 · Cited by 3,309 · cited 1×
“So-called hierarchical subsampling is commonly used in fields such as computer vision where the volume of data is too great to be processed by a ‘flat’ architecture (LeCun et al., 1998b; Reisenhuber and Poggio, 1999).”
MethodBest practices for convolutional neural networks applied to visual document analysis
Simard, P. Y., Steinkraus, D., & Platt, J. C. (2005) · Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings. · doi:10.1109/icdar.2003.1227801 · Cited by 2,741
A guided tour to approximate string matching
Navarro, G. (2001) · ACM Computing Surveys · doi:10.1145/375360.375365 · Cited by 2,561
TIMIT Acoustic-Phonetic Continuous Speech Corpus
Garofolo, J. S., Lamel, L. F., Fisher, W. M., Pallett, D. S., Dahlgren, N. L., Zue, V. W., & Fiscus, J. G. (2020) · Americanae (AECID Library) · doi:10.35111/17gk-bn40 · Cited by 2,508
Mullin, A. A., & Rosenblatt, F. (1963) · The American Mathematical Monthly · doi:10.2307/2312103 · Cited by 2,209
An Introduction to the Conjugate Gradient Method Without the Agonizing Pain
Shewchuk, J. R. (1994) · Cited by 2,173
A Novel Connectionist System for Unconstrained Handwriting Recognition
Graves, A., Liwicki, M., Fernandez, S., Bertolami, R., Bunke, H., & Schmidhuber, J. (2009) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.137 · Cited by 1,983
Self-citationAcoustic Modeling Using Deep Belief Networks
Mohamed, A.-R., Dahl, G. E., & Hinton, G. (2012) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2011.2109382 · Cited by 1,727
The IAM-database: an English sentence database for offline handwriting recognition
Marti, U.-V., & Bunke, H. (2002) · International Journal on Document Analysis and Recognition · doi:10.1007/s100320200071 · Cited by 1,478
Young, S. J., Jansen, J., Odell, J. J., Ollason, D., & Woodland, P. (1995) · Cited by 1,427
Gradient Flow in Recurrent Nets: The Difficulty of Learning LongTerm Dependencies
(2009) · A Field Guide to Dynamical Recurrent Networks · doi:10.1109/9780470544037.ch14 · Cited by 1,246
Bridle, J. S. (1990) · Neurocomputing · doi:10.1007/978-3-642-76153-9_28 · Cited by 1,237
Self-organization and associative memory: 3rd edition
Kohonen, T. (1989) · Springer eBooks · Cited by 1,223
Connectionist Speech Recognition: A Hybrid Approach
Bourlard, H. A., & Morgan, N. H. (1993) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 1,115
Attractor dynamics and parallelism in a connectionist sequential machine
Jordan, M. I. (1986) · eScholarship (California Digital Library) · Cited by 1,040
Keeping the neural networks simple by minimizing the description length of the weights
Hinton, G. E., & van Camp, D. (1993) · Proceedings of the sixth annual conference on Computational learning theory - COLT '93 · doi:10.1145/168304.168306 · Cited by 994
Generalization of backpropagation with application to a recurrent gas market model
Werbos, P. J. (1988) · Neural Networks · doi:10.1016/0893-6080(88)90007-x · Cited by 944
(2007) · Cited by 937
Speaker-independent phone recognition using hidden Markov models
Lee, K.-F., & Hon, H.-W. (1989) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/29.46546 · Cited by 927
Mackay, D. J. C. (1995) · Network Computation in Neural Systems · doi:10.1088/0954-898x/6/3/011 · Cited by 915
Learning long-term dependencies in NARX recurrent neural networks
Lin, T., Horne, B. G., Tino, P., & Giles, C. L. (1996) · IEEE Transactions on Neural Networks · doi:10.1109/72.548162 · Cited by 784
Fast-learning variations on back propagation: an empirical study.
Fahlman, S. E. (1989) · Medical Entomology and Zoology · Cited by 725
LSTM recurrent networks learn simple context-free and context-sensitive languages
Gers, F. A., & Schmidhuber, E. (2001) · IEEE Transactions on Neural Networks · doi:10.1109/72.963769 · Cited by 722
Offline Arabic Handwriting Recognition with Multidimensional Recurrent Neural Networks
Graves, A. (2012) · Guide to OCR for Arabic Scripts · doi:10.1007/978-1-4471-4072-6_12 · Cited by 684
Self-citationBeneš, J. (1990) · Czech digital mathematics library · Cited by 649
A time-delay neural network architecture for isolated word recognition
Lang, K. J., Waibel, A. H., & Hinton, G. E. (1990) · Neural Networks · doi:10.1016/0893-6080(90)90044-l · Cited by 596
IFN/ENIT: database of handwritten arabic words
Pechwitz, M., Maddouri, S. S., Märgner, V., Ellouze, N., & Amiri, H. (2002) · Cited by 591
Training Invariant Support Vector Machines
Decoste, D., & Schölkopf, B. (2002) · Machine Learning · doi:10.1023/a:1012454411458 · Cited by 588
Exploiting the past and the future in protein secondary structure prediction
Baldi, P., Brunak, S., Frasconi, P., Soda, G., & Pollastri, G. (1999) · Bioinformatics · doi:10.1093/bioinformatics/15.11.937 · Cited by 497
The Effects of Adding Noise During Backpropagation Training on a Generalization Performance
An, G. (1996) · Neural Computation · doi:10.1162/neco.1996.8.3.643 · Cited by 475
A general framework for adaptive processing of data structures
Frasconi, P., Gori, M., & Sperduti, A. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/72.712151 · Cited by 471
Marti, U.-V., & Bunke, H. (2001) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001401000848 · Cited by 441
An application of recurrent nets to phone probability estimation
Robinson, A. J. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279192 · Cited by 441
Gradient-based learning algorithms for recurrent networks and their computational complexity
Williams, R. J., & Zipser, D. (1995) · Cited by 424
Experiments on Learning by Back Propagation.
Plaut, D. C., Nowlan, S. J., & Hinton, G. E. (1986) · Cited by 412
Learning Complex, Extended Sequences Using the Principle of History Compression
Schmidhuber, J. (1992) · Neural Computation · doi:10.1162/neco.1992.4.2.234 · Cited by 398
Multi-dimensional Recurrent Neural Networks
Graves, A., Fernández, S., & Schmidhuber, J. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74690-4_56 · Cited by 303 · cited 8×
“LSTM01 LSTM原理与应用及训练方法_Constant dripping wears …Accepted papers | EMNLP 2021roberta-base · Hugging Face有哪些LSTM(Long Short Term Memory)和RNN(Recurrent)网络的 …(PDF) Deep Learning - ResearchGateFake news detection: A hybrid CNN-RNN based deep learning GitHub - shawnyuen IEEE ICIP 2021 || Anchorage, Alaska, USA || 19-22 30th…”
BackgroundInfluentialSelf-citationImage Processing Using Pulse-Coupled Neural Networks
Lindblad, T., & Kinser, J. M. (2005) · Springer eBooks · doi:10.1007/3-540-28293-9 · Cited by 301
A probabilistic framework for segment-based speech recognition
Glass, J. R. (2003) · Computer Speech & Language · doi:10.1016/s0885-2308(03)00006-8 · Cited by 280
Fast Curvature Matrix-Vector Products for Second-Order Gradient Descent
Schraudolph, N. N. (2002) · Neural Computation · doi:10.1162/08997660260028683 · Cited by 265
Token passing: a simple conceptual model for connected speech recognition systems
Young, S. J., Russell, N. H., & Thornton, J. H. S. (1989) · Cambridge University Engineering Department Publications Database · Cited by 258
An Application of Recurrent Neural Networks to Discriminative Keyword Spotting
Fernández, S., Graves, A., & Schmidhuber, J. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74695-9_23 · Cited by 251
Self-citationTraining Recurrent Networks by Evolino
Schmidhuber, J., Wierstra, D., Gagliolo, M., & Gomez, F. (2007) · Neural Computation · doi:10.1162/neco.2007.19.3.757 · Cited by 248
Finding temporal structure in music: blues improvisation with LSTM recurrent networks
Eck, D., & Schmidhuber, J. (2003) · Proceedings of the 12th IEEE Workshop on Neural Networks for Signal Processing · doi:10.1109/nnsp.2002.1030094 · Cited by 236
Long short-term memory in recurrent neural networks
Gers, F. A. (2001) · doi:10.5075/epfl-thesis-2366 · Cited by 233
Connectionist probability estimators in HMM speech recognition
Renals, S., Morgan, N., Bourlard, H., Cohen, M., & Franco, H. (1994) · IEEE Transactions on Speech and Audio Processing · doi:10.1109/89.260359 · Cited by 228
(2019) · Communications in Computer and Information Science · doi:10.1007/978-981-13-9361-7 · Cited by 222
IAM-OnDB - an on-line English sentence database acquired from handwritten text on a whiteboard
Liwicki, M., & Bunke, H. (2005) · Eighth International Conference on Document Analysis and Recognition (ICDAR'05) · doi:10.1109/icdar.2005.132 · Cited by 211
Markovian Models for Sequential Data
(2008) · Machine Learning for Audio, Image and Video Analysis · doi:10.1007/978-1-84800-007-0_10 · Cited by 209
Reinforcement Learning with Long Short-Term Memory
Bakker, B. (2001) · Cited by 209
Global optimization of a neural network-hidden Markov model hybrid
Bengio, Y., De Mori, R., Flammia, G., & Kompe, R. (1992) · IEEE Transactions on Neural Networks · doi:10.1109/72.125866 · Cited by 203
Enhanced MLP performance and fault tolerance resulting from synaptic weight noise during training
Murray, A. F., & Edwards, P. J. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.317730 · Cited by 201 · cited 1×
“An alternative regularisation strategy is to add zero-mean, fixed variance Gaussian noise to the network weights (Murray and Edwards, 1994; Jim et al., 1996).”
BackgroundICDAR 2005 Arabic handwriting recognition competition
Margner, V., Pechwitz, M., & Abed, H. E. (2005) · Eighth International Conference on Document Analysis and Recognition (ICDAR'05) · doi:10.1109/icdar.2005.52 · Cited by 195
Introduction to the Special Issue on Meta-Learning
Giraud-Carrier, C., Vilalta, R., & Brazdil, P. (2004) · Machine Learning · doi:10.1023/b:mach.0000015878.60765.42 · Cited by 186
Liwicki, M., Graves, A., Horst Bunke, A., & Schmidhuber, J. (2007) · BORIS (University Library Bern) · Cited by 183
Self-citationLarge Margin Hidden Markov Models for Automatic Speech Recognition
Sha, F., & Saul, L. K. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0161 · Cited by 177
Speaker-adaptation for hybrid HMM-ANN continuous speech recognition system
Neto, J., Almeida, L., Hochberg, M., Martins, C., Nunes, L., Renals, S., & Robinson, T. (1995) · 4th European Conference on Speech Communication and Technology (Eurospeech 1995) · doi:10.21437/eurospeech.1995-411 · Cited by 175
Introducing a very large dataset of handwritten Farsi digits and a study on their varieties
Khosravi, H., & Kabir, E. (2007) · Pattern Recognition Letters · doi:10.1016/j.patrec.2006.12.022 · Cited by 175
Matplotlib for Python Developers
Tosi, S. (2009) · CERN Document Server (European Organization for Nuclear Research) · Cited by 166
An analysis of noise in recurrent neural networks: convergence and generalization
Jim, K.-C., Giles, C. L., & Horne, B. G. (1996) · IEEE Transactions on Neural Networks · doi:10.1109/72.548170 · Cited by 136
Evolving Memory Cell Structures for Sequence Learning
Bayer, J., Wierstra, D., Togelius, J., & Schmidhuber, J. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-04277-5_76 · Cited by 133
On the approximation capability of recurrent neural networks
Hammer, B. (2000) · Neurocomputing · doi:10.1016/s0925-2312(99)00174-5 · Cited by 132
LeRec: A NN/HMM Hybrid for On-Line Handwriting Recognition
Bengio, Y., LeCun, Y., Nohl, C., & Burges, C. (1995) · Neural Computation · doi:10.1162/neco.1995.7.6.1289 · Cited by 132
Fast model-based protein homology detection without alignment
Hochreiter, S., Heusel, M., & Obermayer, K. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm247 · Cited by 128
Results of the RIMES Evaluation Campaign for Handwritten Mail Processing
Grosicki, E., Carr'e, M., Brodin, J.-M., & Geoffrois, E. (2009) · IAPR International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2009.224 · Cited by 109
ICDAR 2009-Arabic handwriting recognition competition
Abed, H. E., & Märgner, V. (2010) · International Journal on Document Analysis and Recognition (IJDAR) · doi:10.1007/s10032-010-0117-5 · Cited by 94
Sequence labelling in structured domains with hierarchical recurrent neural network
Fernández, S., Graves, A., & Schmidhuber, J. (2008) · mediaTUM (Technical University of Munich) · Cited by 92
Self-citationHeterogeneous acoustic measurements and multiple classifiers for speech recognition
Halberstadt, A. K., & Glass, J. R. (1999) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 90
High performance speaker-independent phone recognition using CDHMM
Lamel, L. F., & Gauvain, J. (1993) · European Conference on Speech Communication and Technology (Eurospeech) · doi:10.21437/eurospeech.1993-49 · Cited by 89
Speech Recognition Using Augmented Conditional Random Fields
Hifny, Y., & Renals, S. (2009) · IEEE Transactions on Audio, Speech, and Language Processing · doi:10.1109/tasl.2008.2010286 · Cited by 81
Robust combination of neural networks and hidden markov models for speech recognition
Trentin, E., & Gori, M. (2003) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2003.820838 · Cited by 81
Capacity and complexity of HMM duration modeling techniques
Johnson, M. T. (2005) · IEEE Signal Processing Letters · doi:10.1109/lsp.2005.845598 · Cited by 80
ICDAR 2009 Online Arabic Handwriting Recognition Competition
Abed, H. E., Märgner, V., Kherallah, M., & Alimi, A. M. (2009) · IAPR International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2009.284 · Cited by 79
Online Arabic Handwriting Recognition Competition
Kherallah, M., Tagougui, N., Alimi, A. M., Abed, H. E., & Märgner, V. (2011) · IAPR International Conference on Document Analysis and Recognition (ICDAR) · doi:10.1109/icdar.2011.289 · Cited by 75
Matplotlib for Python Developers
Tosi, S. (2009) · Cited by 70
Modeling systems with internal state using evolino
Wierstra, D., Gomez, F. J., & Schmidhuber, J. (2005) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1068009.1068315 · Cited by 68
Offline grammar-based recognition of handwritten sentences
Zimmermann, M., Chappelier, J.-C., & Bunke, H. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.103 · Cited by 68
A Comprehensive Isolated Farsi/Arabic Character Database for Handwritten OCR Research
Mozaffari, S., Karim Faez, A., Faradji, F., Ziaratban, M., & Golzan, S. M. (2006) · Cited by 64
Neural network design for J function approximation in dynamic programmingPreprint
Pang, X., & Werbos, P. J. (1998) · arXiv (Cornell University) · doi:10.48550/arxiv.adap-org/9806001 · Cited by 60
Bidirectional Dynamics for Protein Secondary Structure Prediction
Baldi, P., Brunak, S., Frasconi, P., Pollastri, G., & Soda, G. (2000) · Lecture notes in computer science · doi:10.1007/3-540-44565-x_5 · Cited by 56
A CONNECTIONIST APPROACH TO SPEECH RECOGNITION
Bengio, Y. (1993) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001493000327 · Cited by 54
Solimanpour, F., Sadri, J., & Suen, C. Y. (2006) · HAL · Cited by 52
Estimation of global posteriors and forward-backward training of hybrid HMM/ANN systems
Hennebert, J., Ris, C., Bourlard, H. A., Renals, S. J., & Morgan, N. H. (1997) · European Conference on Speech Communication and Technology (Eurospeech) · doi:10.21437/eurospeech.1997-518 · Cited by 50
Combining phonetic attributes using conditional random fields
Morris, J., & Fosler‐Lussier, E. (2006) · Interspeech (USB) · doi:10.21437/interspeech.2006-218 · Cited by 49
Phoneme recognition in TIMIT with BLSTM-CTCPreprint
Fernández, S., Graves, A., & Schmidhuber, J. (2008) · arXiv (Cornell University) · doi:10.48550/arxiv.0804.3269 · Cited by 48
Self-citationContext-Dependent Classes in a Hybrid Recurrent Network-HMM Speech Recognition System
Kershaw, D. J., ROBINSON, A., & Hochberg, M. M. (1995) · neural information processing systems · Cited by 48
Improved phone recognition using Bayesian triphone models
Ming, J., & Smith, F. J. (2002) · Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181) · doi:10.1109/icassp.1998.674454 · Cited by 46
Holographic Recurrent Networks
Plate, T. A. (1992) · Cited by 39
On supervised learning from sequential data with applications for speech regognition
Schuster, M. (1999) · Institutional Repositories DataBase (IRDB) · doi:10.11501/3153839 · Cited by 37
Robinson, T., Almeida, L. B., Boite, J.-M., Bourlard, H. A., Fallside, F., Hochberg, M. M., Kershaw, D. J., Kohn, P., Konig, Y., Morgan, N. H., et al. (1993) · European Conference on Speech Communication and Technology (Eurospeech) · doi:10.21437/eurospeech.1993-401 · Cited by 36
Kernel regression and backpropagation training with noise
Koistinen, P., & Holmström, L. (1991) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.1991.170429 · Cited by 36
Handwriting Recognition of Whiteboard Notes
Liwicki, M., & Bunke, H. (2005) · Cited by 34
An exploration of large vocabulary tools for small vocabulary phonetic recognition
Sainath, T. N., Ramabhadran, B., & Picheny, M. (2009) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2009.5373263 · Cited by 34
Forward-backward retraining of recurrent neural networks
Senior, A., & Robinson, A. J. (1995) · Cited by 33
Recurrent networks for structured data – A unifying approach and its properties
Hammer, B. (2002) · Cognitive Systems Research · doi:10.1016/s1389-0417(01)00056-0 · Cited by 32
Modular DAG–RNN Architectures for Assembling Coarse Protein Structures
Pollastri, G., Vullo, A., Frasconi, P., & Baldi, P. (2006) · Journal of Computational Biology · doi:10.1089/cmb.2006.13.631 · Cited by 26
Near-miss modeling : a segment-based approach to speech recognition
Chang, J. W. (1998) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 22
Phoneme boundary estimation using bidirectional recurrent neural networks and its applications
Fukada, T., Schuster, M., & Sagisaka, Y. (1999) · Systems and Computers in Japan · doi:10.1002/(sici)1520-684x(199904)30:4<20::aid-scj3>3.0.co;2-e · Cited by 20
A lattice search technique for a long-contextual-span hidden trajectory model of speech
Yu, D., Deng, L., & Acero, A. (2006) · Speech Communication · doi:10.1016/j.specom.2006.05.002 · Cited by 19
Capturing Long-Term Dependencies for Protein Secondary Structure Prediction
Chen, J., & Chaudhari, N. S. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-28648-6_79 · Cited by 18
Bow, S. (2002) · CRC Press eBooks · doi:10.1201/9780203903896-9 · Cited by 18
A Scalable Machine Learning Approach to Go
Wu, L., & Baldi, P. (2007) · The MIT Press eBooks · doi:10.7551/mitpress/7503.003.0195 · Cited by 17
Experiments on the implementation of recurrent neural networks for speech phone recognition
Chen, R., & Jamieson, L. H. (2002) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/acssc.1996.601160 · Cited by 16
Facial Expression Recognition with Pseudo-3D Hidden Markov Models
Hülsken, F., Wallhoff, F., & Rigoll, G. (2001) · Lecture notes in computer science · doi:10.1007/3-540-45404-7_39 · Cited by 14
A HYBRID CONTINUOUS SPEECH RECOGNITION SYSTEM USING SEGMENTAL NEURAL NETS WITH HIDDEN MARKOV MODELS
Zavaliagkos, G., Austin, S., Makhoul, J., & Schwartz, R. (1993) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001493000480 · Cited by 13
Rapid Retraining on Speech Data with LSTM Recurrent Networks.
Graves, A., Beringer, N., & Schmidhuber, J. (2005) · doi:10.71910/supsi.6964 · Cited by 12
Self-citation(2002) · Signal processing and communications · doi:10.1201/9780203903896.pt2 · Cited by 12
Robinson, T., Holdsworth, J., Patterson, R. D., & Fallside, F. (1990) · International Conference on Spoken Language Processing (ICSLP) · doi:10.21437/icslp.1990-271 · Cited by 10
Graph transformer networks for image recognition
Bottou, L., & LeCun, Y. (2005) · Cited by 10
Zhang, Z. (2013) · Springer eBooks · doi:10.1007/978-1-4419-9863-7_418 · Cited by 5
A New Training Algorithm For Hybrid Hmm/Ann Speech Recognition Systems
Bourlard, H. A., Konig, Y., Morgan, N. H., & Ris, C. (1996) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.36364 · Cited by 4
Multi-Dimensional Dependency-Tree Hidden Markov Models
Mérialdo, B., Jitén, J., & Huet, B. (2006) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2006.1660457 · Cited by 4
Parameter estimation of multi-dimensional hidden Markov models - a scalable approach
Joshi, D., Li, J., & Wang, J. Z. (2005) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2005.1530350 · Cited by 2
Cited by
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
Speech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
“Instead of combining RNNs with HMMs, it is possible to train RNNs ‘end-to-end’ for speech recognition [8, 9, 10].”
MethodSelf-citationGreff, K., Srivastava, R. K., Koutnik, J., Steunebrink, B. R., & Schmidhuber, J. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2582924 · Cited by 6,955
“results [20], [36].”
Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Network
Sherstinsky, A. (2020) · Physica D: Nonlinear Phenomena · doi:10.1016/j.physd.2019.132306 · Cited by 5,680
“’s flexibility and generality [12]. 1 arXiv:1808.03314v4 [cs.LG] 4 Nov 2018 In all sources that the author is aware of to date, one or more of the elements in the above list is not addressed [8], [9], [10], [56], [54], [11], [57], [45], [24], [20], [31], [33], [19], [66], [41], [3], [26], [25], [27], [17], [46]. An art…”
BackgroundMethodInfluential
Metadata
- Authors
- Graves, A.
- Affiliations
- University of Toronto (CA)
- Corresponding author
- Graves, Alex
- Venue
- Studies in Computational Intelligence
- Publisher
- Springer Berlin Heidelberg
- Published
- 2012
- ISSN
- 1860-949X (ISSN-L)
- 1860-9503
- OpenAlex
- W2144499799
- Cited by
- 3,120
- References
- 138
- Citations by year
- 2026: 185 · 2025: 365 · 2024: 383 · 2023: 332 · 2022: 236 · 2021: 248 · 2020: 242 · 2019: 291 · 2018: 300 · 2017: 212 · 2016: 146 · 2015: 76 · 2014: 35 · 2013: 23 · 2012: 16
- FWCI
- 21.86
- Type
- book
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Studies in computational intelligence (publishedVersion)
- International Linear Collider (submittedVersion)
- DIAL (Catholic University of Leuven) (submittedVersion)
- mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- recurrent neural networks, long short-term memory networks, multidimensional data, image sequences, video sequences, context modeling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.