The DOI matches its Crossref record; 109 of the 109 references it cites were found in a registry or an index.
A Review of Recurrent Neural Networks: LSTM Cells and Network Architectures
Abstract
Recurrent neural networks (RNNs) have been widely adopted in research areas concerned with sequential data, such as text, audio, and video. However, RNNs consisting of sigma cells or tanh cells are unable to learn the relevant information of input data when the input gap is large. By introducing gate functions into the cell structure, the long short-term memory (LSTM) could handle the problem of long-term dependencies well. Since its introduction, almost all the exciting results based on RNNs have been achieved by the LSTM. The LSTM has become the focus of deep learning. We review the LSTM cell and its variants to explore the learning capacity of the LSTM cell. Furthermore, the LSTM networks are divided into two broad categories: LSTM-dominated networks and integrated LSTM networks. In addition, their various applications are discussed. Finally, future research directions are presented for LSTM networks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
Backpropagation Applied to Handwritten Zip Code Recognition
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.541 · Cited by 11,891
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
Bidirectional recurrent neural networks
Schuster, M., & Paliwal, K. K. (1997) · IEEE Transactions on Signal Processing · doi:10.1109/78.650093 · Cited by 10,172
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
Learning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542
Greff, K., Srivastava, R. K., Koutnik, J., Steunebrink, B. R., & Schmidhuber, J. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2582924 · Cited by 6,955
Framewise phoneme classification with bidirectional LSTM and other neural network architectures
Graves, A., & Schmidhuber, J. (2005) · Neural Networks · doi:10.1016/j.neunet.2005.06.042 · Cited by 5,839
Proceedings of the 19th International Joint Conference on Artificial Intelligence
Pujol, J. M., Delgado, J., Ramon Sangüesa, A., & Flache, A. (2005) · International Joint Conference on Artificial Intelligence · Cited by 5,771
Fukushima, K. (1980) · Biological Cybernetics · doi:10.1007/bf00344251 · Cited by 5,759
Learning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 4,941
Learning to forget: Continual prediction with LSTM
Gers, F. A., Schmidhuber, J., & Cummins, F. (2000) · Neural Computation · doi:10.1162/089976600300015015 · Cited by 4,823
Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review
Rawat, W., & Wang, Z. (2017) · Neural Computation · doi:10.1162/neco_a_00990 · Cited by 3,503
Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1406.1078 · Cited by 3,317
Supervised Sequence Labelling with Recurrent Neural Networks
Graves, A. (2012) · Studies in Computational Intelligence · doi:10.1007/978-3-642-24797-2 · Cited by 3,120
Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks
Tai, K. S., Socher, R., & Manning, C. D. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1150 · Cited by 3,081
Generating Sequences With Recurrent Neural Networks
Graves, A. (2013) · arXiv · doi:10.48550/arxiv.1308.0850 · Cited by 2,894
Proceedings of the International Joint Conference on Artificial Intelligence 2007
Bundy, A. (2007) · International Joint Conference on Artificial Intelligence · Cited by 2,761
Gate-variants of Gated Recurrent Unit (GRU) neural networks
Dey, R., & Salem, F. M. (2017) · 2017 IEEE 60th International Midwest Symposium on Circuits and Systems (MWSCAS) · doi:10.1109/mwscas.2017.8053243 · Cited by 2,186
A Critical Review of Recurrent Neural Networks for Sequence Learning
Lipton, Z. C., Berkowitz, J. A., & Elkan, C. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.00019 · Cited by 1,996
Advances in Neural Information Processing Systems 5
Zemel, R. S., Williams, C. K. I., & Mozer, M. C. (1993) · Cited by 1,896
Polynomial Theory of Complex Systems
Ivakhnenko, A. G. (1971) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1971.4308320 · Cited by 1,684
Convolutional, Long Short-Term Memory, fully connected Deep Neural Networks
Sainath, T. N., Vinyals, O., Senior, A., & Sak, H. (2015) · 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2015.7178838 · Cited by 1,678
Microsoft COCO Captions: Data Collection and Evaluation Server
Chen, X., Fang, H., Lin, T.-Y., Vedantam, R., Gupta, S., Dollar, P., & Zitnick, C. L. (2015) · arXiv · doi:10.48550/arxiv.1504.00325 · Cited by 1,614
Pixel Recurrent Neural Networks
van den Oord, A., Kalchbrenner, N., & Kavukcuoglu, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1601.06759 · Cited by 1,437
Hybrid computing using a neural network with dynamic external memory
Graves, A., Wayne, G., Reynolds, M., Harley, T., Danihelka, I., Grabska-Barwińska, A., Colmenarejo, S. G., Grefenstette, E., Ramalho, T., Agapiou, J., et al. (2016) · Nature · doi:10.1038/nature20101 · Cited by 1,412
End-to-End Relation Extraction using LSTMs on Sequences and Tree Structures
Miwa, M., & Bansal, M. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1105 · Cited by 1,322
IEEE Geoscience and Remote Sensing Letters
(2023) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.8859 · Cited by 1,134
A review on the application of deep learning in system health management
Khan, S., & Yairi, T. (2018) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2017.11.024 · Cited by 1,133
Graves, A., Wayne, G., & Danihelka, I. (2014) · arXiv · doi:10.48550/arxiv.1410.5401 · Cited by 1,058
Independently Recurrent Neural Network (IndRNN): Building A Longer and Deeper RNN
Li, S., Li, W., Cook, C., Zhu, C., & Gao, Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00572 · Cited by 972
Proceedings Of The International Joint Conference On Neural Networks 2003
(2003) · Proceedings of the International Joint Conference on Neural Networks, 2003. · doi:10.1109/ijcnn.2003.1223944 · Cited by 950
Generalization of backpropagation with application to a recurrent gas market model
Werbos, P. J. (1988) · Neural Networks · doi:10.1016/0893-6080(88)90007-x · Cited by 944
Srivastava, R. K., Greff, K., & Schmidhuber, J. (2015) · arXiv · doi:10.48550/arxiv.1505.00387 · Cited by 912
A review of semantic segmentation using deep neural networks
Guo, Y., Liu, Y., Georgiou, T., & Lew, M. S. (2018) · International Journal of Multimedia Information Retrieval · doi:10.1007/s13735-017-0141-z · Cited by 882
Visualizing and Understanding Recurrent Networks
Karpathy, A., Johnson, J., & Fei-Fei, L. (2015) · arXiv · doi:10.48550/arxiv.1506.02078 · Cited by 845
Sak, H., Senior, A., & Beaufays, F. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1402.1128 · Cited by 838
LSTM recurrent networks learn simple context-free and context-sensitive languages
Gers, F. A., & Schmidhuber, E. (2001) · IEEE Transactions on Neural Networks · doi:10.1109/72.963769 · Cited by 722
Supervised neural networks for the classification of structures
Sperduti, A., & Starita, A. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.572108 · Cited by 666
An LSTM Network for Highway Trajectory PredictionPreprint
Altch\'e, F., & Fortelle, A. D. L. (2018) · arXiv (Cornell University) · Cited by 663
Learning State Space Trajectories in Recurrent Neural Networks
Pearlmutter, B. A. (1989) · Neural Computation · doi:10.1162/neco.1989.1.2.263 · Cited by 656
A C-LSTM Neural Network for Text Classification
Zhou, C., Sun, C., Liu, Z., & Lau, F. C. M. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.08630 · Cited by 641
Recurrent nets that time and count
Gers, F. A., & Schmidhuber, J. (2000) · Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium · doi:10.1109/ijcnn.2000.861302 · Cited by 623
Palangi, H., Deng, L., Shen, Y., Gao, J., He, X., Chen, J., Song, X., & Ward, R. (2016) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2016.2520371 · Cited by 618
Detect What You Can: Detecting and Representing Objects Using Holistic Models and Body Parts
Chen, X., Mottaghi, R., Liu, X., Fidler, S., Urtasun, R., & Yuille, A. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.254 · Cited by 605
Learning task-dependent distributed representations by backpropagation through structure
Goller, C., & Kuchler, A. (2002) · Proceedings of International Conference on Neural Networks (ICNN'96) · doi:10.1109/icnn.1996.548916 · Cited by 581
Differential Recurrent Neural Networks for Action Recognition
Veeriah, V., Zhuang, N., & Qi, G.-J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.460 · Cited by 516
Massive Exploration of Neural Machine Translation Architectures
Britz, D., Goldie, A., Luong, M.-T., & Le, Q. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1151 · Cited by 482
A general framework for adaptive processing of data structures
Frasconi, P., Gori, M., & Sperduti, A. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/72.712151 · Cited by 471
Parsing clothing in fashion photographs
Yamaguchi, K., Kiapour, M. H., Ortiz, L. E., & Berg, T. L. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248101 · Cited by 464
Proceedings IEEE International Conference on Acoustics, Speech and Signal Processing
Świętojański, P., & Renals, S. J. (2015) · Cited by 401
Minimal gated unit for recurrent neural networks
Zhou, G.-B., Wu, J., Zhang, C.-L., & Zhou, Z.-H. (2016) · International Journal of Automation and Computing · doi:10.1007/s11633-016-1006-2 · Cited by 357
A Review of Deep Learning Methods and Applications for Unmanned Aerial Vehicles
Carrio, A., Sampedro, C., Rodriguez-Ramos, A., & Campoy, P. (2017) · Journal of Sensors · doi:10.1155/2017/3296874 · Cited by 356
Semantic Object Parsing with Graph LSTM
Liang, X., Shen, X., Feng, J., Lin, L., & Yan, S. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_8 · Cited by 352
Learning Fashion Compatibility with Bidirectional LSTMs
Han, X., Wu, Z., Jiang, Y.-G., & Davis, L. S. (2017) · Proceedings of the 25th ACM international conference on Multimedia · doi:10.1145/3123266.3123394 · Cited by 325
Liu, Q., Zhou, F., Hang, R., & Yuan, X. (2017) · Remote Sensing · doi:10.3390/rs9121330 · Cited by 318
Multi-dimensional Recurrent Neural Networks
Graves, A., Fernández, S., & Schmidhuber, J. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74690-4_56 · Cited by 303
Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Models
Plummer, B. A., Wang, L., Cervantes, C. M., Caicedo, J. C., Hockenmaier, J., & Lazebnik, S. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-016-0965-7 · Cited by 298
Deep Human Parsing with Active Template Regression
Liang, X., Liu, S., Shen, X., Yang, J., Liu, L., Dong, J., Lin, L., & Yan, S. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2408360 · Cited by 292
Multimodal Gesture Recognition Using 3-D Convolution and Convolutional LSTM
Zhu, G., Zhang, L., Shen, P., & Song, J. (2017) · IEEE Access · doi:10.1109/access.2017.2684186 · Cited by 270
A CFCC-LSTM Model for Sea Surface Temperature Prediction
Yang, Y., Dong, J., Sun, X., Lima, E., Mu, Q., & Wang, X. (2018) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2017.2780843 · Cited by 270
Kalchbrenner, N., Danihelka, I., & Graves, A. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.01526 · Cited by 267
Koutník, J., Greff, K., Gomez, F. J., & Schmidhuber, J. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1402.3511 · Cited by 262
An Application of Recurrent Neural Networks to Discriminative Keyword Spotting
Fernández, S., Graves, A., & Schmidhuber, J. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74695-9_23 · Cited by 251
Pedestrian Path Prediction with Recursive Bayesian Filters: A Comparative Study
Schneider, N., & Gavrila, D. M. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40602-7_18 · Cited by 249
Training Recurrent Networks by Evolino
Schmidhuber, J., Wierstra, D., Gagliolo, M., & Gomez, F. (2007) · Neural Computation · doi:10.1162/neco.2007.19.3.757 · Cited by 248
Long short-term memory in recurrent neural networks
Gers, F. A. (2001) · doi:10.5075/epfl-thesis-2366 · Cited by 233
Machine health monitoring with LSTM networks
Zhao, R., Wang, J., Yan, R., & Mao, K. (2016) · 2016 10th International Conference on Sensing Technology (ICST) · doi:10.1109/icsenst.2016.7796266 · Cited by 229
On the Practical Computational Power of Finite Precision RNNs for Language Recognition
Weiss, G., Goldberg, Y., & Yahav, E. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p18-2117 · Cited by 226
When Are Tree Structures Necessary for Deep Learning of Representations?
Li, J., Luong, T., Jurafsky, D., & Hovy, E. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1278 · Cited by 207
Residual LSTM: Design of a Deep Recurrent Architecture for Distant Speech Recognition
Kim, J., El-Khamy, M., & Lee, J. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-477 · Cited by 196
Learning state space trajectories in recurrent neural networks
Pearlmutter (1989) · International Joint Conference on Neural Networks · doi:10.1109/ijcnn.1989.118724 · Cited by 186
Semantic Object Parsing with Local-Global Long Short-Term Memory
Liang, X., Shen, X., Xiang, D., Feng, J., Lin, L., & Yan, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.347 · Cited by 175
Hierarchical Multimodal LSTM for Dense Visual-Semantic Embedding
Niu, Z., Zhou, M., Wang, L., Gao, X., & Hua, G. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.208 · Cited by 161
Ivakhnenko, A. G., & Lapa, V. G. (1966) · CCM Information eBooks · Cited by 158
Proceedings of the 21 annual conference of the cognitive science society
Stoness, S. C. (1999) · University of Groningen research database (University of Groningen / Centre for Information Technology) · Cited by 150
Pulver, A., & Lyu, S. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7965940 · Cited by 122
Interpretable Structure-Evolving LSTM
Liang, X., Lin, L., Shen, X., Feng, J., Yan, S., & Xing, E. P. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.234 · Cited by 113
Irie, K., Tüske, Z., Alkhouli, T., Schlüter, R., & Ney, H. (2016) · Interspeech (USB) · doi:10.21437/interspeech.2016-491 · Cited by 107
Semantic part segmentation using compositional model combining shape and appearance
Wang, J., & Yuille, A. (2015) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2015.7298788 · Cited by 102
Thireou, T. N., & Reczko, M. (2007) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2007.1015 · Cited by 95
Era of deep neural networks: A review
Sharma, P., & Singh, A. (2017) · International Conference on Computing, Communication and Networking Technologies (ICCCNT) · doi:10.1109/icccnt.2017.8203938 · Cited by 93
Simplified minimal gated unit variations for recurrent neural networks
Heck, J. C., & Salem, F. M. (2017) · IEEE International Midwest Symposium on Circuits and Systems (MWSCAS) · doi:10.1109/mwscas.2017.8053242 · Cited by 78
Long Short-Term Memory Over Tree StructuresPreprint
Zhu, X., Sobhani, P., & Guo, H. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.04881 · Cited by 72
Stacked LSTM Deep Learning Model for Traffic Prediction in Vehicle-to-Vehicle Communication
Du, X., Zhang, H., Nguyen, H. V., & Han, Z. (2017) · IEEE Vehicular Technology Conference · doi:10.1109/vtcfall.2017.8288312 · Cited by 72
Deep Fusion LSTMs for Text Semantic Matching
Liu, P., Qiu, X., Chen, J., & Huang, X. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1098 · Cited by 67
Exploring multidimensional lstms for large vocabulary ASR
Li, J., Mohamed, A., Zweig, G., & Gong, Y. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472617 · Cited by 55
Modelling Interaction of Sentence Pair with Coupled-LSTMs
Liu, P., Qiu, X., Zhou, Y., Chen, J., & Huang, X. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1176 · Cited by 53
Exploiting LSTM structure in deep neural networks for speech recognition
He, T., & Droppo, J. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472718 · Cited by 52
Polyphonic Music Generation by Modeling Temporal Dependencies Using a RNN-DBN
Goel, K., Vohra, R., & Sahoo, J. K. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-11179-7_28 · Cited by 48
Self-Delimiting Neural NetworksPreprint
Schmidhuber, J. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1210.0118 · Cited by 38
Hsu, W.-N., Zhang, Y., Lee, A., & Glass, J. R. (2016) · Interspeech (USB) · doi:10.21437/interspeech.2016-515 · Cited by 38
Modeling temporal dependencies in data using a DBN-LSTM
Vohra, R., Goel, K., & Sahoo, J. K. (2015) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2015.7344820 · Cited by 36
Schmidhuber, J. (1993) · ICANN ’93 · doi:10.1007/978-1-4471-2063-6_110 · Cited by 34
Syllable-based acoustic modeling with CTC-SMBR-LSTM
Qu, Z., Haghani, P., Weinstein, E., & Moreno, P. J. (2017) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru.2017.8268932 · Cited by 29
Bidirectional Tree-Structured LSTM with Head LexicalizationPreprint
Teng, Z., & Zhang, Y. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.06788 · Cited by 27
LSTM-in-LSTM for generating long descriptions of images
Song, J., Tang, S., Xiao, J., et al. (2016) · Computational Visual Media · doi:10.1007/s41095-016-0059-z · Cited by 23
Residual Convolutional LSTM for Tweet Count Prediction
Wei, H., Zhou, H., Sankaranarayanan, J., Sengupta, S., & Samet, H. (2018) · International World Wide Web Conference (WWW) · doi:10.1145/3184558.3191571 · Cited by 19
Selective Recurrent Neural Network
Šter, B. (2012) · Neural Processing Letters · doi:10.1007/s11063-012-9259-4 · Cited by 18
Tree Recurrent Neural Networks with Application to Language Modeling.Preprint
Zhang, X., Lu, L., & Lapata, M. (2015) · arXiv (Cornell University) · Cited by 15
Reducing the Computational Complexity of Two-Dimensional LSTMs
Li, B., & Sainath, T. N. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-1164 · Cited by 13
Simplified LSTM unit and search space probability exploration for image description
Nina, O., & Rodríguez, A. (2015) · International Conference on Information, Communications & Signal Processing (ICICS) · doi:10.1109/icics.2015.7459976 · Cited by 13
Design of a Resource Management for GPGPU Supported Grid Computing
Dönmez, E. (2016) · DergiPark (Istanbul University) · Cited by 11
A Bidirectional LSTM Model for Question Title and Body Analysis in Question Answering
Nie, Y., An, C., Huang, J., Zhou, Y., & Han, Y. (2016) · IEEE International Conference on Data Science in Cyberspace · doi:10.1109/dsc.2016.72 · Cited by 5
Suffix Bidirectional Long Short-Term Memory.Preprint
Brahma, S. (2018) · arXiv (Cornell University) · Cited by 5
Long-Term Memory Neural Turing Machines
解, 笑. (2018) · Computer Science and Application · doi:10.12677/csa.2018.81008 · Cited by 2
Research works printed but not linked: 41
- Achanta R., 2010, SLIC superpixels
- 10.1109/ITSC.2017.8317913 · DOI
- Brown B., 2004, Circuits, Signals, and Systems: IASTED International Conference Proceedings
- 10.1109/ICNN.1996.549199 · doi:10.1109/icnn.1996.549199
- Cheng M., 2016, Proceedings of the IEEE 24th International Conference on Network Protocols
- Deng L., 2013, APSIPA transactions on signal and information processing
- Francesconi E., 1997, Proceedings of the International Workshop on Graphics Recognition, 104
- 10.1109/CEC.2005.1555002 · doi:10.1109/cec.2005.1555002
- Gers F. A., 2002, Journal of Machine Learning Research, 3, 115
- Goller C., 1996, Neural Networks, 1, 347
- Guo Y., 2017, International Journal of Multimedia Information Retrieval, 2, 1
- Hochreiter S., 1991, Untersuchungen zu dynamischen neuronalen Netzen
- Hsu W. N., 2016, Cell, 50, 395
- Jing L., 2017, Gated orthogonal recurrent units: On learning to forget
- Jozefowicz R., 2015, Proceedings of the International Conference on International Conference on Machine Learning, 2342
- Krause B., 2016, Multiplicative LSTM for sequence modelling
- 10.1145/2820783.2820801 · doi:10.1145/2820783.2820801
- Li J., 2016, Proceedings of the Conference on Automatic Speech Recognition and Understanding, 187
- Mallinar N., 2018, Deep canonically correlated LSTMs
- McCarter G., 2007, Air freight image segmentation database
- Moniz J. R. A., 2018, Nested LSTMs
- Nair V., 2010, Proceedings of the International Conference on International Conference on Machine Learning, 807
- Neil D., 2016, Advances in neural information processing systems, 16, 3882
- Nina O., 2016, Proceedings of the International Conference on Information, Communications and Signal Processing, 1
- Rahman L., 2017, Proceedings of the International Conference on Electrical Engineering and Information Communication Technology, 1
- Ranzato M. A., 2014, Video (language) modeling: A baseline for generative models of natural videos
- Robinson A. J., 1987, The utility driven dynamic error propagation network
- Saleh K., 2018, Proceedings of the IEEE International Conference on Intelligent Transportation Systems, 327
- Schlag I., 2017, NIPS Metalearning Workshop
- Shabanian S., 2017, Variational Bi-LSTMs
- Shi X., 2015, Advances in neural information processing systems, 802
- Sutskever I., 2014, Advances in neural information processing systems, 3104
- Tai K. S., 2015, Computer Science, 5, 36
- Weng J. J., 1993, Proceedings of the Fourth International Conference on Computer Vision, 121
- Williams R. J., 1989, Complexity of exact gradient computation algorithms for recurrent neural networks
- Wu H., 2016, An empirical exploration of skip connections for sequential tagging
- Yao K., 2015, Depth-gated LSTM
- 10.1109/DSC.2018.00019 · doi:10.1109/dsc.2018.00019
- Zaremba W., 2014, Learning to execute
- Zhang J., 2016, Proceedings of the IEEE Conference on Acoustics, Speech, and Signal Processing, 1655
- Zhou C., 2016, Computer Science, 1, 39
Cited by
A review on the long short-term memory model
Van Houdt, G., Mosquera, C., & Nápoles, G. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-020-09838-1 · Cited by 1,991
A comprehensive review on ensemble deep learning: Opportunities and challenges
Mohammed, A., & Kora, R. (2023) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2023.01.014 · Cited by 1,127
Deep learning modelling techniques: Current progress, applications, advantages, and challenges
Ahmed, S. F., Alam, M. S. B., Hassan, M., Rozbu, M. R., Ishtiak, T., Rafa, N., Mofijur, M., Shawkat Ali, A. B. M., & Gandomi, A. H. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10466-8 · Cited by 1,079
Feature dimensionality reduction: a review
Jia, W., Sun, M., Lian, J., & Hou, S. (2022) · Complex & Intelligent Systems · doi:10.1007/s40747-021-00637-x · Cited by 797
“To alleviate this problem, a variant of the RNN network of long shortterm memory (LSTM) is proposed, which uses the cell state with gate structure tomake information flow continuously [145].”
MethodRecurrent Neural Networks: A Comprehensive Review of Architectures, Variants, and Applications
Mienye, I. D., Swart, T. G., & Obaido, G. (2024) · Information · doi:10.3390/info15090517 · Cited by 732
Metadata
- Authors
- Yu, Y., Si, X., Hu, C., & Zhang, J.
- Venue
- Neural Computation
- Publisher
- MIT Press
- Published
- 2019-07
- Volume
- 31
- Issue
- 7
- Pages
- 1235-1270
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2944851425
- Cited by
- 5,591
- References
- 109
- FWCI
- 111.78
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.