The DOI matches its DataCite record; 15 of the 15 references it cites were found in a registry or an index.
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Open accessAbstract
In this paper we compare different types of recurrent units in recurrent neural networks (RNNs). Especially, we focus on more sophisticated units that implement a gating mechanism, such as a long short-term memory (LSTM) unit and a recently proposed gated recurrent unit (GRU). We evaluate these recurrent units on the tasks of polyphonic music modeling and speech signal modeling. Our experiments revealed that these advanced recurrent units are indeed better than more traditional recurrent units such as tanh units. Also, we found GRU to be comparable to LSTM.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“RNNs and their variants, including long short-term memory (LSTM)[23] and gated recurrent units (GRUs)[24], are effective for sequence modeling, capturing the impact of historical measurements on the current SOC[25].”
From Advancements in the estimation of the state of charge of lithium-ion battery: a comprehensive review of traditional and deep learning approaches (2025) · cites this paper as [24]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Additionally, it offers a significant reduction in computational complexity when examined to the LSTM network, making it a more lightweight and efficient alternative.”
From X-GEVON- a novel explainable intelligent network to detect the multiple attacks in vanet systems (2025) · cites this paper as [34]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Recurrent neural networks, long short-term memory [13] and gated recurrent [7] neural networks in particular, have been firmly established as state of the art approaches in sequence modeling and transduction problems such as language modeling and machine translation [35, 2, 5].”
From Attention Is All You Need (2017) · cites this paper as [7]
The cited source says what the claim attributes to it.
In the citing paper
“GRU is particularly effective in dealing with extended sequences and retaining long-term dependencies.”
From X-GEVON- a novel explainable intelligent network to detect the multiple attacks in vanet systems (2025) · cites this paper as [34]
The cited source says what the claim attributes to it.
In the citing paper
“The fourth layer of CPC is the Gated Recurrent Unit [8], which also learns representations similar to supervised learning.”
From Assessing the State of Self-Supervised Human Activity Recognition Using Wearables (2022) · cites this paper as [8]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Self-citationSpeech recognition with deep recurrent neural networks
Graves, A., Mohamed, A.-R., & Hinton, G. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638947 · Cited by 8,893
(2012) · Cited by 8,009
On the Properties of Neural Machine Translation: Encoder–Decoder Approaches
Cho, K., van Merriënboer, B., Bahdanau, D., & Bengio, Y. (2014) · SSST@EMNLP · doi:10.3115/v1/w14-4012 · Cited by 7,251
Self-citationSupervised Sequence Labelling with Recurrent Neural Networks
Graves, A. (2012) · Studies in Computational Intelligence · doi:10.1007/978-3-642-24797-2 · Cited by 3,120
Generating Sequences With Recurrent Neural Networks
Graves, A. (2013) · arXiv · doi:10.48550/arxiv.1308.0850 · Cited by 2,894
Practical Variational Inference for Neural Networks
Graves, A. (2011) · Cited by 1,079
Theano: new features and speed improvements
Bastien, F., Lamblin, P., Pascanu, R., Bergstra, J., Goodfellow, I., Bergeron, A., Bouchard, N., Warde-Farley, D., & Bengio, Y. (2012) · arXiv · doi:10.48550/arxiv.1211.5590 · Cited by 1,005
Self-citation
Research works printed but not linked: 4
- Y. Bengio, P. Simard, and P. Frasconi. Learning long-term dependencies with gradient descent is difficult. IEEE Transactions on Neural Networks , 5(2):157-166, 1994.
- J. Bergstra, O. Breuleux, F. Bastien, P. Lamblin, R. Pascanu, G. Desjardins, J. Turian, D. WardeFarley, and Y. Bengio. Theano: a CPU and GPU math expression compiler. In Proceedings of the Python for Scientific Computing Conference (SciPy) , June 2010. Oral Presentation.
- S. Hochreiter. Untersuchungen zu dynamischen neuronalen Netzen. Diploma thesis, Institut f¨ ur Informatik, Lehrstuhl Prof. Brauer, Technische Universit¨ at M¨ unchen, 1991. URL http:// www7.informatik.tu-muenchen.de/˜Ehochreit .
- R. Pascanu, T. Mikolov, and Y. Bengio. On the difficulty of training recurrent neural networks. In Proceedings of the 30th International Conference on Machine Learning (ICML'13) . ACM, 2013. URL http://icml.cc/2013/ .
Cited by
Sorted by citations
Items 101–171 of 171
Understanding Dataset Design Choices for Multi-hop Reasoning
Chen, J., & Durrett, G. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1405 · Cited by 82
Clune, J. (2019) · arXiv · doi:10.48550/arxiv.1905.10985 · Cited by 82
Deep neural networks predicting oil movement in a development unit
Temirchev, P., Simonov, M., Kostoev, R., Burnaev, E., Oseledets, I., Akhmetov, A., Margarit, A., Sitnikov, A., & Koroteev, D. (2020) · Journal of Petroleum Science and Engineering · doi:10.1016/j.petrol.2019.106513 · Cited by 75
Reinforcement learning-based adaptive PID controller for DPS
Lee, D., Lee, S. J., & Yim, S. C. (2020) · Ocean Engineering · doi:10.1016/j.oceaneng.2020.108053 · Cited by 80
Robust and accurate decoding of hand kinematics from entire spiking activity using deep learning
Ahmadi, N., Constandinou, T. G., & Bouganis, C.-S. (2021) · Journal of Neural Engineering · doi:10.1088/1741-2552/abde8a · Cited by 69
Liao, Z., Girgis, H., Abdi, A., Vaseli, H., Hetherington, J., Rohling, R., Gin, K., Tsang, T., & Abolmaesumi, P. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2959209 · Cited by 56
Conversational Query Understanding Using Sequence to Sequence Modeling
Ren, G., Ni, X., Malik, M., & Ke, Q. (2018) · Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18 · doi:10.1145/3178876.3186083 · Cited by 55
Rostam, N. A. P., Malim, N. H. A. H., Abdullah, R., Ahmad, A. L., Ooi, B. S., & Chan, D. J. C. (2021) · IEEE Access · doi:10.1109/access.2021.3102044 · Cited by 55
Smart Lithium-Ion Battery Monitoring in Electric Vehicles: An AI-Empowered Digital Twin Approach
Pooyandeh, M., & Sohn, I. (2023) · Mathematics · doi:10.3390/math11234865 · Cited by 55
Associated Spatio-Temporal Capsule Network for Gait Recognition
Zhao, A., Dong, J., Li, J., Qi, L., & Zhou, H. (2021) · arXiv · doi:10.48550/arxiv.2101.02458 · Cited by 55
Bardak, B., & Tan, M. (2021) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2021.102112 · Cited by 48
Yao, S., Zhao, Y., Shao, H., Liu, D., Liu, S., Hao, Y., Piao, A., Hu, S., Lu, S., & Abdelzaher, T. F. (2019) · IEEE INFOCOM 2019 - IEEE Conference on Computer Communications · doi:10.1109/infocom.2019.8737500 · Cited by 52
Contrastive Learning Models for Sentence Representations
Xu, L., Xie, H., Li, Z., Wang, F. L., Wang, W., & Li, Q. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3593590 · Cited by 50
Embodied Amodal Recognition: Learning to Move to Perceive Objects
Yang, J., Ren, Z., Xu, M., Chen, X., Crandall, D., Parikh, D., & Batra, D. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00213 · Cited by 48
Cheng, D., & Liu, M. (2017) · 2017 IEEE International Conference on Imaging Systems and Techniques (IST) · doi:10.1109/ist.2017.8261461 · Cited by 49
CardiacWave: A mmWave-based Scheme of Non-Contact and High-Definition Heart Activity Computing
Xu, C., Li, H., Li, Z., Zhang, H., Rathore, A. S., Chen, X., Wang, K., Huang, M.-C., & Xu, W. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3478127 · Cited by 49
BATUR DİNLER, Ö., & AYDIN, N. (2020) · Applied Sciences · doi:10.3390/app10041273 · Cited by 45
Electrical lithium-ion battery models based on recurrent neural networks: A holistic approach
Schmitt, J., Horstkötter, I., & Bäker, B. (2023) · Journal of Energy Storage · doi:10.1016/j.est.2022.106461 · Cited by 44
Direct speech reconstruction from sensorimotor brain activity with optimized deep learning models
Berezutskaya, J., Freudenburg, Z. V., Vansteensel, M. J., Aarnoutse, E. J., Ramsey, N. F., & van Gerven, M. A. J. (2023) · Journal of Neural Engineering · doi:10.1088/1741-2552/ace8be · Cited by 42
EDLA-EFDS: A Novel Ensemble Deep Learning Approach For Electrical Fault Detection Systems
Elmasry, W., & Wadi, M. (2022) · Electric Power Systems Research · doi:10.1016/j.epsr.2022.107834 · Cited by 42
Reinforced Structured State-Evolution for Vision-Language Navigation
Chen, J., Gao, C., Meng, E., Zhang, Q., & Liu, S. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01501 · Cited by 45
Multi-modality Sensor Data Classification with Selective Attention
Zhang, X., Yao, L., Huang, C., Wang, S., Tan, M., Long, G., & Wang, C. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/432 · Cited by 41
Modeling temporal patterns of cyberbullying detection with hierarchical attention networks
Cheng, L., Guo, R., Silva, Y. N., Hall, D., & Liu, H. (2021) · ACM/IMS Transactions on Data Science · doi:10.1145/3441141 · Cited by 43
Bednarski, B. P., Singh, A. D., Zhang, W., Jones, W. M., Naeim, A., & Ramezani, R. (2022) · Scientific Reports · doi:10.1038/s41598-022-25472-z · Cited by 41
“The GRU-D model is a recurrent neural network (RNN) architecture (similar to the long short-term memory network [LSTM]) 49 .”
MethodChoi, M., Pei, J., Kumar, S., Shu, C., & Jurgens, D. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.699 · Cited by 38
Gesture recognition with the linear optical sensor and recurrent neural networks
Czuszynski, K., Ruminski, J., & Kwasniewska, A. (2018) · IEEE Sensors Journal · doi:10.1109/jsen.2018.2834968 · Cited by 36
Harmonized representation learning on dynamic EHR graphs
Lee, D., Jiang, X., & Yu, H. (2020) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2020.103426 · Cited by 34
Shahtalebi, S., Atashzar, S. F., Samotus, O., Patel, R. V., Jog, M. S., & Mohammadi, A. (2020) · Scientific Reports · doi:10.1038/s41598-020-58912-9 · Cited by 32
“The update gate, on the other hand, defines the degree of updating a hidden state based on the newly arrived data 67 .”
BackgroundMoirangthem, D. S., & Lee, M. (2020) · Neural Networks · doi:10.1016/j.neunet.2019.12.022 · Cited by 30
Pre-training in Medical Data: A Survey
Qiu, Y., Lin, F., Chen, W., & Xu, M. (2023) · Machine Intelligence Research · doi:10.1007/s11633-022-1382-8 · Cited by 30
Directed Acyclic Graph Neural Network for Human Motion Prediction
Li, Q., Chalvatzaki, G., Peters, J., & Wang, Y. (2021) · 2021 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra48506.2021.9561540 · Cited by 29
XGest: Enabling Cross-Label Gesture Recognition with RF Signals
Zhang, Y., Yang, Z., Zhang, G., Wu, C., & Zhang, L. (2021) · ACM Transactions on Sensor Networks · doi:10.1145/3458750 · Cited by 29
Kadi, H. A., & Terzić, K. (2023) · Sensors · doi:10.3390/s23052389 · Cited by 27
Deep learning approaches for similarity computation: A survey
Yang, P., Wang, H., Yang, J., Qian, Z., Zhang, Y., & Lin, X. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3422484 · Cited by 28
On the Generation of Medical Question-Answer Pairs
Shen, S., Li, Y., Du, N., Wu, X., Xie, Y., Ge, S., Yang, T., Wang, K., Liang, X., & Fan, W. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6410 · Cited by 25
Sequence to Sequence Modeling for User Simulation in Dialog Systems
Crook, P., & Marin, A. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-161 · Cited by 25
Sc2Mol: a scaffold-based two-step molecule generator with variational autoencoder and transformer
Liao, Z., Xie, L., Mamitsuka, H., & Zhu, S. (2023) · Bioinformatics · doi:10.1093/bioinformatics/btac814 · Cited by 24
Multi-turn Intent Determination for Goal-oriented Dialogue systems
Abro, W. A., Qi, G., Gao, H., Khan, M. A., & Ali, Z. (2019) · 2019 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852246 · Cited by 23
MultiBench: Multiscale Benchmarks for Multimodal Representation Learning
Liang, P. P., Lyu, Y., Fan, X., Wu, Z., Cheng, Y., Wu, J., Chen, L., Wu, P., Lee, M. A., Zhu, Y., et al. (2021) · arXiv · doi:10.48550/arxiv.2107.07502 · Cited by 85
Online learning on tiny micro-controllers for anomaly detection in water distribution systems
Pau, D., Khiari, A., & Denaro, D. (2021) · 2021 IEEE 11th International Conference on Consumer Electronics (ICCE-Berlin) · doi:10.1109/icce-berlin53567.2021.9720009 · Cited by 21
Wu, Y., Bai, D., Zhang, K., Li, Y., & Yang, F. (2025) · Journal of Materials Informatics · doi:10.20517/jmi.2024.84 · Cited by 20
Abbas, Z., Rehman, M. U., Tayara, H., & Chong, K. T. (2023) · Bioinformatics · doi:10.1093/bioinformatics/btad664 · Cited by 17
HMFP-DBRNN: Real-Time Hand Motion Filtering and Prediction via Deep Bidirectional RNN
Shahtalebi, S., Atashzar, S. F., Patel, R. V., & Mohammadi, A. (2019) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2019.2894005 · Cited by 17
Liu, H., Liang, F., Hu, T., Hong, J., & Ma, H. (2024) · Journal of Modern Power Systems and Clean Energy · doi:10.35833/mpce.2023.000726 · Cited by 17
RWKV: Reinventing RNNs for the Transformer Era
Peng, B., Alcaide, E., Anthony, Q., Albalak, A., Arcadinho, S., Biderman, S., Cao, H., Cheng, X., Chung, M., Grella, M., et al. (2023) · arXiv · doi:10.48550/arxiv.2305.13048 · Cited by 17
“In parallel, RNN-style (Hochreiter and Schmidhuber, 1997; Chung et al., 2014) recursive components have also been modified to increase context length, such as the Recurrent Memory Transformer (Bulatov et al., 2022, 2023) and Linear Recurrent Units (Orvieto et al., 2023).”
MethodLog2Intent: Towards Interpretable User Modeling via Recurrent Semantics Memory Unit
Tao, Z., Li, S., Wang, Z., Fang, C., Yang, L., Zhao, H., & Fu, Y. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330889 · Cited by 16
Extracting Cause of Death from Verbal Autopsy with Deep Learning interpretable methods
Blanco, A., Perez, A., Casillas, A., & Cobos, D. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.3005769 · Cited by 17
Enhancing vehicular emissions monitoring: A GA-GRU-based soft sensors approach for HDDVs
Yang, L., Ge, Y., Lyu, L., Tan, J., Hao, L., Wang, X., Yin, H., & Wang, J. (2024) · Environmental Research · doi:10.1016/j.envres.2024.118190 · Cited by 16
Siraj, M. S., & Ahad, M. A. R. (2020) · 2020 Joint 9th International Conference on Informatics, Electronics & Vision (ICIEV) and 2020 4th International Conference on Imaging, Vision & Pattern Recognition (icIVPR) · doi:10.1109/icievicivpr48672.2020.9306630 · Cited by 15
Self-supervised Regularization for Text Classification
Zhou, M., Li, Z., & Xie, P. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00389 · Cited by 14
Buan, T. A., & Ramachandra, R. (2020) · Proceedings of the 2020 4th International Conference on Compute and Data Analysis · doi:10.1145/3388142.3388147 · Cited by 14
“Automated prediction of item difficulty in reading comprehension using long short-term memory,”
Lin, L.-H., Chang, T.-H., & Hsu, F.-Y. (2019) · 2019 International Conference on Asian Language Processing (IALP) · doi:10.1109/ialp48816.2019.9037716 · Cited by 13
Koster, R., Pîslar, M., Tacchetti, A., Balaguer, J., Liu, L., Elie, R., Hauser, O. P., Tuyls, K., Botvinick, M., & Summerfield, C. (2025) · Nature Communications · doi:10.1038/s41467-025-58043-7 · Cited by 12
Hupkes, D., Veldhoen, S., & Zuidema, W. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11196 · Cited by 14
Phone2Proc: Bringing Robust Robots into Our Chaotic World
Deitke, M., Hendrix, R., Farhadi, A., Ehsani, K., & Kembhavi, A. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00932 · Cited by 11
DRL-Based Dynamic Destroy Approaches for Agile-Satellite Mission Planning
Huang, W., Li, Z., He, X., Xiang, J., Du, X., & Liang, X. (2023) · Remote Sensing · doi:10.3390/rs15184503 · Cited by 11
An insider user authentication method based on improved temporal convolutional network
Tao, X., Yu, Y., Fu, L., Liu, J., & Zhang, Y. (2023) · High-Confidence Computing · doi:10.1016/j.hcc.2023.100169 · Cited by 10
Intelligent Systems for Muscle Tracking: A Review on Sensor‐Algorithm Synergy
Putcha, A., Nguyen, T., Smith, R., Choffin, R., & Bai, W. (2023) · Advanced Intelligent Systems · doi:10.1002/aisy.202200351 · Cited by 10
A Multichannel Deep Learning Framework for Cyberbullying Detection on Social Media
Alotaibi, M., Alotaibi, B., & Razaque, A. (2021) · doi:10.20944/preprints202110.0070.v1 · Cited by 94
“The function of the single GRU cell, which is explained in [33,34], is as follows: ) where x ti is the input to the GRU cell at time ti .”
An LSTM-Based Encoder-Decoder Model for State-of-Charge Estimation of Lithium-Ion Batteries
Cui, S., Yong, X., Kim, S., Hong, S., & Joe, I. (2020) · Advances in Intelligent Systems and Computing · doi:10.1007/978-3-030-51965-0_15 · Cited by 8
Attention Mechanism for Human Motion Prediction
Al-aqel, A. F., & Ali Khan, M. (2020) · 2020 3rd International Conference on Computer Applications & Information Security (ICCAIS) · doi:10.1109/iccais48893.2020.9096777 · Cited by 7
Informer: irregular traffic detection for containerized microservices RPC in the real world
Chen, J., Huang, H., & Chen, H. (2019) · Proceedings of the 4th ACM/IEEE Symposium on Edge Computing · doi:10.1145/3318216.3363375 · Cited by 6
X-GEVON- a novel explainable intelligent network to detect the multiple attacks in vanet systems
Anjali, T., Goyal, R., & Balaji, G. N. (2025) · Discover Computing · doi:10.1007/s10791-025-09696-x · Cited by 6
Direct Speech Reconstruction from Sensorimotor Brain Activity with Optimized Deep Learning Models
Berezutskaya, J., Freudenburg, Z. V., Vansteensel, M. J., Aarnoutse, E. J., Ramsey, N. F., & van Gerven, M. A. J. (2022) · doi:10.1101/2022.08.02.502503 · Cited by 42
Assessing the State of Self-Supervised Human Activity Recognition using Wearables
Haresamudram, H., Essa, I., & Plötz, T. (2022) · arXiv · Cited by 107
Craftax: A Lightning-Fast Benchmark for Open-Ended Reinforcement Learning
Matthews, M., Beukman, M., Ellis, B., Samvelyan, M., Jackson, M., Coward, S., & Foerster, J. (2024) · arXiv · doi:10.48550/arxiv.2402.16801 · Cited by 4
“We run PPO with an MLP as well as PPO with memory (using a Gated Recurrent Unit (Chung et al., 2014)), which we refer to as PPO-RNN.”
MethodBaz, M. (2024) · Mathematics · doi:10.3390/math12213320 · Cited by 1
End-to-End Test-Time Training for Long Context
Tandon, A., Dalal, K., Li, X., Koceja, D., Rød, M., Buchanan, S., Wang, X., Leskovec, J., Koyejo, S., Hashimoto, T., et al. (2025) · arXiv
“It is widely known that the gating mechanisms in RNNs can guard the hidden states against spurious inputs and better retain the information in valuable ones [39, 16].”
Learning What to Remember: Test-Time Training via Context Distillation
Wang, Z., Dang, X., Zhu, R.-J., Wen, Z., Fu, H., Chai, W., & Lee, J. D. (2026) · arXiv · doi:10.48550/arxiv.2608.01672
“Recurrent neural networks have a long history in AI [24, 8, 3].”
Emergence of Goal‐Directed Behaviors via Active Inference With Self‐Prior
Kim, D., Kanazawa, H., Yoshida, N., & Kuniyoshi, Y. (2026) · Developmental Science · doi:10.1111/desc.70286
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
“Recurrent neural networks, long short-term memory [12] and gated recurrent [7] neural networks in particular, have been firmly established as state of the art approaches in sequence modeling and transduction problems such as language modeling and machine translation [29, 2, 5].”
Background
Metadata
- Authors
- Chung, J., Gulcehre, C., Cho, K., & Bengio, Y.
- Affiliations
- Alcatel-Lucent (France) (FR)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2014
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1412.3555
- OpenAlex
- W1924770834
- Cited by
- 11,008
- References
- 15
- Citations by year
- 2026: 90 · 2025: 768 · 2024: 1415 · 2023: 1354 · 2022: 1193 · 2021: 1688 · 2020: 1596 · 2019: 1225 · 2018: 921 · 2017: 505 · 2016: 190 · 2015: 38 · 2014: 3
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- gated recurrent neural networks, gated recurrent unit, long short-term memory, sequence modeling, speech signal modeling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
