Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Open accessThe DOI matches its Crossref record; 29 of the 31 references it cites were found in a registry or an index.
Abstract
Kyunghyun Cho, Bart van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, Yoshua Bengio. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). 2014.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“GRU [185] is a variant based on the LSTM, which only contains an update gate and reset gate and has a faster training speed than the LSTM with fewer parameters.”
From Deep Learning for Structural Health Monitoring: Data, Algorithms, Applications, Challenges, and Trends (2023) · cites this paper as [185]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“They are thus well-suited for detecting dependencies and patterns in language-like input.”
From The role of pragmatic mechanisms in referential communication and categorization: An emergent communication model (2026) · cites this paper as [87]
The cited source says what the claim attributes to it.
In the citing paper
“GRU cells are a specific type of Recurrent Neural Networks (RNNs) which have been proven useful for dealing with sequence data such as language.”
From The role of pragmatic mechanisms in referential communication and categorization: An emergent communication model (2026) · cites this paper as [87]
The cited source says what the claim attributes to it.
In the citing paper
“Early work [139-141] mainly relied on recurrent neural networks (e.g., LSTM [142], GRU [143]). Limited by the model's expressiveness, they often suffer from the issue of insufficient diversity.”
From When large language models meet personalization: perspectives of challenges and opportunities (2024) · cites this paper as [143]
The cited source says what the claim attributes to it.
In the citing paper
“Moreover, [Tang et al., 2020] adopts GRU [Cho et al., 2014] on the sequence of hyperplanes to further capture the dynamics among hyperplanes.”
From Temporal Knowledge Graph Completion: A Survey (2023) · cites this paper as Cho et al., 2014
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 1×
“At each time step t , the hidden state h t (cid:105) of the RNN is updated by where f is a non-linear activation function. f may be as simple as an element-wise logistic sigmoid function and as complex as a long short-term memory (LSTM) unit (Hochreiter and Schmidhuber, 1997).”
BackgroundDistributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533 · cited 1×
“We have done so by applying the data selection method proposed in (Moore and Lewis, 2010), and its extension to bi-texts (Axelrod et al., 2011).”
Method(2011) · Cited by 6,993
Self-citationADADELTA: An Adaptive Learning Rate Method
Zeiler, M. D. (2012) · arXiv · doi:10.48550/arxiv.1212.5701 · Cited by 5,322 · cited 2×
“95 (Zeiler, 2012).”
MethodStatistical phrase-based translation
Koehn, P., Och, F. J., & Marcu, D. (2003) · Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - NAACL '03 · doi:10.3115/1073445.1073462 · Cited by 3,197 · cited 2×
“In the phrase-based SMT framework introduced in (Koehn et al., 2003) and (Marcu and Wong, 2002), the translation model log p ( e | f ) is factorized into the translation probabilities of matching phrases in the source and target sentences.”
Method(2005) · Cited by 3,125
Supervised Sequence Labelling with Recurrent Neural Networks
Graves, A. (2012) · Studies in Computational Intelligence · doi:10.1007/978-3-642-24797-2 · Cited by 3,120
Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition
Dahl, G. E., Yu, D., Deng, L., & Acero, A. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2134090 · Cited by 3,011 · cited 1×
“Deep neural networks have shown great success in various applications such as objection recognition (see, e.g., (Krizhevsky et al., 2012)) and speech recognition (see, e.g., (Dahl et al., 2012)).”
BackgroundRecurrent Continuous Translation Models
Kalchbrenner, N., & Blunsom, P. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1176 · Cited by 1,232 · cited 1×
“The closest approach related to the proposed RNN Encoder–Decoder is the Recurrent Continuous Translation Model (Model 2) proposed in (Kalchbrenner and Blunsom, 2013).”
Method
Cited by
Items 1,101–1,200 of 1,296
A Bi-GRU with attention and CapsNet hybrid model for cyberbullying detection on social media
Kumar, A., & Sachdeva, N. (2022) · World Wide Web · doi:10.1007/s11280-021-00920-4 · Cited by 87
“Recurrent neural network (RNN) models [6] have been popularly used in the field of natural language processing.”
Mariani, S., Rendu, Q., Urbani, M., & Sbarufatti, C. (2021) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2021.107748 · Cited by 86
Detecting fake images by identifying potential texture difference
Yang, J., Xiao, S., Li, A., Lan, G., & Wang, H. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2021.06.043 · Cited by 86
A Comprehensive Survey on Passive Techniques for Digital Video Forgery Detection
Shelke, N. A., & Kasana, S. S. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-020-09974-4 · Cited by 87
Barbieri, S., Kemp, J., Perez-Concha, O., Kotwal, S., Gallagher, M., Ritchie, A., & Jorm, L. (2020) · Scientific Reports · doi:10.1038/s41598-020-58053-z · Cited by 86
Roche, R., Moussad, B., Shuvo, M. H., Tarafder, S., & Bhattacharya, D. (2024) · Nucleic Acids Research · doi:10.1093/nar/gkae039 · Cited by 85
BERT-based ensemble learning for multi-aspect hate speech detection
Mazari, A. C., Boudoukhani, N., & Djeffal, A. (2024) · Cluster Computing · doi:10.1007/s10586-022-03956-x · Cited by 89
Neural reverse engineering of stripped binaries using augmented control flow graphs
David, Y., Alon, U., & Yahav, E. (2020) · Proceedings of the ACM on Programming Languages · doi:10.1145/3428293 · Cited by 84
ManipulaTHOR: A Framework for Visual Object Manipulation
Ehsani, K., Han, W., Herrasti, A., VanderBilt, E., Weihs, L., Kolve, E., Kembhavi, A., & Mottaghi, R. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00447 · Cited by 81
“The controller consisting of a GRU [8] with a hidden size of 512 uses this resulting embedding as input to produce a policy (i.e. distribution over actions) and a value (i.e. an estimate of future rewards).”
MethodInfluentialALFWorld: Aligning Text and Embodied Environments for Interactive Learning
Shridhar, M., Yuan, X., Côté, M.-A., Bisk, Y., Trischler, A., & Hausknecht, M. (2020) · arXiv · doi:10.48550/arxiv.2010.03768 · Cited by 80
“Specifically, we use a GRU (Cho et al., 2014): in which, the mean pooling is performed along the dimension of number of tokens, i.e., h RNN ∈ R H . h t − 1 is the output of the GRU cell at game step t − 1 .”
MethodPointRNN: Point Recurrent Neural Network for Moving Point Cloud Processing
Fan, H., & Yang, Y. (2019) · arXiv · doi:10.48550/arxiv.1910.08287 · Cited by 80
“The recurrent neural network (RNN) and its variants, e.g ., Long Short-Term Memory (LSTM) [10] and Gated Recurrent Unit (GRU) [5], are well-suited to processing time series data.”
PathVQA: 30000+ Questions for Medical Visual Question Answering
He, X., Zhang, Y., Mou, L., Xing, E., & Xie, P. (2020) · arXiv · doi:10.48550/arxiv.2003.10286 · Cited by 79
Distilling Reasoning Capabilities into Smaller Language Models
Shridhar, K., Stolfo, A., & Sachan, M. (2023) · Findings of the Association for Computational Linguistics: ACL 2023 · doi:10.18653/v1/2023.findings-acl.441 · Cited by 79
“During training, the previous intermediate solutions generated by the QA model are replaced with the teacher-generated solutions using teacher forcing (Cho et al., 2014).”
MethodSemi-Supervised Federated Learning for Travel Mode Identification From GPS Trajectories
Zhu, Y., Liu, Y., Yu, J. J. Q., & Yuan, X. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3092015 · Cited by 79
“Thanks to GRU’s design based on time state propagation [45], [46], we can use GRU to learn potential time-correlations from the information extracted by CNN.”
MethodKaur, A., Singh, Y., Neeru, N., Kaur, L., & Singh, A. (2022) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-021-09649-9 · Cited by 79
Data Movement Is All You Need: A Case Study on Optimizing Transformers
Ivanov, A., Dryden, N., Ben-Nun, T., Li, S., & Hoefler, T. (2020) · arXiv · doi:10.48550/arxiv.2007.00072 · Cited by 78
How do Decisions Emerge across Layers in Neural Models? Interpretation with Differentiable Masking
De Cao, N., Schlichtkrull, M. S., Aziz, W., & Titov, I. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.262 · Cited by 75
Ji, I. H., Lee, J. H., Kang, M. J., Park, W. J., Jeon, S. H., & Seo, J. T. (2024) · Sensors · doi:10.3390/s24030898 · Cited by 74
Target Adaptive Context Aggregation for Video Scene Graph Generation
Teng, Y., Wang, L., Li, Z., & Wu, G. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01343 · Cited by 74
Knaak, C., von Eßen, J., Kröger, M., Schulze, F., Abels, P., & Gillner, A. (2021) · Sensors · doi:10.3390/s21124205 · Cited by 73
AutoPandas: neural-backed generators for program synthesis
Bavishi, R., Lemieux, C., Fox, R., Sen, K., & Stoica, I. (2019) · Proceedings of the ACM on Programming Languages · doi:10.1145/3360594 · Cited by 73
“The new node state vector h ( k + 1 ) v for the next round is then computed as h where GRU is the gated recurrent unit [Cho et al. 2014] with start state as h ( k ) v and input m v .”
MethodRobust and accurate decoding of hand kinematics from entire spiking activity using deep learning
Ahmadi, N., Constandinou, T. G., & Bouganis, C.-S. (2021) · Journal of Neural Engineering · doi:10.1088/1741-2552/abde8a · Cited by 69
Wang, X., Dai, K., Hu, M., & Ni, N. (2024) · Journal of Energy Storage · doi:10.1016/j.est.2024.112442 · Cited by 72
Deep Fisher discriminant learning for mobile hand gesture recognition
Li, C., Xie, C., Zhang, B., Chen, C., & Han, J. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.12.023 · Cited by 72
Cyberbullying Detection in Social Networks Using Bi-GRU with Self-Attention Mechanism
Fang, Y., Yang, S., Zhao, B., & Huang, C. (2021) · Information · doi:10.3390/info12040171 · Cited by 74
“Both GRU [46] and long short-term memory (LSTM) [47] are special variants of RNN with logic gates.”
BackgroundMethodSequence-to-Action: End-to-End Semantic Graph Generation for Semantic Parsing
Chen, B., Sun, L., & Han, X. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1071 · Cited by 69
“In recent years, RNN models have achieved success in sequence-to-sequence problems due to its strong ability on both representation learning and prediction, e.g., in machine translation (Cho et al., 2014).”
BackgroundThe Vapnik–Chervonenkis dimension of graph and recursive neural networks
Scarselli, F., Tsoi, A. C., & Hagenbuchner, M. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.08.010 · Cited by 69
A Survey on Temporal Knowledge Graph: Representation Learning and Applications
Cai, L., Mao, X., Zhou, Y., Long, Z., Wu, C., & Lan, M. (2024) · arXiv · doi:10.48550/arxiv.2403.04782 · Cited by 68
“Translation-based The translation-based representation learning methods of TKGs are developed based on TransE [11].”
MethodTransforming Digital Marketing with Generative AI
Islam, T., Miron, A., Nandy, M., Choudrie, J., Liu, X., & Li, Y. (2024) · Computers · doi:10.3390/computers13070168 · Cited by 68
“For an RNN, crucial hyperparameters include the number of recurrent units, the type of RNN cell (i.e., long short-term memory (LSTM [81]) or gated recurrent units (GRU [82])), sequence length, and dropout rate [83].”
Background(2020) · International Conference on Learning Representations · Cited by 68
Izadi, M. J., Hassani, P., Raeesi, M., & Ahmadi, P. (2024) · Energy · doi:10.1016/j.energy.2024.130602 · Cited by 67
SayNav: Grounding Large Language Models for Dynamic Planning to Navigation in New Environments
Rajvanshi, A., Sikka, K., Lin, X., Lee, B., Chiu, H.-P., & Velasquez, A. (2023) · arXiv · doi:10.48550/arxiv.2309.04077 · Cited by 67
Extracting Symptoms and their Status from Clinical Conversations
Du, N., Chen, K., Kannan, A., Tran, L., Chen, Y., & Shafran, I. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1087 · Cited by 66
SplitNet: Sim2Sim and Task2Task Transfer for Embodied Visual Navigation
Gordon, D., Kadian, A., Parikh, D., Hoffman, J., & Batra, D. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00111 · Cited by 57
“To avoid purely reactive policies, we employ a GRU [4] to add temporal context.”
MethodAn Empirical Evaluation of Deep Learning for Network Anomaly Detection
Malaiya, R. K., Kwon, D., Kim, J., Suh, S. C., Kim, H., & Kim, I. (2018) · 2018 International Conference on Computing, Networking and Communications (ICNC) · doi:10.1109/iccnc.2018.8390278 · Cited by 62
“yT ′}, also known as a target sequence ( [24], [25]).”
BackgroundLin, S.-C., Yang, J.-H., Nogueira, R., Tsai, M.-F., Wang, C.-J., & Lin, J. (2020) · arXiv · doi:10.48550/arxiv.2005.02230 · Cited by 62
“Like CANARD and text summarization studies [21, 46], we choose a sequence-to-sequence [9, 48] (Seq2Seq) architecture to map variable length conversational contexts u<i and ui into qNL i .”
MethodRobust Multimodal Learning with Missing Modalities via Parameter-Efficient Adaptation
Reza, M. K., Prater-Bennette, A., & Asif, M. S. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3476487 · Cited by 78
Sticking to the Facts: Confident Decoding for Faithful Data-to-Text Generation
Tian, R., Narayan, S., Sellam, T., & Parikh, A. P. (2019) · arXiv · doi:10.48550/arxiv.1910.08684 · Cited by 60
Sykas, D., Sdraka, M., Zografakis, D., & Papoutsis, I. (2022) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2022.3164771 · Cited by 59
EHR-KnowGen: Knowledge-enhanced multimodal learning for disease diagnosis generation
Niu, S., Ma, J., Bai, L., Wang, Z., Guo, L., & Yang, X. (2024) · Information Fusion · doi:10.1016/j.inffus.2023.102069 · Cited by 59
Learning Discriminative Features from Spectrograms Using Center Loss for Speech Emotion Recognition
Dai, D., Wu, Z., Li, R., Wu, X., Jia, J., & Meng, H. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683765 · Cited by 58
“Bi-RNN is implemented with 128-width Gated Recurrent Unit (GRU)[16], so the dimension of Bi-RNN’s output is 256.”
MethodConversational Query Understanding Using Sequence to Sequence Modeling
Ren, G., Ni, X., Malik, M., & Ke, Q. (2018) · Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18 · doi:10.1145/3178876.3186083 · Cited by 55
Unsupervised translation of programming languages
Roziere, B. (2026) · doi:10.70675/416f6582z4576z444eza710z5e930d59bf97 · Cited by 57
Security and Privacy Issues in Deep Learning
Bae, H., Jang, J., Jung, D., Jang, H., Ha, H., Lee, H., & Yoon, S. (2018) · arXiv · doi:10.48550/arxiv.1807.11655 · Cited by 56
“There are well-known problems of RNNs such as the gradient vanishing problem, and some variants, such as Long short-term memory [Hochreiter and Schmidhuber 1997] and Gated recurrent unit [Cho et al. 2014] have been proposed to solve such problems.”
BackgroundRobust Neural Machine Translation with Joint Textual and Phonetic Embedding
Liu, H., Ma, M., Huang, L., Xiong, H., & He, Z. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1291 · Cited by 56
Character-Level Language Modeling with Deeper Self-Attention
Al-Rfou, R., Choe, D., Constant, N., Guo, M., & Jones, L. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33013159 · Cited by 56
Chasing Ghosts: Instruction Following as Bayesian State Tracking
Anderson, P., Shrivastava, A., Parikh, D., Batra, D., & Lee, S. (2019) · arXiv · doi:10.48550/arxiv.1907.02022 · Cited by 55
“To integrate map observations F t into our semantic spatial map M t , we use a convolutional implementation [31] of a Gated Recurrent Unit (GRU) [32].”
MethodInfluentialAnomaly Detection in a Large-Scale Cloud Platform
Islam, M. S., Pourmajidi, W., Zhang, L., Steinbacher, J., Erwin, T., & Miranskyy, A. (2021) · 2021 IEEE/ACM 43rd International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1109/icse-seip52600.2021.00024 · Cited by 54
Erdem, E., Kuyu, M., Yagcioglu, S., Frank, A., Parcalabescu, L., Plank, B., Babii, A., Turuta, O., Erdem, A., Calixto, I., et al. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12918 · Cited by 54
“Different neural network models for machine translation (NMT) were proposed by Kalchbrenner and Blunsom (2013), Cho, van Merriënboer, Gulcehre, Bahdanau, Bougares, Schwenk, and Bengio (2014b), Cho et al. (2014a), Sutskever et al. (2014) more or less concomitantly.”
MethodNeural Machine Translation of Logographic Language Using Sub-character Level Information
Zhang, L., & Komachi, M. (2018) · Proceedings of the Third Conference on Machine Translation: Research Papers · doi:10.18653/v1/w18-6303 · Cited by 53
“Neural machine translation (Cho et al., 2014) (NMT) systems based on sequence-to-sequence models (Sutskever et al., 2014) have recently become the de facto standard architecture.”
BackgroundHoai Thu, N. T., & Han, D. S. (2021) · IEEE Access · doi:10.1109/access.2021.3122298 · Cited by 54
“A combination of inception module-based CNN and gated recurrent units (GRUs) [28] has been proposed in [29] for extracting sequential temporal dependencies in complex human activity recognition.”
DeleSmell: Code smell detection based on deep learning and latent semantic analysis
Zhang, Y., Ge, C., Hong, S., Tian, R., Dong, C., & Liu, J. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.109737 · Cited by 54
Wang, Q., Gu, H., Ye, M., Wei, M., & Xu, X. (2021) · IEEE Access · doi:10.1109/access.2021.3086507 · Cited by 52
“To solve this problem, Hochreiter and Schmidhuber proposed an improved version of RNN: long short term memory (LSTM), and Kyunghyun Cho et al. proposed gate recurrent unit (GRU) [33], [34].”
BackgroundTemporal feature aggregation with attention for insider threat detection from activity logs
Pal, P., Chattopadhyay, P., & Swarnkar, M. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.119925 · Cited by 52
Hunting for Insider Threats Using LSTM-Based Anomaly Detection
Villarreal-Vasquez, M., Modelo-Howard, G., Dube, S., & Bhargava, B. (2023) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2021.3135639 · Cited by 52
“LADOHD tackles the OAR problem by leveraging the event relationship information extracted from different endpoints as well as the properties ingrained to LSTMs and its variants [26], [27], such as memory, short and long term dependencies, stateful representation, and capacity to process variable length sequences [28],…”
BackgroundHierarchical Query Graph Generation for Complex Question Answering over Knowledge Graph
Qiu, Y., Zhang, K., Wang, Y., Jin, X., Bai, L., Guan, S., & Cheng, X. (2020) · Proceedings of the 29th ACM International Conference on Information & Knowledge Management · doi:10.1145/3340531.3411888 · Cited by 52
“A GRU network [14] is adopted to convert the natural language question q into vectors.”
MethodReliable customer analysis using federated learning and exploring deep-attention edge intelligence
Ahmed, U., Srivastava, G., & Lin, J. C.-W. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2021.08.028 · Cited by 52
Improving Cyberbullying Detection with User Interaction
Ge, S., Cheng, L., & Liu, H. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3449828 · Cited by 51
“The second is a word-level gated recurrent units (GRU) [10] layer.”
BackgroundAutomatic Poetry Generation from Prosaic Text
Van de Cruys, T. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.223 · Cited by 50
“The architecture is made up of gated recurrent units ( GRU s; Cho et al., 2014) that are linked together in an encoder-decoder setup.”
BackgroundDialogueTRM: Exploring Multi-Modal Emotional Dynamics in a Conversation
Mao, Y., Liu, G., Wang, X., Gao, W., & Li, X. (2021) · Findings of the Association for Computational Linguistics: EMNLP 2021 · doi:10.18653/v1/2021.findings-emnlp.229 · Cited by 50
Cheng, D., & Liu, M. (2017) · 2017 IEEE International Conference on Imaging Systems and Techniques (IST) · doi:10.1109/ist.2017.8261461 · Cited by 49
Evidence inference 2.0: More data, better models.
DeYoung, J., Lehman, E., Nye, B., Marshall, I., & Wallace, B. C. (2020) · Proceedings of the 19th SIGBioMed Workshop on Biomedical Language Processing · doi:10.18653/v1/2020.bionlp-1.13 · Cited by 49
Knowledge-enhanced Black-box Attacks for Recommendations
Chen, J., Fan, W., Zhu, G., Zhao, X., Yuan, C., Li, Q., & Huang, Y. (2022) · Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining · doi:10.1145/3534678.3539359 · Cited by 49
“Specifically, we adopt an RNN with a gated recurrent unit (GRU) as the network cell [5] to capture fake user’s historical behaviors Pt = {v∗, v1, .”
MethodParameter Efficient Multimodal Transformers for Video Representation Learning
Lee, S., Yu, Y., Kim, G., Breuel, T., Kautz, J., & Song, Y. (2020) · arXiv · doi:10.48550/arxiv.2012.04124 · Cited by 49
“Unfortunately, processing long videos requires large memory resource and capturing long-term dependencies is a long-standing problem (Hochreiter & Schmidhuber, 1997; Cho et al., 2014; Vaswani et al., 2017).”
BackgroundGeneration of Synthetic Electronic Medical Record Text
Guan, J., Li, R., Yu, S., & Zhang, X. (2018) · 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm.2018.8621223 · Cited by 49
Teaching Machines to Ask Questions
Yao, K., Zhang, L., Luo, T., Tao, L., & Wu, Y. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/632 · Cited by 44
Kaur, R., Ginige, J. A., & Obst, O. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.118997 · Cited by 48
Shifts: A Dataset of Real Distributional Shift Across Multiple Large-Scale Tasks
Malinin, A., Band, N., Ganshin, A., Chesnokov, G., Gal, Y., Gales, M. J. F., Noskov, A., Ploskonosov, A., Prokhorenkova, L., Provilkov, I., et al. (2021) · arXiv · doi:10.48550/arxiv.2107.07455 · Cited by 48
“We consider two different model classes as ensemble members: a simple behavioral cloning agent with a Gated Recurrent Unit decoder (BC) [72, 73] and a Deep Imitative Model (DIM) [74] with an autoregressive flow decoder [75], following [69].”
MethodBenchmarking deep learning methods for predicting CRISPR/Cas9 sgRNA on- and off-target activities
Zhang, G., Luo, Y., Dai, X., & Dai, Z. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbad333 · Cited by 47
Emergence of belief-like representations through reinforcement learning
Hennig, J. A., Romero Pinto, S. A., Yamaguchi, T., Linderman, S. W., Uchida, N., & Gershman, S. J. (2023) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1011067 · Cited by 41
“For each task, we trained the Belief model, and a Value RNN (using 141 a gated-recurrent unit cell [24], or GRU, with H = 50 hidden units), on a series of observations from that 142 task to estimate value using TD learning (see Materials and Methods).”
MethodRecent Temporal Pattern Mining for Septic Shock Early Prediction
Khoshnevisan, F., Ivy, J., Capan, M., Arnold, R., Huddleston, J., & Chi, M. (2018) · 2018 IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi.2018.00033 · Cited by 46
“Che et al. showed that GRU can capture long-term dependencies in data as well as taking informative missingness of the values into account in that it achieved better prediction performance than classic machine learning algorithms such as logistic regression and SVM [31].”
BackgroundInfluentialLanguage models: past, present, and future
Li, H. (2022) · Communications of the ACM · doi:10.1145/3490443 · Cited by 45
Electrical lithium-ion battery models based on recurrent neural networks: A holistic approach
Schmitt, J., Horstkötter, I., & Bäker, B. (2023) · Journal of Energy Storage · doi:10.1016/j.est.2022.106461 · Cited by 44
Let there be a clock on the beach: Reducing Object Hallucination in Image Captioning
Biten, A. F., Gomez, L., & Karatzas, D. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv51458.2022.00253 · Cited by 43
EDLA-EFDS: A Novel Ensemble Deep Learning Approach For Electrical Fault Detection Systems
Elmasry, W., & Wadi, M. (2022) · Electric Power Systems Research · doi:10.1016/j.epsr.2022.107834 · Cited by 42
Human Motion prediction based on attention mechanism
Sang, H.-F., Chen, Z.-Z., & He, D.-K. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-019-08269-7 · Cited by 42
Early Perceptions of Teaching and Learning Using Generative AI in Higher Education
Damiano, A. D., Lauría, E. J. M., Sarmiento, C., & Zhao, N. (2024) · Journal of Educational Technology Systems · doi:10.1177/00472395241233290 · Cited by 42
“The fi rst milestone in the development of neural NLP was recurrent neural networks architectures; in particular, Long Short-Term Memory (Hochreiter & Schmidhuber, 1997; Jozefowicz et al., 2015) and Gated Recurrent Units (Cho et al., 2014).”
MethodImproving Natural Language Processing Tasks with Human Gaze-Guided Neural Attention
Sood, E., Tannert, S., Mueller, P., & Bulling, A. (2020) · arXiv · doi:10.48550/arxiv.2010.07891 · Cited by 42
Learning Navigational Visual Representations with Semantic Map Supervision
Hong, Y., Zhou, Y., Zhang, R., Dernoncourt, F., Bui, T., Gould, S., & Tan, H. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00284 · Cited by 42
“All methods in the table adopt a simple pipeline as in the baseline model [94], which feeds the concatenation of visual features, GPS+Compass encodings, and the encodings of previous action to a GRU [19], then, uses a fully-connected layer to predict an action from the updated agent’s state.”
MethodA heterogeneous stacking ensemble based sentiment analysis framework using multiple word embeddings
Subba, B., & Kumari, S. (2022) · Computational Intelligence · doi:10.1111/coin.12478 · Cited by 41
Diet code is healthy: simplifying programs for pre-trained models of code
Zhang, Z., Zhang, H., Shen, B., & Gu, X. (2022) · Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3540250.3549094 · Cited by 41
Self-supervised transfer learning of physiological representations from free-living wearable data
Spathis, D., Perez-Pozuelo, I., Brage, S., Wareham, N. J., & Mascolo, C. (2021) · Proceedings of the Conference on Health, Inference, and Learning · doi:10.1145/3450439.3451863 · Cited by 40
“Specifically we employ a fast variant of RNNs known as Gated Recurrent Units (GRU) (Cho et al. 2014).”
MethodInfluentialFoundations of Multimodal Co-learning
Zadeh, A., Liang, P. P., & Morency, L.-P. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.06.001 · Cited by 40
LAFITE: Towards Language-Free Training for Text-to-Image Generation
Zhou, Y., Zhang, R., Chen, C., Li, C., Tensmeyer, C., Yu, T., Gu, J., Xu, J., & Sun, T. (2021) · arXiv · doi:10.48550/arxiv.2111.13792 · Cited by 38
Hu, Y., Zhang, X.-Q., Xu, L., Xian He, F., Tian, Z., She, W., & Liu, W. (2020) · IEEE Access · doi:10.1109/access.2020.3003162 · Cited by 36
“Recurrent neural networks (RNNs), particularly those based on the LSTM network and its various variants, e.g., Gated Recurrent Unit (GRU) [33], can capture long-range dependencies efficiently and mine fruitful information from stream data strongly [34], [35].”
BackgroundFang, C., Markuzon, N., Patel, N., & Rueda, J.-D. (2022) · Value in Health · doi:10.1016/j.jval.2022.06.004 · Cited by 36
Learning Representations for Incomplete Time Series Clustering
Ma, Q., Chen, C., Li, S., & Cottrell, G. W. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i10.17070 · Cited by 34
“We use Gated Recurrent Units (GRU) in the RNN (Cho et al. 2014).”
MethodAnalyzing and distinguishing fake and real news to mitigate the problem of disinformation
Vereshchaka, A., Cosimini, S., & Dong, W. (2020) · Computational and Mathematical Organization Theory · doi:10.1007/s10588-020-09307-8 · Cited by 34
Shahtalebi, S., Atashzar, S. F., Samotus, O., Patel, R. V., Jog, M. S., & Mohammadi, A. (2020) · Scientific Reports · doi:10.1038/s41598-020-58912-9 · Cited by 32
From Chest X-Rays to Radiology Reports: A Multimodal Machine Learning Approach
Singh, S., Karimi, S., Ho-Shon, K., & Hamey, L. (2019) · 2019 Digital Image Computing: Techniques and Applications (DICTA) · doi:10.1109/dicta47822.2019.8945819 · Cited by 33
“Two of the most popular and important RNNs that overcome these problems are Long-Short Term Memory (LSTM) [26] and Gated Recurrent Unit (GRU) [12].”
BackgroundMethodMikus, A., Hoogendoorn, M., Rocha, A., Gama, J., Ruwaard, J., & Riper, H. (2018) · Internet Interventions · doi:10.1016/j.invent.2017.10.001 · Cited by 31
Inertial-Measurement-Unit-Based Novel Human Activity Recognition Algorithm Using Conformer
Kim, Y.-W., Cho, W.-H., Kim, K.-S., & Lee, S. (2022) · Sensors · doi:10.3390/s22103932 · Cited by 31
“Long short-term memory (LSTM) and Sensors 2022 , 22 , 3932 2 of 13 gated recurrent units (GRUs), which are types of RNN series models, feature a gate structure that can memorize the long-term state of the previous input and learn the sequential context of time-series data [13,14].”
BackgroundMoirangthem, D. S., & Lee, M. (2020) · Neural Networks · doi:10.1016/j.neunet.2019.12.022 · Cited by 30
ProkBERT family: genomic language models for microbiome applications
Ligeti, B., Szepesi-Nagy, I., Bodnár, B., Ligeti-Nagy, N., & Juhász, J. (2024) · Frontiers in Microbiology · doi:10.3389/fmicb.2023.1331233 · Cited by 30
“This approach equips ProkBERT to handle challenges like limited labeled data, a problem that has often hindered traditional models such as CNNs, RNNs, and LSTMs (Cho et al., 2014; LeCun et al., 2015).”
Son, H., Pham, V.-T., Jang, Y., & Kim, S.-E. (2021) · Sensors · doi:10.3390/s21093118 · Cited by 29
“Typical RNN structures, Gated Recurrent Units (GRUs) [44] and Long Short-Term Memory (LSTM), support the gating of the hidden state and control information flow.”
BackgroundZhao, Z., Zhou, G., Xie, Z., Wu, L., & Huang, J. X. (2024) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3658673 · Cited by 29
“To address the sparsity issue in the logical graph, we introduce a relevance matrix between nodes to adaptively establish connections between them during the iteration process.”
At Human Speed: Deep Reinforcement Learning with Action Delay
Firoiu, V., Ju, T., & Tenenbaum, J. (2018) · arXiv · doi:10.48550/arxiv.1810.07286 · Cited by 29
Seidel, R., Jahn, N., Seo, S., Goerttler, T., & Obermayer, K. (2022) · IEEE Open Journal of Intelligent Transportation Systems · doi:10.1109/ojits.2021.3139393 · Cited by 28
“Plain RNNs can not maintain information throughout long sequences, and GRUs are less capable of solving counting problems compared to LSTMs [48].”
BackgroundTheanoLM — An Extensible Toolkit for Neural Network Language Modeling
Enarvi, S., & Kurimo, M. (2016) · Interspeech 2016 · doi:10.21437/interspeech.2016-618 · Cited by 28
“TheanoLM supports LSTM and GRU [14], as well as non-recurrent layers.”
An INS/GNSS fusion architecture in GNSS denied environment using gated recurrent unit
Geragersian, P., Petrunin, I., Guo, W., & Grech, R. (2022) · AIAA SCITECH 2022 Forum · doi:10.2514/6.2022-1759 · Cited by 28
Metadata
- Authors
- Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y.
- Affiliations
- Le Mans Université (FR)
- Polytechnique Montréal (CA)
- Venue
- Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)
- Published
- 2014
- Pages
- 1724-1734
- OpenAlex
- W2157331557
- Cited by
- 25,545
- References
- 31
- Citations by year
- 2026: 1895 · 2025: 2591 · 2024: 2721 · 2023: 3047 · 2022: 3245 · 2021: 3534 · 2020: 3063 · 2019: 2494 · 2018: 1644 · 2017: 816 · 2016: 349 · 2015: 119 · 2014: 22
- FWCI
- 256.40
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- HAL (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Keywords
- statistical machine translation, neural machine translation, phrase embeddings, sequence-to-sequence models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.