Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Open accessThe DOI matches its Crossref record; 29 of the 31 references it cites were found in a registry or an index.
Abstract
Kyunghyun Cho, Bart van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, Yoshua Bengio. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). 2014.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“GRU [185] is a variant based on the LSTM, which only contains an update gate and reset gate and has a faster training speed than the LSTM with fewer parameters.”
From Deep Learning for Structural Health Monitoring: Data, Algorithms, Applications, Challenges, and Trends (2023) · cites this paper as [185]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“They are thus well-suited for detecting dependencies and patterns in language-like input.”
From The role of pragmatic mechanisms in referential communication and categorization: An emergent communication model (2026) · cites this paper as [87]
The cited source says what the claim attributes to it.
In the citing paper
“GRU cells are a specific type of Recurrent Neural Networks (RNNs) which have been proven useful for dealing with sequence data such as language.”
From The role of pragmatic mechanisms in referential communication and categorization: An emergent communication model (2026) · cites this paper as [87]
The cited source says what the claim attributes to it.
In the citing paper
“Early work [139-141] mainly relied on recurrent neural networks (e.g., LSTM [142], GRU [143]). Limited by the model's expressiveness, they often suffer from the issue of insufficient diversity.”
From When large language models meet personalization: perspectives of challenges and opportunities (2024) · cites this paper as [143]
The cited source says what the claim attributes to it.
In the citing paper
“Moreover, [Tang et al., 2020] adopts GRU [Cho et al., 2014] on the sequence of hyperplanes to further capture the dynamics among hyperplanes.”
From Temporal Knowledge Graph Completion: A Survey (2023) · cites this paper as Cho et al., 2014
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 1×
“At each time step t , the hidden state h t (cid:105) of the RNN is updated by where f is a non-linear activation function. f may be as simple as an element-wise logistic sigmoid function and as complex as a long short-term memory (LSTM) unit (Hochreiter and Schmidhuber, 1997).”
BackgroundDistributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533 · cited 1×
“We have done so by applying the data selection method proposed in (Moore and Lewis, 2010), and its extension to bi-texts (Axelrod et al., 2011).”
Method(2011) · Cited by 6,993
Self-citationADADELTA: An Adaptive Learning Rate Method
Zeiler, M. D. (2012) · arXiv · doi:10.48550/arxiv.1212.5701 · Cited by 5,322 · cited 2×
“95 (Zeiler, 2012).”
MethodStatistical phrase-based translation
Koehn, P., Och, F. J., & Marcu, D. (2003) · Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - NAACL '03 · doi:10.3115/1073445.1073462 · Cited by 3,197 · cited 2×
“In the phrase-based SMT framework introduced in (Koehn et al., 2003) and (Marcu and Wong, 2002), the translation model log p ( e | f ) is factorized into the translation probabilities of matching phrases in the source and target sentences.”
Method(2005) · Cited by 3,125
Supervised Sequence Labelling with Recurrent Neural Networks
Graves, A. (2012) · Studies in Computational Intelligence · doi:10.1007/978-3-642-24797-2 · Cited by 3,120
Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition
Dahl, G. E., Yu, D., Deng, L., & Acero, A. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2134090 · Cited by 3,011 · cited 1×
“Deep neural networks have shown great success in various applications such as objection recognition (see, e.g., (Krizhevsky et al., 2012)) and speech recognition (see, e.g., (Dahl et al., 2012)).”
BackgroundRecurrent Continuous Translation Models
Kalchbrenner, N., & Blunsom, P. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1176 · Cited by 1,232 · cited 1×
“The closest approach related to the proposed RNN Encoder–Decoder is the Recurrent Continuous Translation Model (Model 2) proposed in (Kalchbrenner and Blunsom, 2013).”
Method
Cited by
Items 901–1,000 of 1,296
Exploring Neural Text Simplification Models
Nisioi, S., Štajner, S., Ponzetto, S. P., & Dinu, L. P. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p17-2014 · Cited by 194
Predicting Visual Features From Text for Image and Video Caption Retrieval
Dong, J., Li, X., & Snoek, C. G. M. (2018) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2832602 · Cited by 194
Du, J., Vong, C.-M., & Chen, C. L. P. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.2969705 · Cited by 194
Wu, Y., & Wang, G. (2018) · International Journal of Molecular Sciences · doi:10.3390/ijms19082358 · Cited by 193
“The former is more suitable for prediction or recognition of sequences, such as natural language processing [59] and time series prediction [60,61].”
BackgroundGhasemi, A., Hashtarkhani, S., Schwartz, D. L., & Shaban‐Nejad, A. (2024) · Cancer Innovation · doi:10.1002/cai2.136 · Cited by 193
Mobile Traffic Prediction from Raw Data Using LSTM Networks
Trinh, H. D., Giupponi, L., & Dini, P. (2018) · 2018 IEEE 29th Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC) · doi:10.1109/pimrc.2018.8581000 · Cited by 193
A Goal-Driven Tree-Structured Neural Model for Math Word Problems
Xie, Z., & Sun, S. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/736 · Cited by 193
Exploring the GDB-13 chemical space using deep generative models
Arús-Pous, J., Blaschke, T., Ulander, S., Reymond, J.-L., Chen, H., & Engkvist, O. (2019) · Journal of Cheminformatics · doi:10.1186/s13321-019-0341-z · Cited by 193
Location Prediction over Sparse User Mobility Traces Using RNNs: Flashback in Hidden States!
Yang, D., Fankhauser, B., Rosso, P., & Cudre-Mauroux, P. (2020) · Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/302 · Cited by 193
Ding, M., Zhou, H., Xie, H., Wu, M., Nakanishi, Y., & Yokoyama, R. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.07.058 · Cited by 193
Structured Prediction Helps 3D Human Motion Modelling
Aksan, E., Kaufmann, M., & Hilliges, O. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00724 · Cited by 193
Towards Language-Free Training for Text-to-Image Generation
Zhou, Y., Zhang, R., Chen, C., Li, C., Tensmeyer, C., Yu, T., Gu, J., Xu, J., & Sun, T. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01738 · Cited by 192
Reasoning with Sarcasm by Reading In-Between
Tay, Y., Luu, A. T., Hui, S. C., & Su, J. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1093 · Cited by 192
“• GRNN (Gated Recurrent Neural Network) is a Bidirectional Gated Recurrent Unit (GRU) model that was proposed for sarcasm detection by (Zhang et al., 2016).”
BackgroundResearch commentary on recommendations with side information: A survey and research directions
Sun, Z., Guo, Q., Yang, J., Fang, H., Guo, G., Zhang, J., & Burke, R. (2019) · Electronic Commerce Research and Applications · doi:10.1016/j.elerap.2019.100879 · Cited by 192
Machine translation using deep learning: An overview
Singh, S. P., Kumar, A., Darbari, H., Singh, L., Rastogi, A., & Jain, S. (2017) · 2017 International Conference on Computer, Communications and Electronics (Comptelix) · doi:10.1109/comptelix.2017.8003957 · Cited by 192
Evaluating the state-of-the-art of End-to-End Natural Language Generation: The E2E NLG challenge
Dušek, O., Novikova, J., & Rieser, V. (2020) · Computer Speech & Language · doi:10.1016/j.csl.2019.06.009 · Cited by 192
“ZHANG (Zhang et al. 2018) apply a seq2seq model with CAEncoder (Zhang et al. 2017), which adds a second layer over a bidirectional encoder with GRU cells (Cho et al. 2014), summarising both directional encoders.”
BackgroundMethodMozaffar, M., Paul, A., Al-Bahrani, R., Wolff, S., Choudhary, A., Agrawal, A., Ehmann, K., & Cao, J. (2018) · Manufacturing Letters · doi:10.1016/j.mfglet.2018.10.002 · Cited by 192
“In particular, the Long ShortTerm Memory (LSTM) [21] and the Gated Recurrent Unit (GRU) [22] are two successful formulations of RNN structures for training long sequences of data.”
BackgroundMethodEEG-based emotion recognition using simple recurrent units network and ensemble learning
Wei, C., Chen, L.-L., Song, Z.-Z., Lou, X.-G., & Li, D.-D. (2020) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2019.101756 · Cited by 192
Deep learning in generating radiology reports: A survey
Monshi, M. M. A., Poon, J., & Chung, V. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101878 · Cited by 192
Zhang, J., Liu, A., Gao, M., Chen, X., Zhang, X., & Chen, X. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101856 · Cited by 192
URLNet: Learning a URL Representation with Deep Learning for Malicious URL Detection
Le, H., Pham, Q., Sahoo, D., & Hoi, S. C. H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.03162 · Cited by 191
Uncertainty-based Traffic Accident Anticipation with Spatio-Temporal Relational Learning
Bao, W., Yu, Q., & Kong, Y. (2020) · Proceedings of the 28th ACM International Conference on Multimedia · doi:10.1145/3394171.3413827 · Cited by 191
Human Motion Prediction via Spatio-Temporal Inpainting
Hernandez, A., Gall, J., & Moreno, F. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00723 · Cited by 191
OFDM-Guided Deep Joint Source Channel Coding for Wireless Multipath Fading Channels
Yang, M., Bian, C., & Kim, H.-S. (2022) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2022.3151935 · Cited by 191
Jin, X., Jie, L., Wang, S., Qi, H., & Li, S. (2018) · Remote Sensing · doi:10.3390/rs10030395 · Cited by 191
Wang, J., Hsieh, C.-Y., Wang, M., Wang, X., Wu, Z., Jiang, D., Liao, B., Zhang, X., Yang, B., He, Q., et al. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00403-1 · Cited by 191
“The first option is to build an RNN with three-layer gated recurrent units 56 to learn the likelihood of a subset of the molecules sampled from the prior model.”
MethodNatural Language Processing Advancements By Deep Learning: A Survey
Torfi, A., Shirvani, R. A., Keneshloo, Y., Tavaf, N., & Fox, E. A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.01200 · Cited by 190
MV-RNN: A Multi-View Recurrent Neural Network for Sequential Recommendation
Cui, Q., Wu, S., Liu, Q., Zhong, W., & Wang, L. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2018.2881260 · Cited by 190
Mastering diverse control tasks through world models
Hafner, D., Pasukonis, J., Ba, J., & Lillicrap, T. (2025) · Nature · doi:10.1038/s41586-025-08744-2 · Cited by 189
“The input to the GRU at each time step is a linear embedding of the sampled latent z t , of the action a t , and of the recurrent state to allow mixing between blocks.”
Deep learning for small and big data in psychiatry
Koppe, G., Meyer-Lindenberg, A., & Durstewitz, D. (2021) · Neuropsychopharmacology · doi:10.1038/s41386-020-0767-z · Cited by 189
“Some in this sense, deep RNN architectures have been purpose designed to bridge long temporal delays, such as long short-term memory (LSTM) [15] or gated recurrent unit (GRU)-based networks [42].”
BackgroundChen, D., & Krahenbuhl, P. (2022) · 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52688.2022.01671 · Cited by 189
Learning‐Based Animation of Clothing for Virtual Try‐On
Santesteban, I., Otaduy, M. A., & Casas, D. (2019) · Computer Graphics Forum · doi:10.1111/cgf.13643 · Cited by 189
Deep Learning in IoT Intrusion Detection
Tsimenidis, S., Lagkas, T., & Rantos, K. (2022) · Journal of Network and Systems Management · doi:10.1007/s10922-021-09621-9 · Cited by 189
Personality Prediction System from Facebook Users
Tandera, T., Hendro, Suhartono, D., Wongso, R., & Prasetio, Y. L. (2017) · Procedia Computer Science · doi:10.1016/j.procs.2017.10.016 · Cited by 189
Chen, C., Su, T., Meng, G., Xing, Z., & Liu, Y. (2018) · Proceedings of the 40th International Conference on Software Engineering · doi:10.1145/3180155.3180240 · Cited by 188
Li, C. (2019) · Reinforcement Learning for Cyber-Physical Systems · doi:10.1201/9781351006620-6 · Cited by 188
A Novel Stacking Approach for Accurate Detection of Fake News
Jiang, T., Li, J. P., Haq, A. U., Saboor, A., & Ali, A. (2021) · IEEE Access · doi:10.1109/access.2021.3056079 · Cited by 188
“The (14) (16) (17) 3) GATED RECURRENT UNIT (GRU) GRU cell [9] is a simple version of LSTM cell, but sometimes its performance is even better than LSTM.”
BackgroundLearning to Select Knowledge for Response Generation in Dialog Systems
Lian, R., Xie, M., Wang, F., Peng, J., & Wu, H. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/706 · Cited by 188
Vo, N. N. Y., He, X., Liu, S., & Xu, G. (2019) · Decision Support Systems · doi:10.1016/j.dss.2019.113097 · Cited by 188
Spatiotemporal prediction of air quality based on LSTM neural network
Seng, D., Zhang, Q., Zhang, X., Chen, G., & Chen, X. (2021) · Alexandria Engineering Journal · doi:10.1016/j.aej.2020.12.009 · Cited by 188
Bidirectional Recurrent Neural Network with Attention Mechanism for Punctuation Restoration
Tilk, O., & Alumäe, T. (2016) · Interspeech 2016 · doi:10.21437/interspeech.2016-1517 · Cited by 188
Das, S., Tariq, A., Santos, T., Kantareddy, S. S., & Banerjee, I. (2023) · Neuromethods · doi:10.1007/978-1-0716-3195-9_4 · Cited by 187
Georgiou, T., Liu, Y., Chen, W., & Lew, M. (2020) · International Journal of Multimedia Information Retrieval · doi:10.1007/s13735-019-00183-w · Cited by 187
“Cho et al. [40] proposed an extension, the Gated Recurrent Unit (GRU) that simplified the architecture and reduced the number of train-able parameters by combining the forget and input gates.”
BackgroundAnalysis Survey on Deepfake detection and Recognition with Convolutional Neural Networks
Ahmed, S. R., Sonuc, E., Ahmed, M. R., & Duru, A. D. (2022) · 2022 International Congress on Human-Computer Interaction, Optimization and Robotic Applications (HORA) · doi:10.1109/hora55278.2022.9799858 · Cited by 187
Neural Generative Question Answering
Yin, J., Jiang, X., Lu, Z., Shang, L., Li, H., & Li, X. (2016) · Proceedings of the Workshop on Human-Computer Question Answering · doi:10.18653/v1/w16-0106 · Cited by 186
Ahn, J. M., Kim, J., & Kim, K. (2023) · Toxins · doi:10.3390/toxins15100608 · Cited by 186
“The LSTM (Long Short-Term Memory) model [6] and the GRU (Gated Recurrent Unit) model [7] have also been published.”
MethodEfficient Dialogue State Tracking by Selectively Overwriting Memory
Kim, S., Yang, S., Kim, G., & Lee, S.-W. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.53 · Cited by 186
Sentiment analysis using deep learning approaches: an overview
Habimana, O., Li, Y., Li, R., Gu, X., & Yu, G. (2020) · Science China Information Sciences · doi:10.1007/s11432-018-9941-6 · Cited by 186
Nautsch, A., Wang, X., Evans, N., Kinnunen, T. H., Vestman, V., Todisco, M., Delgado, H., Sahidullah, M., Yamagishi, J., & Lee, K. A. (2021) · IEEE Transactions on Biometrics, Behavior, and Identity Science · doi:10.1109/tbiom.2021.3059479 · Cited by 185
TweepFake: about detecting deepfake tweets
Fagni, T., Falchi, F., Gambini, M., Martella, A., & Tesconi, M. (2021) · PLOS ONE · doi:10.1371/journal.pone.0251415 · Cited by 185
“Characters char cnn Single CNN network [59] using internal char embeddings representation char gru Single GRU network [60] using internal char embeddings representation char cnngru Combined CNN and GRU networks using internal char embeddings representation”
MethodA Deep Reinforcement Learning Chatbot
Serban, I. V., Sankar, C., Germain, M., Zhang, S., Lin, Z., Subramanian, S., Kim, T., Pieper, M., Chandar, S., Ke, N. R., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.02349 · Cited by 185
“In principle, it is possible to compute input features by encoding the dialogue context and candidate response using Recurrent Neural Networks (RNNs) or Convolutional Neural Networks (Con-vNets) (Socher et al. 2013, Blunsom et al. 2014, Cho et al. 2014, Yu et al. 2014, Kiros et al. 2015).”
MethodSelf-citationLi, X., Ma, X., Xiao, F., Xiao, C., Wang, F., & Zhang, S. (2022) · Journal of Petroleum Science and Engineering · doi:10.1016/j.petrol.2021.109309 · Cited by 185
Contextual Inter-modal Attention for Multi-modal Sentiment Analysis
Ghosal, D., Akhtar, M. S., Chauhan, D., Poria, S., Ekbal, A., & Bhattacharyya, P. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1382 · Cited by 185
“text, visual & acoustic) for a sequence of utterances and feeds it into three separate bi-directional Gated Recurrent Unit (GRU) (Cho et al., 2014).”
BackgroundInfluentialInterpreting network knowledge with attention mechanism for bearing fault diagnosis
Yang, Z.-B., Zhang, J.-P., Zhao, Z.-B., Zhai, Z., & Chen, X.-F. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106829 · Cited by 185
Compression of Neural Machine Translation Models via Pruning
See, A., Luong, M.-T., & Manning, C. D. (2016) · Proceedings of The 20th SIGNLL Conference on Computational Natural Language Learning · doi:10.18653/v1/k16-1029 · Cited by 184
Adaptive User Modeling with Long and Short-Term Preferences for Personalized Recommendation
Yu, Z., Lian, J., Mahmoody, A., Liu, G., & Xie, X. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/585 · Cited by 184
Stock Price Forecasting with Deep Learning: A Comparative Study
Shahi, T. B., Shrestha, A., Neupane, A., & Guo, W. (2020) · Mathematics · doi:10.3390/math8091441 · Cited by 183
“GRU introduced by Cho et al. [21] is a deep-learning architecture to overcome the problems of vanishing and explosion of gradients in traditional recurrent neural networks (RNNs) when learning long-term dependencies.”
BackgroundHyperbolic Deep Neural Networks: A Survey
Peng, W., Varanka, T., Mostafa, A., Shi, H., & Zhao, G. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3136921 · Cited by 183
Big code != big vocabulary: open-vocabulary models for source code
Karampatsis, R.-M., Babii, H., Robbes, R., Sutton, C., & Janes, A. (2020) · Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering · doi:10.1145/3377811.3380342 · Cited by 182
“Among various gated units, GRUs [21] have been shown to perform comparably to LSTMs [45] in different applications [22].”
BackgroundAn overview and comparative analysis of Recurrent Neural Networks for Short Term Load Forecasting
Bianchi, F. M., Maiorino, E., Kampffmeyer, M., Rizzi, A., & Jenssen, R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.04378 · Cited by 182
“The internal state in GRU is always fully exposed in output, due to the lack of a control mechanism, like the output gate in LSTM. GRU were firstly tested by Cho et al. [121] on a statistical machine translation task and reported mixed results.”
BackgroundResultKim, B., Park, J., & Suh, J. (2020) · Decision Support Systems · doi:10.1016/j.dss.2020.113302 · Cited by 182
Multivariate Time Series Forecasting With Dynamic Graph Neural ODEs
Jin, M., Zheng, Y., Li, Y.-F., Chen, S., Yang, B., & Pan, S. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3221989 · Cited by 182
Named Entity Recognition and Classification in Historical Documents: A Survey
Ehrmann, M., Hamdi, A., Pontes, E. L., Romanello, M., & Doucet, A. (2024) · ACM Computing Surveys · doi:10.1145/3604931 · Cited by 181
Uncovering the Temporal Context for Video Question Answering
Zhu, L., Xu, Z., Yang, Y., & Hauptmann, A. G. (2017) · International Journal of Computer Vision · doi:10.1007/s11263-017-1033-7 · Cited by 181
“We present an encoder–decoder framework using Gated Recurrent Unit (GRU) (Cho et al. 2015).”
BackgroundMethodInfluentialInterpretable Representation Learning for Healthcare via Capturing Disease Progression through Time
Bai, T., Zhang, S., Egleston, B. L., & Vucetic, S. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219904 · Cited by 180
“[35] uses a time decay term in the update gate in GRU to find a tradeoff between the previous hidden state and the candidate hidden state.”
MethodDeep Learning Intervention for Health Care Challenges: Some Biomedical Domain Considerations
Tobore, I., Li, J., Yuhang, L., Al-Handarish, Y., Kandwal, A., Nie, Z., & Wang, L. (2019) · JMIR mHealth and uHealth · doi:10.2196/11966 · Cited by 180
Graph neural networks in particle physics
Shlomi, J., Battaglia, P., & Vlimant, J.-R. (2021) · Machine Learning: Science and Technology · doi:10.1088/2632-2153/abbf9a · Cited by 180
Skin Lesion Classification Using CNNs With Patch-Based Attention and Diagnosis-Guided Loss Weighting
Gessert, N., Sentker, T., Madesta, F., Schmitz, R., Kniep, H., Baltruschat, I., Werner, R., & Schlaefer, A. (2020) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2019.2915839 · Cited by 180
On extended long short-term memory and dependent bidirectional recurrent neural network
Su, Y., & Kuo, C.-C. J. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.04.044 · Cited by 180
A gated graph convolutional network with multi-sensor signals for remaining useful life prediction
Wang, L., Cao, H., Xu, H., & Liu, H. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.109340 · Cited by 180
Deep Learning for Credit Card Fraud Detection: A Review of Algorithms, Challenges, and Solutions
Mienye, I. D., & Jere, N. (2024) · IEEE Access · doi:10.1109/access.2024.3426955 · Cited by 179
Machine learning (ML)-centric resource management in cloud computing: A review and future directions
Khan, T., Tian, W., Zhou, G., Ilager, S., Gong, M., & Buyya, R. (2022) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2022.103405 · Cited by 179
Zhang, Y., & Thorburn, P. J. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2021.09.033 · Cited by 179
Robust High-Resolution Video Matting with Temporal Guidance
Lin, S., Yang, L., Saleemi, I., & Sengupta, S. (2022) · 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv51458.2022.00319 · Cited by 179
A survey on deep learning for textual emotion analysis in social networks
Peng, S., Cao, L., Zhou, Y., Ouyang, Z., Yang, A., Li, X., Jia, W., & Yu, S. (2022) · Digital Communications and Networks · doi:10.1016/j.dcan.2021.10.003 · Cited by 179
Miikkulainen, R., Liang, J., Meyerson, E., Rawal, A., Fink, D., Francon, O., Raju, B., Shahrzad, H., Navruzyan, A., Duffy, N., et al. (2024) · Artificial Intelligence in the Age of Neural Networks and Brain Computing · doi:10.1016/b978-0-323-96104-2.00002-6 · Cited by 179
Meta-Learning with Latent Embedding Optimization
Rusu, A. A., Rao, D., Sygnowski, J., Vinyals, O., Pascanu, R., Osindero, S., & Hadsell, R. T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.05960 · Cited by 178
Vision-Language Models in Remote Sensing: Current progress and future trends
Li, X., Wen, C., Hu, Y., Yuan, Z., & Zhu, X. X. (2024) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2024.3383473 · Cited by 178
Deep Learning for Time Series Forecasting: Advances and Open Problems
Casolaro, A., Capone, V., Iannuzzo, G., & Camastra, F. (2023) · Information · doi:10.3390/info14110598 · Cited by 178
Explanation in AI and law: Past, present and future
Atkinson, K., Bench-Capon, T., & Bollegala, D. (2020) · Artificial Intelligence · doi:10.1016/j.artint.2020.103387 · Cited by 178
“Specifically, HANs use bi-directional gated recurrent units (GRUs) [49] over pre-trained static word embeddings and concatenate the forward and backward hidden states for each token as a contextualised word representation.”
BackgroundDeep Reasoning with Knowledge Graph for Social Relationship Understanding
Wang, Z., Chen, T., Ren, J., Yu, W., Cheng, H., & Lin, L. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/142 · Cited by 178
Survey on reinforcement learning for language processing
Uc-Cetina, V., Navarro-Guerrero, N., Martin-Gonzalez, A., Weber, C., & Wermter, S. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10205-5 · Cited by 177
“SMT algorithms are characterized by their use of machine learning methods, where neural networks have been used with some success [15, 30, 54].”
BackgroundMedical image registration using deep neural networks: A comprehensive review
Boveiri, H. R., Khayami, R., Javidan, R., & Mehdizadeh, A. (2020) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2020.106767 · Cited by 179
Coarse-to-Fine Question Answering for Long Documents
Choi, E., Hewlett, D., Uszkoreit, J., Polosukhin, I., Lacoste, A., & Berant, J. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1020 · Cited by 177
“This model takes the query to-kens, and the document (or document summary) tokens as input and encodes them with a Gated Recurrent Unit (GRU; Cho et al. (2014)).”
MethodGated Fully Fusion for Semantic Segmentation
Li, X., Zhao, H., Han, L., Tong, Y., Tan, S., & Yang, K. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6805 · Cited by 177
Medical visual question answering: A survey
Lin, Z., Zhang, D., Tao, Q., Shi, D., Haffari, G., Wu, Q., He, M., & Ge, Z. (2023) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2023.102611 · Cited by 177
Convolutional Recurrent Neural Networks for Text Classification
Wang, R., Li, Z., Cao, J., Chen, T., & Wang, L. (2019) · 2019 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852406 · Cited by 177
Dynamical Variational Autoencoders: A Comprehensive Review
Girin, L., Leglaive, S., Bie, X., Diard, J., Hueber, T., & Alameda-Pineda, X. (2022) · Foundations and Trends in Machine Learning · doi:10.1561/2200000089 · Cited by 176
Linguistically Regularized LSTM for Sentiment Classification
Qian, Q., Huang, M., Lei, J., & Zhu, X. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1154 · Cited by 176
“LSTM/Bi-LSTM : Long Short-Term Memory (Cho et al., 2014) and the bidirectional variant as introduced previously.”
BackgroundInfluentialMin, X., Yu, B., & Wang, F. (2019) · Scientific Reports · doi:10.1038/s41598-019-39071-y · Cited by 170
“To explore such temporality, we construct a set of deep learning models, specifically Convolutional Neural Networks (CNN) 13 , Recurrent Neural Networks (RNN) 18 and their variants (e.g., Long-Short Term Memory (LSTM) 29 and Gated Recurrent Unit (GRU) 30 ).”
MethodInfluentialPosition Information in Transformers: An Overview
Dufter, P., Schmitt, M., & Schütze, H. (2022) · Computational Linguistics · doi:10.1162/coli_a_00445 · Cited by 175
Water Quality Prediction for Smart Aquaculture Using Hybrid Deep Learning Models
Rasheed Abdul Haq, K. P., & Harigovindan, V. P. (2022) · IEEE Access · doi:10.1109/access.2022.3180482 · Cited by 175
“GRU DL neural network was proposed by authors of [46] in 2014.”
MethodQuaterNet: A Quaternion-based Recurrent Model for Human Motion
Pavllo, D., Grangier, D., & Auli, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.06485 · Cited by 174
LMDrive: Closed-Loop End-to-End Driving with Large Language Models
Shao, H., Hu, Y., Wang, L., Song, G., Waslander, S. L., Liu, Y., & Li, H. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.01432 · Cited by 174
Vision Transformers for Image Classification: A Comparative Survey
Wang, Y., Deng, Y., Zheng, Y., Chattopadhyay, P., & Wang, L. (2025) · Technologies · doi:10.3390/technologies13010032 · Cited by 174
Optimized Skeleton-based Action Recognition via Sparsified Graph Regression
Gao, X., Hu, W., Tang, J., Liu, J., & Guo, Z. (2019) · Proceedings of the 27th ACM International Conference on Multimedia · doi:10.1145/3343031.3351170 · Cited by 174
Multi-Timescale Long Short-Term Memory Neural Network for Modelling Sentences and Documents
Liu, P., Qiu, X., Chen, X., Wu, S., & Huang, X. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1280 · Cited by 174
“Traditionally, a simple strategy for modeling sequence is to map the input sequence to a fixedsized vector using one RNN, and then to feed the vector to a softmax layer for classification or other tasks (Sutskever et al., 2014; Cho et al., 2014).”
MethodOne-Class Adversarial Nets for Fraud Detection
Zheng, P., Yuan, S., Wu, X., Li, J., & Lu, A. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33011286 · Cited by 173
A Survey of Single-Scene Video Anomaly Detection
Ramachandra, B., Jones, M., & Vatsavai, R. R. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3040591 · Cited by 173
Personalized Prompt Learning for Explainable Recommendation
Li, L., Zhang, Y., & Chen, L. (2023) · ACM Transactions on Information Systems · doi:10.1145/3580488 · Cited by 172
Metadata
- Authors
- Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y.
- Affiliations
- Le Mans Université (FR)
- Polytechnique Montréal (CA)
- Venue
- Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)
- Published
- 2014
- Pages
- 1724-1734
- OpenAlex
- W2157331557
- Cited by
- 25,545
- References
- 31
- Citations by year
- 2026: 1895 · 2025: 2591 · 2024: 2721 · 2023: 3047 · 2022: 3245 · 2021: 3534 · 2020: 3063 · 2019: 2494 · 2018: 1644 · 2017: 816 · 2016: 349 · 2015: 119 · 2014: 22
- FWCI
- 256.40
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- HAL (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Keywords
- statistical machine translation, neural machine translation, phrase embeddings, sequence-to-sequence models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.