Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Open accessThe DOI matches its Crossref record; 29 of the 31 references it cites were found in a registry or an index.
Abstract
Kyunghyun Cho, Bart van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, Yoshua Bengio. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). 2014.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“GRU [185] is a variant based on the LSTM, which only contains an update gate and reset gate and has a faster training speed than the LSTM with fewer parameters.”
From Deep Learning for Structural Health Monitoring: Data, Algorithms, Applications, Challenges, and Trends (2023) · cites this paper as [185]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“They are thus well-suited for detecting dependencies and patterns in language-like input.”
From The role of pragmatic mechanisms in referential communication and categorization: An emergent communication model (2026) · cites this paper as [87]
The cited source says what the claim attributes to it.
In the citing paper
“GRU cells are a specific type of Recurrent Neural Networks (RNNs) which have been proven useful for dealing with sequence data such as language.”
From The role of pragmatic mechanisms in referential communication and categorization: An emergent communication model (2026) · cites this paper as [87]
The cited source says what the claim attributes to it.
In the citing paper
“Early work [139-141] mainly relied on recurrent neural networks (e.g., LSTM [142], GRU [143]). Limited by the model's expressiveness, they often suffer from the issue of insufficient diversity.”
From When large language models meet personalization: perspectives of challenges and opportunities (2024) · cites this paper as [143]
The cited source says what the claim attributes to it.
In the citing paper
“Moreover, [Tang et al., 2020] adopts GRU [Cho et al., 2014] on the sequence of hyperplanes to further capture the dynamics among hyperplanes.”
From Temporal Knowledge Graph Completion: A Survey (2023) · cites this paper as Cho et al., 2014
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 1×
“At each time step t , the hidden state h t (cid:105) of the RNN is updated by where f is a non-linear activation function. f may be as simple as an element-wise logistic sigmoid function and as complex as a long short-term memory (LSTM) unit (Hochreiter and Schmidhuber, 1997).”
BackgroundDistributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533 · cited 1×
“We have done so by applying the data selection method proposed in (Moore and Lewis, 2010), and its extension to bi-texts (Axelrod et al., 2011).”
Method(2011) · Cited by 6,993
Self-citationADADELTA: An Adaptive Learning Rate Method
Zeiler, M. D. (2012) · arXiv · doi:10.48550/arxiv.1212.5701 · Cited by 5,322 · cited 2×
“95 (Zeiler, 2012).”
MethodStatistical phrase-based translation
Koehn, P., Och, F. J., & Marcu, D. (2003) · Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - NAACL '03 · doi:10.3115/1073445.1073462 · Cited by 3,197 · cited 2×
“In the phrase-based SMT framework introduced in (Koehn et al., 2003) and (Marcu and Wong, 2002), the translation model log p ( e | f ) is factorized into the translation probabilities of matching phrases in the source and target sentences.”
Method(2005) · Cited by 3,125
Supervised Sequence Labelling with Recurrent Neural Networks
Graves, A. (2012) · Studies in Computational Intelligence · doi:10.1007/978-3-642-24797-2 · Cited by 3,120
Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition
Dahl, G. E., Yu, D., Deng, L., & Acero, A. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2134090 · Cited by 3,011 · cited 1×
“Deep neural networks have shown great success in various applications such as objection recognition (see, e.g., (Krizhevsky et al., 2012)) and speech recognition (see, e.g., (Dahl et al., 2012)).”
BackgroundRecurrent Continuous Translation Models
Kalchbrenner, N., & Blunsom, P. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1176 · Cited by 1,232 · cited 1×
“The closest approach related to the proposed RNN Encoder–Decoder is the Recurrent Continuous Translation Model (Model 2) proposed in (Kalchbrenner and Blunsom, 2013).”
Method
Cited by
Items 601–700 of 1,296
Graph-Based Deep Learning for Medical Diagnosis and Analysis: Past, Present and Future
Ahmedt-Aristizabal, D., Armin, M. A., Denman, S., Fookes, C., & Petersson, L. (2021) · Sensors · doi:10.3390/s21144758 · Cited by 272
“GRUs [55] are a variant of LSTMs which combine the forget and input gates, simplifying the model.”
MethodEdge Intelligence: Empowering Intelligence to the Edge of Network
Xu, D., Li, T., Li, Y., Su, X., Tarkoma, S., Jiang, T., Crowcroft, J., & Hui, P. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3119950 · Cited by 272
Lien Minh, D., Sadeghi-Niaraki, A., Huy, H. D., Min, K., & Moon, H. (2018) · IEEE Access · doi:10.1109/access.2018.2868970 · Cited by 272
Gated Dual Attention Unit Neural Networks for Remaining Useful Life Prediction of Rolling Bearings
Qin, Y., Chen, D., Xiang, S., & Zhu, C. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.2999442 · Cited by 271
Design and Development of RNN Anomaly Detection Model for IoT Networks
Ullah, I., & Mahmoud, Q. H. (2022) · IEEE Access · doi:10.1109/access.2022.3176317 · Cited by 270
“[82] developed a slight variant of LSTM called Gated Recurrent Unit (GRU).”
BackgroundIndoor positioning and wayfinding systems: a survey
Kunhoth, J., Karkar, A., Al-Maadeed, S., & Al-Ali, A. (2020) · Human-centric Computing and Information Sciences · doi:10.1186/s13673-020-00222-0 · Cited by 270
Generating Natural Questions About an Image
Mostafazadeh, N., Misra, I., Devlin, J., Mitchell, M., He, X., & Vanderwende, L. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1170 · Cited by 270
“The MT model is a Sequence2Sequence translation model (Cho et al., 2014; Sutskever et al., 2014) which directly translates a description of an image into a question, where we used the MS COCO captions and Captions Bing 5000 as the source of translation.”
MethodLi, H.-L., Pang, Y.-H., & Liu, B. (2021) · Nucleic Acids Research · doi:10.1093/nar/gkab829 · Cited by 269
H+O: Unified Egocentric Recognition of 3D Hand-Object Poses and Interactions
Tekin, B., Bogo, F., & Pollefeys, M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00464 · Cited by 269
Deep Learning for Time Series Classification and Extrinsic Regression: A Current Survey
Mohammadi Foumani, N., Miller, L., Tan, C. W., Webb, G. I., Forestier, G., & Salehi, M. (2024) · ACM Computing Surveys · doi:10.1145/3649448 · Cited by 268
“The attention mechanism was introduced by [117] for improving the performance of encoderdecoder models [118] in neural machine translation.”
MethodConvolutional Recurrent Neural Networks forHyperspectral Data Classification
Wu, H., & Prasad, S. (2017) · Remote Sensing · doi:10.3390/rs9030298 · Cited by 268
Deep Learning: The Good, the Bad, and the Ugly
Serre, T. (2019) · Annual Review of Vision Science · doi:10.1146/annurev-vision-091718-014951 · Cited by 267
Shaygan, M., Meese, C., Li, W., Zhao, X. (., & Nejad, M. (2022) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2022.103921 · Cited by 267
A Decomposition Dynamic graph convolutional recurrent network for traffic forecasting
Weng, W., Fan, J., Wu, H., Hu, Y., Tian, H., Zhu, F., & Wu, J. (2023) · Pattern Recognition · doi:10.1016/j.patcog.2023.109670 · Cited by 267
Deep Learning for Fading Channel Prediction
Jiang, W., & Schotten, H. D. (2020) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2020.2982513 · Cited by 266
Selective Encoding for Abstractive Sentence Summarization
Zhou, Q., Yang, N., Wei, F., & Zhou, M. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1101 · Cited by 265
Tree-to-Sequence Attentional Neural Machine Translation
Eriguchi, A., Hashimoto, K., & Tsuruoka, Y. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1078 · Cited by 265
Evaluation of Deep Learning Models for Multi-Step Ahead Time Series Prediction
Chandra, R., Goyal, S., & Gupta, R. (2021) · IEEE Access · doi:10.1109/access.2021.3085085 · Cited by 265
“Recent deep learning revolution [24] contributed to further improvements in LSTM networks with gated recurrent unit (GRU) networks [31], [32], which provides similar performance and are simpler to implement.”
MethodRecent advances in deep learning based dialogue systems: a systematic survey
Ni, J., Young, T., Pandelea, V., Xue, F., & Cambria, E. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-022-10248-8 · Cited by 264
Kim, J., Kim, H., Kim, H., Lee, D., & Yoon, S. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11223-9 · Cited by 263
Enhancing Stock Movement Prediction with Adversarial Training
Feng, F., Chen, H., He, X., Ding, J., Sun, M., & Chua, T.-S. (2019) · Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/810 · Cited by 263
Ullah, A., Anwar, S. M., Li, J., Nadeem, L., Mahmood, T., Rehman, A., & Saba, T. (2024) · Complex & Intelligent Systems · doi:10.1007/s40747-023-01175-4 · Cited by 263
Summarizing Source Code with Transferred API Knowledge
Hu, X., Li, G., Xia, X., Lo, D., Lu, S., & Jin, Z. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/314 · Cited by 263
Gao, Y., Ruan, Y., Fang, C., & Yin, S. (2020) · Energy and Buildings · doi:10.1016/j.enbuild.2020.110156 · Cited by 263
What you can cram into a single vector: Probing sentence embeddings for linguistic properties
Conneau, A., Kruszewski, G., Lample, G., Barrault, L., & Baroni, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.01070 · Cited by 263
Root Mean Square Layer Normalization
Zhang, B., & Sennrich, R. (2019) · arXiv · doi:10.48550/arxiv.1910.07467 · Cited by 262
Graph-based Neural Multi-Document Summarization
Yasunaga, M., Zhang, R., Meelu, K., Pareek, A., Srinivasan, K., & Radev, D. (2017) · Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL 2017) · doi:10.18653/v1/k17-1045 · Cited by 262
ChemTS: an efficient python library for de novo molecular generation
Yang, X., Zhang, J., Yoshizoe, K., Terayama, K., & Tsuda, K. (2017) · Science and Technology of Advanced Materials · doi:10.1080/14686996.2017.1401424 · Cited by 262
“Segler et al. [13] showed that a recurrent neural network (RNN) using long short term memory (LSTM) [14] achieves a high probablity of valid SMILES generation.”
BackgroundMethodInfluentialDesign of deep echo state networks
Gallicchio, C., Micheli, A., & Pedrelli, L. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.08.002 · Cited by 262
Video Captioning via Hierarchical Reinforcement Learning
Wang, X., Chen, W., Wu, J., Wang, Y.-F., & Wang, W. Y. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00443 · Cited by 262
Leveraging Knowledge Bases in LSTMs for Improving Machine Reading
Yang, B., & Mitchell, T. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1132 · Cited by 261
“Essential to RNNs’ success on natural language processing is the use of Long Short-Term Memory neural networks (Hochreiter and Schmidhu-ber, 1997) (LSTMs) or Gated Recurrent Unit (Cho et al., 2014) (GRU) as they are able to handle long-term dependencies by adaptively memorizing values for either long or short duration…”
BackgroundMethodLv, H., Chen, J., Pan, T., Zhang, T., Feng, Y., & Liu, S. (2022) · Measurement · doi:10.1016/j.measurement.2022.111594 · Cited by 261
Zero-Resource Translation with Multi-Lingual Neural Machine Translation
Firat, O., Sankaran, B., Al-Onaizan, Y., Yarman Vural, F. T., & Cho, K. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1026 · Cited by 261
Self-citationDeep reinforcement learning in computer vision: a comprehensive survey
Le, N., Rathour, V. S., Yamazaki, K., Luu, K., & Savvides, M. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10061-9 · Cited by 261
Ahmed, A. A., Sayed, S., Abdoulhalik, A., Moutari, S., & Oyedele, L. (2024) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2024.140715 · Cited by 260
“Ghar-ehbaghi et al. (2022) also examined the performance of the GRU model in Northwest Iran.”
BackgroundInfluentialHong, J., Lee, D., Jeong, E.-R., & Yi, Y. (2020) · Applied Energy · doi:10.1016/j.apenergy.2020.115646 · Cited by 260
Speaker-Independent Speech Separation With Deep Attractor Network
Luo, Y., Chen, Z., & Mesgarani, N. (2018) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2018.2795749 · Cited by 260
Agarap, A. F. M. (2018) · Proceedings of the 2018 10th International Conference on Machine Learning and Computing · doi:10.1145/3195106.3195117 · Cited by 259
Zhang, J., Du, J., Zhang, S., Liu, D., Hu, Y., Hu, J., Wei, S., & Dai, L. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.06.017 · Cited by 259
RESIDE: Improving Distantly-Supervised Neural Relation Extraction using Side Information
Vashishth, S., Joshi, R., Prayaga, S. S., Bhattacharyya, C., & Talukdar, P. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1157 · Cited by 258
“Bi-GRUs have been found to be quite effective in encoding the context of tokens in several tasks (Sutskever et al., 2014; Graves et al., 2013).”
MethodInfluentialKong, Z., Tang, B., Deng, L., Liu, W., & Han, Y. (2020) · Renewable Energy · doi:10.1016/j.renene.2019.07.033 · Cited by 258
Feed-Forward Networks with Attention Can Solve Some Long-Term Memory Problems
Raffel, C., & Ellis, D. P. W. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1512.08756 · Cited by 258
“The use of gating architectures [3, 5], sophisticated optimization techniques [6, 7], gradient clipping [2, 8], and/or careful initialization [7, 9, 10, 11] can help mitigate this issue and has facilitated the success of RNNs in a variety of fields (see e.”
BackgroundLog-based anomaly detection with deep learning: how far are we?
Le, V.-H., & Zhang, H. (2022) · Proceedings of the 44th International Conference on Software Engineering · doi:10.1145/3510003.3510155 · Cited by 257
“Recurrent Neural Networks (RNNs), including its variants Long Short-Term Memory (LSTM) [21] and Gated Recurrent Units (GRUs) [9], are neural networks designed to handle the sequential inputs with arbitrary length.”
BackgroundHuang, X., Sun, J., & Sun, J. (2018) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2018.07.022 · Cited by 257
Multiword Expression Processing: A Survey
Constant, M., Eryiğit, G., Monti, J., van der Plas, L., Ramisch, C., Rosner, M., & Todirascu, A. (2017) · Computational Linguistics · doi:10.1162/coli_a_00302 · Cited by 256
Fi-GNN: Modeling Feature Interactions via Graph Neural Networks for CTR Prediction
Li, Z., Cui, Z., Wu, S., Zhang, X., & Wang, L. (2019) · Proceedings of the 28th ACM International Conference on Information and Knowledge Management · doi:10.1145/3357384.3357951 · Cited by 256
“Gated Graph Neural Networks (GGNN) [12] uses GRU [3] as updater.”
MethodLaplace neural operator for solving differential equations
Cao, Q., Goswami, S., & Karniadakis, G. E. (2024) · Nature Machine Intelligence · doi:10.1038/s42256-024-00844-4 · Cited by 362
“As observed in the previous example, the LNO can predict the results more accurately than the FNO and GRU for the systems without damping.”
InfluentialAutomatically generating commit messages from diffs using neural machine translation
Jiang, S., Armaly, A., & McMillan, C. (2017) · 2017 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2017.8115626 · Cited by 255
Chen, G., Ye, D., Xing, Z., Chen, J., & Cambria, E. (2017) · 2017 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966144 · Cited by 255
Large language models for human–robot interaction: A review
Zhang, C., Chen, J., Li, J., Peng, Y., & Mao, Z. (2023) · Biomimetic Intelligence and Robotics · doi:10.1016/j.birob.2023.100131 · Cited by 254
Neural Natural Language Processing for unstructured data in electronic health records: A review
Li, I., Pan, J., Goldwasser, J., Verma, N., Wong, W. P., Nuzumlalı, M. Y., Rosand, B., Li, Y., Zhang, M., Chang, D., et al. (2022) · Computer Science Review · doi:10.1016/j.cosrev.2022.100511 · Cited by 254
Beyond Static Features for Temporally Consistent 3D Human Pose and Shape from a Video
Choi, H., Moon, G., Chang, J. Y., & Lee, K. M. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00200 · Cited by 254
Peng, H., Pappas, N., Yogatama, D., Schwartz, R., Smith, N. A., & Kong, L. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.02143 · Cited by 110
“Inspired by its connections to gated recurrent neural networks (Hochre-iter & Schmidhuber, 1997; Cho et al., 2014) and fast weights (Schmidhuber, 1992), we further augment R FA with an optional gating mechanism, offering a straightforward way of learning with recency bias when locality is desired.”
BackgroundMethodDiscrete Graph Structure Learning for Forecasting Multiple Time Series
Shang, C., Chen, J., & Bi, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.06861 · Cited by 93
A Survey on Text Classification Algorithms: From Text to Predictions
Gasparetto, A., Marcuzzo, M., Zangari, A., & Albarelli, A. (2022) · Information · doi:10.3390/info13020083 · Cited by 253
Disentangled Representation Learning for Non-Parallel Text Style Transfer
John, V., Mou, L., Bahuleyan, H., & Vechtomova, O. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1041 · Cited by 253
Towards Bayesian Deep Learning: A Framework and Some Existing Methods
Wang, H., & Yeung, D.-Y. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2016.2606428 · Cited by 253
Fuzzy bag-of-words model for document representation
Zhao, R., & Mao, K. (2018) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2017.2690222 · Cited by 252
“Another is deep model: multilayers neural networks with various forms including recursive [19], [20], recurrent [21], [22], and convolution [23]–[25] neural networks to learn and perform compositions over word embeddings.”
BackgroundAn Overview of End-to-End Automatic Speech Recognition
Wang, D., Wang, X., & Lv, S. (2019) · Symmetry · doi:10.3390/sym11081018 · Cited by 252
Liu, M., Cheng, D., Yan, W., & Initiative, A. D. N. (2018) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2018.00035 · Cited by 252
“Gradient mass and explosion are the common unsolved problems until the emergence of a special kind of RNN structure—LSTM. LSTM contains three gate units ( forget gate, input gate and output gate) and a memory cell unit.”
BackgroundInfluentialUnsupervised Pretraining for Sequence to Sequence Learning
Ramachandran, P., Liu, P., & Le, Q. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1039 · Cited by 251
“Sequence to sequence (seq2seq) models (Sutskever et al., 2014; Cho et al., 2014; Kalchbrenner and Blunsom, 2013; Allen, 1987; Ñeco and Forcada, 1997) are extremely effective on a variety of tasks that require a mapping between a variable-length input sequence to a variable-length output sequence.”
BackgroundAn Overview of End-to-End Entity Resolution for Big Data
Christophides, V., Efthymiou, V., Palpanas, T., Papadakis, G., & Stefanidis, K. (2021) · ACM Computing Surveys · doi:10.1145/3418896 · Cited by 251
“Word embeddings are commonly used with RNNs for speech recognition [121] and similar Natual Language Processing (NLP) tasks [32].”
MethodTaking a HINT: Leveraging Explanations to Make Vision and Language Models More Grounded
Selvaraju, R. R., Lee, S., Shen, Y., Jin, H., Ghosh, S., Heck, L., Batra, D., & Parikh, D. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00268 · Cited by 251
“The question is encoded using a GRU [6] and a soft-attention over each of the k proposal features is computed using the question embedding.”
MethodAl-Smadi, M., Talafha, B., Al-Ayyoub, M., & Jararweh, Y. (2019) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-018-0799-4 · Cited by 251
“Deep learning has become one of the highly recommended machine learning approaches for handling many of the natural language processing (NLP) research challenges such as named-entity recognition [30], machine translation [18, 20], and sentiment analysis [68, 70].”
BackgroundExploring Hate Speech Detection in Multimodal Publications
Gomez, R., Gibert, J., Gomez, L., & Karatzas, D. (2020) · 2020 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv45572.2020.9093414 · Cited by 250
“Zhang et al. [27] recently proposed a more sophisticated approach for hate speech detection, using a CNN and a GRU [3] over Word2Vec [17] word embeddings.”
MethodImproving text classification with weighted word embeddings via a multi-channel TextCNN model
Guo, B., Zhang, C., Liu, J., & Ma, X. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.07.052 · Cited by 250
Hao, S., Lee, D.-H., & Zhao, D. (2019) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2019.08.005 · Cited by 250
Neural Abstractive Text Summarization with Sequence-to-Sequence Models
Shi, T., Keneshloo, Y., Ramakrishnan, N., & Reddy, C. K. (2021) · ACM/IMS Transactions on Data Science · doi:10.1145/3419106 · Cited by 249
“RNN architectures, especially long short term memory (LSTM) [32] and gated recurrent unit (GRU) [20], have been most widely adopted for seq2seq models.”
BackgroundMethodArtificial Intelligence in Predicting Mechanical Properties of Composite Materials
Kibrete, F., Trzepieciński, T., Gebremedhen, H. S., & Woldemichael, D. E. (2023) · Journal of Composites Science · doi:10.3390/jcs7090364 · Cited by 249
Supervised and Semi-Supervised Text Categorization using One-Hot LSTM for Region EmbeddingsPreprint
Johnson, R., & Zhang, T. (2016) · arXiv.org · doi:10.48550/arxiv.1602.02373 · Cited by 10
“It is in spirit similar to Gated Recurrent Units (Cho et al., 2014) but simpler, having fewer gates.”
Method3-D Quasi-Recurrent Neural Network for Hyperspectral Image Denoising
Wei, K., Fu, Y., & Huang, H. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2978756 · Cited by 248
Learning a Deep Listwise Context Model for Ranking Refinement
Ai, Q., Bi, K., Guo, J., & Croft, W. B. (2018) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3209978.3209985 · Cited by 298
A Survey of Domain Adaptation for Machine Translation
Chu, C., & Wang, R. (2020) · Journal of Information Processing · doi:10.2197/ipsjjip.28.413 · Cited by 282
A Survey on Bayesian Deep Learning
Wang, H., & Yeung, D.-Y. (2021) · ACM Computing Surveys · doi:10.1145/3409383 · Cited by 247
“Similar to [16, 108], we can use the output state and cell state at the last time step (hTj and sTj ) of the first LSTM as the initial output state and cell state of the second LSTM.”
MethodMastering Atari with Discrete World Models
Hafner, D., Lillicrap, T., Norouzi, M., & Ba, J. (2020) · arXiv · doi:10.48550/arxiv.2010.02193 · Cited by 247
“The RSSM uses a Gated Recurrent Unit (GRU; Cho et al., 2014) that outputs a stochastic variable at each time step and feeds it back for the next time step.”
MethodStudying the Usage of Text-To-Text Transfer Transformer to Support Code-Related Tasks
Mastropaolo, A., Scalabrino, S., Cooper, N., Nader Palacio, D., Poshyvanyk, D., Oliveto, R., & Bavota, G. (2021) · 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE) · doi:10.1109/icse43902.2021.00041 · Cited by 247
“commonly adopted in Neural Machine Translation (NMT) [22]–[24], to learn how to automatically fix bugs in Java methods.”
BackgroundRobots Learn Social Skills: End-to-End Learning of Co-Speech Gesture Generation for Humanoid Robots
Yoon, Y., Ko, W.-R., Jang, M., Lee, J., Kim, J., & Lee, G. (2019) · 2019 International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2019.8793720 · Cited by 247
“tures. The decoder GRU inputs n previous poses to make the series of poses continuous. The soft attention mechanism is used but not depicted here. whole text when it generated poses. Two-layered GRUs [24] with 200 hidden units were used for the encoder and decoder. Training a recurrent neural network on long sequences…”
MethodLow-Light Image Enhancement via Progressive-Recursive Network
Li, J., Feng, X., & Hua, Z. (2021) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3049940 · Cited by 247
Neural-machine-translation-based commit message generation: how far are we?
Liu, Z., Xia, X., Hassan, A. E., Lo, D., Xing, Z., & Wang, X. (2018) · Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering · doi:10.1145/3238147.3238190 · Cited by 247
Hyperspectral image classification using spectral-spatial LSTMs
Zhou, F., Hang, R., Liu, Q., & Yuan, X. (2019) · Neurocomputing · doi:10.1016/j.neucom.2018.02.105 · Cited by 246
Noisy Activation FunctionsPreprint
Gülçehre, Ç., Moczulski, M., Denil, M., & Bengio, Y. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.00391 · Cited by 274
Self-citationLearning to Decompose and Disentangle Representations for Video Prediction
Hsieh, J.-T., Liu, B., Huang, D.-A., Fei-Fei, L., & Niebles, J. C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.04166 · Cited by 108
Visual question answering: Datasets, algorithms, and future challenges
Kafle, K., & Kanan, C. (2017) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2017.06.005 · Cited by 245
“A wider variety of question featurizations have been explored, including bag-of-words (BOW), long short term memory (LSTM) encoders [59], gated recurrent units (GRU) [60], and skip-thought vectors [61].”
BackgroundFAST-VQA: Efficient End-to-End Video Quality Assessment with Fragment Sampling
Wu, H., Chen, C., Hou, J., Liao, L., Wang, A., Sun, W., Yan, Q., & Lin, W. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-20068-7_31 · Cited by 244
Jin, J., Zhang, C., Feng, F., Na, W., Ma, J., & Zhang, Q.-J. (2019) · IEEE Transactions on Microwave Theory and Techniques · doi:10.1109/tmtt.2019.2932738 · Cited by 244
Deep learning for human affect recognition: Insights and new developments
Rouast, P. V., Adam, M. T. P., & Chiong, R. (2021) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2018.2890471 · Cited by 243
CodeBERT: A Pre-Trained Model for Programming and Natural Languages
Feng, Z., Guo, D., Tang, D., Duan, N., Feng, X., Gong, M., Shou, L., Qin, B., Liu, T., Jiang, D., et al. (2020) · arXiv · doi:10.48550/arxiv.2002.08155 · Cited by 243
RNN-based longitudinal analysis for diagnosis of Alzheimer’s disease
Cui, R., & Liu, M. (2019) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2019.01.005 · Cited by 243
CANE: Context-Aware Network Embedding for Relation Modeling
Tu, C., Liu, H., Liu, Z., & Sun, M. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1158 · Cited by 243
Latent Space Physics: Towards Learning the Temporal Evolution of Fluid Flow
Wiewel, S., Becher, M., & Thuerey, N. (2019) · Computer Graphics Forum · doi:10.1111/cgf.13620 · Cited by 242
Towards Deep Conversational Recommendations
Li, R., Kahou, S., Schulz, H., Michalski, V., Charlin, L., & Pal, C. (2018) · arXiv · doi:10.48550/arxiv.1812.07617 · Cited by 242
Sheng, Z., Xu, Y., Xue, S., & Li, D. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3155749 · Cited by 242
A Survey on Chatbot Implementation in Customer Service Industry through Deep Neural Networks
Nuruzzaman, M., & Hussain, O. K. (2018) · 2018 IEEE 15th International Conference on e-Business Engineering (ICEBE) · doi:10.1109/icebe.2018.00019 · Cited by 241
A survey on automatic image caption generation
Bai, S., & An, S. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.05.080 · Cited by 241
Xiao, Y., Yin, H., Zhang, Y., Qi, H., Zhang, Y., & Liu, Z. (2021) · International Journal of Intelligent Systems · doi:10.1002/int.22370 · Cited by 241
“For LSTM or GRU models, however, there are two types of problems to predict time series 44 – 46 : (1) Theoretically, the sequence of input and output is of equal length, that is, if the input is time ‐ series data for ω consecutive moments, the data for the ω time period will be predicted.”
MethodSentence Compression by Deletion with LSTMs
Filippova, K., Alfonseca, E., Colmenares, C. A., Kaiser, L., & Vinyals, O. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1042 · Cited by 241
Toward Intelligent Vehicular Networks: A Machine Learning Framework
Liang, L., Ye, H., & Li, G. Y. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2872122 · Cited by 240
Neural networks for deceptive opinion spam detection: An empirical study
Ren, Y., & Ji, D. (2017) · Information Sciences · doi:10.1016/j.ins.2017.01.015 · Cited by 240
Self-Taught convolutional neural networks for short text clustering
Xu, J., Xu, B., Wang, P., Zheng, S., Tian, G., Zhao, J., & Xu, B. (2017) · Neural Networks · doi:10.1016/j.neunet.2016.12.008 · Cited by 240
“The reason maybe that although recursive neural models introduce tree structure to capture compositional semantics, the vector of the top node mainly captures a biased semantic while the average of all vectors in the tree nodes, such as RecNN (Ave.), can be better We further replace the CNN model in our framework as i…”
BackgroundMethodInfluentialZuo, J., Lv, H., Zhou, D., Xue, Q., Jin, L., Zhou, W., Yang, D., & Zhang, C. (2021) · Applied Energy · doi:10.1016/j.apenergy.2020.115937 · Cited by 239
Metadata
- Authors
- Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y.
- Affiliations
- Le Mans Université (FR)
- Polytechnique Montréal (CA)
- Venue
- Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)
- Published
- 2014
- Pages
- 1724-1734
- OpenAlex
- W2157331557
- Cited by
- 25,545
- References
- 31
- Citations by year
- 2026: 1895 · 2025: 2591 · 2024: 2721 · 2023: 3047 · 2022: 3245 · 2021: 3534 · 2020: 3063 · 2019: 2494 · 2018: 1644 · 2017: 816 · 2016: 349 · 2015: 119 · 2014: 22
- FWCI
- 256.40
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- HAL (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Keywords
- statistical machine translation, neural machine translation, phrase embeddings, sequence-to-sequence models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.