Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Open accessThe DOI matches its Crossref record; 29 of the 31 references it cites were found in a registry or an index.
Abstract
Kyunghyun Cho, Bart van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, Yoshua Bengio. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). 2014.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“GRU [185] is a variant based on the LSTM, which only contains an update gate and reset gate and has a faster training speed than the LSTM with fewer parameters.”
From Deep Learning for Structural Health Monitoring: Data, Algorithms, Applications, Challenges, and Trends (2023) · cites this paper as [185]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“They are thus well-suited for detecting dependencies and patterns in language-like input.”
From The role of pragmatic mechanisms in referential communication and categorization: An emergent communication model (2026) · cites this paper as [87]
The cited source says what the claim attributes to it.
In the citing paper
“GRU cells are a specific type of Recurrent Neural Networks (RNNs) which have been proven useful for dealing with sequence data such as language.”
From The role of pragmatic mechanisms in referential communication and categorization: An emergent communication model (2026) · cites this paper as [87]
The cited source says what the claim attributes to it.
In the citing paper
“Early work [139-141] mainly relied on recurrent neural networks (e.g., LSTM [142], GRU [143]). Limited by the model's expressiveness, they often suffer from the issue of insufficient diversity.”
From When large language models meet personalization: perspectives of challenges and opportunities (2024) · cites this paper as [143]
The cited source says what the claim attributes to it.
In the citing paper
“Moreover, [Tang et al., 2020] adopts GRU [Cho et al., 2014] on the sequence of hyperplanes to further capture the dynamics among hyperplanes.”
From Temporal Knowledge Graph Completion: A Survey (2023) · cites this paper as Cho et al., 2014
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 1×
“At each time step t , the hidden state h t (cid:105) of the RNN is updated by where f is a non-linear activation function. f may be as simple as an element-wise logistic sigmoid function and as complex as a long short-term memory (LSTM) unit (Hochreiter and Schmidhuber, 1997).”
BackgroundDistributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533 · cited 1×
“We have done so by applying the data selection method proposed in (Moore and Lewis, 2010), and its extension to bi-texts (Axelrod et al., 2011).”
Method(2011) · Cited by 6,993
Self-citationADADELTA: An Adaptive Learning Rate Method
Zeiler, M. D. (2012) · arXiv · doi:10.48550/arxiv.1212.5701 · Cited by 5,322 · cited 2×
“95 (Zeiler, 2012).”
MethodStatistical phrase-based translation
Koehn, P., Och, F. J., & Marcu, D. (2003) · Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - NAACL '03 · doi:10.3115/1073445.1073462 · Cited by 3,197 · cited 2×
“In the phrase-based SMT framework introduced in (Koehn et al., 2003) and (Marcu and Wong, 2002), the translation model log p ( e | f ) is factorized into the translation probabilities of matching phrases in the source and target sentences.”
Method(2005) · Cited by 3,125
Supervised Sequence Labelling with Recurrent Neural Networks
Graves, A. (2012) · Studies in Computational Intelligence · doi:10.1007/978-3-642-24797-2 · Cited by 3,120
Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition
Dahl, G. E., Yu, D., Deng, L., & Acero, A. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2134090 · Cited by 3,011 · cited 1×
“Deep neural networks have shown great success in various applications such as objection recognition (see, e.g., (Krizhevsky et al., 2012)) and speech recognition (see, e.g., (Dahl et al., 2012)).”
BackgroundRecurrent Continuous Translation Models
Kalchbrenner, N., & Blunsom, P. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1176 · Cited by 1,232 · cited 1×
“The closest approach related to the proposed RNN Encoder–Decoder is the Recurrent Continuous Translation Model (Model 2) proposed in (Kalchbrenner and Blunsom, 2013).”
Method
Cited by
Items 801–900 of 1,296
Multimodal Recurrent Model with Attention for Automated Radiology Report Generation
Xue, Y., Xu, T., Rodney Long, L., Xue, Z., Antani, S., Thoma, G. R., & Huang, X. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-00928-1_52 · Cited by 213
Summarizing Videos with Attention
Fajtl, J., Sokeh, H. S., Argyriou, V., Monekosso, D., & Remagnino, P. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-21074-8_4 · Cited by 213
Hramov, A. E., Maksimenko, V. A., & Pisarchik, A. N. (2021) · Physics Reports · doi:10.1016/j.physrep.2021.03.002 · Cited by 213
A Hybrid Method for Traffic Flow Forecasting Using Multimodal Deep Learning
Du, S., Li, T., Gong, X., & Horng, S. (2020) · International Journal of Computational Intelligence Systems · doi:10.2991/ijcis.d.200120.001 · Cited by 227
Multistep short-term wind speed forecasting using transformer
Wu, H., Meng, K., Fan, D., Zhang, Z., & Liu, Q. (2022) · Energy · doi:10.1016/j.energy.2022.125231 · Cited by 228
Evaluation of Machine Learning Algorithms for Anomaly Detection
Elmrabit, N., Zhou, F., Li, F., & Zhou, H. (2020) · 2020 International Conference on Cyber Security and Protection of Digital Services (Cyber Security) · doi:10.1109/cybersecurity49315.2020.9138871 · Cited by 212
A Comparative Study of Bitcoin Price Prediction Using Deep Learning
Ji, S., Kim, J., & Im, H. (2019) · Mathematics · doi:10.3390/math7100898 · Cited by 212
Mei, S., Li, X., Liu, X., Cai, H., & Du, Q. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3102034 · Cited by 212
“While CNN-based methods have made significant progress [44], [45], other deep learning-based methods also attempt to classify HSIs, such as recurrent neural network (RNN), long short-time memory (LSTM) [46], and gated recurrent unit (GRU) [47].”
InfluentialDual Attention Matching for Audio-Visual Event Localization
Wu, Y., Zhu, L., Yan, Y., & Yang, Y. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00639 · Cited by 212
Deep learning for time series forecasting: a survey
Kong, X., Chen, Z., Liu, W., Ning, K., Zhang, L., Muhammad Marier, S., Liu, Y., Chen, Y., & Xia, F. (2025) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-025-02560-w · Cited by 211
Deep Sequence Learning with Auxiliary Information for Traffic Prediction
Liao, B., Zhang, J., Wu, C., McIlwraith, D., Chen, T., Yang, S., Guo, Y., & Wu, F. (2018) · Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3219819.3219895 · Cited by 211
LCF: A Local Context Focus Mechanism for Aspect-Based Sentiment Classification
Zeng, B., Yang, H., Xu, R., Zhou, W., & Han, X. (2019) · Applied Sciences · doi:10.3390/app9163389 · Cited by 211
“RAM [25] adopts multilayer architecture based on bidirectional LSTMs, and each layer contains attention-based aggregation of token features and Gated Recurrent Units (GRU [26]) to learn the sentence features.”
MethodRecurrent Neural Network for Predicting Transcription Factor Binding Sites
Shen, Z., Bao, W., & Huang, D.-S. (2018) · Scientific Reports · doi:10.1038/s41598-018-33321-1 · Cited by 211
“…layer can be initialized through a pre-trained algorithm, and some algorithms have been proposed based on neural networks 70 , dimensionality reduction on the word co-occurrence matrix 72 , probabilistic models 82 , and explicit representation in terms of the context in which words appear 83 .”
MethodA Label Attention Model for ICD Coding from Clinical Text
Vu, T., Nguyen, D. Q., & Nguyen, A. N. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/461 · Cited by 282
Attention Correctness in Neural Image Captioning
Liu, C., Mao, J., Sha, F., & Yuille, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11197 · Cited by 210
Riegler, G., & Koltun, V. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58529-7_37 · Cited by 210
Bouchabou, D., Nguyen, S. M., Lohr, C., LeDuc, B., & Kanellos, I. (2021) · Sensors · doi:10.3390/s21186037 · Cited by 210
“To avoid this problem, two RNN variations have been proposed, the Long Short Term Memory (LSTM) [58] and Gated Recurrent Unit (GRU) [59], which is a simplification of the LSTM. Liciotti et al., in Reference [14], studied different LSTM structures on activity recognition.”
MethodRepresenting Schema Structure with Graph Neural Networks for Text-to-SQL Parsing
Bogin, B., Berant, J., & Gardner, M. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1448 · Cited by 210
DGL-LifeSci: An Open-Source Toolkit for Deep Learning on Graphs in Life Science
Li, M., Zhou, J., Hu, J., Fan, W., Zhang, Y., Gu, Y., & Karypis, G. (2021) · ACS Omega · doi:10.1021/acsomega.1c04017 · Cited by 210
Sentiment Analysis by Capsules
Wang, Y., Sun, A., Han, J., Liu, Y., & Zhu, X. (2018) · Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18 · doi:10.1145/3178876.3186015 · Cited by 210
Exploiting Semantics in Neural Machine Translation with Graph Convolutional Networks
Marcheggiani, D., Bastings, J., & Titov, I. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers) · doi:10.18653/v1/n18-2078 · Cited by 209
“cannot be processed in a bottom-up fashion as in Eriguchi et al. (2016) or easily linearized as in Aharoni and Goldberg (2017).”
BackgroundOn the use of deep learning in software defect prediction
Giray, G., Bennin, K. E., Köksal, Ö., Babur, Ö., & Tekinerdogan, B. (2023) · Journal of Systems and Software · doi:10.1016/j.jss.2022.111537 · Cited by 209
Deep Learning for Load Forecasting: Sequence to Sequence Recurrent Neural Networks With Attention
Sehovac, L., & Grolinger, K. (2020) · IEEE Access · doi:10.1109/access.2020.2975738 · Cited by 209
Liu, Y., Qin, H., Zhang, Z., Pei, S., Jiang, Z., Feng, Z., & Zhou, J. (2020) · Applied Energy · doi:10.1016/j.apenergy.2019.114259 · Cited by 209
Object-Centric Learning with Slot Attention
Locatello, F., Weissenborn, D., Unterthiner, T., Mahendran, A., Heigold, G., Uszkoreit, J., Dosovitskiy, A., & Kipf, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.15055 · Cited by 208
PhaseLink: A Deep Learning Approach to Seismic Phase Association
Ross, Z. E., Yue, Y., Meier, M., Hauksson, E., & Heaton, T. H. (2019) · Journal of Geophysical Research: Solid Earth · doi:10.1029/2018jb016674 · Cited by 208
“In recent years, another variant called the gated recurrent unit (GRU) [6] has become popular because it has only two gates instead of three, resulting in fewer parameters and faster training.”
BackgroundWhat and How Well You Performed? A Multitask Learning Approach to Action Quality Assessment
Parmar, P., & Morris, B. T. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00039 · Cited by 208
Variational Neural Machine Translation
Zhang, B., Xiong, D., su, J., Duan, H., & Zhang, M. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1050 · Cited by 208
“…encoder - decoder framework, where a neural encoder transforms source sentence x into a distributed representation, and a neural decoder generates the corresponding target sentence y according to the distributed representation 1 (Cho et al., 2014; Sutskever et al., 2014; Bahdanau et al., 2014).”
BackgroundMethodInfluentialCharacter-level neural network for biomedical named entity recognition
Gridach, M. (2017) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.05.002 · Cited by 208
Insights Into LSTM Fully Convolutional Networks for Time Series Classification
Karim, F., Majumdar, S., & Darabi, H. (2019) · IEEE Access · doi:10.1109/access.2019.2916828 · Cited by 208
Copied Monolingual Data Improves Low-Resource Neural Machine Translation
Currey, A., Miceli Barone, A. V., & Heafield, K. (2017) · Proceedings of the Second Conference on Machine Translation · doi:10.18653/v1/w17-4715 · Cited by 208
“We evaluate our approach using sequence-to-sequence neural machine translation (Cho et al., 2014; Kalchbrenner and Blunsom, 2013; Sutskever et al., 2014) augmented with attention (Bahdanau et al., 2015).”
MethodEvaluation of Text Generation: A Survey
Celikyilmaz, A., Clark, E., & Gao, J. (2020) · arXiv · doi:10.48550/arxiv.2006.14799 · Cited by 207
“…neural networks (Graves, 2013) (e.g., long-short term memory networks (LSTM) (Hochreiter & Schmidhuber, 1997), gated recurrent units (GRUs) (Cho et al., 2014), etc.) for learning language representations, such as word2vec (Mikolov et al., 2013) and GloVe (Pennington et al., 2014), and…”
BackgroundA Gated Recurrent Unit Approach to Bitcoin Price Prediction
Dutta, A., Kumar, S., & Basu, M. (2020) · Journal of Risk and Financial Management · doi:10.3390/jrfm13020023 · Cited by 207
DeepTraLog: trace-log combined microservice anomaly detection through graph-based deep learning
Zhang, C., Peng, X., Sha, C., Zhang, K., Fu, Z., Wu, X., Lin, Q., & Zhang, D. (2022) · Proceedings of the 44th International Conference on Software Engineering · doi:10.1145/3510003.3510180 · Cited by 207
Neural Sign Language Translation Based on Human Keypoint Estimation
Ko, S.-K., Kim, C. J., Jung, H., & Cho, C. (2019) · Applied Sciences · doi:10.3390/app9132683 · Cited by 207
On Learning Meaningful Code Changes Via Neural Machine Translation
Tufano, M., Pantiuchina, J., Watson, C., Bavota, G., & Poshyvanyk, D. (2019) · 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2019.00021 · Cited by 207
“3) Hyperparameter Search: We tested ten configurations of the encoder-decoder architecture with different combinations of RNN Cells (LSTM [45] and GRU [33]), number of layers (1, 2, 4) and units (256, 512) for the encoder/decoder, and the embedding size (256, 512).”
MethodNOA-LSTM: An efficient LSTM cell architecture for time series forecasting
Yadav, H., & Thakkar, A. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122333 · Cited by 207
Zhang, Y.-G., Tang, J., He, Z.-Y., Tan, J., & Li, C. (2021) · Natural Hazards · doi:10.1007/s11069-020-04337-6 · Cited by 207
Cui, Z., Kang, L., Li, L., Wang, L., & Wang, K. (2022) · Energy · doi:10.1016/j.energy.2022.124933 · Cited by 207
Advances in Facial Expression Recognition: A Survey of Methods, Benchmarks, Models, and Datasets
Kopalidis, T., Solachidis, V., Vretos, N., & Daras, P. (2024) · Information · doi:10.3390/info15030135 · Cited by 251
Exploring Spatial Context for 3D Semantic Segmentation of Point Clouds
Engelmann, F., Kontogianni, T., Hermans, A., & Leibe, B. (2017) · 2017 IEEE International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw.2017.90 · Cited by 206
Bridging the Gap between Training and Inference for Neural Machine Translation
Zhang, W., Feng, Y., Meng, F., You, D., & Liu, Q. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1426 · Cited by 206
Dibia, V., & Demiralp, C. (2019) · IEEE Computer Graphics and Applications · doi:10.1109/mcg.2019.2924636 · Cited by 206
Short‐Term Precipitation Forecast Based on the PERSIANN System and LSTM Recurrent Neural Networks
Akbari Asanjan, A., Yang, T., Hsu, K., Sorooshian, S., Lin, J., & Peng, Q. (2018) · Journal of Geophysical Research: Atmospheres · doi:10.1029/2018jd028375 · Cited by 206
Text Recognition in the Wild: A Survey
Chen, X., Jin, L., Zhu, Y., Luo, C., & Wang, T. (2022) · ACM Computing Surveys · doi:10.1145/3440756 · Cited by 205
“m decoding step size. At the t-th step, the output prediction o tis given by: o t= Softmax(W os t+b o); (2) where s tis the hidden state of RNN at time step t. Typically, a gated recurrent unit (GRU) [191] is used to update s tand model the longterm dependencies. Hence, s tis computed as s t= GRU(o prev;g t;s t 1); (3…”
BackgroundMethodConstructing Narrative Event Evolutionary Graph for Script Event Prediction
Li, Z., Ding, X., & Liu, T. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/584 · Cited by 205
Deldjoo, Y., Noia, T. D., & Merra, F. A. (2022) · ACM Computing Surveys · doi:10.1145/3439729 · Cited by 204
Analysis of Gradient Vanishing of RNNs and Performance Comparison
Noh, S.-H. (2021) · Information · doi:10.3390/info12110442 · Cited by 203
Deep learning for air pollutant concentration prediction: A review
Zhang, B., Rong, Y., Yong, R., Qin, D., Li, M., Zou, G., & Pan, J. (2022) · Atmospheric Environment · doi:10.1016/j.atmosenv.2022.119347 · Cited by 203
Dual Encoding for Video Retrieval by Text
Dong, J., Li, X., Xu, C., Yang, X., Yang, G., Wang, X., & Wang, M. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3059295 · Cited by 203
Deep Learning for Hand Gesture Recognition on Skeletal Data
Devineau, G., Moutarde, F., Xi, W., & Yang, J. (2018) · 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) · doi:10.1109/fg.2018.00025 · Cited by 203
Search-based Neural Structured Learning for Sequential Question Answering
Iyyer, M., Yih, W.-T., & Chang, M.-W. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1167 · Cited by 203
“However, module selection in NP is computed via soft attention (Cho et al., 2014), and information is propagated from one module to the next using a recurrent neural network.”
BackgroundMethodCao, R., Freitas, C., Chan, L., Sun, M., Jiang, H., & Chen, Z. (2017) · Molecules · doi:10.3390/molecules22101732 · Cited by 203
“The neural machine translation model based on two recurrent neural networks is used to solve the language translation problem [57, 58].”
MethodEmerging trends in federated learning: from model fusion to federated X learning
Ji, S., Tan, Y., Saravirta, T., Yang, Z. Q., Liu, Y., Vasankari, L., Pan, S., Long, G., & Walid, A. (2024) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-024-02119-1 · Cited by 238
Retrieve, Rerank and Rewrite: Soft Template Based Neural Summarization
Cao, Z., Li, W., Li, S., & Wei, F. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1015 · Cited by 202
Syntactic Structure from Deep Learning
Linzen, T., & Baroni, M. (2021) · Annual Review of Linguistics · doi:10.1146/annurev-linguistics-032020-051035 · Cited by 202
Realistic fault detection of li-ion battery via dynamical deep learning
Zhang, J., Wang, Y., Jiang, B., He, H., Huang, S., Wang, C., Zhang, Y., Han, X., Guo, D., He, G., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-41226-5 · Cited by 202
Diehl, P. U., Zarrella, G., Cassidy, A., Pedroni, B. U., & Neftci, E. (2016) · 2016 IEEE International Conference on Rebooting Computing (ICRC) · doi:10.1109/icrc.2016.7738691 · Cited by 202
Chung, Y.-A., Wu, C.-C., Shen, C.-H., Lee, H.-Y., & Lee, L.-S. (2016) · Interspeech 2016 · doi:10.21437/interspeech.2016-82 · Cited by 202
“Because many amazing results were achieved by LSTM, RNN has widely been equipped with LSTM units [25, 26, 27, 28, 22, 29, 30].”
MethodResultInfluentialVisual to Sound: Generating Natural Sound for Videos in the Wild
Zhou, Y., Wang, Z., Fang, C., Bui, T., & Berg, T. L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00374 · Cited by 201
Unsupervised Representation Learning With Long-Term Dynamics for Skeleton Based Action Recognition
Zheng, N., Wen, J., Liu, R., Long, L., Dai, J., & Gong, Z. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11853 · Cited by 201
“Comparing with the Long Short-Term Memory (LSTMs) (Hochreiter and Schmidhuber 1997), the Gated Recurrent Units (GRUs) (Cho et al. 2014) is easier to train and has fewer parameters.”
MethodIs Neural Machine Translation the New State of the Art?
Castilho, S., Moorkens, J., Gaspari, F., Calixto, I., Tinsley, J., & Way, A. (2017) · The Prague Bulletin of Mathematical Linguistics · doi:10.1515/pralin-2017-0013 · Cited by 201
Paraphrase Generation with Deep Reinforcement Learning
Li, Z., Jiang, X., Shang, L., & Li, H. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1421 · Cited by 201
“…(Seq2Seq) learning has made remarkable success in various NLP tasks, including machine translation, short-text conversation, text summarization, and question answering (e.g., Cho et al. (2014); Wu et al. (2016); Shang et al. (2015); Vinyals and Le (2015); Rush et al. (2015); Yin et al. (2016)).”
BackgroundMethodLanguage Models for Image Captioning: The Quirks and What Works
Devlin, J., Cheng, H., Fang, H., Gupta, S., Deng, L., He, X., Zweig, G., & Mitchell, M. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 2: Short Papers) · doi:10.3115/v1/p15-2017 · Cited by 201
“The fc7 vector is then fed into a hidden layer H to obtain a 500- dimensional representation that serves as the initial hidden state to a gated recurrent neural network (GRNN) (?).”
MethodInfluentialDatta, S. D., Islam, M., Rahman Sobuz, M. H., Ahmed, S., & Kar, M. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e26888 · Cited by 200
Personalized re-ranking for recommendation
Pei, C., Zhang, Y., Zhang, Y., Sun, F., Lin, X., Sun, H., Wu, J., Jiang, P., Ge, J., Ou, W., et al. (2019) · Proceedings of the 13th ACM Conference on Recommender Systems · doi:10.1145/3298689.3347000 · Cited by 200
Deep learning for urban land use category classification: A review and experimental assessment
Li, Z., Chen, B., Wu, S., Su, M., Chen, J. M., & Xu, B. (2024) · Remote Sensing of Environment · doi:10.1016/j.rse.2024.114290 · Cited by 200
Applying deep learning approaches for network traffic prediction
Vinayakumar, R., Soman, K. P., & Poornachandran, P. (2017) · 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI) · doi:10.1109/icacci.2017.8126198 · Cited by 200
“With the aim to reduce the computational cost of LSTM, [16] introduced GRU.”
BackgroundInfluentialDeep Neural Networks in Machine Translation: An Overview
Zhang, J., & Zong, C. (2015) · IEEE Intelligent Systems · doi:10.1109/mis.2015.69 · Cited by 200
A Comparison of LSTM and GRU Networks for Learning Symbolic Sequences
Cahuantzi, R., Chen, X., & Güttel, S. (2023) · Lecture Notes in Networks and Systems · doi:10.1007/978-3-031-37963-5_53 · Cited by 199
“In this case the resulting array is [1, 2, 4, 3, 5, 8] corresponding to an LZW complexity of 6.”
BackgroundMethodTransPolymer: a Transformer-based language model for polymer property predictions
Xu, C., Wang, Y., & Barati Farimani, A. (2023) · npj Computational Materials · doi:10.1038/s41524-023-01016-5 · Cited by 199
Explainable and Interpretable Models in Computer Vision and Machine Learning
(2018) · The Springer Series on Challenges in Machine Learning · doi:10.1007/978-3-319-98131-4 · Cited by 199
“, 2012), language translation (Cho et al., 2014), and reinforcement learning (Silver et al.”
Deep Source-Channel Coding for Sentence Semantic Transmission With HARQ
Jiang, P., Wen, C.-K., Jin, S., & Li, G. Y. (2022) · IEEE Transactions on Communications · doi:10.1109/tcomm.2022.3180997 · Cited by 199
A Spatial–Temporal Attention Approach for Traffic Prediction
Shi, X., Qi, H., Shen, Y., Wu, G., & Yin, B. (2021) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2020.2983651 · Cited by 199
Chargrid: Towards Understanding 2D Documents
Katti, A. R., Reisswig, C., Guder, C., Brarda, S., Bickel, S., Höhne, J., & Faddoul, J. B. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1476 · Cited by 199
“It is a stack of bi-directional GRUs (Cho et al., 2014) taking a sequence of characters as input, and producing a sequence of labels as output.”
BackgroundMachine learning toward advanced energy storage devices and systems
Gao, T., & Lu, W. (2021) · iScience · doi:10.1016/j.isci.2020.101936 · Cited by 199
Hierarchical Boundary-Aware Neural Encoder for Video Captioning
Baraldi, L., Grana, C., & Cucchiara, R. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.339 · Cited by 216
RAPID: Early Classification of Explosive Transients Using Deep Learning
Muthukrishna, D., Narayan, G., Mandel, K. S., Biswas, R., & Hložek, R. (2019) · Publications of the Astronomical Society of the Pacific · doi:10.1088/1538-3873/ab1609 · Cited by 229
The Modern Mathematics of Deep Learning
Berner, J., Grohs, P., Kutyniok, G., & Petersen, P. (2022) · Cambridge University Press eBooks · doi:10.1017/9781009025096.002 · Cited by 234
Adversarial Generation of Natural Language
Subramanian, S., Rajeswar, S., Dutil, F., Pal, C., & Courville, A. (2017) · Proceedings of the 2nd Workshop on Representation Learning for NLP · doi:10.18653/v1/w17-2629 · Cited by 112
PyTorch Geometric Temporal: Spatiotemporal Signal Processing with Neural Machine Learning Models
Rózemberczki, B., Scherer, P., He, Y., Panagopoulos, G., Riedel, A., Astefanoaei, M., Kiss, O., Béres, F., López, G., Collignon, N., et al. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482014 · Cited by 338
DeepRank: A New Deep Architecture for Relevance Ranking in Information Retrieval
Pang, L., Lan, Y., Guo, J., Xu, J., Xu, J., & Cheng, X. (2017) · Proceedings of the 2017 ACM on Conference on Information and Knowledge Management · doi:10.1145/3132847.3132914 · Cited by 197
Intelligent financial fraud detection practices in post-pandemic era
Zhu, X., Ao, X., Qin, Z., Chang, Y., Liu, Y., He, Q., & Li, J. (2021) · The Innovation · doi:10.1016/j.xinn.2021.100176 · Cited by 197
Zogan, H., Razzak, I., Wang, X., Jameel, S., & Xu, G. (2022) · World Wide Web · doi:10.1007/s11280-021-00992-2 · Cited by 197
“– BiGRU:We applied Bidirectional Gated Recurrent Unit [7] with attention mechanism to obtain user tweets representations, which we then used for user tweets classification.”
MethodLearning Joint Multilingual Sentence Representations with Neural Machine Translation
Schwenk, H., & Douze, M. (2017) · Proceedings of the 2nd Workshop on Representation Learning for NLP · doi:10.18653/v1/w17-2619 · Cited by 197
“A very successful application of this paradigm is neural machine translation (NMT), see for instance (Kalchbrenner and Blunsom, 2013; Cho et al., 2014; Sutskever et al., 2014).”
BackgroundSelf-citationEstimating Electric Motor Temperatures With Deep Residual Machine Learning
Kirchgassner, W., Wallscheid, O., & Bocker, J. (2021) · IEEE Transactions on Power Electronics · doi:10.1109/tpel.2020.3045596 · Cited by 197
Conditional Molecular Design with Deep Generative Models
Kang, S., & Cho, K. (2019) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.8b00263 · Cited by 197
Self-citationVery short-term forecasting of wind power generation using hybrid deep learning model
Hossain, M. A., Chakrabortty, R. K., Elsawah, S., & Ryan, M. J. (2021) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2021.126564 · Cited by 197
Neural Sequence Learning Models for Word Sense Disambiguation
Raganato, A., Delli Bovi, C., & Navigli, R. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1120 · Cited by 197
“We also plan to exploit the flexibility of our models by integrating them into downstream applications, such as Machine Translation and Information Extraction.”
MethodInfluentialBridging Knowledge Graphs to Generate Scene Graphs
Zareian, A., Karaman, S., & Chang, S.-F. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58592-1_36 · Cited by 196
Evaluation of Deep Learning Techniques in Sentiment Analysis from Twitter Data
Goularas, D., & Kamis, S. (2019) · 2019 International Conference on Deep Learning and Machine Learning in Emerging Applications (Deep-ML) · doi:10.1109/deep-ml.2019.00011 · Cited by 196
Self-Training for End-to-End Speech Recognition
Kahn, J., Lee, A., & Hannun, A. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9054295 · Cited by 196
Unleashing the power of generative AI in drug discovery
Gangwal, A., & Lavecchia, A. (2024) · Drug Discovery Today · doi:10.1016/j.drudis.2024.103992 · Cited by 195
A Survey of Event Extraction From Text
Xiang, W., & Wang, B. (2019) · IEEE Access · doi:10.1109/access.2019.2956831 · Cited by 195
Space-Time-Separable Graph Convolutional Network for Pose Forecasting
Sofianos, T., Sampieri, A., Franco, L., & Galasso, F. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01102 · Cited by 195
“While several other sequence modelling options are available, including LSTM [20], GRU [12] and Transformer Networks [17], here we adopt TCNs for their simplicity and robustness, further to satisfactory performance [30].”
Tian, J., Chen, C., Shen, W., Sun, F., & Xiong, R. (2023) · Energy Storage Materials · doi:10.1016/j.ensm.2023.102883 · Cited by 195
Machine learning for site-adaptation and solar radiation forecasting
Narvaez, G., Giraldo, L. F., Bressan, M., & Pantoja, A. (2021) · Renewable Energy · doi:10.1016/j.renene.2020.11.089 · Cited by 195
AliMe Chat: A Sequence to Sequence and Rerank based Chatbot Engine
Qiu, M., Li, F.-L., Wang, S., Gao, X., Chen, Y., Zhao, W., Chen, H., Huang, J., & Chu, W. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p17-2079 · Cited by 195
Naseem, U., Razzak, I., Khan, S. K., & Prasad, M. (2021) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3434237 · Cited by 194
Deep Learning Approaches on Image Captioning: A Review
Ghandi, T., Pourreza, H., & Mahyar, H. (2024) · ACM Computing Surveys · doi:10.1145/3617592 · Cited by 194
“While the middle component contains LSTM [ 51 ] or GRU [ 19 ] units in other methods, masked convolutions are used in the proposed approach.”
Method
Metadata
- Authors
- Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y.
- Affiliations
- Le Mans Université (FR)
- Polytechnique Montréal (CA)
- Venue
- Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)
- Published
- 2014
- Pages
- 1724-1734
- OpenAlex
- W2157331557
- Cited by
- 25,545
- References
- 31
- Citations by year
- 2026: 1895 · 2025: 2591 · 2024: 2721 · 2023: 3047 · 2022: 3245 · 2021: 3534 · 2020: 3063 · 2019: 2494 · 2018: 1644 · 2017: 816 · 2016: 349 · 2015: 119 · 2014: 22
- FWCI
- 256.40
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- HAL (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Keywords
- statistical machine translation, neural machine translation, phrase embeddings, sequence-to-sequence models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.