Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Open accessThe DOI matches its Crossref record; 29 of the 31 references it cites were found in a registry or an index.
Abstract
Kyunghyun Cho, Bart van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, Yoshua Bengio. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). 2014.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“GRU [185] is a variant based on the LSTM, which only contains an update gate and reset gate and has a faster training speed than the LSTM with fewer parameters.”
From Deep Learning for Structural Health Monitoring: Data, Algorithms, Applications, Challenges, and Trends (2023) · cites this paper as [185]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“They are thus well-suited for detecting dependencies and patterns in language-like input.”
From The role of pragmatic mechanisms in referential communication and categorization: An emergent communication model (2026) · cites this paper as [87]
The cited source says what the claim attributes to it.
In the citing paper
“GRU cells are a specific type of Recurrent Neural Networks (RNNs) which have been proven useful for dealing with sequence data such as language.”
From The role of pragmatic mechanisms in referential communication and categorization: An emergent communication model (2026) · cites this paper as [87]
The cited source says what the claim attributes to it.
In the citing paper
“Early work [139-141] mainly relied on recurrent neural networks (e.g., LSTM [142], GRU [143]). Limited by the model's expressiveness, they often suffer from the issue of insufficient diversity.”
From When large language models meet personalization: perspectives of challenges and opportunities (2024) · cites this paper as [143]
The cited source says what the claim attributes to it.
In the citing paper
“Moreover, [Tang et al., 2020] adopts GRU [Cho et al., 2014] on the sequence of hyperplanes to further capture the dynamics among hyperplanes.”
From Temporal Knowledge Graph Completion: A Survey (2023) · cites this paper as Cho et al., 2014
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 1×
“At each time step t , the hidden state h t (cid:105) of the RNN is updated by where f is a non-linear activation function. f may be as simple as an element-wise logistic sigmoid function and as complex as a long short-term memory (LSTM) unit (Hochreiter and Schmidhuber, 1997).”
BackgroundDistributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533 · cited 1×
“We have done so by applying the data selection method proposed in (Moore and Lewis, 2010), and its extension to bi-texts (Axelrod et al., 2011).”
Method(2011) · Cited by 6,993
Self-citationADADELTA: An Adaptive Learning Rate Method
Zeiler, M. D. (2012) · arXiv · doi:10.48550/arxiv.1212.5701 · Cited by 5,322 · cited 2×
“95 (Zeiler, 2012).”
MethodStatistical phrase-based translation
Koehn, P., Och, F. J., & Marcu, D. (2003) · Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - NAACL '03 · doi:10.3115/1073445.1073462 · Cited by 3,197 · cited 2×
“In the phrase-based SMT framework introduced in (Koehn et al., 2003) and (Marcu and Wong, 2002), the translation model log p ( e | f ) is factorized into the translation probabilities of matching phrases in the source and target sentences.”
Method(2005) · Cited by 3,125
Supervised Sequence Labelling with Recurrent Neural Networks
Graves, A. (2012) · Studies in Computational Intelligence · doi:10.1007/978-3-642-24797-2 · Cited by 3,120
Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition
Dahl, G. E., Yu, D., Deng, L., & Acero, A. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2134090 · Cited by 3,011 · cited 1×
“Deep neural networks have shown great success in various applications such as objection recognition (see, e.g., (Krizhevsky et al., 2012)) and speech recognition (see, e.g., (Dahl et al., 2012)).”
BackgroundRecurrent Continuous Translation Models
Kalchbrenner, N., & Blunsom, P. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1176 · Cited by 1,232 · cited 1×
“The closest approach related to the proposed RNN Encoder–Decoder is the Recurrent Continuous Translation Model (Model 2) proposed in (Kalchbrenner and Blunsom, 2013).”
Method
Cited by
Items 501–600 of 1,296
A Character-level Decoder without Explicit Segmentation for Neural Machine Translation
Chung, J., Cho, K., & Bengio, Y. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1160 · Cited by 309
Self-citationCombining Graph-Based Learning With Automated Data Collection for Code Vulnerability Detection
Wang, H., Ye, G., Tang, Z., Tan, S. H., Huang, S., Fang, D., Feng, Y., Bian, L., & Wang, Z. (2021) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2020.3044773 · Cited by 308
Deep Learning Methods for Vessel Trajectory Prediction Based on Recurrent Neural Networks
Capobianco, S., Millefiori, L. M., Forti, N., Braca, P., & Willett, P. (2021) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.2021.3096873 · Cited by 307
An improved similarity-based prognostic algorithm for RUL estimation using an RNN autoencoder scheme
Yu, W., Kim, I. Y., & Mechefske, C. (2020) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2020.106926 · Cited by 307
A Challenge Dataset and Effective Models for Aspect-Based Sentiment Analysis
Jiang, Q., Chen, L., Xu, R., Ao, X., & Yang, M. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1654 · Cited by 306
Rajagukguk, R. A., Ramadhan, R. A. A., & Lee, H.-J. (2020) · Energies · doi:10.3390/en13246623 · Cited by 306
“The Hybrid Model (CNN–LSTM) CNN is a deep learning algorithm by considering spatial inputs. neurons have learnable weights and biases.”
Ask the GRU: Multi-task Learning for Deep Text Recommendations
Bansal, T., Belanger, D., & McCallum, A. (2016) · Proceedings of the 10th ACM Conference on Recommender Systems · doi:10.1145/2959100.2959180 · Cited by 306
A gentle introduction to deep learning for graphs
Bacciu, D., Errica, F., Micheli, A., & Podda, M. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.06.006 · Cited by 305
Gated Neural Networks for Targeted Sentiment Analysis
Zhang, M., Zhang, Y., & Vo, D.-T. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10380 · Cited by 304
Lynn, H. M., Pan, S. B., & Kim, P. (2019) · IEEE Access · doi:10.1109/access.2019.2939947 · Cited by 304
Lexically Constrained Decoding for Sequence Generation Using Grid Beam Search
Hokamp, C., & Liu, Q. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1141 · Cited by 303
Zero-Shot Video Object Segmentation via Attentive Graph Neural Networks
Wang, W., Lu, X., Shen, J., Crandall, D., & Shao, L. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00933 · Cited by 303
Han, W., Zhang, X., Wang, Y., Wang, L., Huang, X., Li, J., Wang, S., Chen, W., Li, X., Feng, R., et al. (2023) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2023.05.032 · Cited by 303
NExT-QA: Next Phase of Question-Answering to Explaining Temporal Actions
Xiao, J., Shang, X., Yao, A., & Chua, T.-S. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00965 · Cited by 302
Multi-Agent Trajectory Prediction With Heterogeneous Edge-Enhanced Graph Attention Network
Mo, X., Huang, Z., Xing, Y., & Lv, C. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3146300 · Cited by 302
A Review on Deep Learning Techniques for Video Prediction
Oprea, S., Martinez-Gonzalez, P., Garcia-Garcia, A., Castro-Vargas, J. A., Orts-Escolano, S., Garcia-Rodriguez, J., & Argyros, A. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2020.3045007 · Cited by 301
Seo, H., Badiei Khuzani, M., Vasudevan, V., Huang, C., Ren, H., Xiao, R., Jia, X., & Xing, L. (2020) · Medical Physics · doi:10.1002/mp.13649 · Cited by 300
“Especially, for segmentation of dynamic imaging, combination of CNN and RNN can be good solution due to joint modeling of spatial and temporal information 101 .”
BackgroundInfluentialDoes String-Based Neural MT Learn Source Syntax?
Shi, X., Padhi, I., & Knight, K. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1159 · Cited by 300
A Unified Generative Framework for Various NER Subtasks
Yan, H., Gui, T., Dai, J., Guo, Q., Zhang, Z., & Qiu, X. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.451 · Cited by 299
“The Seq2Seq framework has been long studied and adopted in NLP (Sutskever et al., 2014; Cho et al., 2014; Luong et al., 2015; Vaswani et al., 2017; Vinyals et al., 2015).”
MethodDevice Placement Optimization with Reinforcement Learning
Mirhoseini, A., Pham, H., Le, Q. V., Steiner, B., Larsen, R., Zhou, Y., Kumar, N., Norouzi, M., Bengio, S., & Dean, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.04972 · Cited by 299
Zhang, Z., Ye, L., Qin, H., Liu, Y., Wang, C., Yu, X., Yin, X., & Li, J. (2019) · Applied Energy · doi:10.1016/j.apenergy.2019.04.047 · Cited by 299
Attention, please! A survey of neural attention models in deep learning
de Santana Correia, A., & Colombini, E. L. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10148-x · Cited by 298
A Unified Generative Framework for Aspect-based Sentiment Analysis
Yan, H., Dai, J., Ji, T., Qiu, X., & Zhang, Z. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.188 · Cited by 298
HiPPO: Recurrent Memory with Optimal Polynomial ProjectionsPreprint
Gu, A., Dao, T., Ermon, S., Rudra, A., & Ré, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.07669 · Cited by 628
“[16] Kyunghyun Cho, Bart Van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio.”
BackgroundA survey on deep learning-based non-invasive brain signals: recent advances and new frontiers
Zhang, X., Yao, L., Wang, X., Monaghan, J., McAlpine, D., & Zhang, Y. (2021) · Journal of Neural Engineering · doi:10.1088/1741-2552/abc902 · Cited by 296
“Another widely used RNN architecture is GRU [256].”
A Review of Current Trends, Techniques, and Challenges in Large Language Models (LLMs)
Patil, R., & Gudivada, A. V. (2024) · doi:10.20944/preprints202402.0357.v1 · Cited by 296
Order-Embeddings of Images and Language
Vendrov, I., Kiros, R., Fidler, S., & Urtasun, R. (2015) · arXiv · doi:10.48550/arxiv.1511.06361 · Cited by 296
“To embed the captions, we use a recurrent neural net encoder with GRU activations (Cho et al., 2014), so f c ( c ) = | GRU ( c ) | , the absolute value of hidden state after processing the last word.”
MethodDeep Recurrent Neural Network for Intrusion Detection in SDN-based Networks
Tang, T. A., Mhamdi, L., McLernon, D., Zaidi, S. A. R., & Ghogho, M. (2018) · 2018 4th IEEE Conference on Network Softwarization and Workshops (NetSoft) · doi:10.1109/netsoft.2018.8460090 · Cited by 296
“Long Short Term Memory (LSTM) [20] networks and Gated Recurrent Units (GRUs) [21] were proposed to solve this problem.”
BackgroundStoll, S., Camgoz, N. C., Hadfield, S., & Bowden, R. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01281-2 · Cited by 296
“Seq2seq [52,10] has seen success in translating between spoken languages.”
BackgroundCTNet: Conversational Transformer Network for Emotion Recognition
Lian, Z., Liu, B., & Tao, J. (2021) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2021.3049898 · Cited by 296
“This model learns separate contexts for both speaker and listener using two distinct GRUs [52].”
BackgroundMethodInfluentialWang, B., Lei, Y., Yan, T., Li, N., & Guo, L. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.10.064 · Cited by 296
Wang, Y., Hu, M., Zhou, Y., Li, Q., Yao, N., Zhai, G., Zhang, X.-P. S., & Yang, X. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2991456 · Cited by 300
Deep generative molecular design reshapes drug discovery
Zeng, X., Wang, F., Luo, Y., Kang, S.-G., Tang, J., Lightstone, F. C., Fang, E. F., Cornell, W., Nussinov, R., & Cheng, F. (2022) · Cell Reports Medicine · doi:10.1016/j.xcrm.2022.100794 · Cited by 295
Text Understanding with the Attention Sum Reader Network
Kadlec, R., Schmid, M., Bajgar, O., & Kleindienst, J. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1086 · Cited by 295
Kwon, B. C., Choi, M.-J., Kim, J. T., Choi, E., Kim, Y. B., Kwon, S., Sun, J., & Choo, J. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2865027 · Cited by 294
Decoupled Attention Network for Text Recognition
Wang, T., Zhu, Y., Jin, L., Luo, C., Chen, X., Wu, Y., Wang, Q., & Cai, M. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6903 · Cited by 294
DiPietro, R., & Hager, G. D. (2020) · Handbook of Medical Image Computing and Computer Assisted Intervention · doi:10.1016/b978-0-12-816176-0.00026-0 · Cited by 293
Miao, H., Li, B., Sun, C., & Liu, J. (2019) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2019.2900295 · Cited by 293
“2(b)] is a simplified version of the LSTM architecture introduced in 2014 [30].”
BackgroundDeep learning for time series forecasting: The electric load case
Gasparin, A., Lukovic, S., & Alippi, C. (2022) · CAAI Transactions on Intelligence Technology · doi:10.1049/cit2.12060 · Cited by 293
Manoharan, A., Begam, K. M., Aparow, V. R., & Sooriamoorthy, D. (2022) · Journal of Energy Storage · doi:10.1016/j.est.2022.105384 · Cited by 293
Tracing Fake-News Footprints: Characterizing Social Media Messages by How They Propagate
Wu, L., & Liu, H. (2018) · Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining · doi:10.1145/3159652.3159677 · Cited by 292
Long Short-Term Memory Over Recursive Structures
Zhu, X., Sobihani, P., & Guo, H. (2015) · NPARC · Cited by 386
Gated Recurrent Unit Network-Based Short-Term Photovoltaic Forecasting
Wang, Y., Liao, W., & Chang, Y. (2018) · Energies · doi:10.3390/en11082163 · Cited by 291
Nonlocal Graph Convolutional Networks for Hyperspectral Image Classification
Mou, L., Lu, X., Li, X., & Zhu, X. X. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2020.2973363 · Cited by 291
“Deep learning, which is mainly characterized by deep networks, has been quite successful in solving a wide range of problems (e.g., natural language processing [6]–[8], computer vision [9]–[19], and remote sensing [20], [21]).”
BackgroundFlorence-2: Advancing a Unified Representation for a Variety of Vision Tasks
Xiao, B., Wu, H., Xu, W., Dai, X., Hu, H., Lu, Y., Zeng, M., Liu, C., & Yuan, L. (2024) · 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52733.2024.00461 · Cited by 290
Professor Forcing: A New Algorithm for Training Recurrent Networks
Lamb, A., Goyal, A., Zhang, Y., Zhang, S., Courville, A. C., & Bengio, Y. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.09038 · Cited by 290
Self-citationA Review of Current Trends, Techniques, and Challenges in Large Language Models (LLMs)
Patil, R., & Gudivada, V. (2024) · Applied Sciences · doi:10.3390/app14052074 · Cited by 290
“For example, in [20], the decoder received one single encoded hidden state from the encoder, representing the numerical summary of the input sequence.”
Simple Recurrent Units for Highly Parallelizable Recurrence
Lei, T., Zhang, Y., Wang, S. I., Dai, H., & Artzi, Y. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1477 · Cited by 289
Complex-Valued Neural Networks: A Comprehensive Survey
Lee, C., Hasegawa, H., & Gao, S. (2022) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2022.105743 · Cited by 289
Deep learning for misinformation detection on online social networks: a survey and new perspectives
Islam, M. R., Liu, S., Wang, X., & Xu, G. (2020) · Social Network Analysis and Mining · doi:10.1007/s13278-020-00696-x · Cited by 289
“Authors have proposed different RNN architectures, namely tanh-RNN, LSTM and Gated Recurrent Unit (GRU) (Cho et al. 2014a).”
BackgroundKnowledge-Enriched Transformer for Emotion Detection in Textual Conversations
Zhong, P., Wang, D., & Miao, C. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1016 · Cited by 289
Onan, A. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2022.02.025 · Cited by 289
SegRNN: Segment Recurrent Neural Network for Long-Term Time-Series Forecasting
Lin, S., Lin, W., Wu, W., Zhao, F., Mo, R., & Zhang, H. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3647705 · Cited by 369
Working Memory Connections for LSTM
Landi, F., Baraldi, L., Cornia, M., & Cucchiara, R. (2021) · Neural Networks · doi:10.1016/j.neunet.2021.08.030 · Cited by 288
“As an additional comparison, we replace the LSTM layers with GRU layers.”
BackgroundA Survey of Data Mining and Deep Learning in Bioinformatics
Lan, K., Wang, D.-T., Fong, S., Liu, L.-S., Wong, K. K. L., & Dey, N. (2018) · Journal of Medical Systems · doi:10.1007/s10916-018-1003-9 · Cited by 288
Image Captioning with Deep Bidirectional LSTMs
Wang, C., Yang, H., Bartz, C., & Meinel, C. (2016) · Proceedings of the 24th ACM international conference on Multimedia · doi:10.1145/2964284.2964299 · Cited by 287
3D Recurrent Neural Networks with Context Fusion for Point Cloud Semantic Segmentation
Ye, X., Li, J., Huang, H., Du, L., & Zhang, X. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_25 · Cited by 287
“In specific, each one-dimensional recurrent layer can be simply implemented as multi-LSTMs [33] or GRUs [34], in our work multi-LSTM is adopted.”
BackgroundPerera, Y. S., Ratnaweera, D. A. A. C., Dasanayaka, C. H., & Abeykoon, C. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.105988 · Cited by 286
Multi-Temporal Land Cover Classification with Sequential Recurrent Encoders
Rußwurm, M., & Körner, M. (2018) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi7040129 · Cited by 286
Recurrent Fusion Network for Image Captioning
Jiang, W., Ma, L., Jiang, Y.-G., Liu, W., & Zhang, T. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01216-8_31 · Cited by 286
Oh, K.-J., Lee, D., Ko, B., & Choi, H.-J. (2017) · 2017 18th IEEE International Conference on Mobile Data Management (MDM) · doi:10.1109/mdm.2017.64 · Cited by 285
Clotho: an Audio Captioning Dataset
Drossos, K., Lipping, S., & Virtanen, T. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9052990 · Cited by 285
“The encoder is a series of bi-directional gated recurrent units (bi-GRUs) [11], similarly to [4].”
BackgroundSpectral-Spatial Attention Networks for Hyperspectral Image Classification
Mei, X., Pan, E., Ma, Y., Dai, X., Huang, J., Fan, F., Du, Q., Zheng, H., & Ma, J. (2019) · Remote Sensing · doi:10.3390/rs11080963 · Cited by 285
Pitfalls in Machine Learning for Computer Security
Arp, D., Quiring, E., Pendlebury, F., Warnecke, A., Pierazzi, F., Wressnegger, C., Cavallaro, L., & Rieck, K. (2024) · Communications of the ACM · doi:10.1145/3643456 · Cited by 299
Proceedings of the 19th Python in Science Conference
(2020) · Proceedings of the Python in Science Conference · doi:10.25080/majora-342d178e-02b · Cited by 284
StyleNet: Generating Attractive Visual Captions with Styles
Gan, C., Gan, Z., He, X., Gao, J., & Deng, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.108 · Cited by 283
Where to Go Next: A Spatio-Temporal Gated Network for Next POI Recommendation
Zhao, P., Zhu, H., Liu, Y., Xu, J., Li, Z., Zhuang, F., Sheng, V. S., & Zhou, X. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33015877 · Cited by 283
“• GRU (Cho et al. 2014): This is a variant of RNN model, which is equipped with two gates to control the information flow.”
MethodZaremba, W., & Sutskever, I. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1410.4615 · Cited by 283
“Other interesting applications of recurrent neural networks includes speech recognition (Robinson et al., 1996; Graves et al., 2013), machine translation (Cho et al., 2014; Sutskever et al., 2014), handwriting recognition (Pham et al., 2013; Zaremba et al., 2014b), and many more. a r X i v : 1410 .”
BackgroundMethodZreik, M., van Hamersvelt, R. W., Wolterink, J. M., Leiner, T., Viergever, M. A., & Isgum, I. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2883807 · Cited by 282
“The RNN consists of 2 layers of 64 Gated Recurrent Units (GRUs) [36] each.”
MethodSpeech Emotion Classification Using Attention-Based LSTM
Xie, Y., Liang, R., Liang, Z., Huang, C., Zou, C., & Schuller, B. (2019) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2019.2925934 · Cited by 282
A Deep Learning-based Cryptocurrency Price Prediction Scheme for Financial Institutions
Patel, M. M., Tanwar, S., Gupta, R., & Kumar, N. (2020) · Journal of Information Security and Applications · doi:10.1016/j.jisa.2020.102583 · Cited by 282
Progress in Neural NLP: Modeling, Learning, and Reasoning
Zhou, M., Duan, N., Liu, S., & Shum, H.-Y. (2020) · Engineering · doi:10.1016/j.eng.2019.12.014 · Cited by 281
ReSeg: A Recurrent Neural Network-Based Model for Semantic Segmentation
Visin, F., Romero, A., Cho, K., Matteucci, M., Ciccone, M., Kastner, K., Bengio, Y., & Courville, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.60 · Cited by 281
Self-citationRecurrent Neural Networks for Short-Term Load Forecasting: An Overview and Comparative Analysis
Bianchi, F. M., Maiorino, E., Kampffmeyer, M. C., Rizzi, A., & Jenssen, R. (2017) · SpringerBriefs in Computer Science · doi:10.1007/978-3-319-70338-1 · Cited by 280
“The internal state in GRU is always fully exposed in output, due to the lack of a control mechanism, like the output gate in LSTM. GRU were firstly tested by Cho et al. [121] on a statistical machine translation task and reported mixed results.”
BackgroundResultGenerating Factoid Questions With Recurrent Neural Networks: The 30M Factoid Question-Answer Corpus
Serban, I. V., García-Durán, A., Gulcehre, C., Ahn, S., Chandar, S., Courville, A., & Bengio, Y. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1056 · Cited by 280
“For the decoder, we use a GRU recurrent neural network (RNN) (Cho et al., 2014) with an attention-mechanism (Bahdanau et al., 2015) on the encoder representation to generate the associated question Q to that fact F .”
MethodInfluentialSelf-citationA Survey on Conversational Agents/Chatbots Classification and Design Techniques
Hussain, S., Ameri Sianaki, O., & Ababneh, N. (2019) · Advances in Intelligent Systems and Computing · doi:10.1007/978-3-030-15035-8_93 · Cited by 279
Massively Multilingual Neural Machine Translation in the Wild: Findings and Challenges
Arivazhagan, N., Bapna, A., Firat, O., Lepikhin, D., Johnson, M., Krikun, M., Chen, M. X., Cao, Y., Foster, G., Cherry, C., et al. (2019) · arXiv · doi:10.48550/arxiv.1907.05019 · Cited by 279
“Sequence-to-sequence neural models (seq2seq) (Kalchbrenner and Blunsom, 2013; Sutskever et al., 2014; Cho et al., 2014; Bahdanau et al., 2014) have been widely adopted as the state-of-the-art approach for machine translation, both in the research community (Bojar et al., 2016a, 2017, 2018b) and for…”
BackgroundMethodDeep Representation Learning for Trajectory Similarity Computation
Li, X., Zhao, K., Cong, G., Jensen, C. S., & Wei, W. (2018) · 2018 IEEE 34th International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2018.00062 · Cited by 279
“To capture the sequential order information emerging in the sequence processing tasks, Recurrent Neural Networks (RNNs) based encoder-decoder models have been developed, such as sequence to sequence learning [23]–”
MethodEmergent Multi-Agent Communication in the Deep Learning EraPreprint
Lazaridou, A., & Baroni, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.02419 · Cited by 324
Graph Neural Networks for Natural Language Processing: A Survey
Wu, L., Chen, Y., Shen, K., Guo, X., Gao, H., Li, S., Pei, J., & Long, B. (2023) · Foundations and Trends in Machine Learning · doi:10.1561/2200000096 · Cited by 278
A Survey on Deep Learning for Human Mobility
Luca, M., Barlacchi, G., Lepri, B., & Pappalardo, L. (2023) · ACM Computing Surveys · doi:10.1145/3485125 · Cited by 278
“Further mathematical details and formalizations can be found in Reference [166] for RNNs and LSTMs and [39] for GRUs.”
BackgroundAn effective spatial-temporal attention based neural network for traffic flow prediction
Do, L. N. N., Vu, H. L., Vo, B. Q., Liu, Z., & Phung, D. (2019) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2019.09.008 · Cited by 278
Deep code comment generation with hybrid lexical and syntactical information
Hu, X., Li, G., Xia, X., Lo, D., & Jin, Z. (2020) · Empirical Software Engineering · doi:10.1007/s10664-019-09730-9 · Cited by 278
An Analysis of Encoder Representations in Transformer-Based Machine Translation
Raganato, A., & Tiedemann, J. (2018) · Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP · doi:10.18653/v1/w18-5431 · Cited by 277
“…a lot of research has been done on NMT, designing new architectures, starting from the plain sequence-to-sequence model (Sutskever et al., 2014; Cho et al., 2014), to an improved version featuring an attention mechanism (Bahdanau et al., 2015; Luong et al., 2015a), to models that only use…”
BackgroundHybrid Contrastive Learning of Tri-Modal Representation for Multimodal Sentiment Analysis
Mai, S., Zeng, Y., Zheng, S., & Hu, H. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2022.3172360 · Cited by 277
MGAT: Multimodal Graph Attention Network for Recommendation
Tao, Z., Wei, Y., Wang, X., He, X., Huang, X., & Chua, T.-S. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2020.102277 · Cited by 277
Ndikumana, E., Ho Tong Minh, D., Baghdadi, N., Courault, D., & Hossard, L. (2018) · Remote Sensing · doi:10.3390/rs10081217 · Cited by 277
“This is as expected, due to the fact that the GRU unit is considered as an improvement of the LSTM unit [23].”
BackgroundMethodInfluentialExploiting Source-side Monolingual Data in Neural Machine Translation
Zhang, J., & Zong, C. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1160 · Cited by 277
Elmasry, W., Akbulut, A., & Zaim, A. H. (2020) · Computer Networks · doi:10.1016/j.comnet.2019.107042 · Cited by 277
KnowEdu: A System to Construct Knowledge Graph for Education
Chen, P., Lu, Y., Zheng, V. W., Chen, X., & Yang, B. (2018) · IEEE Access · doi:10.1109/access.2018.2839607 · Cited by 276
XSleepNet: Multi-View Sequential Model for Automatic Sleep Staging
Phan, H., Chen, O. Y., Tran, M. C., Koch, P., Mertins, A., & De Vos, M. (2021) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2021.3070057 · Cited by 275
Zhang, Z., Li, M., Lin, X., Wang, Y., & He, F. (2019) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2019.05.039 · Cited by 275
Polysemous Visual-Semantic Embedding for Cross-Modal Retrieval
Song, Y., & Soleymani, M. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00208 · Cited by 275
Iterative Alignment Network for Continuous Sign Language Recognition
Pu, J., Zhou, W., & Li, H. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00429 · Cited by 275
Recurrent neural network wave functions
Hibat-Allah, M., Ganahl, M., Hayward, L. E., Melko, R. G., & Carrasquilla, J. (2020) · Physical Review Research · doi:10.1103/physrevresearch.2.023358 · Cited by 274
Tachibana, H., Uenoyama, K., & Aihara, S. (2018) · 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2018.8461829 · Cited by 274
Controlling Politeness in Neural Machine Translation via Side Constraints
Sennrich, R., Haddow, B., & Birch, A. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1005 · Cited by 273
Why Self-Attention? A Targeted Evaluation of Neural Machine Translation Architectures
Tang, G., Müller, M., Rios, A., & Sennrich, R. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1458 · Cited by 273
Towards End-to-End Reinforcement Learning of Dialogue Agents for Information Access
Dhingra, B., Li, L., Li, X., Gao, J., Chen, Y.-N., Ahmed, F., & Deng, L. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1045 · Cited by 272
“We use GRU hidden state size of d = 50 for the RL agents and d = 100 for the E2E, a learning rate of 0 .”
BackgroundMethodInfluentialA Survey on Deep Learning for Human Activity Recognition
Gu, F., Chung, M.-H., Chignell, M., Valaee, S., Zhou, B., & Liu, X. (2022) · ACM Computing Surveys · doi:10.1145/3472290 · Cited by 272
Metadata
- Authors
- Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y.
- Affiliations
- Le Mans Université (FR)
- Polytechnique Montréal (CA)
- Venue
- Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)
- Published
- 2014
- Pages
- 1724-1734
- OpenAlex
- W2157331557
- Cited by
- 25,545
- References
- 31
- Citations by year
- 2026: 1895 · 2025: 2591 · 2024: 2721 · 2023: 3047 · 2022: 3245 · 2021: 3534 · 2020: 3063 · 2019: 2494 · 2018: 1644 · 2017: 816 · 2016: 349 · 2015: 119 · 2014: 22
- FWCI
- 256.40
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- HAL (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Keywords
- statistical machine translation, neural machine translation, phrase embeddings, sequence-to-sequence models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.