The DOI matches its DataCite record; 26 of the 27 references it cites were found in a registry or an index.
Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
Open accessAbstract
In this paper, we propose a novel neural network model called RNN Encoder-Decoder that consists of two recurrent neural networks (RNN). One RNN encodes a sequence of symbols into a fixed-length vector representation, and the other decodes the representation into another sequence of symbols. The encoder and decoder of the proposed model are jointly trained to maximize the conditional probability of a target sequence given a source sequence. The performance of a statistical machine translation system is empirically found to improve by using the conditional probabilities of phrase pairs computed by the RNN Encoder-Decoder as an additional feature in the existing log-linear model. Qualitatively, we show that the proposed model learns a semantically and syntactically meaningful representation of linguistic phrases.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Recurrent neural networks, long short-term memory [13] and gated recurrent [7] neural networks in particular, have been firmly established as state of the art approaches in sequence modeling and transduction problems such as language modeling and machine translation [35, 2, 5].”
From Attention Is All You Need (2017) · cites this paper as [5]
In the citing paper
“Due to memory and training instability concerns [44] its not always optimal to use very large sequences in recurrent networks.”
From End-to-End Multimodal Emotion Recognition using Deep Neural Networks (2017) · cites this paper as [44]
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
(2011) · Cited by 6,993
Self-citationADADELTA: An Adaptive Learning Rate Method
Zeiler, M. D. (2012) · arXiv · doi:10.48550/arxiv.1212.5701 · Cited by 5,322
Statistical phrase-based translation
Koehn, P., Och, F. J., & Marcu, D. (2003) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/1073445.1073462 · Cited by 3,265
(2005) · Cited by 3,125
Supervised Sequence Labelling with Recurrent Neural Networks
Graves, A. (2012) · Studies in Computational Intelligence · doi:10.1007/978-3-642-24797-2 · Cited by 3,120
Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition
Dahl, G. E., Yu, D., Deng, L., & Acero, A. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2134090 · Cited by 3,011
Recurrent Continuous Translation Models
Kalchbrenner, N., & Blunsom, P. (2013) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d13-1176 · Cited by 1,277
Cited by
Sorted by citations
Items 1,001–1,068 of 1,068
Document Modeling with External Attention for Sentence Extraction
Narayan, S., Cardenas, R., Papasarantopoulos, N., Cohen, S. B., Lapata, M., Yu, J., & Chang, Y. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1188 · Cited by 25
Delay aware transient stability assessment with synchrophasor recovery and prediction framework
Yu, J. J. Q., Hill, D. J., & Lam, A. Y. S. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.09.059 · Cited by 27
Image captioning via semantic element embedding
Zhang, X., He, S., Song, X., Lau, R. W. H., Jiao, J., & Ye, Q. (2019) · Neurocomputing · doi:10.1016/j.neucom.2018.02.112 · Cited by 28
Decoding Imagined Speech and Computer Control using Brain Waves
Singh, A., & Gumaste, A. (2021) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2021.109196 · Cited by 27
BG-SAC: Entity relationship classification model based on Self-Attention supported Capsule Networks
Peng, D., Zhang, D., Liu, C., & Lu, J. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106186 · Cited by 27
Nanayakkara, T., Clermont, G., LANGMEAD, C. J., & Swigon, D. (2022) · PLOS Digital Health · doi:10.1371/journal.pdig.0000012 · Cited by 31
Laser Beam Pointing Stabilization Control through Disturbance Classification
Chang, H., Ge, W., Wang, H., Yuan, H., & Fan, Z. (2021) · Sensors · doi:10.3390/s21061946 · Cited by 28
Learning sentiment sentence representation with multiview attention model
Zhang, Y., Wang, J., & Zhang, X. (2021) · Information Sciences · doi:10.1016/j.ins.2021.05.044 · Cited by 29
Zhang, S., & Fang, W. (2021) · Entropy · doi:10.3390/e23081018 · Cited by 27
Tang, Z., Hu, H., Xu, C., & Zhao, K. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18179037 · Cited by 31
A comprehensive review of the video-to-text problem
Perez-Martin, J., Bustos, B., Guimarães, S. J. F., Sipiran, I., Pérez, J. E. P., & Said, G. C. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10104-1 · Cited by 36
Content Caching Based on Popularity and Priority of Content Using seq2seq LSTM in ICN
Kang, M. W., & Chung, Y. W. (2023) · IEEE Access · doi:10.1109/access.2023.3245803 · Cited by 29
Jia, G., Zhang, X., Wang, X., Zhang, X., & Huang, N. (2023) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-023-11616-6 · Cited by 27
Schnober, C., Eger, S., Dinh, E.-L. D., & Gurevych, I. (2016) · TUbilio (Technical University of Darmstadt) · doi:10.48550/arxiv.1610.07796 · Cited by 27
An Attention-Based Spatiotemporal Gated Recurrent Unit Network for Point-of-Interest Recommendation
Liu, C., Liu, J., Wang, J., Xu, S., Han, H., & Chen, Y. (2019) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi8080355 · Cited by 27
Cybersecurity in SMEs: The Smart-Home/Office Use Case
Vakakis, N., Nikolis, O., Ioannidis, D., Votis, K., & Tzovaras, D. K. (2019) · IEEE International Workshop on Computer Aided Modeling and Design of Communication Links and Networks (CAMAD) · doi:10.1109/camad.2019.8858471 · Cited by 31
Automatic paper writing based on a RNN and the TextRank algorithm
Wang, H., Hsiao, W.-C., & Chang, S.-H. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106767 · Cited by 27
Algorithmic Composition of Melodies with Deep Recurrent Neural NetworksPreprint
Colombo, F., Muscinelli, S. P., Seeholzer, A., Brea, J., & Gerstner, W. (2016) · arXiv (Cornell University) · doi:10.13140/rg.2.1.2436.5683 · Cited by 27
Wang, X., Delgado, H., Tak, H., Jung, J.-W., Shim, H.-J., Todisco, M., Kukanov, I., Liu, X., Sahidullah, M., Kinnunen, T., et al. (2026) · Computer Speech & Language · doi:10.1016/j.csl.2025.101825 · Cited by 30
Application of Machine Learning in Hydraulic Fracturing: A Review
Ma, Y., & Ye, M. (2025) · ACS Omega · doi:10.1021/acsomega.4c11342 · Cited by 33
Visualizing memorization in RNNs
Madsen, A. N. (2019) · Distill · doi:10.23915/distill.00016 · Cited by 29
Transfer Learning for Causal Sentence Detection
Kyriakakis, M., Androutsopoulos, I., Saudabayev, A., & Ametllé, J. G. I. (2019) · BioNLP Workshop and Shared Task (BioNLP) · doi:10.18653/v1/w19-5031 · Cited by 29
Yu, S., Wu, Z., Zhu, X., & PECHT, M. G. (2019) · Prognostics and System Health Management Conference · doi:10.1109/phm-paris.2019.00030 · Cited by 28
Attention Mechanism in Machine Translation
Jia, Y. (2019) · Journal of Physics Conference Series · doi:10.1088/1742-6596/1314/1/012186 · Cited by 32
Pu, B., Liu, Y., Zhu, N., Li, K., & Li, K. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106688 · Cited by 27
Wang, W., Chen, J., & Jin, Q. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413890 · Cited by 27
Neural network-based surrogate model for a bifurcating structural fracture response
van de Weg, B. P., Greve, L., Andres, M., Eller, T., & Rosić, B. (2020) · Engineering Fracture Mechanics · doi:10.1016/j.engfracmech.2020.107424 · Cited by 28
VDARN: Video Disentangling Attentive Relation Network for Few-Shot and Zero-Shot Action Recognition
Su, Y. R., Xing, M., An, S., Peng, W., & Feng, Z. (2020) · Ad Hoc Networks · doi:10.1016/j.adhoc.2020.102380 · Cited by 26
Predictive Mutation Analysis via the Natural Language Channel in Source Code
Kim, J.-H., Jeon, J., Hong, S., & Yoo, S. (2022) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3510417 · Cited by 29
Prediction of In-Hospital Cardiac Arrest Using Shallow and Deep Learning
Chae, M., Han, S., Gil, H., Cho, N., & Lee�, H. (2021) · Diagnostics · doi:10.3390/diagnostics11071255 · Cited by 27
Transformer-Encoder-GRU (T-E-GRU) for Chinese Sentiment Analysis on Chinese Comment Text
Zhang, B., & Zhou, W. M. (2022) · Neural Processing Letters · doi:10.1007/s11063-022-10966-8 · Cited by 28
Mask-RCNN with spatial attention for pedestrian segmentation in cyber–physical systems
Yuan, L., & Qiu, Z. (2021) · Computer Communications · doi:10.1016/j.comcom.2021.09.002 · Cited by 26
A Primer on Deep Learning Architectures and Applications in Speech Processing
Ogunfunmi, T., Ramachandran, R. P., Togneri, R. B., Zhao, Y., & Xia, X. (2019) · Circuits Systems and Signal Processing · doi:10.1007/s00034-019-01157-3 · Cited by 26
Nie, W., Wang, W., Liu, A.-A., Nie, J., & Su, Y. (2019) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3344684 · Cited by 26
A Conditional Variational Framework for Dialog GenerationPreprint
Shen, X., Su, H., Li, Y., Li, W., Niu, S., Zhao, Y., Aizawa, A., & Long, G. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.00316 · Cited by 40
Human Motion Prediction via Spatio-Temporal InpaintingPreprint
Ruiz, A. H., Gall, J., & Moreno-Noguer, F. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.05478 · Cited by 26
A Review of Bangla Natural Language Processing Tasks and the Utility of Transformer ModelsPreprint
Alam, F., Hasan, M. A., Alam, T., Khan, A., Tajrin, J., Khan, N., & Chowdhury, S. A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.03844 · Cited by 51
Unsupervised Multimodal Learning for Dependency-Free Personality Recognition
Ghassemi, S., Zhang, T., van Breda, W., Koutsoumpis, A., Oostrom, J. K., Holtrop, D., & de Vries, R. E. (2023) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2023.3318367 · Cited by 32
Neural Network Transduction Models in Transliteration Generation
Finch, A., Liu, L., Wang, X., & Sumita, E. (2015) · Named Entities Workshop (NEWS) · doi:10.18653/v1/w15-3909 · Cited by 25
Prado, A., Cao, X., Robert, M. T., Gordon, A. M., & Agrawal, S. K. (2019) · Physical Medicine and Rehabilitation Clinics of North America · doi:10.1016/j.pmr.2018.12.007 · Cited by 25
Hybrid Attention for Chinese Character-Level Neural Machine Translation
Wang, F., Chen, W., Yang, Z. C., Xu, S., & Xu, B. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.05.032 · Cited by 26
Kim, S., Kwon, O., & Kim, H. (2020) · Applied Sciences · doi:10.3390/app10093335 · Cited by 25
Recurrent convolutional networks for session-based recommendations
Bach, N. X., Dang, L. H., & Phuong, T. M. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.06.077 · Cited by 25
Neural Network Approaches for Mobile Spectroscopic Gamma-Ray Source Detection
Bilton, K. J., Joshi, T. H. Y., Bandstra, M. S., Curtis, J. C., Hellfeld, D., & Vetter, K. (2021) · Journal of Nuclear Engineering · doi:10.3390/jne2020018 · Cited by 29
Regional Population Forecast and Analysis Based on Machine Learning Strategy
Wang, C.-Y., & Lee, S. (2021) · Entropy · doi:10.3390/e23060656 · Cited by 30
Deep Transformer modeling via grouping skip connection for neural machine translation
Li, Y., Li, J., & Zhang, M. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107556 · Cited by 26
Prior-Aware Cross Modality Augmentation Learning for Continuous Sign Language Recognition
Hu, H., Pu, J., Zhou, W., Fang, H., & Li, H. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2023.3268368 · Cited by 27
Deep sequential models for suicidal ideation from multiple source data
Peis, I., Olmos, P. M., Vera-Varela, C., Barrigon, M. L., Courtet, P., Baca-Garcia, E., & Artes-Rodriguez, A. (2019) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2019.2919270 · Cited by 22
QuickEdit: Editing Text and Translations by Crossing Words Out
Grangier, D., & Auli, M. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1025 · Cited by 20
Zhang, P., Gao, X., Miao, M., & Zhao, P. (2022) · Machines · doi:10.3390/machines10121125 · Cited by 20
Predicting improved protein conformations with a temporal deep recurrent neural network
Pfeiffenberger, E., & Bates, P. A. (2018) · PLOS ONE · doi:10.1371/journal.pone.0202652 · Cited by 21
A Review on Genomics Data Analysis using Machine Learning
Aggarwal, A. K. (2023) · WSEAS TRANSACTIONS ON BIOLOGY AND BIOMEDICINE · doi:10.37394/23208.2023.20.12 · Cited by 17
Cheng, H., Sheng, B., Lee, A., Chaudary, V., Atanasov, A. G., Liu, N., Qiu, Y., Wong, T. Y., Tham, Y.-C., & Zheng, Y. (2024) · doi:10.1101/2024.03.25.586710 · Cited by 15
Singh, P., Kaur, A., & Gill, S. S. (2022) · International Journal of Grid and Utility Computing · doi:10.1504/ijguc.2022.125151 · Cited by 11
Detecting Online Grooming By Simple Contrastive Chat Embeddings
Rezaee Borj, P., Raja, K., & Bours, P. (2023) · Proceedings of the 9th ACM International Workshop on Security and Privacy Analytics · doi:10.1145/3579987.3586564 · Cited by 11
Intelligent Systems for Muscle Tracking: A Review on Sensor‐Algorithm Synergy
Putcha, A., Nguyen, T., Smith, R., Choffin, R., & Bai, W. (2023) · Advanced Intelligent Systems · doi:10.1002/aisy.202200351 · Cited by 10
Cloud-Based Sentiment Analysis for Interactive Agents
Keijsers, M., Bartneck, C., & Kazmi, H. S. (2019) · Proceedings of the 7th International Conference on Human-Agent Interaction · doi:10.1145/3349537.3351883 · Cited by 9
Colas, J. T., O’Doherty, J. P., & Grafton, S. T. (2024) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1011950 · Cited by 6
Exploring the Knowledge of an Outstanding Protein to Protein Interaction Transformer
Yang, S., Cheng, P., Liu, Y., Feng, D., & Wang, S. (2024) · IEEE/ACM Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2024.3381825 · Cited by 6
Fine-Grained Fault Sensitivity Analysis of Vision Transformers Under Soft Errors
He, J., Liu, Y., Xu, C., Liao, X., & Yang, Y. (2025) · Electronics · doi:10.3390/electronics14122418 · Cited by 4
XLand-MiniGrid: Scalable Meta-Reinforcement Learning Environments in JAX
Nikulin, A., Kurenkov, V., Zisman, I., Agarkov, A., Sinii, V., & Kolesnikov, S. (2024) · Advances in Neural Information Processing Systems 37 · doi:10.52202/079017-1390 · Cited by 3
Relation-Aware Question Answering for Heterogeneous Knowledge Graphs
Du, H., Huang, Q., Li, C., Zhang, C., Li, Y., & Zhao, D. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.906 · Cited by 2
A Review of Current Trends, Techniques, and Challenges in Large Language Models (LLMs)
Patil, R., & Gudivada, A. V. (2024) · doi:10.20944/preprints202402.0357.v1 · Cited by 296
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
End-to-End Multimodal Emotion Recognition using Deep Neural Networks
Tzirakis, P., Trigeorgis, G., Nicolaou, M. A., Schuller, B., & Zafeiriou, S. (2017) · arXiv · doi:10.48550/arxiv.1704.08619 · Cited by 752
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
RETAIN: an interpretable predictive model for healthcare using reverse time attention mechanism
Choi, E., Bahadori, M. T., Kulas, J. A., Schuetz, A., Stewart, W. F., & Sun, J. (2016) · arXiv · doi:10.48550/arxiv.1608.05745 · Cited by 1,029
Metadata
- Authors
- Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y.
- Affiliations
- Université de Montréal (CA)
- Constructor University (DE)
- Le Mans Université (FR)
- Corresponding author
- Bahdanau, Dzmitry
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2014
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1406.1078
- OpenAlex
- W2950635152
- Cited by
- 3,317
- References
- 27
- Citations by year
- 2026: 335 · 2025: 348 · 2024: 369 · 2023: 216 · 2022: 93 · 2021: 434 · 2020: 495 · 2019: 436 · 2018: 296 · 2017: 172 · 2016: 87 · 2015: 29 · 2014: 7
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Canadian Institute for Advanced Research
- Compute Canada
- Canada Research Chairs
- Defense Advanced Research Projects Agency
- Natural Sciences and Engineering Research Council of Canada
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Keywords
- statistical machine translation, phrase representation, recurrent neural networks, encoder-decoder architecture, log-linear models, joint training
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
