PreprintCited by 3,317Natural Language Processing TechniquesTopic ModelingSpeech Recognition and Synthesis

The DOI matches its DataCite record; 26 of the 27 references it cites were found in a registry or an index.

Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation

Open access

Cho, Kyunghyun, van Merrienboer, Bart, Gulcehre, Caglar, Bahdanau, Dzmitry, Bougares, Fethi, Schwenk, Holger, Bengio, Yoshua·2014·arXiv

DOI 10.48550/arxiv.1406.1078arXiv 1406.1078

Open this paper in CoChat — free account Open PDF

Abstract

In this paper, we propose a novel neural network model called RNN Encoder-Decoder that consists of two recurrent neural networks (RNN). One RNN encodes a sequence of symbols into a fixed-length vector representation, and the other decodes the representation into another sequence of symbols. The encoder and decoder of the proposed model are jointly trained to maximize the conditional probability of a target sequence given a source sequence. The performance of a statistical machine translation system is empirically found to improve by using the conditional probabilities of phrase pairs computed by the RNN Encoder-Decoder as an additional feature in the existing log-linear model. Qualitatively, we show that the proposed model learns a semantically and syntactically meaningful representation of linguistic phrases.

Integrity signals

Registry

DataCite · 10.48550/arxiv.1406.1078

Cites

26 of 26 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Long Short-Term Memory
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Untitled work
(2011) · Cited by 6,993
Self-citation
ADADELTA: An Adaptive Learning Rate Method
Zeiler, M. D. (2012) · arXiv · doi:10.48550/arxiv.1212.5701 · Cited by 5,322
Statistical phrase-based translation
Koehn, P., Och, F. J., & Marcu, D. (2003) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/1073445.1073462 · Cited by 3,265
Untitled work
(2005) · Cited by 3,125
Supervised Sequence Labelling with Recurrent Neural Networks
Graves, A. (2012) · Studies in Computational Intelligence · doi:10.1007/978-3-642-24797-2 · Cited by 3,120
Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition
Dahl, G. E., Yu, D., Deng, L., & Acero, A. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2134090 · Cited by 3,011
Recurrent Continuous Translation Models
Kalchbrenner, N., & Blunsom, P. (2013) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d13-1176 · Cited by 1,277

Show all 27 references

Sorted by citations

Items 101–200 of 1,068

Rethinking Transformer-based Set Prediction for Object Detection
Sun, Z., Cao, S., Yang, Y., & Kitani, K. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00359 · Cited by 402
Large language models (LLMs): survey, technical frameworks, and future challenges
Kumar, P. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10888-y · Cited by 395
Artificial Neural Networks for Neuroscientists: A Primer
Yang, G. R., & Wang, X. (2020) · Neuron · doi:10.1016/j.neuron.2020.09.005 · Cited by 411
The relative performance of ensemble methods with deep convolutional neural networks for image classification
Ju, C., Bibaut, A., & van der Laan, M. J. (2018) · Journal of Applied Statistics · doi:10.1080/02664763.2018.1441383 · Cited by 389
How social learning amplifies moral outrage expression in online social networks
Brady, W. J., McLoughlin, K., Doan, T. N., & Crockett, M. J. (2021) · Science Advances · doi:10.1126/sciadv.abe5641 · Cited by 375
End-to-end Continuous Speech Recognition using Attention-based Recurrent NN: First ResultsPreprint
Chorowski, J., Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.1602 · Cited by 475
Self-citation
An Empirical Study on Learning Bug-Fixing Patches in the Wild via Neural Machine Translation
Tufano, M., Watson, C., Bavota, G., Penta, M. D., White, M., & Poshyvanyk, D. (2019) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3340544 · Cited by 370
Sharp Minima Can Generalize For Deep NetsPreprint
Dinh, L., Pascanu, R., Samy Bengio, A., & Bengio, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.04933 · Cited by 455
Self-citation
Modulating early visual processing by languagePreprint
de Vries, H., Strub, F., Mary, J., Larochelle, H., Pietquin, O., & Courville, A. C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.00683 · Cited by 397
Gated-Attention Readers for Text Comprehension
Dhingra, B., Liu, H., Yang, Z., Cohen, W., & Salakhutdinov, R. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1168 · Cited by 366
When large language models meet personalization: perspectives of challenges and opportunities
Chen, J., Liu, Z., Huang, X., Wu, C., Liu, Q., Jiang, G., Pu, Y., Lei, Y., Chen, X., Wang, X., et al. (2024) · World Wide Web · doi:10.1007/s11280-024-01276-1 · Cited by 367
Minimal gated unit for recurrent neural networks
Zhou, G., Wu, J., Zhang, C.-L., & Zhou, Z. (2016) · Machine Intelligence Research · doi:10.1007/s11633-016-1006-2 · Cited by 374
LSTM-Based EEG Classification in Motor Imagery Tasks
Wang, P., Jiang, A., Liu, X., Shang, J., & Zhang, L. (2018) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2018.2876129 · Cited by 367
Advances in De Novo Drug Design: From Conventional to Machine Learning Methods
Mouchlis, V. D., Afantitis, A., Serra, A., Fratello, M., Papadiamantis, A. G., Aidinis, V., Lynch, I., Greco, D., & Melagraki, G. (2021) · International Journal of Molecular Sciences · doi:10.3390/ijms22041676 · Cited by 381
Hello Edge: Keyword Spotting on MicrocontrollersPreprint
Zhang, Y., Suda, N., Lai, L., & Chandra, V. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.07128 · Cited by 559
Video Summarization Using Deep Neural Networks: A Survey
Apostolidis, E., Adamantidou, E., Metsai, A. I., Mezaris, V., & Patras, I. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3117472 · Cited by 385
A deep learning algorithm to predict risk of pancreatic cancer from disease trajectories
Placido, D., Yuan, B., Hjaltelin, J. X., Zheng, C., Haue, A. D., Chmura, P. J., Yuan, C., Kim, J., Umeton, R., Antell, G., et al. (2023) · Nature Medicine · doi:10.1038/s41591-023-02332-5 · Cited by 349
A survey on deep learning in medicine: Why, how and when?
Piccialli, F., Somma, V. D., Giampaolo, F., Cuomo, S., & Fortino, G. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.09.006 · Cited by 369
RPVNet: A Deep and Efficient Range-Point-Voxel Fusion Network for LiDAR Point Cloud Segmentation
Xu, J., Zhang, R., Dou, J., Yushi, Z., Sun, J., & Pu, S. (2021) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01572 · Cited by 350
Towards End-to-End Prosody Transfer for Expressive Speech Synthesis with TacotronPreprint
Skerry-Ryan, R., Battenberg, E., Xiao, Y., Wang, Y., Stanton, D., Shor, J., Weiss, R. J., Clark, R., & Saurous, R. A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.09047 · Cited by 348
Learning Text Similarity with Siamese Recurrent Networks
Neculoiu, P., Versteegh, M., & Rotaru, M. (2016) · Proceedings of the 1st Workshop on Representation Learning for NLP · doi:10.18653/v1/w16-1617 · Cited by 341
“In the last few years, neural network models have been applied to tasks ranging from machine translation (Zou et al., 2013; Cho et al., 2014) to question answering (Weston et al.”
Method
Heart sound classification based on improved MFCC features and convolutional recurrent neural networks
Deng, M., Meng, T., Cao, J., Wang, S., Zhang, J., & Fan, H. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.06.015 · Cited by 352
Privacy-preserving blockchain-based federated learning for traffic flow prediction
Qi, Y., Hossain, M. S., Nie, J., & Li, X. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2020.12.003 · Cited by 339
Combining Sentinel-1 and Sentinel-2 Satellite Image Time Series for land cover mapping via a multi-source deep learning architecture
Ienco, D., Interdonato, R., Gaetano, R., & Minh, D. H. T. (2019) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2019.09.016 · Cited by 335
Learning a Multi-View Stereo MachinePreprint
Kar, A., Häne, C., & Malik, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.05375 · Cited by 427
Capturing Car-Following Behaviors by Deep Learning
Wang, X., Jiang, R., Li, L., Lin, Y., Zheng, X., & Wang, F. (2017) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2017.2706963 · Cited by 336
Exploring Temporal Coherence for More General Video Face Forgery Detection
Zheng, Y., Bao, J., Chen, D., Zeng, M., & Wen, F. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01477 · Cited by 320
Machine learning in construction: From shallow to deep learning
Xu, Y., Zhou, Y., Sekuła, P., & Ding, L. (2021) · Developments in the Built Environment · doi:10.1016/j.dibe.2021.100045 · Cited by 356
GAN-Leaks: A Taxonomy of Membership Inference Attacks against Generative Models
Chen, D., Yu, N., Zhang, Y., & Fritz, M. (2020) · Proceedings of the 2020 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3372297.3417238 · Cited by 311
Wind speed prediction method using Shared Weight Long Short-Term Memory Network and Gaussian Process Regression
Zhang, Z., Ye, L., Qin, H., Liu, Y., Wang, C., Yu, X. J., Yin, X., & Li, J. (2019) · Applied Energy · doi:10.1016/j.apenergy.2019.04.047 · Cited by 301
Attention, please! A survey of neural attention models in deep learning
Correia, A. D. S., & Colombini, E. L. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10148-x · Cited by 365
Recurrent convolutional neural network: A new framework for remaining useful life prediction of machinery
Wang, B., Lei, Y., Yan, T., Li, N., & Guo, L. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.10.064 · Cited by 302
Fine-grained Analysis of Sentence Embeddings Using Auxiliary Prediction TasksPreprint
Adi, Y., Kermany, E., Belinkov, Y., Lavi, O., & Goldberg, Y. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1608.04207 · Cited by 446
ReSeg: A Recurrent Neural Network-Based Model for Semantic Segmentation
Visin, F., Romero, A., Cho, K., Matteucci, M., Ciccone, M., Kastner, K., Bengio, Y., & Courville, A. C. (2016) · IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.60 · Cited by 306
Self-citation
Clotho: an Audio Captioning Dataset
Drossos, K., Lipping, S., & Virtanen, T. (2020) · ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp40776.2020.9052990 · Cited by 285
A survey on deep learning-based non-invasive brain signals: recent advances and new frontiers
Zhang, X., Yao, L., Wang, X., Monaghan, J., McAlpine, D., & Zhang, Y. (2021) · Journal of Neural Engineering · doi:10.1088/1741-2552/abc902 · Cited by 296
MGAT: Multimodal Graph Attention Network for Recommendation
Tao, Z., Wei, Y., Wang, X., He, X., Huang, X., & Chua, T. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2020.102277 · Cited by 292
ChemTS: an efficient python library for de novo molecular generation
Yang, X., Zhang, J., Yoshizoe, K., Terayama, K., & Tsuda, K. (2017) · Science and Technology of Advanced Materials · doi:10.1080/14686996.2017.1401424 · Cited by 277
An effective spatial-temporal attention based neural network for traffic flow prediction
Loan, N. N., Vu, H. L., Vo, B. Q., Liu, Z., & Phung, D. (2019) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2019.09.008 · Cited by 280
Adversarial Feature Matching for Text GenerationPreprint
Zhang, Y., Gan, Z., Fan, K., Chen, Z., Henao, R., Shen, D., & Carin, L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.03850 · Cited by 307
Machine learning techniques for biomedical image segmentation: An overview of technical aspects and introduction to state‐of‐art applications
Seo, H., Badiei Khuzani, M., Vasudevan, V., Huang, C., Ren, H., Xiao, R., Jia, X., & Xing, L. (2020) · Medical Physics · doi:10.1002/mp.13649 · Cited by 300
Graph-Based Deep Learning for Medical Diagnosis and Analysis: Past, Present and Future
Ahmedt‐Aristizabal, D., Armin, M. A., Denman, S., Fookes, C., & Petersson, L. (2021) · Sensors · doi:10.3390/s21144758 · Cited by 298
On the Bottleneck of Graph Neural Networks and its Practical ImplicationsPreprint
Alon, U., & Yahav, E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.05205 · Cited by 571
Multistep speed prediction on traffic networks: A deep learning approach considering spatio-temporal dependencies
Zhang, Z., Li, M., Lin, X., Wang, Y., & He, F. (2019) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2019.05.039 · Cited by 297
A Neural Network Architecture Combining Gated Recurrent Unit (GRU) and Support Vector Machine (SVM) for Intrusion Detection in Network Traffic Data
Agarap, A. F. (2018) · International Conference on Machine Learning and Computing (ICMLC) · doi:10.1145/3195106.3195117 · Cited by 285
Generating Natural Questions About an Image
Mostafazadeh, N., Misra, I., Devlin, J., Mitchell, M., He, X., & Vanderwende, L. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1170 · Cited by 270
H+O: Unified Egocentric Recognition of 3D Hand-Object Poses and Interactions
Tekin, B., Bogo, F., & Pollefeys, M. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00464 · Cited by 274
Disentangled Representation Learning for Non-Parallel Text Style Transfer
John, V., Mou, L., Bahuleyan, H., & Vechtomova, O. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1041 · Cited by 314
Fi-GNN
Li, Z., Cui, Z., Wu, S., Zhang, X., & Wang, L. (2019) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3357384.3357951 · Cited by 276
Recent advances in deep learning based dialogue systems: a systematic survey
Ni, J., Young, T., Pandelea, V., Xue, F., & Cambria, E. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10248-8 · Cited by 313
Towards the swift prediction of the remaining useful life of lithium-ion batteries with end-to-end deep learning
Hong, J., Lee, D., Jeong, E., & Yi, Y. (2020) · Applied Energy · doi:10.1016/j.apenergy.2020.115646 · Cited by 262
Condition monitoring of wind turbines based on spatio-temporal fusion of SCADA data by convolutional neural networks and gated recurrent units
Kong, Z., Tang, B., Deng, L., Liu, W. Y., & Han, Y. (2019) · Renewable Energy · doi:10.1016/j.renene.2019.07.033 · Cited by 259
Exploring Hate Speech Detection in Multimodal Publications
Gómez, R., Gibert, J., Gómez, L., & Karatzas, D. (2020) · IEEE Winter Conference on Applications of Computer Vision · doi:10.1109/wacv45572.2020.9093414 · Cited by 284
Recurrent Fully Convolutional Neural Networks for Multi-slice MRI Cardiac Segmentation
Poudel, R. P. K., Lamata, P., & Montana, G. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-52280-7_8 · Cited by 267
Visual Storytelling
Huang, T.-H., Ferraro, F., Mostafazadeh, N., Misra, I., Agrawal, A., Devlin, J., Girshick, R., He, X., Kohli, P., Batra, D., et al. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1147 · Cited by 254
Exploring Spatial Context for 3D Semantic Segmentation of Point Clouds
Engelmann, F., Kontogianni, T., Hermans, A., & Leibe, B. (2017) · RWTH Publications (RWTH Aachen) · Cited by 254
Neural Natural Language Processing for unstructured data in electronic health records: A review
Li, I., Pan, J. N., Goldwasser, J., Verma, N., Wong, W. P., Nuzumlalı, M. Y., Rosand, B., Li, Y., Zhang, M. M., Chang, D., et al. (2022) · Computer Science Review · doi:10.1016/j.cosrev.2022.100511 · Cited by 280
ProtTrans: Towards Cracking the Language of Life's Code Through Self-Supervised Deep Learning and High Performance ComputingPreprint
Elnaggar, A., Heinzinger, M., Dallago, C., Rihawi, G., Wang, Y., Jones, L., Gibbs, T., Fehér, T., Angerer, C. M., Steinegger, M., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.06225 · Cited by 364
Log-based anomaly detection with deep learning: how far are we?
Le, V.-H., & Zhang, H. (2022) · Proceedings of the 44th International Conference on Software Engineering · doi:10.1145/3510003.3510155 · Cited by 257
Data-driven science and engineering : machine learning, dynamical systems, and control
Brunton, S. L., & Kutz, J. N. (2019) · doi:10.1017/978-1-009-08951-7 · Cited by 270
CodeBERT: A Pre-Trained Model for Programming and Natural Languages
Feng, Z., Guo, D., Tang, D., Duan, N., Feng, X., Gong, M., Shou, L., Qin, B., Liu, T., Jiang, D., et al. (2020) · arXiv · doi:10.48550/arxiv.2002.08155 · Cited by 243
BiERU: Bidirectional emotional recurrent unit for conversational sentiment analysis
Li, W., Shao, W., Ji, S., & Cambria, E. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.09.057 · Cited by 271
Neural Relational Inference for Interacting SystemsPreprint
Kipf, T., Fetaya, E., Wang, K.-C. J., Welling, M., & Zemel, R. S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.04687 · Cited by 361
A Review on Speech Emotion Recognition Using Deep Learning and Attention Mechanism
Lieskovská, E., Jakubec, M., Jarina, R., & Chmulík, M. (2021) · Electronics · doi:10.3390/electronics10101163 · Cited by 246
Ensemble of deep sequential models for credit card fraud detection
Forough, J., & Momtazi, S. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106883 · Cited by 256
TarMAC: Targeted Multi-Agent CommunicationPreprint
Das, A., Gervet, T., Romoff, J., Batra, D., Parikh, D., Rabbat, M., & Pineau, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.11187 · Cited by 258
An ensemble-based hotel recommender system using sentiment analysis and aspect categorization of hotel reviews
Ray, B., Garain, A., & Sarkar, R. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106935 · Cited by 248
Deep Learning in Protein Structural Modeling and Design
Gao, W., Mahajan, S. P., Sulam, J., & Gray, J. J. (2020) · Patterns · doi:10.1016/j.patter.2020.100142 · Cited by 227
Deep Learning with Microfluidics for Biotechnology
Riordon, J., Sovilj, D., Sanner, S., Sinton, D. A., & Young, E. W. K. (2018) · Trends in biotechnology · doi:10.1016/j.tibtech.2018.08.005 · Cited by 227
A survey on empathetic dialogue systems
Ma, Y., Nguyen, K. L., Xing, F., & Cambria, E. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.06.011 · Cited by 230
Retrieve, Rerank and Rewrite: Soft Template Based Neural Summarization
Cao, Z., Li, W., Li, S., & Wei, F. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1015 · Cited by 202
Multimodal Language Analysis with Recurrent Multistage Fusion
Liang, P. P., Liu, Z., Bagher Zadeh, A., & Morency, L.-P. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1014 · Cited by 230
Sobolev training of thermodynamic-informed neural networks for interpretable elasto-plasticity models with level set hardening
Vlassis, N. N., & Sun, W. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.113695 · Cited by 220
Exploiting Semantics in Neural Machine Translation with Graph Convolutional Networks
Marcheggiani, D., Bastings, J., & Titov, I. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-2078 · Cited by 241
Text mining-based construction site accident classification using hybrid supervised machine learning
Cheng, M., Kusoemo, D., & Gosno, R. A. (2020) · Automation in Construction · doi:10.1016/j.autcon.2020.103265 · Cited by 233
Supervised and Semi-Supervised Text Categorization using LSTM for Region EmbeddingsPreprint
Johnson, R., & Zhang, T. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.02373 · Cited by 248
Exploring Sparsity in Recurrent Neural NetworksPreprint
Narang, S., Elsen, E., Diamos, G., & Sengupta, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.05119 · Cited by 218
When deep learning met code search
Cambronero, J., Li, H., Kim, S., Sen, K., & Chandra, S. (2019) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3338906.3340458 · Cited by 227
Deep Recurrent Models with Fast-Forward Connections for Neural Machine Translation
Zhou, J., Cao, Y., Wang, X., Li, P., & Xu, W. (2016) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00105 · Cited by 216
Load demand forecasting of residential buildings using a deep learning model
Wen, L., Zhou, K., & Yang, S. (2019) · Electric Power Systems Research · doi:10.1016/j.epsr.2019.106073 · Cited by 220
Deep reinforcement learning in medical imaging: A literature review
Zhou, S., Le, N., Luu, K., Nguyen, H. V., & Ayache, N. (2021) · Medical Image Analysis · doi:10.1016/j.media.2021.102193 · Cited by 227
Online and Linear-Time Attention by Enforcing Monotonic AlignmentsPreprint
Raffel, C., Luong, M.-T., Liu, P. J., Weiss, R. J., & Eck, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.00784 · Cited by 232
Describing Videos by Exploiting Temporal StructurePreprint
Yao, L., Torabi, A., Cho, K., Ballas, N., Pal, C., Larochelle, H., & Courville, A. C. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.08029 · Cited by 303
Self-citation
Physical principles of brain–computer interfaces and their applications for rehabilitation, robotics and control of human brain states
Hramov, A. E., Александрович, М. В., & Pisarchik, A. N. (2021) · Physics Reports · doi:10.1016/j.physrep.2021.03.002 · Cited by 228
A Comparative Study of Bitcoin Price Prediction Using Deep Learning
Ji, S., Kim, J., & Im, H. (2019) · Mathematics · doi:10.3390/math7100898 · Cited by 225
On Learning Meaningful Code Changes Via Neural Machine Translation
Tufano, M., Pantiuchina, J., Watson, C., Bavota, G., & Poshyvanyk, D. (2019) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2019.00021 · Cited by 228
LCF: A Local Context Focus Mechanism for Aspect-Based Sentiment Classification
Zeng, B., Yang, H., Xu, R., Zhou, W., & Han, X. (2019) · Applied Sciences · doi:10.3390/app9163389 · Cited by 218
Paraphrase Generation with Deep Reinforcement Learning
Li, Z., Jiang, X., Shang, L., & Li, H. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1421 · Cited by 229
One-Shot Imitation LearningPreprint
Duan, Y., Andrychowicz, M., Stadie, B. C., Ho, O. J., Schneider, J., Sutskever, I., Abbeel, P., & Zaremba, W. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.07326 · Cited by 473
Learning General Purpose Distributed Sentence Representations via Large Scale Multi-task Learning
Subramanian, S., Trischler, A., Bengio, Y., & Pal, C. J. (2018) · arXiv · doi:10.48550/arxiv.1804.00079 · Cited by 207
Self-citation
Time2Vec: Learning a Vector Representation of Time
Kazemi, S. M., Goel, R., Eghbali, S., Ramanan, J., Sahota, J., Thakur, S., Wu, S., Smyth, C., Poupart, P., & Brubaker, M. (2019) · arXiv · doi:10.48550/arxiv.1907.05321 · Cited by 206
Deep Voice 2: Multi-Speaker Neural Text-to-SpeechPreprint
Arık, S. Ö., Diamos, G., Gibiansky, A., Miller, J. J., Peng, K., Ping, W., Raiman, J., & Zhou, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.08947 · Cited by 251
Tensor2Tensor for Neural Machine TranslationPreprint
Vaswani, A., Samy Bengio, A., Brevdo, E., Chollet, F., Gomez, A. N., Gouws, S., Jones, L., Kaiser, Ł., Kalchbrenner, N., Parmar, N., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.07416 · Cited by 379
Machine translation using deep learning: An overview
Singh, S. P., Kumar, A., Darbari, H., Singh, L., Rastogi, A., & Jain, S. (2017) · International Conference on Computer, Communications and Electronics (Comptelix) · doi:10.1109/comptelix.2017.8003957 · Cited by 204
Demystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency AnalysisPreprint
Ben‐Nun, T., & Hoefler, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.09941 · Cited by 204
Data Noising as Smoothing in Neural Network Language ModelsPreprint
Xie, Z., Wang, S. I., Li, J., Lévy, D., Nie, A., Jurafsky, D., & Ng, A. Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.02573 · Cited by 246
Temporal Recurrent Networks for Online Action Detection
Xu, M., Gao, M., Chen, Y.-T., Davis, L. S., & Crandall, D. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00563 · Cited by 212
AliMe Chat: A Sequence to Sequence and Rerank based Chatbot Engine
Qiu, M., Li, F.-L., Wang, S., Gao, X., Chen, Y., Zhao, W., Chen, H., Huang, J., & Chu, W. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-2079 · Cited by 197
Intelligent financial fraud detection practices in post-pandemic era
Zhu, X., Ao, X., Qin, Z., Chang, Y., Liu, Y., He, Q., & Li, J. (2021) · The Innovation · doi:10.1016/j.xinn.2021.100176 · Cited by 238
Stabilizing Transformers for Reinforcement Learning
Parisotto, E., Song, H. F., Rae, J. W., Pascanu, R., Gulcehre, C., Jayakumar, S. M., Jaderberg, M., Kaufman, R. L., Clark, A., Noury, S., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.06764 · Cited by 199

Authors: Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y.
Affiliations: Université de Montréal (CA)
Constructor University (DE)
Le Mans Université (FR)
Corresponding author: Bahdanau, Dzmitry
ORCID: Cho, Kyunghyun
Bougares, Fethi
Bengio, Yoshua
Venue: arXiv
Publisher: arXiv
Published: 2014
ISSN: 2331-8422 (ISSN-L)
DOI: 10.48550/arxiv.1406.1078
arXiv: 1406.1078
OpenAlex: W2950635152
Cited by: 3,317
References: 27
Citations by year: 2026: 335 · 2025: 348 · 2024: 369 · 2023: 216 · 2022: 93 · 2021: 434 · 2020: 495 · 2019: 436 · 2018: 296 · 2017: 172 · 2016: 87 · 2015: 29 · 2014: 7
Type: posted content
Language: en
Open access: green
arxiv.org
Licence: arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations: arXiv (Cornell University) (submittedVersion)
arXiv (Cornell University)
Funders: Canadian Institute for Advanced Research
Compute Canada
Canada Research Chairs
Defense Advanced Research Projects Agency
Natural Sciences and Engineering Research Council of Canada
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
Keywords: statistical machine translation, phrase representation, recurrent neural networks, encoder-decoder architecture, log-linear models, joint training

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks