PreprintCited by 3,317Natural Language Processing TechniquesTopic ModelingSpeech Recognition and Synthesis

The DOI matches its DataCite record; 26 of the 27 references it cites were found in a registry or an index.

Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation

Open access

Cho, Kyunghyun, van Merrienboer, Bart, Gulcehre, Caglar, Bahdanau, Dzmitry, Bougares, Fethi, Schwenk, Holger, Bengio, Yoshua·2014·arXiv

DOI 10.48550/arxiv.1406.1078arXiv 1406.1078

Open this paper in CoChat — free account Open PDF

Abstract

In this paper, we propose a novel neural network model called RNN Encoder-Decoder that consists of two recurrent neural networks (RNN). One RNN encodes a sequence of symbols into a fixed-length vector representation, and the other decodes the representation into another sequence of symbols. The encoder and decoder of the proposed model are jointly trained to maximize the conditional probability of a target sequence given a source sequence. The performance of a statistical machine translation system is empirically found to improve by using the conditional probabilities of phrase pairs computed by the RNN Encoder-Decoder as an additional feature in the existing log-linear model. Qualitatively, we show that the proposed model learns a semantically and syntactically meaningful representation of linguistic phrases.

Integrity signals

Registry

DataCite · 10.48550/arxiv.1406.1078

Cites

26 of 26 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Long Short-Term Memory
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Untitled work
(2011) · Cited by 6,993
Self-citation
ADADELTA: An Adaptive Learning Rate Method
Zeiler, M. D. (2012) · arXiv · doi:10.48550/arxiv.1212.5701 · Cited by 5,322
Statistical phrase-based translation
Koehn, P., Och, F. J., & Marcu, D. (2003) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/1073445.1073462 · Cited by 3,265
Untitled work
(2005) · Cited by 3,125
Supervised Sequence Labelling with Recurrent Neural Networks
Graves, A. (2012) · Studies in Computational Intelligence · doi:10.1007/978-3-642-24797-2 · Cited by 3,120
Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition
Dahl, G. E., Yu, D., Deng, L., & Acero, A. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2134090 · Cited by 3,011
Recurrent Continuous Translation Models
Kalchbrenner, N., & Blunsom, P. (2013) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d13-1176 · Cited by 1,277

Show all 27 references

Sorted by citations

Items 301–400 of 1,068

The University of Edinburgh's Neural MT Systems for WMT17
Sennrich, R., Birch, A., Currey, A., Germann, U., Haddow, B., Heafield, K., Barone, A. V. M., & Williams, P. J. (2017) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w17-4739 · Cited by 146
Low-resource Deep Entity Resolution with Transfer and Active Learning
Kasai, J., Qian, K., Gurajada, S., Li, Y., & Popa, L. C. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1586 · Cited by 157
Structural dynamics simulation using a novel physics-guided machine learning method
Yu, Y., Yao, H., & Liu, Y. (2020) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2020.103947 · Cited by 140
An empirical investigation into learning bug-fixing patches in the wild via neural machine translation
Tufano, M., Watson, C., Bavota, G., Penta, M. D., White, M., & Poshyvanyk, D. (2018) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3238147.3240732 · Cited by 142
Forecasting Horticultural Products Price Using ARIMA Model and Neural Network Based on a Large-Scale Data Set Collected by Web Crawler
Weng, Y., Wang, X., Hua, J., Wang, H., Kang, M., & Wang, F. (2019) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2019.2914499 · Cited by 133
Temporal Knowledge Graph Completion: A Survey
Cai, B., Xiang, Y., Gao, L., Zhang, H., Li, Y., & Li, J. (2023) · Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/734 · Cited by 133
Soft sensor model for dynamic processes based on multichannel convolutional neural network
Yuan, X., Qi, S., Shardt, Y. A. W., Wang, Y., Yang, C., & Gui, W. (2020) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2020.104050 · Cited by 137
A tutorial on solving ordinary differential equations using Python and hybrid physics-informed neural network
do Nascimento, R. G., Fricke, K., & Viana, F. A. C. (2020) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2020.103996 · Cited by 142
Deep reinforcement learning with shallow controllers: An experimental application to PID tuning
Lawrence, N. P., Forbes, M. G., Loewen, P. D., McClement, D. G., Backström, J. U., & Gopaluni, R. B. (2022) · Control Engineering Practice · doi:10.1016/j.conengprac.2021.105046 · Cited by 133
Region-Object Relation-Aware Dense Captioning via Transformer
Shao, Z., Han, J., Marnerides, D., & Debattista, K. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2022.3152990 · Cited by 134
Transformer-Based Language Models for Software Vulnerability Detection
Thapa, C., Jang, S. I., Ahmed, M. E., Camtepe, S. A., Pieprzyk, J., & Nepal‬, ‪. (2022) · Annual Computer Security Applications Conference · doi:10.1145/3564625.3567985 · Cited by 156
Deep Learning Inference in Facebook Data Centers: Characterization, Performance Optimizations and Hardware ImplicationsPreprint
Park, J., Naumov, M., Basu, P., Deng, S., Kalaiah, A., Khudia, D. S., Law, J., Malani, P., Malevich, A., Nadathur, S., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.09886 · Cited by 186
MovieGraphs: Towards Understanding Human-Centric Situations from Videos
Vicol, P. A., Tapaswi, M., Castrejón, L., & Fidler, S. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00895 · Cited by 130
Sequence-based prediction of protein-protein interaction sites by simplified long short-term memory network
Zhang, B., Li, J., Quan, L., Chen, Y., & Lü, Q. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.05.013 · Cited by 128
Graph Markov network for traffic forecasting with missing data
Cui, Z., Lin, L., Pu, Z., & Wang, Y. (2020) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2020.102671 · Cited by 129
Prediction of wastewater treatment quality using LSTM neural network
Farhi, N., Kohen, E., Mamane, H., & Shavitt, Y. (2021) · Environmental Technology & Innovation · doi:10.1016/j.eti.2021.101632 · Cited by 133
A Comprehensive Study of Activity Recognition Using Accelerometers
Twomey, N., Diethe, T., Fafoutis, X., Elsts, A., McConville, R., Flach, P., & Craddock, I. (2018) · Informatics · doi:10.3390/informatics5020027 · Cited by 143
Attention-Guided Neural Networks for Full-Reference and No-Reference Audio-Visual Quality Assessment
Cao, Y., Min, X., Sun, W., & Zhai, G. (2023) · IEEE Transactions on Image Processing · doi:10.1109/tip.2023.3251695 · Cited by 133
Deep learning for brain disorder diagnosis based on fMRI images
Yin, W., Li, L., & Wu, F. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.05.113 · Cited by 135
An Attention-Based Multilayer GRU Model for Multistep-Ahead Short-Term Load Forecasting
Jung, S., Moon, J., Park, S., & Hwang, E. (2021) · Sensors · doi:10.3390/s21051639 · Cited by 134
TimeNet: Pre-trained deep recurrent neural network for time series classificationPreprint
Malhotra, P., Tv, V., Vig, L., Agarwal, P., & Shroff, G. M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.08838 · Cited by 180
Cyberbullying Detection: Hybrid Models Based on Machine Learning and Natural Language Processing Techniques
Raj, C., Agarwal, A., Bharathy, G., Narayan, B., & Prasad, M. (2021) · Electronics · doi:10.3390/electronics10222810 · Cited by 128
What-and-where to match: Deep spatially multiplicative integration networks for person re-identification
Wu, L. Y., Wang, Y., Li, X., & Gao, J. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.10.004 · Cited by 127
An empirical case study on Indian consumers' sentiment towards electric vehicles: A big data analytics approach
Jena, R. K. (2020) · Industrial Marketing Management · doi:10.1016/j.indmarman.2019.12.012 · Cited by 137
Deep machine learning with Sentinel satellite data to map paddy rice production stages across West Java, Indonesia
Thorp, K. R., & Drajat, D. (2021) · Remote Sensing of Environment · doi:10.1016/j.rse.2021.112679 · Cited by 139
A Framework for Fall Detection Based on OpenPose Skeleton and LSTM/GRU Models
Lin, C.-B., Dong, Z., Kuan, W.-K., & Huang, Y. (2020) · Applied Sciences · doi:10.3390/app11010329 · Cited by 132
Image-Grounded Conversations: Multimodal Context for Natural Question and Response GenerationPreprint
Mostafazadeh, N., Brockett, C., Dolan, B., Galley, M., Gao, J., Spithourakis, G., & Vanderwende, L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.08251 · Cited by 125
Black-Box Attacks against RNN based Malware Detection AlgorithmsPreprint
Hu, W., & Tan, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.08131 · Cited by 130
Multilogue-Net: A Context-Aware RNN for Multi-modal Emotion Detection and Sentiment Analysis in Conversation
Shenoy, A., & Sardana, A. (2020) · doi:10.18653/v1/2020.challengehml-1.3 · Cited by 124
Predicting citation counts based on deep neural network learning techniques
Abrishami, A., & Aliakbary, S. (2019) · RePEc: Research Papers in Economics · Cited by 124
Can neural machine translation do simultaneous translation?Preprint
Cho, K., & Esipova, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.02012 · Cited by 188
Self-citation
Glance and Focus: a Dynamic Approach to Reducing Spatial Redundancy in Image ClassificationPreprint
Wang, Y., Lv, K., Huang, R., Song, S., Yang, L., & Huang, G. M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.05300 · Cited by 131
Link the Head to the "Beak": Zero Shot Learning from Noisy Text Description at Part Precision
Elhoseiny, M., Zhu, Y., Zhang, H., & Elgammal, A. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.666 · Cited by 123
Deep Learning for Natural Language Processing
Xie, Y., Le, L., Zhou, Y., & Raghavan, V. V. (2018) · Handbook of statistics · doi:10.1016/bs.host.2018.05.001 · Cited by 123
Lifelong Sequential Modeling with Personalized Memorization for User Response Prediction
Ren, K., Qin, J., Fang, Y., Zhang, W., Zheng, L., Bian, W., Zhou, G., Xu, J., Yu, Y. H., Zhu, X., et al. (2019) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3331184.3331230 · Cited by 127
Learning short-text semantic similarity with word embeddings and external knowledge sources
Nguyen, H. P. N., Duong, P. H., & Cambria, E. (2019) · Knowledge-Based Systems · doi:10.1016/j.knosys.2019.07.013 · Cited by 132
The Comparison of Predicting Storm-Time Ionospheric TEC by Three Methods: ARIMA, LSTM, and Seq2Seq
Tang, R., Zeng, F., Chen, Z., Wang, J., Huang, C., & Wu, Z. (2020) · Atmosphere · doi:10.3390/atmos11040316 · Cited by 126
Boosting Continuous Sign Language Recognition via Cross Modality Augmentation
Pu, J., Zhou, W., Hu, H., & Li, H. (2020) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3394171.3413931 · Cited by 124
Weighted Transformer Network for Machine TranslationPreprint
Ahmed, K., Keskar, N. S., & Socher, R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.02132 · Cited by 152
Recurrent neural network closure of parametric POD-Galerkin reduced-order models based on the Mori-Zwanzig formalism
Wang, Q., Ripamonti, N., & Hesthaven, J. S. (2020) · Journal of Computational Physics · doi:10.1016/j.jcp.2020.109402 · Cited by 123
Generative Network Complex for the Automated Generation of Drug-like Molecules
Gao, K., Nguyen, D. D., Tu, M., & Wei, G. (2020) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.0c00599 · Cited by 123
A Review of Time-Series Forecasting Algorithms for Industrial Manufacturing Systems
Fatima, S. S. W., & Rahimi, A. (2024) · Machines · doi:10.3390/machines12060380 · Cited by 154
ROMA: Multi-Agent Reinforcement Learning with Emergent RolesPreprint
Wang, T., Dong, H., Lesser, V., & Zhang, C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.08039 · Cited by 191
Improved Neural Machine Translation with SMT Features
He, W. P., He, Z., Wu, H. R., & Wang, H. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.9983 · Cited by 118
Deep learning for big data applications in CAD and PLM – Research review, opportunities and case study
Dekhtiar, J., Durupt, A., Bricogne, M., Eynard, B., Rowson, H., & Kiritsis, D. (2018) · Computers in Industry · doi:10.1016/j.compind.2018.04.005 · Cited by 125
Neural Relation Extraction for Knowledge Base Enrichment
Trisedya, B. D., Weikum, G., Qi, J., & Zhang, R. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1023 · Cited by 127
Machine learning techniques for hate speech classification of twitter data: State-of-the-art, future challenges and research directions
Ayo, F. E., Folorunso, O. O., Ibharalu, F. T., & Osinuga, I. A. (2020) · Computer Science Review · doi:10.1016/j.cosrev.2020.100311 · Cited by 131
The effect of calibration data length on the performance of a conceptual hydrological model versus LSTM and GRU: A case study for six basins from the CAMELS dataset
Ayzel, G., & Heistermann, M. (2021) · Computers & Geosciences · doi:10.1016/j.cageo.2021.104708 · Cited by 122
Research and applications of artificial neural network in pavement engineering: A state-of-the-art review
Yang, X., Guan, J., Ding, L., You, Z., Lee, V. C. S., Hasan, M. R. M., & Cheng, X. (2021) · Journal of Traffic and Transportation Engineering (English Edition) · doi:10.1016/j.jtte.2021.03.005 · Cited by 127
Predicting Expressive Speaking Style from Text in End-To-End Speech Synthesis
Stanton, D., Wang, Y., & Skerry-Ryan, R. (2018) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2018.8639682 · Cited by 116
Neural Language Correction with Character-Based AttentionPreprint
Xie, Z., Avati, A., Arivazhagan, N., Jurafsky, D., & Ng, A. Y. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.09727 · Cited by 116
Deep Learning for User Comment Moderation
Pavlopoulos, J., Malakasiotis, P., & Androutsopoulos, I. (2017) · Workshop on Abusive Language Online (ALW) · doi:10.18653/v1/w17-3004 · Cited by 136
Streaming Keyword Spotting on Mobile Devices
Rybakov, O., Kononenko, N., Subrahmanya, N., Visontai, M., & Laurenzo, S. (2020) · Interspeech (USB) · doi:10.21437/interspeech.2020-1003 · Cited by 132
DeepIDS: Deep Learning Approach for Intrusion Detection in Software Defined Networking
Tang, T. A., Mhamdi, L., McLernon, D., Zaidi, S. A. R., Ghogho, M., & El-Moussa, F. A. (2020) · Electronics · doi:10.3390/electronics9091533 · Cited by 115
A new ANN based crystal plasticity model for FCC materials and its application to non-monotonic strain paths
Ibragimova, O., Brahme, A. P., Muhammad, W., Lévesque, J., & Inal, K. (2021) · International Journal of Plasticity · doi:10.1016/j.ijplas.2021.103059 · Cited by 114
Sequence to Sequence Model Performance for Education Chatbot
Palasundram, K., Sharef, N. M., Nasharuddin, N. A., Kasmiran, K. A., & Azman, A. (2019) · International Journal of Emerging Technologies in Learning (iJET) · doi:10.3991/ijet.v14i24.12187 · Cited by 114
Anomaly detection based on machine learning in IoT-based vertical plant wall for indoor climate control
Liu, Y., Pang, Z., Karlsson, M., & Gong, S. (2020) · Building and Environment · doi:10.1016/j.buildenv.2020.107212 · Cited by 114
Sequence-based dynamic handwriting analysis for Parkinson’s disease detection with one-dimensional convolutions and BiGRUs
Díaz, M., Moetesum, M., Siddiqi, I., & Vessio, G. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.114405 · Cited by 124
Learning Intrinsic Sparse Structures within Long Short-Term MemoryPreprint
Wen, W., He, Y., Rajbhandari, S., Zhang, M., Wang, W., Liu, F., Hu, B., Chen, Y., & Li, H. H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.05027 · Cited by 126
Propagation2Vec: Embedding partial propagation networks for explainable fake news early detection
Silva, A., Han, Y., Luo, L., Karunasekera, S. A., & Leckie, C. A. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102618 · Cited by 115
Imagination improves Multimodal TranslationPreprint
Elliott, D., & Kádár, Á. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.04350 · Cited by 126
Towards Unsupervised Image Captioning With Shared Multimodal Embeddings
Laina, I., Rupprecht, C., & Navab, N. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00751 · Cited by 111
Hardware Acceleration of Sparse and Irregular Tensor Computations of ML Models: A Survey and Insights
Dave, S., Baghdadi, R., Nowatzki, T., Avancha, S., Shrivastava, A., & Li, B. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3098483 · Cited by 120
State-of-charge estimation of lithium-ion battery based on clockwork recurrent neural network
Xiong, F., Chen, J., Zhang, Z., Miao, S., & Zhu, Q. (2021) · Energy · doi:10.1016/j.energy.2021.121360 · Cited by 111
MC-LSTM: Mass-Conserving LSTMPreprint
Hoedt, P.-J., Kratzert, F., Klotz, D., Halmich, C., Holzleitner, M., Nearing, G., Hochreiter, S., & Klambauer, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.05186 · Cited by 142
Sequence-to-Dependency Neural Machine Translation
Wu, S., Zhang, D., Yang, N., Li, M., & Zhou, M. Q. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1065 · Cited by 112
A hybrid unsupervised method for aspect term and opinion target extraction
Wu, C., Wu, F., Wu, S., Yuan, Z., & Huang, Y. (2018) · Knowledge-Based Systems · doi:10.1016/j.knosys.2018.01.019 · Cited by 110
Machine Learning in Resource-Scarce Embedded Systems, FPGAs, and End-Devices: A Survey
Branco, S., Ferreira, A. G., & Cabral, J. (2019) · Electronics · doi:10.3390/electronics8111289 · Cited by 110
Soft Electronics for Health Monitoring Assisted by Machine Learning
Qiao, Y., Luo, J., Cui, T., Liu, H., Tang, H., Zeng, Y.-F., Liu, C., Li, Y., Jian, J., Wu, J., et al. (2023) · Nano-Micro Letters · doi:10.1007/s40820-023-01029-1 · Cited by 121
Learning Longer-term Dependencies in RNNs with Auxiliary LossesPreprint
Trinh, T. H., Dai, A. M., Luong, M.-T., & Le, Q. V. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.00144 · Cited by 140
Blood Pressure Morphology Assessment from Photoplethysmogram and Demographic Information Using Deep Learning with Attention Mechanism
Aguirre, N. A., Grall‐Maës, E., Cymberknop, L. J., & Armentano, R. L. (2021) · Sensors · doi:10.3390/s21062167 · Cited by 115
GRU-based deep learning approach for network intrusion alert prediction
Ansari, M. S., Bartoš, V., & Lee, B. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2021.09.040 · Cited by 109
Hour-Ahead Solar Irradiance Forecasting Using Multivariate Gated Recurrent Units
Wojtkiewicz, J., Hosseini, M., Gottumukkala, R. N., & Chambers, T. L. (2019) · Energies · doi:10.3390/en12214055 · Cited by 108
ALDONAr: A hybrid solution for sentence-level aspect-based sentiment analysis using a lexicalized domain ontology and a regularized neural attention model
Meškelė, D., & Frăsincar, F. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2020.102211 · Cited by 117
Robust Multimodal Emotion Recognition from Conversation with Transformer-Based Crossmodality Fusion
Xie, B., Sidulova, M., & Park, C. H. (2021) · Sensors · doi:10.3390/s21144913 · Cited by 108
An Overview on Generative AI at Scale With Edge–Cloud Computing
Wang, Y.-C., Xue, J., Wei, C., & Kuo, C. ‐. J. (2023) · IEEE Open Journal of the Communications Society · doi:10.1109/ojcoms.2023.3320646 · Cited by 124
Cellular Traffic Prediction and Classification: A Comparative Evaluation of LSTM and ARIMA
Azari, A., Papapetrou, P., Denic, S. Z., & Peters, G. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-33778-0_11 · Cited by 107
Deep Generative Models in De Novo Drug Molecule Generation
Pang, C., Qiao, J., Zeng, X., Zou, Q., & Wei, L. (2023) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.3c01496 · Cited by 113
Bidirectional deep recurrent neural networks for process fault classification
Chadha, G. S., Panambilly, A., Schwung, A., & Ding, S. X. (2020) · ISA Transactions · doi:10.1016/j.isatra.2020.07.011 · Cited by 108
k-Nearest Neighbor Learning with Graph Neural Networks
Kang, S. (2021) · Mathematics · doi:10.3390/math9080830 · Cited by 105
A novel deep learning-based modelling strategy from image of particles to mechanical properties for granular materials with CNN and BiLSTM
Zhang, P., & Yin, Z. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.113858 · Cited by 106
Decoding spoken English from intracortical electrode arrays in dorsal precentral gyrus
Wilson, G. H., Stavisky, S. D., Willett, F. R., Avansino, D. T., Kelemen, J. N., Hochberg, L. R., Henderson, J. M., Druckmann, S., & Shenoy, K. V. (2020) · Journal of Neural Engineering · doi:10.1088/1741-2552/abbfef · Cited by 103
Automated audio captioning with recurrent neural networks
Drossos, K., Adavanne, S., & Virtanen, T. I. (2017) · IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) · doi:10.1109/waspaa.2017.8170058 · Cited by 102
Use of Health Belief Model–Based Deep Learning Classifiers for COVID-19 Social Media Content to Examine Public Perceptions of Physical Distancing: Model Development and Case Study
Raamkumar, A. S., Tan, S. G., & Wee, H. L. (2020) · JMIR Public Health and Surveillance · doi:10.2196/20493 · Cited by 112
A hybrid prognostic method based on gated recurrent unit network and an adaptive Wiener process model considering measurement errors
Chen, Z., Xia, T., Li, Y., & Pan, E. (2021) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2021.107785 · Cited by 103
Workload forecasting and energy state estimation in cloud data centres: ML-centric approach
Khan, T., Tian, W., Ilager, S., & Buyya, R. (2021) · Future Generation Computer Systems · doi:10.1016/j.future.2021.10.019 · Cited by 102
Cascaded multi-modal mixing transformers for Alzheimer’s disease classification with incomplete data
Liu, L., Liu, S., Zhang, L., To, X. V., Nasrallah, F., & Chandra, S. S. (2023) · NeuroImage · doi:10.1016/j.neuroimage.2023.120267 · Cited by 101
Optimizing risk-based breast cancer screening policies with reinforcement learning
Yala, A., Mikhael, P. G., Lehman, C., Lin, G., Strand, F., Wan, Y.-L., Hughes, K., Satuluru, S., Kim, T., Banerjee, I., et al. (2022) · Nature Medicine · doi:10.1038/s41591-021-01599-w · Cited by 103
Inferring Which Medical Treatments Work from Reports of Clinical Trials
Lehman, E., DeYoung, J., Barzilay, R., & Wallace, B. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1371 · Cited by 114
ECG Identification For Personal Authentication Using LSTM-Based Deep Recurrent Neural Networks
Kim, B.-H., & Pyun, J.-Y. (2020) · Sensors · doi:10.3390/s20113069 · Cited by 110
CharBERT: Character-aware Pre-trained Language Model
Ma, W., Cui, Y., Si, C., Liu, T., Wang, S., & Hu, G. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.4 · Cited by 127
LSTM-Based System-Call Language Modeling and Robust Ensemble Method for Designing Host-Based Intrusion Detection SystemsPreprint
Kim, G., Yi, H., Lee, J., Paek, Y., & Yoon, S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01726 · Cited by 130
Style Transfer as Unsupervised Machine TranslationPreprint
Zhang, Z., Ren, S., Liu, S., Wang, J., Chen, P., Li, M., Zhou, M. Q., & Chen, E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.07894 · Cited by 125
Text Data Augmentation Made Simple By Leveraging NLP Cloud APIsPreprint
Coulombe, C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.04718 · Cited by 168
IMU-to-Segment Assignment and Orientation Alignment for the Lower Body Using Deep Learning
Zimmermann, T., Taetz, B., & Bleser, G. (2018) · Sensors · doi:10.3390/s18010302 · Cited by 105
Sequential Variational Autoencoders for Collaborative Filtering
Sachdeva, N., Manco, G., Ritacco, E., & Pudi, V. (2019) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3289600.3291007 · Cited by 99
Block-Sparse Recurrent Neural NetworksPreprint
Narang, S., Undersander, E., & Diamos, G. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.02782 · Cited by 135
A Review on Deep-Learning-Based Cyberbullying Detection
Hasan, M. T., Hossain, M. A. E., Mukta, M. S. H., Akter, A., Ahmed, M., & Islam, S. (2023) · Future Internet · doi:10.3390/fi15050179 · Cited by 103
Semi-supervised Question Retrieval with Gated Convolutions
Lei, T., Joshi, H., Barzilay, R., Jaakkola, T., Tymoshenko, K., Moschitti, A., & Màrquez, L. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1153 · Cited by 101
Using Natural Language for Reward Shaping in Reinforcement Learning
Goyal, P., Niekum, S., & Mooney, R. J. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/331 · Cited by 106

Authors: Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y.
Affiliations: Université de Montréal (CA)
Constructor University (DE)
Le Mans Université (FR)
Corresponding author: Bahdanau, Dzmitry
ORCID: Cho, Kyunghyun
Bougares, Fethi
Bengio, Yoshua
Venue: arXiv
Publisher: arXiv
Published: 2014
ISSN: 2331-8422 (ISSN-L)
DOI: 10.48550/arxiv.1406.1078
arXiv: 1406.1078
OpenAlex: W2950635152
Cited by: 3,317
References: 27
Citations by year: 2026: 335 · 2025: 348 · 2024: 369 · 2023: 216 · 2022: 93 · 2021: 434 · 2020: 495 · 2019: 436 · 2018: 296 · 2017: 172 · 2016: 87 · 2015: 29 · 2014: 7
Type: posted content
Language: en
Open access: green
arxiv.org
Licence: arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations: arXiv (Cornell University) (submittedVersion)
arXiv (Cornell University)
Funders: Canadian Institute for Advanced Research
Compute Canada
Canada Research Chairs
Defense Advanced Research Projects Agency
Natural Sciences and Engineering Research Council of Canada
Topics: Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
Keywords: statistical machine translation, phrase representation, recurrent neural networks, encoder-decoder architecture, log-linear models, joint training

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks