Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Open accessThe DOI matches its Crossref record; 29 of the 31 references it cites were found in a registry or an index.
Abstract
Kyunghyun Cho, Bart van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, Yoshua Bengio. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). 2014.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“GRU [185] is a variant based on the LSTM, which only contains an update gate and reset gate and has a faster training speed than the LSTM with fewer parameters.”
From Deep Learning for Structural Health Monitoring: Data, Algorithms, Applications, Challenges, and Trends (2023) · cites this paper as [185]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“They are thus well-suited for detecting dependencies and patterns in language-like input.”
From The role of pragmatic mechanisms in referential communication and categorization: An emergent communication model (2026) · cites this paper as [87]
The cited source says what the claim attributes to it.
In the citing paper
“GRU cells are a specific type of Recurrent Neural Networks (RNNs) which have been proven useful for dealing with sequence data such as language.”
From The role of pragmatic mechanisms in referential communication and categorization: An emergent communication model (2026) · cites this paper as [87]
The cited source says what the claim attributes to it.
In the citing paper
“Early work [139-141] mainly relied on recurrent neural networks (e.g., LSTM [142], GRU [143]). Limited by the model's expressiveness, they often suffer from the issue of insufficient diversity.”
From When large language models meet personalization: perspectives of challenges and opportunities (2024) · cites this paper as [143]
The cited source says what the claim attributes to it.
In the citing paper
“Moreover, [Tang et al., 2020] adopts GRU [Cho et al., 2014] on the sequence of hyperplanes to further capture the dynamics among hyperplanes.”
From Temporal Knowledge Graph Completion: A Survey (2023) · cites this paper as Cho et al., 2014
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 1×
“At each time step t , the hidden state h t (cid:105) of the RNN is updated by where f is a non-linear activation function. f may be as simple as an element-wise logistic sigmoid function and as complex as a long short-term memory (LSTM) unit (Hochreiter and Schmidhuber, 1997).”
BackgroundDistributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533 · cited 1×
“We have done so by applying the data selection method proposed in (Moore and Lewis, 2010), and its extension to bi-texts (Axelrod et al., 2011).”
Method(2011) · Cited by 6,993
Self-citationADADELTA: An Adaptive Learning Rate Method
Zeiler, M. D. (2012) · arXiv · doi:10.48550/arxiv.1212.5701 · Cited by 5,322 · cited 2×
“95 (Zeiler, 2012).”
MethodStatistical phrase-based translation
Koehn, P., Och, F. J., & Marcu, D. (2003) · Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - NAACL '03 · doi:10.3115/1073445.1073462 · Cited by 3,197 · cited 2×
“In the phrase-based SMT framework introduced in (Koehn et al., 2003) and (Marcu and Wong, 2002), the translation model log p ( e | f ) is factorized into the translation probabilities of matching phrases in the source and target sentences.”
Method(2005) · Cited by 3,125
Supervised Sequence Labelling with Recurrent Neural Networks
Graves, A. (2012) · Studies in Computational Intelligence · doi:10.1007/978-3-642-24797-2 · Cited by 3,120
Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition
Dahl, G. E., Yu, D., Deng, L., & Acero, A. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2134090 · Cited by 3,011 · cited 1×
“Deep neural networks have shown great success in various applications such as objection recognition (see, e.g., (Krizhevsky et al., 2012)) and speech recognition (see, e.g., (Dahl et al., 2012)).”
BackgroundRecurrent Continuous Translation Models
Kalchbrenner, N., & Blunsom, P. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1176 · Cited by 1,232 · cited 1×
“The closest approach related to the proposed RNN Encoder–Decoder is the Recurrent Continuous Translation Model (Model 2) proposed in (Kalchbrenner and Blunsom, 2013).”
Method
Cited by
Items 701–800 of 1,296
Learning to Transduce with Unbounded Memory
Grefenstette, E., Hermann, K. M., Suleyman, M., & Blunsom, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.02516 · Cited by 132
“Machine translation is a prototypical example of transduction and recent results indicate that Deep RNNs have the ability to encode long source strings and produce coherent translations [1, 2].”
BackgroundResultDialogueCRN: Contextual Reasoning Networks for Emotion Recognition in Conversations
Hu, D., Wei, L., & Huai, X. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.547 · Cited by 238
Temporal Attention-Augmented Bilinear Network for Financial Time-Series Data Analysis
Tran, D. T., Iosifidis, A., Kanniainen, J., & Gabbouj, M. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2869225 · Cited by 238
“Representative examples include natural language processing [1], [2], [3], medical data analysis [4], [5], human action/behavior analysis [6], [7], [8], meteorology [9], finance and econometrics [10], [11], [12] and generic time-series classification [13], [14].”
BackgroundSpatio-Temporal Dynamics and Semantic Attribute Enriched Visual Encoding for Video Captioning
Aafaq, N., Akhtar, N., Liu, W., Gilani, S. Z., & Mian, A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.01277 · Cited by 237
Hopfield Networks is All You Need
Ramsauer, H., Schäfl, B., Lehner, J., Seidl, P., Widrich, M., Adler, T., Gruber, L., Holzleitner, M., Pavlović, M., Sandve, G. K., et al. (2020) · arXiv · doi:10.48550/arxiv.2008.02217 · Cited by 879
“Optionally, for substituting GRU & LSTM layers, positional encoding might be considered.”
MethodInfluentialA Multi-Horizon Quantile Recurrent Forecaster
Wen, R., Torkkola, K., Narayanaswamy, B., & Madeka, D. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.11053 · Cited by 236
“The MQ-RNN architecture resembles the Seq2Seq with context (Seq2SeqC, Figure 1a) proposed by Cho et al, 2014.”
MethodDual Encoding for Zero-Example Video Retrieval
Dong, J., Li, X., Xu, C., Ji, S., He, Y., Yang, G., & Wang, X. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00957 · Cited by 236
Chellapandi, V. P., Yuan, L., Brinton, C. G., Żak, S. H., & Wang, Z. (2024) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2023.3332675 · Cited by 236
Toward Multilingual Neural Machine Translation with Universal Encoder and Decoder
Ha, T.-L., Niehues, J., & Waibel, A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.04798 · Cited by 236
BiERU: Bidirectional emotional recurrent unit for conversational sentiment analysis
Li, W., Shao, W., Ji, S., & Cambria, E. (2022) · Neurocomputing · doi:10.1016/j.neucom.2021.09.057 · Cited by 236
Rao, H., Xu, S., Hu, X., Cheng, J., & Hu, B. (2021) · Information Sciences · doi:10.1016/j.ins.2021.04.023 · Cited by 235
Recurrent Fully Convolutional Neural Networks for Multi-slice MRI Cardiac Segmentation
Poudel, R. P. K., Lamata, P., & Montana, G. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-52280-7_8 · Cited by 234
Fully Supervised Speaker Diarization
Zhang, A., Wang, Q., Zhu, Z., Paisley, J., & Wang, C. (2019) · ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2019.8683892 · Cited by 234
Deep Attention-Based Spatially Recursive Networks for Fine-Grained Visual Recognition
Wu, L., Wang, Y., Li, X., & Gao, J. (2019) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2018.2813971 · Cited by 234
Lai, V. D., Ngo, N. T., Veyseh, A. P. B., Man, H., Dernoncourt, F., Bui, T., & Nguyen, T. H. (2023) · arXiv · doi:10.48550/arxiv.2304.05613 · Cited by 233
“the shift of NLP from feature-engineering methods to representation learning with deep learning, the major milestones in NLP involve the presentation of the seq2seq or encoder-decoder framework (Cho et al., 2014; Sutskever et al., 2014) for text genera-”
BackgroundMethodLai, V., Ngo, N., Pouran Ben Veyseh, A., Man, H., Dernoncourt, F., Bui, T., & Nguyen, T. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.878 · Cited by 233
Reversible Architectures for Arbitrarily Deep Residual Neural Networks
Chang, B., Meng, L., Haber, E., Ruthotto, L., Begert, D., & Holtham, E. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11668 · Cited by 233
Collision Avoidance in Pedestrian-Rich Environments With Deep Reinforcement Learning
Everett, M., Chen, Y. F., & How, J. P. (2021) · IEEE Access · doi:10.1109/access.2021.3050338 · Cited by 233
“This work instead uses an idea from Natural Language Processing [12], [13] to encode the varying size state of the world (e.”
MethodMou, L., & Zhu, X. X. (2020) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2019.2933609 · Cited by 233
PlotQA: Reasoning over Scientific Plots
Methani, N., Ganguly, P., Khapra, M. M., & Kumar, P. (2020) · 2020 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv45572.2020.9093523 · Cited by 154
The survey: Text generation models in deep learning
Iqbal, T., & Qureshi, S. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2020.04.001 · Cited by 232
Thakkar, A., & Chaudhari, K. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.114800 · Cited by 232
A Review on Graph Neural Network Methods in Financial Applications
Wang, J., Zhang, S., Xiao, Y., & Song, R. (2022) · Journal of Data Science · doi:10.6339/22-jds1047 · Cited by 259
Federated Learning for Emoji Prediction in a Mobile Keyboard
Ramaswamy, S., Mathews, R., Rao, K., & Beaufays, F. (2019) · arXiv · doi:10.48550/arxiv.1906.04329 · Cited by 231
“As with Gated Recurrent Units (Cho et al., 2014), the CIFG uses a single gate to control both the input and recurrent cell self-connections.”
MethodEarly Prediction of Sepsis in the ICU Using Machine Learning: A Systematic Review
Moor, M., Rieck, B., Horn, M., Jutzeler, C. R., & Borgwardt, K. (2021) · Frontiers in Medicine · doi:10.3389/fmed.2021.607952 · Cited by 231
Where-and-When to Look: Deep Siamese Attention Networks for Video-Based Person Re-Identification
Wu, L., Wang, Y., Gao, J., & Li, X. (2019) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2018.2877886 · Cited by 231
Multimodal Language Analysis with Recurrent Multistage Fusion
Liang, P. P., Liu, Z., Bagher Zadeh, A., & Morency, L.-P. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1014 · Cited by 230
Deep Reinforcement Learning for Sequence-to-Sequence Models
Keneshloo, Y., Shi, T., Ramakrishnan, N., & Reddy, C. K. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2019.2929141 · Cited by 230
Principal Neighbourhood Aggregation for Graph Nets
Corso, G., Cavalleri, L., Beaini, D., Lió, P., & Veličković, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.05718 · Cited by 230
Montes de Oca Zapiain, D., Stewart, J. A., & Dingreville, R. (2021) · npj Computational Materials · doi:10.1038/s41524-020-00471-8 · Cited by 230
A Review on Speech Emotion Recognition Using Deep Learning and Attention Mechanism
Lieskovská, E., Jakubec, M., Jarina, R., & Chmulík, M. (2021) · Electronics · doi:10.3390/electronics10101163 · Cited by 230
Vision-language models for medical report generation and visual question answering: a review
Hartsock, I., & Rasool, G. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1430984 · Cited by 229
Joshi, A., Pradhan, B., Gite, S., & Chakraborty, S. (2023) · Remote Sensing · doi:10.3390/rs15082014 · Cited by 229
“RNNs developed to solve vanishing-or exploding-gradient problems [69].”
A novel time series forecasting model with deep learning
Shen, Z., Zhang, Y., Lu, J., Xu, J., & Xiao, G. (2020) · Neurocomputing · doi:10.1016/j.neucom.2018.12.084 · Cited by 228
Predicting Citywide Crowd Flows in Irregular Regions Using Multi-View Graph Convolutional Networks
Sun, J., Zhang, J., Li, Q., Yi, X., Liang, Y., & Zheng, Y. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3008774 · Cited by 253
Deep Learning in Protein Structural Modeling and Design
Gao, W., Mahajan, S. P., Sulam, J., & Gray, J. J. (2020) · Patterns · doi:10.1016/j.patter.2020.100142 · Cited by 227
Ray, B., Garain, A., & Sarkar, R. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106935 · Cited by 227
Attention-based interpretable neural network for building cooling load prediction
Li, A., Xiao, F., Zhang, C., & Fan, C. (2021) · Applied Energy · doi:10.1016/j.apenergy.2021.117238 · Cited by 227
Recognizing functions in binaries with neural networks
Shin, E. C. R., Song, D. X., & Moazzezi, R. (2015) · USENIX Security Symposium · Cited by 322
Xu, J., Ren, X., Lin, J., & Sun, X. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1428 · Cited by 134
Yu, M., Niu, D., Gao, T. B., Wang, K., Sun, L., Li, M., & Xu, X. (2023) · Energy · doi:10.1016/j.energy.2023.126738 · Cited by 231
Learning to Track with Object Permanence
Tokmakov, P., Li, J., Burgard, W., & Gaidon, A. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01068 · Cited by 226
“At each time step t, the corresponding feature map F t is passed to the ConvGRU, together with the previous state M t−1 to compute the updated state M t = GRU(M t−1, F t).”
MethodInfluentialOn the Practical Computational Power of Finite Precision RNNs for Language Recognition
Weiss, G., Goldberg, Y., & Yahav, E. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p18-2117 · Cited by 226
Zhang, C., Sjarif, N. N. A., & Ibrahim, R. (2023) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1519 · Cited by 282
“1D CNNs can learn hierarchical representations by stacking multiple convolutional layers, where lower layers capture simple local features and higher layers capture more complex global patterns.”
InfluentialEnsemble of deep sequential models for credit card fraud detection
Forough, J., & Momtazi, S. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106883 · Cited by 225
Modeling Human Motion with Quaternion-Based Neural Networks
Pavllo, D., Feichtenhofer, C., Auli, M., & Grangier, D. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-019-01245-6 · Cited by 152
70 years of machine learning in geoscience in review
Dramsch, J. S. (2020) · Technical University of Denmark, DTU Orbit (Technical University of Denmark, DTU) · Cited by 246
Graph2Seq: Graph to Sequence Learning with Attention-based Neural NetworksPreprint
Xu, K., Wu, L., Wang, Z., Feng, Y., Witbrock, M., & Sheinin, V. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.00823 · Cited by 251
“Graph-to-sequence tasks can be treated as machine translation (MT) problems which has been explored by many neural network models such as sequence-to-sequence [21, 4], tree-to-sequence models [7].”
BackgroundXL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languages
Hasan, T., Bhattacharjee, A., Islam, M. S., Mubasshir, K., Li, Y.-F., Kang, Y.-B., Rahman, M. S., & Shahriyar, R. (2021) · Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 · doi:10.18653/v1/2021.findings-acl.413 · Cited by 224
A critical review of state‐of‐the‐art chatbot designs and applications
Luo, B., Lau, R. Y. K., Li, C., & Si, Y. (2022) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1434 · Cited by 224
“Following a recurrent mechanism similar to the hidden layers in RNN, the output sequence y 1 to y 3 is generated as a complete sentence (Cho et al., 2014; Sutskever et al., 2014).”
BackgroundSAFE: Self-Attentive Function Embeddings for Binary Similarity
Massarelli, L., Di Luna, G. A., Petroni, F., Baldoni, R., & Querzoni, L. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-22038-9_15 · Cited by 224
Memory Augmented Graph Neural Networks for Sequential Recommendation
Ma, C., Ma, L., Zhang, Y., Sun, J., Liu, X., & Coates, M. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5945 · Cited by 224
Reservoir Computing Approaches for Representation and Classification of Multivariate Time Series
Bianchi, F. M., Scardapane, S., Lokse, S., & Jenssen, R. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3001377 · Cited by 224
“The second-best accuracy is obtained by oneNN with DTW, while the classifiers based on LSTM and GRU perform only better than lESN.”
BackgroundInfluentialLSTM-MSNet: Leveraging Forecasts on Sets of Related Time Series With Multiple Seasonal Patterns
Bandara, K., Bergmeir, C., & Hewamalage, H. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2985720 · Cited by 224
“To compare against the LSTM cell, we use popular RNN units, namely, the Elman RNN (ERNN) cell [56] and the GRU cell [57], which are commonly used for sequence modeling tasks.”
MethodNeural Paraphrase Generation with Stacked Residual LSTM Networks
Prakash, A., Hasan, S. A., Lee, K., Datla, V. V., Qadir, A., Liu, J., & Farri, O. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.03098 · Cited by 223
Wen, Y., Fashiar Rahman, M., Xu, H., & Tseng, T.-L. B. (2022) · Measurement · doi:10.1016/j.measurement.2021.110276 · Cited by 223
A new hybrid deep learning model for human action recognition
Jaouedi, N., Boujnah, N., & Bouhlel, M. S. (2020) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2019.09.004 · Cited by 223
“Cho et al. (2014) created, a simplify model of LSTM unit, the Gated Recurrent Unit (GRU).”
Graph HyperNetworks for Neural Architecture SearchPreprint
Zhang, C., Ren, M., & Urtasun, R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.05749 · Cited by 233
“U is often modeled with a long short-term memory (LSTM) unit (Hochreiter & Schmidhuber, 1997) or gated recurrent unit (GRU) (Cho et al., 2014), and M with an MLP.”
MethodControlling Output Length in Neural Encoder-Decoders
Kikuchi, Y., Neubig, G., Sasano, R., Takamura, H., & Okumura, M. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1140 · Cited by 222
“Since its first use for machine translation (Kalch-brenner and Blunsom, 2013; Cho et al., 2014; Sutskever et al., 2014), the encoder-decoder approach has demonstrated great success in many other sequence generation tasks including image caption generation (Vinyals et al., 2015b; Xu et al., 2015),…”
BackgroundMethodCrop yield prediction integrating genotype and weather variables using deep learning
Shook, J., Gangopadhyay, T., Wu, L., Ganapathysubramanian, B., Sarkar, S., & Singh, A. K. (2021) · PLOS ONE · doi:10.1371/journal.pone.0252402 · Cited by 222
“Attention-based model [34] was originally introduced for neural machine translation to outperform the encoder-decoder model [22, 35].”
BackgroundMethod70 years of machine learning in geoscience in review
(2020) · Advances in Geophysics · doi:10.1016/bs.agph.2020.08.002 · Cited by 222
“Siamese networks for one-shot image analysis [Koch et al., 2015], transformer networks that largely replaced LSTM and GRU in language modelling [Vaswani et al., 2017], or attention as a general mechanism in deep neural networks [Zheng et al., 2017].”
MethodA Novel Hybrid Deep Learning Model for Sentiment Classification
Salur, M. U., & Aydin, I. (2020) · IEEE Access · doi:10.1109/access.2020.2982538 · Cited by 222
Learning Molecular Representations for Medicinal Chemistry: Miniperspective
Chuang, K. V., Gunsalus, L. M., & Keiser, M. J. (2020) · Journal of Medicinal Chemistry · doi:10.1021/acs.jmedchem.0c00385 · Cited by 222
Grechishnikova, D. (2021) · Scientific Reports · doi:10.1038/s41598-020-79682-4 · Cited by 222
Deep Learning with Microfluidics for Biotechnology
Riordon, J., Sovilj, D., Sanner, S., Sinton, D., & Young, E. W. K. (2019) · Trends in Biotechnology · doi:10.1016/j.tibtech.2018.08.005 · Cited by 222
JUNIPR: a framework for unsupervised machine learning in particle physics
Andreassen, A., Feige, I., Frye, C., & Schwartz, M. D. (2019) · The European Physical Journal C · doi:10.1140/epjc/s10052-019-6607-9 · Cited by 235
Modeling Multi-turn Conversation with Deep Utterance AggregationPreprint
Zhang, Z., Li, J., Zhu, P., Zhao, H., & Liu, G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.09102 · Cited by 258
“To aggregate the matching information of the attentive turns in the last stage, The outputs of CNN, M = [ m 1 , ..., m n ] are fed to GRU to obtain where GRU ( · , · ) denotes the same calculation and parameterization as Eq.”
MethodInfluentialAli, A., Zhu, Y., & Zakarya, M. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-020-10486-4 · Cited by 221
Grammatical error correction using neural machine translation
Yuan, Z., & Briscoe, T. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1042 · Cited by 221
Multivariate time series prediction by RNN architectures for energy consumption forecasting
Amalou, I., Mouhni, N., & Abdali, A. (2022) · Energy Reports · doi:10.1016/j.egyr.2022.07.139 · Cited by 220
PLATO: Pre-trained Dialogue Generation Model with Discrete Latent Variable
Bao, S., He, H., Wang, F., Wu, H., & Wang, H. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.9 · Cited by 220
A survey on empathetic dialogue systems
Ma, Y., Nguyen, K. L., Xing, F. Z., & Cambria, E. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.06.011 · Cited by 220
Deep Recurrent Generative Decoder for Abstractive Text Summarization
Li, P., Lam, W., Bing, L., & Wang, Z. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1222 · Cited by 219
Globally Coherent Text Generation with Neural Checklist Models
Kiddon, C., Zettlemoyer, L., & Choi, Y. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1032 · Cited by 219
“To generate these weights, our model uses a three-way probabilistic classifier, ref - type ( h t ) , to determine whether the hidden state of the GRU h t will generate non-agenda tokens, new agenda item references, or used item references. ref - type ( h t ) generates a probability distribution f t ∈ R 3 as where S ∈ R…”
MethodInfluentialTemporal Convolutional Networks with RNN approach for chaotic time series prediction
Dudukcu, H. V., Taskiran, M., Cam Taskiran, Z. G., & Yildirim, T. (2023) · Applied Soft Computing · doi:10.1016/j.asoc.2022.109945 · Cited by 219
How to Find Your Friendly Neighborhood: Graph Attention Design with Self-SupervisionPreprint
Kim, D., & Oh, A. H. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2204.04879 · Cited by 247
Identifying behavioral structure from deep variational embeddings of animal motion
Luxem, K., Mocellin, P., Fuhrmann, F., Kürsch, J., Miller, S. R., Palop, J. J., Remy, S., & Bauer, P. (2022) · Communications Biology · doi:10.1038/s42003-022-04080-7 · Cited by 218
“Here, we use GRUs as transition function in the encoder and decoder.”
BackgroundMethodReNet: A Recurrent Neural Network Based Alternative to Convolutional Networks
Visin, F., Kastner, K., Cho, K., Matteucci, M., Courville, A. C., & Bengio, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.00393 · Cited by 218
“Natural language processing (NLP) applications include language modeling [see, e.g., Mikolov, 2012], and machine translation [Sutskever et al., 2014, Cho et al., 2014, Bahdanau et al., 2015].”
BackgroundMethodInfluentialSelf-citationHuang, T.-H. (., Ferraro, F., Mostafazadeh, N., Misra, I., Agrawal, A., Devlin, J., Girshick, R., He, X., Kohli, P., Batra, D., et al. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1147 · Cited by 218
A Comparison of Transformer and LSTM Encoder Decoder Models for ASR
Zeyer, A., Bahar, P., Irie, K., Schluter, R., & Ney, H. (2019) · 2019 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU) · doi:10.1109/asru46091.2019.9004025 · Cited by 218
“Initial works on encoder-decoder models were usually based on long short-term memory (LSTM) [17] networks [18].”
BackgroundAutomatic Fetal Ultrasound Standard Plane Recognition Based on Deep Learning and IIoT
Pu, B., Li, K., Li, S., & Zhu, N. (2021) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2021.3069470 · Cited by 218
Khan, W., Daud, A., Khan, K., Muhammad, S., & Haq, R. (2023) · Natural Language Processing Journal · doi:10.1016/j.nlp.2023.100026 · Cited by 217
Wei, X., Zhang, L., Yang, H.-Q., Zhang, L., & Yao, Y.-P. (2021) · Geoscience Frontiers · doi:10.1016/j.gsf.2020.04.011 · Cited by 217
Agarap, A. F. M. (2018) · Proceedings of the 2nd International Conference on Machine Learning and Soft Computing · doi:10.1145/3184066.3184080 · Cited by 217
Less Is More: Picking Informative Frames for Video Captioning
Chen, Y., Wang, S., Zhang, W., & Huang, Q. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01261-8_22 · Cited by 217
Learning the travelling salesperson problem requires rethinking generalization
Joshi, C. K., Cappart, Q., Rousseau, L.-M., & Laurent, T. (2022) · Constraints · doi:10.1007/s10601-022-09327-y · Cited by 285
Antibody structure prediction using interpretable deep learning
Ruffolo, J. A., Sulam, J., & Gray, J. J. (2022) · Patterns · doi:10.1016/j.patter.2021.100406 · Cited by 216
Are You Talking to a Machine? Dataset and Methods for Multilingual Image Question Answering
Gao, H., Mao, J., Zhou, J., Huang, Z., Wang, L., & Xu, W. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.05612 · Cited by 216
“For natural language, the Recurrent Neural Network (RNN [7, 27]) and the Long Short-Term Memory network (LSTM [12]) are also widely used in machine translation [13, 5, 35] and speech recognition [28].”
MethodTwo are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoders
Wang, J., & Lu, W. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.133 · Cited by 216
Graph representation learning in bioinformatics: trends, methods and applications
Yi, H.-C., You, Z.-H., Huang, D.-S., & Kwoh, C. K. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbab340 · Cited by 216
Text mining-based construction site accident classification using hybrid supervised machine learning
Cheng, M.-Y., Kusoemo, D., & Gosno, R. A. (2020) · Automation in Construction · doi:10.1016/j.autcon.2020.103265 · Cited by 216
Multi-Granularity Generator for Temporal Action Proposal
Liu, Y., Ma, L., Zhang, Y., Liu, W., & Chang, S.-F. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00372 · Cited by 216
“However, LSTM [18] and GRU [8] fail to handle video segments with long time spans.”
BackgroundAn Empirical Comparison of Domain Adaptation Methods for Neural Machine Translation
Chu, C., Dabre, R., & Kurohashi, S. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p17-2061 · Cited by 215
“One of the most attractive features of neural machine translation (NMT) (Bahdanau et al., 2015; Cho et al., 2014; Sutskever et al., 2014) is that it is possible to train an end to end system without the need to deal with word alignments, translation rules and complicated decoding algorithms, which are a characteristic…”
BackgroundRahate, A., Walambe, R., Ramanna, S., & Kotecha, K. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.12.003 · Cited by 214
“The recent techniques like Encoder-Decoder [49], Attention models [50], Transformers [51], Generative Adversarial Networks (GAN) [52], Zero-Shot Learning (ZSL) [53], Multi-task Learning [54], Transfer Learning [55], MetaLearning [56], Multiple Instance Learning [57], and Domain Adaptation [58] also facilitate achievem…”
BackgroundMethodA deep active learning system for species identification and counting in camera trap images
Norouzzadeh, M. S., Morris, D., Beery, S., Joshi, N., Jojic, N., & Clune, J. (2021) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13504 · Cited by 214
Joint Entity and Relation Extraction With Set Prediction Networks
Sui, D., Zeng, X., Chen, Y., Liu, K., & Zhao, J. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3264735 · Cited by 214
“Autoregressive decoders, such as [15], [31], [32], and [33], generate each token conditioned on the sequence of tokens previously generated, where the distribution over possible output is factored into a chain of conditional probabilities with a left-to-right causal structure where Y , X , and T…”
BackgroundAnomaly Detection of Time Series With Smoothness-Inducing Sequential Variational Auto-Encoder
Li, L., Yan, J., Wang, H., & Jin, Y. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2980749 · Cited by 214
Vlassis, N. N., & Sun, W. (2021) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2021.113695 · Cited by 214
“[51] Kyunghyun Cho, Bart Van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, Yoshua Bengio, Learning phrase representations using rnn encoder–decoder for statistical machine translation, 2014, arXiv preprint arXiv:1406.”
MethodLoad demand forecasting of residential buildings using a deep learning model
Wen, L., Zhou, K., & Yang, S. (2020) · Electric Power Systems Research · doi:10.1016/j.epsr.2019.106073 · Cited by 214
Beyond Sparsity: Tree Regularization of Deep Models for Interpretability
Wu, M., Hughes, M., Parbhoo, S., Zazzi, M., Roth, V., & Doshi-Velez, F. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11501 · Cited by 213
Metadata
- Authors
- Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y.
- Affiliations
- Le Mans Université (FR)
- Polytechnique Montréal (CA)
- Venue
- Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)
- Published
- 2014
- Pages
- 1724-1734
- OpenAlex
- W2157331557
- Cited by
- 25,545
- References
- 31
- Citations by year
- 2026: 1895 · 2025: 2591 · 2024: 2721 · 2023: 3047 · 2022: 3245 · 2021: 3534 · 2020: 3063 · 2019: 2494 · 2018: 1644 · 2017: 816 · 2016: 349 · 2015: 119 · 2014: 22
- FWCI
- 256.40
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- HAL (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Keywords
- statistical machine translation, neural machine translation, phrase embeddings, sequence-to-sequence models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.