Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Open accessThe DOI matches its Crossref record; 29 of the 31 references it cites were found in a registry or an index.
Abstract
Kyunghyun Cho, Bart van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, Yoshua Bengio. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). 2014.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“GRU [185] is a variant based on the LSTM, which only contains an update gate and reset gate and has a faster training speed than the LSTM with fewer parameters.”
From Deep Learning for Structural Health Monitoring: Data, Algorithms, Applications, Challenges, and Trends (2023) · cites this paper as [185]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“They are thus well-suited for detecting dependencies and patterns in language-like input.”
From The role of pragmatic mechanisms in referential communication and categorization: An emergent communication model (2026) · cites this paper as [87]
The cited source says what the claim attributes to it.
In the citing paper
“GRU cells are a specific type of Recurrent Neural Networks (RNNs) which have been proven useful for dealing with sequence data such as language.”
From The role of pragmatic mechanisms in referential communication and categorization: An emergent communication model (2026) · cites this paper as [87]
The cited source says what the claim attributes to it.
In the citing paper
“Early work [139-141] mainly relied on recurrent neural networks (e.g., LSTM [142], GRU [143]). Limited by the model's expressiveness, they often suffer from the issue of insufficient diversity.”
From When large language models meet personalization: perspectives of challenges and opportunities (2024) · cites this paper as [143]
The cited source says what the claim attributes to it.
In the citing paper
“Moreover, [Tang et al., 2020] adopts GRU [Cho et al., 2014] on the sequence of hyperplanes to further capture the dynamics among hyperplanes.”
From Temporal Knowledge Graph Completion: A Survey (2023) · cites this paper as Cho et al., 2014
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 1×
“At each time step t , the hidden state h t (cid:105) of the RNN is updated by where f is a non-linear activation function. f may be as simple as an element-wise logistic sigmoid function and as complex as a long short-term memory (LSTM) unit (Hochreiter and Schmidhuber, 1997).”
BackgroundDistributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533 · cited 1×
“We have done so by applying the data selection method proposed in (Moore and Lewis, 2010), and its extension to bi-texts (Axelrod et al., 2011).”
Method(2011) · Cited by 6,993
Self-citationADADELTA: An Adaptive Learning Rate Method
Zeiler, M. D. (2012) · arXiv · doi:10.48550/arxiv.1212.5701 · Cited by 5,322 · cited 2×
“95 (Zeiler, 2012).”
MethodStatistical phrase-based translation
Koehn, P., Och, F. J., & Marcu, D. (2003) · Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - NAACL '03 · doi:10.3115/1073445.1073462 · Cited by 3,197 · cited 2×
“In the phrase-based SMT framework introduced in (Koehn et al., 2003) and (Marcu and Wong, 2002), the translation model log p ( e | f ) is factorized into the translation probabilities of matching phrases in the source and target sentences.”
Method(2005) · Cited by 3,125
Supervised Sequence Labelling with Recurrent Neural Networks
Graves, A. (2012) · Studies in Computational Intelligence · doi:10.1007/978-3-642-24797-2 · Cited by 3,120
Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition
Dahl, G. E., Yu, D., Deng, L., & Acero, A. (2012) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/tasl.2011.2134090 · Cited by 3,011 · cited 1×
“Deep neural networks have shown great success in various applications such as objection recognition (see, e.g., (Krizhevsky et al., 2012)) and speech recognition (see, e.g., (Dahl et al., 2012)).”
BackgroundRecurrent Continuous Translation Models
Kalchbrenner, N., & Blunsom, P. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1176 · Cited by 1,232 · cited 1×
“The closest approach related to the proposed RNN Encoder–Decoder is the Recurrent Continuous Translation Model (Model 2) proposed in (Kalchbrenner and Blunsom, 2013).”
Method
Cited by
Items 301–400 of 1,296
A systematic literature review of methods and datasets for anomaly-based network intrusion detection
Yang, Z., Liu, X., Li, T., Wu, D., Wang, J., Zhao, Y., & Han, H. (2022) · Computers & Security · doi:10.1016/j.cose.2022.102675 · Cited by 453
Bentivoglio, R., Isufi, E., Jonkman, S. N., & Taormina, R. (2022) · Hydrology and Earth System Sciences · doi:10.5194/hess-26-4345-2022 · Cited by 453
Semantic Compositional Networks for Visual Captioning
Gan, Z., Gan, C., He, X., Pu, Y., Tran, K., Gao, J., Carin, L., & Deng, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.127 · Cited by 453
ICON: Interactive Conversational Memory Network for Multimodal Emotion Detection
Hazarika, D., Poria, S., Mihalcea, R., Cambria, E., & Zimmermann, R. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1280 · Cited by 452
“Gated Recurrent Unit: GRUs are gated recurrent cells introduced by Cho et al. (2014).”
BackgroundWhat Value Do Explicit High Level Concepts Have in Vision to Language Problems?
Wu, Q., Shen, C., Liu, L., Dick, A., & Van Den Hengel, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.29 · Cited by 452
Intelligent Fault Detection Scheme for Microgrids With Wavelet-Based Deep Neural Networks
Yu, J. J. Q., Hou, Y., Lam, A. Y. S., & Li, V. O. K. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2017.2776310 · Cited by 451
“GRU [30] is a modern variant of ANN, which is among the most commonly used data-mining and machine learning techniques.”
BackgroundMethodTourism demand forecasting: A deep learning approach
Law, R., Li, G., Fong, D. K. C., & Han, X. (2019) · Annals of Tourism Research · doi:10.1016/j.annals.2019.01.014 · Cited by 448
Graph-Structured Representations for Visual Question Answering
Teney, D., Liu, L., & Van Den Hengel, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.344 · Cited by 447
Stock Price Prediction via Discovering Multi-Frequency Trading Patterns
Zhang, L., Aggarwal, C., & Qi, G.-J. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098117 · Cited by 447
Deep Learning in Mining Biological Data
Mahmud, M., Kaiser, M. S., McGinnity, T. M., & Hussain, A. (2021) · Cognitive Computation · doi:10.1007/s12559-020-09773-x · Cited by 446
Dynamic graph convolutional networks
Manessi, F., Rozza, A., & Manzo, M. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2019.107000 · Cited by 446
Deep learning models for solar irradiance forecasting: A comprehensive review
Kumari, P., & Toshniwal, D. (2021) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2021.128566 · Cited by 445
Mao, J., Gan, C., Kohli, P., Tenenbaum, J. B., & Wu, J. (2019) · arXiv · doi:10.48550/arxiv.1904.12584 · Cited by 444
“The expected parsing result of this sentence is: The semantic parser encode the word embeddings with IEncoder .”
MethodInfluentialRecurrent convolutional strategies for face manipulation detection in videos
Sabir, E., Cheng, J., Jaiswal, A., AbdAlmageed, W., Masi, I., & Natarajan, P. (2019) · arXiv · doi:10.48550/arxiv.1905.00582 · Cited by 443
“We use GRU cells [6] for our recurrent network.”
MethodMultivariate time series forecasting via attention-based encoder–decoder framework
Du, S., Li, T., Yang, Y., & Horng, S.-J. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.12.118 · Cited by 441
Parallel spatio-temporal attention-based TCN for multivariate time series prediction
Fan, J., Zhang, K., Huang, Y., Zhu, Y., & Chen, B. (2023) · Neural Computing and Applications · doi:10.1007/s00521-021-05958-z · Cited by 440
“GRU [33]: As a variant of LSTM, GRU merges different gated units in LSTM, and also combines the cell state and the hidden state, making the model lighter and suitable for scenarios with smaller amounts of data.”
BackgroundDeep learning in ECG diagnosis: A review
Liu, X., Wang, H., Li, Z., & Qin, L. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107187 · Cited by 436
A review of irregular time series data handling with gated recurrent neural networks
Weerakody, P. B., Wong, K. W., Wang, G., & Ela, W. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.02.046 · Cited by 433
SST: Single-Stream Temporal Action Proposals
Buch, S., Escorcia, V., Shen, C., Ghanem, B., & Niebles, J. C. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.675 · Cited by 433
Knowledge-Embedded Routing Network for Scene Graph Generation
Chen, T., Yu, W., Chen, R., & Lin, L. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00632 · Cited by 432
“At each timestep t , each node aggregates messages from its neighbors according to the graph structure, formulated as (3) Then, the model take a and its previous hidden state as input to update its hidden state by a gated mechanism similar to the Gated Recurrent Unit [4, 17] In this way, each node can aggregate messag…”
MethodNiu, D., Yu, M., Sun, L., Gao, T., & Wang, K. (2022) · Applied Energy · doi:10.1016/j.apenergy.2022.118801 · Cited by 431
Neural Architecture Optimization
Luo, R., Tian, F., Qin, T., Chen, E., & Liu, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.07233 · Cited by 427
DeepFix: Fixing Common C Language Errors by Deep Learning
Gupta, R., Pal, S., Kanade, A., & Shevade, S. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10742 · Cited by 426
“Both the encoder and decoder RNNs consist of N stacked gated recurrent units (GRUs) (Cho et al. 2014).”
BackgroundGuiding the Long-Short Term Memory Model for Image Caption Generation
Jia, X., Gavves, E., Fernando, B., & Tuytelaars, T. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.277 · Cited by 426
“The pipeline for caption generation with the RNN model [7, 17, 26, 37, 38] is inspired by the encoder-decoder principle in Neural Machine Translation [1, 5, 32].”
BackgroundMethodInfluentialDeep learning and its application in geochemical mapping
Zuo, R., Xiong, Y., Wang, J., & Carranza, E. J. M. (2019) · Earth-Science Reviews · doi:10.1016/j.earscirev.2019.02.023 · Cited by 426
Coupled Multi-Layer Attentions for Co-Extraction of Aspect and Opinion Terms
Wang, W., Pan, S. J., Dahlmeier, D., & Xiao, X. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10974 · Cited by 425
“By applying GRU on β a i , the attention vector rai∈RK becomes context-dependent with the ability to inherit past information.”
MethodInfluentialDeep Reinforcement Learning for Multiobjective Optimization
Li, K., Zhang, T., & Wang, R. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.2977661 · Cited by 424
“In this article, we adopt the RNN model of the gated recurrent unit (GRU) [34] that has similar performance but fewer parameters than the long short-term memory (LSTM) which is employed in the original Pointer Network in [17].”
MethodFault Diagnosis for Electro-Mechanical Actuators Based on STL-HSTA-GRU and SM
Zhang, X., Tang, L., & Chen, J. (2021) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2021.3127641 · Cited by 422
Physical reservoir computing—an introductory perspective
Nakajima, K. (2020) · Japanese Journal of Applied Physics · doi:10.35848/1347-4065/ab8d4f · Cited by 422
Carbon price forecasting based on CEEMDAN and LSTM
Zhou, F., Huang, Z., & Zhang, C. (2022) · Applied Energy · doi:10.1016/j.apenergy.2022.118601 · Cited by 421
Shifting machine learning for healthcare from development to deployment and from models to data
Zhang, A., Xing, L., Zou, J., & Wu, J. C. (2022) · Nature Biomedical Engineering · doi:10.1038/s41551-022-00898-y · Cited by 420
“In particular, long short-term memory networks 109 and gated units 110 were staple RNNs in modelling EHR data, as these networks can model the sequential nature of clinical data 111,112 and clinical text 5,104,105,113 .”
BackgroundInfluentialFast Video Object Segmentation by Reference-Guided Mask Propagation
Oh, S. W., Lee, J.-Y., Sunkavalli, K., & Kim, S. J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00770 · Cited by 420
“In particular, we combine the feature from the previous time step with the current one using a 3×3 convolutional GRU unit [9, 3].”
MethodRhythmNet: End-to-End Heart Rate Estimation From Face via Spatial-Temporal Representation
Niu, X., Shan, S., Han, H., & Chen, X. (2020) · IEEE Transactions on Image Processing · doi:10.1109/tip.2019.2947204 · Cited by 420
PatchmatchNet: Learned Multi-View Patchmatch Stereo
Wang, F., Galliani, S., Vogel, C., Speciale, P., & Pollefeys, M. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01397 · Cited by 420
Deep learning and its application to LHC physics
Guest, D., Cranmer, K., & Whiteson, D. (2018) · Annual Review of Nuclear and Particle Science · doi:10.1146/annurev-nucl-101917-021019 · Cited by 417
Attention mechanism in neural networks: where it comes and where it goes
Soydaner, D. (2022) · Neural Computing and Applications · doi:10.1007/s00521-022-07366-3 · Cited by 414
Convolutional Image Captioning
Aneja, J., Deshpande, A., & Schwing, A. G. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00583 · Cited by 412
Hierarchical Recurrent Neural Encoder for Video Representation with Application to Captioning
Pan, P., Xu, Z., Yang, Y., Wu, F., & Zhuang, Y. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.117 · Cited by 412
“[43] introduce a hierarchical RNN decoder , specifically Gated Recurrent Unit (GRU) [7], into the video captioning system.”
MethodRecurrent Event Network: Autoregressive Structure Inferenceover Temporal Knowledge Graphs
Jin, W., Qu, M., Jin, X., & Ren, X. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.541 · Cited by 409
Adversarial Attacks on Deep-learning Models in Natural Language Processing: A Survey
Zhang, W. E., Sheng, Q. Z., Alhazmi, A., & Li, C. (2020) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3374217 · Cited by 407
Predicting alzheimer’s disease progression using multi-modal deep learning approach
Lee, G., Nho, K., Kang, B., Sohn, K.-A., Kim, D., Initiative, F. A. D. N., Weiner, M. W., Aisen, P., Petersen, R., Jack, C. R., et al. (2019) · Scientific Reports · doi:10.1038/s41598-018-37769-z · Cited by 406
LSTM-Based ECG Classification for Continuous Monitoring on Personal Wearable Devices
Saadatnejad, S., Oveisi, M., & Hashemi, M. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2019.2911367 · Cited by 406
“Gated Recurrent Unit (GRU): This cell is a simplified version of the LSTM cell which merges the two state vectors into one and also employs a different gating strategy [50].”
BackgroundA Convolutional Encoder Model for Neural Machine Translation
Gehring, J., Auli, M., Grangier, D., & Dauphin, Y. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1012 · Cited by 405
Wind power forecasting – A data-driven method along with gated recurrent neural network
Kisvari, A., Lin, Z., & Liu, X. (2021) · Renewable Energy · doi:10.1016/j.renene.2020.10.119 · Cited by 405
Are Sixteen Heads Really Better than One?
Michel, P., Levy, O., & Neubig, G. (2019) · arXiv · doi:10.48550/arxiv.1905.10650 · Cited by 404
The Challenge of Machine Learning in Space Weather: Nowcasting and Forecasting
Camporeale, E. (2019) · Space Weather · doi:10.1029/2018sw002061 · Cited by 403
Stanford neural machine translation systems for spoken language domains.
Luong, M.-T., & Manning, C. D. (2015) · Cited by 499
Attention-Based Multimodal Fusion for Video Description
Hori, C., Hori, T., Lee, T.-Y., Zhang, Z., Harsham, B., Hershey, J. R., Marks, T. K., & Sumi, K. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.450 · Cited by 401
Image Captioning and Visual Question Answering Based on Attributes and External Knowledge
Wu, Q., Shen, C., Wang, P., Dick, A., & van den Hengel, A. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2708709 · Cited by 401
Deep Learning for Medical Anomaly Detection – A Survey
Fernando, T., Gammulle, H., Denman, S., Sridharan, S., & Fookes, C. (2022) · ACM Computing Surveys · doi:10.1145/3464423 · Cited by 399
Neural Machine Translation: A Review
Stahlberg, F. (2020) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12007 · Cited by 397
Tips and Tricks for Visual Question Answering: Learnings from the 2017 Challenge
Teney, D., Anderson, P., He, X., & Hengel, A. V. D. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00444 · Cited by 396
SEQUENCER: Sequence-to-Sequence Learning for End-to-End Program Repair
Chen, Z., Kommrusch, S. J., Tufano, M., Pouchet, L.-N., Poshyvanyk, D., & Monperrus, M. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2019.2940179 · Cited by 396
“After reading the last token, the last hidden state, hn is used as the context vector c for use in initializing the decoder [22]:”
MethodSimple and Effective Multi-Paragraph Reading Comprehension
Clark, C., & Gardner, M. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1078 · Cited by 396
Learning human–environment interactions using conformal tactile textiles
Luo, Y., Li, Y., Sharma, P., Shou, W., Wu, K., Foshey, M., Li, B., Palacios, T., Torralba, A., & Matusik, W. (2021) · Nature Electronics · doi:10.1038/s41928-021-00558-0 · Cited by 395
Large language models (LLMs): survey, technical frameworks, and future challenges
Kumar, P. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10888-y · Cited by 395
Recent Advances in End-to-End Automatic Speech Recognition
Li, J. (2022) · APSIPA Transactions on Signal and Information Processing · doi:10.1561/116.00000050 · Cited by 395
STGAN: A Unified Selective Transfer Network for Arbitrary Image Attribute Editing
Liu, M., Ding, Y., Xia, M., Liu, X., Ding, E., Zuo, W., & Wen, S. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00379 · Cited by 394
Nweke, H. F., Teh, Y. W., Mujtaba, G., & Al-garadi, M. A. (2019) · Information Fusion · doi:10.1016/j.inffus.2018.06.002 · Cited by 394
Deep Learning for Intelligent Transportation Systems: A Survey of Emerging Trends
Veres, M., & Moussa, M. (2020) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2929020 · Cited by 394
Ghimire, S., Deo, R. C., Raj, N., & Mi, J. (2019) · Applied Energy · doi:10.1016/j.apenergy.2019.113541 · Cited by 394
Fully Character-Level Neural Machine Translation without Explicit Segmentation
Lee, J., Cho, K., & Hofmann, T. (2017) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00067 · Cited by 394
“…that builds a single neural network which takes as an input a source sentence X = (x1, . . . , xTX ) and generates its translation Y = (y1, . . . , yTY ), where xt and yt′ are source and target symbols (Bahdanau et al., 2015; Sutskever et al., 2015; Luong et al., 2015; Cho et al., 2014a).”
BackgroundSelf-citationProbabilistic forecasting with temporal convolutional neural network
Chen, Y., Kang, Y., Chen, Y., & Wang, Z. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.03.011 · Cited by 393
Particle swarm optimization of deep neural networks architectures for image classification
Fernandes Junior, F. E., & Yen, G. G. (2019) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2019.05.010 · Cited by 393
A Survey of Available Corpora For Building Data-Driven Dialogue Systems: The Journal Version
Serban, I. V., Lowe, R., Henderson, P., Charlin, L., & Pineau, J. (2018) · Dialogue & Discourse · doi:10.5087/dad.2018.101 · Cited by 150
“In particular, many of the tasks and datasets available are constrained to narrow domains.”
BackgroundLiu, Y., Gong, C., Yang, L., & Chen, Y. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.113082 · Cited by 387
Quality Assessment of In-the-Wild Videos
Li, D., Jiang, T., & Jiang, M. (2019) · Proceedings of the 27th ACM International Conference on Multimedia · doi:10.1145/3343031.3351028 · Cited by 387
Hierarchical Multiscale Recurrent Neural Networks
Chung, J., Ahn, S., & Bengio, Y. (2016) · arXiv · doi:10.48550/arxiv.1609.01704 · Cited by 386
Self-citationChen, Y., Peng, G., Zhu, Z., & Li, S. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2019.105919 · Cited by 386
Overview of the Transformer-based Models for NLP Tasks
Gillioz, A., Casas, J., Mugellini, E., & Khaled, O. A. (2020) · Annals of Computer Science and Information Systems · doi:10.15439/2020f20 · Cited by 385
Randomized SMILES strings improve the quality of molecular generative models
Arús-Pous, J., Johansson, S. V., Prykhodko, O., Bjerrum, E. J., Tyrchan, C., Reymond, J.-L., Chen, H., & Engkvist, O. (2019) · Journal of Cheminformatics · doi:10.1186/s13321-019-0393-0 · Cited by 385
“After the first benchmark, GRU cells were dropped because of their consistently lower performance.”
BackgroundMethodInfluentialTemporal Graph Networks for Deep Learning on Dynamic Graphs
Rossi, E., Chamberlain, B., Frasca, F., Eynard, D., Monti, F., & Bronstein, M. (2020) · arXiv · doi:10.48550/arxiv.2006.10637 · Cited by 382
“a recurrent neural network such as LSTM (Hochreiter & Schmidhuber, 1997) or GRU (Cho et al., 2014).”
BackgroundONAN, A. (2021) · Computer Applications in Engineering Education · doi:10.1002/cae.22253 · Cited by 382
Neural Symbolic Machines: Learning Semantic Parsers on Freebase with Weak Supervision
Liang, C., Berant, J., Le, Q., Forbus, K. D., & Lao, N. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1003 · Cited by 381
Remaining useful lifetime prediction via deep domain adaptation
da Costa, P. R. D. O., Akçay, A., Zhang, Y., & Kaymak, U. (2020) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2019.106682 · Cited by 381
Graph-to-Sequence Learning using Gated Graph Neural Networks
Beck, D., Haffari, G., & Cohn, T. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1026 · Cited by 380
“in a similar fashion to Gated Recurrent Units (Cho et al., 2014).”
ResultA survey: Deep learning for hyperspectral image classification with few labeled samples
Jia, S., Jiang, S., Lin, Z., Li, N., Xu, M., & Yu, S. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.03.035 · Cited by 378
Zampieri, M., Nakov, P., Rosenthal, S., Atanasova, P., Karadzhov, G., Mubarak, H., Derczynski, L., Pitenis, Z., & Çöltekin, Ç. (2020) · Proceedings of the Fourteenth Workshop on Semantic Evaluation · doi:10.18653/v1/2020.semeval-1.188 · Cited by 378
EmoNet: Fine-Grained Emotion Detection with Gated Recurrent Neural Networks
Abdul-Mageed, M., & Ungar, L. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1067 · Cited by 378
Online False Data Injection Attack Detection With Wavelet Transform and Deep Neural Networks
Yu, J. J. Q., Hou, Y., & Li, V. O. K. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2825243 · Cited by 378
Multi-objective de novo drug design with conditional graph generative model
Li, Y., Zhang, L., & Liu, Z. (2018) · Journal of Cheminformatics · doi:10.1186/s13321-018-0287-6 · Cited by 376
Artificial Neural Networks for Neuroscientists: A Primer
Yang, G. R., & Wang, X.-J. (2020) · Neuron · doi:10.1016/j.neuron.2020.09.005 · Cited by 376
How social learning amplifies moral outrage expression in online social networks
Brady, W. J., McLoughlin, K., Doan, T. N., & Crockett, M. J. (2021) · Science Advances · doi:10.1126/sciadv.abe5641 · Cited by 375
Minimum Risk Training for Neural Machine Translation
Shen, S., Cheng, Y., He, Z., He, W., Wu, H., Sun, M., & Liu, Y. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1159 · Cited by 375
Entangled Transformer for Image Captioning
Li, G., Zhu, L., Liu, P., & Yang, Y. (2019) · 2019 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00902 · Cited by 375
Text feature extraction based on deep learning: a review
Liang, H., Sun, X., Sun, Y., & Gao, Y. (2017) · EURASIP Journal on Wireless Communications and Networking · doi:10.1186/s13638-017-0993-1 · Cited by 373
“…[43], information retrieval [44, 45], semantic role labeling [46, 47], sentimental analysis [48], question answering [49 – 52], machine translation [53 – 56], text classification [57], summarization [58, 59], and text generation [60], as well as information extraction, including named entity…”
BackgroundLearning to Read Chest X-Rays: Recurrent Neural Cascade Model for Automated Image Annotation
Shin, H.-C., Roberts, K., Lu, L., Demner-Fushman, D., Yao, J., & Summers, R. M. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.274 · Cited by 373
Multifaceted protein–protein interaction prediction based on Siamese residual RCNN
Chen, M., Ju, C. J. T., Zhou, G., Chen, X., Zhang, T., Chang, K.-W., Zaniolo, C., & Wang, W. (2019) · Bioinformatics · doi:10.1093/bioinformatics/btz328 · Cited by 372
A Survey of Accelerator Architectures for Deep Neural Networks
Chen, Y., Xie, Y., Song, L., Chen, F., & Tang, T. (2020) · Engineering · doi:10.1016/j.eng.2020.01.007 · Cited by 370
GuessWhat?! Visual Object Discovery through Multi-modal Dialogue
De Vries, H., Strub, F., Chandar, S., Pietquin, O., Larochelle, H., & Courville, A. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.475 · Cited by 369
“Several methods have been proposed [18, 40, 43], all inspired by the encoder-decoder approach [10, 39] that has proven successful for machine translation.”
BackgroundMethodIncorporating stock prices and news sentiments for stock market prediction: A case of Hong Kong
Li, X., Wu, P., & Wang, W. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2020.102212 · Cited by 369
Fan, C., Wang, J., Gang, W., & Li, S. (2019) · Applied Energy · doi:10.1016/j.apenergy.2018.12.004 · Cited by 368
When large language models meet personalization: perspectives of challenges and opportunities
Chen, J., Liu, Z., Huang, X., Wu, C., Liu, Q., Jiang, G., Pu, Y., Lei, Y., Chen, X., Wang, X., et al. (2024) · World Wide Web · doi:10.1007/s11280-024-01276-1 · Cited by 367
Gated-Attention Readers for Text Comprehension
Dhingra, B., Liu, H., Yang, Z., Cohen, W., & Salakhutdinov, R. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1168 · Cited by 366
Investigating Capsule Networks with Dynamic Routing for Text Classification
Yang, M., Zhao, W., Ye, J., Lei, Z., Zhao, Z., & Zhang, S. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1350 · Cited by 366
A3T-GCN: Attention Temporal Graph Convolutional Network for Traffic Forecasting
Bai, J., Zhu, J., Song, Y., Zhao, L., Hou, Z., Du, R., & Li, H. (2021) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi10070485 · Cited by 364
A Survey of Knowledge Tracing: Models, Variants, and Applications
Shen, S., Liu, Q., Huang, Z., Zheng, Y., Yin, M., Wang, M., & Chen, E. (2024) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2024.3383325 · Cited by 364
“…update module, GKT updates the temporal knowledge state based on the aggregated features and the knowledge graph structure, as follows: where f self is the multilayer perceptron, G ea is the same erase-followed-by-add mechanism used in DKVMN, and G gru is the gated recurrent unit (GRU) gate [56].”
MethodDrawing and Recognizing Chinese Characters with Recurrent Neural Network
Zhang, X.-Y., Yin, F., Zhang, Y.-M., Liu, C.-L., & Bengio, Y. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2695539 · Cited by 363
“The cell and hidden states of LSTMs and GRUs are initialized at zero.”
BackgroundMethodInfluentialSelf-citationKnow Your Surroundings: Exploiting Scene Information for Object Tracking
Bhat, G., Danelljan, M., Van Gool, L., & Timofte, R. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58592-1_13 · Cited by 362
Explaining Recurrent Neural Network Predictions in Sentiment Analysis
Arras, L., Montavon, G., Müller, K.-R., & Samek, W. (2017) · Proceedings of the 8th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis · doi:10.18653/v1/w17-5221 · Cited by 361
“In the case of recurrent neural network architectures such as LSTMs (Hochreiter and Schmidhuber, 1997) and GRUs (Cho et al., 2014), there are two types of neural connections involved: manyto-one weighted linear connections, and two-toone multiplicative interactions.”
BackgroundInfluential
Metadata
- Authors
- Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y.
- Affiliations
- Le Mans Université (FR)
- Polytechnique Montréal (CA)
- Venue
- Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)
- Published
- 2014
- Pages
- 1724-1734
- OpenAlex
- W2157331557
- Cited by
- 25,545
- References
- 31
- Citations by year
- 2026: 1895 · 2025: 2591 · 2024: 2721 · 2023: 3047 · 2022: 3245 · 2021: 3534 · 2020: 3063 · 2019: 2494 · 2018: 1644 · 2017: 816 · 2016: 349 · 2015: 119 · 2014: 22
- FWCI
- 256.40
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- HAL (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Keywords
- statistical machine translation, neural machine translation, phrase embeddings, sequence-to-sequence models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.