The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
On the Properties of Neural Machine Translation: Encoder–Decoder Approaches
Open accessAbstract
Neural machine translation is a relatively new approach to statistical machine translation based purely on neural networks.The neural machine translation models often consist of an encoder and a decoder.The encoder extracts a fixed-length representation from a variable-length input sentence, and the decoder generates a correct translation from this representation.In this paper, we focus on analyzing the properties of the neural machine translation using two models; RNN Encoder-Decoder and a newly proposed gated recursive convolutional neural network.We show that the neural machine translation performs relatively well on short sentences without unknown words, but its performance degrades rapidly as the length of the sentence and the number of unknown words increase.Furthermore, we find that the proposed gated recursive convolutional network learns a grammatical structure of a sentence automatically.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ADADELTA: An Adaptive Learning Rate Method
Zeiler, M. D. (2012) · arXiv · doi:10.48550/arxiv.1212.5701 · Cited by 5,322
Cited by
Items 101–152 of 152
Mazzi, Y., Ben Sassi, H., Gaga, A., & Errahimi, F. (2022) · International Journal of Energy Research · doi:10.1002/er.7713 · Cited by 53
Impact of log parsing on deep learning-based anomaly detection
Khan, Z. A., Shin, D., Bianculli, D., & Briand, L. C. (2024) · Empirical Software Engineering · doi:10.1007/s10664-024-10533-w · Cited by 49
User Modeling for Task Oriented Dialogues
Gur, I., Hakkani-Tur, D., Tur, G., & Shah, P. (2018) · 2018 IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2018.8639652 · Cited by 48
Fine-grained activity classification in assembly based on multi-visual modalities
Chen, H., Zendehdel, N., Leu, M. C., & Yin, Z. (2024) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-023-02152-x · Cited by 47
Liu, H., Li, Y., Luo, L., & Zhang, C. (2023) · Batteries · doi:10.3390/batteries9060323 · Cited by 47
Ribeiro, L. C. F., Afonso, L. C. S., & Papa, J. P. (2019) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2019.103477 · Cited by 46
Low-Rank Bottleneck in Multi-head Attention Models
Bhojanapalli, S., Yun, C., Rawat, A. S., Reddi, S. J., & Kumar, S. (2020) · arXiv · doi:10.48550/arxiv.2002.07028 · Cited by 46
A Generic Federated Recommendation Framework via Fake Marks and Secret Sharing
Lin, Z., Pan, W., Yang, Q., & Ming, Z. (2023) · ACM Transactions on Information Systems · doi:10.1145/3548456 · Cited by 44
Direct speech reconstruction from sensorimotor brain activity with optimized deep learning models
Berezutskaya, J., Freudenburg, Z. V., Vansteensel, M. J., Aarnoutse, E. J., Ramsey, N. F., & van Gerven, M. A. J. (2023) · Journal of Neural Engineering · doi:10.1088/1741-2552/ace8be · Cited by 42
Chen, J., Lu, C., Chen, C., Cheng, H., & Xuan, D. (2022) · Applied Sciences · doi:10.3390/app12052305 · Cited by 42
Direct Speech Reconstruction from Sensorimotor Brain Activity with Optimized Deep Learning Models
Berezutskaya, J., Freudenburg, Z. V., Vansteensel, M. J., Aarnoutse, E. J., Ramsey, N. F., & van Gerven, M. A. J. (2022) · doi:10.1101/2022.08.02.502503 · Cited by 42
Li, Z., Wang, W., Li, H., Xie, E., Sima, C., Lu, T., Yu, Q., & Dai, J. (2022) · arXiv · doi:10.48550/arxiv.2203.17270 · Cited by 1,419
“Inspired by recurrent neural networks (RNNs) [17, 10], we utilize the BEV features to deliver temporal information from past to present recurrently, which has the same spirit as the hidden states of RNN models.”
MethodRevisiting Challenges in Data-to-Text Generation with Fact Grounding
Wang, H. (2019) · Proceedings of the 12th International Conference on Natural Language Generation · doi:10.18653/v1/w19-8639 · Cited by 34
A Multitask Multimodal Framework for Sentiment and Emotion-Aided Cyberbullying Detection
Maity, K., Kumar, A., & Saha, S. (2022) · IEEE Internet Computing · doi:10.1109/mic.2022.3158583 · Cited by 30
Glow in the Dark: Smartphone Inertial Odometry for Vehicle Tracking in GPS Blocked Environments
Gao, R., Xiao, X., Zhu, S., Xing, W., Li, C., Liu, L., Ma, L., & Chai, H. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3064342 · Cited by 31
Moirangthem, D. S., & Lee, M. (2020) · Neural Networks · doi:10.1016/j.neunet.2019.12.022 · Cited by 30
E-VAT: An Asymmetric End-to-End Approach to Visual Active Exploration and Tracking
Dionigi, A., Devo, A., Guiducci, L., & Costante, G. (2022) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2022.3150866 · Cited by 28
Hwang, I., Cha, G., & Oh, S. (2017) · 2017 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI) · doi:10.1109/mfi.2017.8170441 · Cited by 28
Increasing Video Accessibility for Visually Impaired Users with Human-in-the-Loop Machine Learning
Yuksel, B. F., Kim, S. J., Jin, S. J., Lee, J. J., Fazli, P., Mathur, U., Bisht, V., Yoon, I., Siu, Y.-T., & Miele, J. A. (2020) · Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3334480.3382821 · Cited by 26
An End-to-End Approach to Automatic Speech Assessment for Cantonese-speaking People with Aphasia
Qin, Y., Wu, Y., Lee, T., & Kong, A. P. H. (2020) · Journal of Signal Processing Systems · doi:10.1007/s11265-019-01511-3 · Cited by 25
“ng numerous neural network structures, Recurrent Neural Network (RNN) has the ability to model sequential signals and to deal with variable-length utterances. LSTM [18] and Gated Recurrent Unit (GRU) [19] are well-established \gating" models that tackle the problem of gradient vanishing in vanilla RNN. The GRU is…”
BackgroundZhu, Z., Li, J., Zhao, Q., & Akhtar, F. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120709 · Cited by 24
Relational memory-augmented language models
Liu, Q., Yogatama, D., & Blunsom, P. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00476 · Cited by 23
Optimising insider threat prediction: Exploring BiLSTM networks and sequential features
Manoharan, P., Hong, W., Yin, J., Wang, H., Zhang, Y., & Ye, W. (2024) · Data Science and Engineering · doi:10.1007/s41019-024-00260-z · Cited by 22
Encoding formulas as deep networks: Reinforcement learning for zero-shot execution of LTL formulas
Kuo, Y.-L., Katz, B., & Barbu, A. (2020) · 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros45743.2020.9341325 · Cited by 21
AcLog: An Approach to Detecting Anomalies from System Logs with Active Learning
Duan, C., Jia, T., Li, Y., & Huang, G. (2023) · 2023 IEEE International Conference on Web Services (ICWS) · doi:10.1109/icws60048.2023.00062 · Cited by 20
Human-Timescale Adaptation in an Open-Ended Task Space
Adaptive Agent Team, Bauer, J., Baumli, K., Baveja, S., Behbahani, F., Bhoopchand, A., Bradley-Schmieg, N., Chang, M., Clay, N., Collister, A., et al. (2023) · arXiv · doi:10.48550/arxiv.2301.07608 · Cited by 19
“To implement the RNN, we use a GRU (Cho et al., 2014).”
MethodInfluentialA Structured Learning Approach with Neural Conditional Random Fields for Sleep Staging
Aggarwal, K., Khadanga, S., Joty, S., Kazaglis, L., & Srivastava, J. (2018) · 2018 IEEE International Conference on Big Data (Big Data) · doi:10.1109/bigdata.2018.8622286 · Cited by 20
Toward a Theory of Causation for Interpreting Neural Code Models
Nader Palacio, D., Velasco, A., Cooper, N., Rodriguez, A., Moran, K., & Poshyvanyk, D. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3379943 · Cited by 18
Complex-valued neural networks for voice anti-spoofing
Müller, N. M., Sperl, P., & Böttinger, K. (2023) · INTERSPEECH 2023 · doi:10.21437/interspeech.2023-901 · Cited by 17
What's to Know? Uncertainty as a Guide to Asking Goal-Oriented Questions
Abbasnejad, E., Wu, Q., Shi, Q., & van den Hengel, A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00428 · Cited by 16
Secure and Efficient Coded Multi-Access Edge Computing With Generalized Graph Neural Networks
Asheralieva, A., & Niyato, D. (2023) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2022.3172117 · Cited by 15
Chien, Y.-W., Hong, S.-Y., Cheah, W.-T., Fu, L.-C., & Chang, Y.-L. (2018) · 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC) · doi:10.1109/smc.2018.00557 · Cited by 15
Wei, J., Qi, S., Wang, W., Jiang, L., Gao, H., Zhao, F., Al-Bukhaiti, K., & Wan, A. (2025) · Contemporary Mathematics · doi:10.37256/cm.6220256459 · Cited by 15
“More advanced RNN variants, such as long short-term memory (LSTM) [57] along with gated recurrent units (GRU) [58] further enhance this ability by effectively managing long-term dependencies and overcoming the vanishing gradient problem [59].”
∞-former: Infinite Memory Transformer-former: Infinite Memory Transformer
Martins, P. H., Marinho, Z., & Martins, A. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2022.acl-long.375 · Cited by 15
Question Generation With Doubly Adversarial Nets
Bao, J., Gong, Y., Duan, N., Zhou, M., & Zhao, T. (2018) · IEEE/ACM Transactions on Audio, Speech, and Language Processing · doi:10.1109/taslp.2018.2859777 · Cited by 14
Luo, R., Wang, J., & Gates, I. (2023) · Environmental Research Communications · doi:10.1088/2515-7620/acf0a3 · Cited by 14
Method for detection of unsafe actions in power field based on edge computing architecture
Yin, Y., Lin, J., Sun, N., Zhu, Q., Zhang, S., Zhang, Y., & Liu, M. (2021) · Journal of Cloud Computing · doi:10.1186/s13677-021-00234-w · Cited by 14
Kim, M., Kim, T.-H., Kim, D., Lee, D., Kim, D., Heo, J., Kang, S., Ha, T., Kim, J., Moon, D. H., et al. (2023) · Journal of Clinical Medicine · doi:10.3390/jcm13010036 · Cited by 13
Hupkes, D., Veldhoen, S., & Zuidema, W. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11196 · Cited by 14
Beyond Attention: Breaking the Limits of Transformer Context Length with Recurrent Memory
Bulatov, A., Kuratov, Y., Kapushev, Y., & Burtsev, M. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i16.29722 · Cited by 12
EXCALIBUR: Encouraging and Evaluating Embodied Exploration
Zhu, H., Kapoor, R., Min, S. Y., Han, W., Li, J., Geng, K., Neubig, G., Bisk, Y., Kembhavi, A., & Weihs, L. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01434 · Cited by 9
Leveraging Temporal Information for 3D Trajectory Estimation of Space Objects
Musallam, M. A., Del Castillo, M. O., Al Ismaeil, K., Perez, M. D., & Aouada, D. (2021) · 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw54120.2021.00425 · Cited by 9
“As stated in [2], TCNs generally outperform most of the commonly used networks such as Long Short-Term Memory (LSTM) [8] or Gated Recurrent Unit (GRU) [4] for different tasks.”
MethodAttention Mechanism for Human Motion Prediction
Al-aqel, A. F., & Ali Khan, M. (2020) · 2020 3rd International Conference on Computer Applications & Information Security (ICCAIS) · doi:10.1109/iccais48893.2020.9096777 · Cited by 7
On the Cost of Model-Serving Frameworks: An Experimental Evaluation
De Rosa, P., Bromberg, Y.-D., Felber, P., Mvondo, D., & Schiavoni, V. (2024) · 2024 IEEE International Conference on Cloud Engineering (IC2E) · doi:10.1109/ic2e61754.2024.00032 · Cited by 6
“State-of-the-art neural network architectures (such as recurrent neural networks - RNNs [44], [50], and convolutional neural networks - CNNs [57]), despite their excellent recognition accuracy, come at very high computational costs induced by their training phase [65].”
A Mobility Forecasting Framework with Vertical Federated Learning
Errounda, F. Z., & Liu, Y. (2022) · 2022 IEEE 46th Annual Computers, Software, and Applications Conference (COMPSAC) · doi:10.1109/compsac54236.2022.00050 · Cited by 6
Transfer learning for multimodal dialog
Palaskar, S., Sanabria, R., & Metze, F. (2020) · Computer Speech & Language · doi:10.1016/j.csl.2020.101093 · Cited by 6
Towards Music Captioning: Generating Music Playlist Descriptions
Choi, K., Fazekas, G., McFee, B., Cho, K., & Sandler, M. (2016) · arXiv · doi:10.48550/arxiv.1608.04868 · Cited by 5
Self-citationDesign and evaluation of a global workspace agent embodied in a realistic multimodal environment
Dossa, R. F. J., Arulkumaran, K., Juliani, A., Sasai, S., & Kanai, R. (2024) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2024.1352685 · Cited by 5
“Solving some complex tasks also requires the ability to store and process information in a working memory—a capacity which can be made possible through the use of RNNs (Hochreiter and Schmidhuber, 1997; Cho et al., 2014; Hafner et al., 2020).”
BackgroundMethodInfluentialHasanli, R., & Dursun, M. (2025) · FinTech · doi:10.3390/fintech4040077 · Cited by 3
“The Gated Recurrent Unit (GRU) is a simplified variant of the LSTM network that merges the forget and input gates into a single update gate, while still effectively capturing temporal patterns in sequential data [48].”
Neural Operators for Predictor Feedback Control of Nonlinear Delay Systems
Bhan, L., Qin, P., Krstic, M., & Shi, Y. (2024) · arXiv · doi:10.48550/arxiv.2411.18964 · Cited by 1
Heo, Y., Kim, M., Han, S.-S., Kim, T.-H., Heo, J., Kim, D., Kim, W. J., Lee, S.-J., Kwon, O. B., Kim, Y., et al. (2026) · Diagnostics · doi:10.3390/diagnostics16060874
“Furthermore, recurrent neural networks (RNNs), GRU [20], and long short-term memory models (LSTMs) [21] are DL models designed for time-series analysis and can process real-time data.”
A Multichannel Deep Learning Framework for Cyberbullying Detection on Social Media
Alotaibi, M., Alotaibi, B., & Razaque, A. (2021) · doi:10.20944/preprints202110.0070.v1 · Cited by 94
“The function of the single GRU cell, which is explained in [33,34], is as follows: ) where x ti is the input to the GRU cell at time ti .”
Metadata
- Authors
- Cho, K., van Merrienboer, B., Bahdanau, D., & Bengio, Y.
- Venue
- Proceedings of SSST-8, Eighth Workshop on Syntax, Semantics and Structure in Statistical Translation
- Published
- 2014
- Pages
- 103-111
- OpenAlex
- W2964199361
- Cited by
- 7,099
- References
- 1
- FWCI
- 116.81
- Type
- conference paper
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
