Grammar as a Foreign Language
Open accessAbstract
Syntactic constituency parsing is a fundamental problem in natural language processing and has been the subject of intensive research and engineering for decades. As a result, the most accurate parsers are domain specific, complex, and inefficient. In this paper we show that the domain agnostic attention-enhanced sequence-to-sequence model achieves state-of-the-art results on the most widely used syntactic constituency parsing dataset, when trained on a large synthetic corpus that was annotated using existing parsers. It also matches the performance of standard parsers when trained only on a small human-annotated dataset, which shows that this model is highly data-efficient, in contrast to sequence-to-sequence models without the attention mechanism. Our parser is also fast, processing over a hundred sentences per second with an unoptimized CPU implementation.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
RNN sequence-to-sequence models have not been able to attain state-of-the-art results in small-data regimes.
“Furthermore, RNN sequence-to-sequence models have not been able to attain state-of-the-art results in small-data regimes [37].”
From Attention Is All You Need (2017) · cites this paper as [37]
Table 1 (p. 5) shows that the paper’s best sequence-to-sequence result trained on the small WSJ-only dataset scored 90.5 F1, below the listed 91.8 F1 for another WSJ-only parser. But the Introduction (p. 1) says the attention-enhanced model matched the BerkeleyParser on that small dataset. The evidence supports the narrower finding for syntactic parsing, not a general claim about all RNN sequence-to-sequence models in small-data regimes. (LLM, conf=0.84)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · see citing works
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568 · see citing works
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766 · see citing works
Self-citationBuilding a Large Annotated Corpus of English: The Penn Treebank
Marcus, M. (1993) · doi:10.21236/ada273556 · Cited by 7,405 · see citing works
Accurate unlexicalized parsing
Klein, D., & Manning, C. D. (2003) · Annual Meeting of the Association for Computational Linguistics (ACL) · doi:10.3115/1075096.1075150 · Cited by 3,040 · see citing works
Generating Sequences With Recurrent Neural Networks
Graves, A. (2013) · arXiv · doi:10.48550/arxiv.1308.0850 · Cited by 2,894 · see citing works
Recurrent Continuous Translation Models
Kalchbrenner, N., & Blunsom, P. (2013) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d13-1176 · Cited by 1,277 · see citing works
(2011) · Cited by 1,192 · see citing works
Hovy, E., Marcus, M., Palmer, M., Ramshaw, L., & Weischedel, R. (2006) · Proceedings of the Human Language Technology Conference of the NAACL, Companion Volume: Short Papers on XX - NAACL '06 · doi:10.3115/1614049.1614064 · Cited by 806 · see citing works
Learning Accurate, Compact, and Interpretable Tree Annotation
Petrov, S., Barrett, L., Thibaux, R., & Klein, D. (2006) · Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the ACL - ACL '06 · doi:10.3115/1220175.1220230 · Cited by 793 · see citing works
Self-citationEffective Self-Training for Parsing
Mcclosky, D., Charniak, E., & Johnson, M. (2006) · North American Chapter of the Association for Computational Linguistics · doi:10.3115/1220835.1220855 · Cited by 702 · see citing works
Algorithms for Deterministic Incremental Dependency Parsing
Nivre, J. (2008) · Computational Linguistics · doi:10.1162/coli.07-056-r1-07-027 · Cited by 449 · see citing works
End-to-end Continuous Speech Recognition using Attention-based Recurrent NN: First ResultsPreprint
Chorowski, J., Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1412.1602 · Cited by 374 · see citing works
Incremental parsing with the perceptron algorithm
Collins, M., & Brian Roark, A. (2004) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1218955.1218970 · Cited by 373 · see citing works
Learning to ExecutePreprint
Zaremba, W., & Sutskever, I. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1410.4615 · Cited by 314 · see citing works
Self-citationA Linear Observed Time Statistical Parser Based on Maximum Entropy ModelsPreprint
Ratnaparkhi, A. (1997) · arXiv (Cornell University) · doi:10.48550/arxiv.cmp-lg/9706014 · Cited by 210 · see citing works
Fast and Accurate Shift-Reduce Constituent Parsing
Zhu, M., Zhang, Y., Chen, W., Zhang, M., & Zhu, J. (2013) · doi:10.13140/2.1.2791.2961 · Cited by 166 · see citing works
Overview of the 2012 Shared Task on Parsing the Web
Petrov, S., & McDonald, R. (2012) · Cited by 158 · see citing works
Self-citationDiscriminative training of a neural network statistical parser
Henderson, J. (2004) · Annual Meeting of the Association for Computational Linguistics (ACL) · doi:10.3115/1218955.1218968 · Cited by 109 · see citing works
Addressing the Rare Word Problem in Neural Machine TranslationPreprint
Luong, M.-T., Sutskever, I., Le, Q. V., Vinyals, O., & Zaremba, W. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1410.8206 · Cited by 101 · see citing works
Self-citationSelf-training PCFG grammars with latent annotations across languages
Huang, Z., & Harper, M. P. (2009) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/1699571.1699621 · Cited by 88 · see citing works
Products of Random Latent Variable Grammars
Petrov, S. (2010) · Cited by 87 · see citing works
Self-citationInducing history representations for broad coverage statistical parsing
Henderson, J. (2003) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/1073445.1073459 · Cited by 84 · see citing works
Judge, J., Cahill, A., & van Genabith, J. (2006) · International Conference on Computational Linguistics · doi:10.3115/1220175.1220238 · Cited by 75 · see citing works
Three Generative, Lexicalised Models for Statistical ParsingPreprint
Collins, M. (1997) · arXiv (Cornell University) · doi:10.48550/arxiv.cmp-lg/9706022 · Cited by 44 · see citing works
Constituent Parsing with Incremental Sigmoid Belief Networks
Titov, I., & Henderson, J. (2007) · Cited by 43 · see citing works
Self-training with Products of Latent Variable Grammars
Huang, Z., Harper, M., & Petrov, S. (2010) · Cited by 40 · see citing works
Self-citationAmbiguity-aware Ensemble Training for Semi-supervised Dependency Parsing
Li, Z., Zhang, M., & Chen, W. (2014) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/v1/p14-1043 · Cited by 33 · see citing works
Sparser, Better, Faster GPU Parsing
Hall, D., Berg-Kirkpatrick, T., & Klein, D. (2014) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/v1/p14-1020 · Cited by 18 · see citing works
Incremental Sigmoid Belief Networks for Grammar Learning
Henderson, J., & Titov, I. (2010) · Cited by 13 · see citing works
Flagged first, then by citations
1 of the 31 references couldn’t be matched to a known paper.
Research works printed but not linked: 5
- [2][2] Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473 , 2014. - · arXiv
- [4][4] S´ ebastien Jean, Kyunghyun Cho, Roland Memisevic, and Yoshua Bengio. On using very large target vocabulary for neural machine translation. arXiv preprint arXiv:1412.2007 , 2014. - · arXiv
- [24][24] Ronan Collobert. Deep learning for efficient discriminative parsing. In International Conference on Artificial Intelligence and Statistics , 2011. -
- [31][31] Oriol Vinyals, Alexander Toshev, Samy Bengio, and Dumitru Erhan. Show and tell: A neural image caption generator. arXiv preprint arXiv:1411.4555 , 2014. - · arXiv
- [32][32] Zoubin Ghahramani. A neural network for learning how to parse tree adjoining grammar. B.S.Eng Thesis, University of Pennsylvania, 1990.
Cited by
Sorted by citations
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408 · see citing works
Self-citationDeep Learning with Differential Privacy
Abadi, M., Chu, A., Goodfellow, I., McMahan, H. B., Mironov, I., Talwar, K., & Zhang, L. (2016) · Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2976749.2978318 · Cited by 6,578 · see citing works
Hierarchical Attention Networks for Document Classification
Yang, Z., Yang, D., Dyer, C., He, X., Smola, A. J., & Hovy, E. H. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1174 · Cited by 4,874 · see citing works
Recent Trends in Deep Learning Based Natural Language Processing [Review Article]
Young, T., Hazarika, D., Poria, S., & Cambria, E. (2018) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2018.2840738 · Cited by 2,921 · see citing works
Anchors: High-Precision Model-Agnostic Explanations
Ribeiro, M. T., Singh, S., & Guestrin, C. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11491 · Cited by 2,162 · see citing works
“In Table 2, we compute anchors for a multi-layer RNN encoder/attention-based decoder translation system (Vinyals et al. 2015) trained on English-Portuguese parallel corpora.”
MethodVinyals, O., Fortunato, M., & Jaitly, N. (2015) · neural information processing systems · Cited by 2,024 · see citing works
Self-citationA Diversity-Promoting Objective Function for Neural Conversation Models
Li, J., Galley, M., Brockett, C., Gao, J., & Dolan, B. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1014 · Cited by 1,981 · see citing works
A Survey of the Usages of Deep Learning for Natural Language Processing
Otter, D. W., Medina, J. R., & Kalita, J. K. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2979670 · Cited by 1,836 · see citing works
Tacotron: towards end-to-end speech synthesis
Wang, Y., Skerry-Ryan, R. J., Stanton, D., Wu, Y., Weiss, R. J., Jaitly, N., Yang, Z., Xiao, Y., Chen, Z., Bengio, S., et al. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-1452 · Cited by 1,746 · see citing works
Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks
Bengio, S., Vinyals, O., Jaitly, N., & Shazeer, N. (2015) · arXiv · doi:10.48550/arxiv.1506.03099 · Cited by 1,621 · see citing works
Self-citationVinyals, O., & Le, Q. (2015) · arXiv · doi:10.48550/arxiv.1506.05869 · Cited by 1,400 · see citing works
Self-citationNeural Motifs: Scene Graph Parsing with Global Context
Zellers, R., Yatskar, M., Thomson, S., & Choi, Y. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00611 · Cited by 1,095 · see citing works
Sequence-Level Knowledge Distillation
Kim, Y., & Rush, A. M. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1139 · Cited by 836 · see citing works
Language to Logical Form with Neural Attention
Dong, L., & Lapata, M. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1004 · Cited by 700 · see citing works
Order Matters: Sequence to sequence for setsPreprint
Vinyals, O., Samy Bengio, A., & Kudlur, M. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06391 · Cited by 696 · see citing works
Self-citationAttention in Natural Language Processing
Galassi, A., Lippi, M., & Torroni, P. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3019893 · Cited by 678 · see citing works
Reasoning about Entailment with Neural AttentionPreprint
Rocktäschel, T., Grefenstette, E., Hermann, K. M., Kočiský, T., & Blunsom, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1509.06664 · Cited by 583 · see citing works
What you can cram into a single $&!#* vector: Probing sentence embeddings for linguistic properties
Conneau, A., Kruszewski, G., Lample, G., Barrault, L., & Baroni, M. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1198 · Cited by 572 · see citing works
Transition-Based Dependency Parsing with Stack Long Short-Term Memory
Dyer, C., Ballesteros, M., Ling, W., Matthews, A., & Smith, N. A. (2015) · doi:10.3115/v1/p15-1033 · Cited by 567 · see citing works
A Simple Way to Initialize Recurrent Networks of Rectified Linear UnitsPreprint
Le, Q. V., Jaitly, N., & Hinton, G. E. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.00941 · Cited by 521 · see citing works
Self-citationDeep visual tracking: Review and experimental comparison
Li, P., Wang, D., Wang, L., & Lu, H. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.11.007 · Cited by 517 · see citing works
A Hierarchical Neural Autoencoder for Paragraphs and Documents
Li, J., Luong, M.-T., & Jurafsky, D. (2015) · doi:10.3115/v1/p15-1107 · Cited by 507 · see citing works
A comprehensive survey on applications of transformers for deep learning tasks
Islam, S., Elmekki, H., Elsebai, A., Bentahar, J., Drawel, N., Rjoub, G., & Witold Pedrycz, C. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122666 · Cited by 522 · see citing works
Sequence-to-Sequence Learning as Beam-Search Optimization
Wiseman, S., & Rush, A. M. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1137 · Cited by 485 · see citing works
Constituency Parsing with a Self-Attentive Encoder
Kitaev, N., & Klein, D. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1249 · Cited by 483 · see citing works
Attend and Diagnose: Clinical Time Series Analysis Using Attention Models
Song, H., Rajan, D., Thiagarajan, J., & Spanias, A. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11635 · Cited by 468 · see citing works
Describing Multimedia Content Using Attention-Based Encoder-Decoder Networks
Cho, K., Courville, A. C., & Bengio, Y. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2015.2477044 · Cited by 441 · see citing works
Data Recombination for Neural Semantic Parsing
Jia, R., & Liang, P. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1002 · Cited by 441 · see citing works
(2017) · doi:10.18653/v1/p17-1017 · Cited by 436 · see citing works
DeepFix: Fixing Common C Language Errors by Deep Learning
Gupta, R., Pal, S., Kanade, A., & Shevade, S. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10742 · Cited by 426 · see citing works
Learning Deep Generative Models of GraphsPreprint
Li, Y., Vinyals, O., Dyer, C., Pascanu, R., & Battaglia, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.03324 · Cited by 445 · see citing works
Self-citationCoarse-to-Fine Decoding for Neural Semantic Parsing
Dong, L., & Lapata, M. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1068 · Cited by 378 · see citing works
Meng, R., Zhao, S., Han, S., He, D., Brusilovsky, P. L., & Chi, Y. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1054 · Cited by 369 · see citing works
Knowledge Graph Completion: A Review
Chen, Z., Wang, Y., Zhao, B., Cheng, J., Zhao, X., & Duan, Z. (2020) · IEEE Access · doi:10.1109/access.2020.3030076 · Cited by 352 · see citing works
End-to-end learning of semantic role labeling using recurrent neural networks
Zhou, J., & Xu, W. H. (2015) · doi:10.3115/v1/p15-1109 · Cited by 338 · see citing works
Towards Universal Paraphrastic Sentence EmbeddingsPreprint
Wieting, J., Bansal, M., Gimpel, K., & Livescu, K. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.08198 · Cited by 324 · see citing works
Abstract Syntax Networks for Code Generation and Semantic Parsing
Rabinovich, M., Stern, M., & Klein, D. (2017) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p17-1105 · Cited by 395 · see citing works
Sequence-to-Sequence Models Can Directly Translate Foreign Speech
Weiss, R. J., Chorowski, J., Jaitly, N., Wu, Y., & Chen, Z. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-503 · Cited by 297 · see citing works
Deep Representation Learning for Trajectory Similarity Computation
Li, X., Zhao, K., Cong, G., Jensen, C. S., & Wei, W. (2018) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2018.00062 · Cited by 302 · see citing works
Deep learning for tactile understanding from visual and haptic data
Gao, Y., Hendricks, L. A., Kuchenbecker, K. J., & Darrell, T. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487176 · Cited by 264 · see citing works
Zhang, J., Du, J., Zhang, S. S., Liu, D., Hu, Y., Hu, J., Wei, S., & Dai, L.-R. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.06.017 · Cited by 259 · see citing works
A new concept using LSTM Neural Networks for dynamic system identification
Wang, Y. (2017) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc.2017.7963782 · Cited by 252 · see citing works
Nested Named Entity Recognition Revisited
Katiyar, A., & Cardie, C. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-1079 · Cited by 250 · see citing works
What to talk about and how? Selective Generation using LSTMs with Coarse-to-Fine Alignment
Mei, H., Bansal, M., & Walter, M. R. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1086 · Cited by 251 · see citing works
Compositional Vector Space Models for Knowledge Base Completion
Neelakantan, A., Roth, B., & McCallum, A. (2015) · doi:10.3115/v1/p15-1016 · Cited by 242 · see citing works
Sentence Compression by Deletion with LSTMs
Filippova, K., Alfonseca, E., Colmenares, C. A., Kaiser, Ł., & Vinyals, O. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1042 · Cited by 241 · see citing works
Self-citationAttention Modeling for Targeted Sentiment
Liu, J., & Zhang, Y. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-2091 · Cited by 241 · see citing works
Text2Event: Controllable Sequence-to-Structure Generation for End-to-end Event Extraction
Lu, Y., Lin, H., Xu, J., Han, X., Tang, J., Li, A., Sun, L., Liao, M., & Chen, S. (2021) · doi:10.18653/v1/2021.acl-long.217 · Cited by 230 · see citing works
Neural GPUs Learn AlgorithmsPreprint
Kaiser, Ł., & Sutskever, I. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.08228 · Cited by 224 · see citing works
Self-citationRecognizing functions in binaries with neural networks
Shin, E. C. R., Song, D. X., & Moazzezi, R. (2015) · USENIX Security Symposium · Cited by 223 · see citing works
Lessons from Natural Language Inference in the Clinical Domain
Romanov, A., & Shivade, C. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1187 · Cited by 226 · see citing works
When Are Tree Structures Necessary for Deep Learning of Representations?
Li, J., Luong, M.-T., Jurafsky, D., & Hovy, E. H. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1278 · Cited by 213 · see citing works
Controlling Output Length in Neural Encoder-Decoders
Kikuchi, Y., Neubig, G., Sasano, R., Takamura, H., & Okumura, M. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1140 · Cited by 222 · see citing works
Neural Sequence Learning Models for Word Sense Disambiguation
Raganato, A., Bovi, C. D., & Roberto Navigli, A. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1120 · Cited by 196 · see citing works
A Hierarchical Bidirectional GRU Model With Attention for EEG-Based Emotion Classification
Chen, J., Jiang, D., & Zhang, Y. N. (2019) · IEEE Access · doi:10.1109/access.2019.2936817 · Cited by 193 · see citing works
A Minimal Span-Based Neural Constituency Parser
Stern, M., Andreas, J., & Klein, D. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1076 · Cited by 191 · see citing works
Learning to Generate Product Reviews from Attributes
Dong, L., Huang, S., Wei, F., Lapata, M., Zhou, M., & Xu, K. (2017) · Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers · doi:10.18653/v1/e17-1059 · Cited by 190 · see citing works
On Extended Long Short-term Memory and Dependent Bidirectional Recurrent Neural Network
Su, Y., Huang, Y., & Kuo, C.-C. J. (2018) · Neurocomputing · doi:10.1016/j.neucom.2019.04.044 · Cited by 158 · see citing works
Structured Training for Neural Network Transition-Based Parsing
Weiss, D., Alberti, C., Collins, M., & Petrov, S. (2015) · doi:10.3115/v1/p15-1032 · Cited by 194 · see citing works
Self-citationSemantic Parsing for Task Oriented Dialog using Hierarchical Representations
Gupta, S., Shah, R., Mohit, M., Kumar, A., & Lewis, M. (2018) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1300 · Cited by 219 · see citing works
Contextual LSTM (CLSTM) models for Large scale NLP tasksPreprint
Ghosh, S., Vinyals, O., Strope, B. P., Roy, S., Dean, T., & Heck, L. P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.06291 · Cited by 180 · see citing works
Self-citationFaster sorting algorithms discovered using deep reinforcement learning
Mankowitz, D. J., Michi, A., Zhernov, A., Gelmi, M., Selvi, M., Paduraru, C., Leurent, E., Iqbal, S., Lespiau, J.-B., Ahern, A., et al. (2023) · Nature · doi:10.1038/s41586-023-06004-9 · Cited by 177 · see citing works
Self-citationA Hierarchical Neural Autoencoder for Paragraphs and DocumentsPreprint
Li, J., Luong, M.-T., & Jurafsky, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.01057 · Cited by 169 · see citing works
Attribute Recognition by Joint Recurrent Learning of Context and Correlation
Wang, J., Zhu, X., Gong, S., & Li, W. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.65 · Cited by 164 · see citing works
Attend to You: Personalized Image Captioning with Context Sequence Memory Networks
Park, C. C., Kim, B., & Kim, G. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.681 · Cited by 165 · see citing works
SSIM—A Deep Learning Approach for Recovering Missing Time Series Sensor Data
Zhang, Y., Thorburn, P. J., Xiang, W., & Fitch, P. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2909038 · Cited by 165 · see citing works
Visual Sentiment Analysis by Attending on Local Image Regions
You, Q., Jin, H., & Luo, J. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10501 · Cited by 162 · see citing works
Wang, W., Zhang, M., Chen, G., Jagadish, H. V., Ooi, B. C., & Tan, K. (2016) · ACM SIGMOD Record · doi:10.1145/3003665.3003669 · Cited by 159 · see citing works
How to Represent Part-Whole Hierarchies in a Neural Network
Hinton, G. E. (2022) · Neural Computation · doi:10.1162/neco_a_01557 · Cited by 173 · see citing works
Self-citationText2Action: Generative Adversarial Synthesis from Language to Action
Ahn, H., Ha, T., Choi, Y., Yoo, H., & Oh, S. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8460608 · Cited by 156 · see citing works
Graph-based Dependency Parsing with Bidirectional LSTM
Wang, W., & Chang, B. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1218 · Cited by 154 · see citing works
FERAtt: Facial Expression Recognition With Attention Net
Fernandez, P. D. M., Pena, F. A. G., Ren, T. I., & Cunha, A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00112 · Cited by 142 · see citing works
Zhao, Z., Bao, Z., Zhao, Y., Zhang, Z., Cummins, N., Ren, Z. X., & Schuller, B. W. (2019) · IEEE Access · doi:10.1109/access.2019.2928625 · Cited by 139 · see citing works
Modeling Source Syntax for Neural Machine Translation
Li, J., Xiong, D., Tu, Z., Zhu, M., Zhang, M., & Zhou, G. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1064 · Cited by 137 · see citing works
A Dataset for Multi-Target Stance Detection
Sobhani, P., Inkpen, D. Z., & Zhu, X. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-2088 · Cited by 136 · see citing works
Episodic Transformer for Vision-and-Language Navigation
Pashevich, A., Schmid, C., & Sun, C. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01564 · Cited by 135 · see citing works
What Do Recurrent Neural Network Grammars Learn About Syntax?
Kuncoro, A., Ballesteros, M., Kong, L., Dyer, C., Neubig, G., & Smith, N. A. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-1117 · Cited by 131 · see citing works
Barbieri, F., Ballesteros, M., & Saggion, H. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-2017 · Cited by 130 · see citing works
RobustFill: Neural Program Learning under Noisy I/OPreprint
Devlin, J., Uesato, J., Bhupatiraju, S., Singh, R., Mohamed, A., & Kohli, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.07469 · Cited by 127 · see citing works
Meka, R., Alaeddini, A., & Bhaganagar, K. (2021) · Energy · doi:10.1016/j.energy.2021.119759 · Cited by 125 · see citing works
AMR Parsing as Sequence-to-Graph Transduction
Zhang, S., Ma, X., Duh, K., & Durme, B. V. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1009 · Cited by 119 · see citing works
Span-Based Constituency Parsing with a Structure-Label System and Provably Optimal Dynamic Oracles
Cross, J., & Huang, L. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1001 · Cited by 113 · see citing works
Lee, G., Jeong, J.-Y., Seo, S., Kim, C., & Kang, P. (2018) · Knowledge-Based Systems · doi:10.1016/j.knosys.2018.04.006 · Cited by 111 · see citing works
Interactive neural machine translation
Peris, Á., Domingo, M., & Casacuberta, F. (2016) · Computer Speech & Language · doi:10.1016/j.csl.2016.12.003 · Cited by 107 · see citing works
Character-Level Question Answering with Attention
He, X., & Golub, D. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1166 · Cited by 106 · see citing works
Liu, S., Гуо, Л., Mays, K. K., Betke, M., & Wijaya, D. T. (2019) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k19-1047 · Cited by 109 · see citing works
Zhao, Z., Bao, Z., Zhang, Z., Deng, J., Cummins, N., Wang, H., Tao, J., & Schuller, B. W. (2019) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2019.2955012 · Cited by 106 · see citing works
Multilingual Relation Extraction using Compositional Universal Schema
Verga, P. W., Belanger, D., Strubell, E., Roth, B., & McCallum, A. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1103 · Cited by 100 · see citing works
Zhao, Z., Zheng, Y., Zhang, Z., Wang, H., Zhao, Y., & Li, C. (2018) · Interspeech (USB) · doi:10.21437/interspeech.2018-1477 · Cited by 100 · see citing works
Confusionset-guided Pointer Networks for Chinese Spelling Check
Wang, D., Tay, Y., & Li, Z. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1578 · Cited by 100 · see citing works
SibNet: Sibling Convolutional Encoder for Video Captioning
Liu, S., Ren, Z., & Yuan, J. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2940007 · Cited by 98 · see citing works
Learning to generate one-sentence biographies from Wikidata
Chisholm, A., Radford, W., & Hachey, B. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-1060 · Cited by 97 · see citing works
Wu, Z., Dai, X., Yin, C., Huang, S., & Chen, J. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12054 · Cited by 96 · see citing works
Generating Sentences from Disentangled Syntactic and Semantic Spaces
Bao, Y., Zhou, H., Huang, S., Li, L., Mou, L., Olga Vechtomova, A., Dai, X., & Chen, J. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1602 · Cited by 96 · see citing works
LSTM with particle Swam optimization for sales forecasting
He, Q.-Q., Wu, C., & Si, Y. (2022) · Electronic Commerce Research and Applications · doi:10.1016/j.elerap.2022.101118 · Cited by 93 · see citing works
Durrett, G., & Klein, D. (2015) · doi:10.3115/v1/p15-1030 · Cited by 91 · see citing works
Linking the Neural Machine Translation and the Prediction of Organic Chemistry ReactionsPreprint
Nam, J., & Kim, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.09529 · Cited by 91 · see citing works
S-Net: From Answer Extraction to Answer Generation for Machine Reading ComprehensionPreprint
Tan, C., Wei, F., Yang, N., Du, B., Lv, W., & Zhou, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.04815 · Cited by 91 · see citing works
Advances in all-neural speech recognition
Zweig, G., Yu, C., Droppo, J., & Stolcke, A. (2017) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2017.7953069 · Cited by 89 · see citing works
Microscopy Cell Segmentation Via Convolutional LSTM Networks
Arbelle, A., & Raviv, T. R. (2019) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2019.8759447 · Cited by 87 · see citing works
- Authors
- Vinyals, O., Kaiser, L., Koo, T., Petrov, S., Sutskever, I., & Hinton, G.
- Affiliations
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2014
- Volume
- 28
- Pages
- 2773-2781
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1412.7449
- OpenAlex
- W1869752048
- Cited by
- 464
- References
- 31
- Citations by year
- 2025: 2 · 2024: 11 · 2023: 26 · 2022: 24 · 2021: 42 · 2020: 42 · 2019: 71 · 2018: 88 · 2017: 72 · 2016: 57 · 2015: 29
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- neural information processing systems
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Social Sciences › Arts and Humanities › Language and Linguistics › Syntax, Semantics, Linguistic Variation
- Keywords
- synthetic training data, data efficiency, natural language parsing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
