The DOI matches its DataCite record; 30 of the 31 references it cites were found in a registry or an index.
Grammar as a Foreign Language
Open accessAbstract
Syntactic constituency parsing is a fundamental problem in natural language processing and has been the subject of intensive research and engineering for decades. As a result, the most accurate parsers are domain specific, complex, and inefficient. In this paper we show that the domain agnostic attention-enhanced sequence-to-sequence model achieves state-of-the-art results on the most widely used syntactic constituency parsing dataset, when trained on a large synthetic corpus that was annotated using existing parsers. It also matches the performance of standard parsers when trained only on a small human-annotated dataset, which shows that this model is highly data-efficient, in contrast to sequence-to-sequence models without the attention mechanism. Our parser is also fast, processing over a hundred sentences per second with an unoptimized CPU implementation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Furthermore, RNN sequence-to-sequence models have not been able to attain state-of-the-art results in small-data regimes [37].”
From Attention Is All You Need (2017) · cites this paper as [37]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Self-citationBuilding a Large Annotated Corpus of English: The Penn Treebank
Marcus, M. (1993) · doi:10.21236/ada273556 · Cited by 7,405
Accurate unlexicalized parsing
Klein, D., & Manning, C. D. (2003) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1075096.1075150 · Cited by 3,055
Generating Sequences With Recurrent Neural Networks
Graves, A. (2013) · arXiv · doi:10.48550/arxiv.1308.0850 · Cited by 2,894
Recurrent Continuous Translation Models
Kalchbrenner, N., & Blunsom, P. (2013) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d13-1176 · Cited by 1,277
(2011) · Cited by 1,192
Hovy, E., Marcus, M., Palmer, M., Ramshaw, L., & Weischedel, R. (2006) · Proceedings of the Human Language Technology Conference of the NAACL, Companion Volume: Short Papers on XX - NAACL '06 · doi:10.3115/1614049.1614064 · Cited by 806
Learning Accurate, Compact, and Interpretable Tree Annotation
Petrov, S., Barrett, L., Thibaux, R., & Klein, D. (2006) · Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the ACL - ACL '06 · doi:10.3115/1220175.1220230 · Cited by 793
Self-citation
Research works printed but not linked: 5
- [2][2] Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473 , 2014. - · arXiv
- [4][4] S´ ebastien Jean, Kyunghyun Cho, Roland Memisevic, and Yoshua Bengio. On using very large target vocabulary for neural machine translation. arXiv preprint arXiv:1412.2007 , 2014. - · arXiv
- [24][24] Ronan Collobert. Deep learning for efficient discriminative parsing. In International Conference on Artificial Intelligence and Statistics , 2011. -
- [31][31] Oriol Vinyals, Alexander Toshev, Samy Bengio, and Dumitru Erhan. Show and tell: A neural image caption generator. arXiv preprint arXiv:1411.4555 , 2014. - · arXiv
- [32][32] Zoubin Ghahramani. A neural network for learning how to parse tree adjoining grammar. B.S.Eng Thesis, University of Pennsylvania, 1990.
Cited by
Sorted by citations
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408
Self-citationDeep Learning with Differential Privacy
Abadi, M., Chu, A., Goodfellow, I., McMahan, H. B., Mironov, I., Talwar, K., & Zhang, L. (2016) · Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2976749.2978318 · Cited by 6,578
Hierarchical Attention Networks for Document Classification
Yang, Z., Yang, D., Dyer, C., He, X., Smola, A. J., & Hovy, E. H. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1174 · Cited by 5,022
Recent Trends in Deep Learning Based Natural Language Processing [Review Article]
Young, T., Hazarika, D., Poria, S., & Cambria, E. (2018) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2018.2840738 · Cited by 2,921
Anchors: High-Precision Model-Agnostic Explanations
Ribeiro, M. T., Singh, S., & Guestrin, C. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11491 · Cited by 2,162
“In Table 2, we compute anchors for a multi-layer RNN encoder/attention-based decoder translation system (Vinyals et al. 2015) trained on English-Portuguese parallel corpora.”
MethodVinyals, O., Fortunato, M., & Jaitly, N. (2015) · neural information processing systems · Cited by 2,043
Self-citationA Diversity-Promoting Objective Function for Neural Conversation Models
Li, J., Galley, M., Brockett, C., Gao, J., & Dolan, B. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1014 · Cited by 2,459
A Survey of the Usages of Deep Learning for Natural Language Processing
Otter, D. W., Medina, J. R., & Kalita, J. K. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2979670 · Cited by 1,836
Tacotron: towards end-to-end speech synthesis
Wang, Y., Skerry-Ryan, R. J., Stanton, D., Wu, Y., Weiss, R. J., Jaitly, N., Yang, Z., Xiao, Y., Chen, Z., Bengio, S., et al. (2017) · Interspeech 2017 · doi:10.21437/interspeech.2017-1452 · Cited by 1,746
Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks
Bengio, S., Vinyals, O., Jaitly, N., & Shazeer, N. (2015) · arXiv · doi:10.48550/arxiv.1506.03099 · Cited by 1,621
Self-citationVinyals, O., & Le, Q. (2015) · arXiv · doi:10.48550/arxiv.1506.05869 · Cited by 1,400
Self-citationNeural Motifs: Scene Graph Parsing with Global Context
Zellers, R., Yatskar, M., Thomson, S., & Choi, Y. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00611 · Cited by 1,127
Sequence-Level Knowledge Distillation
Kim, Y., & Rush, A. M. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1139 · Cited by 836
Language to Logical Form with Neural Attention
Dong, L., & Lapata, M. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1004 · Cited by 700
Order Matters: Sequence to sequence for sets
Vinyals, O., Bengio, S., & Kudlur, M. (2015) · arXiv · doi:10.48550/arxiv.1511.06391
Self-citationAttention in Natural Language Processing
Galassi, A., Lippi, M., & Torroni, P. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3019893 · Cited by 726
Reasoning about Entailment with Neural AttentionPreprint
Rocktäschel, T., Grefenstette, E., Hermann, K. M., Kočiský, T., & Blunsom, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1509.06664 · Cited by 704
What you can cram into a single $&!#* vector: Probing sentence embeddings for linguistic properties
Conneau, A., Kruszewski, G., Lample, G., Barrault, L., & Baroni, M. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1198 · Cited by 657
Transition-Based Dependency Parsing with Stack Long Short-Term Memory
Dyer, C., Ballesteros, M., Ling, W., Matthews, A., & Smith, N. A. (2015) · doi:10.3115/v1/p15-1033 · Cited by 848
A Simple Way to Initialize Recurrent Networks of Rectified Linear UnitsPreprint
Le, Q. V., Jaitly, N., & Hinton, G. E. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.00941 · Cited by 744
Self-citationDeep visual tracking: Review and experimental comparison
Li, P., Wang, D., Wang, L., & Lu, H. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.11.007 · Cited by 517
A Hierarchical Neural Autoencoder for Paragraphs and Documents
Li, J., Luong, M.-T., & Jurafsky, D. (2015) · doi:10.3115/v1/p15-1107 · Cited by 511
A comprehensive survey on applications of transformers for deep learning tasks
Islam, S., Elmekki, H., Elsebai, A., Bentahar, J., Drawel, N., Rjoub, G., & Witold Pedrycz, C. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122666 · Cited by 590
Sequence-to-Sequence Learning as Beam-Search Optimization
Wiseman, S., & Rush, A. M. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1137 · Cited by 549
Constituency Parsing with a Self-Attentive Encoder
Kitaev, N., & Klein, D. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1249 · Cited by 531
Attend and Diagnose: Clinical Time Series Analysis Using Attention Models
Song, H., Rajan, D., Thiagarajan, J., & Spanias, A. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11635 · Cited by 468
Describing Multimedia Content Using Attention-Based Encoder-Decoder Networks
Cho, K., Courville, A. C., & Bengio, Y. (2015) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2015.2477044 · Cited by 452
Data Recombination for Neural Semantic Parsing
Jia, R., & Liang, P. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1002 · Cited by 441
(2017) · doi:10.18653/v1/p17-1017 · Cited by 436
DeepFix: Fixing Common C Language Errors by Deep Learning
Gupta, R., Pal, S., Kanade, A., & Shevade, S. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10742 · Cited by 426
Learning Deep Generative Models of GraphsPreprint
Li, Y., Vinyals, O., Dyer, C., Pascanu, R., & Battaglia, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.03324 · Cited by 679
Self-citationCoarse-to-Fine Decoding for Neural Semantic Parsing
Dong, L., & Lapata, M. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1068 · Cited by 410
Meng, R., Zhao, S., Han, S., He, D., Brusilovsky, P. L., & Chi, Y. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1054 · Cited by 399
Knowledge Graph Completion: A Review
Chen, Z., Wang, Y., Zhao, B., Cheng, J., Zhao, X., & Duan, Z. (2020) · IEEE Access · doi:10.1109/access.2020.3030076 · Cited by 382
End-to-end learning of semantic role labeling using recurrent neural networks
Zhou, J., & Xu, W. H. (2015) · doi:10.3115/v1/p15-1109 · Cited by 338
Towards Universal Paraphrastic Sentence EmbeddingsPreprint
Wieting, J., Bansal, M., Gimpel, K., & Livescu, K. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.08198 · Cited by 446
Abstract Syntax Networks for Code Generation and Semantic Parsing
Rabinovich, M., Stern, M., & Klein, D. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1105 · Cited by 368
Sequence-to-Sequence Models Can Directly Translate Foreign Speech
Weiss, R. J., Chorowski, J., Jaitly, N., Wu, Y., & Chen, Z. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-503 · Cited by 343
Deep Representation Learning for Trajectory Similarity Computation
Li, X., Zhao, K., Cong, G., Jensen, C. S., & Wei, W. (2018) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2018.00062 · Cited by 316
Deep learning for tactile understanding from visual and haptic data
Gao, Y., Hendricks, L. A., Kuchenbecker, K. J., & Darrell, T. (2016) · 2016 IEEE International Conference on Robotics and Automation (ICRA) · doi:10.1109/icra.2016.7487176 · Cited by 264
Zhang, J., Du, J., Zhang, S. S., Liu, D., Hu, Y., Hu, J., Wei, S., & Dai, L.-R. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.06.017 · Cited by 259
A new concept using LSTM Neural Networks for dynamic system identification
Wang, Y. (2017) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.23919/acc.2017.7963782 · Cited by 258
Nested Named Entity Recognition Revisited
Katiyar, A., & Cardie, C. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-1079 · Cited by 251
What to talk about and how? Selective Generation using LSTMs with Coarse-to-Fine Alignment
Mei, H., Bansal, M., & Walter, M. R. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1086 · Cited by 261
Compositional Vector Space Models for Knowledge Base Completion
Neelakantan, A., Roth, B., & McCallum, A. (2015) · doi:10.3115/v1/p15-1016 · Cited by 254
Sentence Compression by Deletion with LSTMs
Filippova, K., Alfonseca, E., Colmenares, C. A., Kaiser, Ł., & Vinyals, O. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1042 · Cited by 246
Self-citationAttention Modeling for Targeted Sentiment
Liu, J., & Zhang, Y. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-2091 · Cited by 241
Text2Event: Controllable Sequence-to-Structure Generation for End-to-end Event Extraction
Lu, Y., Lin, H., Xu, J., Han, X., Tang, J., Li, A., Sun, L., Liao, M., & Chen, S. (2021) · doi:10.18653/v1/2021.acl-long.217 · Cited by 262
Neural GPUs Learn AlgorithmsPreprint
Kaiser, Ł., & Sutskever, I. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.08228 · Cited by 333
Self-citationRecognizing functions in binaries with neural networks
Shin, E. C. R., Song, D. X., & Moazzezi, R. (2015) · USENIX Security Symposium · Cited by 223
Lessons from Natural Language Inference in the Clinical Domain
Romanov, A., & Shivade, C. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1187 · Cited by 249
When Are Tree Structures Necessary for Deep Learning of Representations?
Li, J., Luong, M.-T., Jurafsky, D., & Hovy, E. H. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1278 · Cited by 224
Controlling Output Length in Neural Encoder-Decoders
Kikuchi, Y., Neubig, G., Sasano, R., Takamura, H., & Okumura, M. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1140 · Cited by 222
Neural Sequence Learning Models for Word Sense Disambiguation
Raganato, A., Bovi, C. D., & Roberto Navigli, A. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1120 · Cited by 200
A Hierarchical Bidirectional GRU Model With Attention for EEG-Based Emotion Classification
Chen, J., Jiang, D., & Zhang, Y. N. (2019) · IEEE Access · doi:10.1109/access.2019.2936817 · Cited by 193
A Minimal Span-Based Neural Constituency Parser
Stern, M., Andreas, J., & Klein, D. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1076 · Cited by 198
Learning to Generate Product Reviews from Attributes
Dong, L., Huang, S., Wei, F., Lapata, M., Zhou, M., & Xu, K. (2017) · Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers · doi:10.18653/v1/e17-1059 · Cited by 190
On extended long short-term memory and dependent bidirectional recurrent neural network
Su, Y., & Kuo, C. ‐. J. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.04.044 · Cited by 198
Structured Training for Neural Network Transition-Based Parsing
Weiss, D., Alberti, C., Collins, M., & Petrov, S. (2015) · doi:10.3115/v1/p15-1032 · Cited by 196
Self-citationSemantic Parsing for Task Oriented Dialog using Hierarchical Representations
Gupta, S., Shah, R., Mohit, M., Kumar, A., & Lewis, M. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1300 · Cited by 199
Contextual LSTM (CLSTM) models for Large scale NLP tasksPreprint
Ghosh, S., Vinyals, O., Strope, B. P., Roy, S., Dean, T., & Heck, L. P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.06291 · Cited by 236
Self-citationFaster sorting algorithms discovered using deep reinforcement learning
Mankowitz, D. J., Michi, A., Zhernov, A., Gelmi, M., Selvi, M., Paduraru, C., Leurent, E., Iqbal, S., Lespiau, J.-B., Ahern, A., et al. (2023) · Nature · doi:10.1038/s41586-023-06004-9 · Cited by 177
Self-citationA Hierarchical Neural Autoencoder for Paragraphs and DocumentsPreprint
Li, J., Luong, M.-T., & Jurafsky, D. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.01057 · Cited by 287
Attribute Recognition by Joint Recurrent Learning of Context and Correlation
Wang, J., Zhu, X., Gong, S., & Li, W. (2017) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.65 · Cited by 164
Attend to You: Personalized Image Captioning with Context Sequence Memory Networks
Park, C. C., Kim, B., & Kim, G. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.681 · Cited by 170
SSIM—A Deep Learning Approach for Recovering Missing Time Series Sensor Data
Zhang, Y., Thorburn, P. J., Xiang, W., & Fitch, P. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2019.2909038 · Cited by 168
Visual Sentiment Analysis by Attending on Local Image Regions
You, Q., Jin, H., & Luo, J. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10501 · Cited by 162
Wang, W., Zhang, M., Chen, G., Jagadish, H. V., Ooi, B. C., & Tan, K. (2016) · ACM SIGMOD Record · doi:10.1145/3003665.3003669 · Cited by 162
How to Represent Part-Whole Hierarchies in a Neural Network
Hinton, G. E. (2022) · Neural Computation · doi:10.1162/neco_a_01557 · Cited by 173
Self-citationText2Action: Generative Adversarial Synthesis from Language to Action
Ahn, H., Ha, T., Choi, Y., Yoo, H., & Oh, S. (2018) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra.2018.8460608 · Cited by 164
Graph-based Dependency Parsing with Bidirectional LSTM
Wang, W., & Chang, B. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1218 · Cited by 154
FERAtt: Facial Expression Recognition With Attention Net
Fernandez, P. D. M., Pena, F. A. G., Ren, T. I., & Cunha, A. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2019.00112 · Cited by 142
Zhao, Z., Bao, Z., Zhao, Y., Zhang, Z., Cummins, N., Ren, Z. X., & Schuller, B. W. (2019) · IEEE Access · doi:10.1109/access.2019.2928625 · Cited by 141
Modeling Source Syntax for Neural Machine Translation
Li, J., Xiong, D., Tu, Z., Zhu, M., Zhang, M., & Zhou, G. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1064 · Cited by 137
A Dataset for Multi-Target Stance Detection
Sobhani, P., Inkpen, D. Z., & Zhu, X. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-2088 · Cited by 136
Episodic Transformer for Vision-and-Language Navigation
Pashevich, A., Schmid, C., & Sun, C. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.01564 · Cited by 135
What Do Recurrent Neural Network Grammars Learn About Syntax?
Kuncoro, A., Ballesteros, M., Kong, L., Dyer, C., Neubig, G., & Smith, N. A. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-1117 · Cited by 131
Barbieri, F., Ballesteros, M., & Saggion, H. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-2017 · Cited by 147
RobustFill: Neural Program Learning under Noisy I/OPreprint
Devlin, J., Uesato, J., Bhupatiraju, S., Singh, R., Mohamed, A., & Kohli, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.07469 · Cited by 174
Meka, R., Alaeddini, A., & Bhaganagar, K. (2021) · Energy · doi:10.1016/j.energy.2021.119759 · Cited by 132
AMR Parsing as Sequence-to-Graph Transduction
Zhang, S., Ma, X., Duh, K., & Durme, B. V. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1009 · Cited by 128
Span-Based Constituency Parsing with a Structure-Label System and Provably Optimal Dynamic Oracles
Cross, J., & Huang, L. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1001 · Cited by 119
Lee, G., Jeong, J.-Y., Seo, S., Kim, C., & Kang, P. (2018) · Knowledge-Based Systems · doi:10.1016/j.knosys.2018.04.006 · Cited by 112
Interactive neural machine translation
Peris, Á., Domingo, M., & Casacuberta, F. (2016) · Computer Speech & Language · doi:10.1016/j.csl.2016.12.003 · Cited by 108
Character-Level Question Answering with Attention
He, X., & Golub, D. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1166 · Cited by 184
Liu, S., Гуо, Л., Mays, K. K., Betke, M., & Wijaya, D. T. (2019) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k19-1047 · Cited by 119
Zhao, Z., Bao, Z., Zhang, Z., Deng, J., Cummins, N., Wang, H., Tao, J., & Schuller, B. W. (2019) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2019.2955012 · Cited by 110
Multilingual Relation Extraction using Compositional Universal Schema
Verga, P. W., Belanger, D., Strubell, E., Roth, B., & McCallum, A. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1103 · Cited by 101
Zhao, Z., Zheng, Y., Zhang, Z., Wang, H., Zhao, Y., & Li, C. (2018) · Interspeech (USB) · doi:10.21437/interspeech.2018-1477 · Cited by 100
Confusionset-guided Pointer Networks for Chinese Spelling Check
Wang, D., Tay, Y., & Li, Z. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1578 · Cited by 99
SibNet: Sibling Convolutional Encoder for Video Captioning
Liu, S., Ren, Z., & Yuan, J. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2940007 · Cited by 101
Learning to generate one-sentence biographies from Wikidata
Chisholm, A., Radford, W., & Hachey, B. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-1060 · Cited by 97
Wu, Z., Dai, X., Yin, C., Huang, S., & Chen, J. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12054 · Cited by 97
Generating Sentences from Disentangled Syntactic and Semantic Spaces
Bao, Y., Zhou, H., Huang, S., Li, L., Mou, L., Vechtomova, O., Dai, X., & Chen, J. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1602 · Cited by 110
LSTM with particle Swam optimization for sales forecasting
He, Q.-Q., Wu, C., & Si, Y. (2022) · Electronic Commerce Research and Applications · doi:10.1016/j.elerap.2022.101118 · Cited by 100
Durrett, G., & Klein, D. (2015) · doi:10.3115/v1/p15-1030 · Cited by 101
Linking the Neural Machine Translation and the Prediction of Organic Chemistry ReactionsPreprint
Nam, J., & Kim, J. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.09529 · Cited by 91
S-Net: From Answer Extraction to Answer Generation for Machine Reading ComprehensionPreprint
Tan, C., Wei, F., Yang, N., Du, B., Lv, W., & Zhou, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.04815 · Cited by 91
Advances in all-neural speech recognition
Zweig, G., Yu, C., Droppo, J., & Stolcke, A. (2017) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2017.7953069 · Cited by 91
Microscopy Cell Segmentation Via Convolutional LSTM Networks
Arbelle, A., & Raviv, T. R. (2019) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi.2019.8759447 · Cited by 90
Metadata
- Authors
- Vinyals, O., Kaiser, L., Koo, T., Petrov, S., Sutskever, I., & Hinton, G.
- Affiliations
- Google (United States) (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2014
- Volume
- 28
- Pages
- 2773-2781
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1412.7449
- OpenAlex
- W1869752048
- Cited by
- 464
- References
- 31
- Citations by year
- 2025: 2 · 2024: 11 · 2023: 26 · 2022: 24 · 2021: 42 · 2020: 42 · 2019: 71 · 2018: 88 · 2017: 72 · 2016: 57 · 2015: 29
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- neural information processing systems
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Social Sciences › Arts and Humanities › Language and Linguistics › Syntax, Semantics, Linguistic Variation
- Keywords
- synthetic training data, data efficiency, natural language parsing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
