Data Recombination for Neural Semantic Parsing
Open accessAbstract
Modeling crisp logical regularities is crucial in semantic parsing, making it difficult for neural models with no task-specific prior knowledge to achieve good results.In this paper, we introduce data recombination, a novel framework for injecting such prior knowledge into a model.From the training data, we induce a highprecision synchronous context-free grammar, which captures important conditional independence properties commonly found in semantic parsing.We then train a sequence-to-sequence recurrent network (RNN) model with a novel attention-based copying mechanism on datapoints sampled from this grammar, thereby teaching the model about these structural properties.Data recombination improves the accuracy of our RNN model on three semantic parsing datasets, leading to new state-of-the-art performance on the standard GeoQuery dataset for models with comparable supervision.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
For manuscript 726, retrieval supplied explicit comparisons with related semantic-parsing research by Dong and Lapata (2016) and Jia and Liang (2016), which appeared in the final review output.
“For manuscript 726, retrieval supplied explicit comparisons with related semantic-parsing research by Dong and Lapata (2016) and Jia and Liang (2016), which appeared in the final review output.”
From Who Reviews the Reviewer? A Multi‐Agent LLM Architecture With Meta‐Review Synthesis for Editorial Peer Review (2026) · cites this paper as Jia and Liang (2016)
The paper’s Problem statement (§2) establishes Jia and Liang (2016) as semantic-parsing research, and its References list Dong and Lapata (2016). It does not address manuscript 726, what retrieval supplied, or what appeared in a final review output; those parts of the claim are not supported by this source. (LLM, conf=0.84)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · see citing works
Effective Approaches to Attention-based Neural Machine Translation
Luong, T., Pham, H., & Manning, C. D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1166 · Cited by 8,382 · see citing works
Vinyals, O., Kaiser, L., Koo, T., Petrov, S., Sutskever, I., & Hinton, G. (2014) · arXiv · doi:10.48550/arxiv.1412.7449 · Cited by 464 · see citing works
Flagged first, then by citations
Research works printed but not linked: 36
- Y. Artzi and L. Zettlemoyer. 2013a. UW SPF: The University of Washington semantic parsing frame- work. arXiv preprint arXiv:1311.3011. · arXiv
- Y. Artzi and L. Zettlemoyer. 2013b. Weakly super- vised learning of semantic parsers for mapping in- structions to actions. Transactions of the Associ- ation for Computational Linguistics (TACL), 1:49- 62.
- D. Bahdanau, K. Cho, and Y. Bengio. 2014. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473. · arXiv
- J. Berant, A. Chou, R. Frostig, and P. Liang. 2013. Semantic parsing on Freebase from question-answer pairs. In Empirical Methods in Natural Language Processing (EMNLP).
- J. Bergstra, O. Breuleux, F. Bastien, P. Lamblin, R. Pas- canu, G. Desjardins, J. Turian, D. Warde-Farley, and Y. Bengio. 2010. Theano: a CPU and GPU math expression compiler. In Python for Scientific Com- puting Conference.
- J. Clarke, D. Goldwasser, M. Chang, and D. Roth. 2010. Driving semantic parsing from the world's re- sponse. In Computational Natural Language Learn- ing (CoNLL), pages 18-27.
- L. Dong and M. Lapata. 2016. Language to logical form with neural attention. In Association for Com- putational Linguistics (ACL).
- C. Dyer, M. Ballesteros, W. Ling, A. Matthews, and N. A. Smith. 2015. Transition-based dependency parsing with stack long short-term memory. In As- sociation for Computational Linguistics (ACL).
- E. Grefenstette, P. Blunsom, N. de Freitas, and K. M. Hermann. 2014. A deep architecture for seman- tic parsing. In ACL Workshop on Semantic Parsing, pages 22-27.
- J. Gu, Z. Lu, H. Li, and V. O. Li. 2016. Incorporating copying mechanism in sequence-to-sequence learn- ing. In Association for Computational Linguistics (ACL).
- C. Gulcehre, S. Ahn, R. Nallapati, B. Zhou, and Y. Ben- gio. 2016. Pointing the unknown words. In Associ- ation for Computational Linguistics (ACL).
- K. Guu, J. Miller, and P. Liang. 2015. Travers- ing knowledge graphs in vector space. In Em- pirical Methods in Natural Language Processing (EMNLP).
- G. E. Hinton, N. Srivastava, A. Krizhevsky, I. Sutskever, and R. R. Salakhutdinov. 2012. Improving neural networks by preventing co- adaptation of feature detectors. arXiv preprint arXiv:1207.0580. · arXiv
- S. Hochreiter and J. Schmidhuber. 1997. Long short- term memory. Neural Computation, 9(8):1735- 1780.
- N. Jaitly and G. E. Hinton. 2013. Vocal tract length perturbation (vtlp) improves speech recog- nition. In International Conference on Machine Learning (ICML).
- N. Kushman and R. Barzilay. 2013. Using semantic unification to generate regular expressions from nat- ural language. In Human Language Technology and North American Association for Computational Lin- guistics (HLT/NAACL), pages 826-836.
- T. Kwiatkowski, L. Zettlemoyer, S. Goldwater, and M. Steedman. 2010. Inducing probabilistic CCG grammars from logical form with higher-order uni- fication. In Empirical Methods in Natural Language Processing (EMNLP), pages 1223-1233.
- T. Kwiatkowski, L. Zettlemoyer, S. Goldwater, and M. Steedman. 2011. Lexical generalization in CCG grammar induction for semantic parsing. In Empirical Methods in Natural Language Processing (EMNLP), pages 1512-1523.
- P. Liang, M. I. Jordan, and D. Klein. 2011. Learn- ing dependency-based compositional semantics. In Association for Computational Linguistics (ACL), pages 590-599.
- A. Liu, J. Ghosh, and C. Martin. 2007. Generative oversampling for mining imbalanced datasets. In In- ternational Conference on Data Mining (DMIN).
- M. Luong, I. Sutskever, Q. V. Le, O. Vinyals, and W. Zaremba. 2015b. Addressing the rare word problem in neural machine translation. In Associa- tion for Computational Linguistics (ACL), pages 11- 19.
- H. Mei, M. Bansal, and M. R. Walter. 2016. Listen, attend, and walk: Neural mapping of navigational instructions to action sequences. In Association for the Advancement of Artificial Intelligence (AAAI).
- S. Petrov, P. Chang, M. Ringgaard, and H. Alshawi. 2010. Uptraining for accurate deterministic ques- tion parsing. In Empirical Methods in Natural Lan- guage Processing (EMNLP).
- H. Poon. 2013. Grounded unsupervised semantic pars- ing. In Association for Computational Linguistics (ACL).
- I. Sutskever, O. Vinyals, and Q. V. Le. 2014. Se- quence to sequence learning with neural networks. In Advances in Neural Information Processing Sys- tems (NIPS), pages 3104-3112.
- O. Vinyals, M. Fortunato, and N. Jaitly. 2015a. Pointer networks. In Advances in Neural Information Pro- cessing Systems (NIPS), pages 2674-2682.
- S. Wager, S. I. Wang, and P. Liang. 2013. Dropout training as adaptive regularization. In Advances in Neural Information Processing Systems (NIPS).
- W. Y. Wang and D. Yang. 2015. That's so annoying!!!: A lexical and frame-semantic embedding based data augmentation approach to automatic categorization of annoying behaviors using #petpeeve tweets. In Empirical Methods in Natural Language Processing (EMNLP).
- Y. Wang, J. Berant, and P. Liang. 2015. Building a semantic parser overnight. In Association for Com- putational Linguistics (ACL).
- Y. W. Wong and R. J. Mooney. 2006. Learning for se- mantic parsing with statistical machine translation. In North American Association for Computational Linguistics (NAACL), pages 439-446.
- Y. W. Wong and R. J. Mooney. 2007. Learning synchronous grammars for semantic parsing with lambda calculus. In Association for Computational Linguistics (ACL), pages 960-967.
- M. Zelle and R. J. Mooney. 1996. Learning to parse database queries using inductive logic pro- gramming. In Association for the Advancement of Artificial Intelligence (AAAI), pages 1050-1055.
- L. S. Zettlemoyer and M. Collins. 2005. Learning to map sentences to logical form: Structured classifica- tion with probabilistic categorial grammars. In Un- certainty in Artificial Intelligence (UAI), pages 658- 666.
- L. S. Zettlemoyer and M. Collins. 2007. Online learn- ing of relaxed CCG grammars for parsing to log- ical form. In Empirical Methods in Natural Lan- guage Processing and Computational Natural Lan- guage Learning (EMNLP/CoNLL), pages 678-687.
- X. Zhang, J. Zhao, and Y. LeCun. 2015. Character- level convolutional networks for text classification. In Advances in Neural Information Processing Sys- tems (NIPS).
- K. Zhao and L. Huang. 2015. Type-driven incremen- tal semantic parsing with polymorphism. In North American Association for Computational Linguis- tics (NAACL).
Cited by
Sorted by citations
European Union Regulations on Algorithmic Decision Making and a “Right to Explanation”
Goodman, B., & Flaxman, S. (2017) · AI Magazine · doi:10.1609/aimag.v38i3.2741 · Cited by 2,131 · see citing works
Adversarial Examples for Evaluating Reading Comprehension Systems
Jia, R., & Liang, P. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1215 · Cited by 1,410 · see citing works
Self-citationYu, T., Zhang, R., Yang, K., Yasunaga, M., Wang, D., Li, Z., Ma, J., Li, I., Yao, Q., Roman, S., et al. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1425 · Cited by 1,034 · see citing works
Long short-term memory networks in memristor crossbar arrays
Li, C., Wang, Z., Rao, M., Belkin, D., Song, W., Jiang, H., Yan, P., Li, Y., Lin, P., Hu, M., et al. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-018-0001-4 · Cited by 429 · see citing works
Self-Planning Code Generation with Large Language Models
Jiang, X., Dong, Y., Wang, L., Fang, Z., Shang, Q., Li, G., Jin, Z., & Jiao, W. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3672456 · Cited by 158 · see citing works
Constrained Language Models Yield Few-Shot Semantic Parsers
Shin, R., Lin, C., Thomson, S., Chen, C., Roy, S., Platanios, E. A., Pauls, A., Klein, D., Eisner, J., & Van Durme, B. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.608 · Cited by 139 · see citing works
“, 2013), semantic parsing has recently been driven by encoder-decoder neural architectures (starting with Dong and Lapata, 2016; Jia and Liang, 2016; Kočiský et al., 2016).”
BackgroundSequence-to-Action: End-to-End Semantic Graph Generation for Semantic Parsing
Chen, B., Sun, L., & Han, X. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1071 · Cited by 69 · see citing works
Joseph, J. W., Leventhal, E. L., Grossestreuer, A. V., Wong, M. L., Joseph, L. J., Nathanson, L. A., Donnino, M. W., Elhadad, N., & Sanchez, L. D. (2020) · doi:10.1101/2020.05.02.20089052 · Cited by 57 · see citing works
SEQZERO: Few-shot Compositional Semantic Parsing with Sequential Prompts and Zero-shot Models
Yang, J., Jiang, H., Yin, Q., Zhang, D., Yin, B., & Yang, D. (2022) · Findings of the Association for Computational Linguistics: NAACL 2022 · doi:10.18653/v1/2022.findings-naacl.5 · Cited by 15 · see citing works
Ali, Ș., Oprea, S., & Bâra, A. (2026) · Systems Research and Behavioral Science · doi:10.1002/sres.70163
- Authors
- Jia, R., & Liang, P.
- Affiliations
- Stanford University (US)
- Venue
- Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Published
- 2016
- Pages
- 12-22
- ISSN
- 0736-587X (ISSN-L)
- OpenAlex
- W2963655793
- Cited by
- 441
- References
- 3
- Citations by year
- 2026: 6 · 2025: 8 · 2024: 14 · 2023: 40 · 2022: 39 · 2021: 87 · 2020: 86 · 2019: 71 · 2018: 53 · 2017: 34 · 2016: 3
- FWCI
- 28.92
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Proceedings of the conference - Association for Computational Linguistics. Meeting (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation ((DGE-114747, 114747)
- Defense Advanced Research Projects Agency
- Army Research Office (W911NF-15-1-, W911NF, W911NF-15)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Social Sciences › Arts and Humanities › Language and Linguistics › Syntax, Semantics, Linguistic Variation
- Keywords
- semantic parsing, conditional independence, recurrent neural networks, prior knowledge incorporation, natural language understanding
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review