The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Towards Complex Text-to-SQL in Cross-Domain Database with Intermediate Representation
Open accessAbstract
We present a neural approach called IRNet for complex and cross-domain Text-to-SQL.IR-Net aims to address two challenges: 1) the mismatch between intents expressed in natural language (NL) and the implementation details in SQL; 2) the challenge in predicting columns caused by the large number of outof-domain words.Instead of end-to-end synthesizing a SQL query, IRNet decomposes the synthesis process into three phases.In the first phase, IRNet performs a schema linking over a question and a database schema.Then, IRNet adopts a grammar-based neural model to synthesize a SemQL query which is an intermediate representation that we design to bridge NL and SQL.Finally, IRNet deterministically infers a SQL query from the synthesized SemQL query with domain knowledge.On the challenging Text-to-SQL benchmark Spider, IRNet achieves 46.7% accuracy, obtaining 19.5% absolute improvement over previous state-of-the-art approaches.At the time of writing, IRNet achieves the first position on the Spider leaderboard. * Equal Contributions. Work done during an internship at MSRA.NL: Show the names of students who have a grade higher than 5 and have at least 2 friends. SQL: SELECT T1.name FROM friend AS T1 JOIN highschooler AS T2ON T1.student_id = T2.idWHERE T2
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
(2017) · Cited by 11,625
Semantic Parsing on Freebase from Question-Answer Pairs
Berant, J., Chou, A., Frostig, R., & Liang, P. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1160 · Cited by 1,517
Incorporating Copying Mechanism in Sequence-to-Sequence Learning
Gu, J., Lu, Z., Li, H., & Li, V. O. K. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1154 · Cited by 1,446
Heath, J., Kamp, H., & Reyle, U. (1995) · Language · doi:10.2307/415752 · Cited by 1,445
Natural language interfaces to databases – an introduction
Androutsopoulos, I., Ritchie, G. D., & Thanisch, P. (1995) · Natural Language Engineering · doi:10.1017/s135132490000005x · Cited by 768
Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learning
Zhong, V., Xiong, C., & Socher, R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.00103 · Cited by 733
Learning to parse database queries using inductive logic programming
Zelle, J. M., & Mooney, R. J. (1996) · Cited by 642
A Syntactic Neural Model for General-Purpose Code Generation
Yin, P., & Neubig, G. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1041 · Cited by 623
A Syntactic Neural Model for General-Purpose Code Generation
Yin, P., & Neubig, G. (2017) · arXiv · doi:10.48550/arxiv.1704.01696 · Cited by 585
Learning Dependency-Based Compositional Semantics
Liang, P., Jordan, M. I., & Klein, D. (2013) · Computational Linguistics · doi:10.1162/coli_a_00127 · Cited by 546
Developing a natural language interface to complex data
Hendrix, G. G., Sacerdoti, E. D., Sagalowicz, D., & Slocum, J. (1978) · ACM Transactions on Database Systems · doi:10.1145/320251.320253 · Cited by 534
Compositional Semantic Parsing on Semi-Structured Tables
Pasupat, P., & Liang, P. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1142 · Cited by 514
The Value of Semantic Parse Labeling for Knowledge Base Question Answering
Yih, W.-T., Richardson, M., Meek, C., Chang, M.-W., & Suh, J. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p16-2033 · Cited by 461
Constructing an interactive natural language interface for relational databases
Li, F., & Jagadish, H. V. (2014) · Proceedings of the VLDB Endowment · doi:10.14778/2735461.2735468 · Cited by 437
Representing General Relational Knowledge in ConceptNet 5
Speer, R., & Havasi, C. (2012) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/3zycidvg6dgg · Cited by 407
Program synthesis by sketching
Bodík, R., & Solar-Lezama, A. (2008) · UC Berkeley · Cited by 388
Neural Symbolic Machines: Learning Semantic Parsers on Freebase with Weak Supervision
Liang, C., Berant, J., Le, Q., Forbus, K. D., & Lao, N. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1003 · Cited by 381
Coarse-to-Fine Decoding for Neural Semantic Parsing
Dong, L., & Lapata, M. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1068 · Cited by 374
Learning a Neural Semantic Parser from User Feedback
Iyer, S., Konstas, I., Cheung, A., Krishnamurthy, J., & Zettlemoyer, L. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1089 · Cited by 330
Covington, M. A., & Alshawi, H. (1994) · Language · doi:10.2307/416341 · Cited by 328
A Comprehensive Exploration on WikiSQL with Table-Aware Word ContextualizationPreprint
Hwang, W., Yim, J., Park, S., & Seo, M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.01069 · Cited by 305
SQLNet: Generating Structured Queries From Natural Language Without Reinforcement Learning
Xu, X., Liu, C., & Song, D. X. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.04436 · Cited by 283
SQLizer: query synthesis from natural language
Yaghmazadeh, N., Wang, Y., Dillig, I., & Dillig, T. (2017) · Proceedings of the ACM on Programming Languages · doi:10.1145/3133887 · Cited by 279
An efficient easily adaptable system for interpreting natural language queries
Warren, D. H. D., & Pereira, F. C. N. (1982) · doi:10.5555/972942.972944 · Cited by 275
TEAM: An experiment in the design of transportable natural-language interfaces
Grosz, B. J., Appelt, D. E., Martin, P. A., & Pereira, F. C. N. (1987) · Artificial Intelligence · doi:10.1016/0004-3702(87)90011-7 · Cited by 264
TypeSQL: Knowledge-Based Type-Aware Neural Text-to-SQL Generation
Yu, T., Li, Z., Zhang, Z., Zhang, R., & Radev, D. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers) · doi:10.18653/v1/n18-2093 · Cited by 236
Neural Semantic Parsing with Type Constraints for Semi-Structured Tables
Krishnamurthy, J., Dasigi, P., & Gardner, M. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1160 · Cited by 229
End-to-End Neural Entity Linking
Kolitsas, N., Ganea, O.-E., & Hofmann, T. (2018) · Proceedings of the 22nd Conference on Computational Natural Language Learning · doi:10.18653/v1/k18-1050 · Cited by 228
Improving Text-to-SQL Evaluation Methodology
Finegan-Dollak, C., Kummerfeld, J. K., Zhang, L., Ramanathan, K., Sadasivam, S., Zhang, R., & Radev, D. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1033 · Cited by 208
TRANX: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation
Yin, P., & Neubig, G. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing: System Demonstrations · doi:10.18653/v1/d18-2002 · Cited by 203
SyntaxSQLNet: Syntax Tree Networks for Complex and Cross-Domain Text-to-SQL Task
Yu, T., Yasunaga, M., Yang, K., Zhang, R., Wang, D., Li, Z., & Radev, D. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1193 · Cited by 199
Popescu, A.-M., Armanasu, A., Etzioni, O., Ko, D., & Yates, A. (2004) · Proceedings of the 20th international conference on Computational Linguistics - COLING '04 · doi:10.3115/1220355.1220376 · Cited by 189
Learning to transform natural to formal languages
Kate, R. J., Wong, Y. W., & Mooney, R. J. (2005) · Cited by 188
Lambda Dependency-Based Compositional SemanticsPreprint
Liang, P. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1309.4408 · Cited by 159
DialSQL: Dialogue Based Structured Query Generation
Gür, İ., Yavuz, S., Su, Y., & Yan, X. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1124 · Cited by 101
Optimizing synthesis with metasketches
Bornholt, J., Torlak, E., Grossman, D., & Ceze, L. (2016) · ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages (POPL) · doi:10.1145/2837614.2837666 · Cited by 94
Compositional Semantic Parsing on Semi-Structured TablesPreprint
Pasupat, P., & Liang, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1508.00305 · Cited by 91
Automated construction of database interfaces
Tang, L. R., & Mooney, R. J. (2000) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/1117794.1117811 · Cited by 86
Semantic Parsing with Syntax- and Table-Aware SQL Generation
Sun, Y., Tang, D., Duan, N., Ji, J., Cao, G., Feng, X., Qin, B., Liu, T., & Zhou, M. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1034 · Cited by 83
Self-citationMASQUE/SQL: an efficient and portable natural language query interface for relational databases
Androutsopoulos, I., Ritchie, G., & Thanisch, P. (1993) · Cited by 77
Robust Text-to-SQL Generation with Execution-Guided Decoding
Wang, C., Tatwawadi, K., Brockschmidt, M., Huang, P.-S., Mao, Y., Polozov, O., & Singh, R. (2018) · arXiv · Cited by 64
Decoupling Structure and Lexicon for Zero-Shot Semantic Parsing
Herzig, J., & Berant, J. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1190 · Cited by 55
Synthesizing highly expressive SQL queries from input-output examples
Wang, C., Cheung, A., & Bodík, R. (2017) · ACM SIGPLAN Notices · doi:10.1145/3140587.3062365 · Cited by 51
Optimizing synthesis with metasketches
Bornholt, J., Torlak, E., Grossman, D., & Ceze, L. (2016) · ACM SIGPLAN Notices · doi:10.1145/2914770.2837666 · Cited by 22
Generic querying of relational databases using natural language generation techniques
Hallett, C. (2006) · International Conference on Natural Language Generation · doi:10.3115/1706269.1706289 · Cited by 18
Cited by
RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parsers
Wang, B., Shin, R., Liu, X., Polozov, O., & Richardson, M. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.677 · Cited by 512
TaBERT: Pretraining for Joint Understanding of Textual and Tabular Data
Yin, P., Neubig, G., Yih, W.-T., & Riedel, S. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.745 · Cited by 487
Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluation
Gao, D., Wang, H., Li, Y., Sun, X., Qian, Y., Ding, B., & Zhou, J. (2024) · Proceedings of the VLDB Endowment · doi:10.14778/3641204.3641221 · Cited by 342
Li, J., Hui, B., Qu, G., Yang, J., Li, B., Li, B., Wang, B., Qin, B., Cao, R., Geng, R., et al. (2023) · arXiv · doi:10.48550/arxiv.2305.03111 · Cited by 278
(2021) · doi:10.18653/v1/2021.naacl-main.105 · Cited by 148
Metadata
- Authors
- Guo, J., Zhan, Z., Gao, Y., Xiao, Y., Lou, J.-G., Liu, T., & Zhang, D.
- Venue
- Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics
- Published
- 2019
- Pages
- 4524-4535
- OpenAlex
- W2945102109
- Cited by
- 406
- References
- 52
- FWCI
- 18.53
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.