FlashExtract: a framework for data extraction by examples
The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
Various document types that combine model and view (e.g., text files, webpages, spreadsheets) make it easy to organize (possibly hierarchical) data, but make it difficult to extract raw data for any further manipulation or querying. We present a general framework FlashExtract to extract relevant data from semi-structured documents using examples. It includes: (a) an interaction model that allows end-users to give examples to extract various fields and to relate them in a hierarchical organization using structure and sequence constructs. (b) an inductive synthesis algorithm to synthesize the intended program from few examples in any underlying domain-specific language for data extraction that has been built using our specified algebra of few core operators (map, filter, merge, and pair). We describe instantiation of our framework to three different domains: text files, webpages, and spreadsheets. On our benchmark comprising 75 documents, FlashExtract is able to extract intended data using an average of 2.36 examples in 0.84 seconds per field.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Wrangler: interactive visual specification of data transformation scripts
Kandel, S., Paepcke, A., Hellerstein, J., & Heer, J. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979444 · Cited by 581
Automating string processing in spreadsheets using input-output examples
Gulwani, S. (2011) · Proceedings of the 38th annual ACM SIGPLAN-SIGACT symposium on Principles of programming languages · doi:10.1145/1926385.1926423 · Cited by 446
Self-citationGenerating finite-state transducers for semi-structured data extraction from the Web
Hsu, C.-N., & Dung, M.-T. (1998) · Information Systems · doi:10.1016/s0306-4379(98)00027-1 · Cited by 411
IEPAD: information extraction based on pattern discovery
Chang, C.-H., & Lui, S.-C. (2001) · Proceedings of the 10th international conference on World Wide Web · doi:10.1145/371920.372182 · Cited by 411
A hierarchical approach to wrapper induction
Muslea, I., Minton, S., & Knoblock, C. (1999) · Proceedings of the third annual conference on Autonomous Agents · doi:10.1145/301136.301191 · Cited by 371
Spreadsheet data manipulation using examples
Gulwani, S., Harris, W. R., & Singh, R. (2012) · Communications of the ACM · doi:10.1145/2240236.2240260 · Cited by 292
Self-citationBelasco, A., Bergman, D., & Trivette, M. (2023) · Colleges Worth Your Money · doi:10.5771/9781475873191-66 · Cited by 205
Header and Unit Inference for Spreadsheets Through Spatial Analyses
Abraham, R., & Erwig, M. (2005) · 2004 IEEE Symposium on Visual Languages - Human Centric Computing · doi:10.1109/vlhcc.2004.29 · Cited by 130
Learning semantic string transformations from examples
Singh, R., & Gulwani, S. (2012) · Proceedings of the VLDB Endowment · doi:10.14778/2212351.2212356 · Cited by 121
Self-citationSynthesizing Number Transformations from Input-Output Examples
Singh, R., & Gulwani, S. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-31424-7_44 · Cited by 120
Self-citation
Research works printed but not linked: 4
- Anton T., 2005, LWA
- Crescenzi V., 2001, VLDB
- Frenz C., 2005, APress
- Kushmerick N., 1997, IJCAI (1)
Cited by
SQLizer: query synthesis from natural language
Yaghmazadeh, N., Wang, Y., Dillig, I., & Dillig, T. (2017) · Proceedings of the ACM on Programming Languages · doi:10.1145/3133887 · Cited by 279
S3: syntax- and semantic-guided repair synthesis via programming by examples
Le, X.-B. D., Chu, D.-H., Lo, D., Le Goues, C., & Visser, W. (2017) · Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering · doi:10.1145/3106237.3106309 · Cited by 220
Synthesizing highly expressive SQL queries from input-output examples
Wang, C., Cheung, A., & Bodik, R. (2017) · Proceedings of the 38th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/3062341.3062365 · Cited by 178
In-IDE Code Generation from Natural Language: Promise and Challenges
Xu, F. F., Vasilescu, B., & Neubig, G. (2022) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3487569 · Cited by 154
Auto-Suggest: Learning-to-Recommend Data Preparation Steps Using Data Science Notebooks
Yan, C., & He, Y. (2020) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3318464.3389738 · Cited by 74
Metadata
- Authors
- Le, V., & Gulwani, S.
- Affiliations
- University of California, Davis (US)
- Microsoft (United States) (US)
- ORCID
- Venue
- ACM SIGPLAN Notices
- Published
- 2014-06-05
- Volume
- 49
- Issue
- 6
- Pages
- 542-553
- ISSN
- 0362-1340 (ISSN-L)
- 1558-1160
- OpenAlex
- W4256244129
- Cited by
- 59
- References
- 19
- Citations by year
- 2026: 1 · 2024: 1 · 2023: 8 · 2022: 3 · 2021: 7 · 2020: 9 · 2019: 5 · 2018: 7 · 2017: 15 · 2016: 3
- FWCI
- 16.63
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM SIGPLAN Notices (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Information Systems › Web Data Mining and Analysis
- Physical Sciences › Computer Science › Information Systems › Advanced Database Systems and Queries
- Physical Sciences › Computer Science › Software › Spreadsheets and End-User Computing
- Keywords
- data extraction, semi-structured documents, learning from examples, inductive synthesis, program synthesis, hierarchical data, text files, web pages, spreadsheet software, interaction model, relational algebra
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: FlashExtract: a framework for data extraction by examples. https://app.cochat.ai/papers/10.1145/2666356.2594333
- The paper
- Le, V., & Gulwani, S. (2014). FlashExtract: a framework for data extraction by examples. ACM SIGPLAN Notices. https://doi.org/10.1145/2666356.2594333
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.