Recovering semantics of tables on the web
The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
The Web offers a corpus of over 100 million tables [6], but the meaning of each table is rarely explicit from the table itself. Header rows exist in few cases and even when they do, the attribute names are typically useless. We describe a system that attempts to recover the semantics of tables by enriching the table with additional annotations. Our annotations facilitate operations such as searching for tables and finding related tables. To recover semantics of tables, we leverage a database of class labels and relationships automatically extracted from the Web. The database of classes and relationships has very wide coverage, but is also noisy. We attach a class label to a column if a sufficient number of the values in the column are identified with that label in the database of class labels, and analogously for binary relationships. We describe a formal model for reasoning about when we have seen sufficient evidence for a label, and show that it performs substantially better than a simple majority scheme. We describe a set of experiments that illustrate the utility of the recovered semantics for table search and show that it performs substantially better than previous approaches. In addition, we characterize what fraction of tables on the Web can be annotated using our approach.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A training algorithm for optimal margin classifiers
Boser, B. E., Guyon, I. M., & Vapnik, V. N. (1992) · Proceedings of the fifth annual workshop on Computational learning theory · doi:10.1145/130385.130401 · Cited by 11,992
Automatic acquisition of hyponyms from large text corpora
Hearst, M. A. (1992) · Proceedings of the 14th conference on Computational linguistics - · doi:10.3115/992133.992154 · Cited by 3,253
Yago: a core of semantic knowledge
Suchanek, F. M., Kasneci, G., & Weikum, G. (2007) · Proceedings of the 16th international conference on World Wide Web · doi:10.1145/1242572.1242667 · Cited by 2,512
Open information extraction from the web
Banko, M., Cafarella, M., Soderland, S. G., Broadhead, M., & Etzioni, O. (2007) · International Joint Conference on Artificial Intelligence · Cited by 1,398
TnT: a statistical part-of-speech tagger
Brants, T. (2000) · Proceedings of the sixth conference on Applied natural language processing - · doi:10.3115/974147.974178 · Cited by 1,329
WebTables: exploring the power of tables on the web
Cafarella, M. J., Halevy, A., Wang, D. Z., Wu, E., & Zhang, Y. (2008) · Proceedings of the VLDB Endowment · doi:10.14778/1453856.1453916 · Cited by 629
Self-citationEspresso: leveraging generic patterns for automatically harvesting semantic relations
Pantel, P., & Pennacchiotti, M. (2006) · Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the ACL - ACL '06 · doi:10.3115/1220175.1220190 · Cited by 529
Semantic taxonomy induction from heterogenous evidence
Snow, R., Jurafsky, D., & Ng, A. Y. (2006) · Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the ACL - ACL '06 · doi:10.3115/1220175.1220276 · Cited by 441
Annotating and searching web tables using entities, types and relationships
Limaye, G., Sarawagi, S., & Chakrabarti, S. (2010) · Proceedings of the VLDB Endowment · doi:10.14778/1920841.1921005 · Cited by 391
The Tradeoffs Between Open and Traditional Relation Extraction
Banko, M., & Etzioni, O. (2008) · Cited by 320
Automatically refining the wikipedia infobox ontology
Wu, F., & Weld, D. S. (2008) · Proceedings of the 17th international conference on World Wide Web · doi:10.1145/1367497.1367583 · Cited by 303
Self-citationData integration for the relational web
Cafarella, M. J., Halevy, A., & Khoussainova, N. (2009) · Proceedings of the VLDB Endowment · doi:10.14778/1687627.1687750 · Cited by 243
Self-citationPhrase clustering for discriminative learning
Lin, D., & Wu, X. (2009) · Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2 - ACL-IJCNLP '09 · doi:10.3115/1690219.1690290 · Cited by 226
Constant interaction-time scatter/gather browsing of very large document collections
Cutting, D. R., Karger, D. R., & Pedersen, J. O. (1993) · Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '93 · doi:10.1145/160688.160706 · Cited by 207
A Probabilistic Model of Redundancy in Information Extraction
Downey, D., Etzioni, O., & Soderland, S. (2006) · doi:10.21236/ada454763 · Cited by 175
Enhancing cluster labeling using wikipedia
Carmel, D., Roitman, H., & Zwerdling, N. (2009) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1571941.1571967 · Cited by 146
Weakly-supervised acquisition of labeled class instances using graph random walks
Talukdar, P. P., Reisinger, J., PAŞCA, M. A., Ravichandran, D., Bhagat, R., & Pereira, F. M. B. (2008) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/1613715.1613787 · Cited by 140
Self-citationHarvesting relational tables from lists on the web
Elmeleegy, H., Madhavan, J., & Halevy, A. Y. (2009) · Proceedings of the VLDB Endowment · doi:10.14778/1687627.1687749 · Cited by 128
Self-citationAutomatically labeling hierarchical clusters
Treeratpituk, P., & Callan, J. (2006) · Annual International Conference on Digital Government Research · doi:10.1145/1146598.1146650 · Cited by 118
Iterative Set Expansion of Named Entities Using the Web
Wang, R. C., & Cohen, W. W. (2008) · Proceedings · doi:10.1109/icdm.2008.145 · Cited by 109
Answering table augmentation queries from unstructured lists on the web
Gupta, R., & Sarawagi, S. (2009) · Proceedings of the VLDB Endowment · doi:10.14778/1687627.1687661 · Cited by 108
PAŞCA, M. A., & Durme, B. V. (2008) · Cited by 96
Self-citationEntity extraction via ensemble semantics
Pennacchiotti, M., & Pantel, P. (2009) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/1699510.1699542 · Cited by 81
Cited by
Knowledge vault: a web-scale approach to probabilistic knowledge fusion
Dong, X., Gabrilovich, E., Heitz, G., Horn, W., Lao, N., Murphy, K., Strohmann, T., Sun, S., & Zhang, W. (2014) · Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2623330.2623623 · Cited by 1,533
“Then we attempt to identify the relation that is expressed in each column of the table by looking at the entities in each column, and reasoning about which predicate each column could correspond to, by matching to Freebase, as in standard schema matching methods [39].”
MethodYAGO2: A spatially and temporally enhanced knowledge base from Wikipedia
Hoffart, J., Suchanek, F. M., Berberich, K., & Weikum, G. (2013) · Artificial Intelligence · doi:10.1016/j.artint.2012.06.001 · Cited by 1,232
Dong, X. L., & Srivastava, D. (2015) · Synthesis Lectures on Data Management · doi:10.1007/978-3-031-01853-4 · Cited by 539
Compositional Semantic Parsing on Semi-Structured Tables
Pasupat, P., & Liang, P. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1142 · Cited by 514
ClausIE: clause-based open information extraction
Del Corro, L., & Gemulla, R. (2013) · Proceedings of the 22nd international conference on World Wide Web · doi:10.1145/2488388.2488420 · Cited by 456
Metadata
- Authors
- Venetis, P., Halevy, A., Madhavan, J., Paşca, M., Shen, W., Wu, F., Miao, G., & Wu, C.
- Venue
- Proceedings of the VLDB Endowment
- Published
- 2011-06
- Volume
- 4
- Issue
- 9
- Pages
- 528-538
- ISSN
- 2150-8097 (ISSN-L)
- OpenAlex
- W2092364718
- Cited by
- 340
- References
- 23
- FWCI
- 76.76
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.