The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Probase: a probabilistic taxonomy for text understanding
Abstract
Knowledge is indispensable to understanding. The ongoing information explosion highlights the need to enable machines to better understand electronic text in human language. Much work has been devoted to creating universal ontologies or taxonomies for this purpose. However, none of the existing ontologies has the needed depth and breadth for universal understanding. In this paper, we present a universal, probabilistic taxonomy that is more comprehensive than any existing ones. It contains 2.7 million concepts harnessed automatically from a corpus of 1.68 billion web pages. Unlike traditional taxonomies that treat knowledge as black and white, it uses probabilities to model inconsistent, ambiguous and uncertain information it contains. We present details of how the taxonomy is constructed, its probabilistic modeling, and its potential applications in text understanding.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
WordNet: An Electronic Lexical Database
Kilgarriff, A., & Fellbaum, C. (2000) · Language · doi:10.2307/417141 · Cited by 11,464
WordNet: An Electronic Lexical Database
(1998) · The MIT Press eBooks · doi:10.7551/mitpress/7287.001.0001 · Cited by 4,857
Freebase: a collaboratively created graph database for structuring human knowledge
Bollacker, K., Evans, C., Paritosh, P., Sturge, T., & Taylor, J. (2008) · Proceedings of the 2008 ACM SIGMOD international conference on Management of data · doi:10.1145/1376616.1376746 · Cited by 4,852
Automatic acquisition of hyponyms from large text corpora
Hearst, M. A. (1992) · Proceedings of the 14th conference on Computational linguistics - · doi:10.3115/992133.992154 · Cited by 3,253
Yago: a core of semantic knowledge
Suchanek, F. M., Kasneci, G., & Weikum, G. (2007) · Proceedings of the 16th international conference on World Wide Web · doi:10.1145/1242572.1242667 · Cited by 2,512
A survey of named entity recognition and classification
Nadeau, D., & Sekine, S. (2007) · Lingvisticae Investigationes · doi:10.1075/li.30.1.03nad · Cited by 2,507 · cited 4×
“Fine level of understanding is also desirable in many other important tasks, such as named entity recognition (NER) [23] and word sense disambiguation (WSD) [24].”
BackgroundInfluentialMurphy, G. L. (2002) · The MIT Press eBooks · doi:10.7551/mitpress/1602.001.0001 · Cited by 2,505
DBpedia: A Nucleus for a Web of Open Data
Auer, S., Bizer, C., Kobilarov, G., Lehmann, J., Cyganiak, R., & Ives, Z. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-76298-0_52 · Cited by 2,454
Toward an architecture for never-ending language learning
Carlson, A., Betteridge, J., Kisiel, B., Settles, B., Hruschka, E., & Mitchell, T. (2010) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v24i1.7519 · Cited by 2,000
Word sense disambiguation: A survey
Navigli, R. (2009) · ACM Computing Surveys · doi:10.1145/1459352.1459355 · Cited by 1,819
Open information extraction from the web
Banko, M., Cafarella, M., Soderland, S. G., Broadhead, M., & Etzioni, O. (2007) · International Joint Conference on Artificial Intelligence · Cited by 1,398
Web-scale information extraction in knowitall: (preliminary results)
Etzioni, O., Cafarella, M., Downey, D., Kok, S., Popescu, A.-M., Shaked, T., Soderland, S., Weld, D. S., & Yates, A. (2004) · Proceedings of the 13th international conference on World Wide Web · doi:10.1145/988672.988687 · Cited by 747
Open Mind Common Sense: Knowledge Acquisition from the General Public
Singh, P., Lin, T., Mueller, E. T., Lim, G., Perkins, T., & Li Zhu, W. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-36124-3_77 · Cited by 477
Deriving a large scale taxonomy from Wikipedia
Ponzetto, S. P., & Strube, M. (2007) · MADOC (University of Mannheim) · Cited by 443
Semantic taxonomy induction from heterogenous evidence
Snow, R., Jurafsky, D., & Ng, A. Y. (2006) · Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the ACL - ACL '06 · doi:10.3115/1220175.1220276 · Cited by 441
Text Mining: Classification, Clustering, and Applications
(2009) · Chapman & Hall/CRC eBooks · doi:10.1201/9781420059458 · Cited by 385
Automatic construction of a hypernym-labeled noun hierarchy from text
Caraballo, S. A. (1999) · Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics - · doi:10.3115/1034678.1034705 · Cited by 373
Short text conceptualization using a probabilistic knowledgebase
Song, Y., Wang, H., Wang, Z., Li, H., & Chen, W. (2011) · doi:10.5591/978-1-57735-516-8/ijcai11-388 · Cited by 192
Self-citationFine grained classification of named entities
Fleischman, M., & Hovy, E. (2002) · Proceedings of the 19th international conference on Computational linguistics - · doi:10.3115/1072228.1072358 · Cited by 186
A Probabilistic Model of Redundancy in Information Extraction
Downey, D., Etzioni, O., & Soderland, S. (2006) · doi:10.21236/ada454763 · Cited by 175
Locating complex named entities in web text
Downey, D., Broadhead, M., & Etzioni, O. (2007) · Cited by 157
Snow, R., Prakash, S., Jurafsky, D. S., & Ng, A. Y. (2007) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · Cited by 113
Shao, B., Wang, H., & Li, Y. (2012) · Cited by 62
Self-citationManaging and mining large graphs
Shao, B., Wang, H., & Xiao, Y. (2012) · Proceedings - ACM-SIGMOD International Conference on Management of Data · doi:10.1145/2213836.2213907 · Cited by 57
Self-citationAutomated Subcategorization of Named Entities.
Fleischman, M. (2001) · Cited by 42
Lee, T., Wang, Z., Wang, H., & Hwang, S.-W. (2011) · Proceedings of the VLDB Endowment · doi:10.14778/3402755.3402763 · Cited by 40
Self-citationToward Topic Search on the Web
Li, H., & Wang, H. (2011) · Cited by 8
Self-citation
Cited by
A Survey on Knowledge Graphs: Representation, Acquisition, and Applications
Ji, S., Pan, S., Cambria, E., Marttinen, P., & Yu, P. S. (2022) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2021.3070843 · Cited by 2,947
Knowledge vault: a web-scale approach to probabilistic knowledge fusion
Dong, X., Gabrilovich, E., Heitz, G., Horn, W., Lao, N., Murphy, K., Strohmann, T., Sun, S., & Zhang, W. (2014) · Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2623330.2623623 · Cited by 1,533
“This literature can be clustered into 4 main groups: (1) approaches such as YAGO [37], YAGO2 [18], DBpedia [3], and Freebase [4], which are built on Wikipedia infoboxes and other structured data sources; (2) approaches such as Reverb [11], OLLIE [24], and PRISMATIC [12], which use open information (schema-less) extrac…”
MethodJumping NLP Curves: A Review of Natural Language Processing Research [Review Article]
Cambria, E., & White, B. (2014) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2014.2307227 · Cited by 1,102
Entity Linking with a Knowledge Base: Issues, Techniques, and Solutions
Shen, W., Wang, J., & Han, J. (2015) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2014.2327028 · Cited by 761
Dong, X. L., & Srivastava, D. (2015) · Synthesis Lectures on Data Management · doi:10.1007/978-3-031-01853-4 · Cited by 539
Metadata
- Authors
- Wu, W., Li, H., Wang, H., & Zhu, K. Q.
- Venue
- Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data
- Publisher
- ACM
- Published
- 2012-05-20
- Pages
- 481-492
- ISSN
- 0730-8078 (ISSN-L)
- OpenAlex
- W2138605095
- Cited by
- 763
- References
- 27
- FWCI
- 44.31
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.