The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
KATARA: A Data Cleaning System Powered by Knowledge Bases and Crowdsourcing
Abstract
Classical approaches to clean data have relied on using integrity constraints, statistics, or machine learning. These approaches are known to be limited in the cleaning accuracy, which can usually be improved by consulting master data and involving experts to resolve ambiguity. The advent of knowledge bases KBs both general-purpose and within enterprises, and crowdsourcing marketplaces are providing yet more opportunities to achieve higher accuracy at a larger scale. We propose KATARA, a knowledge base and crowd powered data cleaning system that, given a table, a KB, and a crowd, interprets table semantics to align it with the KB, identifies correct and incorrect data, and generates top-k possible repairs for incorrect data. Experiments show that KATARA can be applied to various datasets and KBs, and can efficiently annotate data and suggest possible repairs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Introduction to Information Retrieval
Manning, C. D., Raghavan, P., & Schütze, H. (2008) · doi:10.1017/cbo9780511809071 · Cited by 11,288
Word association norms, mutual information, and lexicography
Church, K., & Hanks, P. (1990) · doi:10.5555/89086.89095 · Cited by 3,590
Abiteboul, S., Hull, R. B., & Vianu, V. (1994) · Cited by 3,461
DBpedia – A large-scale, multilingual knowledge base extracted from Wikipedia
Lehmann, J., Isele, R., Jakob, M., Jentzsch, A., Kontokostas, D., Mendes, P. N., Hellmann, S., Morsey, M., van Kleef, P., Auer, S., et al. (2015) · Semantic Web · doi:10.3233/sw-140134 · Cited by 3,168
Knowledge vault: a web-scale approach to probabilistic knowledge fusion
Dong, X., Gabrilovich, E., Heitz, G., Horn, W., Lao, N., Murphy, K., Strohmann, T., Sun, S., & Zhang, W. (2014) · Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2623330.2623623 · Cited by 1,533 · cited 1×
“Under local completeness assumption of kbs [15], if the kb knows about one possible type of t[Ai], the kb should have all possible types of t[Ai].”
BackgroundYAGO2: A spatially and temporally enhanced knowledge base from Wikipedia
Hoffart, J., Suchanek, F. M., Berberich, K., & Weikum, G. (2013) · Artificial Intelligence · doi:10.1016/j.artint.2012.06.001 · Cited by 1,232
Poggi, A., Lembo, D., Calvanese, D., De Giacomo, G., Lenzerini, M., & Rosati, R. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-77688-8_5 · Cited by 868
Normalized (pointwise) mutual information in collocation extraction
Bouma, G. (2009) · Cited by 845
CrowdER: crowdsourcing entity resolution
Wang, J., Kraska, T., Franklin, M. J., & Feng, J. (2012) · Proceedings of the VLDB Endowment · doi:10.14778/2350229.2350263 · Cited by 507
Potter's Wheel: An Interactive Data Cleaning System
Raman, V., & Hellerstein, J. L. (2001) · Cited by 492
A cost-based model and effective heuristic for repairing constraints by value modification
Bohannon, P., Fan, W., Flaster, M., & Rastogi, R. (2005) · Proceedings of the 2005 ACM SIGMOD international conference on Management of data · doi:10.1145/1066157.1066175 · Cited by 424
Annotating and searching web tables using entities, types and relationships
Limaye, G., Sarawagi, S., & Chakrabarti, S. (2010) · Proceedings of the VLDB Endowment · doi:10.14778/1920841.1921005 · Cited by 391
Supporting top-k join queries in relational databases
Ilyas, I., Aref, W., & Elmagarmid, A. (2004) · The VLDB Journal · doi:10.1007/s00778-004-0128-2 · Cited by 385
Self-citationPARIS: probabilistic alignment of relations, instances, and schema
Suchanek, F. M., Abiteboul, S., & Senellart, P. (2011) · Proceedings of the VLDB Endowment · doi:10.14778/2078331.2078332 · Cited by 358
Recovering semantics of tables on the web
Venetis, P., Halevy, A., Madhavan, J., Paşca, M., Shen, W., Wu, F., Miao, G., & Wu, C. (2011) · Proceedings of the VLDB Endowment · doi:10.14778/2002938.2002939 · Cited by 340
Knowing What to Believe (when you already know something)
Pasternack, J., & Roth, D. (2010) · International Conference on Computational Linguistics · Cited by 332
Holistic data cleaning: Putting violations into context
Chu, X., Ilyas, I. F., & Papotti, P. (2013) · 2013 IEEE 29th International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2013.6544847 · Cited by 326
Self-citationCORDS: automatic discovery of correlations and soft functional dependencies
Ilyas, I. F., Markl, V., Haas, P., Brown, P., & Aboulnaga, A. (2004) · Proceedings of the 2004 ACM SIGMOD international conference on Management of data · doi:10.1145/1007568.1007641 · Cited by 315
Self-citationNADEEF: a commodity data cleaning system
Dallachiesa, M., Ebaid, A., Eldawy, A., Elmagarmid, A., Ilyas, I. F., Ouzzani, M., & Tang, N. (2013) · Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data · doi:10.1145/2463676.2465327 · Cited by 313
Self-citationImproving data quality: consistency and accuracy
Cong, G., Fan, W., Geerts, F., et al. (2007) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 313
DBpedia SPARQL Benchmark – Performance Assessment with Real Queries on Real Data
Morsey, M., Lehmann, J., Auer, S., & Ngomo, A.-C. N. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-25073-6_29 · Cited by 275
Interpreting and Unifying Outlier Scores
Kriegel, H.-P., Kroger, P., Schubert, E., & Zimek, A. (2011) · Proceedings of the 2011 SIAM International Conference on Data Mining · doi:10.1137/1.9781611972818.2 · Cited by 266
Discovering data quality rules
Chiang, F., & Miller, R. J. (2008) · Proceedings of the VLDB Endowment · doi:10.14778/1453856.1453980 · Cited by 265
Discovering denial constraints
Chu, X., Ilyas, I. F., & Papotti, P. (2013) · Proceedings of the VLDB Endowment · doi:10.14778/2536258.2536262 · Cited by 262
Self-citationDependencies revisited for improving data quality
Fan, W. (2008) · Proceedings of the twenty-seventh ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems · doi:10.1145/1376916.1376940 · Cited by 240
Scoring, term weighting, and the vector space model
(2008) · Introduction to Information Retrieval · doi:10.1017/cbo9780511809071.007 · Cited by 238
From data fusion to knowledge fusion
Dong, X. L., Gabrilovich, E., Heitz, G., Horn, W., Murphy, K., Sun, S., & Zhang, W. (2014) · Proceedings of the VLDB Endowment · doi:10.14778/2732951.2732962 · Cited by 232
Yakout, M., Elmagarmid, A. K., Neville, J., Ouzzani, M., & Ilyas, I. F. (2011) · Proceedings of the VLDB Endowment · doi:10.14778/1952376.1952378 · Cited by 216
Self-citationTowards certain fixes with editing rules and master data
Fan, W., Li, J., Ma, S., Tang, N., & Yu, W. (2010) · Proceedings of the VLDB Endowment · doi:10.14778/1920841.1920867 · Cited by 202
Self-citationThe LLUNATIC data-cleaning framework
Geerts, F., Mecca, G., Papotti, P., & Santoro, D. (2013) · Proceedings of the VLDB Endowment · doi:10.14778/2536360.2536363 · Cited by 179
Self-citationERACER: a database approach for statistical inference and data cleaning
Mayfield, C., Neville, J., & Prabhakar, S. (2010) · Proceedings of the 2010 ACM SIGMOD International Conference on Management of data · doi:10.1145/1807167.1807178 · Cited by 173
Yakout, M., Berti‐Équille, L., & Elmagarmid, A. K. (2013) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/2463676.2463706 · Cited by 150
Advanced processing for ontological queries
Calì, A., Gottlob, G., & Pieris, A. (2010) · Proceedings of the VLDB Endowment · doi:10.14778/1920841.1920912 · Cited by 146
Towards certain fixes with editing rules and master data
Fan, W., Li, J., Ma, S., Tang, N., & Yu, W. (2011) · The VLDB Journal · doi:10.1007/s00778-011-0253-7 · Cited by 128
Self-citationCrowdsourced enumeration queries
Trushkowsky, B., Kraska, T., Franklin, M. J. M., & Sarkar, P. (2013) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2013.6544865 · Cited by 121
Interaction between record matching and data repairing
Fan, W., Li, J., Ma, S., Tang, N., & Yu, W. (2011) · Proceedings - ACM-SIGMOD International Conference on Management of Data · doi:10.1145/1989323.1989373 · Cited by 116
Self-citationBuilding, maintaining, and using knowledge bases: a report from the trenches
Deshpande, O., Lamba, D. S., Tourn, M., Das, S., Subramaniam, S., Rajaraman, A., Harinarayan, V., & Doan, A. (2013) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/2463676.2465297 · Cited by 110
Volkovs, M., Chiang, F., Szlichta, J., & Miller, R. J. (2014) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2014.6816655 · Cited by 105
Towards dependable data repairing with fixing rules
Wang, J., & Tang, N. (2014) · Proceedings - ACM-SIGMOD International Conference on Management of Data · doi:10.1145/2588555.2610494 · Cited by 104
Self-citationA unified model for data and constraint repair
Chiang, F., & Miller, R. J. (2011) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2011.5767833 · Cited by 99
Repairing vertex labels under neighborhood constraints
Song, S., Cheng, H., Yu, J. X., & Chen, L. (2014) · Proceedings of the VLDB Endowment · doi:10.14778/2732967.2732974 · Cited by 46
Proof positive and negative in data cleaning
Interlandi, M., & Tang, N. (2015) · Proceedings - International Conference on Data Engineering · doi:10.1109/icde.2015.7113269 · Cited by 38
Self-citationLange, R., & Lange, X. (2012) · National Conference on Artificial Intelligence · Cited by 6
Cited by
AutoML: A survey of the state-of-the-art
He, X., Zhao, K., & Chu, X. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106622 · Cited by 1,691
Self-citationData Cleaning: Overview and Emerging Challenges
Chu, X., Ilyas, I. F., Krishnan, S., & Wang, J. (2016) · Proceedings of the 2016 International Conference on Management of Data · doi:10.1145/2882903.2912574 · Cited by 488
Self-citationHoloClean: holistic data repairs with probabilistic inference
Rekatsinas, T., Chu, X., Ilyas, I. F., & Ré, C. (2017) · Proceedings of the VLDB Endowment · doi:10.14778/3137628.3137631 · Cited by 480
Self-citationBenchmark and Survey of Automated Machine Learning Frameworks
Zöller, M.-A., & Huber, M. F. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11854 · Cited by 448
Systematic Review of Advanced AI Methods for Improving Healthcare Data Quality in Post COVID-19 Era
Isgut, M., Gloster, L., Choi, K., Venugopalan, J., & Wang, M. D. (2023) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2022.3216531 · Cited by 35
Metadata
- Authors
- Chu, X., Morcos, J., Ilyas, I. F., Ouzzani, M., Papotti, P., Tang, N., & Ye, Y.
- Venue
- Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data
- Publisher
- ACM
- Published
- 2015-05-27
- Pages
- 1247-1261
- ISSN
- 0730-8078 (ISSN-L)
- OpenAlex
- W1992479406
- Cited by
- 279
- References
- 43
- FWCI
- 58.68
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.