Data Quality and Explainable AI
The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
In this work, we provide some insights and develop some ideas, with few technical details, about the role of explanations in Data Quality in the context of data-based machine learning models (ML). In this direction, there are, as expected, roles for causality, and explainable artificial intelligence . The latter area not only sheds light on the models, but also on the data that support model construction. There is also room for defining, identifying, and explaining errors in data, in particular, in ML, and also for suggesting repair actions. More generally, explanations can be used as a basis for defining dirty data in the context of ML, and measuring or quantifying them. We think dirtiness as relative to the ML task at hand, e.g., classification.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561
2014 IEEE Symposium on Security and Privacy
(2014) · doi:10.1109/sp16517.2014 · Cited by 1,362
Causes and Explanations: A Structural-Model Approach. Part I: Causes
Halpern, J. Y., & Pearl, J. (2005) · The British Journal for the Philosophy of Science · doi:10.1093/bjps/axi147 · Cited by 779
The Shapley value : essays in honor of Lloyd S. Shapley
Roth, A. E. (1991) · Cited by 716
Mathematical Properties of the Banzhaf Power Index
Dubey, P., & Shapley, L. S. (1979) · Mathematics of Operations Research · doi:10.1287/moor.4.2.99 · Cited by 677 · cited 1×
“Interestingly, it was shown later [29] that the causal effect coincides with the Banzhaf power index [18], which is defined in a similar way as the Shapley value, a well known measure used in coalition game theory.”
Method(2006) · Data-Centric Systems and Applications · doi:10.1007/3-540-33173-5 · Cited by 659 · cited 2×
“a denial semantic constraint, such as ¬(' [2] = 1 ∧ ' [6] > 80), with 2 and 6 indicating position values in the record, that prohibits someone over 80 to be qualied as t to li.”
BackgroundThe Shapley Value: Essays in Honor of Lloyd S. Shapley
(1988) · Cambridge University Press eBooks · doi:10.1017/cbo9780511528446 · Cited by 527
Aequitas: A Bias and Fairness Audit Toolkit
Saleiro, P., Kuester, B., Hinkson, L., London, J., Stevens, A., Anisfeld, A., Rodolfa, K. T., & Ghani, R. (2018) · arXiv · doi:10.48550/arxiv.1811.05577 · Cited by 496 · cited 1×
“However, in these cases, the quality dimension of data seems to be most naturally related to statistical concerns, such as bias [36, 38], or to the (also data fed) algorithm at hand, whose outcomes can also be assessed from the point of view of fairness [27, 39].”
BackgroundSuciu, D. M., Olteanu, D., Ré, C., & Koch, C. E. (2011) · Synthesis lectures on data management · doi:10.2200/s00362ed1v01y201105dtm016 · Cited by 425
Research works printed but not linked: 17
- 10.1016/j.ijar.2017.01.003 · doi:10.1016/j.ijar.2017.01.003
- C. Batini and M. Scannapieco . 2016 . Data Quality: Concepts, Methodologies and Techniques . Second edition, Springer . C. Batini and M. Scannapieco. 2016. Data Quality: Concepts, Methodologies and Techniques. Second edition, Springer.
- L. Bertossi , F. Rizzolo , and J. Lei . 2011 . Data quality is context dependent. In Proc. of the Workshop on Enabling Real-Time Business Intelligence (BIRTE) Collocated with the International Conference on Very Large Data Bases (VLDB) . Springer LNBIP 84 , 52 -- 67 . L. Bertossi, F. Rizzolo, and J. Lei. 2011. Data quality is context dependent. In Proc. of the Workshop on Enabling Real-Time Business Intelligence (BIRTE) Collocated with the International Conference on Very Large Data Bases (VLDB). Springer LNBIP 84, 52--67.
- 10.5555/2591248.2591262 · doi:10.5555/2591248.2591262
- D. Calvanese , D. Lanti , A. Ozaki , R. Peñaloza , and G. Xiao . 2019. Enriching ontology-based data access with provenance . In Proc. IJCAI. D. Calvanese, D. Lanti, A. Ozaki, R. Peñaloza, and G. Xiao. 2019. Enriching ontology-based data access with provenance. In Proc. IJCAI.
- A. Chalamalla , I. F. Ilyas , M. Ouzzani , and P. Papotti . 2017. Descriptive and prescriptive data cleaning . In Proc. SIGMOD. A. Chalamalla, I. F. Ilyas, M. Ouzzani, and P. Papotti. 2017. Descriptive and prescriptive data cleaning. In Proc. SIGMOD.
- C. Chen , K. Lin , C. Rudin , Y. Shaposhnik , S. Wang , and T. Wang . [n.d.]. An interpretable model with globally consistent explanations for credit risk . In Proc. NIPS 2018 Workshop on Challenges and Opportunities for AI in Financial Services: the Impact of Fairness, Explainability, Accuracy, and Privacy. C. Chen, K. Lin, C. Rudin, Y. Shaposhnik, S. Wang, and T. Wang. [n.d.]. An interpretable model with globally consistent explanations for credit risk. In Proc. NIPS 2018 Workshop on Challenges and Opportunities for AI in Financial Services: the Impact of Fairness, Explainability, Accuracy, and Privacy.
- F. Croce and M. Lenzerini . 2018. A framework for explaining query answers in DL-lite . In Proc. EKAW. F. Croce and M. Lenzerini. 2018. A framework for explaining query answers in DL-lite. In Proc. EKAW.
- J. Du , K. Wang , and Y. Shen . 2014. A tractable approach to ABox abduction over description logic ontologies . In Proc. AAAI. J. Du, K. Wang, and Y. Shen. 2014. A tractable approach to ABox abduction over description logic ontologies. In Proc. AAAI.
- M. A. Khamis , H. Q. Ngo , X. Nguyen , D. Olteanu , and M. Schleich . 2018. AC/DC: In-database learning thunderstruck . In Proc. DEEM. M. A. Khamis, H. Q. Ngo, X. Nguyen, D. Olteanu, and M. Schleich. 2018. AC/DC: In-database learning thunderstruck. In Proc. DEEM.
- B. Kimelfeld and C. Ré . 2017. A relational framework for classifier engineering . In Proc. PODS. B. Kimelfeld and C. Ré. 2017. A relational framework for classifier engineering. In Proc. PODS.
- E. Livshits , L. Bertossi , B. Kimelfeld , and M. Sebag . 2020. The Shapley value of tuples in query answering . In Proc. ICDT. arXiv:1904 .08679. E. Livshits, L. Bertossi, B. Kimelfeld, and M. Sebag. 2020. The Shapley value of tuples in query answering. In Proc. ICDT. arXiv:1904.08679. · arXiv
- S. Lundberg and S.-I. Lee . 2017 . A unified approach to interpreting model predictions . In Proc. NIPS. S. Lundberg and S.-I. Lee. 2017. A unified approach to interpreting model predictions. In Proc. NIPS.
- A. Meliou , W. Gatterbauer , K. F. Moore , and D. Suciu . 2010. The complexity of causality and responsibility for query answers and non-answers . In Proc. VLDB. A. Meliou, W. Gatterbauer, K. F. Moore, and D. Suciu. 2010. The complexity of causality and responsibility for query answers and non-answers. In Proc. VLDB.
- J. Rammelaere and F. Geerts . 2018. Explaining repaired data with CFDs . In Proc. VLDB. J. Rammelaere and F. Geerts. 2018. Explaining repaired data with CFDs. In Proc. VLDB.
- B. Salimi , L. Bertossi , D. Suciu , and G. Van den Broeck. 2016. Quantifying causal effects on query answering in databases . In Proc. TaPP. B. Salimi, L. Bertossi, D. Suciu, and G. Van den Broeck. 2016. Quantifying causal effects on query answering in databases. In Proc. TaPP.
- B. Salimi , J. Gehrke , and D. Dan Suciu . 2018. Bias in OLAP queries: Detection, explanation, and removal . In Proc. SIGMOD. 1021--1035 . B. Salimi, J. Gehrke, and D. Dan Suciu. 2018. Bias in OLAP queries: Detection, explanation, and removal. In Proc. SIGMOD. 1021--1035.
Cited by
AI-Generated Content (AIGC): A SurveyPreprint
Wu, J., Gan, W., Chen, Z., Wan, S., & Hong, L. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2304.06632 · Cited by 333
“In order to make output results more effective, the training datasets should ensure data quality and fairness [75].”
BackgroundSoil moisture forecast for smart irrigation: The primetime for machine learning
Togneri, R. M., dos Santos, D. F., Camponogara, G., Nagano, H., Custódio, G., Prati, R. C., Fernandes, S., & Kamienski, C. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.117653 · Cited by 123
XAIR: A Framework of Explainable AI in Augmented Reality
Xu, X., Yu, A., Jonker, T. R., Todi, K., Lu, F., Qian, X., Belo, J. M. E., Wang, T., Li, M., Mun, A., et al. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581500 · Cited by 109
“3) Cases when the model’s input or output confidence is low and the model may make mistakes [30, 108], i.”
BackgroundA Survey of Data Quality Requirements That Matter in ML Development Pipelines
Priestley, M., O’donnell, F., & Simperl, E. (2023) · Journal of Data and Information Quality · doi:10.1145/3592616 · Cited by 86
“For example, Bertossi and Geerts [12] suggest that XAI techniques can be applied to identify the features that cause inconsistencies in data and use this information to predict the best repair actions.”
BackgroundData Preparation: A Technological Perspective and Review
Fernandes, A. A. A., Koehler, M., Κωνσταντίνου, Ν., Pankin, P., Paton, N. W., & Sakellariou, R. (2023) · SN Computer Science · doi:10.1007/s42979-023-01828-8 · Cited by 85
“Of relevance to human-in-the-loop data preparation, there is research on synthesizing readable programs [25], explainability [9] and active learning [67].”
Background
Metadata
- Authors
- Bertossi, L., & Geerts, F.
- Affiliations
- Adolfo Ibáñez University (CL)
- University of Antwerp (BE)
- Venue
- Journal of Data and Information Quality
- Published
- 2020-05-03
- Volume
- 12
- Issue
- 2
- Pages
- 1-9
- ISSN
- 1936-1955 (ISSN-L)
- 1936-1963
- OpenAlex
- W3026358072
- Cited by
- 51
- References
- 26
- Citations by year
- 2026: 8 · 2025: 7 · 2024: 10 · 2023: 12 · 2022: 9 · 2021: 4 · 2020: 1
- FWCI
- 2.55
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Data and Information Quality (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Information Systems › Data Quality and Management
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Keywords
- data quality, explainable AI, causality, data errors, data repair, dirty data, classification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Data Quality and Explainable AI. https://app.cochat.ai/papers/10.1145/3386687
- The paper
- Bertossi, L., & Geerts, F. (2020). Data Quality and Explainable AI. Journal of Data and Information Quality. https://doi.org/10.1145/3386687
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.