Open the Black Box Data-Driven Explanation of Black Box Decision Systems
Open accessThe DOI matches its OpenAlex record; 11 of the 11 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Barocas, S., & Selbst, A. D. (2014) · doi:10.2139/ssrn.2477899 · Cited by 3,048 · cited 1×
“Learning from historical data recording human decision making may lead to the discovery of prejudices that are endemic in reality [3, 34], and to assign to such practices the status of general rules, maybe unconsciously, as these rules can be deeply hidden within the learned classifier.”
BackgroundAnchors: High-Precision Model-Agnostic Explanations
Ribeiro, M. T., Singh, S., & Guestrin, C. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11491 · Cited by 2,162 · cited 5×
“…baselines: pure global classification [8, 11], i.e., learning a decision tree on the whole training dataset, and the collection of all local explanations obtained applying the local explanators LORE and Anchor [20, 38] separately to each example in the training dataset (removing duplicate rules).”
BackgroundMethodInfluentialThe Black Box Society: The Secret Algorithms That Control Money and Information
(2016) · Contemporary Sociology: A Journal of Reviews · doi:10.1177/0094306116641409c · Cited by 1,334
Wachter, S., Mittelstadt, B., & Floridi, L. (2017) · International Data Privacy Law · doi:10.1093/idpl/ipx005 · Cited by 1,308
Survey and critique of techniques for extracting rules from trained artificial neural networks
Andrews, R., Diederich, J., & Tickle, A. B. (1995) · Knowledge-Based Systems · doi:10.1016/0950-7051(96)81920-4 · Cited by 1,225
CPAR: Classification based on Predictive Association Rules
Yin, X., & Han, J. (2003) · Proceedings of the 2003 SIAM International Conference on Data Mining · doi:10.1137/1.9781611972733.40 · Cited by 833
Discrimination-aware data mining
Pedreshi, D., Ruggieri, S., & Turini, F. (2008) · Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1401890.1401959 · Cited by 676 · cited 2×
“the program, often when every surrounding neighbourhood was allowed. Learning from historical data recording human decision making may lead to the discovery of prejudices that are endemic in reality [3, 34], and to assign to such practices the status of general rules, maybe unconsciously, as these rules can be deeply…”
BackgroundSelf-citationA Survey of Methods for Explaining Black Box Models
Guidotti, R., Monreale, A., Ruggieri, S., Turini, F., Giannotti, F., & Pedreschi, D. (2019) · ACM Computing Surveys · doi:10.1145/3236009 · Cited by 629 · cited 4×
“A different stream of approaches, still in the XbD setting, focuses on the local behavior of a black box [21], searching for an explanation of the decision made for a specific instance.”
BackgroundMethodInfluentialSelf-citationIntelligible models for classification and regression
Lou, Y., Caruana, R., & Gehrke, J. (2012) · Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2339530.2339556 · Cited by 547 · cited 1×
“A few methods for global explanation are agnostic w.r.t. the learning model [23, 29].”
MethodFairness testing: testing software for discrimination
Galhotra, S., Brun, Y., & Meliou, A. (2017) · Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering · doi:10.1145/3106237.3106277 · Cited by 405 · cited 1×
“…which calls for exploring alternative ways to query and audit the black box in the vicinity of the target instance to the purpose of revealing the statistical and causal logic adopted; this can possibly draw from the body of research in active learning and testing, such as fairness testing [18].”
Background
Cited by
Auditing of AI: Legal, Ethical and Technical Approaches
Mökander, J. (2023) · Digital Society · doi:10.1007/s44206-023-00074-y · Cited by 152
“Technology providers have thus developed mechanisms to ensure that their products and services meet predefined quality standards and respond to co nsumers’ needs.”
Anik, A. I., & Bunt, A. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445736 · Cited by 103
Explaining sentiment analysis results on social media texts through visualization
Jain, R., Kumar, A., Nayyar, A., Dewan, K., Garg, R., Raman, S., & Ganguly, S. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-14432-y · Cited by 68
“They are closely related and essential to “open the black-box” of machine learning models [13, 47].”
BackgroundDissecting scientific explanation in AI (sXAI): A case for medicine and healthcare
Durán, J. M. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103498 · Cited by 62
Ethics of Artificial Intelligence
(2019) · Research Library Issues · doi:10.29242/rli.299 · Cited by 59
Metadata
- Authors
- Pedreschi, D., Giannotti, F., Guidotti, R., Monreale, A., Pappalardo, L., Ruggieri, S., & Turini, F.
- Venue
- arXiv (Cornell University)
- Publisher
- Cornell University
- Published
- 2018-06-26
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 1806.09936
- OpenAlex
- W2887330082
- Cited by
- 29
- References
- 11
- Type
- posted content
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Open the Black Box Data-Driven Explanation of Black Box Decision Systems. https://app.cochat.ai/papers/10.48550/arxiv.1806.09936
- The paper
- Pedreschi, D., Giannotti, F., Guidotti, R., Monreale, A., Pappalardo, L., Ruggieri, S., & Turini, F. (2018). Open the Black Box Data-Driven Explanation of Black Box Decision Systems. arXiv (Cornell University). https://doi.org/10.48550/arxiv.1806.09936
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.