The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Explaining Classifications For Individual Instances
Abstract
We present a method for explaining predictions for individual instances. The presented approach is general and can be used with all classification models that output probabilities. It is based on decomposition of a model's predictions on individual contributions of each attribute. Our method works for so called black box models such as support vector machines, neural networks, and nearest neighbor algorithms as well as for ensemble methods, such as boosting and random forests. We demonstrate that the generated explanations closely follow the learned models and present a visualization technique which shows the utility of our approach and enables the comparison of different prediction methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
A Mathematical Theory of Communication
Shannon, C. E. (1948) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1948.tb01338.x · Cited by 88,486
(1990) · Choice Reviews Online · doi:10.5860/choice.27-3338 · Cited by 35,305
Tversky, A., & Kahneman, D. (1974) · Science · doi:10.1126/science.185.4157.1124 · Cited by 28,810
Judgment under Uncertainty: Heuristics and Biases
Tversky, A., & Kahneman, D. (1975) · Utility, Probability, and Human Decision Making · doi:10.1007/978-94-010-1834-0_8 · Cited by 22,650
Hosmer, D. W., & Lemeshow, S. (2000) · doi:10.1002/0471722146 · Cited by 20,302
An Introduction to Variable and Feature Selection.
Guyon, I., & Elisseeff, A. (2003) · Cited by 6,576
Marginal Structural Models and Causal Inference in Epidemiology
Robins, J. M., Hernán, M. Á., & Brumback, B. (2000) · Epidemiology · doi:10.1097/00001648-200009000-00011 · Cited by 5,581
(2024) · Physics Subject Headings (PhySH) · doi:10.29172/7c2a6982-6d72-4cd8-bba6-2fccb06a7011 · Cited by 3,857
(2000) · CrossRef Listing of Deleted DOIs · doi:10.1162/153244303322753616 · Cited by 3,502
A Mathematical Theory of Communications
Shannon, C. E. (1948) · Cited by 2,080
Predicting good probabilities with supervised learning
Niculescu-Mizil, A., & Caruana, R. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102430 · Cited by 1,884
Survey and critique of techniques for extracting rules from trained artificial neural networks
Andrews, R., Diederich, J., & Tickle, A. B. (1995) · Knowledge-Based Systems · doi:10.1016/0950-7051(96)81920-4 · Cited by 1,225
Interpreting Probability Models: Logit, Probit, and Other Generalized Linear Models
Liao, T. F. (1994) · Medical Entomology and Zoology · Cited by 960
Extracting refined rules from knowledge-based neural networks
Towell, G. G., & Shavlik, J. W. (1993) · Machine Learning · doi:10.1007/bf00993103 · Cited by 757
Probability and the Weighing of Evidence.
M., P. A., & Good, I. J. (1950) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2981046 · Cited by 753
Extracting Tree-Structured Representations of Trained Networks
Craven, M. W., & SHAVLIK, J. W. (1995) · neural information processing systems · Cited by 602
Interpreting Probability Models
Liao, T. (1994) · Sage eBooks · doi:10.4135/9781412984577 · Cited by 489
Probability and the Weighing of Evidence.
Savage, L. J., & Good, I. J. (1951) · Journal of the American Statistical Association · doi:10.2307/2280518 · Cited by 427
Using Sampling and Queries to Extract Rules from Trained Neural Networks
Craven, M. W., & Shavlik, J. W. (1994) · Machine Learning Proceedings 1994 · doi:10.1016/b978-1-55860-335-6.50013-1 · Cited by 311
INDUCTIVE AND BAYESIAN LEARNING IN MEDICAL DIAGNOSIS
KONONENKO, I. (1993) · Applied Artificial Intelligence · doi:10.1080/08839519308949993 · Cited by 302
Self-citationSymbolic knowledge extraction from trained neural networks: A sound approach
d'Avila Garcez, A. S., Broda, K., & Gabbay, D. M. (2001) · Artificial Intelligence · doi:10.1016/s0004-3702(00)00077-1 · Cited by 217
Extracting Rules from Artificial Neural Networks with Distributed Representations
Thrun, S. (1994) · Cited by 175
Rule Extraction from Recurrent Neural Networks: ATaxonomy and Review
Jacobsson, H. (2005) · Neural Computation · doi:10.1162/0899766053630350 · Cited by 174
Nomograms for Visualization of Naive Bayesian Classifier
Možina, M., Demšar, J., Kattan, M. W., & Zupan, B. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-30116-5_32 · Cited by 133
Understanding neural networks via rule extraction
Setiono, R., & Liu, H. (1995) · Cited by 129
Visual explanation of evidence in additive classifiers
Poulin, B., Eisner, R., Szafron, D., Lu, P., Greiner, R., Wishart, D. S., Fyshe, A., Pearcy, B., Macdonell, C., & Anvik, J. (2006) · Cited by 100
Nomograms for visualizing support vector machines
Jakulin, A., Možina, M., Demšar, J., Bratko, I., & Zupan, B. (2005) · Knowledge Discovery and Data Mining · doi:10.1145/1081870.1081886 · Cited by 94
A Practical Device for the Application of a Diagnostic or Prognostic Function
Lubsen, J. C., Pool, J., & van der Does, E. (1978) · Methods of Information in Medicine · doi:10.1055/s-0038-1636613 · Cited by 68
Graphical Explanation in Belief Networks
Madigan, D., Mosurski, K., & Almond, R. G. (1997) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1997.10474735 · Cited by 63
Visualization of Support Vector Machines with Unsupervised Learning
Hamel, L. H. (2006) · IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB) · doi:10.1109/cibcb.2006.330984 · Cited by 48
Interpretation of Trained Neural Networks by Rule Extraction
Palade, V., Neagu, D. C., & Patton, R. J. (2001) · Lecture notes in computer science · doi:10.1007/3-540-45493-4_20 · Cited by 36
SVM and Graphical Algorithms: A Cooperative Approach
Poulet, F. (2005) · Proceedings · doi:10.1109/icdm.2004.10068 · Cited by 30
Towards simple, easy-to-understand, yet accurate classifiers
Caragea, D., Cook, D., & Honavar, V. (2004) · Proceedings · doi:10.1109/icdm.2003.1250961 · Cited by 13
An Efficient Method for Explaining the Decisions of the Probabilistic RBF Classification Network
Robnik, M., Likas, A. C., Constantinopoulos, C., & Kononenko, I. (2007) · Cited by 2
Self-citation
Research works printed but not linked: 5
- Mitchell, 1997, Machine Learning
- 10.1023/A:1022683529158 · DOI · Paper page
- Främling, Explaining Results of Neural Networks by Contextual Importance and Utility
- Becker, Visualizing the Simple Bayesian Classier
- 10.2307/1390929 · DOI
Cited by
Arrieta, A. B., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., García, S., Gil-López, S., Molina, D., Benjamins, R., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.10045 · Cited by 11,321
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423
Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294
“[93]–[95]).”
MethodExplanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
Explaining prediction models and individual predictions with feature contributions
Štrumbelj, E., & Kononenko, I. (2014) · Knowledge and Information Systems · doi:10.1007/s10115-013-0679-x · Cited by 2,286
Self-citation
Metadata
- Authors
- Robnik-Sikonja, M., & Kononenko, I.
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2008-05
- Volume
- 20
- Issue
- 5
- Pages
- 589-600
- ISSN
- 1041-4347 (ISSN-L)
- OpenAlex
- W2113211233
- Cited by
- 254
- References
- 35
- FWCI
- 8.48
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.