The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Comprehensible classification models: a position paper
Abstract
The vast majority of the literature evaluates the performance of classification models using only the criterion of predictive accuracy. This paper reviews the case for considering also the comprehensibility (interpretability) of classification models, and discusses the interpretability of five types of classification models, namely decision trees, classification rules, decision tables, nearest neighbors and Bayesian network classifiers. We discuss both interpretability issues which are specific to each of those model types and more generic interpretability issues, namely the drawbacks of using model size as the only criterion to evaluate the comprehensibility of a model, and the use of monotonicity constraints to improve the comprehensibility and acceptance of classification models by users.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
(1992) · Cited by 23,431
An Introduction to Support Vector Machines and Other Kernel-based Learning Methods
Cristianini, N., & Shawe-Taylor, J. (2000) · doi:10.1017/cbo9780511801389 · Cited by 13,855
Witten, I. H. (2008) · Cited by 9,143
A systematic analysis of performance measures for classification tasks
Sokolova, M., & Lapalme, G. (2009) · Information Processing & Management · doi:10.1016/j.ipm.2009.03.002 · Cited by 7,515
Friedman, N., Geiger, D., & Goldszmidt, M. (1997) · Machine Learning · doi:10.1023/a:1007465528199 · Cited by 4,742
Machine Learning, Neural and Statistical Classification
Fulkerson, B. (1995) · Technometrics · doi:10.1080/00401706.1995.10484383 · Cited by 2,209
Using AUC and accuracy in evaluating learning algorithms
Huang, J., & Ling, C. X. (2005) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2005.50 · Cited by 2,148
The Minimum Description Length Principle
Grünwald, P. D. (2007) · doi:10.7551/mitpress/4643.001.0001 · Cited by 1,644
Dataset Shift in Machine Learning
(2008) · doi:10.7551/mitpress/9780262170055.001.0001 · Cited by 1,553
Schönemann, P. H. (1985) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0002063x · Cited by 889
Rule induction with CN2: Some recent improvements
Clark, P., & Boswell, R. (1991) · Lecture Notes in Computer Science · doi:10.1007/bfb0017011 · Cited by 859
Bramer, M. (2013) · Undergraduate Topics in Computer Science · doi:10.1007/978-1-4471-4884-5 · Cited by 838
Predictive data mining in clinical medicine: Current issues and guidelines
BELLAZZI, R., & ZUPAN, B. (2008) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2006.11.006 · Cited by 823
Evaluating Learning Algorithms: A Classification Perspective
Japkowicz, N., & Shah, M. (2011) · doi:10.1017/cbo9780511921803 · Cited by 767
Data Mining and Knowledge Discovery with Evolutionary Algorithms
Freitas, A. A. (2002) · Natural Computing Series · doi:10.1007/978-3-662-04923-5 · Cited by 764
Self-citationWettschereck, D., Aha, D. W., & Mohri, T. (1997) · Artificial Intelligence Review · doi:10.1023/a:1006593614256 · Cited by 717
Kohavi, R. (1995) · Lecture Notes in Computer Science · doi:10.1007/3-540-59286-5_57 · Cited by 712
(2011) · Cited by 675
PRISM: An algorithm for inducing modular rules
Cendrowska, J. (1987) · International Journal of Man-Machine Studies · doi:10.1016/s0020-7373(87)80003-2 · Cited by 650
Separate-and-Conquer Rule Learning
Fürnkranz, J. (1999) · Artificial Intelligence Review · doi:10.1023/a:1006524209794 · Cited by 528
Huysmans, J., Dejaeger, K., Mues, C., Vanthienen, J., & Baesens, B. (2011) · Decision Support Systems · doi:10.1016/j.dss.2010.12.003 · Cited by 425
Building comprehensible customer churn prediction models with advanced rule induction techniques
Verbeke, W., Martens, D., Mues, C., & Baesens, B. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2010.08.023 · Cited by 363
Selected techniques for data mining in medicine
Lavrač, N. (1999) · Artificial Intelligence in Medicine · doi:10.1016/s0933-3657(98)00062-1 · Cited by 351
Data Mining with Decision Trees: Theory and Applications
Rokach, L., & Maimon, O. (2007) · Series in Machine Perception and Artificial Intelligence · doi:10.1142/6604 · Cited by 324
INDUCTIVE AND BAYESIAN LEARNING IN MEDICAL DIAGNOSIS
KONONENKO, I. (1993) · Applied Artificial Intelligence · doi:10.1080/08839519308949993 · Cited by 302
Learning Bayesian Belief Network Classifiers: Algorithms and System
Cheng, J., & Greiner, R. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-45153-6_14 · Cited by 284
Multi-Objective Machine Learning
Jin, Y. (2006) · Studies in computational intelligence · doi:10.1007/3-540-33019-4 · Cited by 249
Pattern Classification Using Ensemble Methods
Rokach, L. (2009) · Series in Machine Perception and Artificial Intelligence · doi:10.1142/7238 · Cited by 248
(2000) · CrossRef Listing of Deleted DOIs · doi:10.1162/153244301753344614 · Cited by 219
A critical review of multi-objective optimization in data mining: a position paper
Freitas, A. A. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1046456.1046467 · Cited by 193
Self-citationThe Minimum Description Length Principle (Adaptive Computation and Machine Learning)
Grünwald, P. (2007) · The MIT Press eBooks · Cited by 176
Reverse Engineering the Neural Networks for Rule Extraction in Classification Problems
Augasta, M. G., & Kathirvalavakumar, T. (2012) · Neural Processing Letters · doi:10.1007/s11063-011-9207-8 · Cited by 173
Rule extraction from linear support vector machines
Fung, G., Sandilya, S., & Rao, R. B. (2005) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1081870.1081878 · Cited by 161
Performance of classification models from a user perspective
Martens, D., Vanthienen, J., Verbeke, W., & Baesens, B. (2011) · Decision Support Systems · doi:10.1016/j.dss.2011.01.013 · Cited by 153
Monotonicity Maintenance in Information-Theoretic Machine Learning Algorithms
Ben‐David, A. (1995) · Machine Learning · doi:10.1023/a:1022655006810 · Cited by 147
Machine learning for survival analysis: a case study on recurrence of prostate cancer
Zupan, B., Demšar, J., Kattan, M. W., Beck, J. R., & Ivan Bratko, A. (2000) · Artificial Intelligence in Medicine · doi:10.1016/s0933-3657(00)00053-1 · Cited by 139
Data mining for indicators of early mortality in a database of clinical records
Richards, G., Rayward-Smith, V. J., Sönksen, P. H., Carey, S., & Weng, C. (2001) · Artificial Intelligence in Medicine · doi:10.1016/s0933-3657(00)00110-x · Cited by 118
Szafron, D., Lu, P., Greiner, R., Wishart, D. S., Poulin, B., Eisner, R., Lu, Z., Anvik, J., Macdonell, C., Fyshe, A., et al. (2004) · Nucleic Acids Research · doi:10.1093/nar/gkh485 · Cited by 100
Nearest Neighbour Classification with Monotonicity Constraints
Duivesteijn, W., & Feelders, A. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-87479-9_38 · Cited by 95
Seeing the Forest Through the Trees: Learning a Comprehensible Model from an Ensemble
Assche, A. V., & Blockeel, H. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74958-5_39 · Cited by 94
Domain knowledge integration in data mining using decision tables: case studies in churn prediction
Lima, E., Mues, C., & Baesens, B. (2009) · Journal of the Operational Research Society · doi:10.1057/jors.2008.161 · Cited by 93
On the Importance of Comprehensible Classification Models for Protein Function Prediction
Freitas, A. A., Wieser, D., & Apweiler, R. (2009) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2008.47 · Cited by 91
Self-citationDhar, V., Chou, D., & Provost, F. J. (2000) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009848126475 · Cited by 85
Acceptance of Rules Generated by Machine Learning among Medical Experts
Mani, S., Shankle, W. R., & Pazzani, M. J. (2001) · Methods of Information in Medicine · doi:10.1055/s-0038-1634196 · Cited by 84
Occam's two razors: the sharp and the blunt
Domingos, P. (1998) · Cited by 82
Extracting decision trees from trained neural networks
Boz, O. (2002) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/775047.775113 · Cited by 82
Gaining insight into student satisfaction using comprehensible data mining techniques
Dejaeger, K., Goethals, F., Giangreco, A., Mola, L., & Baesens, B. (2011) · European Journal of Operational Research · doi:10.1016/j.ejor.2011.11.022 · Cited by 77
Evolving decision trees using oracle guides
Johansson, U., & Niklasson, L. (2009) · IEEE Symposium on Computational Intelligence and Data Mining (CIDM) · doi:10.1109/cidm.2009.4938655 · Cited by 64
Adding monotonicity to learning algorithms may impair their accuracy
Ben‐David, A., Sterling, L., & Tran, T. (2008) · Expert Systems with Applications · doi:10.1016/j.eswa.2008.08.021 · Cited by 62
User-oriented Assessment of Classification Model Understandability
Allahyari, H., & Lavesson, N. (2011) · Frontiers in artificial intelligence and applications · doi:10.3233/978-1-60750-754-3-11 · Cited by 55
Targeting business users with decision table classifiers
Kohavi, R., & Sommerfield, D. A. (1998) · Cited by 54
GOTREES: PREDICTING GO ASSOCIATIONS FROM PROTEIN DOMAIN COMPOSITION USING DECISION TREES
Hayete, B., & Bienkowska, J. R. (2004) · Pacific Symposium on Biocomputing (PSB) · doi:10.1142/9789812702456_0013 · Cited by 50
A comparison of the decision table and tree
Subramanian, G. H., Nosek, J. T., Raghunathan, S. P., & Kanitkar, S. S. (1992) · Communications of the ACM · doi:10.1145/129617.129621 · Cited by 50
In Defense of C4.5: Notes on Learning One-Level Decision Trees
Elomaa, T. (1994) · Elsevier eBooks · doi:10.1016/b978-1-55860-335-6.50016-7 · Cited by 41
Improving the interpretability of classification rules discovered by an ant colony algorithm
Otero, F. E. B., & Freitas, A. A. (2013) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/2463372.2463382 · Cited by 34
Self-citationFrom Ensemble Methods to Comprehensible Models
Ferri, C., Hernández‐Orallo, J., & Ramírez-Quintana, M. J. (2002) · Lecture notes in computer science · doi:10.1007/3-540-36182-0_16 · Cited by 29
Homology Induction: the use of machine learning to improve sequence similarity searches
Karwath, A., & King, R. D. (2002) · BMC Bioinformatics · doi:10.1186/1471-2105-3-11 · Cited by 28
An experimental test of Occam’s razor in classification
Zahálka, J., & Železný, F. (2010) · Machine Learning · doi:10.1007/s10994-010-5227-2 · Cited by 22
Clinical Knowledge Discovery in Hospital Information Systems: Two Case Studies
Tsumoto, S. (2000) · Lecture notes in computer science · doi:10.1007/3-540-45372-5_80 · Cited by 21
Predicting post-synaptic activity in proteins with data mining
Pappa, G. L., Baines, A. J., & Freitas, A. A. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti1102 · Cited by 20
Self-citationComprehensible Knowledge Discovery: Gaining Insight from Data
Pazzani, M. J. (1997) · Cited by 12
Karpf, J. (1991) · International Conference on Artificial Intelligence and Law · doi:10.1145/112646.112684 · Cited by 8
Learning with Globally Predictive Tests
Pazzani, M. J. (1998) · Lecture notes in computer science · doi:10.1007/3-540-49292-5_20 · Cited by 7
Research works printed but not linked: 36
- Altendorf E.E., 2005, Proc. 21st Annual Conf. on Uncertainty in Artificial Intelligence (UAI'05)
- Baesens B., 2004, Kluwer
- Bramer M., 2007, Springer
- 10.5555/647462.726278 · doi:10.5555/647462.726278
- Clark P., 1991, Fifth European Conf. (EWSL'91)
- 10.5555/345662 · doi:10.5555/345662
- Doderer M., 2006, Protein subcellular localization prediction using a hybrid of similarity search and error-correcting output code techniques that produces interpretable results, Silico Biology, 6, 419, 10.3233/ISB-00255 · doi:10.3233/isb-00255
- Domingos P., 1998, Proc. 4th Int. Conf. on Knowledge Discovery and Data Mining (KDD'98)
- 10.5555/645804.669974 · doi:10.5555/645804.669974
- 10.1007/978-3-540-45231-7_1 · doi:10.1007/978-3-540-45231-7_1
- 10.5555/647859.736118 · doi:10.5555/647859.736118
- 10.5555/581821 · doi:10.5555/581821
- 10.5555/1213810 · doi:10.5555/1213810
- Hayete B., 2005, Proc. Pacific Symp. on Biocomput. 10
- Henery R.J., 1994, Ellis Horwood
- 10.5555/1964882 · doi:10.5555/1964882
- 10.1186/1471-2105-6-136 · doi:10.1186/1471-2105-6-136
- Kaufmann K.A., 1999, Learning from inconsistent and noisy data: the AQ18 approach. Foundations of Intelligent Systems (Proc. ISMIS'99), LNAI, 1609, 411
- 10.5555/645324.649649 · doi:10.5555/645324.649649
- Kohavi R., 1998, Proc. 4th Int. Conf. on Knowledge Discovery and Data Mining (KDD'98)
- 10.1093/comjnl/31.6.481 · doi:10.1093/comjnl/31.6.481
- Michie D., 1994, Neural and Statistical Classification. Ellis Horwood
- Pazzani M., 1997, Proc. First Federal Data Mining Conf. and Exposition, 73--82
- 10.5555/647855.738200 · doi:10.5555/647855.738200
- Quinlan J.R., 1993, Morgan Kaufmann
- 10.1007/3-540-48751-4_3 · doi:10.1007/3-540-48751-4_3
- Quinonero-Candela J., 2009, MIT Press
- Rokach L., 2010, World Scientific
- Rokach L., 2008, World Scientific
- Schwabacher M., 2001, Proc. 18th Int. Conf. on Machine Learning (ICML' 2001
- 10.5555/1625855.1625950 · doi:10.5555/1625855.1625950
- 10.5555/3120747.3120808 · doi:10.5555/3120747.3120808
- Wettschereck D., 1997, Kluwer
- Witten I.H., 2011, 3rd Ed. Morgan Kaufman
- Wong M.L., 2000, Kluwer
- 10.5555/141975.142091 · doi:10.5555/141975.142091
Cited by
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Arrieta, A. B., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., García, S., Gil-López, S., Molina, D., Benjamins, R., et al. (2019) · arXiv · doi:10.48550/arxiv.1910.10045 · Cited by 11,321
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423
Sagi, O., & Rokach, L. (2018) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1249 · Cited by 3,103
Metadata
- Authors
- Freitas, A. A.
- Venue
- ACM SIGKDD Explorations Newsletter
- Published
- 2014-03-17
- Volume
- 15
- Issue
- 1
- Pages
- 1-10
- ISSN
- 1931-0145 (ISSN-L)
- 1931-0153
- OpenAlex
- W2026905436
- Cited by
- 572
- References
- 64
- FWCI
- 25.09
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.