The DOI matches its Crossref record; 73 of the 75 references it cites were found in a registry or an index.
Interpretable classifiers using rules and Bayesian analysis: Building a better stroke prediction model
Open accessAbstract
We aim to produce predictive models that are not only accurate, but are also interpretable to human experts. Our models are decision lists, which consist of a series of if…then…statements (e.g., if high blood pressure, then stroke) that discretize a high-dimensional, multivariate feature space into a series of simple, readily interpretable decision statements. We introduce a generative model called Bayesian Rule Lists that yields a posterior distribution over possible decision lists. It employs a novel prior structure to encourage sparsity. Our experiments show that Bayesian Rule Lists has predictive accuracy on par with the current top algorithms for prediction in machine learning. Our method is motivated by recent developments in personalized medicine, and can be used to produce highly accurate and interpretable medical scoring systems. We demonstrate this by producing an alternative to the CHADS$_{2}$ score, actively used in clinical practice for estimating the risk of stroke in patients that have atrial fibrillation. Our model is as interpretable as CHADS$_{2}$, but more accurate.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“To this end, they propose Bayesian Rule Lists (BRL) f to extract the comprehensible global predictor c g as a decision list . A decision list consists of a series of if-then statements discretizing the whole feature space into a set of simple and directly interpretable decision statements.”
From A Survey of Methods for Explaining Black Box Models (2019) · cites this paper as [57]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 24,190
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,867
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 21,030
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1956) · Psychological Review · doi:10.1037/h0043158 · Cited by 17,812
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1994) · Psychological Review · doi:10.1037/0033-295x.101.2.343 · Cited by 17,559
Inference from iterative simulation using multiple sequences
Gelman, A., & Rubin, D. B. (1992) · Statistical Science · doi:10.1214/ss/1177011136 · Cited by 16,627
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
Knaus, W. A., Draper, E. A., Wagner, D. P., & Zimmerman, J. E. (1985) · Critical Care Medicine · doi:10.1097/00003246-198510000-00009 · Cited by 15,518
APACHE II-A Severity of Disease Classification System
Knaus, W. A., Draper, E. A., Wagner, D. P., & Zimmerman, J. E. (1986) · Critical Care Medicine · doi:10.1097/00003246-198608000-00028 · Cited by 13,379
Fast algorithms for mining association rules
Agrawal, R., & Srikant, R. (1998) · Cited by 11,362
Binary Codes capable of currecting deletions, insertions, and reversals
Levenshtein, V. I. (1965) · Soviet physics. Doklady · Cited by 10,387
Lip, G. Y. H., Nieuwlaat, R., Pisters, R., Lane, D. A., & Crijns, H. J. G. M. (2010) · Chest · doi:10.1378/chest.09-1584 · Cited by 6,879
LIBLINEAR: A Library for Large Linear Classification
Fan, R.-E., Chang, K., Hsieh, C., Xiang-rui, W., & Lin, C. (2008) · doi:10.5555/1390681.1442794 · Cited by 6,684
Gage, B. F., Waterman, A. D., Shannon, W., Boechler, M., Rich, M. W., & Radford, M. J. (2001) · JAMA · doi:10.1001/jama.285.22.2864 · Cited by 4,832
Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author)
Breiman, L. (2001) · Statistical Science · doi:10.1214/ss/1009213726 · Cited by 4,340
Galit Shmueli, A. (2010) · Statistical Science · doi:10.1214/10-sts330 · Cited by 3,392
The TIMI Risk Score for Unstable Angina/Non–ST Elevation MI
Antman, E. M., Cohen, M. C., Bernink, P. J. L. M., McCabe, C. H., Horacek, T., Papuchis, G., Mautner, B., Corbalán, R., Radley, D. R., & Braunwald, E. (2000) · JAMA · doi:10.1001/jama.284.7.835 · Cited by 3,221
Lim, W. S. (2003) · Thorax · doi:10.1136/thorax.58.5.377 · Cited by 3,066
Multi-Interval Discretization of Continuous-Valued Attributes for Classification Learning
Fayyad, U. M., & Irani, K. B. (1993) · International Joint Conference on Artificial Intelligence · Cited by 2,870
The Nature of Statistical Learning
Vapnik, V. N. (1995) · Medical Entomology and Zoology · Cited by 2,295
Integrating classification and association rule mining
Liu, B., Hsu, W., & Ma, Y. (1998) · Cited by 2,247
The robust beauty of improper linear models in decision making.
Dawes, R. M. (1979) · American Psychologist · doi:10.1037/0003-066x.34.7.571 · Cited by 2,046
BART: Bayesian additive regression trees
Chipman, H., George, E. I., & McCulloch, R. E. (2010) · The Annals of Applied Statistics · doi:10.1214/09-aoas285 · Cited by 2,033
Supervised and Unsupervised Discretization of Continuous Features
Dougherty, J., Kohavi, R., & Sahami, M. (1995) · Elsevier eBooks · doi:10.1016/b978-1-55860-377-6.50032-3 · Cited by 2,005
Very Simple Classification Rules Perform Well on Most Commonly Used Datasets
Holte, R. C. (1993) · Machine Learning · doi:10.1023/a:1022631118932 · Cited by 1,800
Scalable algorithms for association mining
Zaki, M. J. (2000) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/69.846291 · Cited by 1,769
Inductive Logic Programming: Theory and methods
Muggleton, S., & de Raedt, L. (1994) · The Journal of Logic Programming · doi:10.1016/0743-1066(94)90035-3 · Cited by 1,537
Mining quantitative association rules in large relational tables
Srikant, R., & Agrawal, R. (1996) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/233269.233311 · Cited by 1,490
Predictive learning via rule ensembles
Friedman, J. H., & Popescu, B. E. (2008) · The Annals of Applied Statistics · doi:10.1214/07-aoas148 · Cited by 1,315
Statistical modeling: The two cultures
Breiman, L. (2001) · Cited by 1,314
CMAR: accurate and efficient classification based on multiple class-association rules
Li, W., Han, J., & Pei, J. (2002) · Proceedings · doi:10.1109/icdm.2001.989541 · Cited by 1,235
Heuristics of instability and stabilization in model selection
Breiman, L. (1996) · The Annals of Statistics · doi:10.1214/aos/1032181158 · Cited by 1,171
Rivest, R. L. (1987) · Machine Learning · doi:10.1023/a:1022607331053 · Cited by 894
BART: Bayesian Additive Regression Trees
Chipman, H., George, E. I., & McCulloch, R. E. (2006) · ScholarlyCommons (University of Pennsylvania) · Cited by 889
CPAR: Classification based on Predictive Association Rules
Yin, X., & Han, J. (2003) · Proceedings of the 2003 SIAM International Conference on Data Mining · doi:10.1137/1.9781611972733.40 · Cited by 833
Chipman, H., George, E. I., & McCulloch, R. E. (1998) · Journal of the American Statistical Association · doi:10.1080/01621459.1998.10473750 · Cited by 750
Comprehensible classification models
Freitas, A. A. (2014) · ACM SIGKDD Explorations Newsletter · doi:10.1145/2594473.2594475 · Cited by 575
Identifying Patients at High Risk for Stroke Despite Anticoagulation
Lip, G. Y. H., Frison, L., Halperin, J. L., & Lane, D. A. (2010) · Stroke · doi:10.1161/strokeaha.110.590257 · Cited by 493
Efficient mining of both positive and negative association rules
Wu, X., Chengqi Zhang, B., & Zhang, S. (2004) · ACM Transactions on Information Systems · doi:10.1145/1010614.1010616 · Cited by 470
Stang, P. E., Ryan, P. B., Racoosin, J. A., Overhage, J. M., Hartzema, A. G., Reich, C., Welebob, E., Scarnecchia, T., & Woodcock, J. (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-153-9-201011020-00010 · Cited by 441
Huysmans, J., Dejaeger, K., Mues, C., Vanthienen, J., & Baesens, B. (2011) · Decision Support Systems · doi:10.1016/j.dss.2010.12.003 · Cited by 425
An implementation of the FP-growth algorithm
Borgelt, C. (2005) · doi:10.1145/1133905.1133907 · Cited by 350
Dension, D. (1998) · Biometrika · doi:10.1093/biomet/85.2.363 · Cited by 318
Informal covariation assessment: Data-based versus theory-based judgments
Jennings, D. L., Amabile, T. M., & Ross, L. D. (1982) · Cambridge University Press eBooks · doi:10.1017/cbo9780511809477.016 · Cited by 314
Bayesian Inference on Network Traffic Using Link Count Data
Tebaldi, C., & West, M. (1998) · Journal of the American Statistical Association · doi:10.1080/01621459.1998.10473707 · Cited by 312
Bayesian Additive Regression Trees
Chipman, H., George, E. I., & McCulloch, R. E. (2006) · Cited by 254
(2012) · Cited by 253
Computer‐Assisted Keyword and Document Set Discovery from Unstructured Text
King, G., Lam, P., & Roberts, M. E. (2017) · American Journal of Political Science · doi:10.1111/ajps.12291 · Cited by 216
Chipman, H., George, E. I., & McCulloch, R. E. (2002) · Machine Learning · doi:10.1023/a:1013916107446 · Cited by 177
Souillard‐Mandar, W., Davis, R., Rudin, C. D., Au, R., Libon, D. J., Swenson, R. A., Price, C. C., Lamar, M., & Penney, D. L. (2015) · Machine Learning · doi:10.1007/s10994-015-5529-5 · Cited by 163
Self-citation(2015) · International Conference on Artificial Intelligence and Statistics · Cited by 162
Self-citationDynamic Trees for Learning and Design
Taddy, M. A., Gramacy, R. B., & Polson, N. G. (2011) · Journal of the American Statistical Association · doi:10.1198/jasa.2011.ap09769 · Cited by 113
Meinshausen, N. (2010) · The Annals of Applied Statistics · doi:10.1214/10-aoas367 · Cited by 107
Using Decision Lists to Construct Interpretable and Parsimonious Treatment Regimes
Zhang, Y., Laber, E. B., Tsiatis, A. A., & Davidian, M. (2015) · Biometrics · doi:10.1111/biom.12354 · Cited by 105
Weighted Substructure Mining for Image Analysis
Nowozin, S., Tsuda, K., Uno, T., Kudo, T., & Bakır, G. (2007) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2007.383171 · Cited by 89
Expert systems : the technology of knowledge management and decision making for the 21st century
Leondes, C. T. (2002) · Cited by 88
Bayesian CART: Prior Specification and Posterior Simulation
Wu, Y., Tjelmeland, H., & West, M. (2007) · Journal of Computational and Graphical Statistics · doi:10.1198/106186007x180426 · Cited by 74
Stefan Rüping, A. (2006) · Technische Universität Dortmund Eldorado (Technische Universität Dortmund) · doi:10.17877/de290r-8863 · Cited by 70
Machine Learning: Between Accuracy and Interpretability
Bratko, I. (1997) · Learning, Networks and Statistics · doi:10.1007/978-3-7091-2668-4_10 · Cited by 67
Graphical Explanation in Belief Networks
Madigan, D., Mosurski, K., & Almond, R. G. (1997) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1997.10474735 · Cited by 62
Self-citationLearning with Decision Lists of Data-Dependent Features
Marchand, M., & Sokolova, M. (2005) · Cited by 47
Bayesian hierarchical rule modeling for predicting medical conditions
McCormick, T. H., Rudin, C. D., & Madigan, D. (2012) · The Annals of Applied Statistics · doi:10.1214/11-aoas522 · Cited by 43
Self-citationWang, T., Rudin, C., Doshi-Velez, F., Liu, Y.-M., Klampfl, E., & MacNeille, P. (2015) · arXiv.org · doi:10.48550/arxiv.1504.07614 · Cited by 41
Self-citationAn Interpretable Stroke Prediction Model using Rules and Bayesian Analysis
Letham, B., Rudin, C. D., McCormick, T. H., & Madigan, D. (2013) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 40
Self-citationBox drawings for learning with imbalanced data
Goh, S. T., & Rudin, C. D. (2014) · ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2623330.2623648 · Cited by 37
Self-citationBeyond predictive accuracy : what?
Giraud-Carrier, C. G. (1998) · Cited by 31
Efficient sequential decision-making algorithms for container inspection operations
Madigan, D., Mittal, S., & Roberts, F. S. (2011) · Naval Research Logistics (NRL) · doi:10.1002/nav.20472 · Cited by 11
Self-citationLearning Theory Analysis for Association Rules and Sequential Event Prediction
Rudin, C. D., Letham, B., & Madigan, D. (2013) · doi:10.7916/d82n50c1 · Cited by 9
Self-citationYi, Y., & Hüllermeier, E. (2005) · Cited by 6
Integer optimization methods for machine learning
Chang, A. (2012) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 5
Research works printed but not linked: 4
- Letham, B., Rudin, C., McCormick, T. H. and Madigan, D. (2015). Supplement to “Interpretable classifiers using rules and Bayesian analysis: Building a better stroke prediction model.” DOI:10.1214/15-AOAS848SUPPA, DOI:10.1214/15-AOAS848SUPPB. · DOI
- Letham, B., Rudin, C., McCormick, T. H. and Madigan, D. (2014). An interpretable model for stroke prediction using rules and Bayesian analysis. In Proceedings of 2014 KDD Workshop on Data Science for Social Good. MIT, Cambridge, MA.
- Quinlan, J. R. (1993). C 4.5: Programs for Machine Learning. Morgan Kaufmann, San Mateo.
- Rudin, C. and Ertekin, Ş. (2015). Learning optimized lists of classification rules. Technical report, MIT, Cambridge, MA.
Cited by
Sorted by citations
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423
Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294
“[66] proposed a model called Bayesian Rule Lists (BRL) based on decision tree, the authors claimed that preliminary interpretable models provide a concise and convincing capabilities to gain domain experts trust.”
BackgroundMethods for interpreting and understanding deep neural networks
Montavon, G., Samek, W., & Müller, K.-R. (2018) · Digital Signal Processing · doi:10.1016/j.dsp.2017.10.011 · Cited by 2,665
A Survey on Explainable Artificial Intelligence (XAI): Toward Medical XAI
Tjoa, E., & Guan, C. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3027314 · Cited by 2,524
Metadata
- Authors
- Letham, B., Rudin, C., McCormick, T. H., & Madigan, D.
- Affiliations
- Massachusetts Institute of Technology (US)
- University of Washington (US)
- Venue
- The Annals of Applied Statistics
- Publisher
- Institute of Mathematical Statistics
- Published
- 2015-09-01
- Volume
- 9
- Issue
- 3
- Pages
- 1350-1371
- ISSN
- 1932-6157 (ISSN-L)
- 1941-7330
- OpenAlex
- W2118022153
- Cited by
- 766
- References
- 75
- Citations by year
- 2026: 36 · 2025: 51 · 2024: 77 · 2023: 91 · 2022: 90 · 2021: 108 · 2020: 76 · 2019: 88 · 2018: 65 · 2017: 42 · 2016: 26 · 2015: 14
- FWCI
- 47.96
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- The Annals of Applied Statistics (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- Project Euclid (Cornell University) (submittedVersion)
- DSpace@MIT (Massachusetts Institute of Technology) (submittedVersion, cc-by-nc)
- arXiv (Cornell University)
- Funders
- National Science Foundation (1053407, CAREER)
- National Institutes of Health
- National Institute of Allergy and Infectious Diseases
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Keywords
- interpretable classifiers, decision lists, generative models, sparsity prior, stroke risk prediction, atrial fibrillation, CHADS2 score, personalized medicine, rule-based prediction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
