Explaining Data-Driven Document Classifications1
Abstract
Many document classification applications require human understanding of the reasons for data-driven classification decisions by managers, client-facing employees, and the technical team. Predictive models treat documents as data to be classified, and document data are characterized by very high dimensionality, often with tens of thousands to millions of variables (words). Unfortunately, due to the high dimensionality, understanding the decisions made by document classifiers is very difficult. This paper begins by extending the most relevant prior theoretical model of explanations for intelligent systems to account for some missing elements. The main theoretical contribution is the definition of a new sort of explanation as a minimal set of words (terms, generally), such that removing all words within this set from the document changes the predicted class from the class of interest. We present an algorithm to find such explanations, as well as a framework to assess such an algorithm’s performance. We demonstrate the value of the new approach with a case study from a real-world document classification task: classifying web pages as containing objectionable content, with the goal of allowing advertisers to choose not to have their ads appear on those pages. A second empirical demonstration on news-story topic classification shows the explanations to be concise and document-specific, and to be capable of providing understanding of the exact reasons for the classification decisions, of the workings of the classification models, and of the business application itself. We also illustrate how explaining the classifications of documents can help to improve data quality and model performance.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Counterfactual conditional statements are claimed to enable people to produce utterances that are factually false yet truthful irrespective of the interpretation adopted.
“All in all, counterfactual conditional statements are claimed to enable people to produce utterances that are factually false yet truthful irrespective of the interpretation adopted [32].”
From A Survey of Contrastive and Counterfactual Explanation Generation Methods for Explainable Artificial Intelligence (2021) · cites this paper as [32]
Cites
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918 · see citing works
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138 · see citing works
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970 · see citing works
(1992) · Cited by 23,431 · see citing works
Neural networks for pattern recognition
Bishop, C. (1994) · Choice Reviews Online · doi:10.5860/choice.31-5500 · Cited by 18,537 · see citing works
Indexing by latent semantic analysis
Deerwester, S. C., Dumais, S., Furnas, G. W., Landauer, T. K., & Harshman, R. A. (1990) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199009)41:6 · Cited by 12,758 · see citing works
Fast algorithms for mining association rules
Agrawal, R., & Srikant, R. (1998) · Cited by 11,362 · see citing works
Design Science in Information Systems Research1
Hevner, A. R., March, S. T., Park, J., & Ram, S. (2004) · MIS Quarterly · doi:10.2307/25148625 · Cited by 10,707 · cited 1× · see citing works
“We now present an empirical case study (Hevner et al. 2004) onthe problem of classifying web pages as containing adult content.”
Libsvm : A library for support vector machines
Ferrari, V. (2008) · Medical Entomology and Zoology · Cited by 10,124 · see citing works
Fast Algorithms for Mining Association Rules in Large Databases
Agrawal, R., & Srikant, R. (1994) · Very Large Data Bases · Cited by 9,454 · see citing works
Design science in information systems research
(2004) · Journal of the Association for Information Systems · doi:10.5555/2017212.2017217 · Cited by 8,254 · see citing works
Text categorization with Support Vector Machines: Learning with many relevant features
Joachims, T. (1998) · Lecture notes in computer science · doi:10.1007/bfb0026683 · Cited by 8,134 · see citing works
Opinion Mining and Sentiment Analysis
Pang, B., & Lee, L. (2008) · now publishers, Inc. eBooks · doi:10.1561/9781601981516 · Cited by 6,957 · see citing works
LIBLINEAR: A Library for Large Linear Classification
Fan, R.-E., Chang, K., Hsieh, C., Xiang-rui, W., & Lin, C. (2008) · doi:10.5555/1390681.1442794 · Cited by 6,680 · see citing works
Opinion mining and sentiment analysis
Pang, B., & Lee, L. (2008) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000011 · Cited by 6,372 · see citing works
Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods
Platt, J. C. (1999) · Cited by 4,834 · see citing works
From data mining to knowledge discovery: an overview
Fayyad, U. M., Piatetsky-Shapiro, G., & Smyth, P. (1996) · Knowledge Discovery and Data Mining · Cited by 2,319 · see citing works
BoosTexter: A Boosting-based System for Text Categorization
Schapire, R. E., & Singer, Y. (2000) · Machine Learning · doi:10.1023/a:1007649029923 · Cited by 2,191 · see citing works
NewsWeeder: Learning to Filter Netnews
Lang, K. (1995) · Elsevier eBooks · doi:10.1016/b978-1-55860-377-6.50048-7 · Cited by 2,119 · see citing works
Predictive Analytics in Information Systems Research1
Shmueli, G., & Koppius, O. R. (2011) · MIS Quarterly · doi:10.2307/23042796 · Cited by 1,328 · see citing works
Lessmann, S., Baesens, B., Mues, C., & Pietsch, S. (2008) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2008.35 · Cited by 1,231 · see citing works
Get another label? improving data quality and data mining using multiple, noisy labelers
Sheng, V. S., Provost, F. J., & Ipeirotis, P. G. (2008) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1401890.1401965 · Cited by 1,180 · see citing works
Self-citationAndreas Hotho, A., Nürnberger, A., & Paaß, G. (2005) · LDV-Forum/Journal for language technology and computational linguistics · doi:10.21248/jlcl.20.2005.68 · Cited by 909 · see citing works
Benchmarking state-of-the-art classification algorithms for credit scoring
Baesens, B., Van Gestel, T., Viaene, S., Stepanova, M., Suykens, J., & Vanthienen, J. (2003) · Journal of the Operational Research Society · doi:10.1057/palgrave.jors.2601545 · Cited by 904 · see citing works
Fawcett, T. E., & Provost, F. J. (1997) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009700419189 · Cited by 889 · see citing works
Self-citationText mining techniques for patent analysis
Tseng, Y., Lin, C.-J., & Lin, Y.-I. (2007) · Information Processing & Management · doi:10.1016/j.ipm.2006.11.011 · Cited by 784 · see citing works
How to Explain Individual Classification DecisionsPreprint
Baehrens, D., Schroeter, T. S., Stefan Harmeling, B., Kawanabe, M., Hansen, K., & Mueller, K.-R. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0912.1128 · Cited by 743 · see citing works
Predictive Analytics in Information Systems Research
Shmueli, G., & Koppius, O. (2010) · doi:10.2139/ssrn.1606674 · Cited by 676 · see citing works
Extracting Tree-Structured Representations of Trained Networks
Craven, M. W., & SHAVLIK, J. W. (1995) · Neural Information Processing Systems · Cited by 583 · see citing works
Buchanan, B. G., & Shortliffe, E. H. (1984) · Cited by 577 · see citing works
An Efficient Explanation of Individual Classifications using Game Theory
Štrumbelj, E., & Kononenko, I. (2010) · Repository of the University of Ljubljana (University of Ljubljana) · doi:10.5555/1756006.1756007 · Cited by 570 · see citing works
Explanations From Intelligent Systems: Theoretical Foundations and Implications for Practice1
Gregor, S., & Benbasat, I. (1999) · MIS Quarterly · doi:10.2307/249487 · Cited by 535 · see citing works
Interpersonal Conflict and Its Management in Information System Development1
Barki, H., & Hartwick, J. (2001) · MIS Quarterly · doi:10.2307/3250929 · Cited by 486 · see citing works
Comprehensible credit scoring models using rule extraction from support vector machines
Martens, D., Baesens, B., Van Gestel, T., & Vanthienen, J. (2007) · European Journal of Operational Research · doi:10.1016/j.ejor.2006.04.051 · Cited by 448 · see citing works
Self-citationQi, X., & Davison, B. D. (2009) · ACM Computing Surveys · doi:10.1145/1459352.1459357 · Cited by 435 · see citing works
Uncovering the intellectual core of the information systems discipline
Sidorova, A., Evangelopoulos, N. E., Valacich, J. S., & Ramakrishnan, T. (2008) · Journal of the Association for Information Systems · doi:10.5555/2017388.2017390 · Cited by 425 · see citing works
Uncovering the Intellectual Core of the Information Systems Discipline1
Sidorova, A., Evangelopoulos, N. E., Valacich, J. S., & Ramakrishnan, T. (2008) · MIS Quarterly · doi:10.2307/25148852 · Cited by 368 · see citing works
Text Categorization Using Weight Adjusted k-Nearest Neighbor Classification
Han, E.-H. S., Karypis, G., & Kumar, V. (2001) · Lecture notes in computer science · doi:10.1007/3-540-45357-1_9 · Cited by 357 · see citing works
Semi-automated screening of biomedical citations for systematic reviews
Wallace, B. C., Trikalinos, T. A., Lau, J., Brodley, C., & Schmid, C. H. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-55 · Cited by 351 · see citing works
Cognitive biases and decision support systems development: a design science approach
Arnott, D. R. (2005) · Information Systems Journal · doi:10.1111/j.1365-2575.2006.00208.x · Cited by 348 · see citing works
Evaluating the Impact of DSS, Cognitive Effort, and Incentives on Strategy Selection
Todd, P., & Benbasat, I. (1999) · Information Systems Research · doi:10.1287/isre.10.4.356 · Cited by 312 · see citing works
The Impact of Explanation Facilities on User Acceptance of Expert Systems Advice
Ye, L. R., & Johnson, P. E. (1995) · MIS Quarterly · doi:10.2307/249686 · Cited by 290 · see citing works
Banker, R. D., & Kauffman, R. J. (2004) · Management Science · doi:10.1287/mnsc.1040.0206 · Cited by 259 · see citing works
Explaining Classifications For Individual Instances
Robnik‐Šikonja, M., & Kononenko, I. (2008) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2007.190734 · Cited by 255 · see citing works
Decisional Guidance for Computer-Based Decision Support1
Silver, M. S. (1991) · MIS Quarterly · doi:10.2307/249441 · Cited by 212 · see citing works
OPUS: An Efficient Admissible Algorithm for Unordered Search
Webb, G. I. (1995) · Journal of Artificial Intelligence Research · doi:10.1613/jair.227 · Cited by 207 · see citing works
Document-Word Co-regularization for Semi-supervised Sentiment Analysis
Sindhwani, V., & Melville, P. (2008) · Proceedings · doi:10.1109/icdm.2008.113 · Cited by 184 · see citing works
Arnol'd, �. �., Clark, Collier, P. A., Leech, & Sutton, S. G. (2006) · MIS Quarterly · doi:10.2307/25148718 · Cited by 166 · see citing works
Expectancy Theory as an Explanation of Voluntary Use of a Decision-Support System
Sanctis, G. D. (1983) · Psychological Reports · doi:10.2466/pr0.1983.52.1.247 · Cited by 163 · see citing works
Sambamurthy, V., & Poole, M. S. (1992) · Information Systems Research · doi:10.1287/isre.3.3.224 · Cited by 144 · see citing works
Multiattribute Data Presentation and Human Judgment: A Cognitive Fit Perspective
Umanath, N. S., & Vessey, I. (1994) · Decision Sciences · doi:10.1111/j.1540-5915.1994.tb01870.x · Cited by 141 · see citing works
Pant, G., & Srinivasan, P. (2005) · ACM Transactions on Information Systems · doi:10.1145/1095872.1095875 · Cited by 140 · see citing works
Providing Decisional Guidance for Multicriteria Decision Making in Groups
Limayem, M., & Desanctis, G. L. (2000) · Information Systems Research · doi:10.1287/isre.11.4.386.11874 · Cited by 139 · see citing works
Explaining instance classifications with interactions of subsets of feature values
Štrumbelj, E., Kononenko, I., & Robnik-Sikonja, M. (2009) · Data & Knowledge Engineering · doi:10.1016/j.datak.2009.01.004 · Cited by 129 · see citing works
DSS Effectiveness in Marketing Resource Allocation Decisions: Reality vs. Perception
Lilien, G. L., Rangaswamy, A., van Bruggen, G. H., & Starke, K. (2004) · Information Systems Research · doi:10.1287/isre.1040.0026 · Cited by 118 · see citing works
Audience selection for on-line brand advertising
Provost, F. J., Dalessandro, B., Hook, R., Zhang, X., & Murray, A. T. (2009) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1557019.1557098 · Cited by 118 · see citing works
Self-citationHow Incorporating Feedback Mechanisms in a DSS Affects DSS Evaluations
Kayandé, U., Bruyn, A. D., Lilien, G. L., Rangaswamy, A., & van Bruggen, G. H. (2008) · Information Systems Research · doi:10.1287/isre.1080.0198 · Cited by 113 · see citing works
The effects of structural characteristics of explanations on use of a DSS
Gonul, M. S., Önkal, D., & Lawrence, M. J. (2006) · Decision Support Systems · doi:10.1016/j.dss.2005.12.003 · Cited by 103 · see citing works
Why label when you can search?
Attenberg, J., & Provost, F. J. (2010) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/1835804.1835859 · Cited by 75 · see citing works
Self-citationOn Chomsky and the Two Cultures of Statistical Learning
Norvig, P. (2017) · Springer eBooks · doi:10.1007/978-3-658-12153-2_3 · Cited by 70 · see citing works
Beat the machine: Challenging workers to find the unknown unknowns
Attenberg, J., Ipeirotis, P. G., & Provost, F. J. (2011) · Cited by 57 · see citing works
Self-citationThe cost-minimizing inverse classification problem: a genetic algorithm approach
Mannino, M. V., & Koushik, M. V. (2000) · Decision Support Systems · doi:10.1016/s0167-9236(00)00077-4 · Cited by 47 · see citing works
Collaborative Email-Spam Filtering with the Hashing-Trick
Attenberg, J., Weinberger, K. Q., Dasgupta, A., Smola, A. J., & Zinkevich, M. (2009) · Cited by 46 · see citing works
Design principles of massive, robust prediction systems
Raeder, T., Stitelman, O., Dalessandro, B., Perlich, C., & Provost, F. J. (2012) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2339530.2339740 · Cited by 30 · see citing works
Self-citationAudience Selection for On-Line Brand Advertising: Privacy-Friendly Social Network TargetingPreprint
Provost, F. J., Dalessandro, B., Hook, R., Zhang, X., & Murray, A. T. (2011) · SSRN Electronic Journal · doi:10.2139/ssrn.1852644 · Cited by 26 · see citing works
Self-citationPseudo-social network targeting from consumer transaction data
Martens, D., & Provost, F. J. (2011) · Faculty Digital Archive (New York University Florence) · Cited by 22 · see citing works
Self-citationHägerstrand, A. (2011) · Cited by 5 · see citing works
Improved Algorithms for Document Classification &Query-based Multi-Document Summarization
D’Silva, S., Joshi, N., Rao, S., Venkatraman, S., & Shrawne, S. C. (2011) · International Journal of Engineering and Technology · doi:10.7763/ijet.2011.v3.261 · Cited by 4 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555 · see citing works
Barredo Arrieta, A., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., et al. (2020) · Information Fusion · doi:10.1016/j.inffus.2019.12.012 · Cited by 10,423 · see citing works
A Survey on the Explainability of Supervised Machine Learning
Burkart, N., & Huber, M. F. (2021) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.12228 · Cited by 1,008 · see citing works
A data-driven approach to predict the success of bank telemarketing
Moro, S., Cortez, P. C., & Rita, P. (2014) · Decision Support Systems · doi:10.1016/j.dss.2014.03.001 · Cited by 885 · see citing works
Mittelstadt, B., Russell, C., & Wachter, S. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287574 · Cited by 794 · see citing works
"Why Should I Trust You?": Explaining the Predictions of Any ClassifierPreprint
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.04938 · Cited by 587 · see citing works
Counterfactual explanations and how to find them: literature review and benchmarking
Guidotti, R. (2022) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-022-00831-6 · Cited by 497 · see citing works
Actionable Recourse in Linear Classification
Ustun, B., Spangher, A., & Liu, Y. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287566 · Cited by 501 · see citing works
GraphLIME: Local Interpretable Model Explanations for Graph Neural Networks
Huang, Q., Yamada, M., Tian, Y., Singh, D., & Chang, Y. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2022.3187455 · Cited by 455 · see citing works
Explainable Artificial Intelligence: Objectives, Stakeholders, and Future Research Opportunities
Meske, C., Bunde, E., Schneider, J., & Gersch, M. (2020) · Information Systems Management · doi:10.1080/10580530.2020.1849465 · Cited by 426 · see citing works
Artificial intelligence in E-Commerce: a bibliometric study and literature review
Bawack, R. E., Wamba, S. F., Carillo, K., & Akter, S. (2022) · Electronic Markets · doi:10.1007/s12525-022-00537-z · Cited by 453 · see citing works
Stepin, I., Alonso, J. M., Catala, A., & Pereira-Farina, M. (2021) · IEEE Access · doi:10.1109/access.2021.3051315 · Cited by 376 · see citing works
Inherent Tradeoffs in the Fair Determination of Risk Scores
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603197 · Cited by 347 · see citing works
Getting value from Business Intelligence systems: A review and research agenda
Trieu, V.-H. (2016) · Decision Support Systems · doi:10.1016/j.dss.2016.09.019 · Cited by 324 · see citing works
Chou, Y.-L., Moreira, C., Bruza, P., Ouyang, C., & Jorge, J. (2022) · Information Fusion · doi:10.1016/j.inffus.2021.11.003 · Cited by 302 · see citing works
Utilizing big data analytics for information systems research: challenges, promises and guidelines
Müller, O., Junglas, I. A., Brocke, J. V., & Debortoli, S. (2016) · European Journal of Information Systems · doi:10.1057/ejis.2016.2 · Cited by 282 · see citing works
Benchmarking and survey of explanation methods for black box models
Bodria, F., Giannotti, F., Guidotti, R., Naretto, F., Pedreschi, D., & Rinzivillo, S. (2023) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-023-00933-9 · Cited by 353 · see citing works
Counterfactual Explanations and Algorithmic Recourses for Machine Learning: A Review
Verma, S., Boonsanong, V., Hoang, M., Hines, K. E., Dickerson, J. P., & Shah, C. (2020) · arXiv · doi:10.48550/arxiv.2010.10596 · Cited by 267 · see citing works
Counterfactual Explanations and Algorithmic Recourses for Machine Learning: A Review
Verma, S., Boonsanong, V., Hoang, M., Hines, K., Dickerson, J. P., & Shah, C. S. (2024) · ACM Computing Surveys · doi:10.1145/3677119 · Cited by 456 · see citing works
Human Digital Twin for Fitness Management
Barricelli, B. R., Casiraghi, E., Gliozzo, J., Petrini, A., & Valtolina, S. (2020) · IEEE Access · doi:10.1109/access.2020.2971576 · Cited by 259 · see citing works
Beware explanations from AI in health care
Babic, B., Gerke, S., Evgeniou, T., & Cohen, I. G. (2021) · Science · doi:10.1126/science.abg1834 · Cited by 252 · see citing works
The hidden assumptions behind counterfactual explanations and principal reasons
Barocas, S., Selbst, A. D., & Raghavan, M. (2020) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3351095.3372830 · Cited by 225 · see citing works
Designing Transparency for Effective Human-AI Collaboration
Vössing, M., Kühl, N., Lind, M., & Satzger, G. (2022) · Information Systems Frontiers · doi:10.1007/s10796-022-10284-3 · Cited by 266 · see citing works
Human factors in model interpretability: Industry practices, challenges, and needs
Hong, S. R., Hullman, J., & Bertini, E. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3392878 · Cited by 219 · see citing works
Miller, T., Howe, P., & Sonenberg, L. (2017) · arXiv · doi:10.48550/arxiv.1712.00547 · Cited by 218 · see citing works
Counterfactual Explanations for Machine Learning: A Review.Preprint
Verma, S., Dickerson, J. P., & Hines, K. (2020) · arXiv (Cornell University) · Cited by 223 · see citing works
Text mining for information systems researchers: An annotated topic modeling tutorial
University of Liechtenstein, Debortoli, S., Müller, O., IT University of Copenhagen, Junglas, I., Florida State University, vom Brocke, J., & University of Liechtenstein (2016) · Communications of the Association for Information Systems · doi:10.17705/1cais.03907 · Cited by 199 · see citing works
Comprehensible Predictive Models for Business Processes1
Breuker, D., Matzner, M., Delfmann, P., & Becker, J. (2016) · MIS Quarterly · doi:10.25300/misq/2016/40.4.10 · Cited by 190 · see citing works
Comparing Automatic and Human Evaluation of Local Explanations for Text Classification
Nguyen, D. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-1097 · Cited by 175 · see citing works
A Survey of Algorithmic Recourse: Contrastive Explanations and Consequential Recommendations
Karimi, A.-H., Barthe, G., Schölkopf, B., & Valera, I. (2023) · ACM Computing Surveys · doi:10.1145/3527848 · Cited by 301 · see citing works
Social network analysis for customer churn prediction
Verbeke, W., Martens, D., & Baesens, B. (2014) · Applied Soft Computing · doi:10.1016/j.asoc.2013.09.017 · Cited by 164 · see citing works
Self-citationKeane, M. T., Kenny, E. M., Delaney, E. D., & Smyth, B. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/609 · Cited by 169 · see citing works
Mathematical optimization in classification and regression trees
Carrizosa, E., Molero-Río, C., & Morales, D. R. (2021) · Top · doi:10.1007/s11750-021-00594-1 · Cited by 147 · see citing works
Bock, K. W. D., Coussement, K., Caigny, A. D., Słowiński, R., Baesens, B., Boute, R. N., Choi, T., Delen, D., Kraus, M., Lessmann, S., et al. (2023) · European Journal of Operational Research · doi:10.1016/j.ejor.2023.09.026 · Cited by 156 · see citing works
Self-citationComparison-Based Inverse Classification for Interpretability in Machine Learning
Laugel, T., Lesot, M., Marsala, C., Renard, X., & Detyniecki, M. (2018) · Communications in computer and information science · doi:10.1007/978-3-319-91473-2_9 · Cited by 141 · see citing works
Mining Massive Fine-Grained Behavior Data to Improve Predictive Analytics1
Martens, D., Provost, F., Clark, J., & de Fortuny, E. J. (2016) · MIS Quarterly · doi:10.25300/misq/2016/40.4.04 · Cited by 140 · see citing works
Self-citationExplainable Artificial Intelligence for Tabular Data: A Survey
Sahakyan, M., Aung, Z., & Rahwan, T. (2021) · IEEE Access · doi:10.1109/access.2021.3116481 · Cited by 135 · see citing works
“Counterfactual explanations have been used in a wide range of disciplines, including social science [14], data mining [72], philosophy [73] and psychology [74].”
BackgroundOswald, M. (2018) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2017.0359 · Cited by 132 · see citing works
Post-hoc explanation of black-box classifiers using confident itemsets
Moradi, M., & Matthias Samwald, A. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113941 · Cited by 119 · see citing works
Explainability as a Non-Functional Requirement
Köhl, M. A., Baum, K. L., Langer, M., Oster, D., Speith, T., & Bohlender, D. (2019) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re.2019.00046 · Cited by 117 · see citing works
Evaluating and understanding text-based stock price prediction models
de Fortuny, E. J., Smedt, T. D., Martens, D., & Daelemans, W. M. P. (2014) · Information Processing & Management · doi:10.1016/j.ipm.2013.12.002 · Cited by 112 · see citing works
Self-citationSurvey on Explainable AI: Techniques, challenges and open issues
Abusitta, A., Li, M. Q., & Fung, B. C. M. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124710 · Cited by 98 · see citing works
Brasse, J., Broder, H. R., Förster, M., Klier, M., & Sigler, I. (2023) · Electronic Markets · doi:10.1007/s12525-023-00644-5 · Cited by 101 · see citing works
Counterfactual Explanations for Multivariate Time Series
Ates, E., Aksar, B., Leung, V. J., & Coskun, A. K. (2021) · 2021 International Conference on Applied Artificial Intelligence (ICAPAI) · doi:10.1109/icapai49758.2021.9462056 · Cited by 88 · see citing works
A Workflow for Visual Diagnostics of Binary Classifiers using Instance-Level Explanations
Krause, J., Dasgupta, A., Swartz, J. L., Aphinyanaphongs, Y., & Bertini, E. (2017) · IEEE Conference on Visual Analytics Science and Technology (VAST) · doi:10.1109/vast.2017.8585720 · Cited by 87 · see citing works
Explainable image classification with evidence counterfactual
Vermeire, T., Brughmans, D., Goethals, S., Oliveira, R., & Martens, D. (2022) · Pattern Analysis and Applications · doi:10.1007/s10044-021-01055-y · Cited by 88 · see citing works
Self-citationTrier, M., Kundisch, D., Beverungen, D., Müller, O., Schryen, G., Mirbabaie, M., & Trang, S. T.-N. (2023) · Business & Information Systems Engineering · doi:10.1007/s12599-023-00822-x · Cited by 97 · see citing works
Alonso, J. M., Castiello, C., Magdalena, L., & Mencar, C. (2021) · Studies in computational intelligence · doi:10.1007/978-3-030-71098-9 · Cited by 87 · see citing works
PRINCE: Provider-side Interpretability with Counterfactual Explanations in Recommender Systems
Ghazimatin, A., Balalau, O., Saha Roy, R., & Weikum, G. (2020) · Proceedings of the 13th International Conference on Web Search and Data Mining · doi:10.1145/3336191.3371824 · Cited by 88 · see citing works
Acceptance of text-mining systems: The signaling role of information quality
Demoulin, N. T. M., & Coussement, K. (2018) · Information & Management · doi:10.1016/j.im.2018.10.006 · Cited by 86 · see citing works
Kim, D., Song, Y., Kim, S., Lee, S., Wu, Y., Shin, J., & Lee, D. (2023) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2023.122343 · Cited by 89 · see citing works
Value-added tax fraud detection with scalable anomaly detection techniques
Vanhoeyveld, J., Martens, D., & Peeters, B. (2019) · Applied Soft Computing · doi:10.1016/j.asoc.2019.105895 · Cited by 91 · see citing works
Self-citationOn cognitive preferences and the plausibility of rule-based models
Fürnkranz, J., Kliegr, T., & Paulheim, H. (2019) · Machine Learning · doi:10.1007/s10994-019-05856-5 · Cited by 88 · see citing works
Riveiro, M., & Thill, S. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103507 · Cited by 81 · see citing works
Wang, Z., & Culotta, A. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i16.17651 · Cited by 81 · see citing works
A survey of algorithmic recourse: definitions, formulations, solutions, and prospectsPreprint
Karimi, A.-H., Barthe, G., Schölkopf, B., & Valera, I. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.04050 · Cited by 74 · see citing works
Towards a data science toolbox for industrial analytics applications
Flath, C. M., & Stein, N. (2017) · Computers in Industry · doi:10.1016/j.compind.2017.09.003 · Cited by 74 · see citing works
Comprehensible software fault and effort prediction: A data mining approach
Moeyersoms, J., de Fortuny, E. J., Dejaeger, K., Baesens, B., & Martens, D. (2014) · Journal of Systems and Software · doi:10.1016/j.jss.2014.10.032 · Cited by 71 · see citing works
Self-citationInterpreting Black-Box Classifiers Using Instance-Level Visual Explanations
Tamagnini, P., Krause, J., Dasgupta, A., & Bertini, E. (2017) · Workshop on Human-In-the-Loop Data Analytics (HILDA) · doi:10.1145/3077257.3077260 · Cited by 70 · see citing works
Herremans, D., Martens, D., & Sörensen, K. (2014) · Journal of New Music Research · doi:10.1080/09298215.2014.881888 · Cited by 69 · see citing works
Self-citationThe use of big data in corporate communication
Wiencierz, C., & Röttger, U. (2017) · Corporate Communications An International Journal · doi:10.1108/ccij-02-2016-0015 · Cited by 68 · see citing works
Meske, C., & Bunde, E. (2022) · Information Systems Frontiers · doi:10.1007/s10796-021-10234-5 · Cited by 67 · see citing works
Nagahisarchoghaei, M., Nur, N., Cummins, L., Nur, N., Karimi, M. M., Nandanwar, S., Bhattacharyya, S., & Rahimi, S. (2023) · Electronics · doi:10.3390/electronics12051092 · Cited by 76 · see citing works
Mitigating Bias in Algorithmic Hiring: Evaluating Claims and Practices
Raghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603203 · Cited by 67 · see citing works
NICE: an algorithm for nearest instance counterfactual explanations
Brughmans, D., Leyman, P., & Martens, D. (2023) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-023-00930-y · Cited by 64 · see citing works
Self-citationCounterfactual Explanations for Neural Recommenders
Tran, K. H., Ghazimatin, A., & Roy, R. S. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3463005 · Cited by 65 · see citing works
Active Learning-Based Pedagogical Rule Extraction
de Fortuny, E. J., & Martens, D. (2015) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2389037 · Cited by 63 · see citing works
Self-citationIdentifying Spurious Correlations for Robust Text Classification
Wang, Z., & Culotta, A. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.308 · Cited by 64 · see citing works
Bock, K. W. D., & Caigny, A. D. (2021) · Decision Support Systems · doi:10.1016/j.dss.2021.113523 · Cited by 54 · see citing works
Cnudde, S. D., Moeyersoms, J., Stankova, M., Tobback, E., Javaly, V., & Martens, D. (2018) · Journal of the Operational Research Society · doi:10.1080/01605682.2018.1434402 · Cited by 69 · see citing works
Self-citationsDTM: A Supervised Bayesian Deep Topic Model for Text Analytics
Yang, Y., Zhang, K., & Fan, Y. (2022) · Information Systems Research · doi:10.1287/isre.2022.1124 · Cited by 48 · see citing works
Explaining Data-Driven Decisions made by AI Systems: The Counterfactual Approach
Fernández-Loría, C., Provost, F. J., & Han, X. (2022) · MIS Quarterly · doi:10.25300/misq/2022/16749 · Cited by 115 · see citing works
Self-citationExplaining Data-Driven Decisions made by AI Systems: The Counterfactual ApproachPreprint
Fernández-Loría, C., Provost, F. J., & Han, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.07417 · Cited by 49 · see citing works
Self-citationChatrEx: Designing Explainable Chatbot Interfaces for Enhancing Usefulness, Transparency, and Trust
Khurana, A., Harjandi, P. A., & Chilana, P. K. (2021) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vl/hcc51201.2021.9576440 · Cited by 49 · see citing works
Corporate residence fraud detection
de Fortuny, E. J., Stankova, M., Moeyersoms, J., Minnaert, B., Provost, F. J., & Martens, D. (2014) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2623330.2623333 · Cited by 45 · see citing works
Self-citationImbalanced classification in sparse and large behaviour datasets
Vanhoeyveld, J., & Martens, D. (2017) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-017-0517-y · Cited by 45 · see citing works
Self-citationRaghavan, M. (2023) · ACM eBooks · doi:10.1145/3603195.3603207 · Cited by 49 · see citing works
Machine learning in information systems - a bibliographic review and open research issues
Abdel-Karim, B. M., Pfeuffer, N., & Hinz, O. F. (2021) · Electronic Markets · doi:10.1007/s12525-021-00459-2 · Cited by 50 · see citing works
A Framework for Explainable Text Classification in Legal Document Review
Mahoney, C. J., Zhang, J., Huber-Fliflet, N., Gronvall, P., & Zhao, H. (2019) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata47090.2019.9005659 · Cited by 41 · see citing works
Predictive Multiplicity in ClassificationPreprint
Marx, C. T., Calmon, F. P., & Ustun, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.06677 · Cited by 41 · see citing works
Ramon, Y., Farrokhnia, R. A., Matz, S., & Martens, D. (2021) · Information · doi:10.3390/info12120518 · Cited by 40 · see citing works
Self-citationThe Robustness of Counterfactual Explanations Over Time
Ferrario, A., & Loi, M. (2022) · IEEE Access · doi:10.1109/access.2022.3196917 · Cited by 38 · see citing works
Enhancing Transparency and Control When Drawing Data-Driven Inferences About Individuals
Chen, D., Fraiberger, S. P., Moakler, R., & Provost, F. J. (2017) · Big Data · doi:10.1089/big.2017.0074 · Cited by 37 · see citing works
Self-citationChhatwal, R., Gronvall, P., Huber-Fliflet, N., Keeling, R., Zhang, J., & Zhao, H. (2018) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2018.8622073 · Cited by 37 · see citing works
Kühl, N., Hirt, R., Baier, L., Schmitz, B., & Satzger, G. (2021) · Communications of the Association for Information Systems · doi:10.17705/1cais.04845 · Cited by 37 · see citing works
Bunde, E. (2021) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2021.154 · Cited by 36 · see citing works
Tell me a story! Narrative-driven XAI with Large Language Models
Martens, D., Hinns, J., Dams, C., Vergouwen, M., & Evgeniou, T. (2025) · Decision Support Systems · doi:10.1016/j.dss.2025.114402 · Cited by 43 · see citing works
Self-citationStepin, I., Alonso, J. M., Catalá, A., & Pereira-Fariña, M. (2020) · IEEE International Conference on Fuzzy Systems (FUZZ-IEEE) · doi:10.1109/fuzz48607.2020.9177629 · Cited by 35 · see citing works
Design Science Research Modes in Human-Computer Interaction Projects
Adam, M. T. P., Gregor, S. D., Hevner, A. R., & Morana, S. (2021) · AIS Transactions on Human-Computer Interaction · doi:10.17705/1thci.00139 · Cited by 35 · see citing works
Explaining clusterings of process instances
Koninck, P. D., Weerdt, J. D., & Broucke, S. V. (2016) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-016-0488-4 · Cited by 34 · see citing works
Counterfactual Explanations for Oblique Decision Trees:Exact, Efficient Algorithms
Carreira-Perpiñán, M. Á., & Hada, S. S. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i8.16851 · Cited by 34 · see citing works
Vanhoeyveld, J., Martens, D., & Peeters, B. (2019) · Pattern Analysis and Applications · doi:10.1007/s10044-019-00852-w · Cited by 32 · see citing works
Self-citationPreCoF: counterfactual explanations for fairness
Goethals, S., Martens, D., & Calders, T. (2023) · Machine Learning · doi:10.1007/s10994-023-06319-8 · Cited by 31 · see citing works
Self-citationClustering categories in support vector machines
Carrizosa, E., Nogales-Gómez, A., & Morales, D. R. (2016) · Omega · doi:10.1016/j.omega.2016.01.008 · Cited by 31 · see citing works
A Framework and Benchmarking Study for Counterfactual Generating Methods on Tabular Data
Oliveira, R., & Martens, D. (2021) · Applied Sciences · doi:10.3390/app11167274 · Cited by 34 · see citing works
Self-citationInterpretability and Transparency in Artificial Intelligence
Mittelstadt, B. (2022) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198857815.013.20 · Cited by 30 · see citing works
Telecom traffic pumping analytics via explainable data science
Irarrázaval, M. E., Maldonado, S., Pérez, J., & Vairetti, C. (2021) · Decision Support Systems · doi:10.1016/j.dss.2021.113559 · Cited by 29 · see citing works
Mathematical optimization modelling for group counterfactual explanations
Carrizosa, E., Ramírez-Ayerbe, J., & Morales, D. R. (2024) · European Journal of Operational Research · doi:10.1016/j.ejor.2024.01.002 · Cited by 29 · see citing works
Unjustified Classification Regions and Counterfactual Explanations in Machine Learning
Laugel, T., Lesot, M.-J., Marsala, C., Renard, X., & Detyniecki, M. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-46147-8_3 · Cited by 28 · see citing works
Disagreement amongst counterfactual explanations: how transparency can be misleading
Brughmans, D., Melis, L., & Martens, D. (2024) · Top · doi:10.1007/s11750-024-00670-2 · Cited by 30 · see citing works
Self-citation
- Authors
- Martens, D., & Provost, F.
- Affiliations
- University of Antwerp (BE)
- New York University (US)
- Venue
- MIS Quarterly
- Publisher
- MIS Quarterly
- Published
- 2014-03-01
- Volume
- 38
- Issue
- 1
- Pages
- 73-100
- ISSN
- 0276-7783 (ISSN-L)
- 2162-9730
- OpenAlex
- W198744195
- Cited by
- 264
- References
- 68
- Citations by year
- 2026: 4 · 2025: 19 · 2024: 17 · 2023: 49 · 2022: 28 · 2021: 52 · 2020: 29 · 2019: 17 · 2018: 13 · 2017: 12 · 2016: 12 · 2015: 4 · 2014: 6 · 2013: 1
- FWCI
- 11.30
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- MIS Quarterly (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Text and Document Classification Technologies
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Keywords
- explainable AI, document classification, high-dimensional text data, web page classification, model interpretability, data quality improvement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review