Trends and Trajectories for Explainable, Accountable and Intelligible Systems: An HCI Research Agenda
The DOI matches its Crossref record; 172 of the 174 references it cites were found in a registry or an index.
Abstract
Advances in artificial intelligence, sensors and big data management have far-reaching societal impacts. As these systems augment our everyday lives, it becomes increasing-ly important for people to understand them and remain in control. We investigate how HCI researchers can help to develop accountable systems by performing a literature analysis of 289 core papers on explanations and explaina-ble systems, as well as 12,412 citing papers. Using topic modeling, co-occurrence and network analysis, we mapped the research space from diverse domains, such as algorith-mic accountability, interpretable machine learning, context-awareness, cognitive psychology, and software learnability. We reveal fading and burgeoning trends in explainable systems, and identify domains that are closely connected or mostly isolated. The time is ripe for the HCI community to ensure that the powerful new autonomous systems have intelligible interfaces built-in. From our results, we propose several implications and directions for future research to-wards this goal.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“To acquire such knowledge, we follow a user-centric approach as it enables obtaining empirical evidence for designing explanations for specific goals, domain and population [1].”
From Explainable recommendation: when design meets trust calibration (2021) · cites this paper as [1]
In the citing paper
“Providing system explanations may also undermine user perceptions when users lack the attentional capacity to process complex explanations, for example when executing a demanding task [1,12,43,85].”
From Progressive Disclosure: When, Why, and How Do Users Want Algorithmic Transparency Information? (2020) · cites this paper as [1]
In the citing paper
“Transparency may erode confidence in a system, with users trusting it less, because transparency leads them to question the system even when it is correct [1,13,50].”
From Progressive Disclosure: When, Why, and How Do Users Want Algorithmic Transparency Information? (2020) · cites this paper as [1]
In the citing paper
“However, critical scholars highlight that these frameworks often reflect Western-centric values, overlooking the specific needs and cultural contexts of the Global South [1, 3, 10, 16].”
From Designing Responsible AI with Indigenous Communities: Towards Participatory AI with ovaHimba and San People in Namibia (2026) · cites this paper as [1]
In the citing paper
“People's mental model can be refned by explanations of how the system works.”
From Human-AI Collaboration via Conditional Delegation: A Case Study of Content Moderation (2022) · cites this paper as [1]
Citations
Cites
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
Selvaraju, R. R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., & Batra, D. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.74 · Cited by 24,513
Fast unfolding of communities in large networks
Blondel, V. D., Guillaume, J.-L., Lambiotte, R., & Lefebvre, E. (2008) · Journal of Statistical Mechanics: Theory and Experiment · doi:10.1088/1742-5468/2008/10/p10008 · Cited by 21,424
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555
Gephi: An Open Source Software for Exploring and Manipulating Networks
Bastian, M., Heymann, S., & Jacomy, M. (2009) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v3i1.13937 · Cited by 11,675
Item-based collaborative filtering recommendation algorithms
Sarwar, B., Karypis, G., Konstan, J., & Riedl, J. (2001) · Proceedings of the 10th international conference on World Wide Web · doi:10.1145/371920.372071 · Cited by 9,135
Griffiths, T. L., & Steyvers, M. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0307752101 · Cited by 6,049
Lipton, Z. C. (2018) · Queue · doi:10.1145/3236386.3241340 · Cited by 5,427
Explanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
Plans and Situated Actions: The Problem of Human-Machine Communication
Kantowitz, B., & Suchman, L. A. (1990) · The American Journal of Psychology · doi:10.2307/1423221 · Cited by 5,299
Understanding and Using Context
Dey, A. K. (2001) · Personal and Ubiquitous Computing · doi:10.1007/s007790170019 · Cited by 5,012
Readings in Information Visualization: Using Vision to Think
Card, S. K., Mackinlay, J. D., & Shneiderman, B. (1999) · Cited by 3,935
Context-Aware Computing Applications
Schilit, B., Adams, N., & Want, R. (1994) · 1994 First Workshop on Mobile Computing Systems and Applications · doi:10.1109/wmcsa.1994.16 · Cited by 3,231
Dey, A. K., Abowd, G. D., & Salber, D. (2001) · Human–Computer Interaction · doi:10.1207/s15327051hci16234_02 · Cited by 2,951
Jacomy, M., Venturini, T., Heymann, S., & Bastian, M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0098679 · Cited by 2,909
European Union Regulations on Algorithmic Decision Making and a “Right to Explanation”
Goodman, B., & Flaxman, S. (2017) · AI Magazine · doi:10.1609/aimag.v38i3.2741 · Cited by 2,131 · cited 1×
“ion approved a data protection law [57, 65] that includes a “right to explanation”, and USACM released a statement on algorithmic transparency and accountability [171].”
BackgroundCognitive Tutors: Lessons Learned
Anderson, J. R., Corbett, A. T., Koedinger, K. R., & Pelletier, R. (1995) · Journal of the Learning Sciences · doi:10.1207/s15327809jls0402_2 · Cited by 1,982 · cited 1×
“Closely related to this, the field of Cognitive Tutoring from the 90’s based on the ACT [4] cognitive model has explored the role of explanations in how students learn in classrooms and applied it to the development of computer based tutors [5].”
BackgroundFrom translations to problematic networks: An introduction to co-word analysis
Callon, M., Courtial, J.-P., Turner, W. A., & Bauin, S. (1983) · Social Science Information · doi:10.1177/053901883022002003 · Cited by 1,951
(2013) · Cited by 1,951
Illuminating the Path: The Research and Development Agenda for Visual Analytics
Thomas, J. J., & Cook, K. A. (2005) · Cited by 1,770
Explaining collaborative filtering recommendations
Herlocker, J. L., Konstan, J. A., & Riedl, J. (2000) · Proceedings of the 2000 ACM conference on Computer supported cooperative work · doi:10.1145/358916.358995 · Cited by 1,731 · cited 2×
“Some research focused on consumer-oriented applications, such as Recommender Systems [33, 81] and Adaptive User Interfaces of applications and for Software Engineering [95, 96, 135].”
BackgroundIntelligible Models for HealthCare: Predicting Pneumonia Risk and Hospital 30-day Readmission
Caruana, R., Lou, Y., Gehrke, J., Koch, P., Sturm, M., & Elhadad, N. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2788613 · Cited by 1,685
TVERSKY, B., MORRISON, J. B., & BETRANCOURT, M. (2002) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.2002.1017 · Cited by 1,671
What we talk about when we talk about context
Dourish, P. (2004) · Personal and Ubiquitous Computing · doi:10.1007/s00779-003-0253-8 · Cited by 1,529
The role of trust in automation reliance
Dzindolet, M. T., Peterson, S. A., Pomranky, R. A., Pierce, L. G., & Beck, H. P. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00038-7 · Cited by 1,276 · cited 3×
“While research on explainable Intelligent and Ambient Systems (I&A) and Interpretable Machine Learning (iML) have focused on the need to explain to single end-users to gain their individual trust [13, 55, 68], research on fair and accountable, and transparent (FAT) algorithms aims to address macroscopic societal accou…”
BackgroundSurvey and critique of techniques for extracting rules from trained artificial neural networks
Andrews, R., Diederich, J., & Tickle, A. B. (1995) · Knowledge-Based Systems · doi:10.1016/0950-7051(96)81920-4 · Cited by 1,225
Algorithmic Decision Making and the Cost of Fairness
Corbett-Davies, S., Pierson, E., Feller, A., Goel, S., & Huq, A. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098095 · Cited by 1,149
Question Asking During Tutoring
Graesser, A. C., & Person, N. K. (1994) · American Educational Research Journal · doi:10.3102/00028312031001104 · Cited by 900 · cited 1×
“In the field of education, a lot of attention has been paid to how students learn by asking Questions and the question generation mechanisms [67].”
BackgroundACT: A simple theory of complex cognition.
Anderson, J. R. (1996) · American Psychologist · doi:10.1037/0003-066x.51.4.355 · Cited by 830
Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraints
Zhao, J., Wang, T., Yatskar, M., Ordonez, V., & Chang, K.-W. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1323 · Cited by 829
Working with Machines: The Impact of Algorithmic and Data-Driven Management on Human Workers
Lee, M. K., Kusbit, D., Metsky, E., & Dabbish, L. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702548 · Cited by 823
The design of eco-feedback technology
Froehlich, J., Findlater, L., & Landay, J. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753629 · Cited by 813 · cited 1×
“’s eco-feedback technology survey [59], Grosse-Puppendahl et al.”
Letham, B., Rudin, C., McCormick, T. H., & Madigan, D. (2015) · The Annals of Applied Statistics · doi:10.1214/15-aoas848 · Cited by 766
Accountability in algorithmic decision making
Diakopoulos, N. (2016) · Communications of the ACM · doi:10.1145/2844110 · Cited by 763
Datta, A., Sen, S., & Zick, Y. (2016) · 2016 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2016.42 · Cited by 728 · cited 3×
“Privacy issues due to the advent of big data analytics [147,166] and the contention between transparency and privacy is also an active area of investigation [38, 111].”
BackgroundMethodInterpretable Decision Sets: A Joint Framework for Description and Prediction
Lakkaraju, H., Bach, S. H., & Leskovec, J. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939874 · Cited by 687
Opportunities and Challenges for Data Physicalization
Jansen, Y., Dragicevic, P., Isenberg, P., Alexander, J., Karnik, A., Kildal, J., Subramanian, S., & Hornbæk, K. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702180 · Cited by 571
Production Rules as a Representation for a Knowledge-Based Consultation Program
Davis, R., Buchanan, B., & Shortliffe, E. (1977) · Artificial Intelligence · doi:10.1016/0004-3702(77)90003-0 · Cited by 569
Why and why not explanations improve the intelligibility of context-aware intelligent systems
Lim, B. Y., Dey, A. K., & Avrahami, D. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1519023 · Cited by 552 · cited 1×
“tered software engineering [95, 96] but is commonly used for explanations in both communities [101, 113, 117, 135, 179].”
MethodSelf-citationExplainable Artificial Intelligence (XAI)
Hossain, M. (2021) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.6371435 · Cited by 541
Explanations From Intelligent Systems: Theoretical Foundations and Implications for Practice1
Gregor, S., & Benbasat, I. (1999) · MIS Quarterly · doi:10.2307/249487 · Cited by 535 · cited 3×
“This is the biggest, most central, and mature subnetwork spanning many research areas of the Intelligent Systems and Ambient Intelligence communities.”
BackgroundDirect manipulation vs. interface agents
Shneiderman, B., & Maes, P. (1997) · Interactions · doi:10.1145/267505.267514 · Cited by 518 · cited 1×
“Further discussions in the 90s include, for example, Shneiderman and Maes’ CHI ’97 panel on direct manipulation vs. interface agents [ 157].”
MethodAlgorithmic Transparency in the News Media
Diakopoulos, N., & Koliska, M. (2017) · Digital Journalism · doi:10.1080/21670811.2016.1208053 · Cited by 515 · cited 2×
“For instance, Diakopoulis looks at this from a computational journalism perspective [47] and curates a list of newsworthy algorithms used by the U.”
Background(2012) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 484
Software engineering as seen through its research literature: A study in co-word analysis
Coulter, N., Monarch, I., & Konda, S. (1998) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(1998)49:13<1206::aid-asi7>3.0.co;2-f · Cited by 473
Intelligibility and Accountability: Human Considerations in Context-Aware Systems
Bellotti, V., & Edwards, K. (2001) · Human–Computer Interaction · doi:10.1207/s15327051hci16234_05 · Cited by 471
The effects of transparency on trust in and acceptance of a content-based art recommender
Cramer, H., Evers, V., Ramlal, S., van Someren, M., Rutledge, L., Stash, N., Aroyo, L., & Wielinga, B. (2008) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-008-9051-3 · Cited by 448
The Role of Explanations on Trust and Reliance in Clinical Decision Support Systems
Bussone, A., Stumpf, S., & O'Sullivan, D. (2015) · 2015 International Conference on Healthcare Informatics · doi:10.1109/ichi.2015.26 · Cited by 441
Termite: visualization techniques for assessing textual topic models
Chuang, J., Manning, C. D., & Heer, J. (2012) · Proceedings of the International Working Conference on Advanced Visual Interfaces · doi:10.1145/2254556.2254572 · Cited by 420
Making sense of sensing systems: five questions for designers and researchers
Bellotti, V., Back, M., Edwards, W. K., Grinter, R. E., Henderson, A., & Lopes, C. (2002) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/503376.503450 · Cited by 405
XPLAIN: a system for creating and explaining expert consulting programs
Swartout, W. R. (1983) · Artificial Intelligence · doi:10.1016/s0004-3702(83)80014-9 · Cited by 393
Interacting with Predictions: Visual Inspection of Black-box Machine Learning Models
Krause, J., Perer, A., & Ng, K. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858529 · Cited by 390
FilmTrust: movie recommendations using trust in web-based social networks
Golbeck, J., & Hendler, J. (2006) · CCNC 2006. 2006 3rd IEEE Consumer Communications and Networking Conference, 2006. · doi:10.1109/ccnc.2006.1593032 · Cited by 381
Designing the whyline: a debugging interface for asking questions about program behavior
Ko, A. J., & Myers, B. A. (2004) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/985692.985712 · Cited by 361
The Bayesian Case Model: A Generative Approach for Case-Based Reasoning and Prototype Classification
Kim, B., Rudin, C. D., & Shah, J. (2014) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 340
Hu, Y., Boyd-Graber, J., Satinoff, B., & Smith, A. (2014) · Machine Learning · doi:10.1007/s10994-013-5413-0 · Cited by 338
Algorithmic Bias: From Discrimination Discovery to Fairness-aware Data Mining
Hajian, S., Bonchi, F., & Castillo, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2945386 · Cited by 334
Norman, D. A. (2007) · Cited by 327
A survey of software learnability: metrics, methodologies and guidelines
Grossman, T., Fitzmaurice, G., & Attar, R. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518803 · Cited by 322
Causal–explanatory pluralism: How intentions, functions, and mechanisms influence causal ascriptions
Lombrozo, T. (2010) · Cognitive Psychology · doi:10.1016/j.cogpsych.2010.05.002 · Cited by 313
Grad-CAM: Why did you say that?
Selvaraju, R. R., Das, A., Vedantam, R., Cogswell, M., Parikh, D., & Batra, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.07450 · Cited by 309
iLamps: geometrically aware and self-configuring projectors
Raskar, R., van Baar, J., Beardsley, P., Willwacher, T., Rao, S., & Forlines, C. (2006) · ACM SIGGRAPH 2006 Courses on - SIGGRAPH '06 · doi:10.1145/1185657.1185802 · Cited by 307
Functional explanation and the function of explanation
LOMBROZO, T., & CAREY, S. (2006) · Cognition · doi:10.1016/j.cognition.2004.12.009 · Cited by 300
OctoPocus: a dynamic guide for learning gesture-based command sets
Bau, O., & Mackay, W. E. (2008) · Proceedings of the 21st annual ACM symposium on User interface software and technology · doi:10.1145/1449715.1449724 · Cited by 278 · cited 2×
“Other works explored how to de-sign for implicit interaction with sensing-based systems [14, 75, 86, 175], and help people predict what will happen through feedforward [12, 176].”
BackgroundLearning from a learning thermostat: lessons for intelligent systems for the home
Yang, R., & Newman, M. W. (2013) · Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing · doi:10.1145/2493432.2493489 · Cited by 268 · cited 5×
“Research explored the need for [111] and provision of explanations in physical space, such as smart environments [177, 178, 179], the office [26], smart homes [18, 30, 131, 183] and on the move [90, 116].”
BackgroundInfluentialTangible products: redressing the balance between appearance and action
Djajadiningrat, T., Wensveen, S., Frens, J., & Overbeeke, K. (2004) · Personal and Ubiquitous Computing · doi:10.1007/s00779-004-0293-8 · Cited by 265
Explaining Classifications For Individual Instances
Robnik-Sikonja, M., & Kononenko, I. (2008) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2007.190734 · Cited by 254
Assessing demand for intelligibility in context-aware applications
Lim, B. Y., & Dey, A. K. (2009) · Proceedings of the 11th international conference on Ubiquitous computing · doi:10.1145/1620545.1620576 · Cited by 246
Self-citationInterpretation and trust: designing model-driven visualizations for text analysis
Chuang, J., Ramage, D., Manning, C., & Heer, J. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2207738 · Cited by 244
Lopez, P. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-04346-8_62 · Cited by 242
Explanation in Case-Based Reasoning—Perspectives and Goals
Sørmo, F., Cassens, J., & Aamodt, A. (2005) · Artificial Intelligence Review · doi:10.1007/s10462-005-4607-7 · Cited by 239 · cited 1×
“Later research focused on explaining Bayesian Belief Networks [102, 126] and CaseBase Reasoning systems [159], following the trends of research interest in these AI paradigms.”
Kay, M., Kola, T., Hullman, J. R., & Munson, S. A. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858558 · Cited by 239 · cited 5×
“Research explored the need for [111] and provision of explanations in physical space, such as smart environments [177, 178, 179], the office [26], smart homes [18, 30, 131, 183] and on the move [90, 116].”
BackgroundInfluentialA review of explanation methods for Bayesian networks
LACAVE, C., & DÍEZ, F. J. (2002) · The Knowledge Engineering Review · doi:10.1017/s026988890200019x · Cited by 237
DeepRED – Rule Extraction from Deep Neural Networks
Zilke, J. R., Loza Mencía, E., & Janssen, F. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46307-0_29 · Cited by 228
Tell me more?: the effects of mental model soundness on personalizing an intelligent agent
Kulesza, T., Stumpf, S., Burnett, M., & Kwan, I. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2207678 · Cited by 225 · cited 4×
“With the increasing use of machine learning, Intelligent User Interfaces began to focus on providing explanations to debug learned models [100, 101, 162].”
BackgroundInfluentialCauses and Explanations: A Structural-Model ApproachPreprint
Halpern, J. Y., & Pearl, J. (2000) · arXiv (Cornell University) · Cited by 221
Algorithmic Accountability Reporting: On the Investigation of Black Boxes
Diakopoulos, N. A. (2014) · Columbia Academic Commons (Columbia University) · doi:10.7916/d8zk5tw2 · Cited by 221
Finding Common Ground: A Survey of Capacitive Sensing in Human-Computer Interaction
Grosse-Puppendahl, T., Holz, C., Cohn, G., Wimmer, R., Bechtold, O., Hodges, S., Reynolds, M. S., & Smith, J. R. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025808 · Cited by 214
Toward establishing trust in adaptive agents
Glass, A., McGuinness, D. L., & Wolverton, M. (2008) · Proceedings of the 13th international conference on Intelligent user interfaces · doi:10.1145/1378773.1378804 · Cited by 211
Wensveen, S. A. G., Djajadiningrat, J. P., & Overbeeke, C. J. (2004) · Proceedings of the 5th conference on Designing interactive systems: processes, practices, methods, and techniques · doi:10.1145/1013115.1013140 · Cited by 207
Beyond energy monitors: interaction, energy, and emerging energy systems
Pierce, J., & Paulos, E. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2207771 · Cited by 202
Fairness in Learning: Classic and Contextual Bandits
Joseph, M., Kearns, M., Morgenstern, J., & Roth, A. (2016) · arXiv · doi:10.48550/arxiv.1605.07139 · Cited by 199 · cited 1×
“Hajian called for data mining systems which are discrimination-conscious by-design [76]; such as fair systems for loan risk prediction [141], and bail flight risk of violent crime suspects [29], as well as methods to detect bias in black box models, such as Quantitative Influence (QI) [38] and methods that guarantee f…”
MethodTaxonomy-driven computation of product recommendations
Ziegler, C.-N., Lausen, G., & Schmidt-Thieme, L. (2004) · Proceedings of the thirteenth ACM international conference on Information and knowledge management · doi:10.1145/1031171.1031252 · Cited by 195
From today's augmented houses to tomorrow's smart homes: new directions for home automation research
Mennicken, S., Vermeulen, J., & Huang, E. M. (2014) · Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2632048.2636076 · Cited by 194
Self-citationApolo: making sense of large network data by combining rich user interaction and machine learning
Chau, D. H., Kittur, A., Hong, J. I., & Faloutsos, C. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1978967 · Cited by 191
Interacting meaningfully with machine learning systems: Three experiments
Stumpf, S., Rajaram, V., Li, L., Wong, W.-K., Burnett, M., Dietterich, T., Sullivan, E., & Herlocker, J. (2009) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2009.03.004 · Cited by 184
Lee, M. K., & Baykal, S. (2017) · Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/2998181.2998230 · Cited by 182
The Design of Implicit Interactions: Making Interactive Systems Less Obnoxious
Ju, W., & Leifer, L. (2008) · Design Issues · doi:10.1162/desi.2008.24.3.72 · Cited by 177
CHI 1994-2013: mapping two decades of intellectual progress through co-word analysis
Liu, Y., Goncalves, J., Ferreira, D., Xiao, B., Hosio, S., & Kostakos, V. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2556969 · Cited by 174
Rule Extraction from Support Vector Machines
(2006) · Advanced Information and Knowledge Processing · doi:10.1007/3-540-28803-1_10 · Cited by 167
Co-word analysis of the trends in stem cells field based on subject heading weighting
An, X. Y., & Wu, Q. Q. (2011) · Scientometrics · doi:10.1007/s11192-011-0374-1 · Cited by 157
Djajadiningrat, T., Overbeeke, K., & Wensveen, S. (2002) · Proceedings of the 4th conference on Designing interactive systems: processes, practices, methods, and techniques · doi:10.1145/778712.778752 · Cited by 156
Human-Centred Machine Learning
Gillies, M. F. P., Fiebrink, R. A., Tanaka, A., Garcia, J., Bevilacqua, F. P., Héloir, A., Nunnari, F., Mackay, W. E., Amershi, S., Lee, B., et al. (2016) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2851581.2856492 · Cited by 152
Grossman, T., & Fitzmaurice, G. W. (2010) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753552 · Cited by 144
Variolite: Supporting Exploratory Programming by Data Scientists
Kery, M. B., Horvath, A., & Myers, B. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025626 · Cited by 144
Toolkit to support intelligibility in context-aware applications
Lim, B. Y., & Dey, A. K. (2010) · Proceedings of the 12th ACM international conference on Ubiquitous computing · doi:10.1145/1864349.1864353 · Cited by 143 · cited 4×
“…have been proposed to aid the development of explainable ambient intelligence: PersonisAD for scrutable personalization [8], Per-sonisLF for long-term user models with forgetting [10], En-cators to explain context reasoning [41], and the Intelligibility Toolkit to explain question types [113].”
BackgroundInfluentialSelf-citationFreeman, D., Benko, H., Morris, M. R., & Wigdor, D. (2009) · ACM International Conference on Interactive Tabletops and Surfaces (ITS) · doi:10.1145/1731903.1731935 · Cited by 140
How it works: a field study of non-technical users interacting with an intelligent system
Tullio, J., Dey, A. K., Chalecki, J., & Fogarty, J. (2007) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240630 · Cited by 137
Managing Adaptive Versatile Environments
Youngblood, G. M., Holder, L. B., & Cook, D. J. (2005) · IEEE International Conference on Pervasive Computing and Communications · doi:10.1109/percom.2005.23 · Cited by 135
Nomograms for Visualization of Naive Bayesian Classifier
Možina, M., Demšar, J., Kattan, M. W., & Zupan, B. (2004) · Lecture notes in computer science · doi:10.1007/978-3-540-30116-5_32 · Cited by 133
Range: exploring implicit interaction through electronic whiteboard design
Ju, W. G., Lee, B. A., & Klemmer, S. (2008) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/1460563.1460569 · Cited by 132
Visual explanation of evidence in additive classifiers
Poulin, B., Eisner, R., Szafron, D., Lu, P., Greiner, R., Wishart, D. S., Fyshe, A., Pearcy, B., Macdonell, C., & Anvik, J. (2006) · NPARC · Cited by 131
Crossing the bridge over Norman's Gulf of Execution: revealing feedforward's true identity
Vermeulen, J., Luyten, K., van den Hoven, E., & Coninx, K. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466255 · Cited by 128
Self-citationAnswering why and why not questions in user interfaces
Myers, B. A., Weitzman, D. A., Ko, A. J., & Chau, D. H. (2006) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124832 · Cited by 126
Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level ConstraintsPreprint
Zhao, J., Wang, T., Yatskar, M., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.09457 · Cited by 122
Doing the laundry with agents: a field trial of a future smart energy system in the home
Costanza, E., Fischer, J. E., Colley, J. A., Rodden, T., Ramchurn, S. D., & Jennings, N. R. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557167 · Cited by 120
Animated Demonstrations for Learning Procedural Computer-Based Tasks
Palmiter, S., & Elkerton, J. (1993) · Human-Computer Interaction · doi:10.1207/s15327051hci0803_1 · Cited by 119
Koesten, L. M., Kacprzak, E., Tennison, J. F. A., & Simperl, E. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025838 · Cited by 115
Gestalt: integrated support for implementation and analysis in machine learning
Patel, K., Bancroft, N., Drucker, S. M., Fogarty, J., Ko, A. J., & Landay, J. (2010) · Proceedings of the 23nd annual ACM symposium on User interface software and technology · doi:10.1145/1866029.1866038 · Cited by 112
Developing a reflective model of collaborative systems
Dourish, P. (1995) · ACM Transactions on Computer-Human Interaction · doi:10.1145/200968.200970 · Cited by 109
ldatuning: Tuning of the Latent Dirichlet Allocation Models Parameters
Nikita, M. (2015) · doi:10.32614/cran.package.ldatuning · Cited by 109
PersonisAD: Distributed, Active, Scrutable Model Framework for Context-Aware Services
Assad, M., Carmichael, D. J., Kay, J., & Kummerfeld, B. (2007) · Springer eBooks · doi:10.1007/978-3-540-72037-9_4 · Cited by 104
Marquardt, N., Ballendat, T., Boring, S., Greenberg, S., & Hinckley, K. (2012) · ACM International Conference on Interactive Tabletops and Surfaces (ITS) · doi:10.1145/2396636.2396642 · Cited by 103
Investigating intelligibility for uncertain context-aware applications
Lim, B. Y., & Dey, A. K. (2011) · Proceedings of the 13th international conference on Ubiquitous computing · doi:10.1145/2030112.2030168 · Cited by 101
Self-citationExplanation and categorization: How “why?” informs “what?”
Lombrozo, T. (2008) · Cognition · doi:10.1016/j.cognition.2008.10.007 · Cited by 100
Toward a Geographic Understanding of the Sharing Economy: Systemic Biases in UberX and TaskRabbit
Thebault-Spieker, J., Terveen, L., & Hecht, B. (2017) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3058499 · Cited by 100
The Psychology of Scientific Explanation
Trout, J. D. (2007) · Philosophy Compass · doi:10.1111/j.1747-9991.2007.00081.x · Cited by 97
Some problems with the notion of context-aware computing
Erickson, T. (2002) · Communications of the ACM · doi:10.1145/503124.503154 · Cited by 96
Towards improving trust in context-aware systems by displaying system confidence
Antifakos, S., Kern, N., Schiele, B., & Schwaninger, A. (2005) · Proceedings of the 7th international conference on Human computer interaction with mobile devices & services · doi:10.1145/1085777.1085780 · Cited by 95
The human touch: How non-expert users perceive, interpret, and fix topic models
Lee, T. Y., Smith, A., Seppi, K., Elmqvist, N., Boyd-Graber, J., & Findlater, L. (2017) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2017.03.007 · Cited by 92
Bourgeois, J., van der Linden, J., Kortuem, G., Price, B. A., & Rimmer, C. (2014) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2632048.2632106 · Cited by 88
Lee, M. K., Kim, J. T., & Lizarondo, L. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025884 · Cited by 88
Meta-User Interfaces for Ambient Spaces
Coutaz, J. (2007) · Springer eBooks · doi:10.1007/978-3-540-70816-2_1 · Cited by 85
Fixing the program my computer learned: barriers for end users, challenges for the machine
Kulesza, T., Wong, W.-K., Stumpf, S., Perona, S., White, R., Burnett, M. M., Oberst, I., & Ko, A. J. (2009) · Proceedings of the 14th international conference on Intelligent user interfaces · doi:10.1145/1502650.1502678 · Cited by 83 · cited 5×
“Another relevant stream of work in the intelligent user interfaces community explored how end-users make sense of and control machine-learned programs, working towards intelligible and debuggable machine-learned programs [100, 101].”
BackgroundInfluentialSupport for context-aware intelligibility and control
Dey, A. K., & Newberger, A. (2009) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518832 · Cited by 83
Designs for explaining intelligent agents
Haynes, S. R., Cohen, M. A., & Ritter, F. E. (2008) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2008.09.008 · Cited by 81
Cheverst, K., Byun, H. E., Fitton, D., Sas, C., Kray, C., & Villar, N. (2005) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-005-1269-8 · Cited by 81
Intervention user interfaces: a new interaction paradigm for automated systems
Schmidt, A., & Herrmann, T. A. (2017) · interactions · doi:10.1145/3121357 · Cited by 81
Grand challenges for HCI researchers
Shneiderman, B., Catherine Plaisant, B., Cohen, M. S., Jacobs, S., Elmqvist, N., & Diakopoulos, N. (2016) · interactions · doi:10.1145/2977645 · Cited by 75
Supporting device discovery and spontaneous interaction with spatial references
Gellersen, H. W., Fischer, C., Guinard, D., Gostner, R., Kortuem, G., Kray, C., Rukzio, E., & Streng, S. (2008) · Personal and Ubiquitous Computing · doi:10.1007/s00779-008-0206-3 · Cited by 74
Accounting for System Behavior: Representation, Reflection, and Resourceful Action
Dourish, P. (1997) · The MIT Press eBooks · doi:10.7551/mitpress/1966.003.0007 · Cited by 73
The dangers of faulty, biased, or malicious algorithms requires independent oversight
Shneiderman, B. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1618211113 · Cited by 73
Tariff Agent: Interacting with a Future Smart Energy System at Home
Alan, A., Costanza, E., Ramchurn, S. D., Fischer, J. E., Rodden, T. A., & Jennings, N. R. (2016) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2943770 · Cited by 67
A Survey of User Interaction for Spontaneous Device Association
Chong, M. K., Mayrhofer, R., & Gellersen, H. W. (2014) · ACM Computing Surveys · doi:10.1145/2597768 · Cited by 65
Verbalization: narration of autonomous robot experience
Rosenthal, S. L., Selvaraj, S. P. P., & Veloso, M. (2016) · International Joint Conference on Artificial Intelligence · Cited by 65
Graphical Explanation in Belief Networks
Madigan, D., Mosurski, K., & Almond, R. G. (1997) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1997.10474735 · Cited by 61
Web Service Discovery Based on Past User Experience
Kokash, N., Birukou, A., & D’Andrea, V. (2007) · Springer eBooks · doi:10.1007/978-3-540-72035-5_8 · Cited by 59
Extracting and answering why and why not questions about Java program output
Ko, A. J., & Myers, B. A. (2010) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/1824760.1824761 · Cited by 57
EMYCIN: A Knowledge Engineer’s Tool for Constructing Rule-Based Expert Systems
van Melle, W., Shortliffe, E. H., & Buchanan, B. G. (2005) · Cited by 52
Design of an intelligible mobile context-aware application
Lim, B. Y., & Dey, A. K. (2011) · Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services · doi:10.1145/2037373.2037399 · Cited by 45
Self-citationManaging Adaptive Versatile environments
Youngblood, G. M., Cook, D. J., & Holder, L. B. (2005) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2005.08.004 · Cited by 45
Evaluating Intelligibility Usage and Usefulness in a Context-Aware Application
Lim, B. Y., & Dey, A. K. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39342-6_11 · Cited by 38
Self-citationIdentity crisis of ubicomp? mapping 15 years of the field's development and paradigm change
Yong, L., Gonçalves, J., Ferreira, D., Hosio, S. J., & Kostakos, V. (2014) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2632048.2632086 · Cited by 38
Managing private user models and shared personas
Kay, J., Kummerfeld, B., & Lauder, P. (2003) · Cited by 36
(2015) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 34
Vermeulen, J., Vanderhulst, G., Luyten, K., & Coninx, K. (2010) · International Conference on Intelligent Environments (IE) · doi:10.1109/ie.2010.56 · Cited by 34
Self-citationVisualization of uncertainty in context aware mobile applications
Rukzio, E., Hamard, J., Noda, C., & Luca, A. D. (2006) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1152215.1152267 · Cited by 33
Using Multiple Models to Understand Data
Patel, K., Drucker, S. M., Fogarty, J. A., Kapoor, A., & Tan, D. S. (2012) · Cited by 31
Explainable Artificial Intelligence (XAI)
Chen, T. (2025) · SpringerBriefs in applied sciences and technology · doi:10.1007/978-3-031-85374-6_1 · Cited by 30
Designing for Uncertainty in HCI: When Does Uncertainty Help?
Greis, M., Hullman, J., Correll, M., Kay, M., & Shaer, O. (2017) · Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/3027063.3027091 · Cited by 29
Improving intelligibility and control in Ubicomp
Vermeulen, J. (2010) · UbiComp '10 Adjunct · doi:10.1145/1864431.1864493 · Cited by 25
Self-citationTheoretical foundations for user-controlled forgetting in scrutable long term user models
Barua, D., Kay, J., Kummerfeld, B., & Paris, C. L. (2011) · Australian Conference on Computer-Human Interaction (OzCHI) · doi:10.1145/2071536.2071541 · Cited by 23
I Bet You Look Good on the Wall: Making the Invisible Computer Visible
Vermeulen, J., Slenders, J., Luyten, K., & Coninx, K. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-05408-2_24 · Cited by 21
Self-citationNeural network training and rule extraction with augmented discretized input
Hayashi, Y., Setiono, R., & Azcarraga, A. P. (2016) · Neurocomputing · doi:10.1016/j.neucom.2016.05.040 · Cited by 21
Tuning of the Latent Dirichlet Allocation Models Parameters [R package ldatuning version 1.0.2]
Nikita, M. (2020) · Cited by 21
Proceedings of NIPS 2016 Workshop on Interpretable Machine Learning for Complex SystemsPreprint
Wilson, A. G., Kim, B., & Herlands, W. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.09139 · Cited by 20
Big Data and the Future for Privacy
Richards, N., & King, J. H. (2014) · Edward Elgar Publishing eBooks · doi:10.4337/9781784717766.00021 · Cited by 20
Fieldward and Pathward: Dynamic Guides for Defining Your Own Gestures
Malloch, J. W., Griggio, C. F., McGrenere, J., & Mackay, W. E. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025764 · Cited by 19
Interpretable Machine Learning Models for the Digital Clock Drawing TestPreprint
Souillard‐Mandar, W., Davis, R., Rudin, C. D., Au, R., & Penney, D. L. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.07163 · Cited by 16
The design of slow-motion feedback
Vermeulen, J., Luyten, K., Coninx, K., & Marquardt, N. (2014) · Designing Interactive Systems Conference · doi:10.1145/2598510.2598604 · Cited by 14
Self-citationA Little Respect: Four Case Studies of HCI's Disregard for Other Disciplines
Marshall, J., Linehan, C., Spence, J. C., & Rennick‐Egglestone, S. (2017) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3027063.3052752 · Cited by 13
Marc, M. L., Courtial, J., Drozda‐Senkowska, E., Petard, J. P., & Py, Y. (1991) · Scientometrics · doi:10.1007/bf02019183 · Cited by 12
Proceedings of the ACM SIGKDD Workshop on Interactive Data Exploration and Analytics
Chau, P., Vreeken, J., van Leeuwen, M., Shahaf, D., & Faloutsos, C. (2013) · doi:10.1145/2501511 · Cited by 12
Tracing Strength of Relationships in Social Networks
Srba, I., & Bieliková, M. (2010) · IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT) · doi:10.1109/wi-iat.2010.241 · Cited by 11
Malinowski, J. (2017) · Prace Naukowe Wyższej Szkoły Zarządzania i Przedsiębiorczości z siedzibą w Wałbrzychu · Cited by 6
Software engineering as seen through its research literature
CoulterNeal, MonarchIra, & KondaSuresh (1998) · Journal of the American Society for Information Science and Technology · doi:10.5555/292838.292845 · Cited by 5
Requirements for Supporting Dynamic and Adaptive Workflow on the WWW
Kammer, P. J., Bolcer, G. A., & Bergman, M. (1998) · Cited by 4
Context, emergent game play and the mobile gamer as producer
Wolff, S., & Grüter, B. M. (2008) · GI-Jahrestagung · Cited by 3
Answering Why and Why Not Questions in Ubiquitous Computing
Vermeulen, J., Vanderhulst, G., Coninx, K., & Luyten, K. (2009) · Cited by 3
Self-citationCo-word analysis of the trends in stem cells field based on subject heading weighting
Ying, A., & Qiang, W. (2011) · Scientometrics · doi:10.5555/2004102.2004117 · Cited by 1
Designing for intelligibility and control in ubiquitous computing environments
Vermeulen, J. (2014) · Document Server@UHasselt (UHasselt) · Cited by 1
Self-citation(2013) · bepress Legal Repository
Research works printed but not linked: 34
- Aha, D. W., Darrell, T., Pazzani, M., Reid, D., Sam-mut, C.,&Stone, P. (2017). Workshop on Explainable AI (XAI). IJCAI 2017.
- Biran, O.,&Cotton, C. (2017). Explanation and justi-fication in machine learning: A survey. In IJCAI-17 Workshop on Explainable AI (XAI) (p. 8).
- 10.5555/300679 · doi:10.5555/300679
- Chalmers, M.,&MacColl, I. (2003, October). Seam-ful and seamless design in ubiquitous computing. In Workshop at the crossroads: The interaction of HCI and systems issues in UbiComp (Vol. 8).
- Das, A., Agrawal, H., Zitnick, C. L., Parikh, D.,&Ba-tra, D. (2016). Human attention in visual question an-swering: Do humans and deep networks look at the same regions?. arXiv preprint arXiv:1606.03556. · arXiv
- Das, S., McCarter, A., Minieri, J., Damaraju, N., Pad-manabhan, S.,&Chau, D. H. P. ISPARK: Interactive Visual Analytics for Fire Incidents and Station Place-ment. In ACM SIGKDD Workshop on Interactive Da-ta Exploration and Analytics (p. 29).
- Diakopoulis, N. (2018). Algorithm Tips -- Find tips for stories on algorithms. Algorithmtips.org. Retrieved 8 January 2018, from http://algorithmtips.org/
- Diakopoulos, N.,&Koliska, M. (2017). Algorithmic Transparency in the News Media. Digital Journalism,
- Doshi-Velez, F.,&Kim, B. (2017). A Roadmap for a Rigorous Science of Interpretability. arXiv preprint arXiv:1702.08608. · arXiv
- 10.5555/270318.270324 · doi:10.5555/270318.270324
- 10.5555/3086952 · doi:10.5555/3086952
- Google Scholar. (2018). Google Scholar. Retrieved 7 January 2018, from http://scholar.google.com/
- Griffiths, T. L.,&Steyvers, M. (2004). Finding scien-tific topics. Proceedings of the National academy of Sciences, 101 (suppl 1), 5228--5235.
- Hailesilassie, T. (2016). Rule extraction algorithm for deep neural networks: A review. arXiv preprint arXiv:1610.05267. · arXiv
- Halpern, J. Y.,&Pearl, J. (2005b). Causes and expla-nations: A structural-model approach. Part II: Expla-nations. The British journal for the philosophy of sci-ence, 56(4), 889--911.
- 10.5555/3157096.3157133 · doi:10.5555/3157096.3157133
- Kim B. (2015a). Interactive and interpretable ma-chine learning models for human machine collabora-tion (Doctoral dissertation Massachusetts Institute of Technology).
- Kim, B., Malioutov D. M., Varshney, K. R. Proceed-ings of the 2016 ICML Workshop on Human Inter-pretability in Machine Learning (WHI 2016). arXiv preprint, arXiv:1607.02531. · arXiv
- 10.5555/2969033.2969045 · doi:10.5555/2969033.2969045
- 10.5555/1759779.1759790 · doi:10.5555/1759779.1759790
- Lambiotte, R., Delvenne, J. C.,&Barahona, M. (2008). Laplacian dynamics and multiscale modular structure in networks. arXiv preprint arXiv:0812.1770. · arXiv
- Lim, B. Y., Ayalon, O.,&Toch, E. 2017. Reducing Communication Uncertainty with Social Intelligibility: Challenges and Opportunities. In CHI 2017 Workshop on Designing for Uncertainty in HCI.
- Lim, B. Y., Smith, A.,&Stumpf, S. (2018). ExSS: Ex-plainable smart systems. In Proceedings of the 23rd ACM International Conference Adjunct Papers on Intelligent User Interfaces.
- Lipton, Z. C. (2016). The mythos of model interpreta-bility. arXiv preprint, arXiv:1606.03490. · arXiv
- 10.5555/1812799.1812875 · doi:10.5555/1812799.1812875
- 10.5555/1053072.1053104 · doi:10.5555/1053072.1053104
- Muñoz-Avila, H.,&Aha, D. (2004). On the role of explanation for hierarchical case-based planning in real-time strategy games. In Proceedings of ECCBR-04 Workshop on Explanations in CBR (pp. 1--10).
- 10.2139/ssrn.2512069 · doi:10.2139/ssrn.2512069
- Roth-Berghofer, T., Leake, D. B.,&Cassens, J. (2012, July). Explanation-aware Computing ExaCt 2012. In Proceedings of the Seventh International ExaCt workshop.
- Scopus | The largest database of peer-reviewed liter-ature | Elsevier. (2018). Elsevier.com. Retrieved 7 January 2018, from https://www.elsevier.com/solutions/scopus
- 10.5555/38407 · doi:10.5555/38407
- Stolze, M.,&Ströbel, M. (2003). Dealing with learning in ecommerce product navigation and decision sup-port: the teaching salesman problem. In Proceedings of the Second Interdisciplinary World Congress on Mass Customization and Personalization.
- USACM. 2017. Statement on Algorithmic Transpar-ency and Accountability. Accessed on 2017-09-09. https://www.acm.org/binaries/content/assets/public-policy/2017_usacm_statement_algorithms.pdf
- Zhao, J., Wang, T., Yatskar, M., Ordonez, V.,&Chang, K. W. (2017). Men Also Like Shopping: Re-ducing Gender Bias Amplification using Corpus
Cited by
Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294
“Given HCI’s [61] core interest in technology that entails understanding and better empowering users, techniques from this research field can help in developing transparent systems.”
BackgroundInfluentialExplaining Explanations: An Overview of Interpretability of Machine Learning
Gilpin, L. H., Bau, D., Yuan, B. Z., Bajwa, A., Specter, M., & Kagal, L. (2018) · 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2018.00018 · Cited by 2,507
“One previous review paper of explainable AI performed a sizable data-driven literature analysis of explainable systems [75].”
BackgroundMethodInterpreting Black-Box Models: A Review on Explainable Artificial Intelligence
Hassija, V., Chamola, V., Mahapatra, A., Singal, A., Goel, D., Huang, K., Scardapane, S., Spinelli, I., Mahmud, M., & Hussain, A. (2024) · Cognitive Computation · doi:10.1007/s12559-023-10179-8 · Cited by 2,495
Machine Learning Interpretability: A Survey on Methods and Metrics
Carvalho, D. V., Pereira, E. M., & Cardoso, J. S. (2019) · Electronics · doi:10.3390/electronics8080832 · Cited by 1,842
“Recently, the achievements of ML systems for many domains of high interest, as well as the use of increasingly complex and nontransparent algorithms, such as deep learning, calls for another wave of interest in the need to have a greater understanding of the aforementioned systems’ outputs [17].”
BackgroundAli, S., Abuhmed, T., El-Sappagh, S., Muhammad, K., Alonso-Moral, J. M., Confalonieri, R., Guidotti, R., Del Ser, J., Díaz-Rodríguez, N., & Herrera, F. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101805 · Cited by 1,762
Metadata
- Authors
- Abdul, A., Vermeulen, J., Wang, D., Lim, B. Y., & Kankanhalli, M.
- Affiliations
- National University of Singapore (SG)
- Aarhus University (DK)
- Venue
- Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2018-04-21
- Pages
- 1-18
- OpenAlex
- W2795530988
- Cited by
- 743
- References
- 174
- Citations by year
- 2026: 75 · 2025: 65 · 2024: 95 · 2023: 89 · 2022: 115 · 2021: 125 · 2020: 91 · 2019: 69 · 2018: 18
- FWCI
- 30.94
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- explainable systems, algorithmic accountability, model interpretability, human-computer interaction, research trends, research trajectories, context-aware systems, cognitive psychology, autonomous systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.