Tell me more?: the effects of mental model soundness on personalizing an intelligent agent
Abstract
What does a user need to know to productively work with an intelligent agent? Intelligent agents and recommender systems are gaining widespread use, potentially creating a need for end users to understand how these systems operate in order to fix their agent's personalized behavior. This paper explores the effects of mental model soundness on such personalization by providing structural knowledge of a music recommender system in an empirical study. Our findings show that participants were able to quickly build sound mental models of the recommender system's reasoning, and that participants who most improved their mental models during the study were significantly more likely to make the recommender operate to their satisfaction. These results suggest that by helping end users understand a system's reasoning, intelligent agents may elicit more and better feedback, thus more closely aligning their output with each user's intentions.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
People decide when to rely on an AI by using their mental models of how the AI tends to behave.
“People decide when to rely on an AI by using their mental models [3, 30], or internal representations, of how the AI tends to behave: when it is most accurate, when it is most likely to fail, etc.”
From Improving Human-AI Collaboration With Descriptions of AI Behavior (2023) · cites this paper as [30]
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003 · see citing works
Self-efficacy: Toward a unifying theory of behavioral change
Bandura, A. (1978) · Advances in Behaviour Research and Therapy · doi:10.1016/0146-6402(78)90002-4 · Cited by 10,586 · see citing works
Johnson-Laird, P. N. (1983) · Cited by 5,190 · see citing works
LaVan, H., & Carley, C. (1984) · Simulation & Games · doi:10.1177/0037550084152005 · Cited by 3,151 · see citing works
Kaplan, B., DeGross, J. I., Wood-Harper, A. T., Wastell, D. G., & Truex, D. P., III (2004) · IFIP International Federation for Information Processing/IFIP · doi:10.1007/b115738 · Cited by 3,136 · see citing works
Explaining collaborative filtering recommendations
Herlocker, J. L., Konstan, J. A., & Riedl, J. (2000) · Proceedings of the 2000 ACM conference on Computer supported cooperative work · doi:10.1145/358916.358995 · Cited by 1,731 · see citing works
Some observations on mental models
Norman, D. A. (1983) · Medical Entomology and Zoology · Cited by 1,549 · see citing works
Application of Social Cognitive Theory to Training for Computer Skills
Compeau, D., & Higgins, C. A. (1995) · Information Systems Research · doi:10.1287/isre.6.2.118 · Cited by 1,503 · see citing works
The General Inquirer: A Computer Approach to Content Analysis
Green, B. F., Stone, P. J., Dunphy, D. C., Smith, M. S., & Ogilvie, D. M. (1967) · American Educational Research Journal · doi:10.2307/1161774 · Cited by 1,013 · see citing works
Hancock, P. A., & Meshkati, N. (1988) · Cited by 954 · see citing works
The General Inquirer: A Computer Approach to Content Analysis.
Hartman, J. J., Stone, P. J., Dunphy, D. C., Smith, M. S., & Ogilvia, D. M. (1967) · American Sociological Review · doi:10.2307/2092070 · Cited by 723 · see citing works
<i>Why and why not</i> explanations improve the intelligibility of context-aware intelligent systems
Lim, B. Y., Dey, A. K., & Avrahami, D. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1519023 · Cited by 552 · see citing works
The role of transparency in recommender systems
Sinha, R. R., & Swearingen, K. (2002) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/506443.506619 · Cited by 480 · see citing works
Interaction Design: Beyond Human-Computer Interaction. Second Edition
Rogers, Y., Sharp, H., & Preece, J. J. (2007) · Wiley eBooks · Cited by 390 · see citing works
Talbot, J., Lee, B., Kapoor, A., & Tan, D. S. (2009) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518895 · Cited by 226 · see citing works
Human model evaluation in interactive supervised learning
Fiebrink, R., Cook, P. R., & Trueman, D. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1978965 · Cited by 207 · see citing works
Interacting meaningfully with machine learning systems: Three experiments
Stumpf, S., Rajaram, V., Li, L., Wong, W.-K., Burnett, M., Dietterich, T., Sullivan, E., & Herlocker, J. (2009) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2009.03.004 · Cited by 184 · see citing works
Self-citationWilfong, J. D. (2004) · Computers in Human Behavior · doi:10.1016/j.chb.2004.03.020 · Cited by 178 · see citing works
Effective explanations of recommendations
Tintarev, N., & Masthoff, J. (2007) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/1297231.1297259 · Cited by 162 · see citing works
Toolkit to support intelligibility in context-aware applications
Lim, B. Y., & Dey, A. K. (2010) · Proceedings of the 12th ACM international conference on Ubiquitous computing · doi:10.1145/1864349.1864353 · Cited by 143 · see citing works
Tullio, J., Dey, A. K., Chalecki, J., & Fogarty, J. A. (2007) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240630 · Cited by 137 · see citing works
Toward harnessing user feedback for machine learning
Stumpf, S., Rajaram, V., Li, L., Burnett, M., Dietterich, T. G., Sullivan, E., Drummond, R., & Herlocker, J. L. (2007) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/1216295.1216316 · Cited by 134 · see citing works
Self-citationInteractive optimization for steering machine classification
Kapoor, A., Lee, B., Tan, D. S., & Horvitz, E. (2010) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753529 · Cited by 133 · see citing works
Explanatory Debugging: Supporting End-User Debugging of Machine-Learned Programs
Kulesza, T., Stumpf, S., Burnett, M., Wong, W.-K., Riche, Y., Moore, T., Oberst, I., Shinsel, A., & McIntosh, K. (2010) · IEEE Symposium on Visual Languages / Human-Centric Computing Languages and Environments · doi:10.1109/vlhcc.2010.15 · Cited by 124 · see citing works
Self-citationFixing the program my computer learned: barriers for end users, challenges for the machine
Kulesza, T., Wong, W.-K., Stumpf, S., Perona, S., White, R., Burnett, M. M., Oberst, I., & Ko, A. J. (2009) · Proceedings of the 14th international conference on Intelligent user interfaces · doi:10.1145/1502650.1502678 · Cited by 83 · see citing works
Self-citationSmalltalk scaffolding: a case study of minimalist instruction
Rosson, M. B., Carrol, J. M., & Bellamy, R. (1990) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/97243.97319 · Cited by 80 · see citing works
Confidence Displays and Training in Recommender Systems.
McNee, S. M., Lam, S. K., Guetzlaff, C., Konstan, J. A., & Riedl, J. (2003) · International Conference on Human-Computer Interaction · Cited by 56 · see citing works
Examining multiple potential models in end-user interactive concept learning
Amershi, S., Fogarty, J. A., Kapoor, A., & Tan, D. S. (2010) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753531 · Cited by 41 · see citing works
The relationship of instrumental and expressive traits with computer anxiety
Bozionelos, N. (2001) · Personality and Individual Differences · doi:10.1016/s0191-8869(00)00198-7 · Cited by 23 · see citing works
Flagged first, then by citations
1 of the 31 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Power to the People: The Role of Humans in Interactive Machine Learning
Amershi, S., Cakmak, M., Knox, W. B., & Kulesza, T. (2014) · AI Magazine · doi:10.1609/aimag.v35i4.2513 · Cited by 1,084 · see citing works
Self-citationAbdul, A., Vermeulen, J., Wang, D., Lim, B. Y., & Kankanhalli, M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174156 · Cited by 743 · see citing works
Working with Machines: The Impact of Algorithmic and Data-Driven Management on Human Workers
Lee, M. K., Kusbit, D., Metsky, E., & Dabbish, L. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702548 · Cited by 823 · see citing works
A Multidisciplinary Survey and Framework for Design and Evaluation of Explainable AI Systems
Mohseni, S., Zarei, N., & Ragan, E. D. (2021) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3387166 · Cited by 785 · see citing works
Principles of Explanatory Debugging to Personalize Interactive Machine Learning
Kulesza, T., Burnett, M., Wong, W.-K., & Stumpf, S. (2015) · Proceedings of the 20th International Conference on Intelligent User Interfaces · doi:10.1145/2678025.2701399 · Cited by 576 · see citing works
Self-citationTrustworthy AI: From Principles to Practices
Li, B., Qi, P., Liu, B., Di, S., Liu, J., Pei, J., Yi, J., & Zhou, B. (2023) · ACM Computing Surveys · doi:10.1145/3555803 · Cited by 612 · see citing works
“This evaluation has been used for the development of, for instance, recommendation systems [198] and data analysis [132].”
MethodKaur, H., Nori, H., Jenkins, S., Caruana, R., Wallach, H., & Wortman Vaughan, J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376219 · Cited by 564 · see citing works
Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance
Bansal, G., Nushi, B., Kamar, E., Lasecki, W. S., Weld, D. S., & Horvitz, E. (2019) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v7i1.5285 · Cited by 466 · see citing works
The Role of Explanations on Trust and Reliance in Clinical Decision Support Systems
Bussone, A., Stumpf, S., & O'Sullivan, D. (2015) · 2015 International Conference on Healthcare Informatics · doi:10.1109/ichi.2015.26 · Cited by 441 · see citing works
Self-citationToo much, too little, or just right? Ways explanations impact end users' mental models
Kulesza, T., Stumpf, S., Burnett, M., Yang, S., Kwan, I., & Wong, W.-K. (2013) · 2013 IEEE Symposium on Visual Languages and Human Centric Computing · doi:10.1109/vlhcc.2013.6645235 · Cited by 388 · see citing works
Self-citationSocial Bias Frames: Reasoning about Social and Power Implications of Language
Sap, M., Gabriel, S., Qin, L., Jurafsky, D., Smith, N. A., & Choi, Y. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.486 · Cited by 375 · see citing works
Updates in Human-AI Teams: Understanding and Addressing the Performance/Compatibility Tradeoff
Bansal, G., Nushi, B., Kamar, E., Weld, D. S., Lasecki, W. S., & Horvitz, E. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33012429 · Cited by 284 · see citing works
The Metacognitive Demands and Opportunities of Generative AI
Tankelevitch, L., Kewenig, V., Simkute, A., Scott, A. E., Sarkar, A., Sellen, A., & Rintel, S. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642902 · Cited by 280 · see citing works
Sokol, K., & Flach, P. A. (2020) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3351095.3372870 · Cited by 278 · see citing works
Bringing Transparency Design into Practice
Eiband, M., Schneider, H., Bilandzic, M., Fazekas-Con, J., Haug, M., & Hussmann, H. (2018) · 23rd International Conference on Intelligent User Interfaces · doi:10.1145/3172944.3172961 · Cited by 250 · see citing works
A Survey of Data-driven and Knowledge-aware eXplainable AI
Li, X.-H., Cao, C. C., Shi, Y., Bai, W., Gao, H., Qiu, L., Wang, C., Gao, Y., Zhang, S., Xue, X., et al. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.2983930 · Cited by 224 · see citing works
The effects of example-based explanations in a machine learning interface
Cai, C. J., Jongejan, J., & Holbrook, J. (2019) · Proceedings of the 24th International Conference on Intelligent User Interfaces · doi:10.1145/3301275.3302289 · Cited by 220 · see citing works
Lai, V., Chen, C., Smith-Renner, A., Liao, Q. V., & Tan, C. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594087 · Cited by 204 · see citing works
Pataranutaporn, P., Liu, R., Finn, E., & Maes, P. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00720-7 · Cited by 208 · see citing works
Sokol, K., & Flach, P. (2020) · KI - Künstliche Intelligenz · doi:10.1007/s13218-020-00637-y · Cited by 186 · see citing works
Zhang, A., Boltz, A., Wang, C. W., & Lee, M. K. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501866 · Cited by 166 · see citing works
Evaluating saliency map explanations for convolutional neural networks: a user study
Alqaraawi, A., Schuessler, M., Weiß, P., Costanza, E., & Berthouze, N. (2020) · Proceedings of the 25th International Conference on Intelligent User Interfaces · doi:10.1145/3377325.3377519 · Cited by 163 · see citing works
Kawakami, A., Sivaraman, V., Cheng, H.-F., Stapleton, L., Cheng, Y., Qing, D., Perer, A., Wu, Z. S., Zhu, H., & Holstein, K. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517439 · Cited by 143 · see citing works
Family as a Third Space for AI Literacies: How do children and parents learn about AI together?
Druga, S., Christoph, F. L., & Ko, A. J. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502031 · Cited by 130 · see citing works
Druga, S., & Ko, A. J. (2021) · ACM International Conference on Interaction Design and Children (IDC) · doi:10.1145/3459990.3460712 · Cited by 129 · see citing works
When fitness trackers don't 'fit'
Yang, R., Shin, E., Newman, M., & Ackerman, M. S. (2015) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2750858.2804269 · Cited by 119 · see citing works
Mental Models of AI Agents in a Cooperative Game Setting
Gero, K. I., Ashktorab, Z., Dugan, C., Pan, Q., Johnson, J., Geyer, W., Ruiz, M., Miller, S., Millen, D. R., Campbell, M., et al. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376316 · Cited by 121 · see citing works
Smith-Renner, A., Fan, R., Birchfield, M., Wu, T., Boyd-Graber, J., Weld, D. S., & Findlater, L. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376624 · Cited by 112 · see citing works
Trials and tribulations of developers of intelligent systems: A field study
Hill, C., Bellamy, R., Erickson, T. D., & Burnett, M. (2016) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2016.7739680 · Cited by 108 · see citing works
Self-citationNguyen, A. T., Kharosekar, A., Krishnan, S., Krishnan, S., Elizabeth, T., Wallace, B., & Lease, M. (2018) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3242587.3242666 · Cited by 109 · see citing works
Anik, A. I., & Bunt, A. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445736 · Cited by 103 · see citing works
Amazon vs. My Brother: How Users of Shared Smart Speakers Perceive and Cope with Privacy Risks
Huang, Y., Obada-Obieh, B., & Beznosov, K. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376529 · Cited by 96 · see citing works
Fairness and Transparency in Recommendation: The Users’ Perspective
Sonboli, N., Smith, J. J., Berenfus, F. C., Burke, R., & Fiesler, C. L. (2021) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3450613.3456835 · Cited by 88 · see citing works
Improving Human-AI Collaboration With Descriptions of AI Behavior
Cabrera, Á. A., Perer, A., & Hong, J. I. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579612 · Cited by 87 · see citing works
“People decide when to rely on an AI by using their mental models [3, 30], or internal representations, of how the AI tends to behave: when it is most accurate, when it is most likely to fail, etc.”
BackgroundOh, C., Lee, T., Kim, Y., Park, S., Kwon, S., & Suh, B. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025539 · Cited by 85 · see citing works
Exploring Mental Models for Transparent and Controllable Recommender Systems: A Qualitative Study
Ngo, T., Kunkel, J., & Ziegler, J. (2020) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3340631.3394841 · Cited by 83 · see citing works
Toward involving end-users in interactive human-in-the-loop AI fairness
Nakao, Y., Stumpf, S., Ahmed, S., Naseer, A., & Strappelli, L. (2022) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3514258 · Cited by 69 · see citing works
Self-citationA Survey of Evaluation Methods and Measures for Interpretable Machine LearningPreprint
Mohseni, S., Zarei, N., & Ragan, E. D. (2018) · arXiv (Cornell University) · Cited by 69 · see citing works
Verbalization: narration of autonomous robot experience
Rosenthal, S. L., Selvaraj, S. P. P., & Veloso, M. (2016) · International Joint Conference on Artificial Intelligence · Cited by 65 · see citing works
The quest of parsimonious XAI: A human-agent architecture for explanation formulation
Mualla, Y., Tchappi, I., Kampik, T., Najjar, A., Calvaresi, D., Abbas‐Turki, A., Galland, S., & Nicolle, C. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103573 · Cited by 61 · see citing works
Automation bias in public administration – an interdisciplinary perspective from law and psychology
Ruschemeier, H., & Hondrich, L. J. (2024) · Government Information Quarterly · doi:10.1016/j.giq.2024.101953 · Cited by 59 · see citing works
Do explanations make VQA models more predictable to a human?
Chandrasekaran, A., Prabhu, V., Yadav, D., Chattopadhyay, P., & Parikh, D. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1128 · Cited by 59 · see citing works
Ma, S., Wang, X., Lei, Y., Shi, C., Yin, M., & Ma, X. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642671 · Cited by 65 · see citing works
On Being Told How We Feel: How Algorithmic Sensor Feedback Influences Emotion Perception
Hollis, V., Pekurovsky, A., Wu, E., & Whittaker, S. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3264924 · Cited by 52 · see citing works
Eliciting good teaching from humans for machine learners
Çakmak, M., & Thomaz, A. L. (2014) · Artificial Intelligence · doi:10.1016/j.artint.2014.08.005 · Cited by 52 · see citing works
Nakao, Y., Strappelli, L., Stumpf, S., Naseer, A., Regoli, D., & Gamba, G. D. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2067936 · Cited by 55 · see citing works
Self-citationChatrEx: Designing Explainable Chatbot Interfaces for Enhancing Usefulness, Transparency, and Trust
Khurana, A., Harjandi, P. A., & Chilana, P. K. (2021) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vl/hcc51201.2021.9576440 · Cited by 49 · see citing works
Naveed, S., Stevens, G., & Robin-Kern, D. (2024) · Applied Sciences · doi:10.3390/app142311288 · Cited by 54 · see citing works
Is Conversational XAI All You Need? Human-AI Decision Making With a Conversational XAI Assistant
He, G., Aishwarya, N., & Gadiraju, U. (2025) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3708359.3712133 · Cited by 53 · see citing works
Designing for effective end-user interaction with machine learning
Amershi, S. (2011) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2046396.2046416 · Cited by 46 · see citing works
Exploring the Use of Personalized AI for Identifying Misinformation on Social Media
Jahanbakhsh, F., Katsis, Y., Wang, D., Popa, L., & Muller, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581219 · Cited by 42 · see citing works
Evaluating Explanation Without Ground Truth in Interpretable Machine LearningPreprint
Yang, F., Du, M., & Hu, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.06831 · Cited by 59 · see citing works
Salimzadeh, S., He, G., & Gadiraju, U. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641905 · Cited by 41 · see citing works
“In addition, the attributes of AI systems can enhance decision-making outcomes [68], which include aspects such as predictions generated by AI [66, 76, 99], information about AI predictions or AI systems themselves [13, 70, 118, 136], and interventions that impact cognitive processes [65, 99, 105].”
Background“As an AI language model, I cannot”: Investigating LLM Denials of User Requests
Wester, J., Schrills, T., Pohl, H., & van Berkel, N. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642135 · Cited by 40 · see citing works
Dark Patterns of Explainability, Transparency, and User Control for Intelligent Systems.
Chromik, M., Eiband, M., Völkel, S. T., & Buschek, D. (2019) · IUI Workshops · Cited by 42 · see citing works
van Berkel, N., Bellio, M., Skov, M. B., & BLANDFORD, A. E. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3571815 · Cited by 37 · see citing works
Outlining the Design Space of Explainable Intelligent Systems for Medical DiagnosisPreprint
Xie, Y., Gao, G., & Chen, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.06019 · Cited by 47 · see citing works
Caterson, J., Lewin, A., & Williamson, E. (2024) · Digital Health · doi:10.1177/20552076241272657 · Cited by 40 · see citing works
Exploring the Design Space of User-System Communication for Smart-home Routine Assistants
Chiang, Y.-S., Chang, R.-C., Chuang, Y.-L., Chou, S.-Y., Lee, H.-P., Lin, I.-J., Chen, J.-H. J., & Chang, Y.-J. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376501 · Cited by 35 · see citing works
Dynamic generation and refinement of robot verbalization
Perera, V., Selveraj, S. P., Rosenthal, S. L., & Veloso, M. (2016) · IEEE RO-MAN · doi:10.1109/roman.2016.7745133 · Cited by 34 · see citing works
Generative AI in Creative Practice: ML-Artist Folk Theories of T2I Use, Harm, and Harm-Reduction
Shelby, R., Rismani, S., & Rostamzadeh, N. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642461 · Cited by 33 · see citing works
Toward User-Driven Sound Recognizer Personalization with People Who Are d/Deaf or Hard of Hearing
Goodman, S. M., Liu, P., Jain, D., McDonnell, E. J., Froehlich, J. E., & Findlater, L. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3463501 · Cited by 33 · see citing works
Designing Interactive Transfer Learning Tools for ML Non-Experts
Mishra, S., & Rzeszotarski, J. M. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445096 · Cited by 32 · see citing works
User Characteristics in Explainable AI: The Rabbit Hole of Personalization?
Nimmo, R., Constantinides, M., Zhou, K., Quercia, D., & Stumpf, S. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642352 · Cited by 32 · see citing works
Self-citationKim, D.-J., & Lim, Y.-K. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300714 · Cited by 30 · see citing works
How to Support Users in Understanding Intelligent Systems? Structuring the Discussion
Eiband, M., Buschek, D., & Hußmann, H. (2021) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3397481.3450694 · Cited by 31 · see citing works
Dodge, J. E., Penney, S., Hilderbrand, C., Anderson, A. W., & Burnett, M. (2018) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174136 · Cited by 31 · see citing works
Self-citationTowards explainable multi-objective probabilistic planning
Sukkerd, R., Simmons, R., & Garlan, D. (2018) · Proceedings of the 4th International Workshop on Software Engineering for Smart Cyber-Physical Systems · doi:10.1145/3196478.3196488 · Cited by 27 · see citing works
Pradeep, P., Caro-Martínez, M., & Wijekoon, A. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124733 · Cited by 28 · see citing works
Carroll, J. M., & Rosson, M. B. (2014) · Chapman & Hall/CRC eBooks · doi:10.1201/9780429171529-125 · Cited by 30 · see citing works
Explainable Recommendations in Intelligent Systems: Delivery Methods, Modalities and Risks
Naiseh, M., Jiang, N., Ma, J., & Ali, R. (2020) · Lecture Notes in Business Information Processing · doi:10.1007/978-3-030-50316-1_13 · Cited by 27 · see citing works
From ”Explainable AI” to ”Graspable AI”
Ghajargar, M., Bardzell, J., Smith-Renner, A., Krogh, P. G., Höök, K., Cuartielles, D. J., Boer, L., & Wiberg, M. (2021) · International Conference on Tangible, Embedded, and Embodied Interaction (TEI) · doi:10.1145/3430524.3442704 · Cited by 27 · see citing works
Toward Foraging for Understanding of StarCraft Agents
Penney, S., Dodge, J. E., Hilderbrand, C., Anderson, A. W., Simpson, L., & Burnett, M. (2018) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3172944.3172946 · Cited by 30 · see citing works
Self-citationVillareale, J., Harteveld, C., & Zhu, J. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3549482 · Cited by 26 · see citing works
Capturing Humans’ Mental Models of AI: An Item Response Theory Approach
Kelly, M., Kumar, A., Smyth, P., & Steyvers, M. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594111 · Cited by 26 · see citing works
Enabling Data-Driven API Design with Community Usage Data: A Need-Finding Study
Zhang, T., Hartmann, B., Kim, M., & Glassman, E. L. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376382 · Cited by 25 · see citing works
Tenhundfeld, N. L., Barr, H. M., O’Hear, E. H., & Weger, K. (2021) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2021.3107493 · Cited by 26 · see citing works
Exploring the Role of Local and Global Explanations in Recommender Systems
Radensky, M., Downey, D., Lo, K., Popović, Z., & Weld, D. S. (2022) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3491101.3519795 · Cited by 27 · see citing works
Warshaw, J., Taft, N., & Woodruff, A. (2016) · Symposium On Usable Privacy and Security · Cited by 22 · see citing works
A Clinical Decision Support System for the Prediction of Quality of Life in ALS
Antoniadi, A. M., Galvin, M., Heverin, M., Wei, L., Hardiman, O. M., & Mooney, C. (2022) · Journal of Personalized Medicine · doi:10.3390/jpm12030435 · Cited by 21 · see citing works
I Don’t Know, Is AI Also Used in Airbags?
Alizadeh, F., Stevens, G., & Esau, M. (2021) · i-com · doi:10.1515/icom-2021-0009 · Cited by 22 · see citing works
Tangible Explainable AI - an Initial Conceptual Framework
Colley, A., Väänänen, K., & Häkkilä, J. (2022) · International Conference on Mobile and Ubiquitous Multimedia (MUM) · doi:10.1145/3568444.3568456 · Cited by 20 · see citing works
Crowdsourcing and Evaluating Concept-driven Explanations of Machine Learning Models
Mishra, S., & Rzeszotarski, J. M. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449213 · Cited by 20 · see citing works
A Scoping Review of Mental Model Research in HCI from 2010 to 2021
Hu, X., & Twidale, M. B. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-48038-6_7 · Cited by 19 · see citing works
Understanding and Supporting Knowledge Decomposition for Machine Teaching
Ng, F., Suh, J., & Ramos, G. (2020) · Designing Interactive Systems Conference · doi:10.1145/3357236.3395454 · Cited by 19 · see citing works
Building Appropriate Mental Models: What Users Know and Want to Know about an Agentic AI Chatbot
Brachman, M., Kunde, S., Miller, S., Fucs, A., Dempsey, S., Jabbour, J., & Geyer, W. (2025) · Proceedings of the 30th International Conference on Intelligent User Interfaces · doi:10.1145/3708359.3712071 · Cited by 18 · see citing works
Color for Characters - Effects of Visual Explanations of AI on Trust and Observability
Schrills, T., & Franke, T. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-50334-5_8 · Cited by 17 · see citing works
Measuring User Experience Inclusivity in Human-AI Interaction via Five User Problem-Solving Styles
Anderson, A. W., Guevara, J. N., Moussaoui, F., Li, T., Vorvoreanu, M., & Burnett, M. (2024) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3663740 · Cited by 17 · see citing works
Self-citationGhai, B., Liao, Q. V., Zhang, Y., Bellamy, R., & Mueller, K. D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.09219 · Cited by 17 · see citing works
Kim, B. H., Koh, S., Huh, S., Jo, S., & Choi, S. (2020) · IEEE Access · doi:10.1109/access.2020.3032056 · Cited by 18 · see citing works
Investigating the intelligibility of a computer vision system for blind users
Ahmed, S., Balasubramanian, H., Stumpf, S., Morrison, C. P., Sellen, A. J., & Grayson, M. (2020) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3377325.3377508 · Cited by 17 · see citing works
Self-citationDoes the User Have A Theory of the Recommender? A Grounded Theory Study
Ghori, M. M., Dehpanah, A., Gemmell, J. F., Qahri‐Saremi, H., & Mobasher, B. (2022) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3511047.3537680 · Cited by 16 · see citing works
Buschek, D., Eiband, M., & Hußmann, H. (2022) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3519264 · Cited by 15 · see citing works
Preferences for AI Explanations Based on Cognitive Style and Socio-Cultural Factors
Kopecka, H., Such, J. M., & Flucke, G. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637386 · Cited by 15 · see citing works
Trust in the Danger Zone: Individual Differences in Confidence in Robot Threat Assessments
Lin, J., Panganiban, A. R., Matthews, G., Gibbins, K. M., Ankeney, E., See, C., Bailey, R., & Long, M. D. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.601523 · Cited by 15 · see citing works
How Prevalent Is Gender Bias in ChatGPT? - Exploring German and English ChatGPT Responses
Urchs, S., Thurner, V., Aßenmacher, M., Heumann, C., & Thiemichen, S. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-74630-7_20 · Cited by 24 · see citing works
Keeping it "organized and logical"
Mai, T., Khanna, R., Dodge, J. E., Irvine, J., Lam, K.-H., Lin, Z., Kiddle, N. G., Newman, E., Raja, S., Matthews, C., et al. (2020) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3377325.3377525 · Cited by 14 · see citing works
Self-citationOoge, J., Dereu, L., & Verbert, K. (2023) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3581641.3584046 · Cited by 17 · see citing works
Vitharana, P., Zahedi, F., & Jain, H. K. (2016) · Journal of the AIS · doi:10.17705/1jais.00444 · Cited by 23 · see citing works
Exploring Tangible Algorithmic Imaginaries in Movie Recommendations
Alvarado, O., Abeele, V. V., Geerts, D., Gutiérrez, F., & Verbert, K. (2021) · International Conference on Tangible, Embedded, and Embodied Interaction (TEI) · doi:10.1145/3430524.3440631 · Cited by 14 · see citing works
- Authors
- Kulesza, T., Stumpf, S., Burnett, M., & Kwan, I.
- Affiliations
- Oregon State University (US)
- City, University of London (GB)
- Venue
- Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2012-05-05
- Pages
- 1-10
- OpenAlex
- W2168747479
- Cited by
- 225
- References
- 31
- Citations by year
- 2026: 14 · 2025: 25 · 2024: 22 · 2023: 25 · 2022: 24 · 2021: 24 · 2020: 35 · 2019: 16 · 2018: 14 · 2017: 6 · 2016: 9 · 2015: 5 · 2014: 3 · 2013: 1 · 2012: 1
- FWCI
- 2.52
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- City Research Online (City University London) (acceptedVersion)
- ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) (submittedVersion)
- Funders
- National Science Foundation (0803487)
- Topics
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Keywords
- mental models, intelligent agents, recommender systems, music recommendation, personalization, user satisfaction, system transparency
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review