Cited by 225Recommender Systems and TechniquesUsability and User Interface DesignInformation Retrieval and Search Behavior

The DOI matches its Crossref record; 30 of the 31 references it cites were found in a registry or an index.

Tell me more?: the effects of mental model soundness on personalizing an intelligent agent

Kulesza, Todd, Stumpf, Simone, Burnett, Margaret, Kwan, Irwin·2012·Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

DOI 10.1145/2207676.2207678

Open this paper in CoChat — free account

Abstract

What does a user need to know to productively work with an intelligent agent? Intelligent agents and recommender systems are gaining widespread use, potentially creating a need for end users to understand how these systems operate in order to fix their agent's personalized behavior. This paper explores the effects of mental model soundness on such personalization by providing structural knowledge of a music recommender system in an empirical study. Our findings show that participants were able to quickly build sound mental models of the recommender system's reasoning, and that participants who most improved their mental models during the study were significantly more likely to make the recommender operate to their satisfaction. These results suggest that by helping end users understand a system's reasoning, intelligent agents may elicit more and better feedback, thus more closely aligning their output with each user's intentions.

Integrity signals

Registry

Crossref · 10.1145/2207676.2207678

Cites

30 of 30 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
Self-efficacy: Toward a unifying theory of behavioral change
Bandura, A. (1978) · Advances in Behaviour Research and Therapy · doi:10.1016/0146-6402(78)90002-4 · Cited by 10,586
Mental Models
Johnson-Laird, P. N. (1983) · Cited by 5,190
Mental models : Towards a cognitive science of language, inference, and consciousness. By Philip N. Johnson-Laird (Cognitive science series, 6.) Cambridge, MA: Harvard University Press, 1983. Pp. 528. $25.00.
Ford, M. (1985) · Language · doi:10.2307/414498 · Cited by 4,419
Experiential Learning
LaVan, H., & Carley, C. (1984) · Simulation & Games · doi:10.1177/0037550084152005 · Cited by 3,151
Information Systems Research
Kaplan, B., DeGross, J. I., Wood-Harper, A. T., Wastell, D. G., & Truex, D. P., III (2004) · IFIP International Federation for Information Processing/IFIP · doi:10.1007/b115738 · Cited by 3,139
Explaining collaborative filtering recommendations
Herlocker, J. L., Konstan, J. A., & Riedl, J. (2000) · Proceedings of the 2000 ACM conference on Computer supported cooperative work · doi:10.1145/358916.358995 · Cited by 1,731
Some observations on mental models
Norman, D. A. (1983) · Medical Entomology and Zoology · Cited by 1,549
Application of Social Cognitive Theory to Training for Computer Skills
Compeau, D., & Higgins, C. A. (1995) · Information Systems Research · doi:10.1287/isre.6.2.118 · Cited by 1,503
The General Inquirer: A Computer Approach to Content Analysis
Green, B. F., Stone, P. J., Dunphy, D. C., Smith, M. S., & Ogilvie, D. M. (1967) · American Educational Research Journal · doi:10.2307/1161774 · Cited by 1,013

Show all 31 references

Research works printed but not linked: 1

Benedek , J. and Miner , T . Measuring desirability: New methods for evaluating desirability in a usability lab setting . In Proc. Usability Professionals Association International Conference ( 2002 ). Benedek, J. and Miner, T. Measuring desirability: New methods for evaluating desirability in a usability lab setting. In Proc. Usability Professionals Association International Conference (2002).

Sorted by citations

Power to the People: The Role of Humans in Interactive Machine Learning
Amershi, S., Cakmak, M., Knox, W. B., & Kulesza, T. (2014) · AI Magazine · doi:10.1609/aimag.v35i4.2513 · Cited by 1,084
Self-citation
Trends and Trajectories for Explainable, Accountable and Intelligible Systems: An HCI Research Agenda
Abdul, A., Vermeulen, J., Wang, D., Lim, B. Y., & Kankanhalli, M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174156 · Cited by 743
Working with Machines: The Impact of Algorithmic and Data-Driven Management on Human Workers
Lee, M. K., Kusbit, D., Metsky, E., & Dabbish, L. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702548 · Cited by 823
A Multidisciplinary Survey and Framework for Design and Evaluation of Explainable AI Systems
Mohseni, S., Zarei, N., & Ragan, E. D. (2021) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3387166 · Cited by 785
Principles of Explanatory Debugging to Personalize Interactive Machine Learning
Kulesza, T., Burnett, M., Wong, W.-K., & Stumpf, S. (2015) · Proceedings of the 20th International Conference on Intelligent User Interfaces · doi:10.1145/2678025.2701399 · Cited by 576
Self-citation
Trustworthy AI: From Principles to Practices
Li, B., Qi, P., Liu, B., Di, S., Liu, J., Pei, J., Yi, J., & Zhou, B. (2023) · ACM Computing Surveys · doi:10.1145/3555803 · Cited by 612
“This evaluation has been used for the development of, for instance, recommendation systems [198] and data analysis [132].”
Method
Interpreting Interpretability: Understanding Data Scientists' Use of Interpretability Tools for Machine Learning
Kaur, H., Nori, H., Jenkins, S., Caruana, R., Wallach, H., & Wortman Vaughan, J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376219 · Cited by 564
Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance
Bansal, G., Nushi, B., Kamar, E., Lasecki, W. S., Weld, D. S., & Horvitz, E. (2019) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v7i1.5285 · Cited by 466
The Role of Explanations on Trust and Reliance in Clinical Decision Support Systems
Bussone, A., Stumpf, S., & O'Sullivan, D. (2015) · 2015 International Conference on Healthcare Informatics · doi:10.1109/ichi.2015.26 · Cited by 441
Self-citation
Too much, too little, or just right? Ways explanations impact end users' mental models
Kulesza, T., Stumpf, S., Burnett, M., Yang, S., Kwan, I., & Wong, W.-K. (2013) · 2013 IEEE Symposium on Visual Languages and Human Centric Computing · doi:10.1109/vlhcc.2013.6645235 · Cited by 388
Self-citation
Social Bias Frames: Reasoning about Social and Power Implications of Language
Sap, M., Gabriel, S., Qin, L., Jurafsky, D., Smith, N. A., & Choi, Y. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.486 · Cited by 375
Updates in Human-AI Teams: Understanding and Addressing the Performance/Compatibility Tradeoff
Bansal, G., Nushi, B., Kamar, E., Weld, D. S., Lasecki, W. S., & Horvitz, E. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33012429 · Cited by 284
The Metacognitive Demands and Opportunities of Generative AI
Tankelevitch, L., Kewenig, V., Simkute, A., Scott, A. E., Sarkar, A., Sellen, A., & Rintel, S. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642902 · Cited by 493
Explainability fact sheets
Sokol, K., & Flach, P. A. (2020) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3351095.3372870 · Cited by 278
Bringing Transparency Design into Practice
Eiband, M., Schneider, H., Bilandzic, M., Fazekas-Con, J., Haug, M., & Hussmann, H. (2018) · 23rd International Conference on Intelligent User Interfaces · doi:10.1145/3172944.3172961 · Cited by 250
A Survey of Data-driven and Knowledge-aware eXplainable AI
Li, X.-H., Cao, C. C., Shi, Y., Bai, W., Gao, H., Qiu, L., Wang, C., Gao, Y., Zhang, S., Xue, X., et al. (2020) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.2983930 · Cited by 224
The effects of example-based explanations in a machine learning interface
Cai, C. J., Jongejan, J., & Holbrook, J. (2019) · Proceedings of the 24th International Conference on Intelligent User Interfaces · doi:10.1145/3301275.3302289 · Cited by 220
Towards a Science of Human-AI Decision Making: An Overview of Design Space in Empirical Human-Subject Studies
Lai, V., Chen, C., Smith-Renner, A., Liao, Q. V., & Tan, C. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594087 · Cited by 204
Influencing human–AI interaction by priming beliefs about AI can increase perceived trustworthiness, empathy and effectiveness
Pataranutaporn, P., Liu, R., Finn, E., & Maes, P. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00720-7 · Cited by 192
One Explanation Does Not Fit All: The Promise of Interactive Explanations for Machine Learning Transparency
Sokol, K., & Flach, P. (2020) · KI - Künstliche Intelligenz · doi:10.1007/s13218-020-00637-y · Cited by 186
Algorithmic Management Reimagined For Workers and By Workers: Centering Worker Well-Being in Gig Work
Zhang, A., Boltz, A., Wang, C. W., & Lee, M. K. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501866 · Cited by 166
Evaluating saliency map explanations for convolutional neural networks: a user study
Alqaraawi, A., Schuessler, M., Weiß, P., Costanza, E., & Berthouze, N. (2020) · Proceedings of the 25th International Conference on Intelligent User Interfaces · doi:10.1145/3377325.3377519 · Cited by 163
Improving Human-AI Partnerships in Child Welfare: Understanding Worker Practices, Challenges, and Desires for Algorithmic Decision Support
Kawakami, A., Sivaraman, V., Cheng, H.-F., Stapleton, L., Cheng, Y., Qing, D., Perer, A., Wu, Z. S., Zhu, H., & Holstein, K. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517439 · Cited by 143
Family as a Third Space for AI Literacies: How do children and parents learn about AI together?
Druga, S., Christoph, F. L., & Ko, A. J. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502031 · Cited by 130
How do children’s perceptions of machine intelligence change when training and coding smart programs?
Druga, S., & Ko, A. J. (2021) · ACM International Conference on Interaction Design and Children (IDC) · doi:10.1145/3459990.3460712 · Cited by 136
When fitness trackers don't 'fit'
Yang, R., Shin, E., Newman, M., & Ackerman, M. S. (2015) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/2750858.2804269 · Cited by 119
Mental Models of AI Agents in a Cooperative Game Setting
Gero, K. I., Ashktorab, Z., Dugan, C., Pan, Q., Johnson, J., Geyer, W., Ruiz, M., Miller, S., Millen, D. R., Campbell, M., et al. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376316 · Cited by 121
No Explainability without Accountability: An Empirical Study of Explanations and Feedback in Interactive ML
Smith-Renner, A., Fan, R., Birchfield, M., Wu, T., Boyd-Graber, J., Weld, D. S., & Findlater, L. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376624 · Cited by 112
Trials and tribulations of developers of intelligent systems: A field study
Hill, C., Bellamy, R., Erickson, T. D., & Burnett, M. (2016) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2016.7739680 · Cited by 115
Self-citation
Believe it or not
Nguyen, A. T., Kharosekar, A., Krishnan, S., Krishnan, S., Elizabeth, T., Wallace, B., & Lease, M. (2018) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3242587.3242666 · Cited by 124
Data-Centric Explanations: Explaining Training Data of Machine Learning Systems to Promote Transparency
Anik, A. I., & Bunt, A. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445736 · Cited by 103
Amazon vs. My Brother: How Users of Shared Smart Speakers Perceive and Cope with Privacy Risks
Huang, Y., Obada-Obieh, B., & Beznosov, K. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376529 · Cited by 96
Fairness and Transparency in Recommendation: The Users’ Perspective
Sonboli, N., Smith, J. J., Berenfus, F. C., Burke, R., & Fiesler, C. L. (2021) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3450613.3456835 · Cited by 94
Improving Human-AI Collaboration With Descriptions of AI Behavior
Cabrera, Á. A., Perer, A., & Hong, J. I. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579612 · Cited by 87
“People decide when to rely on an AI by using their mental models [3, 30], or internal representations, of how the AI tends to behave: when it is most accurate, when it is most likely to fail, etc.”
Background
Us vs. Them
Oh, C., Lee, T., Kim, Y., Park, S., Kwon, S., & Suh, B. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025539 · Cited by 98
Exploring Mental Models for Transparent and Controllable Recommender Systems: A Qualitative Study
Ngo, T., Kunkel, J., & Ziegler, J. (2020) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3340631.3394841 · Cited by 94
Toward involving end-users in interactive human-in-the-loop AI fairness
Nakao, Y., Stumpf, S., Ahmed, S., Naseer, A., & Strappelli, L. (2022) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3514258 · Cited by 69
Self-citation
A Survey of Evaluation Methods and Measures for Interpretable Machine LearningPreprint
Mohseni, S., Zarei, N., & Ragan, E. D. (2018) · arXiv (Cornell University) · Cited by 69
Verbalization: narration of autonomous robot experience
Rosenthal, S. L., Selvaraj, S. P. P., & Veloso, M. (2016) · International Joint Conference on Artificial Intelligence · Cited by 65
The quest of parsimonious XAI: A human-agent architecture for explanation formulation
Mualla, Y., Tchappi, I., Kampik, T., Najjar, A., Calvaresi, D., Abbas‐Turki, A., Galland, S., & Nicolle, C. (2021) · Artificial Intelligence · doi:10.1016/j.artint.2021.103573 · Cited by 61
Automation bias in public administration – an interdisciplinary perspective from law and psychology
Ruschemeier, H., & Hondrich, L. J. (2024) · Government Information Quarterly · doi:10.1016/j.giq.2024.101953 · Cited by 59
Do explanations make VQA models more predictable to a human?
Chandrasekaran, A., Prabhu, V., Yadav, D., Chattopadhyay, P., & Parikh, D. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1128 · Cited by 67
“Are You Really Sure?” Understanding the Effects of Human Self-Confidence Calibration in AI-Assisted Decision Making
Ma, S., Wang, X., Lei, Y., Shi, C., Yin, M., & Ma, X. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642671 · Cited by 92
On Being Told How We Feel: How Algorithmic Sensor Feedback Influences Emotion Perception
Hollis, V., Pekurovsky, A., Wu, E., & Whittaker, S. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3264924 · Cited by 52
Eliciting good teaching from humans for machine learners
Çakmak, M., & Thomaz, A. L. (2014) · Artificial Intelligence · doi:10.1016/j.artint.2014.08.005 · Cited by 52
Towards Responsible AI: A Design Space Exploration of Human-Centered Artificial Intelligence User Interfaces to Investigate Fairness
Nakao, Y., Strappelli, L., Stumpf, S., Naseer, A., Regoli, D., & Gamba, G. D. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2067936 · Cited by 66
Self-citation
ChatrEx: Designing Explainable Chatbot Interfaces for Enhancing Usefulness, Transparency, and Trust
Khurana, A., Harjandi, P. A., & Chilana, P. K. (2021) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vl/hcc51201.2021.9576440 · Cited by 54
An Overview of the Empirical Evaluation of Explainable AI (XAI): A Comprehensive Guideline for User-Centered Evaluation in XAI
Naveed, S., Stevens, G., & Robin-Kern, D. (2024) · Applied Sciences · doi:10.3390/app142311288 · Cited by 67
Is Conversational XAI All You Need? Human-AI Decision Making With a Conversational XAI Assistant
He, G., Aishwarya, N., & Gadiraju, U. (2025) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3708359.3712133 · Cited by 87
Designing for effective end-user interaction with machine learning
Amershi, S. (2011) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2046396.2046416 · Cited by 49
Exploring the Use of Personalized AI for Identifying Misinformation on Social Media
Jahanbakhsh, F., Katsis, Y., Wang, D., Popa, L., & Muller, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581219 · Cited by 42
Evaluating Explanation Without Ground Truth in Interpretable Machine LearningPreprint
Yang, F., Du, M., & Hu, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.06831 · Cited by 83
Dealing with Uncertainty: Understanding the Impact of Prognostic Versus Diagnostic Tasks on Trust and Reliance in Human-AI Decision Making
Salimzadeh, S., He, G., & Gadiraju, U. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3641905 · Cited by 41
“In addition, the attributes of AI systems can enhance decision-making outcomes [68], which include aspects such as predictions generated by AI [66, 76, 99], information about AI predictions or AI systems themselves [13, 70, 118, 136], and interventions that impact cognitive processes [65, 99, 105].”
Background
“As an AI language model, I cannot”: Investigating LLM Denials of User Requests
Wester, J., Schrills, T., Pohl, H., & van Berkel, N. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642135 · Cited by 59
Dark Patterns of Explainability, Transparency, and User Control for Intelligent Systems.
Chromik, M., Eiband, M., Völkel, S. T., & Buschek, D. (2019) · IUI Workshops · Cited by 42
Measurements, Algorithms, and Presentations of Reality: Framing Interactions with AI-Enabled Decision Support
van Berkel, N., Bellio, M., Skov, M. B., & BLANDFORD, A. E. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3571815 · Cited by 42
Outlining the Design Space of Explainable Intelligent Systems for Medical DiagnosisPreprint
Xie, Y., Gao, G., & Chen, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.06019 · Cited by 47
The application of explainable artificial intelligence (XAI) in electronic health record research: A scoping review
Caterson, J., Lewin, A., & Williamson, E. (2024) · Digital Health · doi:10.1177/20552076241272657 · Cited by 40
Exploring the Design Space of User-System Communication for Smart-home Routine Assistants
Chiang, Y.-S., Chang, R.-C., Chuang, Y.-L., Chou, S.-Y., Lee, H.-P., Lin, I.-J., Chen, J.-H. J., & Chang, Y.-J. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376501 · Cited by 37
Dynamic generation and refinement of robot verbalization
Perera, V., Selveraj, S. P., Rosenthal, S. L., & Veloso, M. (2016) · IEEE RO-MAN · doi:10.1109/roman.2016.7745133 · Cited by 34
Generative AI in Creative Practice: ML-Artist Folk Theories of T2I Use, Harm, and Harm-Reduction
Shelby, R., Rismani, S., & Rostamzadeh, N. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642461 · Cited by 33
Toward User-Driven Sound Recognizer Personalization with People Who Are d/Deaf or Hard of Hearing
Goodman, S. M., Liu, P., Jain, D., McDonnell, E. J., Froehlich, J. E., & Findlater, L. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3463501 · Cited by 33
Designing Interactive Transfer Learning Tools for ML Non-Experts
Mishra, S., & Rzeszotarski, J. M. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445096 · Cited by 34
User Characteristics in Explainable AI: The Rabbit Hole of Personalization?
Nimmo, R., Constantinides, M., Zhou, K., Quercia, D., & Stumpf, S. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642352 · Cited by 39
Self-citation
Co-Performing Agent
Kim, D.-J., & Lim, Y.-K. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300714 · Cited by 30
How to Support Users in Understanding Intelligent Systems? Structuring the Discussion
Eiband, M., Buschek, D., & Hußmann, H. (2021) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3397481.3450694 · Cited by 34
How the Experts Do It
Dodge, J. E., Penney, S., Hilderbrand, C., Anderson, A. W., & Burnett, M. (2018) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174136 · Cited by 32
Self-citation
Towards explainable multi-objective probabilistic planning
Sukkerd, R., Simmons, R., & Garlan, D. (2018) · Proceedings of the 4th International Workshop on Software Engineering for Smart Cyber-Physical Systems · doi:10.1145/3196478.3196488 · Cited by 27
A practical exploration of the convergence of Case-Based Reasoning and Explainable Artificial Intelligence
Pradeep, P., Caro-Martínez, M., & Wijekoon, A. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124733 · Cited by 28
Usability Engineering
Carroll, J. M., & Rosson, M. B. (2014) · Chapman & Hall/CRC eBooks · doi:10.1201/9780429171529-125 · Cited by 30
Explainable Recommendations in Intelligent Systems: Delivery Methods, Modalities and Risks
Naiseh, M., Jiang, N., Ma, J., & Ali, R. (2020) · Lecture Notes in Business Information Processing · doi:10.1007/978-3-030-50316-1_13 · Cited by 27
From ”Explainable AI” to ”Graspable AI”
Ghajargar, M., Bardzell, J., Smith-Renner, A., Krogh, P. G., Höök, K., Cuartielles, D. J., Boer, L., & Wiberg, M. (2021) · International Conference on Tangible, Embedded, and Embodied Interaction (TEI) · doi:10.1145/3430524.3442704 · Cited by 29
Toward Foraging for Understanding of StarCraft Agents
Penney, S., Dodge, J. E., Hilderbrand, C., Anderson, A. W., Simpson, L., & Burnett, M. (2018) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3172944.3172946 · Cited by 32
Self-citation
Trusting AI: does uncertainty visualization affect decision-making?
Reyes, J., Batmaz, A. U., & Kersten-Oertel, M. (2025) · Frontiers in Computer Science · doi:10.3389/fcomp.2025.1464348 · Cited by 27
"I Want To See How Smart This AI Really Is": Player Mental Model Development of an Adversarial AI Player
Villareale, J., Harteveld, C., & Zhu, J. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3549482 · Cited by 30
Capturing Humans’ Mental Models of AI: An Item Response Theory Approach
Kelly, M., Kumar, A., Smyth, P., & Mark Steyvers, B. (2023) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3593013.3594111 · Cited by 42
Enabling Data-Driven API Design with Community Usage Data: A Need-Finding Study
Zhang, T., Hartmann, B., Kim, M., & Glassman, E. L. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376382 · Cited by 25
Is My Siri the Same as Your Siri? An Exploration of Users’ Mental Model of Virtual Personal Assistants, Implications for Trust
Tenhundfeld, N. L., Barr, H. M., O’Hear, E. H., & Weger, K. (2021) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2021.3107493 · Cited by 27
Exploring the Role of Local and Global Explanations in Recommender Systems
Radensky, M., Downey, D., Lo, K., Popović, Z., & Weld, D. S. (2022) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3491101.3519795 · Cited by 29
Intuitions, Analytics, and Killing Ants: Inference Literacy of High School-educated Adults in the {US}
Warshaw, J., Taft, N., & Woodruff, A. (2016) · Symposium On Usable Privacy and Security · Cited by 22
A Clinical Decision Support System for the Prediction of Quality of Life in ALS
Antoniadi, A. M., Galvin, M., Heverin, M., Wei, L., Hardiman, O. M., & Mooney, C. (2022) · Journal of Personalized Medicine · doi:10.3390/jpm12030435 · Cited by 23
I Don’t Know, Is AI Also Used in Airbags?
Alizadeh, F., Stevens, G., & Esau, M. (2021) · i-com · doi:10.1515/icom-2021-0009 · Cited by 22
Tangible Explainable AI - an Initial Conceptual Framework
Colley, A., Väänänen, K., & Häkkilä, J. (2022) · International Conference on Mobile and Ubiquitous Multimedia (MUM) · doi:10.1145/3568444.3568456 · Cited by 23
Crowdsourcing and Evaluating Concept-driven Explanations of Machine Learning Models
Mishra, S., & Rzeszotarski, J. M. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449213 · Cited by 20
A Scoping Review of Mental Model Research in HCI from 2010 to 2021
Hu, X., & Twidale, M. B. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-48038-6_7 · Cited by 19
Understanding and Supporting Knowledge Decomposition for Machine Teaching
Ng, F., Suh, J., & Ramos, G. (2020) · Designing Interactive Systems Conference · doi:10.1145/3357236.3395454 · Cited by 22
Building Appropriate Mental Models: What Users Know and Want to Know about an Agentic AI Chatbot
Brachman, M., Kunde, S., Miller, S., Fucs, A., Dempsey, S., Jabbour, J., & Geyer, W. (2025) · Proceedings of the 30th International Conference on Intelligent User Interfaces · doi:10.1145/3708359.3712071 · Cited by 18
Color for Characters - Effects of Visual Explanations of AI on Trust and Observability
Schrills, T., & Franke, T. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-50334-5_8 · Cited by 17
Measuring User Experience Inclusivity in Human-AI Interaction via Five User Problem-Solving Styles
Anderson, A. W., Guevara, J. N., Moussaoui, F., Li, T., Vorvoreanu, M., & Burnett, M. (2024) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3663740 · Cited by 17
Self-citation
Explainable Active Learning (XAL): An Empirical Study of How Local Explanations Impact Annotator ExperiencePreprint
Ghai, B., Liao, Q. V., Zhang, Y., Bellamy, R., & Mueller, K. D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.09219 · Cited by 17
Improved Explanatory Efficacy on Human Affect and Workload Through Interactive Process in Artificial Intelligence
Kim, B. H., Koh, S., Huh, S., Jo, S., & Choi, S. (2020) · IEEE Access · doi:10.1109/access.2020.3032056 · Cited by 20
Investigating the intelligibility of a computer vision system for blind users
Ahmed, S., Balasubramanian, H., Stumpf, S., Morrison, C. P., Sellen, A. J., & Grayson, M. (2020) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3377325.3377508 · Cited by 17
Self-citation
Does the User Have A Theory of the Recommender? A Grounded Theory Study
Ghori, M. M., Dehpanah, A., Gemmell, J. F., Qahri‐Saremi, H., & Mobasher, B. (2022) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3511047.3537680 · Cited by 16
How to Support Users in Understanding Intelligent Systems? An Analysis and Conceptual Framework of User Questions Considering User Mindsets, Involvement, and Knowledge Outcomes
Buschek, D., Eiband, M., & Hußmann, H. (2022) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3519264 · Cited by 16
Preferences for AI Explanations Based on Cognitive Style and Socio-Cultural Factors
Kopecka, H., Such, J. M., & Flucke, G. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637386 · Cited by 19
Trust in the Danger Zone: Individual Differences in Confidence in Robot Threat Assessments
Lin, J., Panganiban, A. R., Matthews, G., Gibbins, K. M., Ankeney, E., See, C., Bailey, R., & Long, M. D. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.601523 · Cited by 15
How Prevalent Is Gender Bias in ChatGPT? - Exploring German and English ChatGPT Responses
Urchs, S., Thurner, V., Aßenmacher, M., Heumann, C., & Thiemichen, S. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-74630-7_20 · Cited by 29
Keeping it "organized and logical"
Mai, T., Khanna, R., Dodge, J. E., Irvine, J., Lam, K.-H., Lin, Z., Kiddle, N. G., Newman, E., Raja, S., Matthews, C., et al. (2020) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3377325.3377525 · Cited by 15
Self-citation
Steering Recommendations and Visualising Its Impact: Effects on Adolescents’ Trust in E-Learning Platforms
Ooge, J., Dereu, L., & Verbert, K. (2023) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3581641.3584046 · Cited by 17
Enhancing Analysts’ Mental Models for Improving Requirements Elicitation: A Two-stage Theoretical Framework and Empirical Results
Vitharana, P., Zahedi, F. M., & Jain, H. K. (2016) · Journal of the Association for Information Systems · doi:10.17705/1jais.00444 · Cited by 14

Authors: Kulesza, T., Stumpf, S., Burnett, M., & Kwan, I.
Affiliations: Oregon State University (US)
City, University of London (GB)
ORCID: Stumpf, Simone
Burnett, Margaret
Venue: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Publisher: ACM
Published: 2012-05-05
Pages: 1-10
DOI: 10.1145/2207676.2207678
OpenAlex: W2168747479
Cited by: 225
References: 31
Citations by year: 2026: 14 · 2025: 25 · 2024: 22 · 2023: 25 · 2022: 24 · 2021: 24 · 2020: 35 · 2019: 16 · 2018: 14 · 2017: 6 · 2016: 9 · 2015: 5 · 2014: 3 · 2013: 1 · 2012: 1
FWCI: 2.52
Type: conference paper
Language: en
Open access: closed
Licence: www.acm.org/publications/policies/copyright_policy#Background (vor)
Locations: CHI Conference on Human Factors in Computing Systems (publishedVersion)
City Research Online (City University London) (acceptedVersion)
ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) (submittedVersion)
Funders: National Science Foundation (0803487)
Topics: Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
Keywords: mental models, intelligent agents, recommender systems, music recommendation, personalization, user satisfaction, system transparency

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Tell me more?: the effects of mental model soundness on personalizing an intelligent agent

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks