Cited by 225Recommender Systems and TechniquesUsability and User Interface DesignInformation Retrieval and Search Behavior

Tell me more?: the effects of mental model soundness on personalizing an intelligent agent

Kulesza, Todd, Stumpf, Simone, Burnett, Margaret, Kwan, Irwin·2012·Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Abstract

What does a user need to know to productively work with an intelligent agent? Intelligent agents and recommender systems are gaining widespread use, potentially creating a need for end users to understand how these systems operate in order to fix their agent's personalized behavior. This paper explores the effects of mental model soundness on such personalization by providing structural knowledge of a music recommender system in an empirical study. Our findings show that participants were able to quickly build sound mental models of the recommender system's reasoning, and that participants who most improved their mental models during the study were significantly more likely to make the recommender operate to their satisfaction. These results suggest that by helping end users understand a system's reasoning, intelligent agents may elicit more and better feedback, thus more closely aligning their output with each user's intentions.

Integrity signals

Registry

Crossref · 10.1145/2207676.2207678

Cites

30 of 30 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • People decide when to rely on an AI by using their mental models of how the AI tends to behave.

    “People decide when to rely on an AI by using their mental models [3, 30], or internal representations, of how the AI tends to behave: when it is most accurate, when it is most likely to fail, etc.”

Cites

Flagged first, then by citations

1 of the 31 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Kulesza, T., Stumpf, S., Burnett, M., & Kwan, I.
Affiliations
  • Oregon State University (US)
  • City, University of London (GB)
Venue
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Publisher
ACM
Published
2012-05-05
Pages
1-10
OpenAlex
W2168747479
Cited by
225
References
31
Citations by year
2026: 14 · 2025: 25 · 2024: 22 · 2023: 25 · 2022: 24 · 2021: 24 · 2020: 35 · 2019: 16 · 2018: 14 · 2017: 6 · 2016: 9 · 2015: 5 · 2014: 3 · 2013: 1 · 2012: 1
FWCI
2.52
Type
conference paper
Language
en
Open access
closed
Locations
  • CHI Conference on Human Factors in Computing Systems (publishedVersion)
  • City Research Online (City University London) (acceptedVersion)
  • ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) (submittedVersion)
Funders
National Science Foundation (0803487)
Topics
  • Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
  • Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
Keywords
mental models, intelligent agents, recommender systems, music recommendation, personalization, user satisfaction, system transparency

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review