Creating personalized systems that people can scrutinize and control: Drivers, principles and experience
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Widespread personalized computing systems play an already important and fast-growing role in diverse contexts, such as location-based services, recommenders, commercial Web-based services, and teaching systems. The personalization in these systems is driven by information about the user, a user model. Moreover, as computers become both ubiquitous and pervasive, personalization operates across the many devices and information stores that constitute the user's personal digital ecosystem. This enables personalization, and the user models driving it, to play an increasing role in people's everyday lives. This makes it critical to establish ways to address key problems of personalization related to privacy,invisibility of personalization,errors in user models,wasted user models, and the broad issue of enabling people to control their user models and associated personalization. We offer scrutable user models as a foundation for tackling these problems. This article argues the importance of scrutable user modeling and personalization, illustrating key elements in case studies from our work. We then identify the broad roles for scrutable user models. The article describes how to tackle the technical and interface challenges of designing and building scrutable user modeling systems, presenting design principles and showing how they were established over our twenty years of work on the Personis software framework. Our contributions are the set of principles for scrutable personalization linked to our experience from creating and evaluating frameworks and associated applications built upon them. These constitute a general approach to tackling problems of personalization by enabling users to scrutinize their user models as a basis for understanding and controlling personalization.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Brusilovsky, P. (2001) · User Modeling and User-Adapted Interaction · doi:10.1023/a:1011143116306 · Cited by 2,057 · cited 1×
“Navigation refers to the potential for the user model to serve as an interface to an and Brusilovsky 2001], a system which teaches about programming in LISP.”
BackgroundMethods and techniques of adaptive hypermedia
Brusilovsky, P. (1996) · User Modeling and User-Adapted Interaction · doi:10.1007/bf00143964 · Cited by 2,041
FILTER BUBBLE: Wie wir im Internet entmündigt werden
Pariser, E. (2012) · doi:10.3139/9783446431164 · Cited by 1,849
Explaining collaborative filtering recommendations
Herlocker, J. L., Konstan, J. A., & Riedl, J. (2000) · Proceedings of the 2000 ACM conference on Computer supported cooperative work · doi:10.1145/358916.358995 · Cited by 1,731 · cited 2×
“Since evidence”
BackgroundSocial and political dimensions of privacy
Westin, A. F. (2003) · Journal of Social Issues · doi:10.1111/1540-4560.00072 · Cited by 721
The epistemology of a rule-based expert system —a framework for explanation
Clancey, W. J. (1983) · Artificial Intelligence · doi:10.1016/0004-3702(83)90008-5 · Cited by 712 · cited 1×
“(See, for example, the earliest expert systems which explained their reasoning in terms of the chain of rules used [Clancey 1983] to more recent work in conjunction with recommenders [Glass et al.”
MethodWhy and why not explanations improve the intelligibility of context-aware intelligent systems
Lim, B. Y., Dey, A. K., & Avrahami, D. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1519023 · Cited by 552 · cited 1×
“…so that the user can study, or scrutinize , the way she works, to determine what information the user model holds, the processes 2007], inspectable [Zapata-Rivera and Greer 2004], transparent [Cramer et al. 2008; Hook 2000; Hook et al. 1996], and intelligible [Lim et al. 2009; Lim and Dey 2009].”
BackgroundThe effects of transparency on trust in and acceptance of a content-based art recommender
Cramer, H., Evers, V., Ramlal, S., van Someren, M., Rutledge, L., Stash, N., Aroyo, L., & Wielinga, B. (2008) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-008-9051-3 · Cited by 448 · cited 4×
“Research has shown that people are more likely to accept personalised recommendations that are accompanied by an explanation [Herlocker et al. 2000; Tintarev and Masthoff 2007; Cramer et al. 2008].”
BackgroundMethodInfluentialBeyond total capture: a constructive critique of lifelogging
Sellen, A. J., & Whittaker, S. (2010) · Communications of the ACM · doi:10.1145/1735223.1735243 · Cited by 377
Assessing demand for intelligibility in context-aware applications
Lim, B. Y., & Dey, A. K. (2009) · Proceedings of the 11th international conference on Ubiquitous computing · doi:10.1145/1620545.1620576 · Cited by 246 · cited 1×
“…so that the user can study, or scrutinize , the way she works, to determine what information the user model holds, the processes 2007], inspectable [Zapata-Rivera and Greer 2004], transparent [Cramer et al. 2008; Hook 2000; Hook et al. 1996], and intelligible [Lim et al. 2009; Lim and Dey 2009].”
Background
Cited by
Working with Machines: The Impact of Algorithmic and Data-Driven Management on Human Workers
Lee, M. K., Kusbit, D., Metsky, E., & Dabbish, L. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702548 · Cited by 823
openPDS: Protecting the Privacy of Metadata through SafeAnswers
de Montjoye, Y.-A., Shmueli, E., Wang, S. S., & Pentland, A. S. (2014) · PLoS ONE · doi:10.1371/journal.pone.0098790 · Cited by 267
Bringing Transparency Design into Practice
Eiband, M., Schneider, H., Bilandzic, M., Fazekas-Con, J., Haug, M., & Hussmann, H. (2018) · 23rd International Conference on Intelligent User Interfaces · doi:10.1145/3172944.3172961 · Cited by 250
“Explaining how a system works might enable users to correct system decisions through feedback (as in [21, 23]), might improve understanding of the system recommendations and thus foster efficient or effective use [35, 36], prevent mis- and disuse of a system through increased trust [39] or protect users’ privacy [19]…”
BackgroundWriter-Defined AI Personas for On-Demand Feedback Generation
Benharrak, K., Zindulka, T., Lehmann, F., Heuer, H., & Buschek, D. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642406 · Cited by 63
When people and algorithms meet: user-reported problems in intelligent everyday applications
Eiband, M., Völkel, S. T., Buschek, D., Cook, S., & Hussmann, H. (2019) · Proceedings of the 24th International Conference on Intelligent User Interfaces · doi:10.1145/3301275.3302262 · Cited by 62
Metadata
- Authors
- Kay, J., & Kummerfeld, B.
- Venue
- ACM Transactions on Interactive Intelligent Systems
- Published
- 2012-12
- Volume
- 2
- Issue
- 4
- Pages
- 1-42
- ISSN
- 2160-6455 (ISSN-L)
- 2160-6463
- OpenAlex
- W1992446872
- Cited by
- 71
- References
- 14
- FWCI
- 18.35
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Creating personalized systems that people can scrutinize and control: Drivers, principles and experience. https://app.cochat.ai/papers/10.1145/2395123.2395129
- The paper
- Kay, J., & Kummerfeld, B. (2012). Creating personalized systems that people can scrutinize and control: Drivers, principles and experience. ACM Transactions on Interactive Intelligent Systems. https://doi.org/10.1145/2395123.2395129
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.