Investigating intelligibility for uncertain context-aware applications
The DOI matches its Crossref record; 22 of the 23 references it cites were found in a registry or an index.
Abstract
Context-aware applications use sensing and inference to attempt to determine users' contexts, and take appropriate action. However, they are prone to uncertainty, and this may compromise the trust users have in them. Providing intelligibility has been proposed to help explain to users how context-aware applications work in order to improve user impressions of them. However, we hypothesize that intelligibility may actually be harmful for applications that are very uncertain of their actions. We conducted a large controlled study of a location-aware and a sound-aware application, investigating the impact of intelligibility on understanding, and user impression of applications with varying certainty. We found that intelligibility impacts user impressions, depending on the application's certainty and behavior appropriateness. Intelligibility is helpful for applications with high certainty, but it is harmful if applications behave appropriately, yet display low certainty.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Furthermore, making accurate system predictions about emotions is also difficult, allowing us to examine a key challenge for intelligent systems: how to deal with system error [13,50,51,60].”
From Progressive Disclosure: When, Why, and How Do Users Want Algorithmic Transparency Information? (2020) · cites this paper as [50]
In the citing paper
“Transparency may erode confidence in a system, with users trusting it less, because transparency leads them to question the system even when it is correct [1,13,50].”
From Progressive Disclosure: When, Why, and How Do Users Want Algorithmic Transparency Information? (2020) · cites this paper as [50]
In the citing paper
“We first confirm other work showing that as anticipated, transparency is beneficial overall [22,49,50].”
From Progressive Disclosure: When, Why, and How Do Users Want Algorithmic Transparency Information? (2020) · cites this paper as [50]
In the citing paper
“Our studies did not systematically vary error, however, and prior work indicates that reactions to system explanations depend on the level of error [50,51].”
From Progressive Disclosure: When, Why, and How Do Users Want Algorithmic Transparency Information? (2020) · cites this paper as [50]
In the citing paper
“Consistent with other research [43,50,51], our results show that providing overdetailed information can overload or undermine a user who is operating with a simple model.”
From Progressive Disclosure: When, Why, and How Do Users Want Algorithmic Transparency Information? (2020) · cites this paper as [50]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Dey, A. K., Abowd, G. D., & Salber, D. (2001) · Human–Computer Interaction · doi:10.1207/s15327051hci16234_02 · Cited by 2,951
Self-citationCrowdsourcing user studies with Mechanical Turk
Kittur, A., Chi, E. H., & Suh, B. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357127 · Cited by 1,923
The role of trust in automation reliance
Dzindolet, M. T., Peterson, S. A., Pomranky, R. A., Pierce, L. G., & Beck, H. P. (2003) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(03)00038-7 · Cited by 1,276 · cited 1×
“In several domains including decision-making [9], end-user debugging [12], and user modeling [5], explanations have increased user trust and acceptance of applications.”
BackgroundThe Coming Age of Calm Technology
Weiser, M., & Brown, J. S. (1997) · Beyond Calculation · doi:10.1007/978-1-4612-0685-9_6 · Cited by 1,029
MUIR, B. M. (1994) · Ergonomics · doi:10.1080/00140139408964957 · Cited by 873
SoundSense: scalable sound sensing for people-centric applications on mobile phones
Lu, H., Pan, W., Lane, N. D., Choudhury, T., & Campbell, A. T. (2009) · Proceedings of the 7th international conference on Mobile systems, applications, and services · doi:10.1145/1555816.1555834 · Cited by 581
Why and why not explanations improve the intelligibility of context-aware intelligent systems
Lim, B. Y., Dey, A. K., & Avrahami, D. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1519023 · Cited by 552 · cited 7×
“Similar to [1, 14, 15], we use scenarios to let participants learn about and experience our applications.”
BackgroundMethodResultInfluentialSelf-citationIntelligibility and Accountability: Human Considerations in Context-Aware Systems
Bellotti, V., & Edwards, K. (2001) · Human–Computer Interaction · doi:10.1207/s15327051hci16234_05 · Cited by 471
Context as a Dynamic Construct
Greenberg, S. (2001) · Human–Computer Interaction · doi:10.1207/s15327051hci16234_09 · Cited by 264
Assessing demand for intelligibility in context-aware applications
Lim, B. Y., & Dey, A. K. (2009) · Proceedings of the 11th international conference on Ubiquitous computing · doi:10.1145/1620545.1620576 · Cited by 246 · cited 6×
“Similar to [1, 14, 15], we use scenarios to let participants learn about and experience our applications.”
BackgroundMethodResultInfluentialSelf-citation
Research works printed but not linked: 2
- Antifakos S., 2004, Ubicomp, 04, 54
- Chalmers M., 2003, Workshop: At the Crossroads: The Interaction of HCI and Systems Issues, Ubicomp 03
Cited by
Designing Theory-Driven User-Centric Explainable AI
Wang, D., Yang, Q., Abdul, A., & Lim, B. Y. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300831 · Cited by 906
Self-citationPersonal Sensing: Understanding Mental Health Using Ubiquitous Sensors and Machine Learning
Mohr, D. C., Zhang, M., & Schueller, S. M. (2017) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032816-044949 · Cited by 802
“This error is always user-facing, affecting the quality of the & Dey 2011)?”
BackgroundAbdul, A., Vermeulen, J., Wang, D., Lim, B. Y., & Kankanhalli, M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174156 · Cited by 743
Self-citationWang, X., & Yin, M. (2021) · 26th International Conference on Intelligent User Interfaces · doi:10.1145/3397481.3450650 · Cited by 320
“Earlier literature on AI explanations often concerns the communication of uncertainty in AI decisions [45, 46].”
BackgroundKieslich, K., Keller, B., & Starke, C. (2022) · Big Data & Society · doi:10.1177/20539517221092956 · Cited by 203
Metadata
- Authors
- Lim, B. Y., & Dey, A. K.
- Affiliations
- Carnegie Mellon University (US)
- Venue
- Proceedings of the 13th international conference on Ubiquitous computing
- Publisher
- ACM
- Published
- 2011-09-17
- Pages
- 415-424
- OpenAlex
- W2017131938
- Cited by
- 101
- References
- 23
- Citations by year
- 2026: 8 · 2025: 7 · 2024: 5 · 2023: 4 · 2022: 12 · 2021: 5 · 2020: 5 · 2019: 10 · 2018: 11 · 2017: 6 · 2016: 8 · 2015: 4 · 2014: 1 · 2013: 9 · 2012: 6
- FWCI
- 3.81
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) (publishedVersion)
- Funders
- National Science Foundation
- Agency for Science, Technology and Research
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- intelligibility, context-aware systems, uncertainty, user trust, user impressions, explainability, location-aware applications, user understanding
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Investigating intelligibility for uncertain context-aware applications. https://app.cochat.ai/papers/10.1145/2030112.2030168
- The paper
- Lim, B. Y., & Dey, A. K. (2011). Investigating intelligibility for uncertain context-aware applications. Proceedings of the 13th international conference on Ubiquitous computing. https://doi.org/10.1145/2030112.2030168
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.