Heuristic evaluation of ambient displays
The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
We present a technique for evaluating the usability and effectiveness of ambient displays. Ambient displays are abstract and aesthetic peripheral displays portraying non-critical information on the periphery of a user's attention. Although many innovative displays have been published, little existing work has focused on their evaluation, in part because evaluation of ambient displays is difficult and costly. We adapted a low-cost evaluation technique, heuristic evaluation, for use with ambient displays. With the help of ambient display designers, we defined a modified set of heuristics. We compared the performance of Nielsen's heuristics and our heuristics on two ambient displays. Evaluators using our heuristics found more, severe problems than evaluators using Nielsen's heuristics. Additionally, when using our heuristics, 3-5 evaluators were able to identify 40--60% of known usability issues. This implies that heuristic evaluation is an effective technique for identifying usability issues with ambient displays.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Tangible bits: towards seamless interfaces between people, bits and atoms
Ishii, H., & Ullmer, B. (1997) · Proceedings of the ACM SIGCHI Conference on Human factors in computing systems · doi:10.1145/258549.258715 · Cited by 3,853 · cited 1×
“[22, 7, 6, 9]), or report only short evaluations with few details or informal feedback, focusing instead on technology and design innovation [10, 3, 13].”
BackgroundHeuristic evaluation of user interfaces
Nielsen, J., & Molich, R. (1990) · Proceedings of the SIGCHI conference on Human factors in computing systems Empowering people - CHI '90 · doi:10.1145/97243.97281 · Cited by 3,533
A mathematical model of the finding of usability problems
Nielsen, J., & Landauer, T. K. (1993) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '93 · doi:10.1145/169059.169166 · Cited by 1,961
Weiser, M. (1996) · Cited by 820
Slow Technology – Designing for Reflection
Hallnäs, L., & Redström, J. (2001) · Personal and Ubiquitous Computing · doi:10.1007/pl00000019 · Cited by 693
A survey of user-centered design practice
Vredenburg, K., Mao, J.-Y., Smith, P. W., & Carey, T. (2002) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/503376.503460 · Cited by 691 · cited 3×
“As an additional benefit, we have demonstrated a process for creating heuristics applicable to a new domain, building on the work of Baker et al. [ 1 ].”
BackgroundMethodInfluentialDigital family portraits: supporting peace of mind for extended family members
Mynatt, E. D., Rowan, J., Craighill, S., & Jacobs, A. (2001) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/365024.365126 · Cited by 582
Wisneski, C., Ishii, H., Dahley, A., Gorbet, M., Brave, S., Ullmer, B., & Yarin, P. (1998) · Lecture Notes in Computer Science · doi:10.1007/3-540-69706-3_4 · Cited by 498
Damaged Merchandise? A Review of Experiments That Compare Usability Evaluation Methods
Gray, W. D., & Salzman, M. C. (1998) · Human–Computer Interaction · doi:10.1207/s15327051hci1303_2 · Cited by 488
Nielsen, J. (1993) · Communications of the ACM · doi:10.1145/255950.153582 · Cited by 307
Cited by
Current practice in measuring usability: Challenges to usability studies and research
Hornbæk, K. (2006) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2005.06.002 · Cited by 1,123
Vogel, D., & Balakrishnan, R. (2004) · Proceedings of the 17th annual ACM symposium on User interface software and technology · doi:10.1145/1029632.1029656 · Cited by 660
A taxonomy for and analysis of tangible interfaces
Fishkin, K. (2004) · Personal and Ubiquitous Computing · doi:10.1007/s00779-004-0297-4 · Cited by 422
A taxonomy of ambient information systems: four patterns of design
Pousman, Z., & Stasko, J. (2006) · Proceedings of the working conference on Advanced visual interfaces - AVI '06 · doi:10.1145/1133265.1133277 · Cited by 400
An approach to usability evaluation of e-learning applications
Ardito, C., Costabile, M. F., Marsico, M. D., Lanzilotti, R., Levialdi, S., Roselli, T., & Rossano, V. (2006) · Universal Access in the Information Society · doi:10.1007/s10209-005-0008-6 · Cited by 389
Using the experience sampling method to evaluate ubicomp applications
Consolvo, S., & Walker, M. (2003) · IEEE Pervasive Computing · doi:10.1109/mprv.2003.1203750 · Cited by 368
Evaluating Information Visualizations
Carpendale, S. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-70956-5_2 · Cited by 364
Developing a Usability Evaluation Method for e-Learning Applications: Beyond Functional Usability
Zaharias, P., & Poylymenakou, A. (2009) · International Journal of Human-Computer Interaction · doi:10.1080/10447310802546716 · Cited by 330
Heuristic evaluation of virtual reality applications
Sutcliffe, A., & Gault, B. (2004) · Interacting with Computers · doi:10.1016/j.intcom.2004.05.001 · Cited by 289
Rogers, Y., Connelly, K., Tedesco, L., Hazlewood, W., Kurtz, A., Hall, R. E., Hursey, J., & Toscos, T. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74853-3_20 · Cited by 199
Exiting the Cleanroom: On Ecological Validity and Ubiquitous Computing
Carter, S., Mankoff, J., Klemmer, S. R., & Matthews, T. (2008) · Human–Computer Interaction · doi:10.1080/07370020701851086 · Cited by 107
“Matthews, Fong, Ho-Ching, and Mankoff (2006c) conducted needfinding interviews and sketch studies that led to the IC2Hear sound awareness display. In this study, the sketches gave users semiconcrete display ideas to discuss. The rough nature of the sketches encouraged critiques and suggestions, improving the prototype…”
Self-citationGenerating Automatic Feedback on UI Mockups with Large Language Models
Duan, P., Warner, J., Li, Y., & Hartmann, B. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642782 · Cited by 83
“While initially designed for desktop interfaces, other work has adapted heuristic evaluation to more devices and domains [9, 31, 33, 47].”
Method(2004) · Cited by 61
Using emotion in games: emotional flowers
Bernhaupt, R., Boldt, A., Mirlacher, T., Wilfinger, D., & Tscheligi, M. (2007) · Proceedings of the international conference on Advances in computer entertainment technology · doi:10.1145/1255047.1255056 · Cited by 51
Metadata
- Authors
- Mankoff, J., Dey, A. K., Hsieh, G., Kientz, J., Lederer, S., & Ames, M.
- Venue
- Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2003-04-05
- Pages
- 169-176
- OpenAlex
- W2078569098
- Cited by
- 635
- References
- 19
- FWCI
- 24.18
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.