Too good to be bad: Favorable product expectations boost subjective usability ratings
The DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
In an experiment conducted to study the effects of product expectations on subjective usability ratings, participants (N = 36) read a positive or a negative product review for a novel mobile device before a usability test, while the control group read nothing. In the test, half of the users performed easy tasks, and the other half hard ones, with the device. A standard usability test procedure was utilized in which objective task performance measurements as well as subjective post-task and post-experiment usability questionnaires were deployed. The study revealed a surprisingly strong effect of positive expectations on subjective post-experiment ratings: the participants who had read the positive review gave the device significantly better post-experiment ratings than did the negative-prime and no-prime groups. This boosting effect of the positive prime held even in the hard task condition where the users failed in most of the tasks. This finding highlights the importance of understanding: (1) what kinds of product expectations participants bring with them to the test, (2) how well these expectations represent those of the intended user population, and (3) how the test situation itself influences and may bias these expectations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
SUS: A 'Quick and Dirty' Usability Scale
(1996) · Usability Evaluation In Industry · doi:10.1201/9781498710411-35 · Cited by 8,989
Understanding Information Systems Continuance: An Expectation-Confirmation Model1
Bhattacherjee, A. (2001) · MIS Quarterly · doi:10.2307/3250921 · Cited by 8,767 · cited 5×
“By contrast, ECT (Bhattacherjee , 2001; Thong et al., 2006) was not verified in our study.”
BackgroundResultInfluentialSocial Influence: Compliance and Conformity
Cialdini, R. B., & Goldstein, N. J. (2004) · Annual Review of Psychology · doi:10.1146/annurev.psych.55.090902.142015 · Cited by 6,077 · cited 3×
“Reliance on socially trustable sources is reinforced regarding matters of which one possesses only limited first-hand knowledge (Cialdini and Goldstein, 2004).”
BackgroundAn Empirical Evaluation of the System Usability Scale
Bangor, A., Kortum, P. T., & Miller, J. T. (2008) · International Journal of Human–Computer Interaction · doi:10.1080/10447310802205776 · Cited by 5,181 · cited 2×
“(Bangor et al., 2008).”
MethodNASA-Task Load Index (NASA-TLX); 20 Years Later
Hart, S. G. (2006) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120605000909 · Cited by 4,297 · cited 1×
“For the past 20 years, NASA-TLX has been widely used in studies of interface design and evaluation (Hart, 2006).”
MethodOn the Self-Regulation of Behavior
Carver, C. S., & Scheier, M. F. (1998) · Cambridge University Press eBooks · doi:10.1017/cbo9781139174794 · Cited by 4,110
Tractinsky, N., Katz, A. S., & Ikar, D. (2000) · Interacting with Computers · doi:10.1016/s0953-5438(00)00031-x · Cited by 1,376 · cited 1×
“In a well-cited paper ''What Is Beautiful Is Usable'' Tranctinsky et al. (2000) show that visual appeal of an interface can be dominant over objectively measured usability in post-experiment perceptions of usability.”
BackgroundAttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität
Hassenzahl, M., Burmester, M., & Koller, F. (2003) · Berichte des German Chapter of the ACM · doi:10.1007/978-3-322-80058-9_19 · Cited by 955
Nasa-task load index (NASA-TLX); 20 years later: (577632012-009)
Hart, S. G. (2006) · PsycEXTRA Dataset · doi:10.1037/e577632012-009 · Cited by 838
Cited by
Trustworthy Artificial Intelligence: A Review
Kaur, D., Uslu, S., Rittichier, K. J., & Durresi, A. (2023) · ACM Computing Surveys · doi:10.1145/3491209 · Cited by 709
“These expectations affect their acceptance rate and trust in the system [158].”
BackgroundTuch, A. N., Presslaber, E. E., Stöcklin, M., Opwis, K., & Bargas-Avila, J. A. (2012) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2012.06.003 · Cited by 298
Kocielnik, R., Amershi, S., & Bennett, P. N. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300641 · Cited by 277
Conceptual Metaphors Impact Perceptions of Human-AI Collaboration
Khadpe, P., Krishna, R., Fei-Fei, L., Hancock, J. T., & Bernstein, M. S. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415234 · Cited by 183
“Prior theory suggests that pre-use expectations of AI systems influence both initial behaviors [31, 40, 76] and long-term behaviors [42], even if the system itself remains unchanged while varying user expectations [58].”
BackgroundWozney, L., Baxter, P., & Newton, A. S. (2015) · BMC Pediatrics · doi:10.1186/s12887-015-0534-1 · Cited by 38
“This suggests that if credibility issues are not sufficiently addressed, potential users may not commit to the program, regardless of how engaging and interactive the content may be [47].”
Background
Metadata
- Authors
- Raita, E., & Oulasvirta, A.
- Venue
- Interacting with Computers
- Publisher
- Oxford University Press (OUP)
- Published
- 2011-07
- Volume
- 23
- Issue
- 4
- Pages
- 363-371
- ISSN
- 0953-5438 (ISSN-L)
- OpenAlex
- W2035038536
- Cited by
- 90
- References
- 12
- FWCI
- 8.84
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.