Psychometric Evaluation of the USE (Usefulness, Satisfaction, and Ease of use) Questionnaire for Reliability and Validity
The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
The Usefulness, Satisfaction, and Ease of Use Questionnaire (USE, Lund, 2001) measures the subjective usability of a product or service. It is a 30-item survey that examines four dimensions of usability: usefulness, ease of use, ease of learning, and satisfaction. This metric can be applied to various scenarios of usability assessment because it is non-proprietary and technology-agnostic. Items in the USE also have good face validity with unambiguous and relevant descriptions. However, little published research has reported reliability or validity of the USE. The current study aims to address this issue by investigating psychometric properties of the USE. One hundred and fifty-one participants from Mechanical Turk (MTurk) evaluated Microsoft Word and Amazon.com on the USE and the System Usability Scale (SUS, Brooke, 1996). Ignoring the four dimensions in the USE, Cronbach’s alpha was .98, which indicates high reliability of overall USE score. The scale-reliability of dropping any item was .98 in both products. In terms of correlations between the USE dimensions and the SUS, validity was statistically and practically significant ( r between .60 and .82, p < .001). System sensitivity of the USE was also demonstrated via significant t-tests on the USE scores between Microsoft Word and Amazon.com . A principal axis factor analysis revealed a four-factor model that is different from the original model. Three factors resembled the original dimensions, and a fourth factor was related to multiple dimensions. Overall, the USE is a valid and reliable instrument that needs further refinement.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
mice: Multivariate Imputation by Chained Equations in R
Buuren, S. V., & Groothuis-Oudshoorn, K. (2011) · Journal of Statistical Software · doi:10.18637/jss.v045.i03 · Cited by 13,870
Missing data: our view of the state of the art
Schafer, J. L., & Graham, J. W. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.2.147 · Cited by 11,638
An Empirical Evaluation of the System Usability Scale
Bangor, A., Kortum, P. T., & Miller, J. T. (2008) · International Journal of Human–Computer Interaction · doi:10.1080/10447310802205776 · Cited by 5,181 · cited 3×
“Participants evaluated Microsoft Word (Word, a text processing software) and Amazon.com (Amazon, an e-commerce website) on both the USE (Table 1) and the modified version of the SUS (Bangor et al., 2008).”
BackgroundMethodSelf-citationIBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use
Lewis, J. R. (1995) · International Journal of Human-Computer Interaction · doi:10.1080/10447319509526110 · Cited by 2,429
Current practice in measuring usability: Challenges to usability studies and research
Hornbæk, K. (2006) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2005.06.002 · Cited by 1,123
Usability ratings for everyday products measured with the System Usability Scale
Kortum, P. T., & Bangor, A. (2013) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2012.681221 · Cited by 323 · cited 4×
“The current study successfully replicated previous findings by Kortum and Bangor (2013) on the SUS scores of Word and Amazon.”
BackgroundMethodResultInfluentialSelf-citationDiabetic e-Management System (DEMS)
Lutes, K. D., & Baggili, I. M. (2006) · Third International Conference on Information Technology: New Generations (ITNG'06) · doi:10.1109/itng.2006.53 · Cited by 18
Cited by
Assessing the Usability of ChatGPT for Formal English Language Learning
Shaikh, S., Yayilgan, S. Y., Klimova, B., & Pikhart, M. (2023) · European Journal of Investigation in Health, Psychology and Education · doi:10.3390/ejihpe13090140 · Cited by 183
Wiljer, D., Shi, J., Lo, B., Sanches, M., Hollenberg, E., Johnson, A., Abi-Jaoudé, A., Chaim, G., Cleverley, K., Henderson, J., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/20790 · Cited by 78
“At the end of the study, participants in the intervention group completed an adapted version of the Usefulness, Satisfaction, and Ease of Use questionnaire [30] and were invited to participate in qualitative interviews to evaluate Thought Spot’s usability and user experience.”
User Experience of Older People While Using Digital Health Technologies: A Systematic Review
Takano, E., Maruyama, H., Takahashi, T., Mori, K., Nishiyori, K., Morita, Y., Fukuda, T., Kondo, I., & Ishibashi, Y. (2023) · Applied Sciences · doi:10.3390/app132312815 · Cited by 29
Norman-Nott, N., Wilks, C. R., Hesam-Shariati, N., Schroeder, J., Suh, J., Czerwinski, M., Briggs, N. E., Quidé, Y., McAuley, J., & Gustin, S. M. (2022) · The Journal of Pain · doi:10.1016/j.jpain.2021.10.003 · Cited by 17
Duffecy, J., Grekin, R., Long, J. D., Mills, J. A., & O'Hara, M. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.05.123 · Cited by 19
Metadata
- Authors
- Gao, M., Kortum, P., & Oswald, F.
- Venue
- Proceedings of the Human Factors and Ergonomics Society Annual Meeting
- Publisher
- SAGE Publications
- Published
- 2018-09
- Volume
- 62
- Issue
- 1
- Pages
- 1414-1418
- ISSN
- 0163-5182 (ISSN-L)
- 1071-1813
- 2169-5067
- OpenAlex
- W2894223665
- Cited by
- 209
- References
- 8
- FWCI
- 13.78
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Psychometric Evaluation of the USE (Usefulness, Satisfaction, and Ease of use) Questionnaire for Reliability and Validity. https://app.cochat.ai/papers/10.1177/1541931218621322
- The paper
- Gao, M., Kortum, P., & Oswald, F. (2018). Psychometric Evaluation of the USE (Usefulness, Satisfaction, and Ease of use) Questionnaire for Reliability and Validity. Proceedings of the Human Factors and Ergonomics Society Annual Meeting. https://doi.org/10.1177/1541931218621322
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.