The DOI matches its Crossref record; 23 of the 24 references it cites were found in a registry or an index.
IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use
Abstract
This article describes recent research in subjective usability measurement at IBM, focused on evaluating the psychometric properties of questionnaires designed for use in scenario‐based usability evaluation. The questionnaires address evaluation at both a global overall system level and at a more detailed scenario level. The primary goals of this article are to (a) discuss the psychometric characteristics of IBM questionnaires that measure user satisfaction with computer system usability, and (b) provide the questionnaires, with administration and scoring instructions. For scenario‐level measurement, the 3‐item After‐Scenario Questionnaire (ASQ) has excellent internal consistency, with coefficient alphas across a set of scenarios ranging from .90 to .96. For more global assessment, the Post‐Study System Usability Questionnaire (PSSUQ) also has excellent internal consistency, with an overall coefficient alpha of .97. Preliminary principal factor analysis of 48 PSSUQ questionnaires suggested the presence of three factors named, after varimax rotation, System Usefulness, Information Quality, and Interface Quality, with corresponding coefficient alphas of .96, .91, and .91. Evaluation of 377 PSSUQ questionnaires (modified to allow mailing to respondents in their offices and referred to as the Computer System Usability Questionnaire, or CSUQ) confirmed the structure of the preliminary principal factor analysis. Consequently, usability practitioners can use these questionnaires to help them measure users’ satisfaction with the usability of computer systems in the context of scenario‐based usability studies.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The usability and acceptability of the technology were assessed using qualitative methods and standard measures, such as the survey based on the Unified Theory of Acceptance and Use of Technology [27], the Mobile Application Rating Scale [28], and the System Usability and After-Scenario Questionnaire [29].”
From Barriers to and facilitators of user engagement with digital mental health interventions: Systematic review (2021) · cites this paper as [29]
In the citing paper
“It is a 19-item closed-ended ordinal questionnaire, based on 7-point graphic Likert scales.”
From Quantitative home-based assessment of Parkinson’s symptoms: the SENSE-PARK feasibility and usability study (2015) · cites this paper as [15]
In the citing paper
“the IBM Post-Study Usability Questionnaire (PSSUQ) [14] which assesses user satisfaction with, and usability of, technical devices.”
From Quantitative home-based assessment of Parkinson’s symptoms: the SENSE-PARK feasibility and usability study (2015) · cites this paper as [15]
In the citing paper
“The items address five important components of user satisfaction with general computer systems usability: ease of use, ease of learning, simplicity, effectiveness, information, and the user interface [15].”
From Quantitative home-based assessment of Parkinson’s symptoms: the SENSE-PARK feasibility and usability study (2015) · cites this paper as [15]
In the citing paper
“However, these tools were not originally created to evaluate mHealth apps.”
From Usability of Mobile Health Apps for Postoperative Care: Systematic Review (2020) · cites this paper as [20]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Engineering Psychology and Human Performance
Wickens, C. D., Hollands, J. G., Banbury, S., & Parasuraman, R. (2015) · Psychology Press eBooks · doi:10.4324/9781315665177 · Cited by 4,982
Aldenderfer, M. S., & Blashfield, R. K. (1984) · Cited by 2,358
Handbook of Human-Computer Interaction
(1988) · Elsevier eBooks · doi:10.1016/c2009-0-12113-x · Cited by 2,058
A Primer of Multivariate Statistics
Strauss, D. J., & Harris, R. J. (1975) · Biometrics · doi:10.2307/2529445 · Cited by 1,975
Development of an instrument measuring user satisfaction of the human-computer interface
Chin, J. P., Diehl, V. A., & Norman, L. K. (1988) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '88 · doi:10.1145/57167.57203 · Cited by 1,609
The use of pilot rating in the evaluation of aircraft handling qualities
Cooper, G. E., & Harper, R. P. (1969) · Defense Technical Information Center (DTIC) · Cited by 859
Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
(2023) · doi:10.1145/3544548 · Cited by 735
Usability Engineering: Our Experience and Evolution
Whiteside, J., Bennett, J., & Holtzblatt, K. (1988) · Handbook of Human-Computer Interaction · doi:10.1016/b978-0-444-70536-5.50041-5 · Cited by 519
McIver, J., & Carmines, E. (1981) · Sage eBooks · doi:10.4135/9781412986441 · Cited by 500
Research Methods in Human-Computer Interaction
Landauer, T. K. (1988) · Handbook of Human-Computer Interaction · doi:10.1016/b978-0-444-70536-5.50047-6 · Cited by 474
Research works printed but not linked: 7
- Alty, J. L. Can we measure usability? Proceedings of the Advanced Information Systems 1992 Conference. London: Learned Information.
- Kirakowski J., 1988, The Computer User Satisfaction Inventory (CUSI): Manual and scoring key
- Lewis J. R., 1991, User satisfaction questionnaires for usability studies: 1991 manual of directions for the ASQ and PSSUQ
- Lewis J. R., 1992, Psychometric evaluation of the computer system usability questionnaire: The CSUQ
- Lewis J. R., 1990, Human‐computer interaction—INTERACT ‘90
- Nunnally J. C., 1978, Psychometric theory
- Whiteside J., 1988, Handbook of human‐computer interaction
Cited by
An Empirical Evaluation of the System Usability Scale
Bangor, A., Kortum, P. T., & Miller, J. T. (2008) · International Journal of Human–Computer Interaction · doi:10.1080/10447310802205776 · Cited by 5,181
An overview of clinical decision support systems: Benefits, risks, and strategies for success
Sutton, R. T., Pincock, D., Baumgart, D. C., Sadowski, D. C., Fedorak, R. N., & Kroeker, K. I. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0221-y · Cited by 3,019
The System Usability Scale: Past, Present, and Future
Lewis, J. R. (2018) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2018.1455307 · Cited by 1,958
Self-citationThe Factor Structure of the System Usability Scale
Lewis, J. R., & Sauro, J. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-02806-9_12 · Cited by 1,278
Self-citationBorghouts, J., Eikey, E., Mark, G., De Leon, C., Schueller, S. M., Schneider, M., Stadnick, N., Zheng, K., Mukamel, D., & Sorkin, D. H. (2021) · Journal of Medical Internet Research · doi:10.2196/24387 · Cited by 1,069
“The usability and acceptability of the technology were assessed using qualitative methods and standard measures, such as the survey based on the Unified Theory of Acceptance and Use of Technology [27], the Mobile Application Rating Scale [28], and the System Usability and After-Scenario Questionnaire [29].”
BackgroundMethod
Metadata
- Authors
- Lewis, J. R.
- Affiliations
- IBM (United States) (US)
- Corresponding author
- Lewis, James R.
- ORCID
- Lewis, James R.
- Venue
- International Journal of Human-Computer Interaction
- Publisher
- Informa UK Limited
- Published
- 1995-01
- Volume
- 7
- Issue
- 1
- Pages
- 57-78
- ISSN
- 1044-7318 (ISSN-L)
- 1532-7590
- OpenAlex
- W1985816353
- Cited by
- 2,429
- References
- 24
- Citations by year
- 2026: 72 · 2025: 90 · 2024: 125 · 2023: 141 · 2022: 134 · 2021: 148 · 2020: 147 · 2019: 158 · 2018: 161 · 2017: 140 · 2016: 159 · 2015: 114 · 2014: 118 · 2013: 109 · 2012: 105
- FWCI
- 5.25
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Human-Computer Interaction (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Social Sciences › Decision Sciences › Information Systems and Management › Technology Adoption and User Behaviour
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- usability questionnaires, user satisfaction, psychometric properties, Computer System Usability Questionnaire, internal consistency, factor structure, system usefulness, information quality, interface quality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use. https://app.cochat.ai/papers/10.1080/10447319509526110
- The paper
- Lewis, J. R. (1995). IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use. International Journal of Human-Computer Interaction. https://doi.org/10.1080/10447319509526110
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.