CoChat

Is It Time to Go Positive? Assessing the Positively Worded System Usability Scale (SUS)

Kortum, Philip, Acemyan, Claudia Ziegler, Oswald, Frederick L. · 2021 · Human Factors: The Journal of the Human Factors and Ergonomics Society
Cited by 51

The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.

Abstract

Objective: The goal of the research presented in this paper was to determine if the positively worded System Usability Scale (SUS) can be used in place of the positively and negatively worded standard SUS instrument for the subjective assessment of usability, and whether the results found here replicate those of Sauro and Lewis. Background: Sauro and Lewis’ previous study found no evidence that responses to SUS items differed across the standard SUS and the modified, positively worded version of the SUS when participants assessed websites. This study replicates and extends this work by examining a large number of different systems with larger sample sizes to add to the generalizability of previous findings. Methods: So that participants could retrospectively assess 20 products, the standard SUS was administered to 268 participants and the positive SUS to 698 participants. SUS scores were computed and the data analyzed using psychometric methods to explore how the two versions of the SUS differed. Results: The standard and positive versions of the SUS yielded similar SUS scores. In addition, both versions of the scale demonstrated evidence in support of reliability and validity. Conclusion: Either version of the SUS can be used with confidence to measure subjective usability. Furthermore, the scores generated from both versions of the SUS can be directly compared. Applications: In situations where cognitive load, participants’ spoken language, or item consistency with other surveys being given may be a factor, the positive SUS is a viable alternative to the standard SUS.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1177/0018720819881556

Cites

13 of 13 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 13 references

Cited by

See all 51

Metadata

Authors
Kortum, P., Acemyan, C. Z., & Oswald, F. L.
Venue
Human Factors: The Journal of the Human Factors and Ergonomics Society
Published
2020-01-08
Volume
63
Issue
6
Pages
987-998
ISSN
  • 0018-7208 (ISSN-L)
  • 1547-8181
OpenAlex
W2999052780
Cited by
51
References
13
FWCI
4.08
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Is It Time to Go Positive? Assessing the Positively Worded System Usability Scale (SUS). https://app.cochat.ai/papers/10.1177/0018720819881556
The paper
Kortum, P., Acemyan, C. Z., & Oswald, F. L. (2021). Is It Time to Go Positive? Assessing the Positively Worded System Usability Scale (SUS). Human Factors: The Journal of the Human Factors and Ergonomics Society. https://doi.org/10.1177/0018720819881556

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.