The DOI matches its Crossref record; 40 of the 42 references it cites were found in a registry or an index.
Multi-Language Toolkit for the System Usability Scale
Abstract
The System Usability Scale (SUS) is a widely used instrument that measures the subjective usability of products and systems. Although past research has demonstrated the psychometric reliability and criterion-related validity of the SUS in specific languages, the approach and methodology of validating the translations has been somewhat inconsistent. This paper addresses this issue by systematically translating and validating the SUS across multiple languages. Native speakers of Arabic, Chinese, French, German, Hindi, and Spanish evaluated five common everyday products using the translated SUS. Evidence of consistent scale reliability and validity was found in the Chinese, French, German and Spanish SUS, with Cronbach’s alpha often greater than .80, as well as large statistically significant correlations between the SUS and a one-item adjective rating self-report of overall usability (r =.54-.74). Validity of the SUS across languages was also demonstrated by finding reliable differences in mean SUS scores between products. Overall, these translated SUS measures can be used with confidence in practice to measure the usability of everyday products and systems.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Moreover, a study conducted in 2020 examined the Arabic, Chinese, French, German, and Spanish versions of the SUS [14]. The study found that these SUS versions were adequately adapted; however, cultural differences had to be highlighted [14].”
From System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis (2022) · cites this paper as [14]
In the citing paper
“Using the SUS (Gao et al., 2020) the practicability and usability of an early TONI prototype achieved excellent results (85,2 of a total score of 100 points).”
From TONI - One for all? Participatory development of a transtheoretic and transdiagnostic online intervention for blended care (2024) · cites this paper as Gao et al., 2020
In the citing paper
“Using the SUS (Gao et al., 2020), participants also evaluated an early TONI prototype according to its practicability and usability. The prototype achieved excellent results (83,3 of a total score of 100 points).”
From TONI - One for all? Participatory development of a transtheoretic and transdiagnostic online intervention for blended care (2024) · cites this paper as Gao et al., 2020
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
Statistical power analyses using G∗Power 3.1: tests for correlation and regression analyses
Faul, F., Erdfelder, E., Buchner, A., & Lang, A.-G. (2009) · Behavior Research Methods · doi:10.3758/brm.41.4.1149 · Cited by 37,615
(1991) · Cited by 15,554
A Rationale and Test for the Number of Factors in Factor Analysis
Horn, J. L. (1965) · Psychometrika · doi:10.1007/bf02289447 · Cited by 9,527
An Empirical Evaluation of the System Usability Scale
Bangor, A., Kortum, P. T., & Miller, J. T. (2008) · International Journal of Human–Computer Interaction · doi:10.1080/10447310802205776 · Cited by 5,181
Self-citationUsability Evaluation In Industry
(1996) · CRC Press eBooks · doi:10.1201/9781498710411 · Cited by 4,445
The Performance of RMSEA in Models With Small Degrees of Freedom
Kenny, D. A., Kaniskan, B., & McCoach, D. B. (2015) · Sociological Methods & Research · doi:10.1177/0049124114543236 · Cited by 2,841
IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use
Lewis, J. R. (1995) · International Journal of Human-Computer Interaction · doi:10.1080/10447319509526110 · Cited by 2,429
The Electronic Journal of Business Research Methods
(2020) · The Electronic Journal of Business Research Methods · doi:10.34190/jbrm · Cited by 2,344
The Sources of Four Commonly Reported Cutoff Criteria: What Did They Really Say?
Lance, C. E., Butts, M. M., & Michels, L. C. (2006) · Organizational Research Methods · doi:10.1177/1094428105284919 · Cited by 2,053
Research works printed but not linked: 8
- Bangor A., 2009, Journal of Usability Studies, 4, 114
- Brooke J., 2013, Journal of Usability Studies, 8, 29
- Dianat I., 2014, Health Promotion Perspectives, 4, 82
- Fernandes T., 1995, Global interface design: A guide to designing international user interfaces
- Jonsson O., 2016, Journal of Usability Studies, 12, 26
- Lewis J. R., 2017, Journal of Usability Studies, 12, 183
- Li, Z. (2014). Critical evaluation of cross-cultural impact on usability studies: Analysis and case study data collection [Doctoral dissertation]. California State University.
- Sheu F. R., 2017, Workshop Proceedings of the 25th International Conference on Computers in Education, 28
Cited by
Sorted by citations
Items 101–141 of 141
Chen, C.-J., Su, J., Wu, M.-H., Hung, S.-Y., Hou, C.-L., & Lee, H. (2022) · doi:10.2196/preprints.44676
Human-Centered Design (HCD) of Rural Cooking Stove
Arunachalam, M., & Patel, D. (2023) · Journal of the Institution of Engineers (India) Series C · doi:10.1007/s40032-023-00914-3
Alsuwaidi, M. (2023) · International Journal of Computer Applications · doi:10.5120/ijca2023922845
Felix, A., & Farozi, M. (2023) · Jurnal Teknologi Informatika dan Komputer · doi:10.37012/jtik.v9i2.1813
Alternative questionnaire formats in usability evaluation
Baumgartner, J. (2024) · doi:10.51363/unifr.lth.2024.030
Robotic sensory cueing during gait: a usability study with scenarios of daily living
Pimenta, M., Pinheiro, C., & Santos, C. P. (2024) · IEEE International Conference on Autonomous Robot Systems and Competitions · doi:10.1109/icarsc61747.2024.10535942
LONJOU, L., AUGRAS, A. C., Grosboillot, N., & Perrochon, A. (2023) · Revue scientifiques des travaux de fin d'étude en rééducation et réadaptation. · doi:10.25965/rse2r.240
Dell’Era, S., Gimeno‐Santos, E., Chain, N. A. F., Barneche, M. F. C., Turón, G. M., Bykhovsky, I., Balestrieri, M. C., Gracia, G., & Terrasa, S. (2024) · Respirar · doi:10.55720/respirar.16.2.1
Ditmore, M. H., Karouaoui, A. E., & Florez-Arango, J. F. (2024) · doi:10.2196/preprints.65210
Endendijk, J. J. (2024) · Contemporary School Psychology · doi:10.1007/s40688-024-00532-5
Schmücker, V., Grensing, F., Machulska, A., & Klucken, T. (2025) · IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR) · doi:10.1109/aixvr63409.2025.00035
AUGRAS, A. C., LONJOU, L., Ranvial, E., & Perrochon, A. (2025) · Revue scientifiques des travaux de fin d'étude en rééducation et réadaptation. · doi:10.25965/rse2r.485
Ditmore, M. H., Karouaoui, A. E., & Florez-Arango, J. F. (2025) · JMIR Formative Research · doi:10.2196/65210
Technostress: die digitale Transformation als Mehrbelastung beim Gesundheitspersonal
Golz, C., & Bieri, J. S. (2025) · Springer eBooks · doi:10.1007/978-3-658-46762-3_6
Schneider, T., Schlender, M., Uslar, V., Pelzl, S., Kreß, N. A., Tabriz, N., & Weyhe, D. (2025) · doi:10.2196/preprints.82704
Augminded: Ambient Mirror Display Notifications
Götzelmann, T., Karg, P., & Müller, M. (2025) · Multimodal Technologies and Interaction · doi:10.3390/mti9090093
Eggenkemper, F., Feldmann, L., Sontowski, N., Kiel, A., Rothkopf, C. A., & Mertens, R. (2025) · International Journal of Semantic Computing · doi:10.1142/s1793351x25450011
Feasibility of the Mio-Training: A metacognitive training for children and adolescentsPreprint
Salzmann, S., Benzing, V., Martin‐Niedecken, A. L., Grunt, S., & Everts, R. (2025) · Research Square · doi:10.21203/rs.3.rs-8163350/v1
O’Sullivan, S., Krautwald, J., & Schneider, H. (2024) · Figshare · doi:10.6084/m9.figshare.26265154
O’Sullivan, S., Krautwald, J., & Schneider, H. (2024) · Figshare · doi:10.6084/m9.figshare.26265004
Muehlensiepen, F., May, S., Seifert, F., Wengemuth, E., Johannsen, O., Middeke, M., Heinze, M., Petit, P., Vuillerme, N., Spethmann, S., et al. (2025) · doi:10.2196/preprints.83075
PowerTeams – A Novel Approach for Collaboration in Engineering Power System Applications
Brandauer, C., Wohnig, J., Andrén, F., Vettoretti, D., Strasser, T., Veichtlbauer, A., Steinmaurer, G., & Resch, J. (2025) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc58881.2025.11342586
Personalized Adaptive Magnification in Gaze-Based Interaction
Eggenkemper, F., Swerew, J., Rehers, T., Hanhoff, M., Rothkopf, C. A., & Mertens, R. G. (2025) · International Symposium on Multimedia · doi:10.1109/ism66958.2025.00064
System Usability Measured Over Time: An Exploratory Descriptive Study
Kortum, P. T., Acemyan, C. Z., & Oswald, F. L. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2630077
Self-citationGong, P., Lü, Y., Xiahou, X., Deng, Y., & Lovreglio, R. (2026) · Fire Technology · doi:10.1007/s10694-026-01879-2
Charles, C. M., Tozatti, G. V., Torezzan, C., Souza, R. T., Costa, M. L., Cecatti, J. G., & Pacagnella, R. C. (2026) · International Journal of Gynecology & Obstetrics · doi:10.1002/ijgo.70996
Romero-Muñoz, E. (2025) · theses.fr (ABES) · doi:10.70675/9d49058bz3ed7z48c5zada9zbcbc7125eefd
Social media for ecotourism promotion: a systematic review
Gan, L., Saleh, M. S. M., Nordin, N., & Jiao, Y. (2026) · Open Geosciences · doi:10.1515/geo-2025-0920
Göhler, V., Heisel, F., Schierz, F. E., & Pfleging, B. (2026) · ACM International Symposium on Pervasive Displays (PerDis) · doi:10.1145/3797993.3798024
Schneider, T., Schlender, M., Uslar, V., Pelzl, S., Salzmann, D., Kreß, N. A., Tabriz, N., & Weyhe, D. (2026) · JMIR XR and spatial computing. · doi:10.2196/82704
Hirschberg, D. O. W., Hein, O., Alt, F., & Rauschnabel, P. A. (2026) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2026.103848
Zhang, Y., Li, F., Wang, Y., Guo, W., & Wang, H. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2678559
Generative AI-Based Gamification
ak, O., Lowe, S., & Fischer, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-30408-7_1
Measuring the Usability of DeepL: Impact of Translation Technology Courses in Translator Training
Barut, E. (2026) · İstanbul Üniversitesi Çeviribilim Dergisi / Istanbul University Journal of Translation Studies · doi:10.26650/iujts.2026.1882848
Wenk, M. J., Renner, L. V., Lockl, J., Fechner, P., Ruhland, N., Carl, N., Mangold, M. H., Krause, H., & Westhoff, N. (2026) · World Journal of Urology · doi:10.1007/s00345-026-06609-5
Siegler, A. J., Mi, G., Yu, F., Stegmueller, D., Ning, K., Koh, S. H. E., Liu, Y., Powers, K. A., Baral, S., Sullivan, P. S., et al. (2026) · Journal of the International AIDS Society · doi:10.1002/jia2.70203
Ackermann, L. J., Wirth, B., Brändle, M., & Kowatsch, T. (2026) · doi:10.2196/preprints.111252
Topf, C., Bore, E., Härter, M. C., Müller, V., Scholl, I., & Hahlweg, P. (2026) · doi:10.2196/preprints.113445
Aqqad, Y. U. (2026) · Sustainability and Sports Science Journal · doi:10.55860/dnqb4576
Beyond usability: Spatial learning across autonomy-structured browser-based 360° virtual exhibitions
Hsieh, T., & Sheu, K.-W. (2026) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2026.101383
Metadata
- Authors
- Gao, M., Kortum, P., & Oswald, F. L.
- Affiliations
- Rice University (US)
- Corresponding author
- Kortum, Philip
- Venue
- International Journal of Human–Computer Interaction
- Publisher
- Informa UK Limited
- Published
- 2020-08-19
- Volume
- 36
- Issue
- 20
- Pages
- 1883-1901
- ISSN
- 1044-7318 (ISSN-L)
- 1532-7590
- OpenAlex
- W3062812444
- Cited by
- 140
- References
- 42
- Citations by year
- 2026: 23 · 2025: 36 · 2024: 31 · 2023: 22 · 2022: 20 · 2021: 8
- FWCI
- 9.09
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Human-Computer Interaction (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- System Usability Scale, usability measurement, cross-lingual translation, psychometric validation, scale reliability, criterion validity, everyday products, Arabic language, Chinese, French language, German, Hindi, Spanish language
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
