Multi-language toolkit for the system usability scale
Abstract
The System Usability Scale (SUS) is a widely used instrument that measures the subjective usability of products and systems. Although past research has demonstrated the psychometric reliability and criterion-related validity of the SUS in specific languages, the approach and methodology of validating the translations has been somewhat inconsistent. This paper addresses this issue by systematically translating and validating the SUS across multiple languages. Native speakers of Arabic, Chinese, French, German, Hindi, and Spanish evaluated five common everyday products using the translated SUS. Evidence of consistent scale reliability and validity was found in the Chinese, French, German and Spanish SUS, with Cronbach’s alpha often greater than .80, as well as large statistically significant correlations between the SUS and a one-item adjective rating self-report of overall usability (r =.54-.74). Validity of the SUS across languages was also demonstrated by finding reliable differences in mean SUS scores between products. Overall, these translated SUS measures can be used with confidence in practice to measure the usability of everyday products and systems.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
A study conducted in 2020 examined the Arabic, Chinese, French, German, and Spanish versions of the SUS and found that these versions were adequately adapted; however, cultural differences had to be highlighted.
“Moreover, a study conducted in 2020 examined the Arabic, Chinese, French, German, and Spanish versions of the SUS [14]. The study found that these SUS versions were adequately adapted; however, cultural differences had to be highlighted [14].”
From System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis (2022) · cites this paper as [14]
Using the SUS, the practicability and usability of an early TONI prototype achieved excellent results (85.2 of a total score of 100 points).
“Using the SUS (Gao et al., 2020) the practicability and usability of an early TONI prototype achieved excellent results (85,2 of a total score of 100 points).”
From TONI - One for all? Participatory development of a transtheoretic and transdiagnostic online intervention for blended care (2024) · cites this paper as Gao et al., 2020
Using the SUS, participants evaluated an early TONI prototype and it achieved excellent results (83.3 of a total score of 100 points).
“Using the SUS (Gao et al., 2020), participants also evaluated an early TONI prototype according to its practicability and usability. The prototype achieved excellent results (83,3 of a total score of 100 points).”
From TONI - One for all? Participatory development of a transtheoretic and transdiagnostic online intervention for blended care (2024) · cites this paper as Gao et al., 2020
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788 · see citing works
Statistical power analyses using G∗Power 3.1: tests for correlation and regression analyses
Faul, F., Erdfelder, E., Buchner, A., & Lang, A.-G. (2009) · Behavior Research Methods · doi:10.3758/brm.41.4.1149 · Cited by 37,615 · see citing works
(1991) · Cited by 15,554 · see citing works
A Rationale and Test for the Number of Factors in Factor Analysis
Horn, J. L. (1965) · Psychometrika · doi:10.1007/bf02289447 · Cited by 8,965 · see citing works
An Empirical Evaluation of the System Usability Scale
Bangor, A., Kortum, P. T., & Miller, J. T. (2008) · International Journal of Human–Computer Interaction · doi:10.1080/10447310802205776 · Cited by 5,181 · see citing works
Self-citationUsability Evaluation In Industry
(1996) · CRC Press eBooks · doi:10.1201/9781498710411 · Cited by 4,400 · see citing works
The Performance of RMSEA in Models With Small Degrees of Freedom
Kenny, D. A., Kaniskan, B., & McCoach, D. B. (2015) · Sociological Methods & Research · doi:10.1177/0049124114543236 · Cited by 2,841 · see citing works
IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use
Lewis, J. R. (1995) · International Journal of Human-Computer Interaction · doi:10.1080/10447319509526110 · Cited by 2,429 · see citing works
The Electronic Journal of Business Research Methods
(2020) · The Electronic Journal of Business Research Methods · doi:10.34190/jbrm · Cited by 2,344 · see citing works
The Sources of Four Commonly Reported Cutoff Criteria: What Did They Really Say?
Lance, C. E., Butts, M. M., & Michels, L. C. (2006) · Organizational Research Methods · doi:10.1177/1094428105284919 · Cited by 2,053 · see citing works
The halo effect: Evidence for unconscious alteration of judgments.
Nisbett, R. E., & Wilson, T. D. (1977) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.35.4.250 · Cited by 2,021 · see citing works
(2013) · Journal of Usability Studies archive · Cited by 1,357 · see citing works
Effect of the number of variables on measures of fit in structural equation modeling
Kenny, D. A., & McCoach, D. B. (2003) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem1003_1 · Cited by 1,231 · see citing works
(2012) · Cited by 1,032 · see citing works
SUMI: the Software Usability Measurement Inventory
Kirakowski, J., & Corbett, M. (1993) · British Journal of Educational Technology · doi:10.1111/j.1467-8535.1993.tb00076.x · Cited by 630 · see citing works
Determining what individual SUS scores mean
(2009) · Journal of Usability Studies archive · doi:10.5555/2835587.2835589 · Cited by 412 · see citing works
Self-citationResearch Methods in Human-Computer Interaction
Landauer, T. (1988) · Elsevier eBooks · doi:10.1016/b978-0-444-70536-5.50047-6 · Cited by 384 · see citing works
European Portuguese Validation of the System Usability Scale (SUS)
Martins, A. I., Rosa, A. F., Queirós, A., Silva, A., & Rocha, N. P. (2015) · Procedia Computer Science · doi:10.1016/j.procs.2015.09.273 · Cited by 326 · see citing works
Usability ratings for everyday products measured with the System Usability Scale
Kortum, P. T., & Bangor, A. (2013) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2012.681221 · Cited by 323 · see citing works
Self-citationCross-Cultural Technology DesignCreating Culture-Sensitive Technology for Local Users
Sun, H. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199744763.001.0001 · Cited by 283 · see citing works
On the dimensionality of the System Usability Scale: a test of alternative measurement models
Borsci, S., Federici, S., & Lauriola, M. (2009) · Cognitive Processing · doi:10.1007/s10339-009-0268-9 · Cited by 275 · see citing works
Borsci, S., Federici, S., Bacci, S., Gnaldi, M., & Bartolucci, F. (2015) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2015.1064648 · Cited by 180 · see citing works
Cultural cognition in usability evaluation
Clemmensen, T., Hertzum, M., Hornbæk, K., Shi, Q., & Yammiyavar, P. G. (2009) · Interacting with Computers · doi:10.1016/j.intcom.2009.05.003 · Cited by 155 · see citing works
Designing User Interfaces for International Use
Nielsen, J. (1990) · Medical Entomology and Zoology · Cited by 145 · see citing works
Revisiting the factor structure of the system usability scale
Lewis, J. R., & Sauro, J. (2017) · Journal of Usability Studies archive · doi:10.5555/3190867.3190870 · Cited by 113 · see citing works
Introducing ATMs in India: a contextual inquiry
Angeli, A. D., Athavankar, U., Joshi, A. N., Coventry, L., & Johnson, G. I. (2003) · Interacting with Computers · doi:10.1016/j.intcom.2003.11.003 · Cited by 101 · see citing works
Psychometric Properties of the Persian Language Version of the System Usability Scale
Dianat, I., Ghanbari, Z., & AsghariJafarabadi, M. (2014) · Tabriz University of Medical Sciences · doi:10.5681/hpp.2014.011 · Cited by 83 · see citing works
Frandsen-Thorlacius, O., Hornbæk, K., Hertzum, M., & Clemmensen, T. (2009) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518708 · Cited by 67 · see citing works
An Overview of a Decade of Journal Publications about Culture and Human-Computer Interaction (HCI)
Clemmensen, T., & Roese, K. (2010) · IFIP International Federation for Information Processing/IFIP · doi:10.1007/978-3-642-11762-6_9 · Cited by 61 · see citing works
A Slovene Translation of the System Usability Scale: The SUS-SI
Blažica, B., & Lewis, J. R. (2014) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2014.986634 · Cited by 60 · see citing works
Is It Time to Go Positive? Assessing the Positively Worded System Usability Scale (SUS)
Kortum, P. T., Acemyan, C. Z., & Oswald, F. L. (2020) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720819881556 · Cited by 58 · see citing works
Self-citationAlGhannam, B. A., Albustan, S. A., Al-Hassan, A. A., & Albustan, L. A. (2017) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2017.1388099 · Cited by 57 · see citing works
Cultural differences in smartphone user experience evaluation
Walsh, T., Nurkka, P., & Walsh, R. (2010) · International Conference on Mobile and Ubiquitous Multimedia (MUM) · doi:10.1145/1899475.1899499 · Cited by 44 · see citing works
Cultural effects in usability assessment
Yeo, A. W. (1998) · doi:10.1145/286498.286536 · Cited by 41 · see citing works
Pre-testing of Polish Translation of System Usability Scale (SUS)
Borkowska, A., & Jach, K. (2016) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-46583-8_12 · Cited by 36 · see citing works
Towards a Theory of Cultural Usability: A Comparison of ADA and CM-U Theory
Clemmensen, T. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02806-9_48 · Cited by 29 · see citing works
Seddig, D., & Lomazzi, V. (2019) · Social Science Research · doi:10.1016/j.ssresearch.2019.102328 · Cited by 23 · see citing works
Exploring the Impact of Cultures on Web Usability Test
Hsieh, H. C. L. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-21753-1_6 · Cited by 9 · see citing works
Jönsson, O., Haak, M., Tomsone, S., Iwarsson, S., Schmidt, S., Mårtensson, K., Svensson, T., & Slaug, B. (2016) · Lund University Publications (Lund University) · Cited by 7 · see citing works
Flagged first, then by citations
2 of the 42 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis
Hyzy, M., Bond, R., Mulvenna, M., Bai, L., Dix, A., Leigh, S., & Hunt, S. (2022) · JMIR mHealth and uHealth · doi:10.2196/37290 · Cited by 510 · see citing works
“The study found that these SUS versions were adequately adapted; however, cultural differences had to be highlighted [14].”
BackgroundTranslation and Cross-Cultural Adaptation of the System Usability Scale to Brazilian Portuguese
Lourenço, D. F., Carmona, E. V., & Lopes, M. H. B. D. M. (2022) · Aquichan · doi:10.5294/aqui.2022.22.2.8 · Cited by 71 · see citing works
Daling, L. M., Tenbrock, M., Isenhardt, I., & Schlittmeier, S. J. (2023) · Applied Ergonomics · doi:10.1016/j.apergo.2023.104021 · Cited by 49 · see citing works
Altorfer, P., Adcock, M., de Bruin, E. D., Gräf, F., & Giannouli, E. (2021) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2021.739948 · Cited by 30 · see citing works
Dittli, J., Meyer, J. T., Gantenbein, J., Bützer, T., Ranzani, R., Linke, A. D., Curt, A. E. P., Gassert, R., & Lambercy, O. (2023) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-023-01284-8 · Cited by 28 · see citing works
Liu, P., Jiang, Z., Li, T., Wang, G., Wang, R., & Xu, Z. (2021) · Accident Analysis & Prevention · doi:10.1016/j.aap.2021.106383 · Cited by 29 · see citing works
Manser, P., Poikonen, H., & de Bruin, E. D. (2023) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2023.1163388 · Cited by 28 · see citing works
Atik, E., Stricker, J. H., Schückes, M., & Pittig, A. (2023) · JMIR Mental Health · doi:10.2196/44742 · Cited by 25 · see citing works
Gong, P., Lu, Y., Lovreglio, R., Xing-guang, Y., & Deng, Y. (2024) · Safety Science · doi:10.1016/j.ssci.2024.106561 · Cited by 21 · see citing works
Searching of Clinical Trials Made Easier in cBioPortal Using Patients' Genetic and Clinical Profiles
Unberath, P., Mahlmeister, L., Reimer, N., Busch, H. S., Boerries, M., & Christoph, J. (2022) · Applied Clinical Informatics · doi:10.1055/s-0042-1743560 · Cited by 19 · see citing works
Docter, M. W., de Vries, T. N. D., Nguyen, H. D., & van Keulen, H. (2024) · Education Sciences · doi:10.3390/educsci14050540 · Cited by 22 · see citing works
Kopka, M., Slagman, A. C., Schorr, C., Krampe, H., Altendorf, M. B., Balzer, F., Bolanaki, M., Kuschick, D., Möckel, M., Napierala, H., et al. (2024) · Smart Health · doi:10.1016/j.smhl.2024.100517 · Cited by 18 · see citing works
Siebert, J. N., Gosetto, L., Sauvage, M., Bloudeau, L., Suppan, L., Rodieux, F., Haddad, K., Hugon, F., Gervaix, A., Lovis, C., et al. (2022) · JMIR Human Factors · doi:10.2196/35399 · Cited by 22 · see citing works
Perotti, L., Stamm, O., Dietrich, M. R., Buchem, I., & Müller‐Werdan, U. (2024) · Universal Access in the Information Society · doi:10.1007/s10209-024-01124-z · Cited by 23 · see citing works
Reichold, M., Heß, M., Kolominsky‐Rabas, P. L., Graessel, E., & Prokosch, H. (2021) · JMIR Formative Research · doi:10.2196/31649 · Cited by 17 · see citing works
Zimmermann, J., Morf, H., Scharf, F., Knitza, J., Möller, H., Muehlensiepen, F., Nathrath, M., Orlemann, T., Voelker, T., & Deckers, M. (2024) · JMIR Human Factors · doi:10.2196/57771 · Cited by 15 · see citing works
Beyeler, M., Légeret, C., Kiwitz, F., & van der Horst, K. (2023) · JMIR Human Factors · doi:10.2196/47913 · Cited by 14 · see citing works
GazeHand: A Gaze-Driven Virtual Hand Interface
Jeong, J., Kim, S.-H., Yang, H.-J., Lee, G., & Kim, S. (2023) · IEEE Access · doi:10.1109/access.2023.3337372 · Cited by 14 · see citing works
Albrink, K., Schröder, D., Joos, C., Müller, F., & Noack, E. M. (2024) · JMIR Human Factors · doi:10.2196/47755 · Cited by 12 · see citing works
Tacke, T., Nohl-Deryk, P., Lingwal, N., Reimer, L. M., Starnecker, F., Güthlin, C., Gerlach, F. M., Schunkert, H., Jonas, S., & Müller, A. (2024) · Digital Health · doi:10.1177/20552076231225168 · Cited by 14 · see citing works
Supporting Decision-Making for Promoting Teaching and Learning Innovation
Kotorov, I., Krasylnykova, Y., Pérez‐Sanagustín, M., Mansilla, F., & Broisin, J. (2024) · Journal of Learning Analytics · doi:10.18608/jla.2024.8131 · Cited by 12 · see citing works
Baltaxe, E., Hsieh, H. W., Roca, J., & Cano, I. (2022) · Journal of Medical Internet Research · doi:10.2196/40976 · Cited by 12 · see citing works
Measuring Perceived Usability in Chinese Questionnaires: mTAM, SUS, and UMUX
Wang, Y., & Wang, H. (2021) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2021.1979291 · Cited by 13 · see citing works
Behr, S., Fenski, F., Boettcher, J., Knaevelsrud, C., Hammelrath, L., Kovacs, G., Schirmer, W., Petrick, H., Becker, P., & Schaeuffele, C. (2024) · Internet Interventions · doi:10.1016/j.invent.2024.100723 · Cited by 11 · see citing works
Xu, Z., Wang, G., Zhai, S., & Liu, P. (2025) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2023.2176986 · Cited by 12 · see citing works
Gatter, S., Brukamp, K., Adolf, D., Zerth, J., Lorenzl, S., & Weck, C. E. (2022) · BMC Palliative Care · doi:10.1186/s12904-022-01088-y · Cited by 11 · see citing works
Berkman, M. İ., & Şahin, Ş. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2121049 · Cited by 11 · see citing works
Comparison of German Translations of the System Usability Scale – Which to Take?
Brix, T. J., Janssen, A., Storck, M., & Varghese, J. (2023) · Studies in health technology and informatics · doi:10.3233/shti230699 · Cited by 13 · see citing works
Perrig, S. A. C., von Felten, N., Vollenwyder, B., & Opwis, K. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2434720 · Cited by 14 · see citing works
Swedish Version of the System Usability Scale: Translation, Adaption, and Psychometric Evaluation
Persson, H. Å., Castor, C., Andersson, N., & Hylén, M. (2025) · JMIR Human Factors · doi:10.2196/64210 · Cited by 18 · see citing works
Baumgartner, J., Sonderegger, A., & Sauer, J. (2023) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2023.103116 · Cited by 10 · see citing works
O’Sullivan, S., Krautwald, J., & Schneider, H. (2024) · BMC Emergency Medicine · doi:10.1186/s12873-024-01034-6 · Cited by 9 · see citing works
Evaluating Usability of Mobile Augmented Reality System for Enhancing the Learning Experience
Dutta, R., Mantri, A., Singh, G., Kumar, A., & Kaur, D. P. (2021) · International Conference on Image Information Processing (ICIIP) · doi:10.1109/iciip53038.2021.9702603 · Cited by 9 · see citing works
Krafft, J., Barisch‐Fritz, B., Krell‐Roesch, J., Trautwein, S., Scharpf, A., & Wöll, A. (2023) · JMIR Aging · doi:10.2196/46480 · Cited by 10 · see citing works
Zeiler, M., Dietzel, N., Haug, F., Haug, J., Kammerer, K., Pryss, R. C., Heuschmann, P. U., Graessel, E., Kolominsky‐Rabas, P. L., & Prokosch, H. (2025) · JMIR Human Factors · doi:10.2196/65022 · Cited by 8 · see citing works
Guisñan, P. A. B., Lara, J. A., Cano, A., Cerezo, R., & Romero, C. (2026) · Universal Access in the Information Society · doi:10.1007/s10209-025-01278-4 · Cited by 9 · see citing works
Rostetter, R., Jenni, B., Eggmann, S., Meyer, J. T., & Schmitt, K. (2022) · Technology and Health Care · doi:10.3233/thc-213511 · Cited by 7 · see citing works
Mlakar, I., Smrke, U., Flis, V., Bergauer, A., Kobilica, N., Kampič, T., Horvat, S., Vidovič, D., Musil, B., & Plohl, N. (2022) · Digital Health · doi:10.1177/20552076221129068 · Cited by 8 · see citing works
Németh, A., & Bekmukhambetova, A. (2022) · Periodica Polytechnica Social and Management Sciences · doi:10.3311/ppso.20512 · Cited by 7 · see citing works
Landmann, H., Ziegler, W., & Gaschler, R. (2024) · Environment Development and Sustainability · doi:10.1007/s10668-024-05028-z · Cited by 6 · see citing works
Zeiler, M., Dietzel, N., Kammerer, K., Frick, U., Pryss, R. C., Heuschmann, P. U., Prokosch, H., Graessel, E., & Kolominsky‐Rabas, P. L. (2025) · BMJ Open · doi:10.1136/bmjopen-2024-087256 · Cited by 6 · see citing works
Núñez, I., Cano, E. E., Cruz, E., Concepción, D. H., Navarro, N. D. C., & Rovetto, C. (2024) · Applied Sciences · doi:10.3390/app14051751 · Cited by 9 · see citing works
Driving across Markets: An Analysis of a Human–Machine Interface in Different International Contexts
Sogemeier, D., Forster, Y., Naujoks, F., Krems, J. F., & Keinath, A. (2024) · Information · doi:10.3390/info15060349 · Cited by 6 · see citing works
Podda, J., Grange, E., Susini, A., Tacchino, A., Antonio, F. D., Pedullà, L., Brichetto, G., & Ponzio, M. (2024) · JMIR Human Factors · doi:10.2196/58079 · Cited by 7 · see citing works
Kotama, I. N. D., Funabiki, N., Panduman, Y. Y. F., Brata, K. C., Pradhana, A. A. S., Noprianto, N., & Desnanjaya, I. G. M. N. (2025) · Information · doi:10.3390/info16020108 · Cited by 6 · see citing works
Ma, T., Chang, K., Alyusuf, A., Bajracharya, E., Washio, Y., Kelly, P. J., Bellad, R., Mahantashetti, N. S., Charantimath, U., Short, V. L., et al. (2022) · JMIR Formative Research · doi:10.2196/32795 · Cited by 6 · see citing works
Gamal, S., Elseasi, A. M. A., Sabry, N. A., & Farid, S. F. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01742-8 · Cited by 5 · see citing works
Huang, W., Ning, K., Koh, S. H. E., Mi, G., Yu, F., Liu, Y., Stegmueller, D., Powers, K. A., Baral, S., Sullivan, P. S., et al. (2025) · JMIR Research Protocols · doi:10.2196/69536 · Cited by 5 · see citing works
Zörrer, H., Hämmerle, A., Kollingbaum, M. J., Ebenhofer, G., Steiner, F., Ikeda, M., Fixl, S., Widmoser, F., & Pichler, A. (2025) · Applied Sciences · doi:10.3390/app152212230 · Cited by 5 · see citing works
Yuhui, W., Zhang, Y., & Chen, Y. (2024) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2024.103258 · Cited by 5 · see citing works
Perotti, L., Stamm, O., Ferizaj, D., Dietrich, M. R., Buchem, I., & Müller‐Werdan, U. (2025) · BMC Public Health · doi:10.1186/s12889-025-22242-0 · Cited by 5 · see citing works
Rostetter, R., Jenni, B., Eggmann, S., Meyer, J. T., & Schmitt, K. (2022) · ARBOR - Bern University of Applied Sciences Repository · Cited by 5 · see citing works
Schäper, P., Hanke, A., Jonas, S., Nissen, L., Reimer, L. M., Schweizer, F., Wagner, M., Rolke, K., Rosendahl, C., Tillmann, J., et al. (2025) · JMIR Formative Research · doi:10.2196/76010 · Cited by 4 · see citing works
Hofmann, V. E., Glombiewski, J. A., Kininger, F., & Scholten, S. (2024) · BMJ Open · doi:10.1136/bmjopen-2024-089319 · Cited by 5 · see citing works
Zarski, A., Sextl-Plötz, T., Schmidt-Hantke, J., Hess, N. S., & Buntrock, C. (2025) · Frontiers in Public Health · doi:10.3389/fpubh.2025.1626428 · Cited by 4 · see citing works
Almayyan, W. I., Alsuwaidi, M., & AlGhannam, B. A. (2021) · International Journal of Computer Applications · doi:10.5120/ijca2021921757 · Cited by 4 · see citing works
Motivational benefits and usability of a handheld Augmented Reality game for anatomy learning
Blattgerste, J., Franssen, J., Arztmann, M., & Pfeiffer, T. (2022) · IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR) · doi:10.1109/aivr56993.2022.00056 · Cited by 4 · see citing works
Chinese CSUQ: Cross-Cultural Adaptation and Evaluation of Measurement Properties
Wang, Y., Xie, Y., Qiao, Y., Xia, Z., & Chen, Y. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2266795 · Cited by 4 · see citing works
User Profiles and Engagement in a Hypertension Self-Management App: Cross-Sectional Survey
Muehlensiepen, F., May, S., Seifert, F., Wengemuth, E., Johannsen, O., Middeke, M., Heinze, M., Petit, P., Vuillerme, N., Spethmann, S., et al. (2026) · Journal of Medical Internet Research · doi:10.2196/83075 · Cited by 3 · see citing works
Halbeisen, G., Timmesfeld, N., & Paslakis, G. (2025) · BMJ Open · doi:10.1136/bmjopen-2024-097886 · Cited by 4 · see citing works
Blended learning environments to foster self-directed learning
Bergamin, N., Bergamin, P. B., Breed, B., Bunt, B. J., Dhlamini, J. P., Jagals, D., Kemp, A. C., Kruger, C., Kruger, D. J. D., Lotz, C., et al. (2022) · NWU self-directed learning series · doi:10.4102/aosis.2022.bk366 · Cited by 4 · see citing works
The Development of Interactive Games for Covid-19 Prevention Using Indonesian Health Protocols
Kaffi, A., Rizqi, M., Laksono, G. A., Julian, A., & Gumelar, A. B. (2022) · JURNAL TEKNIK INFORMATIKA · doi:10.15408/jti.v15i2.25649 · Cited by 3 · see citing works
Halder, S., Afsari, K., & Reichard, G. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2381931 · Cited by 3 · see citing works
Atik, E., Stricker, J., Schückes, M., & Pittig, A. (2022) · doi:10.2196/preprints.44742 · Cited by 23 · see citing works
Self-control tasks with self-explanation prompts as a component of selfdirected online learning
Werlen, E., Mirata, V., Jagals, D., & Bergamin, N. (2022) · NWU self-directed learning series · doi:10.4102/aosis.2022.bk366.09 · Cited by 2 · see citing works
The Role of Personality and Cognitive Ability in the Measurement of Usability
Wilczewski, H., Mulfinger, E., Oswald, F. L., & Kortum, P. T. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2223823 · Cited by 2 · see citing works
Self-citationBaumgartner, J., Sonderegger, A., & Sauer, J. (2024) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2024.2338333 · Cited by 2 · see citing works
Büttiker, J., Marks, D., Hanke, M., Ludyga, S., Marsico, P., Eggimann, B., & Giannouli, E. (2024) · Frontiers in Neurology · doi:10.3389/fneur.2024.1402145 · Cited by 2 · see citing works
Atik, E., Hornstein, S., Reinking, E., & Schückes, M. (2025) · Internet Interventions · doi:10.1016/j.invent.2025.100815 · Cited by 2 · see citing works
Orthodontic diagnosis and usability of the web-based e-learning application orthotrainer
Lang, N. A., Lang, F. A., Lemos, M., Bell, L., Fink, D., Niederau, C., Mücke, K., Becker, K., Kruse, T., Braumann, B., et al. (2025) · BMC Medical Education · doi:10.1186/s12909-025-07997-9 · Cited by 2 · see citing works
Exploration of interaction modality for civil aircraft flying task: A laboratory study
Yu, R., Sun, Y., & Guo, C. (2025) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2025.103823 · Cited by 2 · see citing works
The Passkey Promise: A Comparative Usability Study of MFA Methods
Kupris, E., & Schreck, T. (2026) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp63933.2026.00055 · Cited by 2 · see citing works
Design and Implementation of a Gesture-Aided E-Learning Platform
Kremser, W., Kranzinger, S., & Bernhart, S. (2021) · Sensors · doi:10.3390/s21238042 · Cited by 2 · see citing works
Do Not Shoot the Messenger: Effect of System Critical Feedback on User-Perceived Usability
Melissourgos, G., & Katsanos, C. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35599-8_30 · Cited by 2 · see citing works
Su, J., Chen, K.-Y., Wu, S., Lee, K., & Ho, S. (2023) · Digital Health · doi:10.1177/20552076231207206 · Cited by 3 · see citing works
Pirus, A. E., Yulin, J., Danuaji, M. F., & Sukmaningsih, D. W. (2023) · International Conference on ICT for Smart Society (ICISS) · doi:10.1109/iciss59129.2023.10291901 · Cited by 2 · see citing works
Semantic Highlighting: Visual Guidance in Multimodal Gaze-Keyboard-Based Interaction
Eggenkemper, F., Feldmann, L., Sontowski, N., Kiel, A., Rothkopf, C. A., & Mertens, R. G. (2025) · IEEE International Conference on Semantic Computing (ICSC) · doi:10.1109/icsc64641.2025.00017 · Cited by 2 · see citing works
Sari, M. A., & Tania, K. D. (2022) · Jurnal Bisnis Manajemen dan Ekonomi · doi:10.47747/jbme.v3i3.763 · Cited by 2 · see citing works
Behr, S., Fenski, F., Böttcher, J., Knaevelsrud, C., Hammelrath, L., Kovacs, G., Schirmer, W., Becker, P., & Schaeuffele, C. (2023) · doi:10.31234/osf.io/8xu5z · Cited by 2 · see citing works
Chojecki, P., Strazdas, D., Przewozny, D., Gard, N., Runde, D., Hoerner, N., Al-Hamadi, A., Eisert, P., & Bosse, S. (2023) · doi:10.20944/preprints202304.0415.v2 · Cited by 7 · see citing works
Friedrich, I., Tasliarmut, M., Hoffmann, H., Schwarzkopf, M., & Bullinger, A. C. (2024) · HMD Praxis der Wirtschaftsinformatik · doi:10.1365/s40702-024-01115-x · Cited by 1 · see citing works
The Use of Mobile Apps in Adolescent Psychotherapy: Assessment of Psychotherapists’ Perspectives
Wüllner, S., Hermenau, K., Hecker, T., & Siniatchkin, M. (2025) · JMIR Formative Research · doi:10.2196/65788 · Cited by 1 · see citing works
Building a Realistic Virtual Luge Experience Using Photogrammetry
Hollaus, B., Kreiner, J., Gallinat, M., Hayotte, M., & Yu, D. (2025) · Sensors · doi:10.3390/s25082568 · Cited by 1 · see citing works
Evaluation of Human-Artificial Hybrid Tutoring System for Mediation of Engagement in E-Learning
Pereira, A. J., Gomes, A. S., & Primo, T. T. (2025) · Revista Brasileira de Informática na Educação · doi:10.5753/rbie.2025.4988 · Cited by 1 · see citing works
Visual Instruction as an Intuitive Interface for Robotic Sorting
Müller, A. T., & Stache, N. C. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-93429-2_12 · Cited by 1 · see citing works
Jeong, J., Kim, S.-H., Yang, H.-J., Lee, G., & Kim, S. (2025) · Electronics · doi:10.3390/electronics14132530 · Cited by 1 · see citing works
Sefira, P. R., Sardi, I. L., & Anbiya, D. R. (2025) · International Conference on Data Science and Its Applications (ICoDSA) · doi:10.1109/icodsa67155.2025.11157436 · Cited by 1 · see citing works
Hausdörfer, T., Kükemück, S., Marschner, F., Biermann, J., Kanzow, P., Wiegand, A., & Lechte, C. (2025) · Journal of Prosthetic Dentistry · doi:10.1016/j.prosdent.2025.10.006 · Cited by 1 · see citing works
Exploration and Visualization of a Legal Knowledge Graph: A Human-Centered Approach
Wehnert, S., Bontha, P. K., Lüders, K., Nguyen, H. H. G., & Luca, E. W. D. (2025) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3746252.3761003 · Cited by 1 · see citing works
Patient Perceptions of Blockchain-Based Health Information Exchange: User-Centered Design Study
Guse, R., Hu, S., Thiebes, S., Erler, C., Caridia, C., Stork, W., Gersch, M., & Sunyaev, A. (2025) · Journal of Medical Internet Research · doi:10.2196/78849 · Cited by 1 · see citing works
A Review of The Evolution of Cross-Cultural Design Research
Yu, D., Liu, Y., Lei, X., & Rau, P. P. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2607560 · Cited by 1 · see citing works
Jung, L., Guth, M., Schönfeld, P., Fuchs, M., Vatter, H., Selaskowski, B., Wiebe, A., Philipsen, A., & Braun, N. (2026) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-026-00613-7 · Cited by 1 · see citing works
Li, Z., Su, J., & Wang, Y. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2695931 · Cited by 1 · see citing works
Адаптация опросника System Usability Scale (SUS) на русскоязычной выборке
Косова, Е., Глебко, Н., & Gorbunova, E. S. (2024) · Психологические исследования · doi:10.54359/ps.v17i95.1593 · Cited by 1 · see citing works
Pointner, L., Steven, A., Paal, P., & Glarcher, M. (2024) · Zeitschrift für Evidenz Fortbildung und Qualität im Gesundheitswesen · doi:10.1016/j.zefq.2024.11.001 · Cited by 1 · see citing works
Orman, B., & Özen, Ç. (2024) · International Symposium on Innovative Approaches in Smart Technologies (ISAS) · doi:10.1109/isas64331.2024.10845557 · Cited by 1 · see citing works
Usability Evaluation in Knowledge Management System (KMS) Using System Usability Scale (SUS) Method
Sari, M. A., & Tania, K. D. (2021) · The IJICS (International Journal of Informatics and Computer Science) · doi:10.30865/ijics.v6i3.4244 · Cited by 1 · see citing works
Baltaxe, E., Hsieh, M., Roca, J., & Cano, I. (2022) · doi:10.2196/preprints.40976
Ruffieux, S., Torche, S., Caon, M., & Khaled, O. A. (2022) · Conference on l'Interaction Homme-Machine (IHM) · doi:10.1145/3500866.3516375
- Authors
- Gao, M., Kortum, P., & Oswald, F. L.
- Affiliations
- Rice University (US)
- Corresponding author
- Kortum, Philip
- Venue
- International Journal of Human–Computer Interaction
- Publisher
- Informa UK Limited
- Published
- 2020-08-19
- Volume
- 36
- Issue
- 20
- Pages
- 1883-1901
- ISSN
- 1044-7318 (ISSN-L)
- 1532-7590
- OpenAlex
- W3062812444
- Cited by
- 140
- References
- 42
- Citations by year
- 2026: 23 · 2025: 36 · 2024: 31 · 2023: 22 · 2022: 20 · 2021: 8
- FWCI
- 9.09
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Human-Computer Interaction (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- System Usability Scale, usability measurement, cross-lingual translation, psychometric validation, scale reliability, criterion validity, everyday products, Arabic language, Chinese, French language, German, Hindi, Spanish language
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review