On the dimensionality of the System Usability Scale: a test of alternative measurement models

Borsci, Simone; Federici, Stefano; Lauriola, Marco

doi:10.1007/s10339-009-0268-9

Cited by 275Usability and User Interface DesignPsychometric Methodologies and TestingTechnology Adoption and User Behaviour

On the dimensionality of the System Usability Scale: a test of alternative measurement models

Borsci, Simone, Federici, Stefano, Lauriola, Marco·2009·Cognitive Processing

DOI 10.1007/s10339-009-0268-9

Open this paper in CoChat — free account

Abstract

The System Usability Scale (SUS), developed by Brooke (Usability evaluation in industry, Taylor & Francis, London, pp 189-194, 1996), had a great success among usability practitioners since it is a quick and easy to use measure for collecting users' usability evaluation of a system. Recently, Lewis and Sauro (Proceedings of the human computer interaction international conference (HCII 2009), San Diego CA, USA, 2009) have proposed a two-factor structure-Usability (8 items) and Learnability (2 items)-suggesting that practitioners might take advantage of these new factors to extract additional information from SUS data. In order to verify the dimensionality in the SUS' two-component structure, we estimated the parameters and tested with a structural equation model the SUS structure on a sample of 196 university users. Our data indicated that both the unidimensional model and the two-factor model with uncorrelated factors proposed by Lewis and Sauro (Proceedings of the human computer interaction international conference (HCII 2009), San Diego CA, USA, 2009) had a not satisfactory fit to the data. We thus released the hypothesis that Usability and Learnability are independent components of SUS ratings and tested a less restrictive model with correlated factors. This model not only yielded a good fit to the data, but it was also significantly more appropriate to represent the structure of SUS ratings.

Integrity signals

Registry

Crossref · 10.1007/s10339-009-0268-9

Cites

15 of 15 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Studies have replicated inconsistent findings pointing towards the two-factor model of the SUS.
“Since then, studies replicated inconsistent findings pointing towards this two-factor model (e.g. ) [23]”
From Dimensionality of the system usability scale among professionals using internet-based interventions for depression: a confirmatory factor analysis (2020) · cites this paper as [23]

Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788 · see citing works
Alternative Ways of Assessing Model Fit
Browne, M. W., & Cudeck, R. (1992) · Sociological Methods & Research · doi:10.1177/0049124192021002005 · Cited by 27,200 · see citing works
Comparative fit indexes in structural models.
Bentler, P. M. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.107.2.238 · Cited by 25,266 · see citing works
Testing Structural Equation Models.
Mueller, C. W., Bollen, K. A., & Long, J. S. (1994) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2074955 · Cited by 14,211 · see citing works
Evaluating the use of exploratory factor analysis in psychological research.
Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999) · Psychological Methods · doi:10.1037/1082-989x.4.3.272 · Cited by 9,587 · see citing works
SUS: A 'Quick and Dirty' Usability Scale
(1996) · Usability Evaluation In Industry · doi:10.1201/9781498710411-35 · Cited by 8,989 · see citing works
Testing Structural Equation Models.
Clogg, C. C., Bollen, K. A., & Long, J. S. (1995) · Social Forces · doi:10.2307/2580595 · Cited by 8,244 · see citing works
Reliability and Validity Assessment
Carmines, E., & Zeller, R. (1979) · doi:10.4135/9781412985642 · Cited by 5,884 · see citing works
A scaled difference chi-square test statistic for moment structure analysis
Satorra, A., & Bentler, P. M. (2001) · Psychometrika · doi:10.1007/bf02296192 · Cited by 5,282 · see citing works
An Empirical Evaluation of the System Usability Scale
Bangor, A., Kortum, P. T., & Miller, J. T. (2008) · International Journal of Human–Computer Interaction · doi:10.1080/10447310802205776 · Cited by 5,181 · see citing works
Reliability and Validity Assessment
Kurian, G. T. (2011) · CQ Press eBooks · doi:10.4135/9781608712434.n1341 · Cited by 5,045 · see citing works
Principles and practice in reporting structural equation analyses.
McDonald, R. P., & Ho, M.-H. R. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.64 · Cited by 4,734 · see citing works
Usability Evaluation In Industry
(1996) · CRC Press eBooks · doi:10.1201/9781498710411 · Cited by 4,400 · see citing works
The Factor Structure of the System Usability Scale
Lewis, J. R., & Sauro, J. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-02806-9_12 · Cited by 1,278 · see citing works
On specifying the null model for incremental fit indices in structural equation modeling.
Widaman, K. F., & Thompson, J. S. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.1.16 · Cited by 401 · see citing works

Flagged first, then by citations

Sorted by citations

The System Usability Scale: Past, Present, and Future
Lewis, J. R. (2018) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2018.1455307 · Cited by 1,958 · see citing works
When designing usability questionnaires, does it hurt to be positive?
Sauro, J., & Lewis, J. R. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979266 · Cited by 363 · see citing works
Usability: Lessons Learned … and Yet to Be Learned
Lewis, J. R. (2014) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2014.930311 · Cited by 317 · see citing works
Measuring Perceived Usability: The CSUQ, SUS, and UMUX
Lewis, J. R. (2018) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2017.1418805 · Cited by 302 · see citing works
Validation of the System Usability Scale (SUS)
Peres, S. C., Pham, T. M. T., & Phillips, R. G. (2013) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931213571043 · Cited by 274 · see citing works
UMUX-LITE: when there's no time for the SUS
Lewis, J. R., Utesch, B. S., & Maher, D. E. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2481287 · Cited by 270 · see citing works
The System Usability Scale
Grier, R. A., Bangor, A. W., Kortum, P. T., & Peres, S. C. (2013) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931213571042 · Cited by 222 · see citing works
Measuring the Usability of Mobile Applications for Phones and Tablets
Kortum, P., & Sorber, M. (2015) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2015.1064658 · Cited by 222 · see citing works
The effect of experience on system usability scale ratings
McLellan, S. G., Muddimer, A., & Peres, S. C. (2012) · doi:10.5555/2835476.2835478 · Cited by 190 · see citing works
Assessing User Satisfaction in the Era of User Experience: Comparison of the SUS, UMUX, and UMUX-LITE as a Function of Product Experience
Borsci, S., Federici, S., Bacci, S., Gnaldi, M., & Bartolucci, F. (2015) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2015.1064648 · Cited by 180 · see citing works
Self-citation
Effects of interactive patient smartphone support app on drug adherence and lifestyle changes in myocardial infarction patients: A randomized study
Johnston, N., Bodegård, J., Jerström, S., Åkesson, J., Brorsson, H., Alfredsson, J., Albertsson, P., Karlsson, J., & Varenhorst, C. (2016) · American Heart Journal · doi:10.1016/j.ahj.2016.05.005 · Cited by 174 · see citing works
Psychometric Evaluation of the F-SUS: Creation and Validation of the French Version of the System Usability Scale
Gronier, G., & Baudet, A. (2021) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2021.1898828 · Cited by 166 · see citing works
USABILITY AND USER EXPERIENCE: DESIGN AND EVALUATION
Lewis, J. R., & Sauro, J. (2021) · Wiley eBooks · doi:10.1002/9781119636113.ch38 · Cited by 156 · see citing works
Multi-language toolkit for the system usability scale
Gao, M., Kortum, P., & Oswald, F. L. (2020) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1801173 · Cited by 140 · see citing works
ICT-based system to predict and prevent falls (iStoppFalls): results from an international multicenter randomized controlled trial
Gschwind, Y. J., Eichberg, S., Ejupi, A., Rosario, H. D., Kroll, M. A., Marston, H. R., Drobics, M., Annegarn, J., Wieching, R., Lord, S. R., et al. (2015) · European Review of Aging and Physical Activity · doi:10.1186/s11556-015-0155-6 · Cited by 131 · see citing works
Measuring Perceived Usability: The SUS, UMUX-LITE, and AltUsability
Lewis, J. R., Utesch, B. S., & Maher, D. E. (2015) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2015.1064654 · Cited by 124 · see citing works
SUPR-Q: a comprehensive measure of the quality of the website user experience
Sauro, J. (2015) · Journal of Usability Studies archive · Cited by 122 · see citing works
Experienced mental workload, perception of usability, their interaction and impact on task performance
Longo, L. (2018) · PLoS ONE · doi:10.1371/journal.pone.0199661 · Cited by 122 · see citing works
“Think aloud” and “Near live” usability testing of two complex clinical decision support tools
Richardson, S. I., Mishuris, R. G., O’Connell, A., Feldstein, D., Hess, R., Smith, P. R., McCullagh, L., McGinn, T. G., & Mann, D. (2017) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2017.06.003 · Cited by 116 · see citing works
Revisiting the factor structure of the system usability scale
Lewis, J. R., & Sauro, J. (2017) · Journal of Usability Studies archive · doi:10.5555/3190867.3190870 · Cited by 113 · see citing works
Empirical evidence, evaluation criteria and challenges for the effectiveness of virtual and mixed reality tools for training operators of car service maintenance
Borsci, S., Lawson, G., & Broomé, S. (2014) · Computers in Industry · doi:10.1016/j.compind.2014.12.002 · Cited by 112 · see citing works
Self-citation
Does size matter?
Raptis, D., Tselios, N. K., Kjeldskov, J., & Skov, M. B. (2013) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/2493190.2493204 · Cited by 105 · see citing works
Exploring user experience and technology acceptance for a fall prevention system: results from a randomized clinical trial and a living lab
Vaziri, D. D., Aal, K., Ogonowski, C., von Rekowski, T., Kroll, M. A., Marston, H. R., Poveda, R., Gschwind, Y. J., Delbaere, K., Wieching, R., et al. (2016) · European Review of Aging and Physical Activity · doi:10.1186/s11556-016-0165-z · Cited by 102 · see citing works
Standardized usability questionnaires
Sauro, J., & Lewis, J. R. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-802308-2.00008-4 · Cited by 95 · see citing works
Dimensionality of the system usability scale among professionals using internet-based interventions for depression: a confirmatory factor analysis
Mol, M., van Schaik, A., Dozeman, E., Ruwaard, J., Vis, C., Ebert, D. D., Etzelmueller, A., Mathiasen, K., Moles, B., Mora, T., et al. (2020) · BMC Psychiatry · doi:10.1186/s12888-020-02627-8 · Cited by 92 · see citing works
It Is Me, Chatbot: Working to Address the COVID-19 Outbreak-Related Mental Health Issues in China. User Experience, Satisfaction, and Influencing Factors
Zhu, Y., Janssen, M., Wang, R., & Liu, Y. (2021) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2021.1988236 · Cited by 88 · see citing works
The Usability Construct: A Dead End?
Tractinsky, N. (2018) · Human–Computer Interaction · doi:10.1080/07370024.2017.1298038 · Cited by 87 · see citing works
Using virtual 3D-models in surgical planning: workflow of an immersive virtual reality application in liver surgery
Boedecker, C., Huettl, F., Saalfeld, P., Paschold, M., Kneist, W., Baumgart, J., Preim, B., Hansen, C., Lang, H., & Huber, T. (2021) · Langenbeck s Archives of Surgery · doi:10.1007/s00423-021-02127-7 · Cited by 85 · see citing works
Supporting end users to control their smart home: design implications from a literature review and an empirical investigation
Caivano, D., Fogli, D., Lanzilotti, R., Piccinno, A., & Cassano, F. (2018) · Journal of Systems and Software · doi:10.1016/j.jss.2018.06.035 · Cited by 84 · see citing works
Usability, user experience and mental workload in a mobile Augmented Reality application for digital storytelling in cultural heritage
Paolis, L. D. D., Gatto, C., Corchia, L., & Luca, V. D. (2022) · Virtual Reality · doi:10.1007/s10055-022-00712-9 · Cited by 63 · see citing works
Chinese System Usability Scale: Translation, Revision, Psychological Measurement
Wang, Y., Lei, T., & Liu, X. (2019) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2019.1700644 · Cited by 83 · see citing works
The Relationship Between System Effectiveness and Subjective Usability Scores Using the System Usability Scale
Kortum, P. T., & Peres, S. C. (2014) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2014.904177 · Cited by 81 · see citing works
Efficiency and Patient-Reported Outcome Measures From Clinic to Home: The Human Empowerment Aging and Disability Program for Digital-Health Rehabilitation
Isernia, S., Pagliari, C., Jonsdottir, J., Castiglioni, C., Gindri, P., Gramigna, C., Palumbo, G., Salza, M., Molteni, F., Baglio, F., et al. (2019) · Frontiers in Neurology · doi:10.3389/fneur.2019.01206 · Cited by 78 · see citing works
Usability of Videogame-Based Dexterity Training in the Early Rehabilitation Phase of Stroke Patients: A Pilot Study
Vanbellingen, T., Filius, S. J., Nyffeler, T., & van Wegen, E. E. H. (2017) · Frontiers in Neurology · doi:10.3389/fneur.2017.00654 · Cited by 77 · see citing works
Epic Allies: Development of a Gaming App to Improve Antiretroviral Therapy Adherence Among Young HIV-Positive Men Who Have Sex With Men
LeGrand, S., Muessig, K. E., McNulty, T., Soni, K., Knudtson, K., Lemann, A., Nwoko, N., & Hightow‐Weidman, L. (2016) · JMIR Serious Games · doi:10.2196/games.5687 · Cited by 76 · see citing works
Standardized Usability Questionnaires
Sauro, J., & Lewis, J. R. (2012) · Elsevier eBooks · doi:10.1016/b978-0-12-384968-7.00008-4 · Cited by 74 · see citing works
Evaluating the effectiveness of a home-based exercise programme delivered through a tablet computer for preventing falls in older community-dwelling people over 2 years: study protocol for the Standing Tall randomised controlled trial
Delbaere, K., Valenzuela, T., Woodbury, A. M., Davies, T., Yeong, J. W., Steffens, D., Miles, L., Pickett, L., Zijlstra, G. A. R., Clemson, L. M., et al. (2015) · BMJ Open · doi:10.1136/bmjopen-2015-009173 · Cited by 71 · see citing works
Re-assessing the usability metric for user experience (UMUX) scale
Berkman, M. İ., & Karahoca, D. (2016) · Journal of Usability Studies archive · doi:10.5555/2993219.2993221 · Cited by 71 · see citing works
Measuring Perceived Usability: SUS, UMUX, and CSUQ Ratings for Four Everyday Products
Lewis, J. R. (2018) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2018.1533152 · Cited by 66 · see citing works
ICT-based system to predict and prevent falls (iStoppFalls): study protocol for an international multicenter randomized controlled trial
Gschwind, Y. J., Eichberg, S., Marston, H. R., Ejupi, A., Rosario, H. D., Kroll, M. A., Drobics, M., Annegarn, J., Wieching, R., Lord, S. R., et al. (2014) · BMC Geriatrics · doi:10.1186/1471-2318-14-91 · Cited by 64 · see citing works
Usage of Multilingual Mobile Translation Applications in Clinical Settings
Albrecht, U.-V., Behrends, M., Matthies, H. K., & von Jan, U. (2013) · JMIR mhealth and uhealth · doi:10.2196/mhealth.2268 · Cited by 60 · see citing works
A Slovene Translation of the System Usability Scale: The SUS-SI
Blažica, B., & Lewis, J. R. (2014) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2014.986634 · Cited by 60 · see citing works
Using socially assistive robots for monitoring and preventing frailty among older adults: A study on usability and user experience challenges
Olde Keizer, R. A. C. M., van Velsen, L., Moncharmont, M., Riche, B., Ammour, N., Del Signore, S., Zia, G., Hermens, H., & N’Dja, A. (2019) · Health and Technology · doi:10.1007/s12553-019-00320-9 · Cited by 57 · see citing works
Development of a virtual reality system usability questionnaire (VRSUQ)
Kim, Y. M., & Rhiu, I. (2024) · Applied Ergonomics · doi:10.1016/j.apergo.2024.104319 · Cited by 55 · see citing works
An Analysis of the Impact of Personality Traits towards Augmented Reality in Online Shopping
Lixandroiu, R. C., Cazan, A., & Maican, C. I. (2021) · Symmetry · doi:10.3390/sym13030416 · Cited by 52 · see citing works
Rule-based tools for the configuration of ambient intelligence systems: a comparative user study
Cabitza, F., Fogli, D., Lanzilotti, R., & Piccinno, A. (2016) · Multimedia Tools and Applications · doi:10.1007/s11042-016-3511-2 · Cited by 51 · see citing works
Exergaming-Based Dexterity Training in Persons With Parkinson Disease: A Pilot Feasibility Study
van Beek, J. J. W., van Wegen, E. E. H., Bohlhalter, S., & Vanbellingen, T. (2019) · Neurology Report · doi:10.1097/npt.0000000000000278 · Cited by 50 · see citing works
Is the LITE version of the usability metric for user experience (UMUX-LITE) a reliable tool to support rapid assessment of new healthcare technology?
Borsci, S., Buckle, P., & Walne, S. (2019) · Applied Ergonomics · doi:10.1016/j.apergo.2019.103007 · Cited by 49 · see citing works
Self-citation
Assessing Academics’ Perceptions of Blackboard Usability Using SUS and CSUQ: A Case Study during the COVID-19 Pandemic
Alhadreti, O. (2020) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2020.1861766 · Cited by 47 · see citing works
Effectiveness of a multidevice 3D virtual environment application to train car service maintenance procedures
Borsci, S., Lawson, G., Jha, B., Burges, M., & Salanitri, D. (2016) · Virtual Reality · doi:10.1007/s10055-015-0281-5 · Cited by 46 · see citing works
Self-citation
Development and Usability of a Life-Logging Behavior Monitoring Application for Obese Patients
Lee, J., Kim, J. Y., Kim, Y. S., Kim, Y. S., Koo, H. Y., Kim, S., Kim, S., Park, J. H., Han, J. S., Kil, S., et al. (2019) · Journal of Obesity & Metabolic Syndrome · doi:10.7570/jomes.2019.28.3.194 · Cited by 45 · see citing works
Psychometric Evaluation of the EMO and the SUS in the Context of a Large-Sample Unmoderated Usability Study
Lewis, J. R., Brown, J., & Mayes, D. K. (2015) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2015.1064665 · Cited by 44 · see citing works
A hybrid approach to user-oriented programming of collaborative robots
Fogli, D., Gargioni, L., Guida, G., & Tampalini, F. (2021) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2021.102234 · Cited by 44 · see citing works
Translation and Validation of the System Usability Scale in a Danish Mental Health Setting Using Digital Technologies in Treatment Interventions
Hvidt, J. C. S., Christensen, L. F., Sibbersen, C., Helweg-Jørgensen, S., Hansen, J. P., & Lichtenstein, M. B. (2019) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2019.1680922 · Cited by 43 · see citing works
Eye of the beholder: risk calculators and barriers to adoption in surgical trainees.
Leeds, I. L., Rosenblum, A. J., Wise, P. E., Watkins, A. C., Goldblatt, M. I., Haut, E. R., Efron, J. E., & Johnston, F. M. (2018) · Surgery · doi:10.1016/j.surg.2018.07.002 · Cited by 42 · see citing works
Investigating the Correspondence Between UMUX-LITE and SUS Scores
Lewis, J. R., Utesch, B. S., & Maher, D. E. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-20886-2_20 · Cited by 40 · see citing works
The impact of the input interface in a virtual environment: the Vive controller and the Myo armband
Paolis, L. T. D., & Luca, V. D. (2019) · Virtual Reality · doi:10.1007/s10055-019-00409-6 · Cited by 39 · see citing works
Critical Review of 'The Usability Metric for User Experience'
Lewis, J. R. (2013) · Interacting with Computers · doi:10.1093/iwc/iwt013 · Cited by 37 · see citing works
Nursing Diagnosis Accuracy in Nursing Education
Bertocchi, L., Dante, A., Cerra, C. L., Masotta, V., Marcotullio, A., Caponnetto, V., Ferraiuolo, F., Jones, D. A., Lancia, L., & Petrucci, C. (2023) · CIN Computers Informatics Nursing · doi:10.1097/cin.0000000000001066 · Cited by 36 · see citing works
Psychometric Properties of the Spanish Full and Short Forms of the System Usability Scale (SUS): Detecting the Effect of Negatively Worded Items
Castilla, D., Jaén, I., Suso‐Ribera, C., García‐Soriano, G., Zaragozá, I., Bretón-López, J. M., Mira, A., Díaz‐García, A., & García‐Palacios, A. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2209840 · Cited by 35 · see citing works
A Complete System for Analysis of Video Lecture Based on Eye Tracking
Zhang, X., Yuan, S.-M., Chen, M., & Liu, X. (2018) · IEEE Access · doi:10.1109/access.2018.2865754 · Cited by 28 · see citing works
The effects of touchless interaction on usability and sense of presence in a virtual environment
Paolis, L. T. D., & Luca, V. D. (2022) · Virtual Reality · doi:10.1007/s10055-022-00647-1 · Cited by 35 · see citing works
Gamification
Marston, H. R., & Hall, A. K. (2015) · Advances in medical technologies and clinical practice book series · doi:10.4018/978-1-4666-9522-1.ch005 · Cited by 33 · see citing works
ImAtHome: Making trigger-action programming easy and fun
Fogli, D., Peroni, M., & Stefini, C. (2017) · Journal of Visual Languages & Computing · doi:10.1016/j.jvlc.2017.08.003 · Cited by 31 · see citing works
Virtual Reality-Based Framework to Simulate Control Algorithms for Robotic Assistance and Rehabilitation Tasks through a Standing Wheelchair
Ortiz, J. S., Palacios-Navarro, G., Andaluz, V. H., & Guevara, B. S. (2021) · Sensors · doi:10.3390/s21155083 · Cited by 31 · see citing works
Augmenting Emerging Hospitality Services: A Playful Immersive Experience to Foster Interactions among Locals and Visitors
Prandi, C., Nisi, V., Ceccarini, C., & Nunes, N. (2021) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2021.2012382 · Cited by 31 · see citing works
Augmenting Surgery: Medical Students’ Assessment and Ergonomics of 3D Holograms vs. CT Scans for Pre-Operative Planning
Triberti, S., Petrella, F., Gorini, A., Pappalardo, O. A., Sebri, V., Savioni, L., Redaelli, A. C. L., & Pravettoni, G. (2021) · EAI Endorsed Transactions on Pervasive Health and Technology · doi:10.4108/eai.8-1-2021.167844 · Cited by 29 · see citing works
Análisis comparativo de la Escala de Usabilidad del Sistema (EUS) en dos versiones / Comparative analysis of the System Usability Scale (SUS) in two versions
Aguilar, M. I. H., & Villegas, A. A. G. (2016) · RECI Revista Iberoamericana de las Ciencias Computacionales e Informática · doi:10.23913/reci.v5i10.48 · Cited by 29 · see citing works
Utilisation of remote capillary blood testing in an outpatient clinic setting to improve shared decision making and patient and clinician experience: a validation and pilot study
Nwankwo, L., McLaren, K., Donovan, J., Ni, M. Z., Vidal-Diaz, A., Loebinger, M. R., Morrisey, A., Igra, A., & Shah, A. (2021) · BMJ Open Quality · doi:10.1136/bmjoq-2020-001192 · Cited by 29 · see citing works
Effect of Age on the Touchscreen Manipulation Ability of Community-Dwelling Adults
Gabyzon, M. E., Weiss, P. L., & Danial‐Saad, A. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18042094 · Cited by 28 · see citing works
Relationship Between Trust and Usability in Virtual Environments: An Ongoing Study
Salanitri, D., Hare, C., Borsci, S., Lawson, G., Sharples, S., & Waterfield, B. C. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-20901-2_5 · Cited by 27 · see citing works
Self-citation
Informing evaluation of a smartphone application for people with acquired brain injury: a stakeholder engagement study
Kettlewell, J., Phillips, J. S., Radford, K., & das Nair, R. (2018) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-018-0611-0 · Cited by 27 · see citing works
A novel multimodal tool for telemonitoring patients with COPD
Sánchez-Morillo, D., Crespo, M., León, A., & Crespo Foix, L. F. (2015) · Informatics for Health and Social Care · doi:10.3109/17538157.2013.872114 · Cited by 25 · see citing works
Fall Prevention Self-Assessments Via Mobile 3D Visualization Technologies: Community Dwelling Older Adults’ Perceptions of Opportunities and Challenges
Hamm, J., Money, A., & Atwal, A. (2017) · JMIR Human Factors · doi:10.2196/humanfactors.7161 · Cited by 25 · see citing works
MyHealthPortal – A web-based e-Healthcare web portal for out-of-hospital patient care
Tanbeer, S. K., & Sykes, E. R. (2021) · Digital Health · doi:10.1177/2055207621989194 · Cited by 24 · see citing works
Towards the Detection of UX Smells: The Support of Visualizations
Buono, P., Caivano, D., Costabile, M. F., Desolda, G., & Lanzilotti, R. (2019) · IEEE Access · doi:10.1109/access.2019.2961768 · Cited by 24 · see citing works
Audio Recording Patient-Nurse Verbal Communications in Home Health Care Settings: Pilot Feasibility and Usability Study
Zolnoori, M., Vergez, S., Kostić, Z., Jonnalagadda, S., McDonald, M. V., Bowles, K. H., & Topaz, M. (2022) · JMIR Human Factors · doi:10.2196/35325 · Cited by 23 · see citing works
Usage Position and Virtual Keyboard Design Affect Upper-Body Kinematics, Discomfort, and Usability during Prolonged Tablet Typing
Lin, M.-I. B., Hong, R.-H., Chang, J., & Ke, X.-M. (2015) · PLoS ONE · doi:10.1371/journal.pone.0143585 · Cited by 23 · see citing works
What do healthcare professionals need to turn risk models for type 2 diabetes into usable computerized clinical decision support systems? Lessons learned from the MOSAIC project
Fico, G., Hernanzez, L., Cancela, J., Dagliati, A., Sacchi, L., Martinez-Millana, A., Posada, J., Manero, L., Verdú, J., Facchinetti, A., et al. (2019) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-019-0887-8 · Cited by 22 · see citing works
Psychometric evaluation of the System Usability Scale in the context of a childrearing app co-designed for low- and middle-income countries
Khan, Q., Hickie, I. B., Loblay, V., Ekambareshwar, M., Zahed, I. U. M., Naderbagi, A., Song, Y. J., & LaMonica, H. M. (2025) · Digital Health · doi:10.1177/20552076251335413 · Cited by 22 · see citing works
System Usability Scale (SUS): Oculus Rift® DK2 and Samsung Gear VR®
Webster, R., & Dues, J. F. (2018) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--28899 · Cited by 21 · see citing works
Arabic Translation, Cultural Adaptation and Psychometric Validation of the Post-Study System Usability Questionnaire (PSSUQ)
Al-Tahat, K. S. (2021) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2021.1913844 · Cited by 21 · see citing works
Italia Ti Ascolto [Italy, I am listening]: an app-based group psychological intervention during the COVID-19 pandemic
Parolin, L. A. L., Benzi, I. M. A., Fanti, E., Milesi, A., Cipresso, P., & Preti, E. (2021) · Research in Psychotherapy Psychopathology Process and Outcome · doi:10.4081/ripppo.2021.517 · Cited by 20 · see citing works
Effectiveness and therapeutic compliance of digital therapy in shoulder rehabilitation: a randomized controlled trial
Rizzato, A., Pizzichemi, M., Gobbi, E., Gerardi, A., Fortin, C., Copcia, A., Paoli, A., & Marcolin, G. (2023) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-023-01188-7 · Cited by 20 · see citing works
EVIDENT 3 Study
Recio-Rodriguez, J. I., Gómez-Marcos, M. Á., Agudo-Conde, C., Ramı́rez, I., González-Viejo, N., Gómez-Arranz, A., Salcedo‐Aguilar, F., Rodríguez‐Sánchez, E., Alonso‐Domínguez, R., Sánchez‐Aguadero, N., et al. (2018) · Medicine · doi:10.1097/md.0000000000009633 · Cited by 20 · see citing works
Two sides of the same coin: adaptation of BCIs to internal states with user-centered design and electrophysiological features
Han, Y., Ziebell, P., Riccio, A., & Halder, S. (2022) · Brain-Computer Interfaces · doi:10.1080/2326263x.2022.2041294 · Cited by 19 · see citing works
Virtual reality digital surgical planning for jaw reconstruction: a usability study
Manzie, T. G. H., MacDougall, H. G., Cheng, K., Venchiarutti, R. L., Fox, R., Sharman, A. R., Charters, E. K., Seyfi, D., Dunn, M., Mukherjee, P., et al. (2023) · ANZ Journal of Surgery · doi:10.1111/ans.18307 · Cited by 19 · see citing works
Swedish Version of the System Usability Scale: Translation, Adaption, and Psychometric Evaluation
Persson, H. Å., Castor, C., Andersson, N., & Hylén, M. (2025) · JMIR Human Factors · doi:10.2196/64210 · Cited by 18 · see citing works
User-centered design and development of TWIN-Acta: A novel control suite of the TWIN lower limb exoskeleton for the rehabilitation of persons post-stroke
Semprini, M., Lencioni, T., Hinterlang, W., Vassallo, C., Scarpetta, S., Maludrottu, S., Iandolo, R., Carè, M., Laffranchi, M., Chiappalone, M., et al. (2022) · Frontiers in Neuroscience · doi:10.3389/fnins.2022.915707 · Cited by 18 · see citing works
Feasibility and usability of a new home-based immersive virtual reality headset-based dexterity training in multiple sclerosis
Kamm, C. P., Blättler, R., Kueng, R., & Vanbellingen, T. (2023) · Multiple Sclerosis and Related Disorders · doi:10.1016/j.msard.2023.104525 · Cited by 18 · see citing works
Effect of cognitive-only and cognitive-motor training on preventing falls in community-dwelling older people: protocol for the smart±step randomised controlled trial
Sturnieks, D. L., Menant, J. C., Valenzuela, M., Delbaere, K., Sherrington, C., Herbert, R., Lampit, A., Broadhouse, K. M., Turner, J., Schoene, D., et al. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-029409 · Cited by 18 · see citing works
Biofeedback in Partial Weight Bearing: Usability of Two Different Devices from a Patient’s and Physical Therapist’s Perspective
van Lieshout, R., Pisters, M. F., Vanwanseele, B., de Bie, R. A., Wouters, E., & Stukstette, M. J. P. M. (2016) · PLoS ONE · doi:10.1371/journal.pone.0165199 · Cited by 18 · see citing works
When simulated environments make the difference: the effectiveness of different types of training of car service procedures
Borsci, S., Lawson, G., Salanitri, D., & Jha, B. (2016) · Virtual Reality · doi:10.1007/s10055-016-0286-8 · Cited by 18 · see citing works
Self-citation
A Mobile Phone–Based Self-Monitoring Tool for Perioperative Gastric Cancer Patients With Incentive Spirometer: Randomized Controlled Trial
Soh, J. Y., Lee, S. U., Lee, I., Yoon, K. S., Song, C., Kim, N. H., Sohn, T. S., Bae, J. M., Chang, D. K., & Cha, W. C. (2018) · JMIR mhealth and uhealth · doi:10.2196/12204 · Cited by 18 · see citing works
The Usability Perception Scale (UPscale): A Measure for Evaluating Feedback Displays
Karlin, B., & Ford, R. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39229-0_34 · Cited by 17 · see citing works
Feasibility of a Home-Based Tablet App for Dexterity Training in Multiple Sclerosis: Usability Study
van Beek, J. J. W., van Wegen, E. E. H., Rietberg, M. B., Nyffeler, T., Bohlhalter, S., Kamm, C. P., Nef, T., & Vanbellingen, T. (2020) · JMIR mhealth and uhealth · doi:10.2196/18204 · Cited by 17 · see citing works
Learning Experience Design:
Sousa, F., & Martins, N. (2020) · Springer series in design and innovation · doi:10.1007/978-3-030-61671-7_5 · Cited by 17 · see citing works
Alexa depression and anxiety self-tests: a preliminary analysis of user experience and trust
Quiroz, J. C., Bongolan, T., & Ijaz, K. (2020) · Adjunct Proceedings of the 2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2020 ACM International Symposium on Wearable Computers · doi:10.1145/3410530.3414374 · Cited by 16 · see citing works
Feasibility, usability and acceptability of a lifestyle-integrated multicomponent exercise delivered via a mobile health platform in community-dwelling pre-frail older adults: a short-term, mixed-methods, prospective pilot study
Li, N., Liu, C., Wang, N., Lin, S., Yuan, Y., Huang, F., & Zhu, P. (2024) · BMC Geriatrics · doi:10.1186/s12877-024-05523-y · Cited by 16 · see citing works
Toward a Usability Evaluation of BCIs
Pasqualotto, E., Simonetta, A., Gnisci, V., Federici, S., & Belardinelli, M. O. (2011) · Digital Access to Libraries (Université catholique de Louvain (UCL), l'Université de Namur (UNamur) and the Université Saint-Louis (USL-B)) · Cited by 16 · see citing works
Self-citation

Authors: Borsci, S., Federici, S., & Lauriola, M.
Affiliations: Sapienza University of Rome (IT)
University of Perugia (IT)
Corresponding author: Borsci, Simone
ORCID: Borsci, Simone
Federici, Stefano
Lauriola, Marco
Venue: Cognitive Processing
Publisher: Springer Science and Business Media LLC
Published: 2009-06-30
Volume: 10
Issue: 3
Pages: 193-197
ISSN: 1612-4782 (ISSN-L)
1612-4790
DOI: 10.1007/s10339-009-0268-9
OpenAlex: W2058625228
Cited by: 275
References: 15
Citations by year: 2026: 22 · 2025: 17 · 2024: 23 · 2023: 23 · 2022: 24 · 2021: 25 · 2020: 21 · 2019: 23 · 2018: 22 · 2017: 11 · 2016: 17 · 2015: 19 · 2014: 7 · 2013: 12 · 2012: 5
FWCI: 4.79
Type: journal article
Language: en
Open access: closed
Licence: www.springer.com/tdm (tdm)
Locations: Cognitive Processing (publishedVersion)
PubMed (publishedVersion)
IRIS Research product catalog (Sapienza University of Rome) (submittedVersion)
University of Twente Research Information (submittedVersion)
Topics: Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Social Sciences › Decision Sciences › Information Systems and Management › Technology Adoption and User Behaviour
Keywords: System Usability Scale, usability evaluation, dimensionality, two-factor model, learnability, usability, correlated factors, measurement model, structural equation modeling, user ratings
MeSH terms: Female, Humans, Learning, Male, Models, Theoretical, Surveys and Questionnaires, User-Computer Interface, Young Adult

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

On the dimensionality of the System Usability Scale: a test of alternative measurement models

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks