The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
On the dimensionality of the System Usability Scale: a test of alternative measurement models
Abstract
The System Usability Scale (SUS), developed by Brooke (Usability evaluation in industry, Taylor & Francis, London, pp 189-194, 1996), had a great success among usability practitioners since it is a quick and easy to use measure for collecting users' usability evaluation of a system. Recently, Lewis and Sauro (Proceedings of the human computer interaction international conference (HCII 2009), San Diego CA, USA, 2009) have proposed a two-factor structure-Usability (8 items) and Learnability (2 items)-suggesting that practitioners might take advantage of these new factors to extract additional information from SUS data. In order to verify the dimensionality in the SUS' two-component structure, we estimated the parameters and tested with a structural equation model the SUS structure on a sample of 196 university users. Our data indicated that both the unidimensional model and the two-factor model with uncorrelated factors proposed by Lewis and Sauro (Proceedings of the human computer interaction international conference (HCII 2009), San Diego CA, USA, 2009) had a not satisfactory fit to the data. We thus released the hypothesis that Usability and Learnability are independent components of SUS ratings and tested a less restrictive model with correlated factors. This model not only yielded a good fit to the data, but it was also significantly more appropriate to represent the structure of SUS ratings.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Since then, studies replicated inconsistent findings pointing towards this two-factor model (e.g. ) [23]”
From Dimensionality of the system usability scale among professionals using internet-based interventions for depression: a confirmatory factor analysis (2020) · cites this paper as [23]
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
Alternative Ways of Assessing Model Fit
Browne, M. W., & Cudeck, R. (1992) · Sociological Methods & Research · doi:10.1177/0049124192021002005 · Cited by 27,200
Comparative fit indexes in structural models.
Bentler, P. M. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.107.2.238 · Cited by 25,266
Testing Structural Equation Models.
Mueller, C. W., Bollen, K. A., & Long, J. S. (1994) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2074955 · Cited by 14,211
Evaluating the use of exploratory factor analysis in psychological research.
Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999) · Psychological Methods · doi:10.1037/1082-989x.4.3.272 · Cited by 9,587
SUS: A 'Quick and Dirty' Usability Scale
(1996) · Usability Evaluation In Industry · doi:10.1201/9781498710411-35 · Cited by 8,989
Testing Structural Equation Models.
Clogg, C. C., Bollen, K. A., & Long, J. S. (1995) · Social Forces · doi:10.2307/2580595 · Cited by 8,246
Reliability and Validity Assessment
Carmines, E., & Zeller, R. (1979) · doi:10.4135/9781412985642 · Cited by 5,884
A scaled difference chi-square test statistic for moment structure analysis
Satorra, A., & Bentler, P. M. (2001) · Psychometrika · doi:10.1007/bf02296192 · Cited by 5,282
An Empirical Evaluation of the System Usability Scale
Bangor, A., Kortum, P. T., & Miller, J. T. (2008) · International Journal of Human–Computer Interaction · doi:10.1080/10447310802205776 · Cited by 5,181
Research works printed but not linked: 1
- Bentler PM (2004) EQS structural equations modeling software (Version 6.1) (Computer software). Multivariate Software, Encino
Cited by
Sorted by citations
Items 201–275 of 275
Palacpac, E. P., Balingit, K. A. M. P., Bonifacio, A. A. D., Villanueva, M. A., Tolentino, R. B., Uy-DeGuia, M. R. D. L., Llantada, P. L. T., Castillo, C. I., Brul, B. J., Rubio, H. C. A., et al. (2024) · Journal of Buffalo Science · doi:10.6000/1927-520x.2024.13.04 · Cited by 2
Al-Bayati, A. J., Aramali, V., & Ko, C. (2024) · ASCE Construction Research Congress (CRC) · doi:10.1061/9780784485293.042 · Cited by 2
User Expectations and Experiences in Using Location-Based Game in Educational Context
Vuorio, J., Okkonen, J., & Viteli, J. (2019) · Lecture notes in educational technology · doi:10.1007/978-981-13-7361-9_2 · Cited by 2
Evaluation of Touch Technology for the Aging Population
Gabyzon, M. E., Chiari, L., Laufer, S., Corzani, M., & Danial‐Saad, A. (2019) · International Conference on Virtual Rehabilitation · doi:10.1109/icvr46560.2019.8994539 · Cited by 2
Usability of online courses registration systems: empirical study from Saudi Arabia on ODUS plus
Almazmomi, N. K. (2020) · Indian Journal of Science and Technology · doi:10.17485/ijst/v13i14.155 · Cited by 2
Usability of the User Interface Design of Tablet Drawing Applications
Hsu, Y.-H., & Chen, C. (2021) · Lecture notes in networks and systems · doi:10.1007/978-3-030-80091-8_124 · Cited by 2
Interactive Diversity Optimization of EnvironmentsPreprint
Berseth, G., Khayatkhoei, M., Haworth, B., Usman, M., Kapadia, M., & Faloutsos, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.08607 · Cited by 2
Alexa Depression and Anxiety Self-tests: A Preliminary Analysis of User Experience and TrustPreprint
Quiroz, J. C., Bongolan, T., & Ijaz, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2008.03892 · Cited by 2
Sturnieks, D. L., Menant, J. C., & Lord, S. R. (2022) · doi:10.31219/osf.io/72fuz · Cited by 2
Usability Testing for Electronic Remote Control Interaction Interface for Smart Home Products
Li, F., Liu, Y., & Bai, X. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-61351-7_18 · Cited by 1
Development and Validation of the Robot Acceptance Questionnaire (RAQ)
Amorese, T., Cuciniello, M., Greco, C., D’Iorio, A., Aiello, E. N., Poletti, B., Silani, V., Ticozzi, N., Santangelo, G., Cordasco, G., et al. (2025) · Applied Sciences · doi:10.3390/app15179281 · Cited by 1
Hadjadj, Z., Masmoudi, M., Meziane, A., & Zenati, N. (2026) · Springer eBooks · doi:10.1007/978-981-95-3048-9_13 · Cited by 1
Marston, H. R., Brittain, K., Lynch, J. K., Lariviere, M., Mehta, R., Thorn, J. C., Henderson, C., Steils, N., Wilson-Nash, C., & Gibson, G. (2026) · Cogent Gerontology · doi:10.1080/28324897.2026.2645518 · Cited by 1
Kerstens, H. C. J. W., Nijkrake, M. J., Swart, B. J. M. D., der Sanden, M. W. G. N., der Hulst, M. V.-V., Bos, G. J., Geurts, A. C. H., & van der Wees, P. J. (2023) · Journal of Rehabilitation Medicine · doi:10.2340/jrm.v55.6572 · Cited by 1
The Potential Utility of the System Usability Scale in U.S. Military Acquisition
Grier, R. A. (2013) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931213571046 · Cited by 1
Using the SUS: Lessons Learned & Forward Looking Research
Grier, R. A., Allanson, K., Bangor, A. W., Kortum, P. T., Acemyan, C. Z., & Oswald, F. L. (2018) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931218621460 · Cited by 1
EUREKATAX: A Taxonomy for the Representation and Analysis of Qualitative Usability Test Data
Germanakos, P., & Fichte, L. (2020) · Multimodal Technologies and Interaction · doi:10.3390/mti4020022 · Cited by 2
Augmented Reality Gamification of Intra- and Production Logistics
Moritz, S., Schlüter, C., & Berg, B. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-90436-4_40 · Cited by 1
Schreier, M. M., Pitzer, S., Dellinger, J. K., Schaffler‐Schaden, D., Osterbrink, J., & Flamm, M. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-08562-6 · Cited by 1
González‐Sánchez, J., Alonso‐Domínguez, R., Sánchez‐Aguadero, N., & Recio-Rodriguez, J. I. (2024) · Nurse Education Today · doi:10.1016/j.nedt.2024.106130 · Cited by 1
Estimation Method for Advanced Driver Assistance System and Real-Time Context-Aware
Oh, B., & Lee, H. (2017) · International Journal of Engineering and Technology · doi:10.7763/ijet.2017.v9.1024 · Cited by 1
Evaluating the Applicability of a Social Content Management Framework: A Case Analysis
Ahmad, W. A. Z. W., Mukhta, M., & Yahya, Y. (2018) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2018.091249 · Cited by 1
Usability Study on the User Interface Design of Tablet Note-Taking Applications
Hsu, Y.-H., & Chen, C. (2021) · Communications in computer and information science · doi:10.1007/978-3-030-78635-9_55 · Cited by 1
On the Usability of Snapchat: What do Users Think About It
Yüce, Y. K., Tezcan, E., Uyguralp, C., Yolcular, B. O., & Akca, M. (2019) · Journal of Intelligent Systems with Applications · doi:10.54856/jiswa.201912085 · Cited by 1
Usability of the super-vowel for gaze-based text entry
Matulewski, J., & Patera, M. (2022) · ACM Symposium on Eye Tracking Research and Applications (ETRA) · doi:10.1145/3517031.3529231 · Cited by 1
Rossetti, A. (2019) · Arrow@dit (Dublin Institute of Technology) · Cited by 1
Carrera, P., Elias, O., Zhang, R., Norajitra, T., Goncalves, A., & Maier-Hein, K. (2025) · doi:10.1101/2025.04.29.25326679 · Cited by 1
Development and Perceived Usability Evaluation of a Mobile application for Notetaking
Demirelli, H., Isler, Y., & Yuce, Y. K. (2023) · EAI Endorsed Transactions on e-Learning · doi:10.4108/eetel.4538
Electronic Health Record Optimization for Cardiac Care
Grabenbauer, L. A. (2015) · DigitalCommons@UNMC
Correlation of affiliate performance against web evaluation metrics
Miehling, M. J. (2026) · Research Output (Edinburgh Napier University) · doi:10.17869/enu.177070
The Usability Testing of the Web Accessible Population Pharmacokinetics Service- Hemophilia
Barghash, I. (2015) · MacSphere (McMaster University) · doi:10.71548/9263
User experience evaluation of whatsonweb: a sonificated visual web search clustering engine
Mele, M. L., Federici, S., Borsci, S., & Liotta, G. (2012)
Self-citationXI Convegno Nazionale: Firenze, 17–19 marzo 2016, Palazzo dei Congressi – Villa Vittoria
(2016) · Journal of Alzheimer s Disease · doi:10.3233/jad-169001
Usability Evaluation of e-Kocaeli M-Goverment Application
Ozturk, E. O., Ellu, M. E., & Durdu, P. O. (2019) · Innovations in Intelligent Systems and Applications Conference (ASYU) · doi:10.1109/asyu48272.2019.8946419
A collaborative Tool to Support Junior Developers in Secure Software Development.
Baldassarre, M. T., Barletta, V. S., Caivano, D., Dimauro, G., & Piccinno, A. (2021) · SEBD
Medición de usabilidad y portabilidad de una Aplicación Web desarrollada con tecnología PWA
Guamangate, Y. K. M., Caisaluisa, J. L. M., & Cerda, V. D. C. T. (2021) · ConcienciaDigital · doi:10.33262/concienciadigital.v4i4.1882
(2012) · Elsevier eBooks · doi:10.1016/b978-0-12-385241-0.00027-0
Desarrollo de una app de evaluación para casos clínicos en un contexto de cooperación internacional
Fernández, M. L. R., Álvarez, L. J. M., Méndez, I. F., & Arberas, E. J. (2022) · Congreso de Innovación Educativa y Docencia en Red (IN-RED) · doi:10.4995/inred2022.2022.15804
Pribeanu, C., Santi, E. A., & Gorghiu, G. (2022) · RoCHI - International Conference on Human-Computer Interaction (RoCHI) · doi:10.37789/rochi.2022.1.1.6
Abdelgawad, A. A., & Comes, T. (2023) · Public administration and information technology · doi:10.1007/978-3-031-20939-0_9
eGLU-Box Mobile: A Smartphone App for Usability Testing by Italian Public Administration Webmasters
Federici, S., Bifolchi, G., Bracalenti, M., Ansani, A., Napoletti, A., Lanzilotti, R., Desolda, G., Mele, M. L., Borsci, S., Filippis, M. L. D., et al. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35596-7_5
Self-citationAlternative questionnaire formats in usability evaluation
Baumgartner, J. (2024) · doi:10.51363/unifr.lth.2024.030
Al-Abri, A., Al-Khanjari, Z. A. S., & Jamoussi, Y. (2024) · Jurnal Kejuruteraan · doi:10.17576/jkukm-2024-36(4)-36
罗, 林. (2024) · Advances in Psychology · doi:10.12677/ap.2024.148524
Caldwell, S., Kirby, O., Flickinger, T., Frietas, G., Ingersoll, K. S., Castel, A. D., & on behalf of the DC Cohort-PositiveLinks Study team (2025) · AIDS and Behavior · doi:10.1007/s10461-025-04649-3
Moon, J., Laine, T. H., Magar, S. T., & Suk, H. (2025) · Entertainment Computing · doi:10.1016/j.entcom.2025.101004
Yuan, X., Ye, P., Liu, X., Hu, Y., Xu, Q., Zhao, W., & Li, K. (2025) · JMIR Serious Games · doi:10.2196/75641
Gomes, E. A. B., Ximenes, T. A., da Costa, E. I. C., Machado, D. P., Cavalcante, J. P., Silva, P. G. D. B., Marçal, E., & Rolim, J. P. M. L. (2025) · Brazilian Journal of Dental Education · doi:10.30979/brazjdenteduc.v25.2448
Mol, M., van Schaik, A., Dozeman, E., Ruwaard, J., Vis, C., Ebert, D. D., Etzelmueller, A., Mathiasen, K., Moles, B., Mora, T., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12291794
Facchino, A. P., Marchetti, D., Verrocchio, M. C., & Porcelli, P. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-11043-5_37
Perachiotti, G., Moccaldi, N., d'Errico, G., Busch, I. M., Magosso, E., & Straudi, S. (2025) · IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE) · doi:10.1109/metroxraine66377.2025.11340310
Usability Evaluation of Warning Cues for Remotely Supervised Autonomous Agricultural Machines
EZEAGBA, A. C., Lorenz, S., Glazebrook, C. M., & Mann, D. D. (2026) · Journal of Agricultural Safety and Health · doi:10.13031/jash.16543
Simone, M. S. D., Costa, A., Zabberoni, S., & Tieri, G. (2026) · Journal of Clinical Medicine · doi:10.3390/jcm15051700
Menekşeoğlu, A. K., Sezikli, S., Bilget, S., Yilmaz, U., & Şahbaz, T. (2025) · Turkish Journal of Physical Medicine and Rehabilitation · doi:10.5606/tftrd.2026.16467
Spinoso, M., Benassi, M., Mazzoni, N., Orsoni, M., Stefanutti, L., Anselmi, P., de Chiusole, D., Bacherini, A., Pierluigi, I., Garofalo, S., et al. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1702085 · Cited by 1
Usability of Train Ticket Apps for Low-Literacy Migrant Workers in India: A SUS Study
Shilpa Rajith, M., P, L. M., & Kochuveetil, P. C. (2026) · International Journal of Innovative Research in Technology · doi:10.64643/ijirtv12i12-200185-459
Petrocelli, M., Cutrupi, S., Vaira, L. A., Salzano, G., Manfuso, A., & Copelli, C. (2026) · European Journal of Plastic Surgery · doi:10.1007/s00238-026-02472-0
Khan, S., Thomas, Y. T., Garg, N., Genes, N. G., Simon, G. W., Cleland, C. M., Mir, U., Dauber-Decker, K. L., Solomon, J., Shunk, A., et al. (2026) · Implementation Science · doi:10.1186/s13012-026-01508-0
Momand, Z., Mongkolnam, P., Pal, D., & Yamsaengsung, S. (2026) · JMIR Aging · doi:10.2196/91873
Pedram, S., & Pickard, J. A. (2026) · JMIR Human Factors · doi:10.2196/93212
Başoğlu, C., Menekşeoğlu, A. K., & Korkmaz, M. D. (2026) · Journal of Hand Therapy · doi:10.1016/j.jht.2026.05.002
Dachena, C., Gatta, R., Franceschini, L., Vicario, M. A. D., Serra, M. L., Acampora, N., Marchetti, A., Arcuri, G., Patarnello, S., Masciocchi, C., et al. (2026) · JMIR Formative Research · doi:10.2196/81480
Moser, C. H., Huffman, S. L., Fredericks, M. T., Stucky, C. H., Hartmann, J. M., & West, G. F. (2026) · Excellence and Credentialing in Health Care · doi:10.1097/echc.0000000000000024
Measuring the Usability of DeepL: Impact of Translation Technology Courses in Translator Training
Barut, E. (2026) · İstanbul Üniversitesi Çeviribilim Dergisi / Istanbul University Journal of Translation Studies · doi:10.26650/iujts.2026.1882848
Settimo, C., Aeo, D. C., Facciale, A. L., Turriziani, L., Tripodi, E., Impallomeni, C., Quartarone, A., Calabrò, R. S., & Cucinotta, F. (2026) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2026.1888297
Chen, X., Ning, H., Peng, L., Zhang, C., Zhang, J., Jiang, D., Li, X., Wan, X., Huang, J., Xie, Q., et al. (2026) · JMIR Serious Games · doi:10.2196/93081
Bramanti, A., Ciccarelli, M., Carrizzo, A., Bramanti, P., Visco, V., Calabrese, M., Garofano, M., Palo, M. P. D., Pessolano, C., Romano, S., et al. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1929955
Rakhmadi, A., Yudistira, I. A., Adhantoro, M. S., Yuliana, I., Kurniawan, Y. I., & Hakim, D. K. (2026) · International Conference on Information Technology and Computing (ICITCOM) · doi:10.1109/icitcom70739.2026.11714427
Nan, J., Azmi, N. H., & Jin, Y. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2741513
Carr, A. L., Jenkins, A., Gómez, V., Lorenzo, J. A., Moclair, R., Pocchia, J., Gandhi, D., Miller, K., Graves, K. D., & Jonklaas, J. (2026) · JMIR Cancer · doi:10.2196/84151
(2013) · Journal of Usability Studies archive · Cited by 1,357
Metadata
- Authors
- Borsci, S., Federici, S., & Lauriola, M.
- Affiliations
- Sapienza University of Rome (IT)
- University of Perugia (IT)
- Corresponding author
- Borsci, Simone
- Venue
- Cognitive Processing
- Published
- 2009-06-30
- Volume
- 10
- Issue
- 3
- Pages
- 193-197
- ISSN
- 1612-4782 (ISSN-L)
- 1612-4790
- OpenAlex
- W2058625228
- Cited by
- 275
- References
- 15
- Citations by year
- 2026: 22 · 2025: 17 · 2024: 23 · 2023: 23 · 2022: 24 · 2021: 25 · 2020: 21 · 2019: 23 · 2018: 22 · 2017: 11 · 2016: 17 · 2015: 19 · 2014: 7 · 2013: 12 · 2012: 5
- FWCI
- 4.79
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Cognitive Processing (publishedVersion)
- PubMed (publishedVersion)
- IRIS Research product catalog (Sapienza University of Rome) (submittedVersion)
- University of Twente Research Information (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Decision Sciences › Information Systems and Management › Technology Adoption and User Behaviour
- Keywords
- System Usability Scale, usability evaluation, dimensionality, two-factor model, learnability, usability, correlated factors, measurement model, structural equation modeling, user ratings
- MeSH terms
- Female, Humans, Learning, Male, Models, Theoretical, Surveys and Questionnaires, User-Computer Interface, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review