System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis
Open accessThe DOI matches its Crossref record; 32 of the 33 references it cites were found in a registry or an index; 8 of the 17 sources its claims cite were checked for support.
Abstract
Background: The System Usability Scale (SUS) is a widely used scale that has been used to quantify the usability of many software and hardware products. However, the SUS was not specifically designed to evaluate mobile apps, or in particular digital health apps (DHAs). Objective: The aim of this study was to examine whether the widely used SUS distribution for benchmarking (mean 68, SD 12.5) can be used to reliably assess the usability of DHAs. Methods: A search of the literature was performed using the ACM Digital Library, IEEE Xplore, CORE, PubMed, and Google Scholar databases to identify SUS scores related to the usability of DHAs for meta-analysis. This study included papers that published the SUS scores of the evaluated DHAs from 2011 to 2021 to get a 10-year representation. In total, 117 SUS scores for 114 DHAs were identified. R Studio and the R programming language were used to model the DHA SUS distribution, with a 1-sample, 2-tailed t test used to compare this distribution with the standard SUS distribution. Results: The mean SUS score when all the collected apps were included was 76.64 (SD 15.12); however, this distribution exhibited asymmetrical skewness (–0.52) and was not normally distributed according to Shapiro-Wilk test (P=.002). The mean SUS score for “physical activity” apps was 83.28 (SD 12.39) and drove the skewness. Hence, the mean SUS score for all collected apps excluding “physical activity” apps was 68.05 (SD 14.05). A 1-sample, 2-tailed t test indicated that this health app SUS distribution was not statistically significantly different from the standard SUS distribution (P=.98). Conclusions: This study concludes that the SUS and the widely accepted benchmark of a mean SUS score of 68 (SD 12.5) are suitable for evaluating the usability of DHAs. We speculate as to why physical activity apps received higher SUS scores than expected. A template for reporting mean SUS scores to facilitate meta-analysis is proposed, together with future work that could be done to further examine the SUS benchmark scores for DHAs.
Overview
CoChat Summary
TL;DR
This meta-analysis pooled 117 System Usability Scale (SUS) scores from 114 digital health apps (DHAs) to test whether the standard SUS benchmark of mean 68 (SD 12.5) applies to DHAs. It found the benchmark fits DHAs once physical activity apps are excluded, while physical activity apps scored substantially higher and skewed the overall distribution.
Key findings
- Across all collected apps, the mean SUS score was 76.64 (SD 15.12); the distribution was asymmetrical (skewness –0.52) and not normal by Shapiro-Wilk test (P=.002).
- Physical activity apps had a mean SUS score of 83.28 (SD 12.39) and accounted for 66 of 117 scores (56.4%); excluding them yielded a mean of 68.05 (SD 14.05), which was not statistically significantly different from the standard SUS distribution (mean 68, SD 12.5) by 1-sample, 2-tailed t test (P=.98).
- Category means were 71.30 (SD 12.72) for health care, 61.29 (SD 15.08) for first aid/CPR/choking, 71.06 (SD 14.55) for diet/food/nutrition, and 69.45 (SD 5.30) for health information.
- The probability of a SUS score ≤68 was 28.39% for all categories, 10.88% for physical activity apps only, and 49.85% for all categories excluding physical activity apps, compared with the standard 50%.
Methods
- The authors searched ACM Digital Library, IEEE Xplore, CORE, PubMed, and Google Scholar for papers published from 2011 to 2021 that reported SUS scores for DHAs evaluated by end users, collecting 117 SUS scores from 114 DHAs across 19 papers.
- Data were separated into three subsets: all DHAs, physical activity apps only, and all DHAs excluding physical activity apps. Analyses in R 4.0.3 included Shapiro-Wilk normality tests, skewness and kurtosis, density plots, histograms, boxplots, 1-sample 2-tailed t tests, and Wilcoxon signed rank tests against the standard SUS distribution of mean 68 (SD 12.5).
- Extracted variables included first author, DHA health area, app name, device, platform, sample size used for the mean SUS score, publication year, and SUS score.
Limitations
- The paper states the dataset is small (n=117 SUS scores), came from 19 papers, and some mean SUS scores were based on as few as 2 or 3 reviewers; 65 physical activity apps came from the same paper, which used 2 reviewers per app, raising the possibility of inflated scores or limited evaluation time.
- The paper also states possible publication bias/file drawer effect, overrepresentation of particular DHA genres, language and cultural bias when SUS is used with non-English speakers, and the need for genre- or device-specific benchmarks.
- Evident from the text: participant sample sizes used to collect SUS scores had a distribution of 6 (SD 6.16; range 2-31), and physical activity apps dominated the dataset (66/117), limiting generalizability of the pooled distribution.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
7 Valid · 1 Not valid · 9 Not checked · 44 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Gamification has been shown to improve the use of physical activity apps [37]”
§ System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis > Discussion > Principal Findings
What the sources say
- Partly supportedcites [37] sourceExperimental — accuracy not yet measured
The Results (Characteristics of Included Studies; page unavailable) say that most included studies used smartphone apps, and the Discussion (Conclusions; page unavailable) says gamified interventions improved daily physical activity compared with nongamified interventions such as apps. The paper does not show that gamification increased use of the apps themselves, such as how often people opened or continued using them. (LLM, conf=0.79)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“According to a scoping review from 2019 [10], SUS was the most frequently used questionnaire for evaluating the usability of DHAs.”
§ System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis > Introduction
What the sources say
- Supportedcites [10] source
The Abstract (page not provided) states that the System Usability Scale (SUS) was the most frequently used questionnaire in the review’s studies of eHealth-app usability. (LLM, conf=0.95)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“A study from 2017, where the top 50 health and fitness apps were downloaded from the Apple app store, found that physical activity and weight loss apps most frequently (97%) used gamification [36].”
§ System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis > Discussion > Principal Findings
What the sources say
- Partly supportedcites [36] sourceExperimental — accuracy not yet measured
The Methods say the top 50 free health and fitness apps in Apple’s App Store were evaluated in August 2017, and the Results say gamification was most prevalent in physical activity and weight-loss apps. But the Results report that 100% of those apps used gamification. The Abstract’s 97% describes the share of gamified apps that targeted physical activity or weight loss, not the share of apps in those categories that used gamification. (LLM, conf=0.89)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Moreover, 65 of the physical activity apps used in this study came from the same paper [15].”
§ System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis > Discussion > Limitations
What the sources say
- Supportedcites [15] source
The Methods (Sample Assessment) say the paper randomly selected 65 physical activity apps for assessment, and the Results (Sample Identification) confirm that 65 apps were assessed. This supports the citation’s identification of the paper as the source of a 65-app sample. (LLM, conf=0.89)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“The paper that published the SUS scores of these 65 physical activity apps focused on the most popular apps available to conduct their SUS evaluation”
§ System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis > Discussion > Principal Findings
What the sources say
- Supportedcites [15] source
The Introduction (Objective) explicitly says the study focused on the most popular physical activity apps, defined by top app-store rankings. The Methods (Sample Assessment) say 65 apps were randomly selected from the identified apps, and the Results report SUS scores for all 65. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
30 more claims
Create a free account to see all 61 claims and every source verdict.
- It may state two separate claims as one. 17
- Probably not a substantial claim. 13
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Based on recommendations from the validated SUS for mHealth apps, we set a priori cutoff scores for a passable app at 68.”
From Co-Designing the MOSAIC mHealth App With Breast Cancer Survivors: User-Centered Design Approach (2024) · cites this paper as [67]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Apps with SUS scores at this level or higher are considered usable and likely to experience user uptake [67].”
From Co-Designing the MOSAIC mHealth App With Breast Cancer Survivors: User-Centered Design Approach (2024) · cites this paper as [67]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“After a facilitated onboarding session, caregivers completed a post-onboarding survey, including the System Usability Scale (SUS) [66–69] to assess usability.”
From Caregiver experiences of an integrative patient-centered digital health application for pediatric type 1 diabetes care: Findings from a pilot clinical trial (2025) · cites this paper as [69]
In the citing paper
“A score of 68 is considered average usability ( Hyzy et al., 2022 ).”
From Feasibility and acceptability of incorporating artificial intelligence into simulation education (2025) · cites this paper as Hyzy et al., 2022
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis > Results
“| Category | App (N=117), n (%) | SUSa score, mean (SD) |”
§ System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis > Methods > Data Collection
“A total of 114 DHAs producing 117 SUS scores were collected to conduct this meta-analysis.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis > Discussion > Principal Findings
“In Figure 1B, the blue line indicates the mean SUS score of 68 when all SUS scores are included in the distribution, which is exactly in line with the first peak in the distribution.”
§ System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis > Results
“| Mean (SD) | 76.64 (15.12) | 68.05 (14.05) | 83.28 (12.39) |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis > Results
“The table indicates that the SUS distribution from all DHAs and the SUS distribution from physical activity apps only are statistically different distributions compared to the accepted mean 68 (SD 12.5) SUS distribution (P=.002).”
§ System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis > Results
“| | 1-sample, 2-tailed t test | <.001 | 73.87-79.41 |”
Citations
Cites
Guidelines for the process of cross-cultural adaptation of self-report measures
Beaton, D. E., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2000) · Spine · doi:10.1097/00007632-200012150-00014 · Cited by 14,542 · cited 1×
“Cross-cultural adaptation guidelines [12] could be used to adapt SUS; previously, these guidelines have been used to develop the Indonesian version of SUS [13].”
MethodThe file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068 · cited 1×
“This is related to the file drawer effect [11], where researchers withhold studies that show nonsignificant or negative results (P>.”
BackgroundThe mHealth App Usability Questionnaire (MAUQ): Development and Validation Study
Zhou, L., Bao, J., Setiawan, I. M. A., Saptono, A., & Parmanto, B. (2019) · JMIR mHealth and uHealth · doi:10.2196/11500 · Cited by 675
Methods of usability testing in the development of eHealth applications: A scoping review
Maramba, I., Chatterjee, A., & Newman, C. (2019) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2019.03.018 · Cited by 602 · cited 2×
“The mHealth App Usability Questionnaire (MAUQ) is a validated alternative to SUS for measuring usability that is tailored to mobile health (mHealth) apps [10].”
BackgroundMethodAn Indonesian adaptation of the System Usability Scale (SUS)
Sharfina, Z., & Santoso, H. B. (2016) · 2016 International Conference on Advanced Computer Science and Information Systems (ICACSIS) · doi:10.1109/icacsis.2016.7872776 · Cited by 262 · cited 1×
“Cross-cultural adaptation guidelines [12] could be used to adapt SUS; previously, these guidelines have been used to develop the Indonesian version of SUS [13].”
MethodMazeas, A., Duclos, M., Pereira, B., & Chalabaev, A. (2022) · Journal of Medical Internet Research · doi:10.2196/26779 · Cited by 222 · cited 1×
“Gamification has been shown to improve the use of physical activity apps [37], which could explain the”
BackgroundFerrara, G., Kim, J., Lin, S., Hua, J., & Seto, E. (2019) · JMIR mHealth and uHealth · doi:10.2196/mhealth.9232 · Cited by 179
Liew, M. S., Zhang, J., See, J., & Ong, Y. L. (2019) · JMIR mHealth and uHealth · doi:10.2196/12160 · Cited by 179 · cited 1×
“The usability of DHAs can be improved; in the study by Liew et al [40], researchers provided insight and suggestions for improving the usability of health and wellness mobile apps.”
Quality of Publicly Available Physical Activity Apps: Review and Content Analysis
Bondaronek, P., Alkhaldi, G., Slee, A., Hamilton, F. L., & Murray, E. (2018) · JMIR mHealth and uHealth · doi:10.2196/mhealth.9069 · Cited by 156
Multi-language toolkit for the system usability scale
Gao, M., Kortum, P., & Oswald, F. L. (2020) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1801173 · Cited by 140 · cited 2×
“The study found that these SUS versions were adequately adapted; however, cultural differences had to be highlighted [14].”
Background
Research works printed but not linked: 5
- BrookeJSUS: a quick and dirty usability scaleResearchGate1995112021-11-21https://www.researchgate.net/publication/228593520_SUS_A_quick_and_dirty_usability_scale
- Sauro, J, 2016, Quantifying the User Experience: Practical Statistics for User Research. 2nd ed
- Brooke, J, 2013, J Usability Stud, 8, 29
- Kizakevich, Paul N, 2014, Stud Health Technol Inform, 199, 35
- Jon, Yablonski, 2020, Jakob's Law
Cited by
Duggan, M. J., Gervase, J., Schoenbaum, A., Hanson, W., Howell, J. T., Sheinberg, M., & Johnson, K. B. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.60637 · Cited by 249
Jabir, A. I., Martinengo, L., Lin, X., Torous, J., Subramaniam, M., & Tudor Car, L. (2023) · Journal of Medical Internet Research · doi:10.2196/44548 · Cited by 63
“While efforts had been made to set a standardized benchmark for subjectively reported user experience outcomes [14], there are no gold standards that objectively measure these outcomes [8].”
Digital health behaviour change interventions in severe mental illness: a systematic review
Sawyer, C. S., McKeon, G., Hassan, L., Onyweaka, H., Agulleiro, L. M. M., Guinart, D., Torous, J. B., & Firth, J. (2023) · Psychological Medicine · doi:10.1017/s0033291723002064 · Cited by 45
“Usability measures included the SUS, task scores, and interview comments regarding design, layout, and/or other aspects of the user interface.”
MethodCruz‐Cobo, C., Bernal-Jiménez, M. Á., Calle, G., Gheorghe, L. L., Gutiérrez, A., Cañadas, D., Tur, J. A., Vázquez, R., & Santi-Cano, M. J. (2024) · JMIR mhealth and uhealth · doi:10.2196/55421 · Cited by 65
“…team (maximum score: 50 points; a higher score indicates more satisfaction), and the usability of the app was measured using the System Usability Scale (SUS) questionnaire (total score: 100 points; excellent: >80.3 points, good: 68-80.3 points, poor: 51-67 points, and very poor: <51 points) [33].”
MethodInfluentialTechnology Usability for People Living With Dementia: Concept Analysis
Chien, S., Zaslavsky, O., & Berridge, C. W. (2024) · JMIR Aging · doi:10.2196/51987 · Cited by 36
Babington‐Ashaye, A., de Moerloose, P., Diop, S., & Geissbühler, A. (2023) · Haemophilia · doi:10.1111/hae.14815 · Cited by 46
“Median Age (y), range (min-max) 32 (8-61) 28 (8-61) 40 (26-60)”
Kabukye, J. K., Namugga, J., Mpamani, C., Katumba, A., Nabende, J. N., Nabuuma, H., Musoke, S. S., Nankya, E., Soomre, E., Nakisige, C., et al. (2023) · Journal of Medical Internet Research · doi:10.2196/45132 · Cited by 36
“The evaluation survey assessed the system usability using the System Usability Scale (SUS) [75], as well as health workers’ rating of the value of the intervention.”
Aljamaan, F., Malki, K. H., Alhasan, K. A., Jamal, A. A., Altamimi, I., Khayat, A., Alhaboob, A. A. N., Abdulmajeed, N., Alshahrani, F. S., Saad, K., et al. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e28962 · Cited by 34
“The SUS tool is universally acceptable tool of assessing digital health applications, for both healthcare providers and end users [30 – 32].”
BackgroundMethodInfluentialLorusso, L., Mošmondor, M., Grgurić, A., Toccafondi, L., D’Onofrio, G., Russo, S., Lampe, J., Pihl, T., Mayer, N., Vignani, G., et al. (2023) · Sensors · doi:10.3390/s23020797 · Cited by 25
“[53] demonstrated that the use of the SUS could be reliable in case of mHealth solutions.”
BackgroundSoni, H., Ivanova, J., Wilczewski, H., Bailey, A., Ong, T., Narma, A., Bunnell, B. E., & Welch, B. M. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.954069 · Cited by 28
Patient-Centered Chronic Wound Care Mobile Apps: Systematic Identification, Analysis, and Assessment
Dege, T., Glatzel, B., Borst, V., Grän, F., Goller, S. G., Glatzel, C. M., Goebeler, M., & Schmieder, A. (2024) · JMIR mhealth and uhealth · doi:10.2196/51592 · Cited by 22
“It has been effectively applied to evaluate mobile apps related to dementia, depression, pediatric obesity, and smoking cessation [7].”
BackgroundLarkin, C., Djamasbi, S., Boudreaux, E. D., Varzgani, F., Garner, R. C., Siddique, M., Pietro, J., & Tulu, B. (2022) · JMIR Formative Research · doi:10.2196/41422 · Cited by 20
“We chose the SUS as a subjective measure of usability in our study because of its suitability for benchmarking digital health applications [35].”
MethodSantangelo, G., Nicora, G., Bellazzi, R., & Dagliati, A. (2025) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-024-02731-9 · Cited by 27
“Overall, the software achieved a high SUS score (83.93), which, according to the guidelines [42, 43], is an excellent result, exceeding the threshold of 68.”
InfluentialWitharana, P., Chang, L., Maier, R. H., Ogundimu, E. O., Wilkinson, C., Athanasiou, T., & Akowuah, E. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-079404 · Cited by 20
Healthcare practitioners and robotic-assisted rehabilitation: understanding needs and barriers
Nicora, G., Parimbelli, E., Mauro, M. C., Falchini, F., Germanotta, M., Fasano, A., Sgandurra, G., Beani, E., Gruppioni, E., Bugané, F., et al. (2025) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-025-01593-0 · Cited by 29
“Although the mean SUS scores are lower than the threshold for benchmark [19], it is in line with the recently reported SUS scores for robotic devices in rehabilitation collected in France with a rectruiment procedure similar to the one used in our survey [20].”
Heijsters, F. A. C. J., van Loon, G. A. P., Santema, J. M. M., Mullender, M. G., Bouman, M., de Bruijne, M. C., & van Nassau, F. (2023) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2023.105070 · Cited by 22
Adler, R. F., Baez, K., Morales, P., Sotelo, J., Victorson, D. E., & Magasi, S. R. (2024) · JMIR Human Factors · doi:10.2196/51522 · Cited by 30
“While the SUS has been around since 1986, it has been shown to be effective in evaluating the usability of recent health apps [44].”
MethodNorouzkhani, N., Norouzi, S., Faramarzi, M., Bahari, A., Shokri‐Shirvani, J., Eslami, S., & Tabesh, H. (2025) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-024-02842-3 · Cited by 30
Fink, F., Kalter, I., Steindorff, J.-V., Helmbold, H. K., Paulicke, D., & Jahn, P. (2024) · JMIR Human Factors · doi:10.2196/51587 · Cited by 18
“It is technology independent, that is, it can be used for a wide range of systems and technologies [28-30].”
BackgroundEvaluation of Endo 10 mobile application as diagnostic tool in endodontics
Abuabara, A., Castro, J., Locks, M. E. N., Pezzin, A., Mattos, N. H. R., de Araújo, C. M., Küchler, É. C., & Baratto‐Filho, F. (2023) · Journal of Clinical and Experimental Dentistry · doi:10.4317/jced.60342 · Cited by 13
“(16) assigned the adjectives for SUS score: “worst imaginable” (0-25), “poor” (26-39), “acceptable” (40-52), “good” (53-74), “excellent” (75-85), “best imaginable” (86-100).”
Mulawa, M. I., Mtukushe, B., Knippler, E. T., Matiwane, M., Al-Mujtaba, M., Muessig, K. E., Hoare, J., & Hightow‐Weidman, L. (2023) · JMIR Formative Research · doi:10.2196/47575 · Cited by 15
“5 (SD 18), which is considered to be slightly above average for digital health apps [30].”
BackgroundMethodTelemedicine and eHealth Solutions in Clinical Practice
Delgado, F. D. C., Bernedo-Moreira, D. H., Espíritu-Martínez, A. P., Aguilar-Cruzado, J. L., García, C. E. J., Mamani-Laura, M. R., & Romero-Carazas, R. (2023) · EAI Endorsed Transactions on Pervasive Health and Technology · doi:10.4108/eetpht.9.4272 · Cited by 22
Lacruz-Pleguezuelos, B., Bazán, G. X., Romero-Tapiador, S., Freixer, G., Tolosana, R., Daza, R., Fernández-Díaz, C. M., Molina, S., Crespo, M. C., Laguna, T., et al. (2025) · Clinical Nutrition · doi:10.1016/j.clnu.2025.03.003 · Cited by 13
Sato, K., Niimi, Y., Ihara, R., Suzuki, K., Iwata, A., & Iwatsubo, T. (2024) · The Journal of Prevention of Alzheimer s Disease · doi:10.14283/jpad.2024.48 · Cited by 13
“SUS is a widely used scale for measuring the usability of systems, including websites (11, 12).”
Kopka, M., Slagman, A. C., Schorr, C., Krampe, H., Altendorf, M. B., Balzer, F., Bolanaki, M., Kuschick, D., Möckel, M., Napierala, H., et al. (2024) · Smart Health · doi:10.1016/j.smhl.2024.100517 · Cited by 23
A novel smartphone application for the informal caregivers of cancer patients: Usability study
Oakley-Girvan, I. A., Yunis, R., Fonda, S. J., Neeman, E., Liu, R., Aghaee, S., Ramsey, M., Kubo, A., & Davis, S. W. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000173 · Cited by 13
“The SUS has been used widely to study the usability of software and hardware, and a recent study shows that it has a similar distribution and interpretability when used to assess mobile health apps [60].”
MethodMaddison, R., Nourse, R. A., Daryabeygi‐Khotbehsara, R., Tegegne, T. K., Jansons, P., Rawstorn, J. C., Atherton, J. J., Driscoll, A. L., Oldenburg, B. F., Vasa, R., et al. (2025) · JMIR Research Protocols · doi:10.2196/62964 · Cited by 14
Hyzy, M., Bond, R., Mulvenna, M. D., Bai, L., Dix, A. J., Daly, R., Frey, A.-L., & Leigh, S. (2023) · JMIR mhealth and uhealth · doi:10.2196/47043 · Cited by 12
“Previous work has been done on benchmarking DHI system usability scores (SUS) across digital health apps [33] and for heart failure apps [34].”
Self-citationEiselt, A.-K., Kirkendall, S., Xiong, E., Langner, D., & Goldfarb, M. B. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1713334 · Cited by 21
“…like personalized onboarding, coach interactions, and conversational interfaces, and measured through trust and alliance scales, like the Digital Working Alliance Inventory (DWAI) and Mobile Agnew Relationship Measure (mARM), as well as user satisfaction ratings (e.g., NPS, CSAT) (127, 128).”
Usability Testing: A Bibliometric Analysis Based on WoS Data
ShojaeiBaghini, M., Mohammadi, M., & Norouzkhani, N. (2024) · Journal of Scientometric Research · doi:10.5530/jscires.13.1.2 · Cited by 20
“…usability challenges in the use of medical devices in the home environment, [18] system usability scale benchmarking for digital health apps, [19] usability of robotic and virtual reality devices in neuromotor rehabilitation, [20] usability of web-based applications in advocating consumers…”
BackgroundMoulaei, K., Moulaei, R., & Bahaadinbeigy, K. (2024) · DIGITAL HEALTH · doi:10.1177/20552076241237384 · Cited by 13
“9 Moreover, existing literature has diligently explored usability scores in digital health, 10 the usability of robots and smart wearables has remained a relatively underexplored frontier.”
BackgroundCase study of virtual reality sepsis management- instructional design and ITEM outcomes
Jacobs, C., Vaidya, K., Medwell, L. J., Old, T., & Joiner, R. (2023) · Journal of Visual Communication in Medicine · doi:10.1080/17453054.2023.2280611 · Cited by 10
“Furthermore, a score above 68 is a benchmark acceptability (Hyzy et al., 2022).”
BackgroundFeeling Moodie: Insights from a Usability Evaluation to Improve the Design of mHealth Apps
Chan, G., Alslaity, A., Wilson, R., & Orji, R. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2241613 · Cited by 11
“The SUS is a widely accepted benchmark for evaluating the usability of digital health apps (Hyzy et al., 2022).”
Wilde, C. D., Bekhuis, Y., Kuznetsova, T., Claes, J., Claessen, G., Coninx, K., Decorte, E., Smedt, D. D., Hansen, D., Lannoo, M., et al. (2023) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2023.1194693 · Cited by 15
Suffoletto, B. P., Clark, D. B., Lee, C. M., Mason, M. J., Schultz, J., Szeto, I., & Walker, D. (2025) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2025.112697 · Cited by 11
Mehdizadeh, H., Asadi, F., Nazemi, E., Mehrvar, A., Yazdanian, A., & Emami, H. (2023) · JMIR Pediatrics and Parenting · doi:10.2196/43867 · Cited by 13
“Studies show that products with higher scores in usability evaluation tests are more desired and used, while low usability has a negative effect on user acceptance [19,20].”
Artificial Intelligence Physician Avatars for Patient Education: A Pilot Study
Haider, S. A., Prabha, S., Gomez-Cabello, C. A., Genovese, A., Collaço, B. G., Wood, N. G., Lifson, M. A., Bagaria, S. P., Tao, C., & Forte, A. J. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14238595 · Cited by 15
“A meta-analysis of digital health apps established a mean benchmark SUS score of 68.05 (SD 14.05) [34].”
InfluentialFu, T., Wang, X.-J., Xiao, S., & Fan, L. (2024) · Nurse Education Today · doi:10.1016/j.nedt.2024.106306 · Cited by 13
Mulawa, M. I., Hoare, J., Knippler, E. T., Mtukushe, B., Matiwane, M., Muessig, K. E., Al-Mujtaba, M., Wilkinson, T. H., Platt, A. C., Egger, J. R., et al. (2023) · JMIR Research Protocols · doi:10.2196/47137 · Cited by 10
Adams, M. C. B., Perkins, M. L., Hudson, C., Madhira, V., Akbilgiç, O., Ma, D., Hurley, R. W., & Topaloĝlu, Ü. (2025) · Journal of Medical Internet Research · doi:10.2196/69004 · Cited by 9
“For evaluating the usability of our system from the perspective of end users, we used the System Usability Scale (SUS), a widely used and validated tool for assessing the perceived usability of software and other digital health systems [25].”
Acoustic and Natural Language Markers for Bipolar Disorder: A Pilot, mHealth Cross-Sectional Study
Crocamo, C., Cioni, R. M., Canestro, A., Nasti, C., Palpella, D., Piacenti, S., Bartoccetti, A., Re, M., Simonetti, V., Pietro, C. B. D. S., et al. (2025) · JMIR Formative Research · doi:10.2196/65555 · Cited by 17
“Then, the System Usability Scale (SUS), a short 10-item questionnaire based on a 5-point Likert scale, was administered to assess the usability [35] of the app.”
Bernocchi, P., Giudici, V., Borghi, G., Bertolaia, P., D’Isa, S., Trevisan, R., & Scalvini, S. (2024) · Trials · doi:10.1186/s13063-024-08171-0 · Cited by 15
“Usability of the devices and the app through the System Usability Scale (SUS) [37–39].”
MethodEvaluation of an application for the self-assessment of lifestyle behaviour in cardiac patients
Goevaerts, W. F., Limpt, N. T. V., Lü, Y., Kop, W. J., Kemps, H., & Brouwers, R. W. M. (2023) · Netherlands Heart Journal · doi:10.1007/s12471-023-01835-7 · Cited by 12
Leung, Y. W., So, J., Sidhu, A., Asokan, V., Gancarz, M., Gajjar, V. B., Patel, A., Li, J. M., Kwok, D. K. S., Nadler, M. B., et al. (2025) · Current Oncology · doi:10.3390/curroncol32030145 · Cited by 9
“The post-survey had an additional section evaluating user experience with AIPL using the System Usability Scale (SUS) [19].”
Thomas, C. M., Baudry, D., Arkir, Z., et al. (2025) · Journal of Investigative Dermatology · doi:10.1016/j.jid.2025.01.031 · Cited by 8
Nasri, S. A. E. M., Kavakli, M., Hassan-Smith, Z. K., Salt, A., & Hassan‐Smith, G. (2025) · F1000Research · doi:10.12688/f1000research.172599.1 · Cited by 9
Usability and feasibility of PreventS-MD web app for stroke prevention
Feigin, V. L., Krishnamurthi, R., Medvedev, O. N., Merkin, A., Nair, B., Kravchenko, M. A., Jalili‐Moghaddam, S., Barker-Collo, S. L., Ratnasabapathy, Y., Skinner, L. C., et al. (2023) · International Journal of Stroke · doi:10.1177/17474930231190745 · Cited by 12
“With the validated mean SUS score of 68 (standard deviation [SD] 12.5) as the benchmark for usability of digital health apps, 32 the overall SUS score was analyzed, and usability was categorized into four validated groups: unacceptable (0–50), poor (51–68), good (69–80.3), and excellent ( > 80.3).”
MethodInfluentialKarlsson, P., Nygren‐Bonnier, M., Henningsohn, L., Rydwik, E., & Hagströmer, M. (2023) · Pilot and Feasibility Studies · doi:10.1186/s40814-023-01377-0 · Cited by 7
“The result of the SUS also indicates a high usability as the mean score result of 77 is well above the previously stated benchmark of a mean score > 68 [17].”
BackgroundResultO'Connor, S. R., Wilson, V., Brown, D., Cleland, I., & McCance, T. (2024) · Digital Health · doi:10.1177/20552076241271788 · Cited by 9
Rathbone, A. L., Neill, S., Prime, S. J., Thomas, N., & Everett, K. (2024) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2024.105504 · Cited by 8
Donawa, A., Powell, C., Wang, R., Chih, M.-Y., Patel, R., Zinner, R., Aronoff-Spencer, E., & Baker, C. E. (2024) · JMIR Formative Research · doi:10.2196/57801 · Cited by 8
“The SUS has been used in industry and academic research and is sufficient for pilot studies of mHealth apps [25,27,40,83,87-89].”
MethodPaulissen, J. M. J., Zegers, C. M. L., Nijsten, I. R., Reiters, P. H. C. M., Houben, R. M. A., Eekers, D. B. P., & Roelofs, E. (2022) · Technical Innovations & Patient Support in Radiation Oncology · doi:10.1016/j.tipsro.2022.10.005 · Cited by 10
“The total SUS score is a number between 0 and 100 and is calculated by adding all individual scores and multiplying them by 2.5 [16,17].”
BackgroundInfluentialSupporting Self-Management of Healthy Behaviors in Chronic Kidney Disease and Hypertension
Schrauben, S. J., Park, D., Amaral, S. G., Purcell, A., Zhang, S., Kearney, M. D., Bilger, A., Feldman, H. I., & Dember, L. M. (2024) · Clinical Journal of the American Society of Nephrology · doi:10.2215/cjn.0000000000000492 · Cited by 9
“29 After 12 weeks, participants were asked to complete a survey that included the same questions at enrollment related to usability, CKD knowledge, digital health literacy, self-ef fi cacy, self-management skills, and quality of life.”
Krafft, J., Barisch‐Fritz, B., Krell‐Roesch, J., Trautwein, S., Scharpf, A., & Wöll, A. (2023) · JMIR Aging · doi:10.2196/46480 · Cited by 13
“By further categorizing the included apps, they observed a mean SUS score of 83.28 (SD 12.39) for “physical activity” apps (n=66) and a mean SUS score of 71.3 (SD 12.72) for “health care” apps [62].”
InfluentialFinet, M., Bellicha, A., Sage, É., Glorion, M., Kennel, T., Labro, M., Trillat, B., Fischler, M., Vallée, A., Guen, M. L., et al. (2023) · Journal of Clinical Anesthesia · doi:10.1016/j.jclinane.2022.111048 · Cited by 9
Li, Q., Zhao, J., Yan, R., Gao, Q., Zhen, Y., Li, X., Ying, L., Min, S., & Yang, L. (2024) · BMC Medical Education · doi:10.1186/s12909-024-05131-9 · Cited by 13
“According to a recent systematic review, the mean SUS score of 68 is a useful benchmark, with 50% of apps falling below or above it [34].”
Backgroundde Guex, K. P., Flickinger, T., Mayevsky, L., Zaveri, H., Goncalves, M., Reed, H., Pesina, L., & Dillingham, R. (2023) · JAMIA Open · doi:10.1093/jamiaopen/ooad083 · Cited by 8
Miłosz, M., Plechawska–Wójcik, M., & Dzieńkowski, M. (2024) · Applied Sciences · doi:10.3390/app14156583 · Cited by 7
MoveONParkinson: developing a personalized motivational solution for Parkinson’s disease management
Alves, B., Mota, P. R., Sineiro, D., Carmo, R., Santos, P. A., Macedo, P., Casaca-Carreira, J., Madeira, R. N., Dias, S. B., & Pereira, C. M. (2024) · Frontiers in Public Health · doi:10.3389/fpubh.2024.1420171 · Cited by 8
de Looff, P. C., Noordzij, M. L., Nijman, H. L. I., Goedhard, L. E., Bogaerts, S., & Didden, R. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1330993 · Cited by 7
“Physical activity apps reached a mean usability score of ~83 in a recent meta-analysis (68), and the authors indicated that the popularity of physical activity apps might be due to the gami fi ed nature and motivational features built in these apps.”
BackgroundMethodInfluentialCerfoglio, S., Verme, F., Capodaglio, P., Rossi, P., Cvetkova, V., Boldini, G., Galli, M., & Cimolin, V. (2024) · Life · doi:10.3390/life14070864 · Cited by 12
“At the end of the program, partici ‐ pants completed a satisfaction questionnaire (System Usability Scale, SUS) [33] regarding the use of both devices.”
MethodLi, H., Gai, J., Bu, L., & Gao, C. (2025) · Universal Access in the Information Society · doi:10.1007/s10209-025-01245-z · Cited by 7
“Prior studies have demonstrated that SUS retains its psychometric robustness when applied to older adult populations, validating its relevance for this demographic [26].”
Waring, M. E., Simas, T. A. M., Heersping, G. E., Rudin, L. R., Balakrishnan, K., Burdick, A. R., & Pagoto, S. (2023) · mHealth · doi:10.21037/mhealth-22-49 · Cited by 6
“Following the usability testing, participants completed the System Usability Scale (SUS), a 10-item 5-point Likert scale measure assessing human-computer interaction (29,30).”
Navarro, N. D. C., Cedeño-Moreno, D., López-Cabrera, V., Matus, E., Núñez, I., & Concepción, D. H. (2024) · International Journal of Interactive Mobile Technologies (iJIM) · doi:10.3991/ijim.v18i02.44623 · Cited by 6
Chew, J. L., Zeng, Z., Tan, T. H. B., Chew, P., Ali, N. B., Wang, H., Ong, M., Raymond, R., Pek, K., Wang, D., et al. (2024) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph22010042 · Cited by 8
“A widely accepted benchmark for SUS scores is a score of 68 [28], which denotes an average level of usability.”
Roberts, R. L., Cherry, K. D., Mohan, D. P., Statler, T. M., Kirkendall, E. S., Moses, A., McCraw, J., Brown, A. E., Fofanova, T. Y., & Gabbard, J. (2024) · JMIR Aging · doi:10.2196/54128 · Cited by 10
“Usability was measured using the validated System Usability Scale (SUS) [45,46], a 10-item questionnaire.”
MethodKochashvili, M., Guttoo, P., Sezgın, E., Pai, A. L. H., Bajwa, R. P. S., Landier, W., Gerhardt, C. A., & Skeens, M. A. (2025) · JMIR Cancer · doi:10.2196/66847 · Cited by 5
Klaff, R., Tundealao, S. T., Krenek, B., & Tamí‐Maury, I. (2023) · mHealth · doi:10.21037/mhealth-23-4 · Cited by 6
Guo, R., Zheng, Z., Yang, F., & Wu, Y. X. (2025) · Journal of Medical Internet Research · doi:10.2196/67948 · Cited by 8
Perez, W. D. D., Prasetyo, Y. T., Cahigas, M. M. L., Nadlifatin, R., & Gumasing, M. J. J. (2024) · Acta Psychologica · doi:10.1016/j.actpsy.2024.104527 · Cited by 8
Che, R., Ruan, Y., Kodate, N., Shi, Y., Liu, X., Donnelly, S., Suwa, S., Yu, W., Kong, D., & Cheung, M. (2025) · Digital Health · doi:10.1177/20552076251370058 · Cited by 10
“54 In the study of Pérez-Rodríguez et al., 43 frail participants reported an average SUS score of 52.86 — below the average threshold — after using a robotic walker.”
InfluentialGovathson, C., Chetty-Makkan, C. M., Greener, R., Frade, S., Rech, D., Morris, S., Richard, Y., Mendonca, R., Maricich, N., Long, L. C., et al. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1731002 · Cited by 7
Mobile-based program improves healthy eating of ulcerative colitis patients: A pilot study
Tu, W., Yan, S., Yin, T., Zhang, S., Xu, W., Zhang, P., & Xu, G. (2023) · Digital Health · doi:10.1177/20552076231205741 · Cited by 6
“Scores ≥68 indicated above-average usability.(31) Moreover, semi-structured interviews were conducted by the first author following the 12-week program with those who agreed to participate to gain additional insights into their perceptions of using HealthyGut and suggestions for improvement.”
BackgroundElectronic Health Records (EHR) Usability and User Experience Evaluation: A Case Study
Yunus, M. H., Sakkinah, I. S., Rahmawati, U. E., Deharja, A., & Santi, M. W. (2023) · INTENSIF Jurnal Ilmiah Penelitian dan Penerapan Teknologi Sistem Informasi · doi:10.29407/intensif.v7i2.19090 · Cited by 9
“…is in using the software. besides that, UX also assesses emotions, beliefs, preferences and perceptions [6], [21] Ease of use is the degree to which an item can be utilized by certain clients to attain certain objectives with adequacy, proficiency, and fulfillment in certain utilized contexts [1].”
BackgroundKurban, Z., Khassenov, D., Burkitbayev, Z. K., Bulekbayeva, S. A., Chinaliyev, A., Serik, B., Saparbayev, S. S., Т.А., С., Zhunissova, U., Slivkina, N., et al. (2025) · Frontiers in Public Health · doi:10.3389/fpubh.2025.1590401 · Cited by 6
Savage, L. C., Soto-Cossio, L. E., Minardi, F., Beyrouty, M., Schoonover, J., Musella, J., Frazier, M., Villagra, C., Sly, J. R., Erblich, J., et al. (2024) · JMIR Formative Research · doi:10.2196/53224 · Cited by 8
“After excluding 1 participant with a missing value, the average SUS score for our second user test was 75.28, which is above the mean SUS score or the suggested benchmark for usability [37,38].”
BackgroundMethodInfluentialGamal, S., Elseasi, A. M. A., Sabry, N. A., & Farid, S. F. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01742-8 · Cited by 14
“Assessing app usability is important as it can dictate the adoption of such interventions, users ’ willingness to use them, sustained engagement as well as their actual usefulness and clinical impact 42,43 .”
Melamed, O. C., Mehra, K., Panda, R., Minian, N., Veldhuizen, S., Zawertailo, L. A., Buckley, L., Maslej, M. M., Greaves, L., Brabete, A. C., et al. (2024) · JMIR Research Protocols · doi:10.2196/60677 · Cited by 7
“Following the 28-day trial period, at the final survey we will assess participant perceptions on the usability of the app using the System Usability Scale [27] (Multimedia Appendix 4).”
Lin, L., Liao, J., Huang, C., Lin, F.-H., Lu, L.-T., Chien, H.-C., & Guo, J. (2025) · Games for Health Journal · doi:10.1089/g4h.2024.0207 · Cited by 9
Teague, S. J., Shatte, A. B. R., Fuller‐Tyszkiewicz, M., & Hutchinson, D. M. (2025) · Behaviour and Information Technology · doi:10.1080/0144929x.2025.2502474 · Cited by 10
“A score of 68 or more is considered above average usability (Hyzy et al. 2022).”
la Puente, G. D., da Silva, A. R. F., & Felix, R. (2024) · IEEE International Conference on Electronics, Electrical Engineering and Computing (INTERCON) · doi:10.1109/intercon63140.2024.10833503 · Cited by 7
MyTrack+: Human-centered design of an mHealth app to support long-term weight loss maintenance
Chen, Y.-P., Woodward, J., Shankar, M. N., Bista, D., Ugwoaba, U. A., Brockmann, A., Ross, K. M., Ruiz, J., & Anthony, L. (2024) · Frontiers in Digital Health · doi:10.3389/fdgth.2024.1334058 · Cited by 6
“The average SUS score was 84.53 (min ¼ 60; max ¼ 100; SD ¼ 10.92), surpassing the widely accepted SUS score benchmark of 68 (53).”
BackgroundInfluentialUsability Analysis on Digital Library Information System using System Usability Scale (SUS)
Pratiwi, P. Y., Pradnyana, I. M. A., & Damayanti, N. K. W. (2023) · International Conference on Electrical and Information Technology (IEIT) · doi:10.1109/ieit59852.2023.10335582 · Cited by 5
“Lastly, its employment of neutral technology enables the assessment of a diverse array of user interfaces, encompassing websites, mobile phones, and interactive voice response systems [8][9].”
BackgroundWälchli, G., Berger, T., Nissen, C., Moggi, F., & Bielinski, L. L. (2024) · Psychiatry Research · doi:10.1016/j.psychres.2024.116326 · Cited by 5
“A score of 68 or higher can be considered good usability (Hyzy et al., 2022).”
InfluentialRG4Face: A serious game incorporating mime movement recognition for facial rehabilitation
Sousa, D. L., Teixeira, S. S., Fontenele, J. E., Souza, H. D. S., Moreira, R., Silva, F., Ribeiro, P. F. M., & Teles, A. S. (2024) · Multimedia Tools and Applications · doi:10.1007/s11042-024-20429-y · Cited by 4
Feasibility and acceptability of incorporating artificial intelligence into simulation education
Swan, B. A., Febres-Cordero, S., Steiger, L., Lisenby, A., Getz, T., Hudson, J., Cole, K., Branch, R., McDermott, C., Fugate, K., et al. (2025) · Clinical Simulation in Nursing · doi:10.1016/j.ecns.2025.101739 · Cited by 5
Clinical Utility and Usability of the Digital Box and Block Test: Mixed Methods Study
Prochaska, E., & Ammenwerth, E. (2024) · JMIR Rehabilitation and Assistive Technologies · doi:10.2196/54939 · Cited by 7
“The System Usability Scale (SUS) is a widely used scale to quantify the usability of many software and hardware products [24].”
MethodInfluentialMoniz Game: Usability and User Experience Evaluation of a Musical Game for Motor Coordination
Moniz, Y. F., Gunji, B. T. G., da Silva, A. P., et al. (2024) · Games for Health Journal · doi:10.1089/g4h.2023.0133 · Cited by 5
“20 Despite the positive results, there is room for improvement in the Moniz Game.”
Poudyal, A., Lewis, D.-M., Taha, S., Martinez, A., Magoun, L., Ho, Y. X., Carmio, N., Naslund, J. A., Sanchez, K., Lesh, N. B., et al. (2024) · JMIR Formative Research · doi:10.2196/55205 · Cited by 6
“Overall, participants found the app usable, with an average SUS of 72.5 (SD 18.1) compared with the industry benchmark of 68, which has been found to be the average SUS for digital health apps and used in previous digital health studies [56,57].”
MethodInfluentialSupporting Dementia Caregiving With a Mobile Care Ecosystem: Development and Mixed Methods Study
Malhotra, C., Yue, Y., Ramakrishnan, C., Shah, S. U., Chen, W., Yap, P. L. K., Cheong, C. Y., Teo, I., Wee, S. L., Lan, X., et al. (2025) · JMIR Aging · doi:10.2196/78759 · Cited by 7
“For the phase 1 pilot, we compared the SUS scores to the benchmark mean of 68, which indicates good usability [35,36].”
Solorio-García, M. Y., Mata-López, W. A., Álvarez-Flores, J. L., Simon, J., & Castillo, V. H. (2026) · Electricity · doi:10.3390/electricity7010015 · Cited by 5
“SUS has been widely used as a highly reliable measure of perceived usability of systems, products, or services [50] and conforms to international standards, such as ISO [45].”
A Digital Intervention to Address Sexual Health in Hematopoietic Stem Cell Transplant Survivors
El-Jawahri, A. R., Reese, J. B., Traeger, L. N., Dizon, D. S., Cutler, C. S., Bober, S. L., Greer, J. A., Vanderklish, J., Rabideau, D. J., Cronin, K. G., et al. (2025) · Journal of the National Comprehensive Cancer Network · doi:10.6004/jnccn.2024.7076 · Cited by 6
“41 We also conducted exit interviews with 8 participants after they completed their week-12 questionnaire to assess their perceptions of (1) the acceptability and content of SHIFT, (2) SHIFT usability and engagement, and (3) the duration of ac-cesstoSHIFT.”
Laven, I. E. W. G., Oosterhoff, V. P. S., Franssen, A. J. P. M., van Roozendaal, L. M., Hulsewé, K. W. E., Vissers, Y. L. J., & de Loos, E. R. (2024) · Translational Lung Cancer Research · doi:10.21037/tlcr-24-134 · Cited by 10
“The primary outcome of this study, the usability of the 3D lung reconstructions, was evaluated using the postoperative system usability score (SUS) questionnaire (16,17).”
Co-Designing the MOSAIC mHealth App With Breast Cancer Survivors: User-Centered Design Approach
Nuseibeh, B. Z., Johns, S. A., Shih, P. C., Lewis, G. F., Gowan, T. M., & Jordan, E. J. (2024) · JMIR Formative Research · doi:10.2196/59426 · Cited by 5
Hayashi, K., Hachiya, K., Yonezu, K., Otani, N., Furuya, K., Miura, I., Tomoe, T., Sugiyama, T., Wada, Y., Takahashi, N., et al. (2023) · Circulation Reports · doi:10.1253/circrep.cr-23-0088 · Cited by 5
Chen, D., Shen, E., Kolbuck, V. D., Sajwani, A., Finlayson, C. A., & Gordon, E. J. (2024) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsae032 · Cited by 6
Devraj, K., Jones, L., Higgins, B. E., Thomas, P. B. M., & Moosajee, M. (2024) · Healthcare · doi:10.3390/healthcare12242550 · Cited by 5
Chan, A., Kodali, S., Lee, G. Y., Gadhave, S., Feldman, J. M., Arora, S., Pawar, S., Gadkari, R., Bargaje, M. D., Salvi, S. S., et al. (2022) · Journal of Asthma · doi:10.1080/02770903.2022.2155188 · Cited by 6
“Because of the outdated nature of QUIS and recent developments in information and communications technology (ICT), the use of another usability tool such as the System Usability Scale (SUS) may be more appropriate for upcoming studies (54).”
BackgroundMethodKerdar, S. H., Kirchhoff, B. M., Adolph, L., et al. (2025) · Technologies · doi:10.3390/technologies13040146 · Cited by 5
“: h(cid:308)ps://land-bot.io/, accessed on 17 June 2024) from the Developers’ point of view [32, The score ranges from 0 to 100, with a benchmark (mean score) of 68 [34].”
Metadata
- Authors
- Hyzy, M., Bond, R., Mulvenna, M., Bai, L., Dix, A., Leigh, S., & Hunt, S.
- Affiliations
- University of Ulster (GB)
- Swansea University (GB)
- University of Warwick (GB)
- Corresponding author
- Hyzy, Maciej
- Venue
- JMIR mHealth and uHealth
- Publisher
- JMIR Publications Inc.
- Published
- 2022-08-18
- Volume
- 10
- Issue
- 8
- Pages
- e37290
- ISSN
- 2291-5222 (ISSN-L)
- PMC
- PMC9437782
- OpenAlex
- W4287886354
- Semantic Scholar
- d6a7afe442a8d18d14ec6c390355103e41b42957
- Cited by
- 510
- References
- 33
- Citations by year
- 2026: 202 · 2025: 161 · 2024: 91 · 2023: 51 · 2022: 5
- FWCI
- 7.96
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR mhealth and uhealth (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Warwick Research Archive Portal (University of Warwick) (acceptedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Ulster University Research Portal (Ulster University) (submittedVersion, cc-by)
- Funders
- Department for the Economy
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Health Professions › Health Information Management › Health, Technology, Consumer Behavior
- Keywords
- System Usability Scale, digital health apps, physical activity apps, skewness, usability evaluation, report templates
- MeSH terms
- Humans, Telemedicine, Benchmarking, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.