Usability of Mobile Health Apps for Postoperative Care: Systematic Review
Open accessPublished version of a preprint
Abstract
Background: Mobile health (mHealth) apps are increasingly used postoperatively to monitor, educate, and rehabilitate. The usability of mHealth apps is critical to their implementation. Objective: This systematic review evaluates the (1) methodology of usability analyses, (2) domains of usability being assessed, and (3) results of usability analyses. Methods: The A Measurement Tool to Assess Systematic Reviews checklist was consulted. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses reporting guideline was adhered to. Screening was undertaken by 2 independent reviewers. All included studies were assessed for risk of bias. Domains of usability were compared with the gold-standard mHealth App Usability Questionnaire (MAUQ). Results: A total of 33 of 720 identified studies were included for data extraction. Of the 5 included randomized controlled trials (RCTs), usability was never the primary end point. Methodology of usability analyses included interview (10/33), self-created questionnaire (18/33), and validated questionnaire (9/33). Of the 3 domains of usability proposed in the MAUQ, satisfaction was assessed in 28 of the 33 studies, system information arrangement was assessed in 11 of the 33 studies, and usefulness was assessed in 18 of the 33 studies. Usability of mHealth apps was above industry average, with median System Usability Scale scores ranging from 76 to 95 out of 100. Conclusions: Current analyses of mHealth app usability are substandard. RCTs are rare, and validated questionnaires are infrequently consulted. Of the 3 domains of usability, only satisfaction is regularly assessed. There is significant bias throughout the literature, particularly with regards to conflicts of interest. Future studies should adhere to the MAUQ to assess usability and improve the utility of mHealth apps.
Verified 2026-10-06 · 1 reference not checked yet
AI snapshot
Written from the paper’s full text.
TL;DR
This systematic review of 33 studies found that usability assessment of postoperative mobile health apps is substandard: validated questionnaires are infrequent, satisfaction dominates, and randomized controlled trials rarely make usability a primary endpoint. Reported usability scores were generally above industry average, but bias and conflicts of interest are common.
Key findings
- Of 720 identified studies, 33 were included. Among 5 randomized controlled trials, usability was never the primary endpoint; 25 studies were prospective noncontrolled and 3 were retrospective reviews.
- Usability methods included interviews in 10/33 studies, self-created questionnaires in 18/33, and validated questionnaires in 9/33 (7 used the System Usability Scale, 1 used uMARS, 1 used technology acceptance subscales, and 1 used the Computer System Usability Questionnaire).
- By the MAUQ domains, satisfaction was assessed in 28/33 studies, system information arrangement in 11/33, and usefulness in 18/33.
- Usability was above industry average: SUS scores ranged from 76 to 95 out of 100 with a median of 87; uMARS score was 4.1/5; CSUQ score was 2/7, where 1 indicates greatest usability. Bias was common: 8/33 studies reported authors’ conflicts of interest, including holding shares in the app.
Methods
- Systematic review conducted with the AMSTAR checklist and PRISMA reporting guideline; a university librarian experienced in systematic review methodology was consulted, and Rayyan software was used.
- Medline, Embase, and Association for Computing Machinery Digital Library were searched using 4 broad themes; screening was performed by 2 independent reviewers, with full-text review and reference-list/review-article checking.
- Included studies were assessed for risk of bias, and usability domains were compared with the gold-standard 21-item mHealth App Usability Questionnaire (MAUQ).
Limitations
- The paper states significant potential for bias, especially conflicts of interest, hidden agenda bias, secondary gains bias, nonresponse bias, and population bias; it notes that nonresponders may report poorer usability, inflating results, and that younger populations may show inflated usability.
- The paper states that RCTs are rare, usability was never a primary endpoint in included RCTs, validated questionnaires were infrequently used, and the SUS was not validated for mHealth apps; MAUQ correlation with SUS was not strong (r=0.643).
- Evident from the text: the review was restricted to English-language, post-2000 full papers, excluded web/text/email-only technologies and pilot/feasibility studies without real-life postoperative analysis, and noted heterogeneity in usability definitions and methods.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 28 cited sources checked · 0 supported · 0 flagged
- Findingown data
Five included studies were randomized controlled trials.
“Of the 5 included randomized controlled trials (RCTs), usability was never the primary end point.”
- Also stated in: § Study Characteristics · plain
“With regards to study design, 5 studies were randomized controlled trials (RCTs), 25 were prospective noncontrolled studies, and 3 were retrospective reviews.”
Quote in the paperNot a substantial claim - Also stated in: § Study Characteristics · plain
- Findingown data
Satisfaction was assessed in 28 of 33 studies.
“Of the 3 domains of usability proposed in the MAUQ, satisfaction was assessed in 28 of the 33 studies, system information arrangement was assessed in 11 of the 33 studies, and usefulness was assessed in 18 of the 33 studies.”
Quote in the paperNot a substantial claim - Findingown data
Of the 5 included randomized controlled trials, usability was never the primary end point.
“Of the 5 included randomized controlled trials (RCTs), usability was never the primary end point.”
Quote in the paperNot a substantial claim - Findingcitation
Nilsson et al [43] had much lower rates (57.5% on day 14).
“others, such as Nilsson et al [43], had much lower rates (57.5% on day 14)”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [43] source
Not checked in the free run.
- Findingown data
Of the 33 included studies, 8 officially reported authors' conflicts of interest, stating that they held shares in the app.
“Of the 33 included studies, 8 officially reported authors’ conflicts of interest, stating that they held shares in the app.”
Quote in the paperNot a substantial claim
- Findingown data
Some [51] did not disclose the proportion of responders.
“some [51] did not disclose the proportion of responders.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [51] source
Not checked in the free run.
- Findingown data
Usage (monitoring of user engagement with the app) was used in 15 studies.
“usage (ie, monitoring of user engagement with the app) was used in 15 studies”
Quote in the paperNot a substantial claim - Findingown data
28 studies covered ease of use and satisfaction.
“A total of 28 studies covered ease of use and satisfaction”
Quote in the paperNot a substantial claim - Findingown data
Most of the included studies were derived from the United States and Europe.
“Most of the included studies were derived from the United States and Europe”
Quote in the paperNot a substantial claim - Findingown data
This review identified 33 studies evaluating the usability of mHealth apps in the postoperative period across a broad range of surgical subspecialties.
“This review identified 33 studies evaluating the usability of mHealth apps in the postoperative period across a broad range of surgical subspecialties”
Quote in the paperSubstantial claim - Findingown data
The uMARS score was 4.1 out of 5.
“The uMARS score was 4.1 out of 5.”
Quote in the paperNot a substantial claim - Findingcitation
A number of groups [38] declared no conflict of interest despite seemingly being founders of their app.
“a number of groups [38] declared no conflict of interest, despite seemingly being founders of their app.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [38] source
Not checked in the free run.
- Findingown data
The CSUQ score was 2 out of 7.
“The CSUQ score was 2 out of 7”
Quote in the paperNot a substantial claim - Findingown data
11 studies covered system information arrangement.
“11 studies covered system information arrangement”
- Also stated in: § Principal Findings · plain
“only 11 of the 33 usability analyses assessed the domain of system information arrangement”
Quote in the paperSubstantial claim - Also stated in: § Principal Findings · plain
- Findingown data
Validated questionnaires were used in 9 studies.
“Validated questionnaires were used in 9 studies.”
- Also stated in: § Principal Findings · plain
“Only 9 of the 33 included studies used validated questionnaires”
Quote in the paperSubstantial claim - Also stated in: § Principal Findings · plain
- Findingown data
Usage was the only usability analysis employed in 4 studies.
“was the only usability analysis employed in 4 studies”
Quote in the paperNot a substantial claim - Findingown data
18 studies covered usefulness.
“18 studies covered usefulness”
Quote in the paperNot a substantial claim - Findingnone given
Smartphones were the most commonly used devices.
“smartphones were the most commonly used devices”
Quote in the paperNot a substantial claim - Findingnone given
This is the first comprehensive systematic review to assess usability of mHealth apps in postoperative management.
“To our knowledge, this is the first comprehensive systematic review to assess usability of mHealth apps in postoperative management.”
Quote in the paperNot a substantial claim - Findingown data
Of the validated questionnaires, 7 used the SUS questionnaire.
“Of these, 7 used the SUS questionnaire”
- Also stated in: § Principal Findings · plain
“most of which used the SUS”
Quote in the paperNot a substantial claim - Also stated in: § Principal Findings · plain
- Findingcitation
Several study groups were provided with the apps free of charge [28].
“several of the study groups were provided with the apps free of charge [28]”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [28] source
Not checked in the free run.
- Findingown data
Median System Usability Scale scores ranged from 76 to 95 out of 100.
“Usability of mHealth apps was above industry average, with median System Usability Scale scores ranging from 76 to 95 out of 100.”
Quote in the paperSubstantial claim - Findingcitation
Pecorelli et al [44] had high response rates (96%) to usability analyses.
“Some studies, such as Pecorelli et al [44], had high response rates (96%) to usability analyses.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [44] source
Not checked in the free run.
- Findingown data
The majority of analyses used simplistic self-created questionnaires that asked rudimentary questions focusing on the domain of satisfaction.
“The majority of analyses used simplistic self-created questionnaires that asked rudimentary questions focusing on the domain of satisfaction (28/33 studies) rather than other domains of usability.”
Quote in the paperSubstantial claim - Findingown data
Usability was never a primary end point in the RCTs.
“usability was never a primary end point in these studies”
Quote in the paperSubstantial claim - Findingnone given
A number of the studies' authors have a financial interest in the usability of their apps.
“A number of the studies’ authors have a financial interest in the usability of their apps”
Quote in the paperSubstantial claim - Findingown data
28/33 studies focused on satisfaction.
“focusing on the domain of satisfaction (28/33 studies)”
Quote in the paperSubstantial claim - Findingown data
There were 5 RCTs.
“There were 5 RCTs”
Quote in the paperNot a substantial claim - Findingown data
25 of 33 studies were prospective noncontrolled trials.
“25 of 33 studies were prospective noncontrolled trials”
Quote in the paperSubstantial claim - Interpretationreasoning
There is significant potential for bias in studies evaluating the usability of mHealth apps.
“There is significant potential for bias in studies evaluating the usability of mHealth apps.”
Quote in the paperSubstantial claim - Premisecitation
Poor usability of mHealth apps will lead to less common use.
“The usability of mHealth apps is important [10,11] because those with poor usability will be less commonly used [12,13].”
Quote in the paperSubstantial claim0 of 2 sources checked - Interpretationreasoning
Nonresponse bias is a further concern.
“Nonresponse bias is a further concern.”
Quote in the paperNot a substantial claim - Premisecitation
Little empirical research is undertaken to analyze the usability of mHealth apps before they are launched.
“Despite this, little empirical research is undertaken to analyze the usability of mHealth apps before they are launched [15].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [15] source
Not checked in the free run.
- Interpretationreasoning
Population bias is a further issue.
“Population bias is a further issue.”
Quote in the paperNot a substantial claim - Interpretationown data
Of the 3 domains of usability, only satisfaction is regularly assessed.
“Of the 3 domains of usability, only satisfaction is regularly assessed.”
Quote in the paperSubstantial claim- Rests on an assumption: The MAUQ is a gold-standard reference for assessing usability of mHealth apps.
- Interpretationown data
Current analyses of mHealth app usability are substandard.
“Current analyses of mHealth app usability are substandard.”
Quote in the paperSubstantial claim- Rests on an assumption: The MAUQ is a gold-standard reference for assessing usability of mHealth apps.
- Interpretationown data
Usability of mHealth apps was above industry average.
“Usability of mHealth apps was above industry average, with median System Usability Scale scores ranging from 76 to 95 out of 100.”
Quote in the paperNot a substantial claim - Interpretationreasoning
Studies with high rates of nonresponders are likely to have inflated usability results.
“Therefore, studies with high rates of nonresponders are likely to have inflated usability results.”
Quote in the paperNot a substantial claim- Rests on an assumption: Nonresponders to usability analyses are more likely to have reported poor usability.
- Premisecitation
Around half of all mHealth app users stop engaging for various reasons, including loss of interest.
“One study revealed that around half of all mHealth app users stop engaging for various reasons, including loss of interest [14].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [14] source
Not checked in the free run.
- Interpretationown data
There is significant bias throughout the literature, particularly with regards to conflicts of interest.
“There is significant bias throughout the literature, particularly with regards to conflicts of interest.”
Quote in the paperSubstantial claim - Interpretationreasoning
Studies that include a younger demographic are likely to demonstrate inflated usability results.
“Therefore, studies that include a younger demographic are likely to demonstrate inflated usability results.”
Quote in the paperNot a substantial claim- Rests on an assumption: Younger audiences are likely to be more adept at using mobile technologies.
- Interpretationown data
RCTs are rare.
“RCTs are rare, and validated questionnaires are infrequently consulted.”
Quote in the paperSubstantial claim - Interpretationown data
Validated questionnaires are infrequently consulted.
“RCTs are rare, and validated questionnaires are infrequently consulted.”
Quote in the paperSubstantial claim - Premisecitation
The MAUQ was recently proposed and validated for use in mHealth apps in a population of English-speaking adults [64].
“the MAUQ was recently proposed and validated for use in mHealth apps in a population of English-speaking adults [64].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [64] source
Not checked in the free run.
- Interpretationreasoning
According to this review, usability analyses to date have been substandard.
“According to this review, usability analyses to date have been substandard.”
Quote in the paperSubstantial claim - Interpretationreasoning
A major concern in these studies is the risk of bias.
“A major concern in these studies is the risk of bias.”
Quote in the paperSubstantial claim - Interpretationown data
The inadequacy of studies that have only used the SUS is highlighted by the weak correlation.
“thereby highlighting the inadequacy of studies that have only used the SUS.”
Quote in the paperSubstantial claim - Interpretationreasoning
The methodology for assessing usability was generally poor.
“The methodology for assessing usability was generally poor.”
Quote in the paperSubstantial claim - Interpretationown data
The correlation between MAUQ and SUS is not strong (r=0.643).
“this is not a strong correlation (r=0.643)”
Quote in the paperSubstantial claim- Rests on an assumption: Scores on the MAUQ have previously been shown to correlate with the SUS, with a correlation of r=0.643.
- Interpretationreasoning
The SUS has not been validated for assessing mHealth apps.
“The SUS has not been validated for assessing mHealth apps.”
Quote in the paperSubstantial claim
- Classified as probably not a substantial claim. 39
- May combine two claims. 10
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataInterview was used as a method of usability analysis in 10 of 33 studies.
“Methodology of usability analyses included interview (10/33), self-created questionnaire (18/33), and validated questionnaire (9/33).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataSystem information arrangement was assessed in 11 of 33 studies.
“Of the 3 domains of usability proposed in the MAUQ, satisfaction was assessed in 28 of the 33 studies, system information arrangement was assessed in 11 of the 33 studies, and usefulness was assessed in 18 of the 33 studies.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Findingown dataA total of 33 studies were included for data extraction.
“A total of 33 of 720 identified studies were included for data extraction.”
- Also stated in: § Database Search Results · plain
“leaving 33 studies included for data extraction.”
Quote in the paperSubstantial claim- Also stated in: § Database Search Results · plain
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataValidated questionnaire was used as a method of usability analysis in 9 of 33 studies.
“Methodology of usability analyses included interview (10/33), self-created questionnaire (18/33), and validated questionnaire (9/33).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataSelf-created questionnaire was used as a method of usability analysis in 18 of 33 studies.
“Methodology of usability analyses included interview (10/33), self-created questionnaire (18/33), and validated questionnaire (9/33).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataSelf-created questionnaires were used in 18 studies.
“Self-created questionnaires were used in 18 studies.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataOf the validated questionnaires, 1 used the technology acceptance subscale.
“1 used the technology acceptance subscale”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataAverage SUS scores ranged from 76 to 95 out of 100, with a median score of 87.
“Average SUS scores ranged from 76 to 95 out of 100, with a median score of 87.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataInterviews were used in 10 studies.
“Interviews were used in 10 studies.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataThe initial search and reference list screening identified 721 studies.
“The initial search and reference list screening identified 721 studies.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataOf the 61 full-text studies, 28 were excluded.
“Of these, 28 were excluded, leaving 33 studies included for data extraction.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataAfter title and abstract screening, 660 studies were excluded.
“After title and abstract screening, 660 were excluded, leaving 61 full-text studies to be assessed.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataUsefulness was assessed in 18 of 33 studies.
“Of the 3 domains of usability proposed in the MAUQ, satisfaction was assessed in 28 of the 33 studies, system information arrangement was assessed in 11 of the 33 studies, and usefulness was assessed in 18 of the 33 studies.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataOf the validated questionnaires, 1 used the Computer System Usability Questionnaire (CSUQ).
“1 used the Computer System Usability Questionnaire (CSUQ)”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataOf the validated questionnaires, 1 used the uMARS questionnaire.
“1 used the uMARS questionnaire”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown data61 full-text studies were assessed.
“After title and abstract screening, 660 were excluded, leaving 61 full-text studies to be assessed.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingnone givenUsability analyses have focused on satisfaction, a narrow dimension of usability, with simplistic self-created questionnaires.
“They have focused on satisfaction, a narrow dimension of usability, with simplistic self-created questionnaires.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingnone givenDevices were sometimes provided free of charge.
“devices were sometimes provided free of charge”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitationThe PRISMA reporting guideline was adhered to for this review.
“The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) [26] reporting guideline was adhered to for this review.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [26] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningFree provision of apps has implications on satisfaction; users who paid might have higher expectations than those given free.
“which has clear implications on the usability domain of satisfaction; users who have paid for an app might be expected to have higher expectations than those who have been given an app for free.”
Quote in the paperNot a substantial claim- Rests on an assumption: Users who have paid for an app might be expected to have higher expectations than those who have been given an app for free.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenDomains of usability were compared with the gold-standard MAUQ.
“Domains of usability were compared with the gold-standard mHealth App Usability Questionnaire (MAUQ).”
Quote in the paperNot a substantial claim- Rests on an assumption: The MAUQ is a gold-standard reference for assessing usability of mHealth apps.
May combine two claims.
Interpretationown dataHidden agenda bias and secondary gains bias were common and seemingly underreported in the literature.
“Hidden agenda bias and secondary gains bias were common and seemingly underreported in the literature.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe user version of the Mobile App Rating Scale was proposed shortly after the Mobile App Rating Scale.
“The Mobile App Rating Scale [22] was recently created for researchers and clinicians to assess the quality of mHealth apps, with the simpler user version of the Mobile App Rating Scale (uMARS) [23] being proposed shortly after.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [23] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe Mobile App Rating Scale was created for researchers and clinicians to assess the quality of mHealth apps.
“The Mobile App Rating Scale [22] was recently created for researchers and clinicians to assess the quality of mHealth apps, with the simpler user version of the Mobile App Rating Scale (uMARS) [23] being proposed shortly after.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [22] source
Not checked in the free run.
May combine two claims.
InterpretationreasoningGeneralizability of results from studies [44] that included patients not used to mobile technologies may be limited and may change in the future when greater numbers of older patients are used to mobile technologies.
“Additionally, the generalizability of results from studies [44] that included patients that were not used to mobile technologies may be limited and may change in the future, when greater numbers of older patients are used to mobile technologies.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [44] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductcitationThe AMSTAR checklist was analyzed before conducting the review, with all methodology established prior to the review.
“The A Measurement Tool to Assess Systematic Reviews checklist [25] was analyzed before conducting this review, with all methodology being established prior to the review being conducted.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [25] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationDifferent methods have been proposed for assessing domains of usability, such as the Post-Study System Usability Questionnaire and the System Usability Scale.
“Different methods have been proposed for assessing domains of usability, such as the Post-Study System Usability Questionnaire [20] and the System Usability Scale (SUS) [21].”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [20] source
Not checked in the free run.
- cites [21] Brooke, J, 1996, Usability Evaluation In Industry
Not checked in the free run.
May combine two claims.
PremisecitationThe Post-Study System Usability Questionnaire and the System Usability Scale were not originally created to evaluate mHealth apps.
“However, these tools were not originally created to evaluate mHealth apps.”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [20] source
Not checked in the free run.
- cites [21] Brooke, J, 1996, Usability Evaluation In Industry
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Interpretationown dataThe United States and Europe appear to be hubs of innovation in the field.
“which appear to be hubs of innovation in the field”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationSeveral definitions and domains of usability have been previously defined without clear unification.
“Several definitions and domains of usability have been previously defined without clear unification [11,16,17], but with several recurring themes.”
Quote in the paperNot a substantial claim0 of 3 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing).
Interpretationown dataThe identified studies demonstrate growing interest in this area.
“demonstrating the growing interest in this area”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Study design and conductnone givenAll included studies were assessed for risk of bias.
“All included studies were assessed for risk of bias.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
PremisecitationThe 3 MAUQ domains are in line with the ISO definition: ease of use and satisfaction akin to ISO satisfaction; system information arrangement akin to ISO efficiency; usefulness akin to ISO effectiveness.
“This tool explores 3 domains of usability, which are in line with the ISO definition: (1) ease of use and satisfaction, akin to ISO satisfaction; (2) system information arrangement, akin to ISO efficiency; and (3) usefulness, akin to ISO effectiveness.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [24] source
Not checked in the free run.
May combine two claims.
PremisecitationThe mHealth App Usability Questionnaire (MAUQ) was developed and validated.
“Given the heterogeneity in definitions and methods used for assessing the usability of mHealth apps, one group has recently developed and validated the 21-item mHealth App Usability Questionnaire (MAUQ) [24].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [24] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationMAUQ explores 3 domains of usability: ease of use and satisfaction, system information arrangement, and usefulness.
“This tool explores 3 domains of usability, which are in line with the ISO definition: (1) ease of use and satisfaction, akin to ISO satisfaction; (2) system information arrangement, akin to ISO efficiency; and (3) usefulness, akin to ISO effectiveness.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [24] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenScreening was undertaken by 2 independent reviewers.
“Screening was undertaken by 2 independent reviewers.”
- Also stated in: § Screening of Papers for Inclusion and Exclusion · plain
“Screening of article titles and abstracts was performed by 2 authors independently.”
Quote in the paperNot a substantial claim- Also stated in: § Screening of Papers for Inclusion and Exclusion · plain
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationMAUQ is a 21-item tool.
“Given the heterogeneity in definitions and methods used for assessing the usability of mHealth apps, one group has recently developed and validated the 21-item mHealth App Usability Questionnaire (MAUQ) [24].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [24] source
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningThorough analysis of usability is critical to the adoption of these novel technologies in the postoperative period.
“Thorough analysis of usability is critical to the adoption of these novel technologies in the postoperative period”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based). May combine two claims.
Interpretationnone givenmHealth apps have significant potential during the postoperative period for encouraging earlier discharge, improving patient engagement, and offering a safety net for early identification of complications.
“mHealth apps have significant potential during the postoperative period for encouraging earlier discharge, improving patient engagement, and offering a safety net for early identification of complications.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenThere is a significant risk of bias, given the common conflicts of interest among authors of published studies.
“there is a significant risk of bias, given the common conflicts of interest among authors of published studies.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
Interpretationnone givenThose with poor usability will have little impact in health care.
“those with poor usability will have little impact in health care”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningFree devices could influence the feedback from users.
“which could influence the feedback from users”
Quote in the paperNot a substantial claim- Rests on an assumption: Devices provided free of charge could influence the feedback from users.
Probably not a substantial claim: may not pass S1 (asserted), S3 (load-bearing).
PremisecitationmHealth app interventions are associated with a falsely heightened level of user satisfaction due to patients' affinities for their digital devices [62].
“It has also been suggested that mHealth app interventions are associated with a falsely heightened level of user satisfaction due to patients’ affinities for their digital devices [62].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [62] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenHigh user satisfaction makes adoption by hospitals and investors more likely.
“with high user satisfaction making adoption by hospitals and investors more likely”
Quote in the paperNot a substantial claim- Rests on an assumption: High user satisfaction makes adoption by hospitals and investors more likely.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationRCTs have previously been described as an impractical evaluation methodology for mHealth apps, due to their prolonged duration from recruitment to results and their high costs [63].
“RCTs have previously been described as an impractical evaluation methodology for mHealth apps, due to their prolonged duration from recruitment to results and their high costs [63].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [63] source
Not checked in the free run.
The paper relies on this without support.
The usability of mHealth apps is critical to their implementation.
“The usability of mHealth apps is critical to their implementation.”
The paper relies on this without support.
mHealth apps are increasingly used postoperatively to monitor, educate, and rehabilitate.
“Mobile health (mHealth) apps are increasingly used postoperatively to monitor, educate, and rehabilitate.”
The paper relies on this without support.
The MAUQ is a gold-standard reference for assessing usability of mHealth apps.
“Domains of usability were compared with the gold-standard mHealth App Usability Questionnaire (MAUQ).”
“using the validated MAUQ as the gold-standard reference.”
The paper relies on this without support.
Nonresponders to usability analyses are more likely to have reported poor usability.
“Nonresponders to usability analyses are more likely to have reported poor usability.”
The paper relies on this without support.
Younger audiences are likely to be more adept at using mobile technologies.
“Younger audiences are likely to be more adept at using mobile technologies.”
The paper relies on this without support.
The average SUS score is 68 out of 100.
“The average SUS score is 68 out of 100”
The paper relies on this without support.
Users who have paid for an app might be expected to have higher expectations than those who have been given an app for free.
“users who have paid for an app might be expected to have higher expectations than those who have been given an app for free.”
The paper relies on this without support.
High user satisfaction makes adoption by hospitals and investors more likely.
“high user satisfaction making adoption by hospitals and investors more likely”
The paper relies on this without support.
Devices provided free of charge could influence the feedback from users.
“which could influence the feedback from users”
The paper relies on this without support.
Scores on the MAUQ have previously been shown to correlate with the SUS, with a correlation of r=0.643.
“scores on the MAUQ have previously been shown to correlate with the SUS, this is not a strong correlation (r=0.643)”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
North American country counts do not add to the stated total
MinorThe stated 14 studies from the United States and 6 from Canada add to 20, not 21.
Reported 21 · recomputed 20
“Of the 33 studies, 21 were from North America (14 from the United States and 6 from Canada), 9 were from Europe, 2 were from Asia, and 1 was from South America.”
Identified-study total differs between abstract and results
MinorThe abstract reports 720 identified studies, whereas the database search results report 721.
“A total of 33 of 720 identified studies were included for data extraction.”
“The initial search and reference list screening identified 721 studies.”
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823 · see citing works
Rayyan-a web and mobile app for systematic reviews.
Ouzzani, M., Hammady, H., Fedorowicz, Z., & Elmagarmid, A. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0384-4 · Cited by 26,092 · see citing works
Shea, B. J., Reeves, B. C., Wells, G., Thuku, M., Hamel, C., Moran, J., Moher, D., Tugwell, P., Welch, V., Kristjansson, E., et al. (2017) · BMJ · doi:10.1136/bmj.j4008 · Cited by 10,636 · see citing works
Usability Evaluation In Industry
(1996) · CRC Press eBooks · doi:10.1201/9781498710411 · Cited by 4,400 · see citing works
IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use
Lewis, J. R. (1995) · International Journal of Human-Computer Interaction · doi:10.1080/10447319509526110 · Cited by 2,429 · see citing works
Mobile app rating scale: a new tool for assessing the quality of health mobile apps
Stoyanov, S. R., Hides, L., Kavanagh, D. J., Zelenko, O., Tjondronegoro, D., & Mani, M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3422 · Cited by 2,233 · see citing works
Health App Use Among US Mobile Phone Owners: A National Survey
Krebs, P., & Duncan, D. T. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4924 · Cited by 1,274 · see citing works
Development and validation of the user version of the Mobile application rating scale (uMARS)
Stoyanov, S. R., Hides, L., Kavanagh, D. J., & Wilson, H. (2016) · JMIR mhealth and uhealth · doi:10.2196/mhealth.5849 · Cited by 872 · see citing works
Usability of mobile applications: literature review and rationale for a new usability model
Harrison, R., Flood, D., & Duce, D. (2013) · Journal of Interaction Science · doi:10.1186/2194-0827-1-1 · Cited by 736 · see citing works
The mHealth App Usability Questionnaire (MAUQ): Development and Validation Study
Zhou, L., Bao, J., Setiawan, I. M. A., Saptono, A., & Parmanto, B. (2019) · JMIR mHealth and uHealth · doi:10.2196/11500 · Cited by 675 · cited 1× · see citing works
“In comparison, the MAUQ was recently proposed and validated for use in mHealth apps in a population of English-speaking adults [64].”
MethodMobile medical and health apps: state of the art, concerns, regulatory control and certification
Kamel Boulos, M. N., Brewer, A. C., Karimkhani, C., Buller, D. B., & Dellavalle, R. P. (2014) · Online Journal of Public Health Informatics · doi:10.5210/ojphi.v5i3.4814 · Cited by 659 · see citing works
Empirical Studies on Usability of mHealth Apps: A Systematic Literature Review
Zapata, B. C., Fernández-Alemán, J. L., Idri, A., & Toval, A. (2015) · Journal of Medical Systems · doi:10.1007/s10916-014-0182-2 · Cited by 585 · see citing works
<i>mHealth Consumer Apps</i> : The Case for User-Centered Design
McCurdie, T., Taneva, S., Casselman, M., Yeung, M., McDaniel, C., Ho, W., & Cafazzo, J. (2012) · Biomedical Instrumentation & Technology · doi:10.2345/0899-8205-46.s2.49 · Cited by 478 · see citing works
Prescribable mHealth apps identified from an overview of systematic reviews
Byambasuren, O., Sanders, S., Beller, E., & Glasziou, P. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0021-9 · Cited by 291 · see citing works
Ramkumar, P. N., Haeberle, H. S., Ramanathan, D., Cantrell, W. A., Navarro, S. M., Mont, M. A., Bloomfield, M. R., & Patterson, B. M. (2019) · The Journal of Arthroplasty · doi:10.1016/j.arth.2019.05.021 · Cited by 209 · see citing works
The digital placebo effect: mobile mental health meets clinical psychiatry
Torous, J., & Firth, J. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00565-9 · Cited by 200 · see citing works
Semple, J. L., Sharpe, S., Murnaghan, M. L., Theodoropoulos, J., & Metcalfe, K. A. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3929 · Cited by 190 · see citing works
Bini, S. A., & Mahajan, J. (2016) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x16634518 · Cited by 168 · see citing works
Timmers, T., Janssen, L., van der Weegen, W., Das, D., Marijnissen, W.-J., Hannink, G., van der Zwaard, B. C., Plat, A., Thomassen, B., Swen, J.-W., et al. (2019) · JMIR mHealth and uHealth · doi:10.2196/15323 · Cited by 162 · see citing works
Beyond the Randomized Controlled Trial: A Review of Alternatives in mHealth Clinical Trial Methods
Pham, Q., Wiljer, D., & Cafazzo, J. A. (2016) · JMIR mHealth and uHealth · doi:10.2196/mhealth.5720 · Cited by 162 · see citing works
Usability Dimensions for Mobile Applications-A Review
Baharuddin, R., Singh, D., & Razali, R. (2013) · Research Journal of Applied Sciences Engineering and Technology · doi:10.19026/rjaset.5.4776 · Cited by 158 · see citing works
Armstrong, K., Coyte, P. C., Brown, M. H., Beber, B. A., & Semple, J. L. (2017) · JAMA Surgery · doi:10.1001/jamasurg.2017.0111 · Cited by 147 · see citing works
Feasibility of an Image-Based Mobile Health Protocol for Postoperative Wound Monitoring
Gunter, R. L., Fernandes‐Taylor, S., Rahman, S., Awoyinka, I., Bennett, K. M., Weber, S. M., Greenberg, C. C., & Kent, K. C. (2018) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2017.12.013 · Cited by 111 · see citing works
Debono, B., Bousquet, P., Sabatier, P., Plas, J.-Y., Lescure, J.-P., & Hamel, O. (2016) · European Spine Journal · doi:10.1007/s00586-016-4680-4 · Cited by 96 · see citing works
Schnall, R., Mosley, J. P., Iribarren, S. J., Bakken, S., Carballo-Diéguez, A., & Brown III, W. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4882 · Cited by 89 · see citing works
Harder, H., Holroyd, P., Burkinshaw, L., Watten, P., Zammit, C., Harris, P. R., Good, A., & Jenkins, V. (2017) · Journal of Cancer Survivorship · doi:10.1007/s11764-017-0630-3 · Cited by 84 · see citing works
From patient centred to people powered: autonomy on the rise
deBronkart, D. (2015) · BMJ · doi:10.1136/bmj.h148 · Cited by 83 · see citing works
Symer, M. M., Abelson, J. S., Milsom, J. W., McClure, B., & Yeo, H. (2017) · Journal of Gastrointestinal Surgery · doi:10.1007/s11605-017-3482-2 · Cited by 80 · see citing works
Gunter, R., Fernandes-Taylor, S., Mahnke, A., Awoyinka, L., Schroeder, C., Wiseman, J., Sullivan, S., Bennett, K., Greenberg, C., & Kent, K. C. (2016) · JMIR mHealth and uHealth · doi:10.2196/mhealth.6023 · Cited by 77 · see citing works
Argent, R., Slevin, P., Bevilacqua, A., Neligan, M. C., Daly, A., & Caulfield, B. (2019) · Sensors · doi:10.3390/s19020432 · Cited by 75 · see citing works
Pecorelli, N., Fiore, J. F., Kaneva, P., Somasundram, A., Charlebois, P., Liberman, A. S., Stein, B. L., Carli, F., & Feldman, L. S. (2018) · Surgical Endoscopy · doi:10.1007/s00464-017-5920-3 · Cited by 68 · cited 7× · see citing works
“SUS average score 87/100 Satisfaction; System information arrangement SUS questionnaire 4 weeks 45 Prospective study (no control) Pecorelli et al [44]”
BackgroundInfluentialMixed-methods analysis of factors impacting use of a postoperative mHealth app
Scott, A. R., Alore, E. A., Naik, A. D., Berger, D. H., & Suliburk, J. W. (2017) · JMIR mhealth and uhealth · doi:10.2196/mhealth.6728 · Cited by 67 · see citing works
Jaensson, M., Dahlberg, K., Eriksson, M., Grönlund, Å., & Nilsson, U. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4649 · Cited by 59 · cited 4× · see citing works
“2 | e19099 | p. 9https://periop.jmir.org/2020/2/e19099 (page number not for citation purposes) XSL•FO RenderX Selected quantitative measure of usability Aspects of usability measured Method of analysis of usability /outcome measure Duration follow-up Number of patients Study designStudy 85% strongly agree with intenti…”
BackgroundInfluentialDahlberg, K., Philipsson, A., Hagberg, L., Jaensson, M., Nyman, M. H., & Nilsson, U. G. (2017) · British Journal of Anaesthesia · doi:10.1093/bja/aex332 · Cited by 59 · see citing works
Mata, J., Pecorelli, N., Kaneva, P. A., Moldoveanu, D., Gosselin-Tardiff, A., Alhashemi, M., Robitaille, S., Balvardi, S., Lee, L., Stein, B., et al. (2019) · Surgical Endoscopy · doi:10.1007/s00464-019-06823-w · Cited by 59 · see citing works
An Evolution of Communication in Postoperative Free Flap Monitoring
Hwang, J. H., & Mun, G. (2012) · Plastic & Reconstructive Surgery · doi:10.1097/prs.0b013e318254b202 · Cited by 55 · see citing works
Shellmer, D. A., Dew, M. A., Mazariegos, G. V., & Dabbs, A. D. (2016) · Pediatric Transplantation · doi:10.1111/petr.12639 · Cited by 54 · see citing works
Chai, Y. J., Song, J., Kang, J., Woo, J., Song, R., Kwon, H., Kim, S., Choi, J. Y., & Lee, K. E. (2016) · Annals of Surgical Treatment and Research · doi:10.4174/astr.2016.90.5.239 · Cited by 54 · see citing works
Belarmino, A., Walsh, R. J., Alshak, M. N., Patel, N., Wu, R., & Hu, J. C. (2018) · European Urology Oncology · doi:10.1016/j.euo.2018.08.016 · Cited by 48 · see citing works
van der Meij, E., Huirne, J. A. F., ten Cate, A. D., Stockmann, H. B. A. C., Scholten, P. C., Davids, P. H. P., Bonjer, H. J., & Anema, J. R. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.8338 · Cited by 45 · see citing works
Sun, T., West, N., Ansermino, J. M., Montgomery, C. J., Myers, D., Dunsmuir, D. T., LAUDER, G. R., & von Baeyer, C. L. (2015) · Pediatric Anesthesia · doi:10.1111/pan.12790 · Cited by 45 · see citing works
Telemedicine with mobile devices and augmented reality for early postoperative care
Ponce, B. A., Brabston, E. W., Zu, S., Watson, S. L., Baker, D. K., Winn, D., Guthrie, B. L., & Shenai, M. B. (2016) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2016.7591705 · Cited by 41 · see citing works
Gustavell, T., Langius‐Eklöf, A., Wengström, Y., Segersvärd, R., & Sundberg, K. K. (2018) · Cancer Nursing · doi:10.1097/ncc.0000000000000584 · Cited by 41 · see citing works
Desenvolvimento de aplicativo de celular educativo para pacientes submetidos à cirurgia ortognática
Sousa, C. S., & Turrini, R. N. T. (2019) · Revista Latino-Americana de Enfermagem · doi:10.1590/1518-8345.2904.3143 · Cited by 37 · see citing works
Sereika, S. M., Dabbs, A. D., Handler, S. M., Schlenk, E. A., & Jiang, Y. (2016) · Applied Clinical Informatics · doi:10.4338/aci-2015-12-ra-0170 · Cited by 36 · see citing works
Felbaum, D. R., Stewart, J. J., Anaizi, A. N., Sandhu, F. A., Nair, M. N., & Voyadzis, J.-M. (2017) · Operative Neurosurgery · doi:10.1093/ons/opx112 · Cited by 32 · see citing works
Mobile Web-Based Follow-up for Postoperative ACL Reconstruction: A Single-Center Experience
Higgins, J. P., Semple, J. L., Murnaghan, M. L., Sharpe, S., & Theodoropoulos, J. S. (2017) · Orthopaedic Journal of Sports Medicine · doi:10.1177/2325967117745278 · Cited by 31 · see citing works
Common criteria for usability review
Nassar, V. (2012) · Work · doi:10.3233/wor-2012-0282-1053 · Cited by 31 · see citing works
Nilsson, U., Dahlberg, K., & Jaensson, M. (2017) · JMIR mHealth and uHealth · doi:10.2196/mhealth.9061 · Cited by 27 · see citing works
At‐home monitoring after surgery/anaesthesia – a challenge
Warrén‐Stomberg, M., Jacobsson, J., Brattwall, M., & Jildenstål, P. K. (2016) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12551 · Cited by 26 · see citing works
Software-Based Postoperative Communication With Patients Undergoing Spine Surgery
Goz, V., Anthony, C., Pugely, A., Lawrence, B., Spina, N., Brodke, D., & Spiker, W. R. (2019) · Global Spine Journal · doi:10.1177/2192568217728047 · Cited by 21 · see citing works
Highland, K. B., Tran, J., Brandon-Edwards, H., Bedöcs, P., Suen, J., & Buckenmaier, C. C. (2018) · Pain Medicine · doi:10.1093/pm/pny288 · Cited by 21 · see citing works
Chang, P., Lin, L., Zhang, H., Zhao, Y., Xie, J., Yu, Y., & Zhao, Y. (2018) · Graefe s Archive for Clinical and Experimental Ophthalmology · doi:10.1007/s00417-018-4080-z · Cited by 21 · see citing works
Khanwalkar, A. R., Shen, J., Kern, R. C., Welch, K. C., Smith, S. S., Tan, B. K., & Conley, D. B. (2018) · International Forum of Allergy & Rhinology · doi:10.1002/alr.22273 · Cited by 20 · see citing works
Sun, T., Dunsmuir, D. T., Miao, I., Devoy, G. M., West, N., Görges, M., LAUDER, G. R., & Ansermino, J. M. (2018) · Pediatric Anesthesia · doi:10.1111/pan.13471 · Cited by 19 · see citing works
Yadav, S. K., Jha, C. K., Mishra, S. K., & Mishra, A. (2019) · World Journal of Surgery · doi:10.1007/s00268-019-05212-7 · Cited by 15 · see citing works
Using technology to enhance medication regimen education after solid organ transplantation
Tsapepas, D. S., Salerno, D. M., Jandovitz, N., Hammad, S., Jordan, P., Mohan, S., Hardy, M. A., Kotchoubey, H., Vawdrey, D. K., & Fleischut, P. M. (2018) · American Journal of Health-System Pharmacy · doi:10.2146/ajhp170799 · Cited by 14 · see citing works
Brunner, T. H., DiFortuna, K., LeTang, M. L. M., Murphy, J., Stemplewicz, K., Kovacs, M., DeRosa, A. P., Gibson, D. S., & Ginex, P. (2017) · Journal of PeriAnesthesia Nursing · doi:10.1016/j.jopan.2016.10.008 · Cited by 14 · see citing works
Zhao, B., Tai‐Seale, M., Longhurst, C., & Clay, B. J. (2019) · JMIR mhealth and uhealth · doi:10.2196/13964 · Cited by 7 · see citing works
Mühlbach, L. (2005) · Springer eBooks · doi:10.1007/3-540-28144-4_13 · Cited by 2 · see citing works
Flagged first, then by citations
1 of the 62 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
System Usability Scale Benchmarking for Digital Health Apps: Meta-analysis
Hyzy, M., Bond, R., Mulvenna, M., Bai, L., Dix, A., Leigh, S., & Hunt, S. (2022) · JMIR mHealth and uHealth · doi:10.2196/37290 · Cited by 510 · see citing works
“A systematic literature review [39] evaluated the methodologies of usability analyses, domains of usability being assessed, and results of usability analyses.”
BackgroundKnight, S. R., Ng, N., Tsanas, A., Mclean, K., Pagliari, C., & Harrison, E. M. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00525-1 · Cited by 104 · see citing works
Özden, F., & Sarı, Z. (2023) · Archives of Gerontology and Geriatrics · doi:10.1016/j.archger.2023.105058 · Cited by 33 · see citing works
The first AI ‐based Chatbot to promote HIV self‐management: A mixed methods usability study
Ma, Y., Achiche, S., Tu, G., Vicente, S., Lessard, D., Engler, K., Lemire, B., Laymouna, M. A., de Pokomandy, A., Cox, J., et al. (2024) · HIV Medicine · doi:10.1111/hiv.13720 · Cited by 31 · see citing works
Which criteria are important in usability evaluation of mHealth applications: an umbrella review
Galavi, Z., Montazeri, M., & Khajouei, R. (2024) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-024-02738-2 · Cited by 30 · see citing works
Rossi, S. M. P., Panzera, R. M., Sangaletti, R., Andriollo, L., Giudice, L., Lecci, F., & Benazzo, F. (2024) · Healthcare · doi:10.3390/healthcare12020153 · Cited by 28 · see citing works
Pooni, A., Brar, M. S., Anpalagan, T., Schmocker, S., Rashid, S., Goldstein, R., Goriawala, A., Easson, A. M., & Kennedy, E. D. (2022) · Annals of Surgery · doi:10.1097/sla.0000000000005527 · Cited by 27 · see citing works
Lim, J. Y., Kim, Y., Yeo, S. M., Chae, B. J., Yu, J. H., & Hwang, J. H. (2023) · Health Informatics Journal · doi:10.1177/14604582231156476 · Cited by 21 · see citing works
Lv, C., Lu, F., Zhou, X., Li, X., Yu, W., Zhang, C., Chen, K., Du, S., Han, C., Wang, J., et al. (2024) · International Journal of Surgery · doi:10.1097/js9.0000000000001845 · Cited by 20 · see citing works
Pape, M., Färber, T., Seiferth, C., Roth, T., Schroeder, S., Wolstein, J., Herpertz, S., & Steins‐Loeber, S. (2022) · JMIR Formative Research · doi:10.2196/38480 · Cited by 20 · see citing works
Reichold, M., Heß, M., Kolominsky‐Rabas, P. L., Graessel, E., & Prokosch, H. (2021) · JMIR Formative Research · doi:10.2196/31649 · Cited by 17 · see citing works
Tacke, T., Nohl-Deryk, P., Lingwal, N., Reimer, L. M., Starnecker, F., Güthlin, C., Gerlach, F. M., Schunkert, H., Jonas, S., & Müller, A. (2024) · Digital Health · doi:10.1177/20552076231225168 · Cited by 14 · see citing works
Haveman, M. E., van Melzen, R., Schuurmann, R. C. L., Hermens, H. J., Tabak, M., & de Vries, J. P. P. M. (2022) · Expert Review of Medical Devices · doi:10.1080/17434440.2022.2108703 · Cited by 14 · see citing works
Lonner, J. H., Anderson, M. B., Redfern, R. E., Andel, D. V., Ballard, J. C., & Parratte, S. (2022) · International Orthopaedics · doi:10.1007/s00264-022-05651-3 · Cited by 14 · see citing works
Happe, L., Sgraja, M., Hein, A., & Diekmann, R. (2022) · JMIR Human Factors · doi:10.2196/31823 · Cited by 11 · see citing works
Postoperative innovative technology for ambulatory anesthesia and surgery
Coppens, M. J., Caelenberg, E. V., & Regge, M. D. (2021) · Current Opinion in Anaesthesiology · doi:10.1097/aco.0000000000001036 · Cited by 11 · see citing works
Exploring the digital divide: results of a survey informing mobile application development
Claudio, M. C., Rehany, Z., Stachtari, K., Guadagno, E., Osmanlliu, E., & Poenaru, D. (2024) · Frontiers in Digital Health · doi:10.3389/fdgth.2024.1382507 · Cited by 10 · see citing works
Fabens, I., Makhele, C., Igaba, N., Hlongwane, S., Phohole, M., Waweru, E., Oni, F., Khwepeya, M., Sardini, M., Moyo, K., et al. (2024) · JMIR Formative Research · doi:10.2196/62762 · Cited by 9 · see citing works
Kamecka, K., Foti, C., Gawinski, L. P., Matejun, M., Rybarczyk-Szwajkowska, A., Kiljański, M., Krochmalski, M., Kozłowski, R., & Marczak, M. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph191811521 · Cited by 8 · see citing works
Gagnon, J., Chartrand, J., Probst, S., Maillet, É., Reynolds, E., & Lalonde, M. (2024) · International Wound Journal · doi:10.1111/iwj.70064 · Cited by 7 · see citing works
Glenn, L. M., Jackson, D., Barton, C., Lan, D., Fuhrmeister, L., Symons, K., Turnour, L., Tefay, B., Holland, A. E., Goh, N. S. L., et al. (2024) · Respirology · doi:10.1111/resp.14874 · Cited by 7 · see citing works
Chughtai, B. I., Cho, A., Simonyan, V. V., Mao, J., Viviano, C. J., Marinac‐Dabic, D., Menafee, S., Rardin, C. R., & Sedrakyan, A. (2021) · Urology · doi:10.1016/j.urology.2021.10.011 · Cited by 7 · see citing works
Ranzani, R., Razzoli, M., Sanson, P., Song, J., Galati, S., Ferrarese, C., Lambercy, O., Kaelin‐Lang, A., & Gassert, R. (2024) · Toxins · doi:10.3390/toxins16080346 · Cited by 5 · see citing works
Harari, R. E., Al-Taweel, A., Anderson, E. M., Pozner, C. N., Grossmann, R. J., Goldsmith, A. J., & Shokoohi, H. (2025) · JMIR XR and spatial computing. · doi:10.2196/60792 · Cited by 5 · see citing works
Buawangpong, N., Siviroj, P., Pinyopornpanish, K., & Sirikul, W. (2025) · JMIR Aging · doi:10.2196/60156 · Cited by 5 · see citing works
Usability of an mHealth application in India for type 2 diabetes mellitus
Goswami, R., Garner, S. L., & George, C. E. (2022) · Health Education Journal · doi:10.1177/00178969221138483 · Cited by 5 · see citing works
Hiltunen, A.-M., Haavisto, I., Nuutinen, M., Lahelma, M., Salminen, A., Mello, J. D. A., Liperoti, R., Howard, E., Fialová, D., Szczerbińska, K. E., et al. (2025) · BMJ Open · doi:10.1136/bmjopen-2025-101234 · Cited by 4 · see citing works
Post discharge digital health technology interventions in ambulatory surgery
Bentsen, S. B., Stjernberg, M., Raeder, J. C., Eide, G. E., Tvedt, M. N., & Hegland, P. A. (2025) · European Journal of Anaesthesiology · doi:10.1097/eja.0000000000002233 · Cited by 4 · see citing works
Tang, Y., Gierc, M. S. H., La, H., Kim, J., Liu, S., Lam, R. W. M., Puterman, E. M., & Faulkner, G. (2025) · Digital Health · doi:10.1177/20552076251317756 · Cited by 4 · see citing works
Is the Quality of Mobile Health Applications for Burns Being Adequately Assessed?
Patel, B., Edwards, T., Schrire, T., Barnard, K., & Sen, S. K. (2021) · Journal of Burn Care & Research · doi:10.1093/jbcr/irab197 · Cited by 4 · see citing works
Self-citationObjectively Assessing and Comparing the User Experience of Two Thousand Digital Health Apps
Hyzy, M., Bond, R., Mulvenna, M. D., Bai, L., Daly, R., & Leigh, S. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35705-3_25 · Cited by 4 · see citing works
Strange, E., Altermatt, F. R., Cáceres, L. A. C., Morrison, C., Cortés, L., Sumonte, N. I., & Neyem, A. (2025) · Regional Anesthesia & Pain Medicine · doi:10.1136/rapm-2025-106818 · Cited by 3 · see citing works
Artificial Intelligence in Sports Medicine
Fares, M. Y., Boufadel, P., Vadhera, A. S., & Abboud, J. A. (2024) · Springer eBooks · doi:10.1007/978-3-031-70310-2_12 · Cited by 3 · see citing works
Emerging Technological Innovations in Perioperative Nursing
Macieira, T. G. R., Cho, H., Bjarnadóttir, R. I., & Pruinelli, L. (2025) · AORN Journal · doi:10.1002/aorn.70002 · Cited by 3 · see citing works
Avaliação da usabilidade do aplicativo Agente Escuta: uma pesquisa translacional
Amorim, A. A. L., Alvarenga, K. D. F., Jacob-Corteletti, L. C. B., & Araújo, E. S. (2023) · CoDAS · doi:10.1590/2317-1782/20232022149pt · Cited by 3 · see citing works
Nuutinen, M., Hiltunen, A.-M., Leskelä, R., Messo, M., Salminen, A., Lahelma, M., Mello, J. D. A., Declercq, A., Švihnosová, O., Langmaierová, K., et al. (2026) · Journal of Medical Systems · doi:10.1007/s10916-026-02358-5 · Cited by 2 · see citing works
A Decision-Making Model Based on Spiking Neural Network (SNN) for Remote Patient Monitoring
Cohen, S., Levé, F., Trannois, H., Badreddine, W., & Legendre, F. (2023) · International Journal of Machine Learning · doi:10.18178/ijml.2023.13.2.1134 · Cited by 2 · see citing works
Backman, C., Papp, S., Harley, A., Kolle, A. T., Visintini, S. M., Shah, S., Berdusco, R., Poitras, S., Beaulé, P. E., & French-Merkley, V. (2023) · JMIR Research Protocols · doi:10.2196/42056 · Cited by 2 · see citing works
Tamí-Maury, I. M., Tundealao, S. T., Guzman, J., Noé-Díaz, V., Markham, C. M., & Vigil, K. J. (2023) · Digital Health · doi:10.1177/20552076231179029 · Cited by 2 · see citing works
Jeong, J. H. (2025) · Archives of Aesthetic Plastic Surgery · doi:10.14730/aaps.2025.01284 · Cited by 1 · see citing works
Gagnon, J., Chartrand, J., Probst, S., Maillet, É., Reynolds, E., Chaplain, V., St-Jean, H., East, R., & Lalonde, M. (2025) · Canadian Journal of Nursing Research · doi:10.1177/08445621241312394 · Cited by 1 · see citing works
Usability evaluation of the Agente Escuta application: translational research
Amorim, A. A. L., Alvarenga, K. D. F., Jacob-Corteletti, L. C. B., & Araújo, E. S. (2023) · CoDAS · doi:10.1590/2317-1782/20232022149en · Cited by 1 · see citing works
Lorenzen, M. D., Pedersen, C. F., Nielsen, L., Andersen, M. Ø., Clemensen, J., & Carreon, L. Y. (2025) · Digital Health · doi:10.1177/20552076251324687 · Cited by 1 · see citing works
Glatzel, C. M., Dege, T., Glatzel, B., Goebeler, M., Presser, D., & Schmieder, A. (2025) · JMIR mhealth and uhealth · doi:10.2196/69030 · Cited by 1 · see citing works
Bioinformatics in anaesthesia: A new era of personalised and predictive perioperative care
Jahangeerbasha, A., Ekambaram, R., Suchitra, M. R., R., H. K. V., Rani, P., Ravindran, C., & Parthasarathy, S. (2026) · Indian Journal of Clinical Anaesthesia · doi:10.18231/j.ijca.14586.1766463788 · Cited by 1 · see citing works
Patients’ Usability Experience With a Postoperative Follow-Up Web Application
Vera, F., Cofre, M. E., & Pérez, J. I. F. (2026) · Journal of Patient Experience · doi:10.1177/23743735261416365 · Cited by 1 · see citing works
E‐Health Follow‐up: Is it the Way Forward?
Bindal, V., & Pandey, D. (2022) · World Journal of Surgery · doi:10.1007/s00268-022-06793-6
Web Usability Segmentation - Applying K-Means Clustering to the System Usability Scale
Agbozo, E. (2023) · Ural Symposium on Biomedical Engineering, Radioelectronics and Information Technology (USBEREIT) · doi:10.1109/usbereit58508.2023.10158893
Fragelli, T. B. O., de Oliveira, J. A. C., Machado, V. P., Garcia, K. R., Pereira, L. C., Karnikowski, M. G. D. O., & Areda, C. A. (2024) · InfoDesign - Revista Brasileira de Design da Informação · doi:10.51358/id.v21i2.1176
Seerig, K. H., Finze, N., Yang, C., & Gewald, H. (2025) · Lecture notes in information systems and organisation · doi:10.1007/978-3-031-80125-9_33
Acceptability of mobile health technology in elective surgery: A study of postoperative patients
Sinyard, R. D., Anteby, R., Margo, J. N., Molina, G., Kaelberer, Z., Cauley, C. E., Haynes, A. B., Brindle, M. E., & Panda, N. (2025) · Surgery · doi:10.1016/j.surg.2025.109523
Alfikri, Z. F., Johnson, M. E., Dicianno, B. E., Greco, C. M., Parmanto, B., Piva, S. R., Roos, R. E., Saptono, A., Sowa, G., Zhou, L., et al. (2025) · JOR Spine · doi:10.1002/jsp2.70118
Haryanti, P., Pandugaran, S. L., & Aljaberi, M. A. A. (2025) · Malaysian Journal of Medicine and Health Sciences · doi:10.47836/mjmhs.21.s3.9
Krenev, D. A., Gerya, D. A., Kulushеv, V. M., Bagateliya, Z. A., Kreneva, E. L., Grekov, D. N., Lebedev, S. S., Lebedko, M. S., & Maksimkin, A. I. (2026) · Pirogov Russian Journal of Surgery · doi:10.17116/hirurgia20260217
Krishnan, A., Khurana, P., Stankus, A. R., de Leon, S. J. G., Sánchez, J., & Altice, F. L. (2026) · JMIR Formative Research · doi:10.2196/85108
Lee, Y., Son, H. G., & Byun, J. (2026) · JMIR Formative Research · doi:10.2196/87928
Sari, R. S., Dhamayanti, M., Solehati, T., & Mediani, . S. (2026) · Journal of Multidisciplinary Healthcare · doi:10.2147/jmdh.s561368
Freires, R. A., de Aguiar, G. B., Dutra, J. L., Tannus, L. D. O., de Sousa, L. G., Cantão, B. D. C. G., Júnior, F. A. L., & de Lima, A. B. (2026) · Pará Research Medical Journal · doi:10.5327/prmj.969
Goh, H., Khuon, D., Ung, M., Oy, S., Dary, C., Khim, C., Chhay, S. C. A., Lee, Y. L., Kim, R., Yi, S., et al. (2026) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2025-101691
Freires, R. A., de Sousa, L. G., Paulo, T. D. S., de Brito, M. F., Brito, M. V. H., & Sabbá, A. D. C. S. (2026) · Pará Research Medical Journal · doi:10.5327/prmj.991
Lazaridou, A., Kraus, M., Oettl, F. C., Imiolczyk, J.-P., Back, D. A., & Scheibel, M. T. (2026) · Orthopedic Research and Reviews · doi:10.2147/orr.s605861
Wang, Y., Shang, Y., Xu, L., X, J., Aini, C. A. I., & Hong, H. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1803994
Rizk, M. M. F., Ayed, M. M. A., Khalil, D. E., & Abdelalim, M. H. A. E. (2022) · International Journal of Health Sciences · doi:10.53730/ijhs.v6ns10.15972
Alhassani, N. D., Muslihi, A., Alhejaili, A. A., Allehyani, Y., & Alsahli, S. (2026) · Healthcare · doi:10.3390/healthcare14193246
- Authors
- Patel, B., & Thind, A.
- Affiliations
- East Surrey Hospital (GB)
- Venue
- JMIR Perioperative Medicine
- Publisher
- JMIR Publications Inc.
- Published
- 2020-07-20
- Volume
- 3
- Issue
- 2
- Pages
- e19099
- ISSN
- 2561-9128 (ISSN-L)
- PMC
- PMC7709840
- OpenAlex
- W3029874888
- Cited by
- 64
- References
- 62
- Citations by year
- 2026: 12 · 2025: 15 · 2024: 12 · 2023: 10 · 2022: 10 · 2021: 5
- FWCI
- 1.19
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- Locations
- JMIR Perioperative Medicine (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Health Sciences › Health Professions › Health Information Management › Health, Technology, Consumer Behavior
- Keywords
- mobile health apps, usability, postoperative care, System Usability Scale, user satisfaction, conflicts of interest, risk of bias, postoperative rehabilitation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-06.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-06.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review