The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index; 8 of the 19 sources its claims cite were checked for support.
Adapting and Validating Tools to Assess the Usability and Acceptability of mHealth Tools Among Community Health Workers in Rural Settings: Development and Usability Study
Open accessPublished version of a preprint
Abstract
BACKGROUND: Mobile health (mHealth) apps are increasingly leveraged to support community health workers (CHWs) in delivering high-quality care, particularly in low- and middle-income countries. However, despite the proliferation of mHealth tools, few have been implemented at scale, partly due to limited attention to usability and acceptability among end users. In sub-Saharan Africa, mHealth tools designed for CHWs often lack systematic evaluation using validated instruments tailored to local contexts. Without such assessments, it is difficult to ensure that these tools can be integrated effectively into CHW workflows and scaled sustainably. OBJECTIVE: This study aimed to adapt and validate existing mHealth usability and acceptability assessment tools to be contextually appropriate for CHWs in Rwanda. Specifically, we sought to ensure contextual appropriateness for CHWs supporting postoperative home follow-up for women after cesarean delivery. The resulting tool was designed for use in an implementation study of a novel CHW-led mHealth app. METHODS: This study was conducted in the Kirehe district, Rwanda, from October 2022 to March 2023. We adapted 2 established tools-the mHealth App Usability Questionnaire and selected items from the Practitioner Opinion (Acceptability) Scale-and added new items that reflect core functions of the CHW-focused mHealth app. All items were translated into Kinyarwanda and simplified to align with CHWs' educational levels. We conducted a three-stage validation that consisted of (1) content validity testing with 8 local and international experts using a recommended content validity index threshold of >0.78; (2) face validity testing with 10 CHWs using a recommended face validity index threshold of ≥0.60; and (3) reliability testing using responses from 30 CHWs, with a Cronbach α coefficient of ≥0.70 indicating acceptable internal consistency. RESULTS: Of the 25 items assessed, 22 (88%) achieved a content validity index score of >0.78 for both clarity and relevance. The face validity index across all 22 items was 0.991, indicating strong comprehensibility and relevance to CHWs. Internal consistency was high: the Cronbach α was 0.86 for the mHealth App Usability Questionnaire items, 0.73 for the Practitioner Opinion (Acceptability) Scale items, and 0.87 for the newly developed questions. The final tool-named the Community Health Worker mHealth Usability and Acceptability Assessment Tool-included 22 items with strong content validity, face validity, and internal reliability. CONCLUSIONS: This study presents a rigorously adapted and validated tool for assessing mHealth usability and acceptability among CHWs in Rwanda. The Community Health Worker mHealth Usability and Acceptability Assessment Tool can guide future evaluations of mHealth interventions in similar contexts and serve as a model for localizing mHealth assessment tools in low- and middle-income country settings to ensure fit-for-purpose implementation.
Overview
CoChat Summary
## TL;DR
The paper adapted and validated a quantitative tool, the Community Health Worker mHealth Usability and Acceptability Assessment Tool (CHW-MUAAT), to assess a CHW mHealth app in rural Rwanda. The final 22-item tool showed strong content validity, face validity, and internal consistency.
## Key findings
- The adapted instrument started with 25 items: 14 from the mHealth App Usability Questionnaire (MAUQ), 4 from the Practitioner Opinion (Acceptability) Scale (POAS), and 7 new items added by the study team.
- In content validity testing, 22 of 25 items (88%) achieved an item CVI of >0.78 for both clarity and relevance; 3 items were removed.
- Face validity was very high: the face validity index across all 22 retained items was 0.991.
- Internal consistency was acceptable to high: Cronbach α was 0.86 for the MAUQ usability items, 0.73 for the POAS acceptability items, and 0.87 for the new questions.
## Methods
- Design: Tool adaptation and validation study conducted from October 2022 to March 2023 in Kirehe district, rural Rwanda, as part of a larger CHW mHealth post-cesarean follow-up project.
- Sample/data: 8 experts for content validity, 10 CHWs for face validity, and 30 CHWs for reliability testing.
- Main analysis: Cross-cultural adaptation into Kinyarwanda, then three-stage validation using content validity index (threshold >0.78), face validity index (threshold ≥0.60), and Cronbach α (acceptable ≥0.70).
## Limitations
- The paper states that the study had a small sample size of content experts and CHWs.
- The paper states the tool is a quantitative assessment and cannot capture nuanced responses.
- The paper states the tool was designed for a specific intervention and validated only in Kinyarwanda; this limits transferability to other interventions or languages.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
4 Valid · 2 Not valid · 7 Not checked · 19 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“While there is an increasing number of mHealth apps designed to support CHWs across SSA, very few are operating at a large scale and beyond isolated research settings [2,23,24].”
§ Adapting and Validating Tools to Assess the Usability and Acceptability of mHealth Tools Among Community Health Workers in Rural Settings: Development and Usability Study > Discussion > Principal Results
What the sources say
- Not checked — no full text of the sourcecites [2] source
- Partly supportedcites [23] sourceExperimental — accuracy not yet measured
The Introduction says that the great majority of digital health innovations in low- and middle-income countries have remained small-scale, stand-alone projects. It does not establish that this is specifically true of apps supporting community health workers across sub-Saharan Africa; the Uganda case study describes a mobile reporting system used by facility health workers. No page numbers are supplied in our copy. (LLM, conf=0.84)
- Partly supportedcites [24] sourceExperimental — accuracy not yet measured
O'Donnell's commentary (p.1, main text) does state the general point behind the claim — 'beyond the initial positive trial results, there are few instances where these types of digital health innovations have led to long-term impacts in global health systems', with 'limited interoperability and scalability of digital technology' among the common barriers, and the whole piece is framed around curing 'pilotitis' in low- and middle-income countries (Kenya as the illustrative setting). However, what it does not support are the claim's specific qualifiers: our copy never mentions community health workers or apps designed to support CHWs, and it speaks of LMICs globally rather than of sub-Saharan Africa specifically (SSA appears only in a cited Pew reference title and in Ferreira-Borges et al. on alcohol control policy). So the source backs 'few mHealth interventions in LMICs scale beyond pilot/research settings', not the CHW-and-SSA-scoped version. (LLM, conf=0.72)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“This quantitative CHW-MUAAT scale provides a standardized, scalable way to summarize usability and acceptability constructs, which facilitates comparison of potential digital tools in one environment or of the functionality of a single tool in different contexts [26].”
§ Adapting and Validating Tools to Assess the Usability and Acceptability of mHealth Tools Among Community Health Workers in Rural Settings: Development and Usability Study > Discussion > Principal Results
What the sources say
- Could not verifycites [26] sourceExperimental — accuracy not yet measured
Split into 2 atoms — 0 confirmed, 0 partially supported, 0 disputed, 0 misattributed, 2 unverifiable. Expand the claim to see per-atom verdicts.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Could not verify
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The final tool—named the Community Health Worker mHealth Usability and Acceptability Assessment Tool—included 22 items with strong content validity, face validity, and internal reliability.”
- Also stated in: § Principal Results · plain
“Our final tool included 22 items in total: 12 (55%) out of the 15 original items from the MAUQ tool, all 4 (18%) of the items that we pulled from the POAS, and 6 (27%) new items added by our study team.”
§ Adapting and Validating Tools to Assess the Usability and Acceptability of mHealth Tools Among Community Health Workers in Rural Settings: Development and Usability Study > Abstract > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Principal Results · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The first adapted tool included 14 questions from the MAUQ, 4 POAS questions, and 7 questions added by the study team, yielding a total of 25 questions.”
§ Adapting and Validating Tools to Assess the Usability and Acceptability of mHealth Tools Among Community Health Workers in Rural Settings: Development and Usability Study > Results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The FVI score for clarity across all questions was 0.991 and was the same for relevance.”
§ Adapting and Validating Tools to Assess the Usability and Acceptability of mHealth Tools Among Community Health Workers in Rural Settings: Development and Usability Study > Results
plainn = 22- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
12 more claims
Create a free account to see all 32 claims and to verify the 2 references still open.
- Probably not a substantial claim. 7
- It may state two separate claims as one. 11
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Adapting and Validating Tools to Assess the Usability and Acceptability of mHealth Tools Among Community Health Workers in Rural Settings: Development and Usability Study > Methods > Validity and Reliability Testing
“Eight content experts, including app developers, study team members, and clinicians, were conveniently asked to rate the relevancy and clarity of items from the CHW-MUAAT”
§ Adapting and Validating Tools to Assess the Usability and Acceptability of mHealth Tools Among Community Health Workers in Rural Settings: Development and Usability Study > Results
“A total of 10 content experts participated in the content validity survey.”
Citations
Cites
Guidelines for the process of cross-cultural adaptation of self-report measures
Beaton, D. E., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2000) · Spine · doi:10.1097/00007632-200012150-00014 · Cited by 14,542 · cited 1×
“…its comprehensibility with a reading level equivalent to sixth grade, the CHW mHealth usability and acceptability assessment tool underwent a cross-cultural adaptation process, which consisted of translation into Kinyarwanda, back translation, and harmonization, as described by Beaton et al [17].”
The Technology Acceptance Model: Its past and its future in health care
Holden, R. J., & Karsh, B.-T. (2010) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2009.07.002 · Cited by 2,669
Zamanzadeh, V., Ghahramanian, A., Rassouli, M., Abbaszadeh, A., Alavi-Majd, H., & Nikanfar, A.-R. (2015) · Journal of Caring Sciences · doi:10.15171/jcs.2015.017 · Cited by 1,540
The mHealth App Usability Questionnaire (MAUQ): Development and Validation Study
Zhou, L., Bao, J., Setiawan, I. M. A., Saptono, A., & Parmanto, B. (2019) · JMIR mHealth and uHealth · doi:10.2196/11500 · Cited by 675 · cited 2×
“Tools that assess usability among clinical providers are the Telehealth Usability Tool [10] and the mHealth App Usability Questionnaire (MAUQ) [11].”
Development of the Telehealth Usability Questionnaire (TUQ)
Parmanto, B., Lewis, Jr., Graham, K. M., & Bertolet, M. H. (2016) · International Journal of Telerehabilitation · doi:10.5195/ijt.2016.6196 · Cited by 624 · cited 1×
“Tools that assess usability among clinical providers are the Telehealth Usability Tool [10] and the mHealth App Usability Questionnaire (MAUQ) [11].”
[Content validity index in scale development].
(2012) · PubMed · doi:10.3969/j.issn.1672-7347.2012.02.007 · Cited by 559
Community Health Workers and Mobile Technology: A Systematic Review of the Literature
Braun, R., Catalani, C., Wimbush, J., & Israelski, D. (2013) · PLoS ONE · doi:10.1371/journal.pone.0065772 · Cited by 493
Readability of Patient Education Materials on the American Association for Surgery of Trauma Website
Eltorai, A., Ghanian, S., Adams, C., Born, C., & Daniels, A. (2014) · Archives of Trauma Research · doi:10.5812/atr.18161 · Cited by 265
Schnall, R., Cho, H., & Liu, J. (2018) · JMIR mHealth and uHealth · doi:10.2196/mhealth.8851 · Cited by 239
Beyond pilotitis: taking digital health interventions to the national level in China and Uganda
Huang, F., Blaschke, S., & Lucas, H. (2017) · Globalization and Health · doi:10.1186/s12992-017-0275-z · Cited by 182
Research works printed but not linked: 1
- Allen, P, 2014, SPSS Statistics Version 22: A Practical Guide
Cited by
Sugira, D., Nkurikiyeyezu, K. N., Marara, A. A., Mugisha, E., Twizere, C., & Tumusiime, D. K. (2026) · Research Square · doi:10.21203/rs.3.rs-10831662/v1
Galarza, A. B., Gamarra-Moreno, A., Bautista, W. E. Q., & Guillén, J. A. R. (2026) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph23091182
Metadata
- Authors
- Nkurunziza, J., Nuss, S., Estrada, E. H., Kubwimana, M., Boatin, A. A., Bikorimana, L., Fletcher, R. R., Byiringiro, N., Hedt-Gauthier, B., & Cubaka, V. K.
- Affiliations
- Harvard University (US)
- Massachusetts Institute of Technology (US)
- University of Global Health Equity (RW)
- Corresponding author
- Nkurunziza, Jonathan
- ORCID
- Venue
- JMIR mHealth and uHealth
- Publisher
- JMIR Publications Inc.
- Published
- 2026-02-20
- Volume
- 14
- Pages
- e64916
- ISSN
- 2291-5222 (ISSN-L)
- PMC
- PMC12966820
- OpenAlex
- W7130715907
- Semantic Scholar
- a835f61b7fe03fce185402fc14efeb41ca16a531
- Cited by
- 2
- References
- 28
- Citations by year
- 2026: 2
- FWCI
- 16.70
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR mhealth and uhealth (publishedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Institutes of Health
- National Institute of Mental Health (TW010543)
- Fogarty International Center (TW010543, D43TW010543)
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (R21HD103052)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Physical Sciences › Computer Science › Information Systems › ICT in Developing Communities
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- mobile health, community health workers, usability evaluation, cesarean section, rural health care, Rwanda, low- and middle-income countries, content validity
- MeSH terms
- Digital Health, Adult, Community Health Workers, Female, Humans, Male, Psychometrics, Surveys and Questionnaires, Rural Population, Rwanda, Reproducibility of Results, Telemedicine, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.