CoChat

Adapting and Validating Tools to Assess the Usability and Acceptability of mHealth Tools Among Community Health Workers in Rural Settings: Development and Usability Study

Open access

Published version of a preprint

The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index; 8 of the 19 sources its claims cite were checked for support.

Abstract

BACKGROUND: Mobile health (mHealth) apps are increasingly leveraged to support community health workers (CHWs) in delivering high-quality care, particularly in low- and middle-income countries. However, despite the proliferation of mHealth tools, few have been implemented at scale, partly due to limited attention to usability and acceptability among end users. In sub-Saharan Africa, mHealth tools designed for CHWs often lack systematic evaluation using validated instruments tailored to local contexts. Without such assessments, it is difficult to ensure that these tools can be integrated effectively into CHW workflows and scaled sustainably. OBJECTIVE: This study aimed to adapt and validate existing mHealth usability and acceptability assessment tools to be contextually appropriate for CHWs in Rwanda. Specifically, we sought to ensure contextual appropriateness for CHWs supporting postoperative home follow-up for women after cesarean delivery. The resulting tool was designed for use in an implementation study of a novel CHW-led mHealth app. METHODS: This study was conducted in the Kirehe district, Rwanda, from October 2022 to March 2023. We adapted 2 established tools-the mHealth App Usability Questionnaire and selected items from the Practitioner Opinion (Acceptability) Scale-and added new items that reflect core functions of the CHW-focused mHealth app. All items were translated into Kinyarwanda and simplified to align with CHWs' educational levels. We conducted a three-stage validation that consisted of (1) content validity testing with 8 local and international experts using a recommended content validity index threshold of >0.78; (2) face validity testing with 10 CHWs using a recommended face validity index threshold of ≥0.60; and (3) reliability testing using responses from 30 CHWs, with a Cronbach α coefficient of ≥0.70 indicating acceptable internal consistency. RESULTS: Of the 25 items assessed, 22 (88%) achieved a content validity index score of >0.78 for both clarity and relevance. The face validity index across all 22 items was 0.991, indicating strong comprehensibility and relevance to CHWs. Internal consistency was high: the Cronbach α was 0.86 for the mHealth App Usability Questionnaire items, 0.73 for the Practitioner Opinion (Acceptability) Scale items, and 0.87 for the newly developed questions. The final tool-named the Community Health Worker mHealth Usability and Acceptability Assessment Tool-included 22 items with strong content validity, face validity, and internal reliability. CONCLUSIONS: This study presents a rigorously adapted and validated tool for assessing mHealth usability and acceptability among CHWs in Rwanda. The Community Health Worker mHealth Usability and Acceptability Assessment Tool can guide future evaluations of mHealth interventions in similar contexts and serve as a model for localizing mHealth assessment tools in low- and middle-income country settings to ensure fit-for-purpose implementation.

Overview

CoChat Summary

## TL;DR

The paper adapted and validated a quantitative tool, the Community Health Worker mHealth Usability and Acceptability Assessment Tool (CHW-MUAAT), to assess a CHW mHealth app in rural Rwanda. The final 22-item tool showed strong content validity, face validity, and internal consistency.

## Key findings

  • The adapted instrument started with 25 items: 14 from the mHealth App Usability Questionnaire (MAUQ), 4 from the Practitioner Opinion (Acceptability) Scale (POAS), and 7 new items added by the study team.
  • In content validity testing, 22 of 25 items (88%) achieved an item CVI of >0.78 for both clarity and relevance; 3 items were removed.
  • Face validity was very high: the face validity index across all 22 retained items was 0.991.
  • Internal consistency was acceptable to high: Cronbach α was 0.86 for the MAUQ usability items, 0.73 for the POAS acceptability items, and 0.87 for the new questions.

## Methods

  • Design: Tool adaptation and validation study conducted from October 2022 to March 2023 in Kirehe district, rural Rwanda, as part of a larger CHW mHealth post-cesarean follow-up project.
  • Sample/data: 8 experts for content validity, 10 CHWs for face validity, and 30 CHWs for reliability testing.
  • Main analysis: Cross-cultural adaptation into Kinyarwanda, then three-stage validation using content validity index (threshold >0.78), face validity index (threshold ≥0.60), and Cronbach α (acceptable ≥0.70).

## Limitations

  • The paper states that the study had a small sample size of content experts and CHWs.
  • The paper states the tool is a quantitative assessment and cannot capture nuanced responses.
  • The paper states the tool was designed for a specific intervention and validated only in Kinyarwanda; this limits transferability to other interventions or languages.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.2196/64916

Cites

28 of 28 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

4 Valid · 2 Not valid · 7 Not checked · 19 Own results and interpretations

12 more claims

Create a free account to see all 32 claims and to verify the 2 references still open.

See all claims — free account
  • Probably not a substantial claim. 7
  • It may state two separate claims as one. 11

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 28 references

Research works printed but not linked: 1

  1. Allen, P, 2014, SPSS Statistics Version 22: A Practical Guide

Cited by

Metadata

Authors
Nkurunziza, J., Nuss, S., Estrada, E. H., Kubwimana, M., Boatin, A. A., Bikorimana, L., Fletcher, R. R., Byiringiro, N., Hedt-Gauthier, B., & Cubaka, V. K.
Affiliations
  • Harvard University (US)
  • Massachusetts Institute of Technology (US)
  • University of Global Health Equity (RW)
Corresponding author
Nkurunziza, Jonathan
Venue
JMIR mHealth and uHealth
Published
2026-02-20
Volume
14
Pages
e64916
ISSN
2291-5222 (ISSN-L)
OpenAlex
W7130715907
Cited by
2
References
28
Citations by year
2026: 2
FWCI
16.70
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR mhealth and uhealth (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • PubMed Central (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • National Institutes of Health
  • National Institute of Mental Health (TW010543)
  • Fogarty International Center (TW010543, D43TW010543)
  • Eunice Kennedy Shriver National Institute of Child Health and Human Development (R21HD103052)
Topics
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
  • Physical Sciences › Computer Science › Information Systems › ICT in Developing Communities
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
Keywords
mobile health, community health workers, usability evaluation, cesarean section, rural health care, Rwanda, low- and middle-income countries, content validity
MeSH terms
Digital Health, Adult, Community Health Workers, Female, Humans, Male, Psychometrics, Surveys and Questionnaires, Rural Population, Rwanda, Reproducibility of Results, Telemedicine, Mobile Applications

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.