Cited by 53Mobile Health and mHealth ApplicationsTelemedicine and Telehealth ImplementationDigital Mental Health Interventions

Conducting Internet-Based Visits for Onboarding Populations With Limited Digital Literacy to an mHealth Intervention: Development of a Patient-Centered Approach

Open access
Hernandez-Ramos, Rosa, Aguilera, Adrian, Garcia, Faviola, Miramontes-Gomez, Jose, Pathak, Laura Elizabeth, Figueroa, Caroline Astrid, Lyles, Courtney Rees·2021·JMIR Formative Research

Published version of a preprint

Abstract

BACKGROUND: The COVID-19 pandemic has propelled patient-facing research to shift to digital and telehealth strategies. If these strategies are not adapted for minority patients of lower socioeconomic status, health inequality will further increase. Patient-centered models of care can successfully improve access and experience for minority patients. OBJECTIVE: This study aims to present the development process and preliminary acceptability of altering in-person onboarding procedures into internet-based, remote procedures for a mobile health (mHealth) intervention in a population with limited digital literacy. METHODS: We actively recruited safety-net patients (English- and Spanish-speaking adults with diabetes and depression who were receiving care at a public health care delivery system in San Francisco, United States) into a randomized controlled trial of text messaging support for physical activity. Because of the COVID-19 pandemic, we modified the in-person recruitment and onboarding procedures to internet-based, remote processes with human support. We conducted a preliminary evaluation of how the composition of the recruited cohort might have changed from the pre-COVID-19 period to the COVID-19 enrollment period. First, we analyzed the digital profiles of patients (n=32) who had participated in previous in-person onboarding sessions prior to the COVID-19 pandemic. Next, we documented all changes made to our onboarding processes to account for remote recruitment, especially those needed to support patients who were not very familiar with downloading apps onto their mobile phones on their own. Finally, we used the new study procedures to recruit patients (n=11) during the COVID-19 social distancing period. These patients were also asked about their experience enrolling into a fully digitized mHealth intervention. RESULTS: Recruitment across both pre-COVID-19 and COVID-19 periods (N=43) demonstrated relatively high rates of smartphone ownership but lower self-reported digital literacy, with 32.6% (14/43) of all patients reporting they needed help with using their smartphone and installing apps. Significant changes were made to the onboarding procedures, including facilitating app download via Zoom video call and/or a standard phone call and implementing brief, one-on-one staff-patient interactions to provide technical assistance personalized to each patient's digital literacy skills. Comparing recruitment during pre-COVID-19 and COVID-19 periods, the proportion of patients with digital literacy barriers reduced from 34.4% (11/32) in the pre-COVID-19 cohort to 27.3% (3/11) in the COVID-19 cohort. Differences in digital literacy scores between both cohorts were not significant (P=.49). CONCLUSIONS: Patients of lower socioeconomic status have high interest in using digital platforms to manage their health, but they may require additional upfront human support to gain access. One-on-one staff-patient partnerships allowed us to provide unique technical assistance personalized to each patient's digital literacy skills, with simple strategies to troubleshoot patient barriers upfront. These additional remote onboarding strategies can mitigate but not eliminate digital barriers for patients without extensive technology experience. TRIAL REGISTRATION: Clinicaltrials.gov NCT0349025, https://clinicaltrials.gov/ct2/show/NCT03490253.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/25299

Cites

36 of 36 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Similar onboarding procedures in app-based interventions for people of color seem to be effective as users can ask questions about the program and request assistance with technology.

    “Similar procedures in app-based interventions for POC seem to be effective as users can ask questions about the program and request assistance with technology [53].”

    From App-Based Mindfulness Meditation for People of Color Who Experience Race-Related Stress: Protocol for a Randomized Controlled Trial (2022) · cites this paper as [53]

    The Results (Changes to Study Procedures; Patient Experience, page unavailable) describe one-on-one technical assistance for a racially and ethnically diverse cohort, and all 11 remote-onboarding participants said they enjoyed the visits. The paper does not specifically report that users asked questions about the program or identify that as a reason the procedures worked. (LLM, conf=0.81)

    Experimental — accuracy not yet measured
  • Remote assessment strategies have been shown to be effective in app-based intervention research with low-income people of color.

    “These remote assessment strategies have shown to be effective in app-based intervention research with low-income POC [53].”

    From App-Based Mindfulness Meditation for People of Color Who Experience Race-Related Stress: Protocol for a Randomized Controlled Trial (2022) · cites this paper as [53]

    The Methods (Overview of the mHealth Intervention) describe moving online baseline assessments and app onboarding to remote procedures. The Results (Digital Profiles) report enrolling racially or ethnically diverse participants with lower socioeconomic status, and the Discussion (Principal Findings) reports successful remote enrollment and app downloads. However, the study evaluated a small, supported onboarding process, not the effectiveness of remote assessment strategies generally; its Limitations section says the remote approaches were not statistically compared. (LLM, conf=0.84)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Hernandez-Ramos, R., Aguilera, A., Garcia, F., Miramontes-Gomez, J., Pathak, L. E., Figueroa, C. A., & Lyles, C. R.
Affiliations
  • University of California, Berkeley (US)
  • University of California, San Francisco (US)
  • San Francisco General Hospital (US)
Corresponding author
Lyles, Courtney Rees
Venue
JMIR Formative Research
Published
2021-04-29
Volume
5
Issue
4
Pages
e25299
ISSN
2561-326X (ISSN-L)
OpenAlex
W3154933051
Cited by
53
References
35
Citations by year
2026: 10 · 2025: 8 · 2024: 10 · 2023: 8 · 2022: 11 · 2021: 5 · 2020: 1
FWCI
9.55
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR Formative Research (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • eScholarship (California Digital Library) (submittedVersion)
Funders
Agency for Healthcare Research and Quality (R01 HS025429)
Topics
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
Keywords
literacy, mobile health intervention, remote onboarding, online recruitment, COVID-19 pandemic, diabetes mellitus, depression, text messaging, physical activity, patient-centered care, health equity, minority patients, low socioeconomic status, technical assistance, smartphone ownership, telemedicine, recruitment barriers, Spanish-speaking patients, health disparities, digital divide

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review