Cited by 4Mobile Health and mHealth ApplicationsElectronic Health Records SystemsDigital Mental Health Interventions

Buy or build: challenges developing consumer digital health interventions

Open access
Saver, Barry G., Marquard, Jenna L., Gummeson, Jeremy, Stekler, Joanne, Scanlon, James M.·2023·Applied Clinical Informatics

Abstract

BACKGROUND: Digital health interventions offer opportunities to improve collaborative care between clinicians and patients. Designing and implementing digital health interventions requires decisions about buying or building each technology-related component, all of which can lead to unanticipated issues. OBJECTIVES: This study aimed to describe issues encountered from our "buy or build" decisions developing two digital health interventions over different timeframes, designed to use patient-generated health data to: (1) improve hypertension control and (2) measure and improve adherence to HIV-related medications. METHODS: CONDUIT-HID (CONtrolling Disease Using Information Technology-Hypertension In Diabetes) was developed during 2010 to 2015 to allow patients receiving care from a multispecialty group practice to easily upload home blood pressure readings into their electronic health record and trigger clinician action if mean blood pressure values indicated inadequate control. USE-MI (Unobtrusive SEnsing of Medication Intake) was developed from 2016 to 2022 to allow entry of patients' HIV-related medication regimens, send reminders if patients had not taken their medications by the scheduled time(s), attempt to detect medication ingestion through machine learning analysis of smartwatch motion data, and present graphical adherence summaries to patients and clinicians. RESULTS: Both projects required multiple "buy or build" decisions across all system components, including data collection, transfer, analysis, and display. We used commercial, off-the-shelf technology where possible, but virtually all of these components still required substantial custom development. We found that, even though our projects spanned years, issues related to our "buy or build" decisions stemmed from several common themes, including mismatches between existing and new technologies, our use case being new or unanticipated, technology stability, technology longevity, and resource limitations. CONCLUSION: Those designing and implementing digital health interventions need to make numerous "buy or build" decisions as they create the technologies that underpin their intervention. These "buy or build" decisions, and the ensuing issues that will arise because of them, require careful planning, particularly if they represent an "edge case" use of existing commercial systems.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1055/a-2148-8036

Cites

15 of 15 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Automated oscillometric blood pressure cuffs faced the highest absolute operational friction, combining significant workflow routine disruptions with digital literacy gaps.

    “Automated oscillometric blood pressure cuffs faced the highest absolute operational friction, combining significant workflow routine disruptions with digital literacy gaps [6].”

    From Clinical Efficacy and Patient Adherence Hurdles of Remote Patient Monitoring (RPM) Frameworks in Managing Hypertension and Type 2 Diabetes: A Scoping Review (2026) · cites this paper as [6]

    The Structured Analysis of Our “Buy or Build” Decisions (Table 1; page not specified) describes operational difficulties with the home BP cuff system, including clinic staff taking over data uploads and technical fixes when connections broke. It does not rank cuffs as having the highest absolute friction or identify digital literacy gaps as a cause of those difficulties. (LLM, conf=0.85)

    Experimental — accuracy not yet measured
  • Contemporary deployment failures of RPM are increasingly attributed to operational and human factors.

    “contemporary deployment failures are increasingly attributed to operational and human factors [5,6].”

    From Clinical Efficacy and Patient Adherence Hurdles of Remote Patient Monitoring (RPM) Frameworks in Managing Hypertension and Type 2 Diabetes: A Scoping Review (2026) · cites this paper as [6]

    The Discussion describes deployment barriers involving clinician workflow and EHR integration, while the structured analysis describes staff workload and vendor disruptions. These support operational challenges, but the paper does not establish that RPM deployment failures are increasingly attributed to operational and human factors; its focus is on technology and integration problems. (LLM, conf=0.78)

    Experimental — accuracy not yet measured
  • Large-scale implementation of RPM across healthcare delivery organizations remains fragmented and frequently plagued by high attrition rates.

    “large-scale implementation across healthcare delivery organizations remains fragmented and frequently plagued by high attrition rates [5,6].”

    From Clinical Efficacy and Patient Adherence Hurdles of Remote Patient Monitoring (RPM) Frameworks in Managing Hypertension and Type 2 Diabetes: A Scoping Review (2026) · cites this paper as [6]

    The Discussion reports that few patient-generated health data interventions successfully integrated with electronic health records, supporting the claim of implementation barriers. It does not establish that large-scale RPM implementation is fragmented across healthcare organizations or report high attrition rates. (LLM, conf=0.84)

    Experimental — accuracy not yet measured
  • The introduction of an RPM pathway introduces structural shifts in routine clinical data workflows, creating significant friction points for both patients and healthcare providers.

    “The introduction of an RPM pathway introduces structural shifts in routine clinical data workflows, creating significant friction points for both patients and healthcare providers [6].”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 1

  1. [2]Integrating Patient-Generated Digital Health Data into Electronic Health Records in Ambulatory Care Settings: An Environmental Scan. 2021. AHRQ Publication No. 21-0031. Accessed January 25, 2023 at: https://digital.ahrq.gov/sites/default/files/docs/citation/pghd-environmental-scan.pdf 42691194

Cited by

Sorted by citations

Authors
Saver, B. G., Marquard, J. L., Gummeson, J., Stekler, J., & Scanlon, J. M.
Affiliations
  • Swedish Family Medicine Residency - Cherry Hill (US)
  • University of Minnesota (US)
  • University of Massachusetts Amherst (US)
  • University of Washington (US)
  • Swedish Medical Center (US)
Corresponding author
Saver, Barry G.
Venue
Applied Clinical Informatics
Published
2023-08
Volume
14
Issue
04
Pages
803-810
ISSN
1869-0327 (ISSN-L)
OpenAlex
W4385566838
Cited by
4
References
15
Citations by year
2026: 2 · 2025: 2
FWCI
1.42
Type
journal article
Language
en
Open access
Locations
  • Applied Clinical Informatics (publishedVersion, cc-by-nc-nd)
  • PubMed Central (publishedVersion, cc-by-nc-nd)
  • PubMed (publishedVersion)
Funders
  • Agency for Healthcare Research and Quality (R18 HS018461)
  • The National Institute of Mental Health (R01 MH109319)
Topics
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
  • Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
Keywords
digital health interventions, patient-generated health data, hypertension control, HIV treatment adherence, home blood pressure monitoring, electronic health records, machine learning, off-the-shelf technology
MeSH terms
Digital Health, Diabetes Mellitus, Humans, Hypertension, HIV Infections, Electronic Health Records

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review