Cited by 241Electronic Health Records SystemsArtificial Intelligence in Healthcare and EducationTechnology and Human Factors in Education and Health

Deploying digital health tools within large, complex health systems: key considerations for adoption and implementation

Open access
Marwaha, Jayson S., Landman, Adam B., Brat, Gabriel A., Dunn, Todd, Gordon, William J.·2022·npj Digital Medicine

Abstract

In recent years, the number of digital health tools with the potential to significantly improve delivery of healthcare services has grown tremendously. However, the use of these tools in large, complex health systems remains comparatively limited. The adoption and implementation of digital health tools at an enterprise level is a challenge; few strategies exist to help tools cross the chasm from clinical validation to integration within the workflows of a large health system. Many previously proposed frameworks for digital health implementation are difficult to operationalize in these dynamic organizations. In this piece, we put forth nine dimensions along which clinically validated digital health tools should be examined by health systems prior to adoption, and propose strategies for selecting digital health tools and planning for implementation in this setting. By evaluating prospective tools along these dimensions, health systems can evaluate which existing digital health solutions are worthy of adoption, ensure they have sufficient resources for deployment and long-term use, and devise a strategic plan for implementation.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41746-022-00557-1

Cites

27 of 28 references verified1 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Health systems commonly require eHealth software to be approved through a governance board process before deployment into patient care settings.

    “Health systems commonly require eHealth software to be approved through a governance board process before deployment into patient care settings [65].”

    From Patient Engagement with Conversational Agents in Health Applications 2016–2022: A Systematic Review and Meta-Analysis (2024) · cites this paper as [65]

    The sections “Are there executive sponsors?” and “What data assets are required for product functionality?” discuss executive oversight and data-governance agreements, respectively, but neither describes a governance board approving software before patient-care deployment. Searches for governance boards, approval committees, and pre-deployment approval found no passage establishing that this is a common health-system requirement. Page numbers were not available in our copy. (LLM, conf=0.73)

    Experimental — accuracy not yet measured
  • Directly increasing patient and caregiver awareness of risk factors for depression can help promote proactive pursuit of treatment or incentivize visits to the clinic.

    “Directly increasing patient and caregiver awareness of risk factors for depression can help promote proactive pursuit of treatment or incentivize visits to the clinic.78”

    From Digital health technologies and major depressive disorder (2023) · cites this paper as [78]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 1

  1. [37]NEJM Catalyst. How to Avoid Common Pitfalls of Health IT Implementation. https://catalyst.nejm.org/doi/full/10.1056/CAT.20.0048 (2020). · DOI

Cited by

Sorted by citations

Authors
Marwaha, J. S., Landman, A. B., Brat, G. A., Dunn, T., & Gordon, W. J.
Affiliations
  • Beth Israel Deaconess Medical Center (US)
  • Brigham and Women's Hospital (US)
Corresponding author
Marwaha, Jayson S.
Venue
npj Digital Medicine
Published
2022-01-27
Volume
5
Issue
1
Pages
13-13
ISSN
2398-6352 (ISSN-L)
OpenAlex
W4210337422
Cited by
241
References
27
Citations by year
2026: 43 · 2025: 63 · 2024: 59 · 2023: 42 · 2022: 34
FWCI
7.32
Type
journal article
Language
en
Open access
Locations
  • npj Digital Medicine (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • Harvard University (Biomedical Informatics and Data Science Research Training (BIRT) Program)
  • U.S. Department of Health & Human Services | NIH | U.S. National Library of Medicine (T15LM007092)
Topics
  • Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Technology and Human Factors in Education and Health
Keywords
digital health tools, implementation planning, enterprise adoption, clinical validation, workflow integration, implementation strategies

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review