The DOI matches its Crossref record; 27 of the 28 references it cites were found in a registry or an index.
Deploying digital health tools within large, complex health systems: key considerations for adoption and implementation
Open accessAbstract
In recent years, the number of digital health tools with the potential to significantly improve delivery of healthcare services has grown tremendously. However, the use of these tools in large, complex health systems remains comparatively limited. The adoption and implementation of digital health tools at an enterprise level is a challenge; few strategies exist to help tools cross the chasm from clinical validation to integration within the workflows of a large health system. Many previously proposed frameworks for digital health implementation are difficult to operationalize in these dynamic organizations. In this piece, we put forth nine dimensions along which clinically validated digital health tools should be examined by health systems prior to adoption, and propose strategies for selecting digital health tools and planning for implementation in this setting. By evaluating prospective tools along these dimensions, health systems can evaluate which existing digital health solutions are worthy of adoption, ensure they have sufficient resources for deployment and long-term use, and devise a strategic plan for implementation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Health systems commonly require eHealth software to be approved through a governance board process before deployment into patient care settings [65].”
From Patient Engagement with Conversational Agents in Health Applications 2016–2022: A Systematic Review and Meta-Analysis (2024) · cites this paper as [65]
Experimental — accuracy not yet measuredIn the citing paper
“Directly increasing patient and caregiver awareness of risk factors for depression can help promote proactive pursuit of treatment or incentivize visits to the clinic.78”
From Digital health technologies and major depressive disorder (2023) · cites this paper as [78]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
From Triple to Quadruple Aim: Care of the Patient Requires Care of the Provider
Bodenheimer, T., & Sinsky, C. (2014) · The Annals of Family Medicine · doi:10.1370/afm.1713 · Cited by 3,462
Cresswell, K., & Sheikh, A. (2013) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2012.10.007 · Cited by 690 · cited 1×
“Many frameworks exist for clinical validation of these tools 3,9 – 11 , but few strategies describe how to integrate these validated tools in health systems; the literature on digital health implementation within large organizations is limited 12 – 14 .”
BackgroundDigital health: a path to validation
Mathews, S. C., McShea, M. J., Hanley, C. L., Ravitz, A., Labrique, A. B., & Cohen, A. B. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0111-3 · Cited by 508
Reeves, J. J., Hollandsworth, H. M., Torriani, F. J., Taplitz, R., Abeles, S., Tai-Seale, M., Millen, M., Clay, B. J., & Longhurst, C. A. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa037 · Cited by 429
Cresswell, K. M., Bates, D. W., & Sheikh, A. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-001684 · Cited by 366
Randomized controlled trial of a 12-week digital care program in improving low back pain
Shebib, R., Bailey, J. F., Smittenaar, P., Perez, D. A., Mecklenburg, G., & Hunter, S. (2019) · npj Digital Medicine · doi:10.1038/s41746-018-0076-7 · Cited by 341
Beyond validation: getting health apps into clinical practice
Gordon, W. J., Landman, A., Zhang, H., & Bates, D. W. (2020) · npj Digital Medicine · doi:10.1038/s41746-019-0212-z · Cited by 322
Self-citationBlockchain vehicles for efficient Medical Record management
Vazirani, A. A., O’Donoghue, O., Brindley, D., & Meinert, E. (2020) · npj Digital Medicine · doi:10.1038/s41746-019-0211-0 · Cited by 245
Powell, A. C., Landman, A., & Bates, D. W. (2014) · JAMA · doi:10.1001/jama.2014.2564 · Cited by 236
Self-citationDeveloping a delivery science for artificial intelligence in healthcare
Li, R., Asch, S. M., & Shah, N. H. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00318-y · Cited by 206
Research works printed but not linked: 1
- NEJM Catalyst. How to Avoid Common Pitfalls of Health IT Implementation. https://catalyst.nejm.org/doi/full/10.1056/CAT.20.0048 (2020). · DOI
Cited by
Sorted by citations
Items 201–241 of 241
Allen, M. R., Webb, S., Mandvi, A., Frieden, M. J., Tai‐Seale, M., & Kallenberg, G. (2024) · Figshare · doi:10.6084/m9.figshare.25097361
Allen, M. R., Webb, S., Mandvi, A., Frieden, M. J., Tai‐Seale, M., & Kallenberg, G. (2024) · Figshare · doi:10.6084/m9.figshare.25097339
Boyle, L. D., Husebo, B. S., & Vislapuu, M. (2024) · Figshare · doi:10.6084/m9.figshare.26556920
Donovan, T., Abell, B., Fernando, M., McPhail, S., & Carter, H. E. (2023) · Figshare · doi:10.6084/m9.figshare.22606361
Boyle, L. D., Husebo, B. S., & Vislapuu, M. (2024) · Figshare · doi:10.6084/m9.figshare.26556926
Shakya, H., & Gandhi, S. (2025) · De Gruyter eBooks · doi:10.1515/9783111681870-012
Dorosan, M., Chen, Y.-L., He, Y., Zhuang, Q., & Lam, S. W. (2026) · JMIR AI · doi:10.2196/72472
Vrijlandt, S., Ista, E., Kuiper, R., van Veen, M., van Wermeskerken, A., Ropers, F. G., & Oostenbrink, R. (2026) · BMJ Open · doi:10.1136/bmjopen-2025-106788
Nowak, A., Gaul, C., Hinz, E., Knoll, C. M., Kül, B., Wels, A., Berkmann, J. C., de Pasquale, C., Kremser, G., Fürstenau, D., et al. (2026) · JMIR Human Factors · doi:10.2196/84841
Exploring complexity and learning: insights from the DIBH-app project using NASSS-CAT
Ventura, F. I. Q. S., Brovall, M., & Smith, F. (2026) · Health Services and Outcomes Research Methodology · doi:10.1007/s10742-026-00373-0
YouTube as a Source of Patient Information for Malignant and Benign Primary Bone Tumors
Guirguis, P. G., Youssef, M. P., Punreddy, A., Botros, M., Raiford, M. E., & McDowell, S. (2026) · Journal of Cancer Education · doi:10.1007/s13187-026-02854-9
Herzog, M., Park, L., & Quanbeck, A. (2026) · doi:10.2196/preprints.97536
Litchfield, I. J., Shukla, D., & Greenfield, S. (2026) · BMJ Digital Health & AI · doi:10.1136/bmjdh-2026-000051
Khatun, S. (2026) · Studies in big data · doi:10.1007/978-3-032-18871-7_18
Afandi, A. T., Putri, P., & Rondhianto (2026) · Indian Journal of Tuberculosis · doi:10.1016/j.ijtb.2026.04.016 · Cited by 2
Arzahan, I. S. N., Abdullah, K. H., Jamil, P. A. S. M., & Yusof, N. A. D. M. (2026) · Safety Science · doi:10.1016/j.ssci.2026.107277
Msheik, A., Peralta, R. R., Mokdad, Z. A., Alsaad, N., Illeyan, A., Hussein, M., Khan, M. M., Mohamad, A. R. E., & Mohammed, K. (2026) · IntechOpen eBooks · doi:10.5772/intechopen.1015292
Yang, Z., Lu, Y., Bagdasarian, J. L., Swain, V. D., Agarwal, R., Campbell, C., Al‐Refaie, W. B., El-Bayoumi, J., Gao, G. G., Wang, D., et al. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3788068 · Cited by 6
Kuria, T., Kamau, G. K., Makokha, F., Omondi, P., Mbugua, G., Kamau, D., Mbugua, S., & Gitaka, J. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1832634 · Cited by 1
Davins, M., Cano, M., Carrión, C., Valero, P., Bonjorn, M., Vlad, I., Ortuño, F. M., Lopez, R., Ara, J., Mòdol, J. M., et al. (2026) · doi:10.2196/preprints.101984
Standard treatment workflows in orthopedics: An Indian Council of Medical Research initiative
Kabra, A. P., Mittal, S., Goel, S. C., Jain, V. K., Arya, R., Kumar, U., Srivastava, S., & Grover, A. (2026) · Annals of the National Academy of Medical Sciences (India) · doi:10.25259/anams_264_2024
Kyytsönen, M., Faxvaag, A., Pedersen, R., Eriksen, J., Lintvedt, O., & Reponen, J. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-28812-7_3
To Build or Not to Build? Factors that Lead to Non-Development or Abandonment of AI Systems
Chappidi, S., & Singh, J. P. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3806736 · Cited by 1
Sandhu, R. K., Yow, B., Hopley, L., & Day, K. (2025) · Methods of Information in Medicine · doi:10.1055/a-2895-5157
National scale up of PROM based monitoring after joint replacement in Germany
Wittich, L., Schöner, L., Ehlig, D., Busse, R., & Vogel, J. (2026) · npj Health Systems · doi:10.1038/s44401-026-00122-y
Clinician-engaged co-creation enables adoption and impact of digital health innovations
Kaliya-Perumal, A.-K., & Tan, B. Y. (2026) · Informatics and Health · doi:10.1016/j.infoh.2026.06.003
Zaghloul, H. B., Arabi, B., Al-Ani, M., Abdullah, A., El-Masri, R., AboMuslim, O., Ahdab, F., Rizwan, M. R. M., Tag, Z. M., Zaghlool, S. B., et al. (2026) · medRxiv · doi:10.64898/2026.07.17.26358328
Herzog, M., Park, L., & Quanbeck, A. (2026) · Journal of Medical Internet Research · doi:10.2196/97536
Sahakyan, S., Akseer, S., Abrahamyan, L., Metcalf, O., Allin, S. M., Chenhall, R. D., & Seto, E. (2026) · Journal of Medical Internet Research · doi:10.2196/93875 · Cited by 1
Iseni, J., Houben, D., Swoboda, W. J., & Holl, F. (2026) · doi:10.2196/preprints.109634
The application of the SEIPS framework in a digital health context: A scoping review
Carrigan, A., Makeham, M., Jayawardena, T. D., Bamgboje‐Ayodele, A., Clay‐Williams, R., Cheek, C., Newton, N., & Baysari, M. T. (2026) · Proceedings of the International Symposium on Human Factors and Ergonomics in Health Care · doi:10.1177/2327857926151223
Chaudhary, P., Bourgeois, A., Underwood, R. A., Martin, M., Denstel, K. D., Redman, L. M., & Staiano, A. E. (2026) · JMIR Formative Research · doi:10.2196/92287
Toll, K., Haywood, Z., Yeung, J., Jurat, D. R., Andrew, S., Williams, A., Moullin, J. C., & Robinson, S. (2026) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x261480531
Diabetes and Cardiovascular Diseases and Evolving Digital Health Technologies
Islam, S. M. S., Wahiduzzaman, M., Habib, A., Rahman, S., Karmakar, C. K., Banik, P. C., Faruque, M., Tegegne, T., Moses, J. C., & Azam, S. (2026) · Springer eBooks · doi:10.1007/978-3-032-24854-1_23
Nakamura, H., & Kato, Y. (2022) · Journal of Health Informatics and Digital Systems · doi:10.68159/n552358828
Maternal mHealth usability strengthened by trust, governance, and navigation
Azugbene, E. A. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1825544
Lam, J., Barras, M., Scott, I. A., Abdel-Hafez, A., & Falconer, N. (2026) · Journal of Evaluation In Clinical Practice · doi:10.1111/jep.70592
Rethinking Objectivity in Clinical AI: A Qualitative Study of Concussion Evaluators
Zaidi, A. M., Saw, J. J.-W., Fu, L., Arneson, K., Kim, I., Cross, A., & Karahalios, K. G. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3816992
Sukums, F. K., Paulo, L. S., Thadeo, Y., Paul, M., Mndima, S., Mbuke, J., Chaula, R., Kaskazi, J., Anaeli, A., & Nyongole, O. V. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1895664
Vasileiou, N., Kouris, I., Kakkos, I., Koumakis, L., Kokkonidis, M., Danciu, G. M., Goletsis, Y., Toro, G., Gkouziouta, A., Masetti, M., et al. (2026) · Applied Sciences · doi:10.3390/app16199837
The HealthTech Adoption Gap : Rethinking Entrepreneurial Selling Beyond the Contract
Shirahattimath, V. (2026) · AMC Indian Journal of Entrepreneurship · doi:10.17010/amcije/2026/v9i1/176106
Metadata
- Authors
- Marwaha, J. S., Landman, A. B., Brat, G. A., Dunn, T., & Gordon, W. J.
- Affiliations
- Beth Israel Deaconess Medical Center (US)
- Brigham and Women's Hospital (US)
- Corresponding author
- Marwaha, Jayson S.
- Venue
- npj Digital Medicine
- Published
- 2022-01-27
- Volume
- 5
- Issue
- 1
- Pages
- 13-13
- ISSN
- 2398-6352 (ISSN-L)
- PMC
- PMC8795422
- OpenAlex
- W4210337422
- Cited by
- 241
- References
- 27
- Citations by year
- 2026: 43 · 2025: 63 · 2024: 59 · 2023: 42 · 2022: 34
- FWCI
- 7.32
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- npj Digital Medicine (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Harvard University (Biomedical Informatics and Data Science Research Training (BIRT) Program)
- U.S. Department of Health & Human Services | NIH | U.S. National Library of Medicine (T15LM007092)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Technology and Human Factors in Education and Health
- Keywords
- digital health tools, implementation planning, enterprise adoption, clinical validation, workflow integration, implementation strategies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
