Cited by 508Mobile Health and mHealth ApplicationsHealth, Technology, Consumer BehaviorArtificial Intelligence in Healthcare and Education

Digital health: a path to validation

Open access
Mathews, Simon C., McShea, Michael J., Hanley, Casey L., Ravitz, Alan, Labrique, Alain B., Cohen, Adam B.·2019·npj Digital Medicine

Abstract

Digital health solutions continue to grow in both number and capabilities. Despite these advances, the confidence of the various stakeholders — from patients and clinicians to payers, industry and regulators — in medicine remains quite low. As a result, there is a need for objective, transparent, and standards-based evaluation of digital health products that can bring greater clarity to the digital health marketplace. We believe an approach that is guided by end-user requirements and formal assessment across technical, clinical, usability, and cost domains is one possible solution. For digital health solutions to have greater impact, quality and value must be easier to distinguish. To that end, we review the existing landscape and gaps, highlight the evolving responses and approaches, and detail one pragmatic framework that addresses the current limitations in the marketplace with a path toward implementation.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41746-019-0111-3

Cites

24 of 24 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Evidence-supported apps are slow to be made publicly accessible due to research-to-practice translational lags and complex regulatory systems.

    “evidence-supported apps are slow to be made publicly accessible due to research-to-practice translational lags and complex regulatory systems (Mathews et al. 2019).”

    From Evaluating the quality, safety, and functionality of commonly used smartphone apps for bipolar disorder mood and sleep self-management (2022) · cites this paper as Mathews et al. 2019

    The Existing landscape section says digital health technologies generally lack the constraints that slowed traditional medical products, enabling rapid creation and distribution, often without clinical efficacy trials. It acknowledges regulatory ambiguity and a time-consuming healthcare innovation process, but does not say these delay public access to evidence-supported apps; its account of app distribution points the other way. No page number is available in our copy. (LLM, conf=0.85)

    Checked by a reasoning model — may be wrong.

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Mathews, S. C., McShea, M. J., Hanley, C. L., Ravitz, A., Labrique, A. B., & Cohen, A. B.
Affiliations
Johns Hopkins University (US)
Corresponding author
Mathews, Simon C.
Venue
npj Digital Medicine
Published
2019-05-13
Volume
2
Issue
1
Pages
38-38
ISSN
2398-6352 (ISSN-L)
OpenAlex
W2946661638
Cited by
508
References
24
Citations by year
2026: 52 · 2025: 81 · 2024: 107 · 2023: 85 · 2022: 73 · 2021: 60 · 2020: 44 · 2019: 6
FWCI
8.41
Type
journal article
Language
en
Open access
Locations
  • npj Digital Medicine (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
Topics
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
  • Health Sciences › Health Professions › Health Information Management › Health, Technology, Consumer Behavior
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
Keywords
digital health, validation framework, end-user needs, clinical evaluation, usability, cost evaluation, standards-based evaluation, stakeholder confidence

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review