‘Trust but verify’ – five approaches to ensure safe medical apps
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Mobile health apps are health and wellness programs available on mobile devices such as smartphones or tablets. In three systematic assessments published in BMC Medicine, Huckvale and colleagues demonstrate that widely available health apps meant to help patients calculate their appropriate insulin dosage, educate themselves about asthma, or perform other important functions are methodologically weak. Insulin dose calculators lacked user input validation and made inappropriate dose recommendations, with a lack of documentation throughout. Since 2011, asthma apps have become more interactive, but have not improved in quality; peak flow calculators have the same issues as the insulin calculators. A review of the accredited National Health Service Health Apps Library found poor and inconsistent implementation of privacy and security, with 28% of apps lacking a privacy policy and one even transmitting personally identifying data the policy claimed would be anonymous. Ensuring patient safety might require a new approach, whether that be a consumer education program at one extreme or government regulation at the other. App store owners could ensure transparency of algorithms (whiteboxing), data sharing, and data quality. While a proper balance must be struck between innovation and caution, patient safety must be paramount.Please see related articles: http://dx.doi.org/10.1186/s12916-015-0444-y , http://www.biomedcentral.com/1741-7015/13/106 and http://www.biomedcentral.com/1741-7015/13/58.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mobile app rating scale: a new tool for assessing the quality of health mobile apps
Stoyanov, S. R., Hides, L., Kavanagh, D. J., Zelenko, O., Tjondronegoro, D., & Mani, M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3422 · Cited by 2,233 · cited 2×
“Although important for user satisfaction, rating app quality primarily on dimensions such as visual appeal, functionality, and overall satisfaction without rigorous data quality checking [13] fails to put sufficient emphasis on uncovering the type of data quality issues identified in the studies described here.”
BackgroundThe ClinicalTrials.gov Results Database — Update and Key Issues
Zarin, D. A., Tse, T., Williams, R. J., Califf, R. M., & Ide, N. C. (2011) · New England Journal of Medicine · doi:10.1056/nejmsa1012065 · Cited by 838
Mobile medical and health apps: state of the art, concerns, regulatory control and certification
Kamel Boulos, M. N., Brewer, A. C., Karimkhani, C., Buller, D. B., & Dellavalle, R. P. (2014) · Online Journal of Public Health Informatics · doi:10.5210/ojphi.v5i3.4814 · Cited by 659 · cited 2×
“Voluntary certification schemes such as the Happtique Health App Certification Program have been piloted [10].”
BackgroundMethodHuckvale, K., Prieto, J. T., Tilney, M., Benghozi, P.-J., & Car, J. (2015) · BMC Medicine · doi:10.1186/s12916-015-0444-y · Cited by 376
The evolution of mobile apps for asthma: an updated systematic assessment of content and tools
Huckvale, K., Morrison, C., Ouyang, J., Ghaghda, A., & Car, J. (2015) · BMC Medicine · doi:10.1186/s12916-015-0303-x · Cited by 166
Cited by
O’Connor, S., Hanlon, P., O’Donnell, C. A., Garcia, S., Glanville, J., & Mair, F. S. (2016) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-016-0359-3 · Cited by 636
Mental Health Mobile Apps for Preadolescents and Adolescents: A Systematic Review.
Grist, R., Porter, J., & Stallard, P. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7332 · Cited by 518
“This contrasts starkly with the large number available from commercial sites and raises questions about the safety, quality, and efficacy of those that are available [11,22,62].”
BackgroundThe diverse domains of quantified selves: self-tracking modes and dataveillance
Lupton, D. (2016) · Economy and Society · doi:10.1080/03085147.2016.1143726 · Cited by 446
Lupton, D. (2016) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-016-0971-3 · Cited by 330
An Australian survey of women's use of pregnancy and parenting apps
Lupton, D., & Pedersen, S. (2016) · Women and Birth · doi:10.1016/j.wombi.2016.01.008 · Cited by 256
Metadata
- Authors
- Wicks, P., & Chiauzzi, E.
- Venue
- BMC Medicine
- Published
- 2015-09-25
- Volume
- 13
- Issue
- 1
- Pages
- 205-205
- ISSN
- 1741-7015 (ISSN-L)
- OpenAlex
- W2155053848
- Cited by
- 133
- References
- 5
- FWCI
- 31.55
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: ‘Trust but verify’ – five approaches to ensure safe medical apps. https://app.cochat.ai/papers/10.1186/s12916-015-0451-z
- The paper
- Wicks, P., & Chiauzzi, E. (2015). ‘Trust but verify’ – five approaches to ensure safe medical apps. BMC Medicine. https://doi.org/10.1186/s12916-015-0451-z
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.