Standards for Mobile Health–Related Apps: Systematic Review and Development of a Guide
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Background: In recent years, the considerable increase in the number of mobile health (mHealth) apps has made health care more accessible and affordable for all. However, the exponential growth in mHealth solutions has occurred with almost no control or regulation of any kind. Despite some recent initiatives, there is still no specific regulation procedure, accreditation system, or standards to help the development of the apps, mitigate risks, or guarantee quality. Objective: The main aim of this study was to propose a set of criteria for mHealth-related apps on the basis of what is available from published studies, guidelines, and standards in the various areas that are related to health app development. Methods: We used three sources of information to identify the most important criteria. First, we conducted a systematic review of all the studies published on pain-related apps. Second, we searched for health app recommendations on the websites of professional organizations. Third, we looked for standards governing the development of software for medical devices on the specialized websites of regulatory organizations. Then, we grouped and subsumed the criteria we had identified on the basis of their shared characteristics. Finally, the comprehensibility and perceived importance of the resulting criteria were evaluated for face validity with a group of 18 stakeholders. Results: We identified a total of 503 criteria from all sources, which, after close analysis, were grouped into eight different categories, including 36 important criteria for health apps. The resulting categories were usability, privacy, security, appropriateness and suitability, transparency and content, safety, technical support and updates, and technology. The results of the preliminary analysis showed that the criteria were mostly understood by the group of stakeholders. In addition, they perceived all of them as important. Conclusions: This set of criteria can help health care providers, developers, patients, and other stakeholders to guide the development of mHealth-related apps and, potentially, to measure the quality of an mHealth app.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mobile app rating scale: a new tool for assessing the quality of health mobile apps
Stoyanov, S. R., Hides, L., Kavanagh, D. J., Zelenko, O., Tjondronegoro, D., & Mani, M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3422 · Cited by 2,233 · cited 4×
“For example, in the case of the MARS [17], which is one of the most used rating systems, authors have failed to include some very basic items on their scale.”
InfluentialMobile medical and health apps: state of the art, concerns, regulatory control and certification
Kamel Boulos, M. N., Brewer, A. C., Karimkhani, C., Buller, D. B., & Dellavalle, R. P. (2014) · Online Journal of Public Health Informatics · doi:10.5210/ojphi.v5i3.4814 · Cited by 659 · cited 1×
“In this so-called strategic field, progress depends not only on what each research group is doing but also on developing general standards and improving certification procedures [11,12].”
BackgroundUsing smartphones and health apps to change and manage health behaviors: a population-based survey
Ernsting, C., Dombrowski, S. U., Oedekoven, M., O´Sullivan, J. L., Kanzler, M., Kuhlmey, A., & Gellert, P. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6838 · Cited by 400 · cited 1×
“In the last few years, mHealth has undergone considerable development because of its potential to make health care more accessible and affordable for all [2,5-7].”
Huckvale, K., Prieto, J. T., Tilney, M., Benghozi, P.-J., & Car, J. (2015) · BMC Medicine · doi:10.1186/s12916-015-0444-y · Cited by 376
Medical apps for smartphones: lack of evidence undermines quality and safety
Buijink, A. W. G., Visser, B. J., & Marshall, L. (2013) · Evidence Based Medicine · doi:10.1136/eb-2012-100885 · Cited by 303 · cited 1×
“This goes against the current trend in the area, which is seeking apps that have been scientifically tested and designed on the basis of evidence [25-27].”
Brown, W., Yen, P.-Y., Rojas, M., & Schnall, R. (2013) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2013.08.001 · Cited by 299 · cited 1×
“Some more recent attempts to provide alternatives to assess mHealth apps also share some of these weaknesses (eg, developed for one specific group of stakeholders and using one specific source of information) [18,19].”
Salazar, A., de Sola, H., Failde, I., & Moral-Munoz, J. A. (2018) · JMIR mHealth and uHealth · doi:10.2196/10718 · Cited by 154 · cited 5×
“For example, in the case of the MARS [17], which is one of the most used rating systems, authors have failed to include some very basic items on their scale.”
Influential
Research works printed but not linked: 12
- 2017, Health at a Glance 2017 OECD Indicators
- 2011, mHealth: New Horizons for Health through Mobile Technologies
- 10.2196/medinform.6799 · DOI
- 10.1057/ejis.2015.1 · DOI
- Ventola, CL, 2014, Pharm Ther, 39, 356
- 10.1371/journal.pone.0101312 · DOI · Paper page
- Miró, J, 2003, Dolor Crónico. Procedimientos de evaluación e intervención psicológica
- 10.2196/jmir.3133 · DOI · Paper page
- 10.1145/3145846 · DOI
- 10.1371/journal.pmed.1000097 · DOI · Paper page
- 10.2196/10414 · DOI · Paper page
- 10.2196/10056 · DOI
Cited by
Effectiveness of Disease-Specific mHealth Apps in Patients With Diabetes Mellitus: Scoping Review
Eberle, C., Löhnert, M., & Stichling, S. (2021) · JMIR mHealth and uHealth · doi:10.2196/23477 · Cited by 160
“Because the mHealth app market is very heterogeneous and growing so rapidly, there is currently no general mandated definition of mHealth app [10,11].”
Smoking cessation apps: a systematic review of format, outcomes, and features
Barroso-Hurtado, M., Suárez-Castro, D., Martínez-Vispo, C., Becoña, E., & López-Durán, A. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph182111664 · Cited by 58
“Moreover, future studies should design smoking cessation apps adhering to standard guidelines [72,73] and using rigorous methodologies, including sample size calculations, intention-to-treat analysis, and longer follow-up periods.”
BackgroundChao, A., Martignetti, L., Groh, R., Kist, A. M., & Li-Jessen, N. Y. (2025) · JMIR Formative Research · doi:10.2196/73584
Metadata
- Authors
- Llorens-Vernet, P., & Miró, J.
- Venue
- JMIR mHealth and uHealth
- Publisher
- JMIR Publications Inc.
- Published
- 2020-03-03
- Volume
- 8
- Issue
- 3
- Pages
- e13057
- ISSN
- 2291-5222 (ISSN-L)
- OpenAlex
- W2964270354
- Cited by
- 115
- References
- 7
- FWCI
- 2.70
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.