The Effectiveness of Publicly Available Web-Based Interventions in Promoting Health App Use, Digital Health Literacy, and Media Literacy: Pre-Post Evaluation Study
Open accessPublished version of a preprint
The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Abstract
Background According to the World Health Organization, implementing mobile health (mHealth) technologies can increase access to quality health services worldwide. mHealth apps for smartphones, also known as health apps, are a central component of mHealth, and they are already used in diverse medical contexts. To benefit from health apps, potential users need specific skills that enable them to use such apps in a responsible and constructive manner. Objective This study aimed to evaluate the effectiveness of the free and widely used web-based intervention, The APPocalypse?. Besides providing knowledge about health apps, the web-based intervention was designed to promote digital health and media literacy by teaching skills that enable users to distinguish between trustworthy and less trustworthy health apps. It was hypothesized that after completing the web-based intervention, participants’ knowledge in the domain of health apps, their digital health literacy, and their media literacy would be higher than it was before completing the web-based intervention. Methods The study was divided into 3 parts. During part 1, participants (n=365; 181 female, 181 male, and 3 diverse; mean age 17.74, SD 1.391 years) provided demographic information and answered the pre- and postmeasurements. The measurements included questionnaires about participants’ knowledge in the domain of health apps, digital health literacy, and media literacy. During part 2, participants had 1 week to complete the web-based intervention. During part 3, participants answered the pre- and postmeasurements again. Furthermore, they answered educational quality and user experience questionnaires. Bayesian paired samples 2-tailed t tests were conducted to test the hypotheses. Results Overall, the results support the hypotheses. After completing the web-based intervention, participants demonstrated more elaborate knowledge in the domain of health apps. Specifically, they displayed higher competencies in the domains of subjective (Bayes factor10 [BF10]=1.475×1079; effect size δ=–1.327) and objective health app knowledge (BF10=8.162×1080; effect size δ=–1.350). Furthermore, participants demonstrated higher digital health literacy. Specifically, they displayed higher competencies in the domains of information appraisal (BF10=3.413×1043; effect size δ=–0.870), information searching (BF10=3.324×1023; effect size δ=–0.604), evaluating reliability (BF10=3.081×1035; effect size δ=–0.766), and determining relevance (BF10=3.451×1024; effect size δ=–0.618). Regarding media literacy, the results were mixed. Participants displayed higher competencies in the domain of technology literacy beliefs (BF10=1.533×1021; effect size δ=–0.570). In the domain of technology control beliefs, their competencies did not seem to improve (BF10=0.109; effect size δ=–0.058). In comparison to relevant benchmarks, the web-based intervention offers exceptional educational quality and a superior user experience. Conclusions The free web-based intervention The APPocalypse? might promote the constructive use of health apps, digital health literacy, and media literacy. Therefore, it may contribute to achieving the health-related United Nations Sustainable Development Goals.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures









Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“These cross-sectional observations are consistent with existing literature on the relationship between university education in health programmes and epistemological attitudes toward science (71, 72).”
From Health misinformation, digital health literacy, and attitudes toward science among university students: an exploratory cross-sectional survey (2026) · cites this paper as [71]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971
Transforming Our World: The 2030 Agenda for Sustainable Development
(2018) · A New Era in Global Health · doi:10.1891/9780826190123.ap02 · Cited by 19,351
Making sense of cronbach’s alpha.
Tavakol, M., & Dennick, R. (2011) · International Journal of Medical Education · doi:10.5116/ijme.4dfb.8dfd · Cited by 15,126
Statistics notes: Cronbach's alpha: Table 1
Bland, J. M., & Altman, D. G. (1997) · BMJ · doi:10.1136/bmj.314.7080.572 · Cited by 5,300
Handbook of Research on Educational Communications and Technology
(2013) · Routledge eBooks · doi:10.4324/9781410609519 · Cited by 2,732
eHEALS: The eHealth Literacy Scale
Norman, C. D., & Skinner, H. A. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.4.e27 · Cited by 2,680 · cited 2×
“Besides providing knowledge about health apps, the web-based intervention was designed to promote digital health and media literacy by teaching skills that enable users to distinguish between trustworthy and less trustworthy health apps and health information in general [21-24].”
eHealth Literacy: Essential Skills for Consumer Health in a Networked World.
Norman, C. D., & Skinner, H. A. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.2.e9 · Cited by 2,643
Handbook of Research on Educational Communications and Technology
(2014) · doi:10.1007/978-1-4614-3185-5 · Cited by 1,475
Experimental methods: Between-subject and within-subject design
Charness, G., Gneezy, U., & Kuhn, M. A. (2012) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2011.08.009 · Cited by 1,469
(2016) · Wiley eBooks · doi:10.1002/9781119239086 · Cited by 1,341
Cited by
Mukhtar, T., Babur, M., Abbas, R., Irshad, A., & Kiran, Q. (2025) · Pakistan Journal of Medical Sciences · doi:10.12669/pjms.41.3.10639 · Cited by 81
The influence of digital literacy on mHealth app usability: The mediating role of patient expertise
Durmuş, A. (2024) · Digital Health · doi:10.1177/20552076241299061 · Cited by 30
Zhang, X., Yuan, Y., & Jiang, J. (2025) · Frontiers in Public Health · doi:10.3389/fpubh.2025.1661177 · Cited by 27
Schröder, R., Hamer, T., Kruzewitz, V., Busch, E., Suhr, R., & König, L. (2025) · JMIR Mental Health · doi:10.2196/76004 · Cited by 18
Self-citationSchröder, R., Hamer, T., Suhr, R., & König, L. (2025) · JMIR Public Health and Surveillance · doi:10.2196/67078 · Cited by 13
Self-citation
Metadata
- Authors
- König, L., & Suhr, R.
- Affiliations
- Charité – Universitätsmedizin Berlin (DE)
- Corresponding author
- König, Lars
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2023-12-04
- Volume
- 25
- Pages
- e46336
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC10728793
- OpenAlex
- W4389312248
- Cited by
- 16
- References
- 56
- Citations by year
- 2026: 3 · 2025: 9 · 2024: 4
- FWCI
- 5.63
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Health Professions › Health Information Management › Health, Technology, Consumer Behavior
- Keywords
- health apps, digital health literacy, media literacy, online intervention, mobile health, information evaluation, information searching, information sharing, data privacy, information security, information retention, information storage
- MeSH terms
- Internet-Based Intervention, Adolescent, Bayes Theorem, Female, Humans, Male, Reproducibility of Results, Health Literacy, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Effectiveness of Publicly Available Web-Based Interventions in Promoting Health App Use, Digital Health Literacy, and Media Literacy: Pre-Post Evaluation Study. https://app.cochat.ai/papers/10.2196/46336
- The paper
- König, L., & Suhr, R. (2023). The Effectiveness of Publicly Available Web-Based Interventions in Promoting Health App Use, Digital Health Literacy, and Media Literacy: Pre-Post Evaluation Study. Journal of Medical Internet Research. https://doi.org/10.2196/46336
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.