Performance-Based Measurement of eHealth Literacy: Systematic Scoping Review
Open accessPublished version of a preprint
The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Abstract
Background: eHealth literacy describes the ability to locate, comprehend, evaluate, and apply web-based health information to a health problem. In studies of eHealth literacy, researchers have primarily assessed participants’ perceived eHealth literacy using a short self-report instrument, for which ample research has shown little to no association with actual performed eHealth-related skills. Performance-based measures of eHealth literacy may be more effective at assessing actual eHealth skills, yet such measures seem to be scarcer in the literature. Objective: The primary purpose of this study was to identify tools that currently exist to measure eHealth literacy based on objective performance. A secondary purpose of this study was to characterize the prevalence of performance-based measurement of eHealth literacy in the literature compared with subjective measurement. Methods: We conducted a systematic scoping review of the literature, aligning with the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) checklist, in 3 stages: conducting the search, screening articles, and extracting data into a summary table. The summary table includes terminology for eHealth literacy, description of participants, instrument design, health topics used, and a brief note on the evidence of validity for each performance-based measurement tool. A total of 1444 unique articles retrieved from 6 relevant databases (MEDLINE; PsycINFO; CINAHL; Library and Information Science Abstracts [LISA]; Library, Information Science & Technology Abstracts [LISTA]; and Education Resources Information Center [ERIC]) were considered for inclusion, of which 313 (21.68%) included a measure of eHealth literacy. Results: Among the 313 articles that included a measure of eHealth literacy, we identified 33 (10.5%) that reported on 29 unique performance-based eHealth literacy measurement tools. The types of tools ranged from having participants answer health-related questions using the internet, having participants engage in simulated internet tasks, and having participants evaluate website quality to quizzing participants on their knowledge of health and the web-based health information–seeking process. In addition, among the 313 articles, we identified 280 (89.5%) that measured eHealth literacy using only a self-rating tool. Conclusions: This study is the first research synthesis looking specifically at performance-based measures of eHealth literacy and may direct researchers toward existing performance-based measurement tools to be applied in future projects. We discuss some of the key benefits and drawbacks of different approaches to performance-based measurement of eHealth literacy. Researchers with an interest in gauging participants’ actual eHealth literacy (as opposed to perceived eHealth literacy) should make efforts to incorporate tools such as those identified in this systematic scoping review.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The discrepancy between perceived and actual proficiency in health information evaluation is a well-documented phenomenon in the health literacy literature, whereby individuals systematically overestimate their critical appraisal abilities when evaluated against standardized measures (50, 51).”
From Health misinformation, digital health literacy, and attitudes toward science among university students: an exploratory cross-sectional survey (2026) · cites this paper as [50]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565
Munn, Z., Peters, M. D. J., Stern, C., Tufanaru, C., McArthur, A., & Aromataris, E. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0611-x · Cited by 11,385
Predicting and Changing Behavior
Fishbein, M., & Ajzen, I. (2011) · doi:10.4324/9780203838020 · Cited by 2,807
eHEALS: The eHealth Literacy Scale
Norman, C. D., & Skinner, H. A. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.4.e27 · Cited by 2,680 · cited 2×
“Concurrent with their publication coining eHealth literacy, Norman and Skinner [9] published the eHealth Literacy Scale (eHEALS), an 8-item questionnaire wherein each item is rated using a 5-point Likert scale ranging from 1 (strongly disagree) to 5 (strongly agree), with higher scores indicating…”
eHealth Literacy: Essential Skills for Consumer Health in a Networked World.
Norman, C. D., & Skinner, H. A. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.2.e9 · Cited by 2,643 · cited 7×
“Although evaluating the credibility of a web-based source is undoubtedly a pivotal component of eHealth literacy, it does not encompass all components of eHealth literacy as defined by Norman and Skinner [7].”
InfluentialMoorhead, S. A., Hazlett, D. E., Harrison, L., Carroll, J. K., Irwin, A., & Hoving, C. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.1933 · Cited by 2,517 · cited 1×
“The validity and trustworthiness of information quality on these platforms has been flagged as a major concern [65]; however, public health organizations have also used these engaging platforms to distribute high-quality and up-to-date information [66,67].”
Flawed Self-Assessment: Implications for Health, Education, and the Workplace
Dunning, D., Heath, C., & Suls, J. M. (2004) · Psychological Science in the Public Interest · doi:10.1111/j.1529-1006.2004.00018.x · Cited by 1,865
Kata, A. (2012) · Vaccine · doi:10.1016/j.vaccine.2011.11.112 · Cited by 1,094 · cited 1×
“Many avid followers of the antivaccine movement have spent several hours surfing the internet for health-related information [15,16].”
Dietary Guidelines for Americans
DeSalvo, K. B., Olson, R., & Casavale, K. O. (2016) · JAMA · doi:10.1001/jama.2015.18396 · Cited by 1,059
Research works printed but not linked: 4
- 10.1037/0021-9010.67.3.280 · DOI · Paper page
- Brown, CA, 2010, J Allied Health, 39, 179
- 2010, Encyclopedia of Research Design
- Hanik, B, 2011, Int Electron J Health Educ, 14, 46
Cited by
Petrič, G., & Atanasova, S. (2024) · BMC Public Health · doi:10.1186/s12889-024-19431-8 · Cited by 31
Choosing the Best Digital Health Literacy Measure for Research: Mixed Methods Study
Thorup, C. B., Uitto, M., Butler-Henderson, K. A., Andersson, S. W., Hoffrén‐Mikkola, M., Thoft, D. S., Hæsum, L. K. E., Irrazábal, G., Pruneda, L., & Valkama, K. (2025) · Journal of Medical Internet Research · doi:10.2196/59807 · Cited by 29
eHealth literacy in the general population: a cross-sectional study in China
Sun, C., Meijer, E., Chavannes, N. H., Dai, H., Li, X., Wang, Y., Wu, L., Zhang, Q., & Kasteleyn, M. J. (2025) · BMC Public Health · doi:10.1186/s12889-025-21389-0 · Cited by 25
Li, J., Wu, X., Wu, Y., Fong, D., Song, Y., Xu, S., Kim, C., Lin, X., & Pandian, V. (2025) · Journal of Medical Internet Research · doi:10.2196/70822 · Cited by 11
Naeem, S. B., Faiola, A. J., Ur-Rehman, A., & Boulos, M. N. K. (2024) · Information · doi:10.3390/info15100636 · Cited by 10
Metadata
- Authors
- Crocker, B., Feng, O., & Duncan, L. R.
- Affiliations
- McGill University (CA)
- Corresponding author
- Crocker, Bradley
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2023-06-02
- Volume
- 25
- Pages
- e44602
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC10276324
- OpenAlex
- W4322750995
- Cited by
- 28
- References
- 67
- Citations by year
- 2026: 13 · 2025: 8 · 2024: 5 · 2023: 2
- FWCI
- 1.42
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- other-oa
- Locations
- Journal of Medical Internet Research (publishedVersion, other-oa)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
- Social Sciences › Library and Information Sciences › Library Science and Information Literacy
- Physical Sciences › Computer Science › Information Systems › ICT in Developing Communities
- Keywords
- digital health literacy, self-report measures, online health information, health information seeking, website quality evaluation, digital literacy, information literacy, self-efficacy, self-regulation, self-monitoring
- MeSH terms
- Humans, Surveys and Questionnaires, Telemedicine, Checklist, Health Literacy, Self Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
