Relationship Between Levels of Digital Health Literacy Based on the Taiwan Digital Health Literacy Assessment and Accurate Assessment of Online Health Information: Cross-Sectional Questionnaire Study
Open accessPublished version of a preprint
The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
Background: The increasing amount of health information available on the internet makes it more important than ever to ensure that people can judge the accuracy of this information to prevent them from harm. It may be possible for platforms to set up protective mechanisms depending on the level of digital health literacy and thereby to decrease the possibility of harm by the misuse of health information. Objective: This study aimed to create an instrument for digital health literacy assessment (DHLA) based on the eHealth Literacy Scale (eHEALS) to categorize participants by level of risk of misinterpreting health information into high-, medium-, and low-risk groups. Methods: This study developed a DHLA and constructed an online health information bank with correct and incorrect answers. Receiver operating characteristic curve analysis was used to detect the cutoff value of DHLA, using 5 items randomly selected from the online health information bank, to classify users as being at low, medium, or high risk of misjudging health information. This provided information about the relationship between risk group for digital health literacy and accurate judgement of online health information. The study participants were Taiwanese residents aged 20 years and older. Snowball sampling was used, and internet questionnaires were anonymously completed by the participants. The reliability and validity of DHLA were examined. Logistic regression was used to analyze factors associated with risk groups from the DHLA. Results: This study collected 1588 valid questionnaires. The online health information bank included 310 items of health information, which were classified as easy (147 items), moderate (122 items), or difficult (41 items) based on the difficulty of judging their accuracy. The internal consistency of DHLA was satisfactory (α=.87), and factor analysis of construct validity found three factors, accounting for 76.6% of the variance. The receiver operating characteristic curve analysis found 106 people at high risk, 1368 at medium risk, and 114 at low risk of misinterpreting health information. Of the original grouped cases, 89.6% were correctly classified after discriminate analysis. Logistic regression analysis showed that participants with a high risk of misjudging health information had a lower education level, lower income, and poorer health. They also rarely or never browsed the internet. These differences were statistically significant. Conclusions: The DHLA score could distinguish those at low, medium, and high risk of misjudging health information on the internet. Health information platforms on the internet could consider incorporating DHLA to set up a mechanism to protect users from misusing health information and avoid harming their health.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Liu et al. provided direct empirical support for this phenomenon in a digital health literacy context: participants reporting adequate self-assessed digital health literacy scores nonetheless frequently misclassified inaccurate online health content, underscoring the gap between perceived and actual information appraisal competence (77).”
From Health misinformation, digital health literacy, and attitudes toward science among university students: an exploratory cross-sectional survey (2026) · cites this paper as [77]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A primer on partial least squares structural equation modeling (PLS-SEM)
Leguina, A. (2015) · International Journal of Research & Method in Education · doi:10.1080/1743727x.2015.1005806 · Cited by 18,921
Quality criteria were proposed for measurement properties of health status questionnaires
Terwee, C. B., Bot, S. D. M., de Boer, M. R., van der Windt, D. A. W. M., Knol, D. L., Dekker, J., Bouter, L. M., & de Vet, H. C. W. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.03.012 · Cited by 10,764 · cited 2×
“Floor or ceiling effects were considered present if more than 15% of participants scored either the worst or the best possible score on the DHLA [29].”
BackgroundMethodInfluentialeHEALS: The eHealth Literacy Scale
Norman, C. D., & Skinner, H. A. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.4.e27 · Cited by 2,680 · cited 2×
“A higher score shows better digital health literacy [9,10].”
BackgroundQuick Assessment of Literacy in Primary Care: The Newest Vital Sign
Weiss, B. D. (2005) · The Annals of Family Medicine · doi:10.1370/afm.405 · Cited by 2,215
Choi, N. G., & DiNitto, D. M. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2645 · Cited by 871
eHealth Literacy: Extending the Digital Divide to the Realm of Health Information
Neter, E., & Brainin, E. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1619 · Cited by 843
Tennant, B., Stellefson, M., Dodd, V., Chaney, B., Chaney, D., Paige, S., & Alber, J. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.3992 · Cited by 760
On determining the most appropriate test cut-off value: the case of tests with continuous results
Habibzadeh, F., Habibzadeh, P., & Yadollahie, M. (2016) · Biochemia Medica · doi:10.11613/bm.2016.034 · Cited by 694
Diviani, N., van den Putte, B., Giani, S., & van Weert, J. C. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4018 · Cited by 638 · cited 1×
“In a systematic review, Diviani et al [34] found that 10 (26”
Backgroundvan der Vaart, R., van Deursen, A. J., Drossaert, C. H., Taal, E., van Dijk, J. A., & van de Laar, M. A. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1840 · Cited by 404 · cited 7×
“The online health information bank is thus considered to be a reasonable analogy to online health information, but it cannot be regarded as a performance test comparable to those used in previous studies [12,17,18,35,37,38].”
BackgroundMethodResultInfluential
Research works printed but not linked: 9
- 2019, Measuring digital development: Facts and figures 2019
- 2014, European Citizens' Digital Health Literacy: Report
- 2017, 2016 Digital Opportunity Survey for Individuals and Households (AE010014)
- Lee, HY, 2003, The Journal of Information Society, 5, 175
- 2020, 2019 digital opportunity survey for individuals and households
- Koo, M, 2012, Glob J Health Educ Promot, 15, 29
- Wu, CC, 2014, An analysis of health-related questions on social Q&A
- Monkman, H, 2017, Stud Health Technol Inform, 245, 178
- De Caro, W, 2016, Stud Health Technol Inform, 225, 949
Cited by
Digital literacy as a new determinant of health: A scoping review
Arias López, M. D. P., Ong, B. A., Borrat Frigola, X., Fernández, A. L., Hicklent, R. S., Obeles, A. J. T., Rocimo, A. M., & Celi, L. A. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000279 · Cited by 422
Digital Health Literacy: Bibliometric Analysis
Yang, K., Hu, Y., & Qi, H. (2022) · Journal of Medical Internet Research · doi:10.2196/35816 · Cited by 188
“As research deepens, digital health literacy assessment tools are continually iterated and improved by scholars to enhance the measurement of digital health literacy [6,17,18].”
Research progress on digital health literacy of older adults: A scoping review
Wang, X., & Luan, W. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.906089 · Cited by 146
Wu, C., & Lim, G. G. (2024) · Frontiers in Public Health · doi:10.3389/fpubh.2024.1449594 · Cited by 106
Addressing health literacy in the digital domain: insights from a literature review
Palumbo, R., Nicola, C., & Adinolfi, P. (2022) · Kybernetes · doi:10.1108/k-07-2021-0547 · Cited by 67
Metadata
- Authors
- Liu, P., Yeh, L.-L., Wang, J.-Y., & Lee, S.-T.
- Affiliations
- Asia University (TW)
- Dharma Drum Institute of Liberal Arts (TW)
- Corresponding author
- Yeh, Ling-Ling
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2020-12-21
- Volume
- 22
- Issue
- 12
- Pages
- e19767
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC7781799
- OpenAlex
- W3094450072
- Cited by
- 53
- References
- 41
- Citations by year
- 2026: 11 · 2025: 12 · 2024: 9 · 2023: 10 · 2022: 5 · 2021: 5
- FWCI
- 5.22
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
- Social Sciences › Education › Digital literacy in education
- Social Sciences › Library and Information Sciences › Library Science and Information Literacy
- Keywords
- digital health literacy, online health information, health information accuracy, eHealth Literacy Scale, risk classification, instrument validation, educational attainment, income, health status, internet use, health information platform, social media health information, health education, health promotion, health policy
- MeSH terms
- Adult, Cross-Sectional Studies, Female, Humans, Male, Surveys and Questionnaires, Taiwan, Reproducibility of Results, Telemedicine, Internet, Young Adult, Health Literacy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Relationship Between Levels of Digital Health Literacy Based on the Taiwan Digital Health Literacy Assessment and Accurate Assessment of Online Health Information: Cross-Sectional Questionnaire Study. https://app.cochat.ai/papers/10.2196/19767
- The paper
- Liu, P., Yeh, L.-L., Wang, J.-Y., & Lee, S.-T. (2020). Relationship Between Levels of Digital Health Literacy Based on the Taiwan Digital Health Literacy Assessment and Accurate Assessment of Online Health Information: Cross-Sectional Questionnaire Study. Journal of Medical Internet Research. https://doi.org/10.2196/19767
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.