Measuring Electronic Health Literacy: Development, Validation, and Test of Measurement Invariance of a Revised German Version of the eHealth Literacy Scale
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
Background: The World Wide Web has become an essential source of health information. Nevertheless, the amount and quality of information provided may lead to information overload. Therefore, people need certain skills to search for, identify, and evaluate information from the internet. In the context of health information, these competencies are summarized as the construct of eHealth literacy. Previous research has highlighted the relevance of eHealth literacy in terms of health-related outcomes. However, the existing instrument assessing eHealth literacy in the German language reveals methodological limitations regarding test development and validation. The development and validation of a revised scale for this important construct is highly relevant. Objective: The objective of this study was the development and validation of a revised German eHealth literacy scale. In particular, this study aimed to focus on high methodological and psychometric standards to provide a valid and reliable instrument for measuring eHealth literacy in the German language. Methods: Two internationally validated instruments were merged to cover a wide scope of the construct of eHealth literacy and create a revised eHealth literacy scale. Translation into the German language followed scientific guidelines and recommendations to ensure content validity. Data from German-speaking people (n=470) were collected in a convenience sample from October to November 2020. Validation was performed by factor analyses. Further, correlations were performed to examine convergent, discriminant, and criterion validity. Additionally, analyses of measurement invariance of gender, age, and educational level were conducted. Results: Analyses revealed a 2-factorial model of eHealth literacy. By item-reduction, the 2 factors information seeking and information appraisal were measured with 8 items reaching acceptable-to-good model fits (comparative fit index [CFI]: 0.942, Tucker Lewis index [TLI]: 0.915, root mean square error of approximation [RMSEA]: 0.127, and standardized root mean square residual [SRMR]: 0.055). Convergent validity was comprehensively confirmed by significant correlations of information seeking and information appraisal with health literacy, internet confidence, and internet anxiety. Discriminant and criterion validity were examined by correlation analyses with various scales and could partly be confirmed. Scalar level of measurement invariance for gender (CFI: 0.932, TLI: 0.923, RMSEA: 0.122, and SRMR: 0.068) and educational level (CFI: 0.937, TLI: 0.934, RMSEA: 0.112, and SRMR: 0.063) were confirmed. Measurement invariance of age was rejected. Conclusions: Following scientific guidelines for translation and test validation, we developed a revised German eHealth Literacy Scale (GR-eHEALS). Our factor analyses confirmed an acceptable-to-good model fit. Construct validation in terms of convergent, discriminant, and criterion validity could mainly be confirmed. Our findings provide evidence for measurement invariance of the instrument regarding gender and educational level. The newly revised GR-eHEALS questionnaire represents a valid instrument to measure the important health-related construct eHealth literacy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
Guidelines for the process of cross-cultural adaptation of self-report measures
Beaton, D. E., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2000) · Spine · doi:10.1097/00007632-200012150-00014 · Cited by 14,542
Guillemin, F., Bombardier, C., & Beaton, D. (1993) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(93)90142-n · Cited by 6,060
Putnick, D. L., & Bornstein, M. H. (2016) · Developmental Review · doi:10.1016/j.dr.2016.06.004 · Cited by 4,369 · cited 1×
“We applied a cutoff criterion of a difference of CFI ( Δ CFI) of 0.01 as it is proposed as appropriate to assume invariance between two models [75,76].”
InfluentialDual-Process Theories of Higher Cognition: Advancing the Debate
Evans, J. S. B. T., & Stanovich, K. E. (2013) · Perspectives on Psychological Science · doi:10.1177/1745691612460685 · Cited by 4,271
eHEALS: The eHealth Literacy Scale
Norman, C. D., & Skinner, H. A. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.4.e27 · Cited by 2,680 · cited 7×
“Items 1 to 8 are translated from the original eHEALS questionnaire from Norman & Skinner [16], and items 9 to 16 are translated from the questionnaire (eHEALS-E) from Petri č and colleagues [54].”
InfluentialeHealth Literacy: Essential Skills for Consumer Health in a Networked World.
Norman, C. D., & Skinner, H. A. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.2.e9 · Cited by 2,643 · cited 3×
“To cope with information overload and use the information from the internet, Norman and Skinner [15] proposed a set of different competencies: skills to read, identify, and understand different information to distinguish helpful from less helpful or even false or harmful information.”
InfluentialThe adequacy of response rates to online and paper surveys: what can be done?
Nulty, D. D. (2008) · Assessment & Evaluation in Higher Education · doi:10.1080/02602930701293231 · Cited by 2,581
Kyriazos, T. A. (2018) · Psychology · doi:10.4236/psych.2018.98126 · Cited by 1,882 · cited 1×
“The sample size is in accordance with recommendations for validation studies [62,63].”
Consumer health information seeking on the internet: the state of the art
Cline, R. J. W. (2001) · Health Education Research · doi:10.1093/her/16.6.671 · Cited by 1,708 · cited 1×
“With the rise of the internet as a source of information, the gathering of health information was no longer limited to professional or face-to-face health sources but was available from many different health topic websites [6].”
Pennycook, G., & Rand, D. G. (2020) · Journal of Personality · doi:10.1111/jopy.12476 · Cited by 879
van der Vaart, R., & Drossaert, C. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6709 · Cited by 687
Diseases, T. L. I. (2020) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(20)30565-x · Cited by 421 · cited 1×
“Not only is a large amount of information available, but a significant amount of it must be considered misinformation because the sources of the information must be classified questionable [13,14].”
van der Vaart, R., van Deursen, A. J., Drossaert, C. H., Taal, E., van Dijk, J. A., & van de Laar, M. A. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1840 · Cited by 404
Li, X., & Liu, Q. (2020) · Journal of Medical Internet Research · doi:10.2196/19684 · Cited by 319 · cited 1×
“In the context of COVID-19, associations of eHealth literacy and lower psychological symptoms [28] and higher prevention behaviors [29] could be confirmed.”
The Concept of eHealth Literacy and Its Measurement: German Translation of the eHEALS
Soellner, R., Huber, S., & Reder, M. (2014) · Journal of Media Psychology · doi:10.1027/1864-1105/a000104 · Cited by 184
Neter, E., & Brainin, E. (2019) · European Psychologist · doi:10.1027/1016-9040/a000350 · Cited by 169
Electronic Health Literacy Across the Lifespan: Measurement Invariance Study
Paige, S. R., Miller, M. D., Krieger, J. L., Stellefson, M., & Cheong, J. (2018) · Journal of Medical Internet Research · doi:10.2196/10434 · Cited by 93
Cited by
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
König, L., & Suhr, R. (2023) · Journal of Medical Internet Research · doi:10.2196/46336 · Cited by 16
Hindelang, M., Zink, A., Knitza, J., Darkow, R., Welcker, M., Biedermann, T., May, S., & Muehlensiepen, F. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-13043-7 · Cited by 4
“Additionally, we examined the perceived impact of digital services on the doctor-patient relationship, care quality, and changes in usage due to the COVID-19 pandemic [28, 29].”
Metadata
- Authors
- Marsall, M., Engelmann, G., Skoda, E.-M., Teufel, M., & Bäuerle, A.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2022-02-02
- Volume
- 24
- Issue
- 2
- Pages
- e28252
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W3215725931
- Cited by
- 73
- References
- 18
- FWCI
- 10.38
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.