Being an Informed Consumer of Health Information and Assessment of Electronic Health Literacy in a National Sample of Internet Users: Validity and Reliability of the e-HLS Instrument
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The Internet, with its capacity to provide information that transcends time and space barriers, continues to transform how people find and apply information to their own lives. With the current explosion in electronic sources of health information, including thousands of websites and hundreds of mobile phone health apps, electronic health literacy is gaining an increasing prominence in health and medical research. An important dimension of electronic health literacy is the ability to appraise the quality of information that will facilitate everyday health care decisions. Health information seekers explore their care options by gathering information from health websites, blogs, Web-based forums, social networking websites, and advertisements, despite the fact that information quality on the Internet varies greatly. Nonetheless, research has lagged behind in establishing multidimensional instruments, in part due to the evolving construct of health literacy itself. OBJECTIVE: The purpose of this study was to examine psychometric properties of a new electronic health literacy (ehealth literacy) measure in a national sample of Internet users with specific attention to older users. Our paper is motivated by the fact that ehealth literacy is an underinvestigated area of inquiry. METHODS: Our sample was drawn from a panel of more than 55,000 participants maintained by Knowledge Networks, the largest national probability-based research panel for Web-based surveys. We examined the factor structure of a 19-item electronic Health Literacy Scale (e-HLS) through exploratory factor analysis (EFA) and confirmatory factor analysis, internal consistency reliability, and construct validity on sample of adults (n=710) and a subsample of older adults (n=194). The AMOS graphics program 21.0 was used to construct a measurement model, linking latent factors obtained from EFA with 19 indicators to determine whether this factor structure achieved a good fit with our entire sample and the subsample (age ≥ 60 years). Linear regression analyses were performed in separate models to examine: (1) the construct validity of the e-HLS and (2) its association with respondents' demographic characteristics and health variables. RESULTS: The EFA produced a 3-factor solution: communication (2 items), trust (4 items), and action (13 items). The 3-factor structure of the e-HLS was found to be invariant for the subsample. Fit indices obtained were as follows: full sample: χ(2) (710)=698.547, df=131, P<.001, comparative fit index (CFI)=0.94, normed fit index (NFI)=0.92, root mean squared error of approximation (RMSEA)=0.08; and for the older subsample (age ≥ 60 years): χ(2) (194)=275.744, df=131, P<.001, CFI=0.95, NFI=0.90, RMSEA=0.08. CONCLUSIONS: The analyses supported the e-HLS validity and internal reliability for the full sample and subsample. The overwhelming majority of our respondents reported a great deal of confidence in their ability to appraise the quality of information obtained from the Internet, yet less than half reported performing quality checks contained on the e-HLS.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Low Health Literacy and Health Outcomes: An Updated Systematic Review
Berkman, N. D., Sheridan, S. L., Donahue, K. E., Halpern, D. J., & Crotty, K. (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-2-201107190-00005 · Cited by 5,505
Health Literacy: A Prescription to End Confusion
Committee on Health Literacy, Board on Neuroscience and Behavioral Health, & Institute of Medicine (2004) · doi:10.17226/10883 · Cited by 3,444
eHEALS: The eHealth Literacy Scale
Norman, C. D., & Skinner, H. A. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.4.e27 · Cited by 2,680 · cited 3×
“Their Lily Model included 6 core health literacy skills depicted as petals of a lily: traditional (reading ability and numeracy), information, media, health, computer, and science [41].”
InfluentialeHealth Literacy: Essential Skills for Consumer Health in a Networked World.
Norman, C. D., & Skinner, H. A. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.2.e9 · Cited by 2,643 · cited 1×
“There are few tools to assess users’ ability to engage in ehealth in an informed way [37-38].”
Eysenbach, G., Powell, J., Kuss, O., & Sa, E.-R. (2002) · JAMA · doi:10.1001/jama.287.20.2691 · Cited by 1,871 · cited 1×
“Scale items designed to measure the communication dimension are based on the findings of previous studies of patient–provider dialogue [63-65].”
van der Vaart, R., van Deursen, A. J., Drossaert, C. H., Taal, E., van Dijk, J. A., & van de Laar, M. A. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1840 · Cited by 404 · cited 1×
“Although current assessments of health literacy focus primarily on reading ability, our review of the literature suggested the need for updated measures of health literacy that would measure information search strategies and skills to judge the quality of information found [12,50,51].”
French Validation of the Internet Addiction Test
Khazaal, Y., Billieux, J., Thorens, G., Khan, R., Louati, Y., Scarlatti, E., Theintz, F., Lederrey, J., Van Der Linden, M., & Zullino, D. (2008) · CyberPsychology & Behavior · doi:10.1089/cpb.2007.0249 · Cited by 329 · cited 1×
“Beginning analytical procedures with EFA by examining the measurement model followed by CFA was also reported in the literature on the psychometric validation of new instruments [54-57].”
Succinct survey measures of web-use skills
Hargittai, E., & Hsieh, Y. P. (2012) · Social Science Computer Review · doi:10.1177/0894439310397146 · Cited by 288
The Role of Health Anxiety in Online Health Information Search
Baumgartner, S. E., & Hartmann, T. (2011) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2010.0425 · Cited by 264
e-Health Research and Patient-Centered Care
Atienza, A. A., Hesse, B. W., Gustafson, D. H., & Croyle, R. T. (2010) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2009.10.027 · Cited by 33
Research works printed but not linked: 65
- Brown, N, 2004, New medical technologies and society: reordering life
- 10.1089/cpb.2007.9986 · DOI · Paper page
- 10.1080/10810730.2011.606071 · doi:10.1080/10810730.2011.606071
- 10.1016/j.ijmedinf.2011.03.001 · DOI
- 10.1080/10810730.2011.601967 · DOI
- 10.1016/j.ijmedinf.2010.04.004 · DOI
- 10.1016/j.pec.2012.09.006 · DOI · Paper page
- Dutta-Bergman, M, 2006, The internet and health care: theory, research, and practice, 83
- 10.1016/S0140-6736(08)60875-2 · DOI · Paper page
- Seckin, G, 2016, Emotions, technology, and health, 41, 10.1016/B978-0-12-801737-1.00003-2 · DOI
- 10.2196/jmir.2499 · DOI
- 10.1016/j.soncn.2011.04.002 · DOI
- Seidman, J, 2006, The Internet and Health Care. Theory, Research, and Practice. Mahwah, New Jersey: Lawrence-Erlbaum Associates.. ISBN, 195
- 10.1016/j.socscimed.2010.10.017 · DOI · Paper page
- 10.1016/j.chb.2009.05.011 · DOI
- 10.2196/med20.3213 · DOI
- 10.1016/j.soncn.2011.04.008 · DOI
- Bickmore, Tw, 2013, J Health Commun. (Suppl. 3), 17, 23, 10.1080/10810730.2012.712626 · DOI · Paper page
- 2015, Health literacy and consumer-facing technology: Workshop summary
- Seçkin, G, 2015, The Encyclopedia of Mobile Phone Behavior, 898, 10.4018/978-1-4666-8239-9.ch073 · DOI
- 10.1080/10810730.2011.604392 · DOI · Paper page
- 10.1186/s12889-015-1551-6 · DOI
- 10.1186/1471-2458-12-80 · DOI · Paper page
- 10.1080/10810730.2010.499995 · DOI
- 10.1080/10810730.2012.712615 · DOI · Paper page
- 10.1080/10810730.2014.943377 · DOI · Paper page
- 10.1080/10810730.2013.829538 · DOI · Paper page
- 10.1080/10810730.2011.604380 · DOI
- 10.2196/jmir.3992 · DOI · Paper page
- Zarcadoolas, C, 2006, Advancing health literacy: A framework for understanding and action
- 10.1080/10810730.2014.954083 · DOI
- Coleman, C, 2008, The Calgary Charter on Health Literacy: Rationale and Core Principles for the Development of Health Literacy Curricula
- 10.2196/jmir.2035 · DOI · Paper page
- Norgaard, O, 2015, Know Man E-Learn, 7, 522
- 10.1080/10810730.2011.571345 · DOI
- Murero, M, 2006, The internet and health care: theory, research, and practice, 29
- 10.1016/j.jclinepi.2010.04.005 · DOI · Paper page
- Chew, LD, 2004, Fam Med, 36, 588
- 10.1186/1471-2296-15-18 · DOI · Paper page
- 10.1080/15398285.2013.812914 · DOI
- Murphy, P, 1993, J Reading, 37, 124
- Karnoe, A, 2015, Know Manage E-Learn, 7, 576
- 10.1186/1471-2458-13-658 · DOI · Paper page
- 10.1080/10810730.2013.825665 · DOI
- Hair, J, 2006, Multivriate Data Analysis
- 10.2466/PR0.105.F.1103-1112 · DOI
- Spector, P, 1992, Summated rating scale construction, 10.4135/9781412986038 · DOI · Paper page
- 10.2337/dc07-1932 · DOI · Paper page
- 2001, A report on the quality of health information on the Internet
- 10.1177/089443930202000309 · DOI · Paper page
- 10.1177/0093650209351512 · DOI · Paper page
- 10.1089/cpb.2007.0172 · DOI
- Vanderminden, J, 2010, The New Blackwell Companion to Medical Sociology, 355
- Morahan-Martin, JM, 2004, Cyberpsychol Behav, 7, 497, 10.1089/cpb.2004.7.497 · doi:10.1089/cpb.2004.7.497 · Paper page
- Murero, M, 2006, The internet and health care: theory, research, and practice, 127
- 10.2196/jmir.5.4.e33 · DOI · Paper page
- 10.1093/her/cyl062 · DOI · Paper page
- 10.1007/s00520-011-1249-y · DOI
- Todman, J, 2007, An Introduction for Psychology
- Kenny, D, 2006, Dyadic Data Analysis (Methodology In The Social Sciences)
- 10.1080/10810730.2010.499985 · DOI · Paper page
- 2010, National Action Plan to Improve Health Literacy
- 10.1097/01.NOR.0000345852.22122.d6 · DOI · Paper page
- Murero, M, 2006, Theory, research, and practice
- 10.2196/jmir.2934 · DOI · Paper page
Cited by
van der Vaart, R., & Drossaert, C. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6709 · Cited by 687
Digital literacy as a new determinant of health: A scoping review
Arias López, M. D. P., Ong, B. A., Borrat Frigola, X., Fernández, A. L., Hicklent, R. S., Obeles, A. J. T., Rocimo, A. M., & Celi, L. A. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000279 · Cited by 422
“Twelve of the twenty assessment tools identified are available in English, five in Chinese, three in Danish, four in Korean, two in Vietnamese, and two in Spanish.”
BackgroundInfluentialSocial Media Use and Access to Digital Technology in US Young Adults in 2016
Villanti, A. C., Johnson, A. L., Ilakkuvan, V., Jacobs, M. A., Graham, A. L., & Rath, J. M. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7303 · Cited by 275
Liu, S., Zhao, H., Fu, J., Kong, D., Zhong, Z., Hong, Y., Tan, J., & Luo, Y. (2022) · BMC Public Health · doi:10.1186/s12889-022-13378-4 · Cited by 133
Bittlingmayer, U. H., Dadaczynski, K., Sahrai, D., van den Broucke, S., & Okan, O. (2020) · Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz · doi:10.1007/s00103-019-03087-6 · Cited by 103
Metadata
- Authors
- Seçkin, G., Yeatts, D., Hughes, S., Hudson, C., & Bell, V.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2016-07-11
- Volume
- 18
- Issue
- 7
- Pages
- e161
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W2466851860
- Cited by
- 133
- References
- 10
- FWCI
- 19.77
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.