Effects of objective and subjective health literacy on patients' accurate judgment of health information and decision-making ability: survey study
Open accessPublished version of a preprint
The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
Background: Interpreting health information and acquiring health knowledge have become more important with the accumulation of scientific medical knowledge and ideals of patient autonomy. Health literacy and its tremendous success as a concept can be considered an admission that not all is well in the distribution of health knowledge. The internet makes health information much more easily accessible than ever, but it introduces its own problems, of which health disinformation is a major one. Objective: The objective of this study was to determine whether objective and subjective health literacy are independent concepts and to test which of the two was associated more strongly with accurate judgments of the quality of a medical website and with behavioral intentions beneficial to health. Methods: A survey on depression and its treatments was conducted online (n=362). The Newest Vital Sign was employed to measure objective, performance-based health literacy, and the eHealth Literacy Scale was used to measure subjective, perception-based health literacy. Correlations, comparisons of means, linear and binary logistic regression, and mediation models were used to determine the associations. Results: Objective and subjective health literacy were weakly associated with one another (r=0.06, P=.24). High objective health literacy levels were associated with an inclination to behave in ways that are beneficial to one’s own or others’ health (Exp[B]=2.068, P=.004) and an ability to recognize low-quality online sources of health information (β=–.4698, P=.005). The recognition also improved participants’ choice of treatment (β=–.3345, P<.001). Objective health literacy helped people to recognize misinformation on health websites and improved their judgment on their treatment for depression. Conclusions: Self-reported, perception-based health literacy should be treated as a separate concept from objective, performance-based health literacy. Only objective health literacy appears to have the potential to prevent people from becoming victims of health disinformation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Schulz and colleagues documented only a weak correlation (r = 0.06) between perception-based and performance-based health literacy, and concluded that self-rated assessments should not be used as proxies for actual competence (73).”
From Health misinformation, digital health literacy, and attitudes toward science among university students: an exploratory cross-sectional survey (2026) · cites this paper as [73]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971 · cited 1×
“4 software [46] to determine the sample size (with α=.”
(2013) · Cited by 44,563
The Need for a New Medical Model: A Challenge for Biomedicine
Engel, G. L. (1977) · Science · doi:10.1126/science.847460 · Cited by 12,887
Health literacy and public health: A systematic review and integration of definitions and models
Sørensen, K., Van den Broucke, S., Fullam, J., Doyle, G., Pelikan, J., Slonska, Z., Brand, H., & (HLS-EU) Consortium Health Literacy Project European (2012) · BMC Public Health · doi:10.1186/1471-2458-12-80 · Cited by 6,213
Nutbeam, D. (2000) · Health Promotion International · doi:10.1093/heapro/15.3.259 · Cited by 5,286 · cited 1×
“Patients’ knowledge of health matters and their capacity to acquire such knowledge have recently become more important than ever [1].”
Beyond Accuracy: What Data Quality Means to Data Consumers
Wang, R. Y., & Strong, D. M. (1996) · Journal of Management Information Systems · doi:10.1080/07421222.1996.11518099 · Cited by 4,672 · cited 1×
“Participants’ perceptions of information quality were assessed using 7-step semantic differential scales [30,45].”
Charnock, D., Shepperd, S., Needham, G., & Gann, R. (1999) · Journal of Epidemiology and Community Health · doi:10.1136/jech.53.2.105 · Cited by 3,329 · cited 1×
“However, in the future, better selection criteria could be established by reviewing the main Italian information websites about depression using appropriate tools, such as DISCERN [50].”
The evolving concept of health literacy
Nutbeam, D. (2008) · Social Science & Medicine · doi:10.1016/j.socscimed.2008.09.050 · Cited by 2,944 · cited 3×
“In addition to knowledge, functional reading and writing abilities, adequate information processing, critical thinking skills, and the capability to make decisions that are beneficial to one’s health [5] are all elements of health literacy.”
eHEALS: The eHealth Literacy Scale
Norman, C. D., & Skinner, H. A. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.4.e27 · Cited by 2,680 · cited 2×
“Self-reported health literacy was measured using the eHealth Literacy Scale (eHEALS) [14,39].”
eHealth Literacy: Essential Skills for Consumer Health in a Networked World.
Norman, C. D., & Skinner, H. A. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.2.e9 · Cited by 2,643 · cited 1×
“Online health literacy, or eHealth literacy, refers to “the ability to seek out, find, evaluate and appraise, integrate, and apply what is gained in electronic environments toward solving a health problem” [40].”
Four Models of the Physician-Patient Relationship
Emanuel, E. J. (1992) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1992.03480160079038 · Cited by 2,449
Doctor-patient communication: a review of the literature
Ong, L. M. L., de Haes, J. C. J. M., Hoos, A. M., & Lammes, F. B. (1995) · Social Science & Medicine · doi:10.1016/0277-9536(94)00155-m · Cited by 2,430 · cited 2×
“Other autonomy concepts include the expert patient, shared decision making, and patient-centered health care [4].”
Parker, R. M., Baker, D. W., Williams, M. V., & Nurss, J. R. (1995) · Journal of General Internal Medicine · doi:10.1007/bf02640361 · Cited by 2,023
General Performance on a Numeracy Scale among Highly Educated Samples
Lipkus, I. M., Samsa, G., & Rimer, B. K. (2001) · Medical Decision Making · doi:10.1177/0272989x0102100105 · Cited by 1,497 · cited 1×
“Most commonly, the objective, performance-based measures require individuals to demonstrate their knowledge and familiarity regarding medical terms (eg, Rapid Estimate of Adult Literacy in Medicine [REALM] [16]) or their understanding of sentences by their ability to fill in gaps within them (eg, Test of Functional He…”
Sørensen, K., Van den Broucke, S., Pelikan, J. M., Fullam, J., Doyle, G., Slonska, Z., Kondilis, B., Stoffels, V., Osborne, R. H., & Brand, H. (2013) · BMC Public Health · doi:10.1186/1471-2458-13-948 · Cited by 1,241 · cited 1×
“Most commonly, the objective, performance-based measures require individuals to demonstrate their knowledge and familiarity regarding medical terms (eg, Rapid Estimate of Adult Literacy in Medicine [REALM] [16]) or their understanding of sentences by their ability to fill in gaps within them (eg, Test of Functional He…”
Diviani, N., van den Putte, B., Giani, S., & van Weert, J. C. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4018 · Cited by 638 · cited 2×
“Participants’ perceptions of information quality were assessed using 7-step semantic differential scales [30,45].”
Schulz, P. J., & Nakamoto, K. (2013) · Patient Education and Counseling · doi:10.1016/j.pec.2012.09.006 · Cited by 459 · cited 5×
“Feeling empowered, indeed, was argued not to be a sufficient requisite for making good decisions [5,10].”
InfluentialSelf-citationvan der Vaart, R., van Deursen, A. J., Drossaert, C. H., Taal, E., van Dijk, J. A., & van de Laar, M. A. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1840 · Cited by 404 · cited 2×
“This result was in line with the literature supporting the inadequacy of self-reported measures to detect one’s actual health literacy level [48] and demonstrated the fact that the two measures evaluate different constructs [21,39,48,49].”
Gazmararian, J. A., Kripalani, S., Miller, M. J., Echt, K. V., Ren, J., & Rask, K. (2006) · Journal of General Internal Medicine · doi:10.1111/j.1525-1497.2006.00591.x · Cited by 351
Adolescent Cybersurfing for Health Information: A New Resource That Crosses Barriers
Borzekowski, D. L. G., & Rickert, V. I. (2001) · Archives of Pediatrics & Adolescent Medicine · doi:10.1001/archpedi.155.7.813 · Cited by 347 · cited 1×
“These variables were seldom studied together and the results were inconsistent [30-36].”
Patient health literacy and participation in the health‐care process
Ishikawa, H., & Yano, E. (2008) · Health Expectations · doi:10.1111/j.1369-7625.2008.00497.x · Cited by 326 · cited 2×
“It is something genuinely different from patients’ personal impressions that a consultation went well, that they succeeded in presenting their case, and that they understood what the doctor had to say [7].”
Bernhardt, J. M., & Felter, E. M. (2004) · Journal of Medical Internet Research · doi:10.2196/jmir.6.1.e7 · Cited by 322 · cited 1×
“These variables were seldom studied together and the results were inconsistent [30-36].”
Haun, J., Luther, S., Dodd, V., & Donaldson, P. (2012) · Journal of Health Communication · doi:10.1080/10810730.2012.712615 · Cited by 295 · cited 1×
“Haun et al [28] found no significant relationship between limited health literacy and patient self-report of having or not having hypertension, diabetes, or a past stroke after adjusting for covariates (ie, gender, race, education, self-reported reading level, retiree status, and having a functional disability).”
Zhang, Y., Sun, Y., & Xie, B. (2015) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23311 · Cited by 291 · cited 1×
“The quality of the information found online is sometimes deplorable [9], and that creates its own problems.”
Associations of eHealth Literacy With Health Behavior Among Adult Internet Users
Mitsutake, S., Shibata, A., Ishii, K., & Oka, K. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5413 · Cited by 271 · cited 1×
“Mitsutake et al [26] found mixed results.”
How Adolescents Search for and Appraise Online Health Information: A Systematic Review
Freeman, J. L., Caldwell, P. H. Y., Bennett, P. A., & Scott, K. M. (2018) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2017.11.031 · Cited by 171 · cited 1×
“Conversely, the criterion for low-quality was the emphasis on common misbeliefs about treatment [43], including the overestimation of the curative effect of natural and self-help remedies [44].”
Cancer Fatalism, Literacy, and Cancer Information Seeking in the American Public
Kobayashi, L. C., & Smith, S. G. (2015) · Health Education & Behavior · doi:10.1177/1090198115604616 · Cited by 168 · cited 1×
“People with limited health literacy were less likely to have sought cancer information and more frequently endorsed fatalistic beliefs about their decision making [24].”
van der Heide, I., Uiters, E., Rademakers, J. J. D. J. M., Struijs, J. N., Schuit, A. J., & Baan, C. A. (2014) · Journal of Health Communication · doi:10.1080/10810730.2014.936989 · Cited by 155 · cited 1×
“One study in patients with diabetes [25] found that low self-reported health literacy was associated with less diabetes knowledge, glycemic control, and physical activity.”
Kiechle, E. S., Bailey, S. C., Hedlund, L., Viera, A. J., & Sheridan, S. (2015) · Journal of General Internal Medicine · doi:10.1007/s11606-015-3288-4 · Cited by 120 · cited 3×
“A systematic review [11] found a paucity of research analyzing the relationship between objective and subjective health literacy and health outcomes.”
InfluentialWångdahl, J. M., Lytsy, P., Mårtensson, L. I., & Westerling, R. (2018) · International Journal of Public Health · doi:10.1007/s00038-017-1074-2 · Cited by 119 · cited 2×
“Wångdahl et al [27] found that refugees with limited self-reported health literacy reported worse health, impaired well-being, and fewer health care–seeking behaviors than those with high health literacy.”
Benotsch, E. G., Kalichman, S., & Weinhardt, L. S. (2004) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.72.6.1004 · Cited by 105 · cited 1×
“In a unique study by Benotsch et al [37], they found an overall positive association between low health literacy levels and wrong perceptions of information quality.”
What do Web-Use Skill Differences Imply for Online Health Information Searches?
Feufel, M. A., & Stahl, S. F. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2051 · Cited by 96 · cited 1×
“These variables were seldom studied together and the results were inconsistent [30-36].”
Use of the Internet to Obtain Cancer Information Among Cancer Patients at an Urban County Hospital
Helft, P. R., Eckles, R. E., Johnson, C. S., & Daugherty, C. K. (2005) · Journal of Clinical Oncology · doi:10.1200/jco.2005.09.621 · Cited by 95 · cited 1×
“These variables were seldom studied together and the results were inconsistent [30-36].”
Practical intelligence and tacit knowledge: Advancements in the measurement of developing expertise
Cianciolo, A. T., Grigorenko, E. L., Jarvin, L., Gil, G., Drebot, M. E., & Sternberg, R. J. (2006) · Learning and Individual Differences · doi:10.1016/j.lindif.2006.04.002 · Cited by 78 · cited 2×
“knowledge [20], goes back to the idea that people react primarily not to objective states but to their perception of those states.”
Diviani, N., Dima, A. L., & Schulz, P. J. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6749 · Cited by 78 · cited 2×
“Self-reported health literacy was measured using the eHealth Literacy Scale (eHEALS) [14,39].”
Self-citationThe State of the Science of Health Literacy Measurement.
Nguyen, T. H., Paasche‐Orlow, M. K., & Mccormack, L. A. (2017) · PubMed · Cited by 78
Patients and medical statistics. Interest, confidence, and ability.
Woloshin, S., Schwartz, L. M., & Welch, H. G. (2005) · PubMed · doi:10.1111/j.1525-1497.2005.00179.x · Cited by 56 · cited 1×
“Most commonly, the objective, performance-based measures require individuals to demonstrate their knowledge and familiarity regarding medical terms (eg, Rapid Estimate of Adult Literacy in Medicine [REALM] [16]) or their understanding of sentences by their ability to fill in gaps within them (eg, Test of Functional He…”
Use of the internet for health information: A study of Australians and New Zealanders
Gauld, R., & Williams, S. (2009) · Informatics for Health and Social Care · doi:10.1080/17538150903102448 · Cited by 54 · cited 1×
“These variables were seldom studied together and the results were inconsistent [30-36].”
Smith, S. G., Curtis, L. M., O’Conor, R. M., Federman, A. D., & Wolf, M. S. (2015) · Patient Education and Counseling · doi:10.1016/j.pec.2015.04.007 · Cited by 47 · cited 1×
“One study [22], for example, demonstrated that performance-based numeracy and literacy, considered together, predicted skills to perform health tasks among older adults.”
Hirsh, J. M., Boyle, D. J., Collier, D. H., Oxenfeld, A. J., Nash, A., Quinzanos, I., & Caplan, L. (2011) · JCR Journal of Clinical Rheumatology · doi:10.1097/rhu.0b013e318226a01f · Cited by 46 · cited 2×
“Interpreting self-confidence as health literacy does not suffice; the more consequential performance-based level of health literacy counts more [21,29,48,49], especially in terms of making accurate judgments of health information.”
The Evolving Field of Health Literacy Research
Paasche‐Orlow, M. K., Wilson, E., & Mccormack, L. A. (2010) · Journal of Health Communication · doi:10.1080/10810730.2010.499995 · Cited by 45 · cited 1×
“Due to its extraordinary potential of overcoming traditional limitations to information finding, the internet is today a primary focus of health literacy research [8].”
Gerich, J., & Moosbrugger, R. (2016) · Health Communication · doi:10.1080/10410236.2016.1255846 · Cited by 42
Capecchi, L., Guazzini, A., Lorini, C., Santomauro, F., & Bonaccorsi, G. (2015) · PubMed · Cited by 31
Mantwill, S., Allam, A., Camerini, A.-L., & Schulz, P. J. (2018) · Journal of Health Communication · doi:10.1080/10810730.2017.1417515 · Cited by 31 · cited 4×
“This result was in line with the literature supporting the inadequacy of self-reported measures to detect one’s actual health literacy level [48] and demonstrated the fact that the two measures evaluate different constructs [21,39,48,49].”
InfluentialSelf-citationInternet use in rheumatology outpatients in 2006: gender less important.
Jg, R., Becker, A., Koch, T., Nixdorf, M., Schacher, B., Monser, R., Specker, C., Alten, R., & Schneider, M. A. (2009) · PubMed · Cited by 25
Ideas equivocadas sobre la depresión y su tratamiento (I)
Sanz, J., & García‐Vera, M. P. (2017) · Papeles del Psicólogo - Psychologist Papers · doi:10.23923/pap.psicol2017.2833 · Cited by 5
Interaction between liposomes with different lipid composition and hepatocytesin vitro
Burkhanov, S. A., Dormeneva, E. V., Kosykh, V. A., Berdichevskii, V. R., Torchilin, V. P., Saatov, T. A., & Repin, V. S. (1985) · Bulletin of Experimental Biology and Medicine · doi:10.1007/bf00839253 · Cited by 3
[Interaction of liposomes with a varying lipid composition with hepatocytes in vitro].
Burkhanov, S. A., Dormeneva, E. V., Va, K., Vr, B., & Torchilin, V. P. (1985) · PubMed · Cited by 2
(2004) · PubMed
Research works printed but not linked: 4
- Nguyen, TH, 2017, Stud Health Technol Inform, 240, 17
- Chew, LD, 2004, Fam Med, 36, 588
- Richter, JG, 2009, Clin Exp Rheumatol, 27, 15
- Capecchi, L, 2015, Epidemiol Prev, 39, 124
Cited by
Digital Health Literacy: Bibliometric Analysis
Yang, K., Hu, Y., & Qi, H. (2022) · Journal of Medical Internet Research · doi:10.2196/35816 · Cited by 188
“Schulz’s latest research analyzes the impact of subjective and objective health literacy on patients' judgment of health information and their decision-making ability [48].”
Kanejima, Y., Shimogai, T., Kitamura, M., Ishihara, K., & Izawa, K. P. (2021) · Patient Education and Counseling · doi:10.1016/j.pec.2021.11.021 · Cited by 146
Digitization and Health in Germany: Cross-sectional Nationwide Survey
De Santis, K. K., Jahnel, T., Sina, E., Wienert, J., & Zeeb, H. (2021) · JMIR Public Health and Surveillance · doi:10.2196/32951 · Cited by 94
“Interestingly, subjective (self-reported and perception-based) estimation of eHealth literacy was not associated with accurate judgments of the quality of a medical website or behavioral intentions beneficial to health [28].”
BackgroundDigitization and Health in Germany: Cross-sectional Nationwide Survey (Preprint)
De Santis, K. K., Jahnel, T., Sina, E., Wienert, J., & Zeeb, H. (2021) · doi:10.2196/preprints.32951 · Cited by 94
Poureslami, I. M., FitzGerald, J. M., Tregobov, N., Goldstein, R. S., Lougheed, M. D., & Gupta, S. (2022) · Respiratory Research · doi:10.1186/s12931-022-02290-5 · Cited by 62
“Accurate measurement of evaluation skills could help to identify the differences between patients’ expectations and their perceptions of the services and information received [61].”
BackgroundInfluential
Metadata
- Authors
- Schulz, P. J., Pessina, A., Hartung, U., & Petrocchi, S.
- Affiliations
- Università della Svizzera italiana (CH)
- Corresponding author
- Schulz, Peter Johannes
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2021-01-21
- Volume
- 23
- Issue
- 1
- Pages
- e20457
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC7861996
- OpenAlex
- W3097466170
- Cited by
- 84
- References
- 49
- Citations by year
- 2026: 22 · 2025: 11 · 2024: 12 · 2023: 14 · 2022: 21 · 2021: 4
- FWCI
- 10.18
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- PubliCatt (Università Cattolica del Sacro Cuore) (submittedVersion, other-oa)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
- Health Sciences › Health Professions › General Health Professions › Patient-Provider Communication in Healthcare
- Social Sciences › Communication › Media Influence and Health
- Keywords
- health disinformation, online health information, eHealth Literacy Scale, Newest Vital Sign, health decision-making, health behavior intentions, patient autonomy
- MeSH terms
- Adolescent, Adult, Aged, Decision Making, Female, Humans, Male, Middle Aged, Surveys and Questionnaires, Telemedicine, Young Adult, Health Literacy, Diagnostic Self Evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.