eHealth literacy and web-based health information-seeking behaviors on COVID-19 in Japan: Internet-based mixed methods study
Open accessPublished version of a preprint
Abstract
Background: During the COVID-19 pandemic, much misinformation and disinformation emerged and spread rapidly via the internet, posing a severe public health challenge. While the need for eHealth literacy (eHL) has been emphasized, few studies have compared the difficulties involved in seeking and using COVID-19 information between adult internet users with low or high eHL. Objective: This study examines the association between eHL and web-based health information–seeking behaviors among adult Japanese internet users. Moreover, this study qualitatively shed light on the difficulties encountered in seeking and using this information and examined its relationship with eHL. Methods: This cross-sectional internet-based survey (October 2021) collected data from 6000 adult internet users who were equally divided into sample groups by gender, age, and income. We used the Japanese version of the eHL Scale (eHEALS). We also used a Digital Health Literacy Instrument (DHLI) adapted to the COVID-19 pandemic to assess eHL after we translated it to Japanese. Web-based health information–seeking behaviors were assessed by using a 10-item list of web sources and evaluating 10 topics participants searched for regarding COVID-19. Sociodemographic and other factors (eg, health-related behavior) were selected as covariates. Furthermore, we qualitatively explored the difficulties in information seeking and using. The descriptive contents of the responses regarding difficulties in seeking and using COVID-19 information were analyzed using an inductive qualitative content analysis approach. Results: Participants with high eHEALS and DHLI scores on information searching, adding self-generated information, evaluating reliability, determining relevance, and operational skills were more likely to use all web sources of information about COVID-19 than those with low scores. However, there were negative associations between navigation skills and privacy protection scores when using several information sources, such as YouTube (Google LLC), to search for COVID-19 information. While half of the participants reported no difficulty seeking and using COVID-19 information, participants who reported any difficulties, including information discernment, incomprehensible information, information overload, and disinformation, had lower DHLI score. Participants expressed significant concerns regarding “information quality and credibility,” “abundance and shortage of relevant information,” “public trust and skepticism,” and “credibility of COVID-19–related information.” Additionally, they disclosed more specific concerns, including “privacy and security concerns,” “information retrieval challenges,” “anxieties and panic,” and “movement restriction.” Conclusions: Although Japanese internet users with higher eHEALS and total DHLI scores were more actively using various web sources for COVID-19 information, those with high navigation skills and privacy protection used web-based information about COVID-19 cautiously compared with those with lower proficiency. The study also highlighted an increased need for information discernment when using social networking sites in the “Health 2.0” era. The identified categories and themes from the qualitative content analysis, such as “information quality and credibility,” suggest a framework for addressing the myriad challenges anticipated in future infodemics.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The mean score for the "protecting privacy" subscale (3.04) was somewhat lower than those reported in previous studies conducted with the general population (3.58, 3.31, and 3.52).
“However, the mean score for this subscale (3.04) was somewhat lower than those reported in previous studies conducted with the general population (3.58, 3.31, and 3.52 in previous studies) (Mitsutake et al., 2024; Miyawaki et al., 2024; van der Vaart & Drossaert, 2017).”
From Digital health literacy and trust in health information sources: A comparative study of university students in Japan, the United States, and India (2025) · cites this paper as Mitsutake et al., 2024
Table 2 in the Results reports a mean privacy-protection score of 3.42 for this study’s participants, which is higher than the citing paper’s 3.04. It does not support attributing any of the stated comparison scores (3.58, 3.31, or 3.52) to Mitsutake et al.; the other cited studies cannot be judged from this source. (LLM, conf=0.85)
Experimental — accuracy not yet measuredPrevious studies suggested that those with higher digital health literacy were more likely to use reliable information sources such as websites of public institutions.
“Previous studies suggested that those with higher digital health literacy were more likely to use reliable information sources such as websites of public institutions (Bak et al., 2022; Htay et al., 2022; Mitsutake et al., 2024; Vrdelja et al., 2021).”
From Digital health literacy and trust in health information sources: A comparative study of university students in Japan, the United States, and India (2025) · cites this paper as Mitsutake et al., 2024
Japanese students' DHLI scores were generally lower than those reported in previous studies with the Japanese general population.
“Given that the DHLI scores for Japanese students were generally lower than those reported in previous studies with the Japanese general population (Mitsutake et al., 2024; Miyawaki et al., 2024), educational programs to improve students' ability to utilize health information online might be essential in the university curriculum.”
From Digital health literacy and trust in health information sources: A comparative study of university students in Japan, the United States, and India (2025) · cites this paper as Mitsutake et al., 2024
Those with higher digital health literacy use more reliable online information sources such as websites of public agencies.
“This is consistent with previous reports indicating that those with higher digital health literacy use more reliable online information sources such as websites of public agencies (Bak et al., 2022; Htay et al., 2022; Mitsutake et al., 2024; Vrdelja et al., 2021).”
From Digital health literacy and trust in health information sources: A comparative study of university students in Japan, the United States, and India (2025) · cites this paper as Mitsutake et al., 2024
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The qualitative content analysis process
Elo, S., & Kyngäs, H. (2008) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2007.04569.x · Cited by 22,617 · cited 1× · see citing works
“The contents were inductively organized into codes and categories to achieve trustworthiness [29].”
eHEALS: The eHealth Literacy Scale
Norman, C. D., & Skinner, H. A. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.4.e27 · Cited by 2,680 · see citing works
Zarocostas, J. (2020) · The Lancet · doi:10.1016/s0140-6736(20)30461-x · Cited by 2,344 · see citing works
Understanding and Responding to Health Literacy as a Social Determinant of Health
Nutbeam, D., & Lloyd, J. E. (2021) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-090419-102529 · Cited by 1,178 · see citing works
Psychological inoculation improves resilience against misinformation on social media
Roozenbeek, J., van der Linden, S., Goldberg, B., Rathje, S., & Lewandowsky, S. (2022) · Science Advances · doi:10.1126/sciadv.abo6254 · Cited by 472 · see citing works
Definition of Health 2.0 and Medicine 2.0: A Systematic Review
Van De Belt, T. H., Engelen, L. J., Berben, S. A., & Schoonhoven, L. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1350 · Cited by 351 · see citing works
Takahashi, Y., Uchida, C., Miyaki, K., Sakai, M., Shimbo, T., & Nakayama, T. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1142 · Cited by 129 · cited 1× · see citing works
“Descriptive responses regarding difficulties in seeking and using COVID-19 information were analyzed using the inductive qualitative content analysis approach [28-30].”
Self-citationVrdelja, M., Vrbovšek, S., Klopčič, V., Dadaczynski, K., & Okan, O. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18168507 · Cited by 90 · see citing works
Self-citationHtay, M. N. N., Parial, L. L., Tolabing, M. C., Dadaczynski, K., Okan, O., Leung, A. Y. M., & Su, T. T. (2022) · PLOS ONE · doi:10.1371/journal.pone.0266276 · Cited by 78 · see citing works
Self-citationAdebesin, F., Smuts, H., Mawela, T., Maramba, G., & Hattingh, M. (2023) · JMIR Infodemiology · doi:10.2196/48620 · Cited by 57 · see citing works
Flagged first, then by citations
Research works printed but not linked: 29
- [4]Mitsutake S Takahashi Y Otsuki A Umezawa J Yaguchi-Saito A Saito J Fujimori M Shimazu T Chronic diseases and sociodemographic characteristics associated with online health information seeking and using social networking sites: nationally representative cross-sectional survey in Japan J Med Internet Res 2023 03 02 25 e44741 10.2196/44741 36862482 v25i1e44741 36862482 PMC10020913 · DOI
- [5]Berland GK Elliott MN Morales LS Algazy JI Kravitz RL Broder MS Kanouse DE Muñoz JA Puyol J Lara M Watkins KE Yang H McGlynn EA Health information on the internet: accessibility, quality, and readability in English and Spanish JAMA 2001 05 23 285 20 2612 21 10.1001/jama.285.20.2612 11368735 joc02274 11368735 PMC4182102 · DOI
- [6]Charow R Snow M Fathima S Giuliani ME McEwan K Winegust J Papadakos J Evaluation of the scope, quality, and health literacy demand of internet-based anal cancer information J Med Libr Assoc 2019 10 01 107 4 527 37 10.5195/jmla.2019.393 31607810 jmla-107-527 31607810 PMC6774557 · DOI
- [7]Fefer M Lamb CC Shen AH Clardy P Muralidhar V Devlin PM Dee EC Multilingual analysis of the quality and readability of online health information on the adverse effects of breast cancer treatments JAMA Surg 2020 08 01 155 8 781 4 10.1001/jamasurg.2020.1668 32520317 2767226 32520317 PMC7287949 · DOI
- [11]Paakkari L Okan O COVID-19: health literacy is an underestimated problem Lancet Public Health 2020 05 5 5 e249 50 10.1016/S2468-2667(20)30086-4 32302535 S2468-2667(20)30086-4 32302535 PMC7156243 · DOI · Paper page
- [12]Okan O Bollweg TM Berens EM Hurrelmann K Bauer U Schaeffer D Coronavirus-related health literacy: a cross-sectional study in adults during the COVID-19 infodemic in Germany Int J Environ Res Public Health 2020 07 30 17 15 5503 10.3390/ijerph17155503 32751484 ijerph17155503 32751484 PMC7432052 · DOI · Paper page
- [14]Bak CK Krammer JØ Dadaczynski K Orkan O von Seelen J Prinds C Søbjerg LM Klakk H Digital health literacy and information-seeking behavior among university college students during the COVID-19 pandemic: a cross-sectional study from Denmark Int J Environ Res Public Health 2022 03 19 19 6 3676 10.3390/ijerph19063676 35329363 ijerph19063676 35329363 PMC8955471 · DOI · Paper page
- [15]Dadaczynski K Okan O Messer M Leung AY Rosário R Darlington E Rathmann K Digital health literacy and web-based information-seeking behaviors of university students in Germany during the COVID-19 pandemic: cross-sectional survey study J Med Internet Res 2021 01 15 23 1 e24097 10.2196/24097 33395396 v23i1e24097 33395396 PMC7813561 · DOI · Paper page
- [16]Rosário R Martins MR Augusto C Silva MJ Martins S Duarte A Fronteira I Ramos N Okan O Dadaczynski K Associations between COVID-19-related digital health literacy and online information-seeking behavior among Portuguese university students Int J Environ Res Public Health 2020 12 02 17 23 8987 10.3390/ijerph17238987 33276647 ijerph17238987 33276647 PMC7730120 · DOI · Paper page
- [19]Assaye BT Kassa M Belachew M Birhanu S Worku A Association of digital health literacy and information-seeking behaviors among physicians during COVID-19 in Ethiopia: a cross-sectional study Digit Health 2023 06 04 9 20552076231180436 10.1177/20552076231180436 37312956 10.1177_20552076231180436 37312956 PMC10259119 · DOI
- [20]Mitsutake S Shibata A Ishii K Okazaki K Oka K [Developing Japanese version of the eHealth literacy scale (eHEALS)] Nihon Koshu Eisei Zasshi 2011 05 58 5 361 71 21905612 21905612
- [22]van der Vaart R Drossaert C Development of the digital health literacy instrument: measuring a broad spectrum of health 1.0 and health 2.0 skills J Med Internet Res 2017 01 24 19 1 e27 10.2196/jmir.6709 28119275 v19i1e27 28119275 PMC5358017 · DOI · Paper page
- [23]Arias López MD Ong BA Borrat Frigola X Fernández AL Hicklent RS Obeles AJ Rocimo AM Celi LA Digital literacy as a new determinant of health: a scoping review PLOS Digit Health 2023 10 2 10 e0000279 10.1371/journal.pdig.0000279 37824584 PDIG-D-22-00373 37824584 PMC10569540 · DOI · Paper page
- [24]Miyawaki R Kato M Kawamura Y Ishikawa H Oka K [Developing a Japanese version of the Digital Health Literacy Instrument] Nihon Koshu Eisei Zasshi 2024 01 26 71 1 3 14 10.11236/jph.23-021 10.11236/jph.23-021 37673595 37673595 · DOI
- [26]Creswell JW Plano Clark VL Gutmann ML Hanson WE Tashakkori A Teddlie C Advanced mixed methods research designs Handbook of Mixed Methods in Social and Behavioral Research 2003 Thousand Oaks, CA SAGE Publications 209 40
- [27]Curry L Nunez-Smith M Mixed Methods in Health Sciences Research: A Practical Primer 2015 Thousand Oaks, CA SAGE Publications
- [30]Graneheim UH Lundman B Qualitative content analysis in nursing research: concepts, procedures and measures to achieve trustworthiness Nurse Educ Today 2004 02 24 2 105 12 10.1016/j.nedt.2003.10.001 14769454 S0260691703001515 14769454 · DOI · Paper page
- [31]Inoue M Shimoura K Nagai-Tanima M Aoyama T The relationship between information sources, health literacy, and COVID-19 knowledge in the COVID-19 infodemic: cross-sectional online study in Japan J Med Internet Res 2022 07 22 24 7 e38332 10.2196/38332 35839380 v24i7e38332 35839380 PMC9311384 · DOI
- [33]Norman C eHealth literacy 2.0: problems and opportunities with an evolving concept J Med Internet Res 2011 12 23 13 4 e125 10.2196/jmir.2035 22193243 v13i4e125 22193243 PMC3278111 · DOI
- [36]Lu C Hu B Li Q Bi C Ju XD Psychological inoculation for credibility assessment, sharing intention, and discernment of misinformation: systematic review and meta-analysis J Med Internet Res 2023 08 29 25 e49255 10.2196/49255 37560816 v25i1e49255 37560816 PMC10498317 · DOI
- [37]Nutbeam D From health education to digital health literacy - building on the past to shape the future Glob Health Promot 2021 12 28 4 51 5 10.1177/17579759211044079 34719292 34719292 · DOI
- [38]Robillard JM Jun JH Lai JA Feng TL The QUEST for quality online health information: validation of a short quantitative tool BMC Med Inform Decis Mak 2018 10 19 18 1 87 10.1186/s12911-018-0668-9 30340488 10.1186/s12911-018-0668-9 30340488 PMC6194721 · DOI
- [39]Denniss E Lindberg R McNaughton SA Development of principles for health-related information on social media: Delphi study J Med Internet Res 2022 09 08 24 9 e37337 10.2196/37337 36074544 v24i9e37337 36074544 PMC9501680 · DOI
- [40]Kington RS Arnesen S Chou WY Curry SJ Lazer D Villarruel AM Identifying credible sources of health information in social media: principles and attributes NAM Perspect 2021 2021 10.31478/202107a 10.31478/202107a 34611600 202107a PMC8486420 34611600 · DOI
- [41]Graham G Goren N Sounderajah V DeSalvo K Information is a determinant of health Nat Med 2024 04 30 4 927 8 10.1038/s41591-023-02792-9 38351186 10.1038/s41591-023-02792-9 38351186 · DOI
- [42]Eysenbach G Wyatt J Using the internet for surveys and health research J Med Internet Res 2002 4 2 E13 10.2196/jmir.4.2.e13 12554560 12554560 PMC1761932 · DOI · Paper page
- [43]Mitsutake S Shibata A Ishii K Oka K Association of eHealth literacy with colorectal cancer knowledge and screening practice among internet users in Japan J Med Internet Res 2012 11 13 14 6 e153 10.2196/jmir.1927 23149453 v14i6e153 23149453 PMC3510729 · DOI
- [44]Mitsutake S Shibata A Ishii K Oka K Associations of eHealth literacy with health behavior among adult internet J Med Internet Res 2016 07 18 18 7 e192 10.2196/jmir.5413 27432783 v18i7e192 27432783 PMC4969548 · DOI
- [45]Neter E Brainin E Perceived and performed eHealth literacy: survey and simulated performance test JMIR Hum Factors 2017 01 17 4 1 e2 10.2196/humanfactors.6523 28096068 v4i1e2 28096068 PMC5285606 · DOI
Cited by
Sorted by citations
Ishikawa, H., Miyawaki, R., Kato, M., Muilenburg, J. L., Tomar, Y. A., & Kawamura, Y. (2025) · SSM - Population Health · doi:10.1016/j.ssmph.2025.101844 · Cited by 17 · see citing works
- Authors
- Mitsutake, S., Oka, K., Okan, O., Dadaczynski, K., Ishizaki, T., Nakayama, T., & Takahashi, Y.
- Affiliations
- Tokyo Metropolitan Institute of Gerontology (JP)
- Waseda University (JP)
- Technical University of Munich (DE)
- Leuphana University of Lüneburg (DE)
- Kyoto University (JP)
- Corresponding author
- Mitsutake, Seigo
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2024-07-11
- Volume
- 26
- Pages
- e57842
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC11273073
- OpenAlex
- W4399117469
- Cited by
- 16
- References
- 10
- Citations by year
- 2026: 10 · 2025: 6
- FWCI
- 7.61
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Institutional Repositories DataBase (IRDB) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- mediaTUM (Technical University of Munich) (submittedVersion)
- Multilingual Matters (Channel View Publications) (submittedVersion, cc-by)
- Kyoto University Research Information Repository (Kyoto University) (submittedVersion, cc-by)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Social Sciences › Education › E-Learning and COVID-19
- Keywords
- digital health literacy, COVID-19 pandemic, health information seeking, online information sources, disinformation, information overload, information discernment, information credibility, privacy concerns, eHealth Literacy Scale, YouTube, mobility restrictions, social media misinformation
- MeSH terms
- COVID-19, SARS-CoV-2, Adult, Aged, Cross-Sectional Studies, Female, Humans, Japan, Male, Middle Aged, Surveys and Questionnaires, Telemedicine, Internet, Consumer Health Information, Young Adult, Health Literacy, Information Seeking Behavior, Pandemics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review