Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.

An objective analysis of quality and readability of online information on COVID-19

Open access
Wrigley Kelly, N. E., Murray, K. E., McCarthy, C., O’Shea, D. B. · 2021 · Health and Technology

Abstract

High quality, readable health information is vital to mitigate the impact of the COVID-19 pandemic. The aim of this study was to assess the quality and readability of online COVID-19 information using 6 validated tools. This is a cross-sectional study. “COVID-19” was searched across the three most popular English language search engines. Quality was evaluated using the DISCERN score, Journal of the American Medical Association benchmark criteria and Health On the Net Foundation Code of Conduct. Readability was assessed using the Flesch Reading Ease Score, Flesch-Kincaid Grade Level and Gunning-Fog Index. 41 websites were suitable for analysis. 9.8% fulfilled all JAMA criteria. Only one website was HONCode certified. Mean DISCERN score was 47.8/80 (“fair”). This was highest in websites published by a professional society/medical journal/healthcare provider. Readability varied from an 8th to 12th grade level. The overall quality of online COVID-19 information was “fair”. Much of this information was above the recommended 5th to 6th grade level, impeding access for many.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s12553-021-00574-2

Cites

32 of 32 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 1 Internet search strategy for COVID-19 search term
Fig. 1 Internet search strategy for COVID-19 search termCC BY · PubMed Central
Fig. 2 Mean GFI (Gunning-Fog Index) (range 0–20) according to website producer organisation type. Individual values are shown with mean represented by bar. ns = Not significant, * = p < 0.05. GO = Governmental organisation, NGO = Non-governmental organisation, FPO = for profit organisation, PMH = professional society/medical journal/healthcare provider
Fig. 2 Mean GFI (Gunning-Fog Index) (range 0–20) according to website producer organisation type. Individual values are shown with mean represented by bar. ns = Not significant, * = p < 0.05. GO = Governmental organisation, NGO = Non-governmental organisation, FPO = for profit organisation, PMH = professional society/medical journal/healthcare providerCC BY · PubMed Central
Fig. 3 DISCERN score (range 16–80) by type of website producer. Individual values are shown with mean represented by bar. * = p < 0.05, ** = p < 0.001 GO = Governmental organisation, NGO = Non-governmental organisation, FPO = for profit organisation, PMH = professional society/medical journal/healthcare provider
Fig. 3 DISCERN score (range 16–80) by type of website producer. Individual values are shown with mean represented by bar. * = p < 0.05, ** = p < 0.001 GO = Governmental organisation, NGO = Non-governmental organisation, FPO = for profit organisation, PMH = professional society/medical journal/healthcare providerCC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 31 references

Research works printed but not linked: 3

  1. Silberg WM. Assessing, Controlling, and Assuring the Quality of Medical Information on the Internet. Jama. 1997;277(15). · DOI · Paper page
  2. Janan D, Wray D. Readability: The limitations of an approach through formulae. in British Educational Research Association Annual Conference. 2012. University of Manchester: Education Line.
  3. Communicating risk in public health emergencies. a WHO guideline for emergency risk communication (ERC) policy and practice. Geneva: World Health Organization; 2017.

Cited by

See all 77

Metadata

Authors
Wrigley Kelly, N. E., Murray, K. E., McCarthy, C., & O’Shea, D. B.
Affiliations
University College Dublin (IE)
Venue
Health and Technology
Published
2021-06-24
Volume
11
Issue
5
Pages
1093-1099
ISSN
  • 2190-7188 (ISSN-L)
  • 2190-7196
OpenAlex
W3174777258
Cited by
69
References
31
Citations by year
2026: 11 · 2025: 15 · 2024: 16 · 2023: 15 · 2022: 10 · 2021: 2
FWCI
12.08
Type
journal article
Language
en
Open access
Licence
Locations
  • Health and Technology (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Lenus, The Irish Health Repository (Dr Steevens Hospital Library) (submittedVersion, cc-by)
Funders
University College Dublin
Topics
  • Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
  • Social Sciences › Health › Social Media in Health Education
  • Social Sciences › Communication › Communication and COVID-19 Impact
Keywords
COVID-19 pandemic, online health information, information quality, readability, health websites, DISCERN, HONcode, JAMA benchmark criteria, Flesch-Kincaid Grade Level, Gunning Fog Index, health literacy, search engine results

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: An objective analysis of quality and readability of online information on COVID-19. https://app.cochat.ai/papers/10.1007/s12553-021-00574-2
The paper
Wrigley Kelly, N. E., Murray, K. E., McCarthy, C., & O’Shea, D. B. (2021). An objective analysis of quality and readability of online information on COVID-19. Health and Technology. https://doi.org/10.1007/s12553-021-00574-2

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.