The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
An objective analysis of quality and readability of online information on COVID-19
Open accessAbstract
High quality, readable health information is vital to mitigate the impact of the COVID-19 pandemic. The aim of this study was to assess the quality and readability of online COVID-19 information using 6 validated tools. This is a cross-sectional study. “COVID-19” was searched across the three most popular English language search engines. Quality was evaluated using the DISCERN score, Journal of the American Medical Association benchmark criteria and Health On the Net Foundation Code of Conduct. Readability was assessed using the Flesch Reading Ease Score, Flesch-Kincaid Grade Level and Gunning-Fog Index. 41 websites were suitable for analysis. 9.8% fulfilled all JAMA criteria. Only one website was HONCode certified. Mean DISCERN score was 47.8/80 (“fair”). This was highest in websites published by a professional society/medical journal/healthcare provider. Readability varied from an 8th to 12th grade level. The overall quality of online COVID-19 information was “fair”. Much of this information was above the recommended 5th to 6th grade level, impeding access for many.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“No scoring system has been widely accepted as the gold standard for evaluating the ease of readability.”
From Are paid tools worth the cost? A prospective cross-over study to find the right tool for plagiarism detection (2023) · cites this paper as [19]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Lazer, D. M. J., Baum, M. A., Benkler, Y., Berinsky, A. J., Greenhill, K. M., Menczer, F., Metzger, M. J., Nyhan, B., Pennycook, G., Rothschild, D., et al. (2018) · Science · doi:10.1126/science.aao2998 · Cited by 4,160
Kincaid, J. P., Fishburne, Jr., Robert P., R., Richard L., C., & Brad, S. (1975) · doi:10.21236/ada006655 · Cited by 3,497
Charnock, D., Shepperd, S., Needham, G., & Gann, R. (1999) · Journal of Epidemiology and Community Health · doi:10.1136/jech.53.2.105 · Cited by 3,329
Consumer health information seeking on the internet: the state of the art
Cline, R. J. W. (2001) · Health Education Research · doi:10.1093/her/16.6.671 · Cited by 1,708 · cited 1×
“There has been an increase in internet usage worldwide, as well as an increase in the depth and breadth of online content [3, 4].”
BackgroundHealth Information on the Internet: Accessibility, Quality, and Readability in English and Spanish
Berland, G. K., Elliott, M. N., Morales, L. S., Algazy, J. I., Kravitz, R. L., Broder, M. S., Kanouse, D. E., Muñoz, J. A., Puyol, J.-A., Lara, M., et al. (2001) · JAMA · doi:10.1001/jama.285.20.2612 · Cited by 1,208
Silberg, W. M. (1997) · JAMA · doi:10.1001/jama.277.15.1244 · Cited by 1,151
Readability Standards for Informed-Consent Forms as Compared with Actual Readability
Paasche-Orlow, M. K., Taylor, H. A., & Brancati, F. L. (2003) · New England Journal of Medicine · doi:10.1056/nejmsa021212 · Cited by 754
Kincaid, J. P., Robert, P. F. L., Richard, L. R., & Brad, S. (1975) · Cited by 739
Wang, L.-W., Miller, M. J., Schmitt, M. R., & Wen, F. K. (2013) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2012.05.009 · Cited by 445
Research works printed but not linked: 3
- Silberg WM. Assessing, Controlling, and Assuring the Quality of Medical Information on the Internet. Jama. 1997;277(15). · DOI · Paper page
- Janan D, Wray D. Readability: The limitations of an approach through formulae. in British Educational Research Association Annual Conference. 2012. University of Manchester: Education Line.
- Communicating risk in public health emergencies. a WHO guideline for emergency risk communication (ERC) policy and practice. Geneva: World Health Organization; 2017.
Cited by
People Overtrust AI-Generated Medical Advice despite Low Accuracy
Shekar, S., Pataranutaporn, P., Sarabu, C. R., Cecchi, G., & Maes, P. (2025) · NEJM AI · doi:10.1056/aioa2300015 · Cited by 133
The utility of ChatGPT in generating patient-facing and clinical responses for melanoma
Young, J. N., O’Hagan, R., Poplausky, D., Levoska, M. A., Gulati, N., Ungar, B., & Ungar, J. P. (2023) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2023.05.024 · Cited by 53
Shekar, S., Pataranutaporn, P., Sarabu, C. R., Cecchi, G., & Maes, P. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2408.15266 · Cited by 52
Readability Metrics in Patient Education: Where Do We Innovate?
Singh, S. P., Jamal, A., & Qureshi, F. (2024) · Clinics and Practice · doi:10.3390/clinpract14060183 · Cited by 35
Erkin, Y., Hancı, V., & Özduran, E. (2023) · Medicine · doi:10.1097/md.0000000000033529 · Cited by 28
Metadata
- Authors
- Wrigley Kelly, N. E., Murray, K. E., McCarthy, C., & O’Shea, D. B.
- Affiliations
- University College Dublin (IE)
- Venue
- Health and Technology
- Published
- 2021-06-24
- Volume
- 11
- Issue
- 5
- Pages
- 1093-1099
- ISSN
- 2190-7188 (ISSN-L)
- 2190-7196
- PMC
- PMC8222704
- OpenAlex
- W3174777258
- Semantic Scholar
- ad8f1bd1f788da1d5a5538038c99fec66c34cf47
- Cited by
- 69
- References
- 31
- Citations by year
- 2026: 11 · 2025: 15 · 2024: 16 · 2023: 15 · 2022: 10 · 2021: 2
- FWCI
- 12.08
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Health and Technology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Lenus, The Irish Health Repository (Dr Steevens Hospital Library) (submittedVersion, cc-by)
- Funders
- University College Dublin
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
- Social Sciences › Health › Social Media in Health Education
- Social Sciences › Communication › Communication and COVID-19 Impact
- Keywords
- COVID-19 pandemic, online health information, information quality, readability, health websites, DISCERN, HONcode, JAMA benchmark criteria, Flesch-Kincaid Grade Level, Gunning Fog Index, health literacy, search engine results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: An objective analysis of quality and readability of online information on COVID-19. https://app.cochat.ai/papers/10.1007/s12553-021-00574-2
- The paper
- Wrigley Kelly, N. E., Murray, K. E., McCarthy, C., & O’Shea, D. B. (2021). An objective analysis of quality and readability of online information on COVID-19. Health and Technology. https://doi.org/10.1007/s12553-021-00574-2
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.