COVID-19 prevention and treatment information on the internet: a systematic analysis and quality assessment
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Objective: To evaluate the quality of information regarding the prevention and treatment of COVID-19 available to the general public from all countries. Design: Systematic analysis using the ‘Ensuring Quality Information for Patients’ (EQIP) Tool (score 0–36), Journal of American Medical Association ( JAMA ) benchmark (score 0–4) and the DISCERN Tool (score 16–80) to analyse websites containing information targeted at the general public. Data sources: Twelve popular search terms, including ‘Coronavirus’, ‘COVID-19 19’, ‘Wuhan virus’, ‘How to treat coronavirus’ and ‘COVID-19 19 Prevention’ were identified by ‘Google AdWords’ and ‘Google Trends’. Unique links from the first 10 pages for each search term were identified and evaluated on its quality of information. Eligibility criteria for selecting studies: All websites written in the English language, and provides information on prevention or treatment of COVID-19 intended for the general public were considered eligible. Any websites intended for professionals, or specific isolated populations, such as students from one particular school, were excluded, as well as websites with only video content, marketing content, daily caseload update or news dashboard pages with no health information. Results: Of the 1275 identified websites, 321 (25%) were eligible for analysis. The overall EQIP, JAMA and DISCERN scores were 17.8, 2.7 and 38.0, respectively. Websites originated from 34 countries, with the majority from the USA (55%). News Services (50%) and Government/Health Departments (27%) were the most common sources of information and their information quality varied significantly. Majority of websites discuss prevention alone despite popular search trends of COVID-19 treatment. Websites discussing both prevention and treatment (n=73, 23%) score significantly higher across all tools (p<0.001). Conclusion: This comprehensive assessment of online COVID-19 information using EQIP, JAMA and DISCERN Tools indicate that most websites were inadequate. This necessitates improvements in online resources to facilitate public health measures during the pandemic.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Uncanny similarity of unique inserts in the 2019-nCoV spike protein to HIV-1 gp120 and Gag
Pradhan, P., Pandey, A. K., Mishra, A., Gupta, P., Tripathi, P. K., Menon, M. B., Gomes, J., Vivekanandan, P., & Kundu, B. (2020) · doi:10.1101/2020.01.30.927871 · Cited by 198
RetractedLazer, D. M. J., Baum, M. A., Benkler, Y., Berinsky, A. J., Greenhill, K. M., Menczer, F., Metzger, M. J., Nyhan, B., Pennycook, G., Rothschild, D., et al. (2018) · Science · doi:10.1126/science.aao2998 · Cited by 4,160
Charnock, D., Shepperd, S., Needham, G., & Gann, R. (1999) · Journal of Epidemiology and Community Health · doi:10.1136/jech.53.2.105 · Cited by 3,329
Elwyn, G. (2006) · BMJ · doi:10.1136/bmj.38926.629329.ae · Cited by 1,824
Nepogodiev, D., Bhangu, A., Glasbey, J. C., Li, E., Omar, O. M., Simoes, J. F., Abbott, T. E., Alser, O., Arnaud, A. P., Bankhead-Kendall, B. K., et al. (2020) · The Lancet · doi:10.1016/s0140-6736(20)31182-x · Cited by 1,711
Self-citationInternet Health Information Seeking and the Patient-Physician Relationship: A Systematic Review
Tan, S. S.-L., & Goonawardene, N. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.5729 · Cited by 1,101
Trust and Credibility in Web-Based Health Information: A Review and Agenda for Future Research
Sbaffi, L., & Rowley, J. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7579 · Cited by 537
Evaluation of symptom checkers for self diagnosis and triage: audit study
Semigran, H. L., Linder, J. A., Gidengil, C., & Mehrotra, A. (2015) · BMJ · doi:10.1136/bmj.h3480 · Cited by 489
Silver, M. P. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.3588 · Cited by 224
Schwitzer, G. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050095 · Cited by 174
Cited by
Walker, H. L., Ghani, S., Kuemmerli, C., Nebiker, C. A., Müller, B. P., Raptis, D. A., & Staubli, S. M. (2023) · Journal of Medical Internet Research · doi:10.2196/47479 · Cited by 363
“Low quality of internet-available medical information for patients has been reported for a number of other conditions, including pancreatic cancer, appendicitis, and COVID-19, among others [22,23,26].”
Self-citationHamulka, J., Jeruszka-Bielak, M., Górnicka, M., Drywień, M. E., & Zielinska-Pukos, M. A. (2020) · Nutrients · doi:10.3390/nu13010054 · Cited by 240
“, governmental or commercial) and sometimes has an inadequate quality or even presents potentially harmful information quite often [14,15,50,63].”
Vågenes, H., & Pranić, S. M. (2023) · Reproductive Biology and Endocrinology · doi:10.1186/s12958-023-01100-x · Cited by 10
“Validated quality indicators are needed to help improve the quality and clarity of PCOS information available online as most of them achieved low scores overall, which highlights similar research findings showing a need to improve online resources providing health information [5, 12, 32].”
Background
Metadata
- Authors
- Fan, K. S., Ghani, S. A., Machairas, N., Lenti, L., Fan, K. H., Richardson, D., Scott, A., & Raptis, D. A.
- Venue
- BMJ Open
- Publisher
- BMJ
- Published
- 2020-09
- Volume
- 10
- Issue
- 9
- Pages
- e040487
- ISSN
- 2044-6055 (ISSN-L)
- OpenAlex
- W3085420741
- Cited by
- 85
- References
- 10
- FWCI
- 13.43
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: COVID-19 prevention and treatment information on the internet: a systematic analysis and quality assessment. https://app.cochat.ai/papers/10.1136/bmjopen-2020-040487
- The paper
- Fan, K. S., Ghani, S. A., Machairas, N., Lenti, L., Fan, K. H., Richardson, D., Scott, A., & Raptis, D. A. (2020). COVID-19 prevention and treatment information on the internet: a systematic analysis and quality assessment. BMJ Open. https://doi.org/10.1136/bmjopen-2020-040487
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.