Using GRADE in situations of emergencies and urgencies: certainty in evidence and recommendations matters during the COVID-19 pandemic, now more than ever and no matter what
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Objectives The public, policy makers, and science communities are subject to many false, uninformed, overly optimistic, premature, or simply ridiculous health claims. The coronavirus disease 2019 (COVID-19) pandemic and its context is a paramount example for such claims. In this article, we describe why expressing the certainty in evidence to support a decision is critical and why the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach matters now, perhaps more than ever and no matter what the specific topic is in relation to COVID-19. We finally also offer suggestions for how it can be used appropriately to support decision-making at global, national, and local level when emergency, urgent or rapid responses are needed. Study Design and Setting This is an invited commentary to address the objectives above building on examples from the recent COVID-19 pandemic. This includes an iterative discussion of examples and development of guidance. Results The GRADE approach is a transparent and structured method for assessing the certainty of evidence and when developing recommendations that requires little additional time. We describe why emergency, urgent, or rapid responses do not justify omitting this critical assessment of the evidence. In situations of emergencies and urgencies, such as the COVID-19 pandemic, GRADE can similarly be used to express and convey certainty in intervention effects, test accuracy, risk and prognostic factors, consequences of public health measures, and qualitative bodies of evidence. Conclusions Assessing and communicating the certainty of evidence during the COVID-19 pandemic is critical. Those offering evidence synthesis or making recommendations should use transparent ratings of the body of evidence supporting a claim regardless of time that is available or needed to provide this response.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
GRADE: an emerging consensus on rating quality of evidence and strength of recommendations
Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39489.470347.ad · Cited by 23,305
Self-citationChu, D. K., Akl, E. A., Duda, S., Solo, K., Yaacoub, S., Schünemann, H. J., Chu, D. K., Akl, E. A., El-harakeh, A., Bognanni, A., et al. (2020) · The Lancet · doi:10.1016/s0140-6736(20)31142-9 · Cited by 3,843
Self-citationAlhazzani, W., Møller, M. H., Arabi, Y. M., Loeb, M., Gong, M. N., Fan, E., Oczkowski, S., Levy, M. M., Derde, L., Dzierba, A., et al. (2020) · Intensive Care Medicine · doi:10.1007/s00134-020-06022-5 · Cited by 2,105
Alonso-Coello, P., Schünemann, H. J., Moberg, J., Brignardello-Petersen, R., Akl, E. A., Davoli, M., Treweek, S., Mustafa, R. A., Rada, G., Rosenbaum, S., et al. (2016) · BMJ · doi:10.1136/bmj.i2016 · Cited by 1,317 · cited 1×
“The questions proposed by GRADE to guide decision makers, including those formulating recommendations (and the recipients of them), are equally simple (Box 2), and can be tailored to the type of decision (clinical recommendations, public health recommendations/decisions, or health system recommendations/decisions) [11…”
Self-citationSantesso, N., Glenton, C., Dahm, P., Garner, P., Akl, E. A., Alper, B., Brignardello-Petersen, R., Carrasco-Labra, A., De Beer, H., Hultcrantz, M., et al. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.10.014 · Cited by 1,198
Self-citationIorio, A., Spencer, F. A., Falavigna, M., Alba, C., Lang, E., Burnand, B., McGinn, T., Hayden, J., Williams, K., Shea, B., et al. (2015) · BMJ · doi:10.1136/bmj.h870 · Cited by 880
Physical interventions to interrupt or reduce the spread of respiratory viruses
Jefferson, T., Del Mar, C. B., Dooley, L., Ferroni, E., Al-Ansary, L. A., Bawazeer, G. A., van Driel, M. L., Nair, N. S., Jones, M. A., Thorning, S., et al. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006207.pub4 · Cited by 805
GRADE guidelines: 13. Preparing Summary of Findings tables and evidence profiles—continuous outcomes
Guyatt, G. H., Thorlund, K., Oxman, A. D., Walter, S. D., Patrick, D., Furukawa, T. A., Johnston, B. C., Karanicolas, P., Akl, E. A., Vist, G., et al. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.08.001 · Cited by 772 · cited 1×
“In the earlier phases of the review, we saved time through streamlining the evidence assessments, structuring the questions and making decisions about what evidence to search for to address relevant outcomes as suggested by GRADE [9].”
Self-citationThe GRADE Evidence to Decision (EtD) framework for health system and public health decisions
for the GRADE Working Group, Moberg, J., Oxman, A. D., Rosenbaum, S., Schünemann, H. J., Guyatt, G., Flottorp, S., Glenton, C., Lewin, S., Morelli, A., et al. (2018) · Health Research Policy and Systems · doi:10.1186/s12961-018-0320-2 · Cited by 376 · cited 1×
“The questions proposed by GRADE to guide decision makers, including those formulating recommendations (and the recipients of them), are equally simple (Box 2), and can be tailored to the type of decision (clinical recommendations, public health recommendations/decisions, or health system recommendations/decisions) [11…”
Self-citationHooijmans, C. R., de Vries, R. B. M., Ritskes-Hoitinga, M., Rovers, M. M., Leeflang, M. M., IntHout, J., Wever, K. E., Hooft, L., de Beer, H., Kuijpers, T., et al. (2018) · PLOS ONE · doi:10.1371/journal.pone.0187271 · Cited by 176
Self-citation
Cited by
Muller, A. E., Hafstad, E. V., Himmels, J. P. W., Smedslund, G., Flottorp, S., Stensland, S. Ø., Stroobants, S., Van de Velde, S., & Vist, G. E. (2020) · Psychiatry Research · doi:10.1016/j.psychres.2020.113441 · Cited by 895
“We also call on journals and researchers to balance the need for rapid publication with properly conducted studies, reviews and guidelines 94 .”
Self-citationKahale, L. A., Elkhoury, R., El Mikati, I., Pardo-Hernandez, H., Khamis, A. M., Schünemann, H. J., Haddaway, N. R., & Akl, E. A. (2022) · F1000Research · doi:10.12688/f1000research.51723.3 · Cited by 48
Self-citationProbiotics and the Microbiome—How Can We Help Patients Make Sense of Probiotics?
Britton, R. A., Hoffmann, D. E., & Khoruts, A. (2021) · Gastroenterology · doi:10.1053/j.gastro.2020.11.047 · Cited by 40
Metadata
- Authors
- Schünemann, H. J., Santesso, N., Vist, G. E., Cuello, C., Lotfi, T., Flottorp, S., Davoli, M., Mustafa, R., Meerpohl, J. J., Alonso-Coello, P., & Akl, E. A.
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2020-11
- Volume
- 127
- Pages
- 202-207
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W3034078120
- Cited by
- 57
- References
- 12
- FWCI
- 8.60
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using GRADE in situations of emergencies and urgencies: certainty in evidence and recommendations matters during the COVID-19 pandemic, now more than ever and no matter what. https://app.cochat.ai/papers/10.1016/j.jclinepi.2020.05.030
- The paper
- Schünemann, H. J., Santesso, N., Vist, G. E., Cuello, C., Lotfi, T., Flottorp, S., Davoli, M., Mustafa, R., Meerpohl, J. J., Alonso-Coello, P., & Akl, E. A. (2020). Using GRADE in situations of emergencies and urgencies: certainty in evidence and recommendations matters during the COVID-19 pandemic, now more than ever and no matter what. Journal of Clinical Epidemiology. https://doi.org/10.1016/j.jclinepi.2020.05.030
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.