The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Using systematic reviews in guideline development: The GRADE approach
Abstract
Systematic reviews are essential to produce trustworthy guidelines. To assess the certainty of a body of evidence included in a systematic review, the Grading of Recommendations Assessment, Development and Evaluation (GRADE) Working Group has developed an approach that is currently used by over 100 organizations, including the World Health Organization and the Cochrane Collaboration. GRADE provides operational definitions and instructions to rate the certainty of the evidence for each outcome in a review as high, moderate, low, or very low for the effects of interventions, prognostic estimates, values and preferences, test accuracy, and resource utilization. The assessment includes assessing risk of bias, imprecision, inconsistency, indirectness, and publication bias, the magnitude of effects, dose‐response relations, and the impact of residual confounding and bias. Summary statistical information and assessments of certainty are presented in GRADE evidence summary tables, which can be produced using GRADE's official GRADEpro software tool ( www.gradepro.org /). The evidence summary tables feed into the GRADE Evidence to Decision frameworks which guideline panels can use to produce recommendations.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Quality of the cumulative body of evidence for each outcome variable was appraised using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach [51].”
From Rates of compliance and adherence to high-intensity interval training: a systematic review and Meta-analyses (2023) · cites this paper as [51]
Citations
Cites
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions
Sterne, J. A., Hernán, M. A., Reeves, B. C., Savović, J., Berkman, N. D., Viswanathan, M., Henry, D., Altman, D. G., Ansari, M. T., Boutron, I., et al. (2016) · BMJ · doi:10.1136/bmj.i4919 · Cited by 20,329
Self-citationQUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies
Whiting, P. F., Rutjes, A. W. S., Westwood, M. E., Mallett, S., Deeks, J. J., Reitsma, J. B., Leeflang, M. M. G., Sterne, J. A. C., Bossuyt, P. M. M., & the QUADAS-2 Group* (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-8-201110180-00009 · Cited by 14,199
GRADE guidelines: 1. Introduction—GRADE evidence profiles and summary of findings tables
Guyatt, G., Oxman, A. D., Akl, E. A., Kunz, R., Vist, G., Brozek, J., Norris, S., Falck-Ytter, Y., Glasziou, P., & deBeer, H. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.04.026 · Cited by 10,681
Self-citationGrading quality of evidence and strength of recommendations
(2004) · BMJ · doi:10.1136/bmj.328.7454.1490 · Cited by 8,477
Self-citationGRADE guidelines: 3. Rating the quality of evidence
Balshem, H., Helfand, M., Schünemann, H. J., Oxman, A. D., Kunz, R., Brozek, J., Vist, G. E., Falck-Ytter, Y., Meerpohl, J., & Norris, S. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.07.015 · Cited by 8,285
Self-citationThe Environment and Disease: Association or Causation?
Hill, A. B. (1965) · Proceedings of the Royal Society of Medicine · doi:10.1177/003591576505800503 · Cited by 6,974
Clinical Practice Guidelines We Can Trust
Board on Health Care Services (2011) · National Academies Press eBooks · doi:10.17226/13058 · Cited by 3,146
Deeks, J. J., Macaskill, P., & Irwig, L. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.01.016 · Cited by 2,910
GRADE guidelines: 4. Rating the quality of evidence—study limitations (risk of bias)
Guyatt, G. H., Oxman, A. D., Vist, G., Kunz, R., Brozek, J., Alonso-Coello, P., Montori, V., Akl, E. A., Djulbegovic, B., & Falck-Ytter, Y. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.07.017 · Cited by 2,798
Self-citation
Flagged first, then by citations
Research works printed but not linked: 4
- World Health Organization, 2014, WHO Handbook for Guideline Development
- Schunemann H, 2013, Handbook for grading the quality of evidence and the strength of recommendations using the GRADE approach
- Schünemann HJ, Oxman AD, Higgins JPT, Vist GE, Glasziou P, Guyatt GH. Chapter 11: Presenting results and ‘Summary of findings' tables. In: Higgins JPT, gGreen S (editors), Cochrane Handbook for sSystematic rReviews of iInterventions vVersion 5.1.0 (updated March 2011), The Cochrane Collaboration, 2011
- WHO, 2013, WHO Guidelines for Screening and Treatment of Precancerous Lesions for Cervical Cancer Prevention
Cited by
Sorted by citations
Items 201–259 of 259
The conundrum of guidelines, recommendations, and strength of recommendation
Nair, A. S., & Diwan, S. M. (2019) · Ain-Shams Journal of Anaesthesiology · doi:10.1186/s42077-019-0041-y
ENFERMEIROS PARA O CUIDADO NO PRÉ-PARTO, TRABALHO DE PARTO E PÓS-PARTO: REVISÃO INTEGRATIVA
Costa, I. A. P., Bertoncello, K. C. G., Martini, J. G., Parreira, P., Rodrigues, D. B., & de Souza, M. D. L. (2021) · Ciencia y enfermería/Ciencia y enfermería · doi:10.29393/ce27-2ecip60002
Tunthanathip, T., & Bejrananda, T. (2021) · PSU Medical Journal · doi:10.31584/psumj.2021246346
Lima, I. F. P., Vieira, W. D. A., Bernardino, Í. D. M., Costa, P. A., Pithon, M. M., & Paranhos, L. R. (2019) · The Angle Orthodontist · doi:10.2319/0003-3219-89.4.673
Dioguardi, M., Spirito, F., Sovereto, D., Femina, L. L., Caloro, G. A., Cosola, M. D., Cantore, S., Ballini, A., Muzio, L. L., & Troiano, G. (2022) · Research Square · doi:10.21203/rs.3.rs-1607497/v1
Abaate, T. J., & Prince, A. N. (2022) · medRxiv · doi:10.1101/2022.11.10.22282181
Dhungana, S., Rijal, R., Regmi, B. U., Bajracharya, J. S., Sharma, S., Singh, S. K., Karn, N., & Chapagai, M. (2023) · PLoS ONE · doi:10.1371/journal.pone.0281366
GRADE: A Transparent Approach for Evidence-Based Recommendations and Decisions in Health
Schünemann, H. J., & Reinap, M. (2023) · Sustainable development goals series · doi:10.1007/978-3-031-33851-9_84
Self-citationThe need for clear criteria for the selection of participants in scientific workshops
Faggion, C. M. (2023) · BDJ · doi:10.1038/s41415-023-6325-4
Tinnitus Treatment: Evidence and Guidelines
Langguth, B., Kleinjung, T., Schlee, W., Vanneste, S., & Ridder, D. D. (2024) · Springer eBooks · doi:10.1007/978-3-031-35647-6_59
(2024) · American Journal of Tropical Medicine and Hygiene · doi:10.4269/ajtmh.110-4s
Khan, Z. M., Ball, C., Saeed, D., Tai, G., Chandran, S., Vashista, A., Davey, S., Lee, M. J., Brown, S. R., Hind, D., et al. (2024) · Colorectal Disease · doi:10.1111/codi.17258
Ali, A., Pirie, K., Hughes, C., Jacob, B. M., Doyle, F., Brain, K. E., Bonniec, A. L., Cotter, S., Walsh, K. R., McCutchan, G. M., et al. (2025) · HRB Open Research · doi:10.12688/hrbopenres.13931.1
Patnana, A. K., Galani, M. M., Narain, S., Kumar, P., Jayam, C., Kumar, N., Joshi, K., & Agarwal, A. (2025) · Journal of Indian Society of Pedodontics and Preventive Dentistry · doi:10.4103/jisppd.jisppd_8_25
Saldaña, D. M. A., Fonseca, D. A., Ardila, A. D. G., Moreno‐Fergusson, M. E., Torres, E. P., & Rondón, M. (2025) · CIN Computers Informatics Nursing · doi:10.1097/cin.0000000000001290
Ali, A. R., Patnana, A. K., Kumar, P., Pathak, K., Chugh, A., & Chaudhry, K. (2025) · Evidence-Based Dentistry · doi:10.1038/s41432-025-01165-0
Efeitos do exercício físico em indivíduos com anemia falciforme: revisão sistemática
Ferreira, R. L. D. S., & de Souza, L. B. R. (2025) · Pará Research Medical Journal · doi:10.5327/prmj.914
Pandey, S., Tiwari, A., Bhattarai, A., Timalsina, A., Pandey, A., Poudel, A., Basnet, A., Khatiwada, P., Neupane, A., & Ojha, B. (2025) · medRxiv · doi:10.1101/2025.09.05.25335094
Treatments to Avoid Ranula Recurrence: A Network Meta‐Analysis
Souza, M. R. F., Gonçalves, M. W. A., Martins‐Chaves, R. R., Alvarenga‐Brant, R., Chrcanovic, B. R., Ge, L., Lai, H., Gomez, R. S., & Martins, C. C. (2025) · Journal of Oral Pathology and Medicine · doi:10.1111/jop.70041
Yamamoto, M., Hosoya, Y., Hanada, H., Osawa, T., Arai, M., Sakamoto, K., Okazaki, Y., Katasako-Yabumoto, A., Ishizu, T., Kondo, T., et al. (2025) · Circulation Reports · doi:10.1253/circrep.cr-25-0152
Can recommendations be based upon low or very low certainty evidence?
Antoniou, S. A., Mavridis, D., Seitidis, G., Carrano, F. M., Huo, B., Tzanis, A. Α., Koutsiouroumpa, O., Doré, S., & Bigaki, M. (2025) · Surgical Endoscopy · doi:10.1007/s00464-025-12301-3
Hu, M., Li, M., Liu, Q., Luo, Z., Zhang, Y., Niu, Y., Jiang, X., & Yang, K. (2025) · Journal of General Internal Medicine · doi:10.1007/s11606-025-09944-2
Self-citationDinesh, T. K., Shetty, A., Dhyani, V. S., T.S, S., & Dsouza, K. J. (2022) · Figshare · doi:10.6084/m9.figshare.19669903
Hamel, C., Hersi, M., Kelly, S. E., Tricco, A. C., Straus, S., Wells, G., Pham, B., & Hutton, B. (2021) · Figshare · doi:10.6084/m9.figshare.17305092
Alvarenga‐Brant, R., Notaro, S. Q., Stefani, C. M., Canto, G. D. L., Pereira, A. G., Póvoa-Santos, L., Souza‐Oliveira, A. C., Campos, J. R., & Martins-Pfeifer, C. C. (2024) · Figshare · doi:10.6084/m9.figshare.26748974
Dinesh, T. K., Shetty, A., Dhyani, V. S., T.S, S., & Dsouza, K. J. (2022) · Figshare · doi:10.6084/m9.figshare.19669909
Alvarenga‐Brant, R., Notaro, S. Q., Stefani, C. M., Canto, G. D. L., Pereira, A. G., Póvoa-Santos, L., Souza‐Oliveira, A. C., Campos, J. R., & Martins-Pfeifer, C. C. (2024) · Figshare · doi:10.6084/m9.figshare.26748977
Dinesh, T. K., Shetty, A., Dhyani, V. S., T.S, S., & Dsouza, K. J. (2022) · Figshare · doi:10.6084/m9.figshare.19669906
Alvarenga‐Brant, R., Notaro, S. Q., Stefani, C. M., Canto, G. D. L., Pereira, A. G., Póvoa-Santos, L., Souza‐Oliveira, A. C., Campos, J. R., & Martins-Pfeifer, C. C. (2024) · Figshare · doi:10.6084/m9.figshare.26299324
Alvarenga‐Brant, R., Notaro, S. Q., Stefani, C. M., Canto, G. D. L., Pereira, A. G., Póvoa-Santos, L., Souza‐Oliveira, A. C., Campos, J. R., & Martins-Pfeifer, C. C. (2024) · Figshare · doi:10.6084/m9.figshare.26299267
Patankar, V. R., Jain, A. K., Rao, R., Mistry, L. N., & Langade, D. G. (2025) · Biomaterial Investigations in Dentistry · doi:10.2340/biid.v12.45221
Gaasterland, C. M. W., Haneveld, M. J. K., Tinselboer, B. M., Zárate, Y. A., Osredkar, D., van Eeghen, A. M., & Stariha, E. (2026) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2026.112187
Hetényi, R., Hanna, D. D., Kopasz, Z., Szentpéteri, J. L., Szabó, P., Somogyi, B. A., Bànyai, K., & Szabó‐Meleg, E. (2026) · Viruses · doi:10.3390/v18030276
Choi, T., Ang, L., & Lee, M. S. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1712003
Applying evidence-to-decision to construction safety: A review of safety culture evidence in Taiwan
Merrett, H. C., & Chen, W. T. (2026) · Work · doi:10.1177/10519815261428096
Daniel, A., Bendabenda, J., McCaul, M., Naude, C. E., Adrianopoli, M., & Prinzo, Z. W. (2025) · BMJ Global Health · doi:10.1136/bmjgh-2025-021214
bin shafiq, S., Uddin, A., Hussain, M., Khan, G. T., Hassan, M., Razzak, M. J., Majid, M., Islam, F., Ahmed, U., Uddin, A. A., et al. (2026) · Brain and Behavior · doi:10.21203/rs.3.rs-9389793/v1
Thamran, B., Sihombing, B., & Steven, S. (2026) · Urogynaecologia · doi:10.4081/uij.2026.367
Do, P. N. V., Nguyen, T. D. K., Qi, Y., Choi, K. C., Hoang, T. X. H., Le, B. P., Lam, Y. T., Tse, M., & Wong, C. L. (2026) · Supportive Care in Cancer · doi:10.1007/s00520-026-10779-8
Alsakti, A. M., Ghazwi, Z. H. A., Alotaibi, A. K., Alharbi, M. A., Aldeaiji, L., Binshmilan, A. B., Al-anazi, N. M., Alsharif, R. E., Aldehaim, F. M., Alhindi, B. A., et al. (2026) · BMC Neurology · doi:10.1186/s12883-026-05016-y
MARQUES-MEDEIROS, A. C., Zina, L. G., Abreu, L. G., Mendes, S. D. R., de Pádua, C. A. M., Pinto, R. S., & de Abreu, M. H. N. G. (2026) · BMC Health Services Research · doi:10.1186/s12913-026-14515-0 · Cited by 1
Sarma, I. D., Biswas, K. P., Jagdish, P., Praveen, K., Ahmed, K. A., & Saikia, D. (2026) · Cureus · doi:10.7759/cureus.111641 · Cited by 2
Cueva-Cañola, L. E., Natera-Rodriguez, D. E., Ramírez-Navarro, D. I., Gasca, J. A., Gómez-Villarroel, R. A., Quinteros, M. R. H., Fuente, A. C. B.-D. L., Barreto, A. K. L. M., Grande, A. W., Armonda, R. A., et al. (2026) · Neurocritical Care · doi:10.1007/s12028-026-02555-7
Práticas integrativas e complementares no manejo do diabetes: revisão rápida de diretrizes clínicas
Silva, M. T., Amado, D. M., Rocha, P. R. S., & Barreto, J. O. M. (2026) · Epidemiologia e Serviços de Saúde · doi:10.1590/s2237-96222026v35e20250602.pt
Mirzohreh, S., Dehghan, M., Sadeghi, S., Sadeghi, Z., Mirian, Z., Noroozi, M., Fathi, M., Ghaffari, S., Javanshir, E., Roshanravan, N., et al. (2026) · European Radiology · doi:10.1007/s00330-026-12778-z
Causal inference methods for evaluating comparative effectiveness: target trial emulation
Haugegaard, T., & Christensen, R. (2026) · Exploration of Musculoskeletal Diseases · doi:10.37349/emd.2026.1007132
Keller, L., Lehmann, T., Brunner, S., Meier, C., & Thompson, D. (2026) · Archives of Pharmacy Practice · doi:10.51847/cviybd7v1l
Rissardo, J. P., Jain, M., & Caprara, A. L. F. (2026) · Neurological Research · doi:10.1080/01616412.2026.2717709
Metformin Exposure in Pregnancy and Fetal Programming: A Focused Review of Contemporary Evidence
Gojnić-Dugalić, M., Dugalić, S., Milinčić, M., & Ivanović, K. (2026) · Biomedicines · doi:10.3390/biomedicines14081867
Clinical Epidemiology and Evidence-Based Health Care
Germini, F., Marcucci, M., Bognanni, A., & Schünemann, H. J. (2025) · Springer eBooks · doi:10.1007/978-1-4614-6625-3_30-1
Self-citationSzabó, P., Somogyi, B. A., Ábrahám, Á., Kemenesi, G., Kuczmog, A., Hetényi, R., Hanna, D. D., Kumli, K., & Szentpéteri, J. L. (2026) · Safety Science · doi:10.1016/j.ssci.2026.107436
Shakeel, R., Uddin, A., Ladhani, D., Mansoor, K., Mansour, A., Talpur, B. Z., Azeem, M. H., Fatima, A., Sajid, E. U., Chaudhry, S. A. A., et al. (2026) · Pacing and Clinical Electrophysiology · doi:10.1111/pace.70433
Cueva-Cañola, L. E., Montaño, K. P. Z., Fuente, A. C. B.-D. L., Díaz-Gutierrez, W. E., Camacho-Hernández, O. E., & Gu, Y. (2026) · European Journal of Gastroenterology & Hepatology · doi:10.1097/meg.0000000000003261
Alamoudi, A., Alnabihi, A. N., Alqahtani, S., Alsarhani, W. K., & Kertes, P. J. (2026) · Eye · doi:10.1038/s41433-026-04904-4
Витальевич, С. М., Ishchenko, R. V., Turchyn, V. V., Bushe, V., Станиславовна, К. А., Akopyan, G. V., Lebed, E. D., & Геннадиевич, П. А. (2026) · Bioengineering · doi:10.3390/bioengineering13101143
Zheng, M., Yan, T., Wang, X., Yin, Y., Yu, T., 李喜亮, Luo, S., & Xiao, Z. (2026) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.70184
Baldiotti, A. L. P., SANTOS-SILVA, P., Ferreira, F. M., Fernandes, I. B., & Martins, C. C. (2026) · The Journal of the American Dental Association · doi:10.1016/j.adaj.2026.07.007
Asquino, N., Lima, R. P. E., Andrade, É., Drescher, A., Mayol, M., Bertl, K., & Stavropoulos, A. (2026) · Clinical and Experimental Dental Research · doi:10.1002/cre2.70476
Ali, A. R., Patnana, A. K., Kumar, P., Shanmugam, S., & Chugh, A. (2026) · Journal of Indian Society of Periodontology · doi:10.4103/jisp.jisp_5_26
Metadata
- Authors
- Zhang, Y., Akl, E. A., & Schünemann, H. J.
- Affiliations
- McMaster University (CA)
- Corresponding author
- Schünemann, Holger J.
- Venue
- Research Synthesis Methods
- Publisher
- Wiley
- Published
- 2018-09-25
- Volume
- 10
- Issue
- 3
- Pages
- 312-329
- ISSN
- 1759-2879 (ISSN-L)
- 1759-2887
- OpenAlex
- W2884972765
- Cited by
- 260
- References
- 67
- Citations by year
- 2026: 38 · 2025: 51 · 2024: 44 · 2023: 42 · 2022: 31 · 2021: 29 · 2020: 13 · 2019: 10
- FWCI
- 2.58
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Research Synthesis Methods (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- GRADE, quality of evidence, systematic reviews, clinical guideline development, risk of bias, imprecision, inconsistency, indirectness, publication bias, dose-response relationship, residual confounding, evidence-to-decision framework
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review