The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
GRADE guidelines: 4. Rating the quality of evidence—study limitations (risk of bias)
Abstract
In the GRADE approach, randomized trials start as high-quality evidence and observational studies as low-quality evidence, but both can be rated down if most of the relevant evidence comes from studies that suffer from a high risk of bias. Well-established limitations of randomized trials include failure to conceal allocation, failure to blind, loss to follow-up, and failure to appropriately consider the intention-to-treat principle. More recently recognized limitations include stopping early for apparent benefit and selective reporting of outcomes according to the results. Key limitations of observational studies include use of inappropriate controls and failure to adequately adjust for prognostic imbalance. Risk of bias may vary across outcomes (e.g., loss to follow-up may be far less for all-cause mortality than for quality of life), a consideration that many systematic reviews ignore. In deciding whether to rate down for risk of bias--whether for randomized trials or observational studies--authors should not take an approach that averages across studies. Rather, for any individual outcome, when there are some studies with a high risk, and some with a low risk of bias, they should consider including only the studies with a lower risk of bias.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Certainty of evidence was assessed with use of GRADE tools for RCTs (Guyatt et al., 2011; Ryan & Hill, 2016).”
From Effectiveness of Mental Health and Wellbeing Interventions for Children and Young People in Foster, Kinship, and Residential Care: Systematic Review and Meta-Analysis (2024) · cites this paper as Guyatt et al., 2011
In the citing paper
“Additionally, the researchers (JL and WS) will assess the evidence profiles for each of the identified outcomes based on the GRADE (Grading of Recommendations, Assessment, Development and Evaluation) approach to reviewing evidence [86–88].”
From Acceptance and commitment therapy for chronic pain: Protocol of a systematic review and individual participant data meta-Analysis (2019) · cites this paper as [88]
In the citing paper
“Relevant criteria from the Grades of Recommendation, Assessment, Development, and Evaluation (GRADE) handbook were used to assess bias in all other study designs [37].”
From Computerized cognitive behavior therapy for anxiety and depression in rural areas:a systematic review (2015) · cites this paper as [37]
In the citing paper
“The overall quality of evidence was graded using the Grading of Recommendations, Assessment, Development, and Evaluations (GRADE) approach, considering study limitations, inconsistency, indirectness, imprecision and publication bias [40–44].”
In the citing paper
“We also assessed each study for risk of potential bias following the Grading of Recommendations, Assessment, Development and Evaluations (GRADE) approach and recorded the information in the extraction template469.”
From Health effects associated with exposure to secondhand smoke: a Burden of Proof study (2024) · cites this paper as [469]
In the citing paper
“Quality of evidence in included systematic reviews was assessed by outcome using the Grades of Recommendation, Assessment, Development, and Evaluation (GRADE) system criteria [17-27].”
From Effects of Home Telemonitoring Interventions on Patients With Chronic Heart Failure: An Overview of Systematic Reviews (2015) · cites this paper as [20]
In the citing paper
“applied the key criteria of the Grading of Recommendations Assessment, Development and Evaluation (GRADE) guidelines for observational studies to assess the methodological quality of nonrandomised studies.31”
In the citing paper
“we assessed the risk of selection bias, performance bias, selective reporting bias, detection bias, attrition bias, and potential confounding [32].”
In the citing paper
“The overall quality of research evidence for mental health indicators was assessed using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) framework [32].”
In the citing paper
“The overall quality of evidence was rated as “very low” according to the GRADE framework [32].”
In the citing paper
“Second, the review used a rigorous methodology following the PRISMA statement for reporting systematic reviews and meta-analyses [26] and GRADE framework [32].”
In the citing paper
“RCTs are first categorised as high-quality evidence in the GRADE system, while observational studies are classified as low-quality data supporting estimates of intervention effects.”
In the citing paper
“To determine the quality of evidence, the GRADE approach was used [29–36].”
In the citing paper
“Risk of bias was assessed using the Cochrane risk‐of‐bias tool for RCTs, and certainty of the evidence was assessed using the GRADE approach.”
Citations
Cites
Prevention of Venous Thromboembolism
Geerts, W. H., Pineo, G. F., Heit, J. A., Bergqvist, D., Lassen, M. R., Colwell, C. W., & Ray, J. G. (2004) · CHEST Journal · doi:10.1378/chest.126.3_suppl.338s · Cited by 5,889
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634
Prevention of Venous Thromboembolism
Geerts, W. H., Heit, J. A., Clagett, G. P., Pineo, G. F., Colwell, C. W., Anderson, F. A., & Wheeler, H. B. (2001) · CHEST Journal · doi:10.1378/chest.119.1_suppl.132s · Cited by 4,368
Evaluating non-randomised intervention studies
Deeks, J., Dinnes, J., D'Amico, R., Sowden, A., Sakarovitch, C., Song, F., Petticrew, M., & Altman, D. (2003) · Health Technology Assessment · doi:10.3310/hta7270 · Cited by 2,907
Wood, L., Egger, M., Gluud, L. L., Schulz, K. F., Jüni, P., Altman, D. G., Gluud, C., Martin, R. M., Wood, A. J. G., & Sterne, J. A. C. (2008) · BMJ · doi:10.1136/bmj.39465.451748.ad · Cited by 2,538
The Hazards of Scoring the Quality of Clinical Trials for Meta-analysis
Jüni, P. (1999) · JAMA · doi:10.1001/jama.282.11.1054 · Cited by 1,981
Chan, A.-W., Hróbjartsson, A., Haahr, M. T., Gøtzsche, P. C., & Altman, D. G. (2004) · JAMA · doi:10.1001/jama.291.20.2457 · Cited by 1,845
Sanderson, S., Tatt, I. D., & Higgins, J. P. (2007) · International Journal of Epidemiology · doi:10.1093/ije/dym018 · Cited by 1,531
Moher, D., Jadad, A. R., Nichol, G., Penman, M., Tugwell, P., & Walsh, S. (1995) · Controlled Clinical Trials · doi:10.1016/0197-2456(94)00031-w · Cited by 1,308
Users' guides to the medical literature : a manual for evidence-based clinical practice
Guyatt, G. H., Rennie, D., Meade, M. O., & Cook, D. J. (2002) · Cited by 1,196
Self-citation
Cited by
Sorted by citations
Items 701–800 of 1,022
Nazari, G., Bobos, P., MacDermid, J. C., & Birmingham, T. B. (2019) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2019.01.017 · Cited by 51
Fujii, T., Udy, A. A., Licari, E., Romero, L., & Bellomo, R. (2019) · Journal of Critical Care · doi:10.1016/j.jcrc.2019.02.027 · Cited by 51
Tan, R. Z. H., Lockart, I., Shaheed, C. A., & Danta, M. (2021) · Alimentary Pharmacology & Therapeutics · doi:10.1111/apt.16515 · Cited by 53
Beta-blockers for hypertension
Wiysonge, C. S., Bradley, H., Volmink, J. A., Mayosi, B. M., Mbewu, A. D., & Opie, L. H. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002003.pub4 · Cited by 54
A Systematic Review of Physical Activity Interventions in Individuals with Binge Eating Disorders
Blanchet, C., Mathieu, M.-È., St-Laurent, A., Fecteau, S., St-Amour, N., & Drapeau, V. (2018) · Current Obesity Reports · doi:10.1007/s13679-018-0295-x · Cited by 48
Pharmacological interventions for antisocial personality disorder
Khalifa, N. R., Gibbon, S., Vӧllm, B., Cheung, N. H.-Y., & McCarthy, L. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007667.pub3 · Cited by 64
Brożek, J., Firmino, R. T., Bognanni, A., Arasi, S., Ansotegui, I. J., Assa’ad, A., Bahna, S. L., Canani, R. B., Bózzola, M., Chu, D. K., et al. (2022) · World Allergy Organization Journal · doi:10.1016/j.waojou.2022.100646 · Cited by 49
Han, S.-L., Liu, D., Tan, C., Tan, L., & Xu, W. (2023) · BMC Medicine · doi:10.1186/s12916-023-03159-0 · Cited by 54
“Five domains were used to assess the credibility of the meta-analysis: “risk of bias [17],” “inconsistency [18],” “imprecision [19],” “indirectness [20],” and “publication bias [21].”
Bognanni, A., Fiocchi, A. G., Arasi, S., Chu, D. K., Ansotegui, I. J., Assa’ad, A., Bahna, S. L., Canani, R. B., Bózzola, M., Dahdah, L., et al. (2024) · World Allergy Organization Journal · doi:10.1016/j.waojou.2024.100888 · Cited by 50
“63 The judgments for each GRADE domain were accounted together at outcome level, leading to a CoE rating ranging from to very low to high.”
BackgroundLee, J. H., Shin, K.-H., Bahk, S. G., Lee, G. J., Kim, D. H., Lee, C.-H., Kim, D. H., Yang, H. S., & Lee, S. (2018) · The Spine Journal · doi:10.1016/j.spinee.2018.06.720 · Cited by 52
Developing and Evaluating Prediction Models in Rehabilitation Populations
Seel, R. T., Steyerberg, E. W., Malec, J. F., Sherer, M., & Macciocchi, S. N. (2012) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2012.04.021 · Cited by 49
Holder, T., Gruen, M. E., Roberts, D. L., Somers, T. J., & Bozkurt, A. Y. (2020) · Integrative Cancer Therapies · doi:10.1177/1534735420943278 · Cited by 57
Dose fractionation of CAR-T cells. A systematic review of clinical outcomes
Frigault, M. J., Rotte, A., Ansari, A., Gliner, B., Heery, C. R., & Shah, B. D. (2023) · Journal of Experimental & Clinical Cancer Research · doi:10.1186/s13046-022-02540-w · Cited by 52
Blood Loss in Surgery for Aggressive Vertebral Haemangioma with and without Embolisation
Robinson, Y., Sheta, R. A., Salci, K., & Willander, J. (2015) · Asian Spine Journal · doi:10.4184/asj.2015.9.3.483 · Cited by 49
Interventions for treating leg ulcers in people with sickle cell disease
Martí-Carvajal, A. J., Knight‐Madden, J., & Martínez‐Zapata, M. J. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008394.pub3 · Cited by 46
The reliability of methodological ratings for speechBITE using the PEDro-P scale.
Murray, E., Power, E., Togher, L., Mccabe, P., Munro, N., & Smith, K. (2013) · International journal of language and communication disorders · doi:10.1111/1460-6984.12007 · Cited by 50
Part 2: Evidence Evaluation and Management of Conflicts of Interest
Morley, P. T., Lang, E., Aickin, R. P., Billi, J. E., Eigel, B. N., Ferrer, J. M. E., Finn, J., Gent, L. M., Griffin, R. E., Hazinski, M. F., et al. (2015) · Circulation · doi:10.1161/cir.0000000000000271 · Cited by 49
Active surveillance in desmoid-type fibromatosis: A systematic literature review
Timbergen, M. J. M., Schut, A. W., Grünhagen, D. J., Sleijfer, S., & Verhoef, C. K. (2020) · European Journal of Cancer · doi:10.1016/j.ejca.2020.06.022 · Cited by 49
Assessing Confidence in the Results of Network Meta-Analysis (Cinema)Preprint
Nikolakopoulou, A., Higgins, J. P. T., Papakonstantinou, T., Chaimani, A., Giovane, C. D., Egger, M., & Salanti, G. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/597047 · Cited by 49
Zeraattalab-Motlagh, S., Jayedi, A., & Shab‐Bidar, S. (2021) · American Journal of Clinical Nutrition · doi:10.1093/ajcn/nqab250 · Cited by 48
Hamre, H. J., Glockmann, A., von Ammon, K., Riley, D. S., & Kiene, H. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02313-2 · Cited by 67
“…Recommendations Assessment, Development and Evaluation (GRADE) group [20] was used, with a focus on six issues: risk of bias of individual trials [21], inconsistency/heterogeneity [22], risk of publication bias/small study bias [23], imprecision [24], indirectness [25] and occasions for rating…”
MethodDeprato, A., Ruchat, S.-M., Ali, M. U., Cai, C., Forte, M., Gierc, M. S. H., Meyer, S., Sjwed, T. N., Shirazi, S., Matenchuk, B. A., et al. (2024) · British Journal of Sports Medicine · doi:10.1136/bjsports-2024-108478 · Cited by 55
“52 Accordingly, evidence from RCTs was considered ‘high’ quality and was graded down if there was a concern with risk of bias, 53 indirectness, 54 inconsistency, 55 imprecision 56 or risk of publication bias 57 because these factors reduce the level of confidence in the observed effects.”
Systematic comparison of study quality criteria
Lynch, H. N., Goodman, J. E., Tabony, J. A., & Rhomberg, L. R. (2015) · Regulatory Toxicology and Pharmacology · doi:10.1016/j.yrtph.2015.12.017 · Cited by 48
Ellinger, S., & Stehle, P. (2016) · Nutrients · doi:10.3390/nu8060321 · Cited by 48
Sensitivity of Treatment Recommendations to Bias in Network Meta-Analysis
Phillippo, D., Dias, S., Ades, A. E., Didelez, V., & Welton, N. J. (2017) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/rssa.12341 · Cited by 50
Surgery versus conservative management of endometriomas in subfertile women. A systematic review
Brink Laursen, J., Schroll, J. B., Macklon, K. T., & Rudnicki, M. (2017) · Acta Obstetricia et Gynecologica Scandinavica · doi:10.1111/aogs.13154 · Cited by 47
Li, R., Li, Y., Kong, Y., Li, H., Hu, D., Fu, C., & Wei, Q. (2024) · Journal of Medical Internet Research · doi:10.2196/45406 · Cited by 48
dos Santos, Í. K., Nunes, F. A. S. D. S., de Queirós, V. S., Cobucci, R. N., Dantas, P. B., Soares, G. M., Cabral, B. G. D. A. T., Maranhão, T. M. D. O., & Dantas, P. M. S. (2021) · PLoS ONE · doi:10.1371/journal.pone.0245023 · Cited by 52
Treatment of the lung injury of drowning: a systematic review
Thom, O., Roberts, K., Devine, S., Leggat, P. A., & Franklin, R. C. (2021) · Critical Care · doi:10.1186/s13054-021-03687-2 · Cited by 51
“Observational studies were defined prior to assessment as having a low quality of evidence [14].”
BackgroundAn MDS Evidence‐Based Review on Treatments for Huntington's Disease
Ferreira, J. J., Rodrigues, F. B., Duarte, G. S., Mestre, T., Bachoud‐Lévi, A., Bentivoglio, A. R., Burgunder, J., Cardoso, F., Claassen, D. O., Landwehrmeyer, G. B., et al. (2021) · Movement Disorders · doi:10.1002/mds.28855 · Cited by 47
“The GRADE Working Group approach was applied to evaluate the level of the available evidence.(13,14,16,19-25) This methodology is based on the assessment of six categories: (1) risk of bias, (2) inconsistency, (3) indirectness, (4) imprecision, (5) publication bias, and (6) other criteria.”
Silva, E. J. N. L., Pinto, K. P., Belladonna, F. G., Ferreira, C. M. A., VERSIANI, M. A., & De‐Deus, G. A. (2023) · International Endodontic Journal · doi:10.1111/iej.13939 · Cited by 59
Janus kinase-1 and Janus kinase-2 inhibitors for treating myelofibrosis
Martí-Carvajal, A. J., Anand, V., & Solà, I. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010298.pub2 · Cited by 46
Medlock, S. K., Eslami, S., Askari, M., Taherzadeh, Z., Opondo, D., de Rooij, S. E., & Abu–Hanna, A. (2013) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2013.05.034 · Cited by 47
Responsive versus scheduled feeding for preterm infants
Watson, J., & McGuire, W. L. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005255.pub5 · Cited by 47
Effect of periodontal treatment on preterm birth rate: a systematic review of meta‐analyses
López, N., Uribe, S. E., & Martinez, B. (2014) · Periodontology 2000 · doi:10.1111/prd.12073 · Cited by 49
Local analgesia in paediatric dentistry: a systematic review of techniques and pharmacologic agents
Klingberg, G., Ridell, K., Brogårdh‐Roth, S., Vall, M., & Berlin, H. (2017) · European Archives of Paediatric Dentistry · doi:10.1007/s40368-017-0302-z · Cited by 47
Effects of total fat intake on bodyweight in children
Naude, C. E., Visser, M. E., Nguyen, K. A., Durão, S., & Schoonees, A. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012960.pub2 · Cited by 50
Bahadoran, Z., Mirmiran, P., Kashfi, K., & Ghasemi, A. (2020) · Journal of the American Association for Laboratory Animal Science · doi:10.30802/aalas-jaalas-19-000139 · Cited by 52
Psychological therapies for people with borderline personality disorder
Storebø, O. J., Stoffers‐Winterling, J., Vӧllm, B., Kongerslev, M., Mattivi, J. T., Kielsholm, M. L., Nielsen, S. S., Jørgensen, M. S., Faltinsen, E. G., Lieb, K., et al. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012955 · Cited by 48
Chu, A., Holdaway, C., Varma, T., Petocz, P., & Samman, S. (2018) · Sports Medicine · doi:10.1007/s40279-017-0818-8 · Cited by 44
Autonomic Effects of Spinal Manipulative Therapy: Systematic Review of Randomized Controlled Trials
Araujo, F. X., Ferreira, G. E., Angellos, R. F., Stieven, F. F., Plentz, R. D. M., & da Silva, M. F. (2019) · Journal of Manipulative and Physiological Therapeutics · doi:10.1016/j.jmpt.2018.12.005 · Cited by 46
Sakuraba, A., Luna, A., & Micić, D. (2022) · Viruses · doi:10.3390/v14081822 · Cited by 45
Beamish, N., Davenport, M. H., Ali, M. U., Gervais, M. J., Sjwed, T. N., Bains, G., Sivak, A., Deering, R. E., & Ruchat, S.-M. (2024) · British Journal of Sports Medicine · doi:10.1136/bjsports-2024-108619 · Cited by 76
“24 Evidence from randomised controlled trials (RCTs) was considered ‘high’ certainty and downgraded, if there was a concern with risk of bias (ROB), 25 indirectness, 26 inconsistency, 27 imprecision 28 or publication bias 29 because these factors reduce confidence in the observed effects.”
Puhan, M. A., & Lareau, S. C. (2014) · Clinics in Chest Medicine · doi:10.1016/j.ccm.2014.02.001 · Cited by 45
Büchter, R. B., & Fechtelpeter, D. (2011) · PubMed Central · doi:10.3205/000142 · Cited by 44
MURPHY, C. P., Fajt, V. R., Scott, H. M., Foster, M., WICKWIRE, P., & McEwen, S. A. (2015) · Epidemiology and Infection · doi:10.1017/s0950268815000722 · Cited by 46
Kirkpatrick, A. W., Roberts, D. J., Jaeschke, R., Waele, J. J. D., Keulenaer, B. L. D., Duchesne, J. C., Björck, M., Leppäniemi, A. K., Ejike, J. C., Sugrue, M., et al. (2015) · Anaesthesiology Intensive Therapy · doi:10.5603/ait.a2015.0081 · Cited by 46
Bugeja, L. C., Ibrahim, J., Ferrah, N., Murphy, B., Willoughby, M., & Ranson, D. (2016) · Health Research Policy and Systems · doi:10.1186/s12961-016-0096-1 · Cited by 48
Patel, P. B., & Patel, T. K. (2017) · European Journal of Rheumatology · doi:10.5152/eurjrheum.2017.160080 · Cited by 47
Chen, S., Zhang, N., Shao, J., & Wang, X. (2018) · International Journal of Surgery · doi:10.1016/j.ijsu.2018.02.045 · Cited by 46
Davenport, M. H., Yoo, C., Mottola, M. F., Poitras, V. J., Garcia, A. J., Gray, C. E., Barrowman, N., Davies, G., Kathol, A. J., Skow, R. J., et al. (2018) · British Journal of Sports Medicine · doi:10.1136/bjsports-2018-099653 · Cited by 46
Kim, K., Zhu, M. F., Munro, J. T., & Young, S. W. (2018) · ANZ Journal of Surgery · doi:10.1111/ans.14936 · Cited by 46
Joyce, K. E., Beyer, F. R., Thomson, R. G., & Clarke, M. W. (2014) · British Journal of Ophthalmology · doi:10.1136/bjophthalmol-2013-304627 · Cited by 46
Canadian Urological Association guideline on male urethral stricture
Rourke, K. F., Welk, B. K., Kodama, R. T., Bailly, G. G., Davies, T., Santesso, N. A., & Violette, P. D. (2020) · Canadian Urological Association Journal · doi:10.5489/cuaj.6792 · Cited by 45
VECCHIO, M., Chiaramonte, R., & BENEDETTO, P. D. (2022) · European Journal of Physical and Rehabilitation Medicine · doi:10.23736/s1973-9087.22.07217-3 · Cited by 46
Abraham, N. S., Barkun, A. N., Sauer, B. G., Douketis, J. D., Laine, L., Noseworthy, P. A., Telford, J. J., & Leontiadis, G. I. (2022) · Journal of the Canadian Association of Gastroenterology · doi:10.1093/jcag/gwac010 · Cited by 45
“The certainty of the evidence for each PICO question was categorized as very low, low, moderate, or high depending on the assessment of (i) limitations in the design and execution of the studies, (ii) indirectness, (iii) inconsistency, (iv) imprecision, and (v) other considerations including publication bias, accordin…”
Guidance to best tools and practices for systematic reviews
Kolaski, K., Logan, L. R., & Ioannidis, J. P. A. (2023) · JBI Evidence Synthesis · doi:10.11124/jbies-23-00139 · Cited by 57
Li, Y.-K., Xiao, C., Ren, H., Li, W., Guo, Z., & Luo, J. (2025) · European Journal of Pharmacology · doi:10.1016/j.ejphar.2025.177255 · Cited by 47
Groen, J., Gordon, M. A., Chogle, A. S., Benninga, M. A., Borlack, R. E., Borrelli, O., Darbari, A., Dolinšek, J., Khlevner, J., Lorenzo, C. D., et al. (2025) · Journal of Pediatric Gastroenterology and Nutrition · doi:10.1002/jpn3.70070 · Cited by 56
Aneurysm diameter as a risk factor for pretreatment rebleeding: a meta-analysis
Boogaarts, H. D., van Lieshout, J. H., van Amerongen, M. J., de Vries, J., Verbeek, A. L. M., Grotenhuis, J. A., Westert, G. P., & Bartels, R. (2015) · Journal of neurosurgery · doi:10.3171/2014.12.jns14931 · Cited by 45
Seta, T., Takahashi, Y., Noguchi, Y., Shikata, S., Sakai, T., Sakai, K., Yamashita, Y., & Nakayama, T. (2017) · PLoS ONE · doi:10.1371/journal.pone.0183321 · Cited by 45
Weight of Evidence for Hazard Identification: A Critical Review of the Literature
Martin, P., Bladier, C., Meek, B., Bruyère, O., Feinblatt, E., Touvier, M., Watier, L., & Makowski, D. (2018) · Environmental Health Perspectives · doi:10.1289/ehp3067 · Cited by 50
Platelet Transfusion in Cardiac Surgery: A Systematic Review and Meta-Analysis.
Yanagawa, B., Ribeiro, R., Lee, J., Mazer, C., Cheng, D., Martin, J., Verma, S., & Friedrich, J. (2020) · Annals of Thoracic Surgery · doi:10.1016/j.athoracsur.2020.04.139 · Cited by 33
Robinson, E., Humphreys, G., & Jones, A. (2021) · Obesity Reviews · doi:10.1111/obr.13198 · Cited by 45
Vitamin D supplementation for chronic liver diseases in adults
Bjelaković, M., Nikolova, D., Bjelaković, G., & Gluud, C. N. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011564.pub3 · Cited by 49
Ten essential steps for performing a systematic review
Kuo, L., Shao, S., & Chi, C. (2022) · Dermatologica Sinica · doi:10.4103/1027-8117.362992 · Cited by 45
Systemic inflammatory biomarkers in painful diabetic neuropathy
Baka, P., Escolano‐Lozano, F., & Birklein, F. (2021) · Journal of Diabetes and its Complications · doi:10.1016/j.jdiacomp.2021.108017 · Cited by 44
Efficacy of COVID-19 Treatments: A Bayesian Network Meta-Analysis of Randomized Controlled Trials
Zhang, C., Jin, H., Wen, Y. F., & Yin, G. (2021) · Frontiers in Public Health · doi:10.3389/fpubh.2021.729559 · Cited by 44
Conger, A., Burnham, T. R., Clark, T., Teramoto, M., & McCormick, Z. L. (2022) · Pain Medicine · doi:10.1093/pm/pnac070 · Cited by 44
“RCTs, although not without their own limitations [54, 55], continue to represent the gold-standard study design in medical research [56].”
BackgroundZemplenyi, A. T., Tachkov, K., Balkányi, L., Németh, B., Petykó, Z. I., Petrova, G. I., Czech, M., Dawoud, D., Goettsch, W., Gutiérrez‐Ibarluzea, I., et al. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1088121 · Cited by 44
“Standardized reporting guidelines for publication, such as GRADE (31–33) or the ISPOR and ISPE joint Task Force initiative for transparency in RWE (34) can be used to facilitate AI-assisted aggregation based on secondary data.”
MethodA systematic review and meta‐analysis of acute severe complications of pediatric anesthesia
MirGhassemi, A., Neira, V. M., Ufholz, L., Barrowman, N., Mulla, J., Bradbury, C. L., & Bould, M. D. (2015) · Pediatric Anesthesia · doi:10.1111/pan.12751 · Cited by 44
Hong, C. J. H., Tsang, A. C., Quinn, J. G., Bonaparte, J. P., Stevens, A., & Kilty, S. (2015) · Systematic Reviews · doi:10.1186/s13643-015-0157-5 · Cited by 44
The Health Burden of Invasive Meningococcal Disease: A Systematic Review
Strifler, L., Morris, S. K., Dang, V., Tu, H., Minhas, R. S., Jamieson, F., Deeks, S. L., Crowcroft, N. S., & Sander, B. (2015) · Journal of the Pediatric Infectious Diseases Society · doi:10.1093/jpids/piv065 · Cited by 44
A Systematic Review of Surgical Randomized Controlled Trials
Voineskos, S. H., Coroneos, C. J., Ziolkowski, N. I., Kaur, M. N., Banfield, L. E., Meade, M. O., Thoma, A., Chung, K. C., & Bhandari, M. (2016) · Plastic & Reconstructive Surgery · doi:10.1097/01.prs.0000475766.83901.5b · Cited by 44
GRADE Leitlinien: 14. Von der Evidenz zur Empfehlung: Die Bedeutung und Darstellung von Empfehlungen
Kaminski-Hartenthaler, A., Meerpohl, J. J., Gartlehner, G., Kien, C., Langer, G., Wipplinger, J., & Schünemann, H. J. (2014) · Zeitschrift für Evidenz Fortbildung und Qualität im Gesundheitswesen · doi:10.1016/j.zefq.2014.08.003 · Cited by 44
Health-Related Quality of Life (HRQoL) in Idiopathic Inflammatory Myopathy: A Systematic Review
Leclair, V., Regardt, M., Wojcik, S., Hudson, M., & (CIMS), C. I. M. S. (2016) · PLoS ONE · doi:10.1371/journal.pone.0160753 · Cited by 45
Mirghani, H., Sturgis, E. M., Auperin, A., Monsonégo, J., & Blanchard, P. (2017) · Oral Oncology · doi:10.1016/j.oraloncology.2017.02.024 · Cited by 44
Obuku, E. A., Lavis, J. N., Kinengyere, A. A., Senono, R., Ocan, M., Mafigiri, D. K., Ssengooba, F., Karamagi, C., & Sewankambo, N. K. (2018) · Health Research Policy and Systems · doi:10.1186/s12961-018-0360-7 · Cited by 44
Bazoukis, G., Naka, K. Κ., Alsheikh-Ali, A. A. A., Tse, G., Letsas, Κ. P., Korantzopoulos, P. G., Liu, T., Yeung, C., Efremidis, M., Tsioufis, K. P., et al. (2019) · Heart Failure Reviews · doi:10.1007/s10741-019-09839-5 · Cited by 47
Alternating pressure (active) air surfaces for preventing pressure ulcers
Shi, C., Dumville, J. C., Cullum, N. A., Rhodes, S., Jammali‐Blasi, A., & McInnes, E. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013620.pub2 · Cited by 48
Understanding the evaluation of mHealth app features based on a cross-country Kano analysis
Gimpel, H., Manner-Romberg, T., Schmied, F., & Winkler, T. J. (2021) · Electronic Markets · doi:10.1007/s12525-020-00455-y · Cited by 46
Sargeant, J. M., & O'Connor, A. M. (2014) · Zoonoses and Public Health · doi:10.1111/zph.12124 · Cited by 42
Enhanced recovery after abdominal wall reconstruction: a systematic review and meta-analysis
Lode, L., Oma, E., Henriksen, N. A., & Jensen, K. K. (2020) · Surgical Endoscopy · doi:10.1007/s00464-020-07995-6 · Cited by 43
Godah, M. W., Beydoun, Z., Abdul-Khalek, R. A., Safieddine, B., Khamis, A. M., & Abdulrahim, S. (2021) · Maternal and Child Health Journal · doi:10.1007/s10995-021-03133-3 · Cited by 43
“Risk of Bias (RoB) and Quality Assessment: RoB was assessed using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) tool for observational studies (Guyatt et al., 2011).”
MethodNo Evidence of Creative Benefit Accompanying Dyslexia: A Meta-Analysis
Erbeli, F., Peng, P., & Rice, M. (2021) · Journal of Learning Disabilities · doi:10.1177/00222194211010350 · Cited by 45
Lü, Y., Zhu, H., Wang, Q., Tian, C., Lai, H., Hou, L., Liu, Y., Gao, Y., Liu, M., Yang, F., et al. (2022) · Sleep Medicine · doi:10.1016/j.sleep.2022.03.012 · Cited by 42
Randomized controlled trials in de-implementation research: a systematic scoping review
Raudasoja, A., Falkenbach, P., Vernooij, R. W. M., Mustonen, J. M. J., Agarwal, A., Aoki, Y., Blanker, M. H., Cartwright, R., García‐Perdomo, H. A., Kilpeläinen, T. P., et al. (2022) · Implementation Science · doi:10.1186/s13012-022-01238-z · Cited by 43
“Risk of bias and quality indicators To improve judgements regarding the studies with complex intervention designs and to enhance the interrater agreement [15] in risk-of-bias assessment, through iterative discussion, consensus building, and informed by previous literature [16, 17], we modified the Cochrane risk-of-bia…”
MethodBurrai, F., Sguanci, M. E., Petrucci, G., Marinis, M. G. D., & Piredda, M. (2023) · European Journal of Oncology Nursing · doi:10.1016/j.ejon.2023.102340 · Cited by 46
Weiss, S. L., Peters, M. J., Oczkowski, S. J. W., Belley‐Côté, E. P., Buysse, C., Choong, K. L. M., Deep, A., Inwald, D. P., Flori, H. R., Kneyber, M. C. J., et al. (2026) · Pediatric Critical Care Medicine · doi:10.1097/pcc.0000000000003927 · Cited by 46
Transcutaneous Electrical Nerve Stimulation in Patients With Knee Osteoarthritis
Chen, L., Zhou, Z., Li, Y., Ning, G., Li, Y., Wang, X.-B., & Feng, S. (2015) · Clinical Journal of Pain · doi:10.1097/ajp.0000000000000233 · Cited by 43
Treatment of Fatigue in Primary Biliary Cholangitis: A Systematic Review and Meta-Analysis
Lee, J. Y., Danford, C. J., Trivedi, H. D., Tapper, E. B., Patwardhan, V. R., & Bonder, A. (2019) · Digestive Diseases and Sciences · doi:10.1007/s10620-019-5457-5 · Cited by 43
Jazayeri, H. E., Khavanin, N., Yu, J. W., Lopez, J., Shamliyan, T., Peacock, Z. S., & Dorafshar, A. H. (2019) · Journal of Oral and Maxillofacial Surgery · doi:10.1016/j.joms.2019.04.025 · Cited by 43
Abboud, M. (2020) · Nutrients · doi:10.3390/nu12041163 · Cited by 43
Rod, J. E., Oviedo-Trespalacios, Ó., Senserrick, T. M., & King, M. (2021) · Accident Analysis & Prevention · doi:10.1016/j.aap.2021.105970 · Cited by 47
Guirado, T., Chambonnière, C., Chaput, J., Metz, L., Thivel, D., & Duclos, M. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18062828 · Cited by 44
Boccardi, M., Dodich, A., Albanese, E., Gayet‐Ageron, A., Festari, C., Ashton, N. J., Bischof, G. N., Chiotis, K., Leuzy, A., Wolters, E. E., et al. (2021) · European Journal of Nuclear Medicine and Molecular Imaging · doi:10.1007/s00259-020-05120-2 · Cited by 44
Do orthodontic tooth movements induce pulp necrosis? A systematic review
Weissheimer, T., Silva, E. J. N. L., Pinto, K. P., Só, G. B., da Rosa, R. A., & Só, M. V. R. (2021) · International Endodontic Journal · doi:10.1111/iej.13523 · Cited by 43
Antibiotics for treating acute chest syndrome in people with sickle cell disease
Martí-Carvajal, A. J., Conterno, L. D. O., & Knight‐Madden, J. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006110.pub4 · Cited by 42
Height outcome of the recombinant human growth hormone treatment in Turner syndrome: a meta-analysis
Li, P., Cheng, F., & Xiu, L. (2018) · Endocrine Connections · doi:10.1530/ec-18-0115 · Cited by 41
Postoperative adjuvant chemotherapy for resectable cholangiocarcinoma
Luvira, V., Satitkarnmanee, E., Pugkhem, A., Kietpeerakool, C., Lumbiganon, P., & Pattanittum, P. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012814.pub2 · Cited by 40
Metadata
- Authors
- Guyatt, G. H., Oxman, A. D., Vist, G., Kunz, R., Brozek, J., Alonso-Coello, P., Montori, V., Akl, E. A., Djulbegovic, B., & Falck-Ytter, Y.
- Affiliations
- McMaster University (CA)
- Nasjonalt Kunnskapssenter for Helsetjenesten (NO)
- University of Basel (CH)
- University at Buffalo, State University of New York (US)
- Case Western Reserve University (US)
- Corresponding author
- Guyatt, Gordon H.
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2011-04
- Volume
- 64
- Issue
- 4
- Pages
- 407-415
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W1981680557
- Cited by
- 2,798
- References
- 37
- Citations by year
- 2026: 130 · 2025: 182 · 2024: 238 · 2023: 199 · 2022: 264 · 2021: 280 · 2020: 284 · 2019: 198 · 2018: 184 · 2017: 180 · 2016: 176 · 2015: 179 · 2014: 120 · 2013: 95 · 2012: 65
- FWCI
- 100.89
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Clinical Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- GRADE, risk of bias, quality of evidence, observational studies, allocation concealment, blinding, loss to follow-up, intention-to-treat analysis, early stopping, selective reporting
- MeSH terms
- Female, Humans, Male, Quality Assurance, Health Care, Randomized Controlled Trials as Topic, Practice Guidelines as Topic, Publication Bias, Risk Assessment, Evidence-Based Practice
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
