The DOI matches its Crossref record; 30 of the 31 references it cites were found in a registry or an index.
GRADE guidelines 6. Rating the quality of evidence—imprecision
Abstract
GRADE suggests that examination of 95% confidence intervals (CIs) provides the optimal primary approach to decisions regarding imprecision. For practice guidelines, rating down the quality of evidence (i.e., confidence in estimates of effect) is required if clinical action would differ if the upper versus the lower boundary of the CI represented the truth. An exception to this rule occurs when an effect is large, and consideration of CIs alone suggests a robust effect, but the total sample size is not large and the number of events is small. Under these circumstances, one should consider rating down for imprecision. To inform this decision, one can calculate the number of patients required for an adequately powered individual trial (termed the "optimal information size" [OIS]). For continuous variables, we suggest a similar process, initially considering the upper and lower limits of the CI, and subsequently calculating an OIS. Systematic reviews require a somewhat different approach. If the 95% CI excludes a relative risk (RR) of 1.0, and the total number of events or patients exceeds the OIS criterion, precision is adequate. If the 95% CI includes appreciable benefit or harm (we suggest an RR of under 0.75 or over 1.25 as a rough guide) rating down for imprecision may be appropriate even if OIS criteria are met.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The ERTupdated Cochrane review identi fi ed serious imprecision for 1 outcome -hypoglycemia requiring third-party assistance -because of a few events, well below the required optimal information size (as a rule of thumb, a value of 300 events, assuming modest effect sizes and baseline risks), resulting in the inability to exclude the minimally important clinical difference.”
From KDIGO 2022 Clinical Practice Guideline for Diabetes Management in Chronic Kidney Disease (2022) · cites this paper as [135]
In the citing paper
“The overall quality of evidence was graded using the Grading of Recommendations, Assessment, Development, and Evaluations (GRADE) approach, considering study limitations, inconsistency, indirectness, imprecision and publication bias [40–44].”
In the citing paper
“On the other hand, if only a few (small) studies are included in an overall effect size, the precision of meta-analytic results may, nevertheless, be low (Guyatt et al., 2011).”
From Meta-analytic evidence on the efficacy of hypnosis for mental and somatic health issues: a 20-year perspective (2024) · cites this paper as Guyatt et al., 2011
In the citing paper
“Quality of evidence in included systematic reviews was assessed by outcome using the Grades of Recommendation, Assessment, Development, and Evaluation (GRADE) system criteria [17-27].”
From Effects of Home Telemonitoring Interventions on Patients With Chronic Heart Failure: An Overview of Systematic Reviews (2015) · cites this paper as [22]
In the citing paper
“To determine the quality of evidence, the GRADE approach was used [29–36].”
In the citing paper
“RCTs are first categorised as high-quality evidence in the GRADE system, while observational studies are classified as low-quality data supporting estimates of intervention effects.”
Citations
Cites
(1996) · The Lancet · doi:10.1016/s0140-6736(96)09457-3 · Cited by 6,503
A Comparison of Albumin and Saline for Fluid Resuscitation in the Intensive Care Unit
The SAFE Study Investigators (2004) · New England Journal of Medicine · doi:10.1056/nejmoa040232 · Cited by 2,827
Dennis, M. S. (1996) · The Lancet · Cited by 2,728
Collins, R. T., Peto, R., Flather, M., Parish, S., Sleight, P., Conway, M., Pipilis, A., Baigent, C., Barnett, D., Boissel, J., et al. (1995) · The Lancet · doi:10.1016/s0140-6736(95)90865-x · Cited by 1,888
Poldermans, D., Boersma, E. H., Bax, J. J., Thomson, I. R., van de Ven, L. L. M., Blankensteijn, J. D., Baars, H. F., Yo, T. I., Trocino, G., Vigna, C., et al. (1999) · New England Journal of Medicine · doi:10.1056/nejm199912093412402 · Cited by 1,480
GRUPPOITALIANOPERLOSTUDIODELL (1994) · The Lancet · doi:10.1016/s0140-6736(94)90232-1 · Cited by 1,201
Collins, R. T., Peto, R., Flather, M. D., Parish, S., Sleight, P., Conway, M. A., Pipilis, A., Baigent, C., Barnett, D., Boissel, J., et al. (1995) · Ghent University Academic Bibliography (Ghent University) · Cited by 1,115
Cochrane Injuries Group Albumin ReviewersWhy albumin may not work
Berger, A. (1998) · BMJ · doi:10.1136/bmj.317.7153.235 · Cited by 1,080
(1994) · The Lancet · doi:10.1016/s0140-6736(94)92633-6 · Cited by 1,021
Effect of ramipril on the incidence of diabetes
(2006) · New England Journal of Medicine · doi:10.1056/nejmoa065061 · Cited by 737
Bassler, D. (2010) · JAMA · doi:10.1001/jama.2010.310 · Cited by 613
Meta-Analysis: Antibiotic Prophylaxis Reduces Mortality in Neutropenic Patients
Gafter‐Gvili, A., Fraser, A., Paul, M., & Leibovici, L. (2005) · Annals of Internal Medicine · doi:10.7326/0003-4819-142-12_part_1-200506210-00008 · Cited by 495
Abuissa, H. S., Jones, P. G., Marso, S. P., & O’Keefe, J. H. (2005) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2005.05.051 · Cited by 452
Devereaux, P. J., Beattie, W. S., Choi, P. T.-L., Badner, N. H., Guyatt, G. H., Villar, J. C., Cinà, C. S., Leslie, K., Jacka, M. J., Montori, V. M., et al. (2005) · BMJ · doi:10.1136/bmj.38503.623646.8f · Cited by 428
Self-citationPogue, J. M., & Yusuf, S. (1997) · Controlled Clinical Trials · doi:10.1016/s0197-2456(97)00051-2 · Cited by 415
Yusuf, S., MacMahon, S. W., Collins, R., & Peto, R. (1988) · The Lancet · doi:10.1016/s0140-6736(88)91906-x · Cited by 386
Perioperative β blockers in patients having non-cardiac surgery: a meta-analysis
Bangalore, S., Wetterslev, J., Pranesh, S., Sawhney, S., Gluud, C. N., & Messerli, F. H. (2008) · The Lancet · doi:10.1016/s0140-6736(08)61560-3 · Cited by 355
Teo, K. K., Yusuf, S., Collins, R., Held, P. H., & Peto, R. (1991) · BMJ · doi:10.1136/bmj.303.6816.1499 · Cited by 333
Contemporary Management of Acute Exacerbations of COPD
Quon, B. S., Gan, W., & Sin, D. D. (2008) · CHEST Journal · doi:10.1378/chest.07-1207 · Cited by 246
A Meta-analysis of Low-Dose Aspirin for the Prevention of Pregnancy-Induced Hypertensive Disease
Imperiale, T. F. (1991) · JAMA · doi:10.1001/jama.1991.03470020086038 · Cited by 234
Probiotics for induction of remission in Crohn's disease
Limketkai, B. N., Akobeng, A. K., Gordon, M. A., & Adepoju, A. A. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006634.pub3 · Cited by 205
Effect sizes in cumulative meta-analyses of mental health randomized trials evolved over time
Trikalinos, T. A., Churchill, R., Ferri, M., Leucht, S., Tuunainen, A., Wahlbeck, K., & Ioannidis, J. P. A. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.02.018 · Cited by 177
Meta-analysis of flavonoids for the treatment of haemorrhoids
Alonso‐Coello, P., Zhou, Q. X., Martínez‐Zapata, M. J., Mills, E. J., Heels‐Ansdell, D., Johanson, J. F., & Guyatt, G. H. (2006) · British journal of surgery · doi:10.1002/bjs.5378 · Cited by 168
Self-citationPractical problems in interim analyses, with particular regard to estimation
Pocock, S., & Hughes, M. D. (1989) · Controlled Clinical Trials · doi:10.1016/0197-2456(89)90059-7 · Cited by 160
Probiotics for induction of remission in Crohn's disease
Butterworth, A. D., Thomas, A. G., & Akobeng, A. K. (2008) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006634.pub2 · Cited by 91
Endarterectomy vs stenting for carotid artery stenosis: A systematic review and meta-analysis
Murad, M. H., Flynn, D. N., Elamin, M. B., Guyatt, G. H., Hobson, R. W., Erwin, P. J., & Montori, V. M. (2008) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2008.05.035 · Cited by 67
Self-citationA meta-analysis of low-dose aspirin for the prevention of pregnancy-induced hypertensive disease
Imperiale, T. (1991) · JAMA · doi:10.1001/jama.266.2.260 · Cited by 45
Randomized Trials Stopped Early for Benefit: A Systematic Review
Montori, V. M., Devereaux, P. J., Adhikari, N. K. J., Burns, K. E. A., Eggert, C. H., Briel, M., Lacchetti, C., Leung, T. W., Darling, E., Bryant, D. M., et al. (2005) · JAMA · doi:10.1001/jama.294.17.2203 · Cited by 26
Self-citation
Flagged first, then by citations
1 of the 31 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
KDIGO 2024 clinical practice guideline for the evaluation and management of chronic kidney disease
Stevens, P. E., Ahmed, S. B., Carrero, J. J., Foster, B., Francis, A., Hall, R. K., Herrington, W. G., Hill, G., Inker, L. A., Kazancıoğlu, R., et al. (2024) · Kidney International · doi:10.1016/j.kint.2023.10.018 · Cited by 8,530
GRADE guidelines: 3. Rating the quality of evidence
Balshem, H., Helfand, M., Schünemann, H. J., Oxman, A. D., Kunz, R., Brozek, J., Vist, G. E., Falck-Ytter, Y., Meerpohl, J., & Norris, S. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.07.015 · Cited by 8,285
Self-citationAntithrombotic Therapy for VTE Disease
Kearon, C., Akl, E. A., Ornelas, J., Blaivas, A., Jimenez, D., Bounameaux, H., Huisman, M., King, C. S., Morris, T. A., Sood, N., et al. (2016) · Chest · doi:10.1016/j.chest.2015.11.026 · Cited by 4,830
KDIGO 2021 Clinical Practice Guideline for the Management of Glomerular Diseases
Rovin, B. H., Adler, S. G., Barratt, J., Bridoux, F., Burdge, K. A., Chan, T. M., Cook, H. T., Fervenza, F. C., Gibson, K. L., Glassock, R. J., et al. (2021) · Kidney International · doi:10.1016/j.kint.2021.05.021 · Cited by 2,735
Japanese Society for Cancer of the Colon and Rectum, Watanabe, T., Muro, K., Ajioka, Y., Hashiguchi, Y., Ito, Y., Saito, Y., Hamaguchi, T., Ishida, H., Ishiguro, M., et al. (2018) · International Journal of Clinical Oncology · doi:10.1007/s10147-017-1101-6 · Cited by 2,467
Metadata
- Authors
- Guyatt, G. H., Oxman, A. D., Kunz, R., Brozek, J., Alonso-Coello, P., Rind, D., Devereaux, P. J., Montori, V. M., Freyschuss, B., Vist, G., Jaeschke, R., Williams, J. W., Murad, M. H., Sinclair, D., Falck-Ytter, Y., Meerpohl, J., Whittington, C., Thorlund, K., Andrews, J., & Schünemann, H. J.
- Affiliations
- McMaster University (CA)
- Nasjonalt Kunnskapssenter for Helsetjenesten (NO)
- University Hospital of Basel (CH)
- Harvard University (US)
- Karolinska University Hospital (SE)
- Duke Medical Center (US)
- Mayo Clinic (US)
- Liverpool School of Tropical Medicine (GB)
- Case Western Reserve University (US)
- University Medical Center Freiburg (DE)
- University College London (GB)
- Vanderbilt University (US)
- Corresponding author
- Guyatt, Gordon H.
- ORCID
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2011-12
- Volume
- 64
- Issue
- 12
- Pages
- 1283-1293
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W2090132603
- Cited by
- 2,693
- References
- 31
- Citations by year
- 2026: 189 · 2025: 194 · 2024: 255 · 2023: 217 · 2022: 266 · 2021: 260 · 2020: 224 · 2019: 165 · 2018: 186 · 2017: 179 · 2016: 172 · 2015: 162 · 2014: 96 · 2013: 69 · 2012: 48
- FWCI
- 73.46
- Type
- journal article
- Language
- en
- Update notices
- erratum (2021-09-01)
- Open access
- closed
- Locations
- Journal of Clinical Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- GRADE, quality of evidence, imprecision, confidence intervals, sample size, number of events, relative risk, continuous outcomes, systematic reviews, clinical guidelines
- MeSH terms
- Humans, Risk, Meta-Analysis as Topic, Confidence Intervals, Randomized Controlled Trials as Topic, Practice Guidelines as Topic, Sample Size, Evidence-Based Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review