The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Interpreting results and drawing conclusions
Abstract
This chapter addresses first one of the key aspects of interpreting findings that is also fundamental in completing a ‘Summary of findings’ table: the certainty of evidence related to each of the outcomes. It then provides a more detailed consideration of issues around applicability and around interpretation of numerical results, and provides suggestions for presenting authors' conclusions. Methods are presented for computing, presenting and interpreting relative and absolute effects for dichotomous outcome data, including the number needed to treat. For continuous outcome measures, review authors can present summary results for studies using natural units of measurement or as minimal important differences when all studies use the same scale. When studies measure the same construct but with different scales, review authors will need to find a way to interpret the standardized mean difference, or to use an alternative effect measure for the meta-analysis such as the ratio of means.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
GRADE: an emerging consensus on rating quality of evidence and strength of recommendations
Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39489.470347.ad · Cited by 23,305
Self-citationGRADE guidelines: 1. Introduction—GRADE evidence profiles and summary of findings tables
Guyatt, G., Oxman, A. D., Akl, E. A., Kunz, R., Vist, G., Brozek, J., Norris, S., Falck-Ytter, Y., Glasziou, P., & deBeer, H. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.04.026 · Cited by 10,681
Self-citationGrading quality of evidence and strength of recommendations
(2004) · BMJ · doi:10.1136/bmj.328.7454.1490 · Cited by 8,477
Self-citationEvidence-Based Medicine: How to Practice and Teach EBM
Sackett, D. L. (2000) · Cited by 5,950
Jaeschke, R., Singer, J., & Guyatt, G. H. (1989) · Controlled Clinical Trials · doi:10.1016/0197-2456(89)90005-6 · Cited by 4,982
Self-citationWhat is ‘quality of evidence’ and why is it important to clinicians?
Guyatt, G. H., Oxman, A. D., Kunz, R., Vist, G. E., Falck-Ytter, Y., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39490.551019.be · Cited by 3,250
Self-citationClinical Practice Guidelines We Can Trust
Committee on Standards for Developing Trustworthy Clinical Practice Guidelines, Board on Health Care Services, & Institute of Medicine (2011) · National Academies Press eBooks · doi:10.17226/13058 · Cited by 3,081
External validity of randomised controlled trials: “To whom do the results of this trial apply?”
Rothwell, P. M. (2005) · The Lancet · doi:10.1016/s0140-6736(04)17670-8 · Cited by 2,544
GRADE guidelines: 8. Rating the quality of evidence—indirectness
Guyatt, G. H., Oxman, A. D., Kunz, R., Woodcock, J., Brozek, J., Helfand, M., Alonso-Coello, P., Falck-Ytter, Y., Jaeschke, R., Vist, G., et al. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2011.04.014 · Cited by 1,843
Self-citationAlonso-Coello, P., Schünemann, H. J., Moberg, J., Brignardello-Petersen, R., Akl, E. A., Davoli, M., Treweek, S., Mustafa, R. A., Rada, G., Rosenbaum, S., et al. (2016) · BMJ · doi:10.1136/bmj.i2016 · Cited by 1,317
Self-citationGrading Strength of Recommendations and Quality of Evidence in Clinical Guidelines
Guyatt, G., Gutterman, D., Baumann, M. H., Addrizzo-Harris, D., Hylek, E. M., Phillips, B., Raskob, G., Lewis, S. Z., & Schünemann, H. (2006) · Chest · doi:10.1378/chest.129.1.174 · Cited by 1,220
Self-citationHemorrhagic Complications of Anticoagulant Treatment
Levine, M. N., Raskob, G., Landefeld, S., & Kearon, C. (2001) · Chest · doi:10.1378/chest.119.1_suppl.108s · Cited by 1,134
Confidence intervals for the number needed to treat.
Altman, D. G. (1998) · BMJ · doi:10.1136/bmj.317.7168.1309 · Cited by 938
Interventions for promoting smoking cessation during pregnancy
Lumley, J., Chamberlain, C., Dowswell, T., Oliver, S., Oakley, L., & Watson, L. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001055.pub3 · Cited by 890
GRADE guidelines: 12. Preparing Summary of Findings tables—binary outcomes
Guyatt, G. H., Oxman, A. D., Santesso, N., Helfand, M., Vist, G., Kunz, R., Brozek, J., Norris, S., Meerpohl, J., Djulbegovic, B., et al. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.01.012 · Cited by 836
Self-citationGRADE guidelines: 13. Preparing Summary of Findings tables and evidence profiles—continuous outcomes
Guyatt, G. H., Thorlund, K., Oxman, A. D., Walter, S. D., Patrick, D., Furukawa, T. A., Johnston, B. C., Karanicolas, P., Akl, E. A., Vist, G., et al. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.08.001 · Cited by 772
Self-citationGuyatt, G. H. (1994) · JAMA · doi:10.1001/jama.1994.03510250075039 · Cited by 696
Self-citationSchünemann, H. J., Wiercioch, W., Etxeandia, I., Falavigna, M., Santesso, N., Mustafa, R., Ventresca, M., Brignardello-Petersen, R., Laisaar, K.-T., Kowalski, S., et al. (2014) · Canadian Medical Association Journal · doi:10.1503/cmaj.131237 · Cited by 686
Self-citationCommunicating Statistical Information
Hoffrage, U., Lindsey, S., Hertwig, R., & Gigerenzer, G. (2000) · Science · doi:10.1126/science.290.5500.2261 · Cited by 651
Interventions for promoting smoking cessation during pregnancy
Lumley, J., Oliver, S., Chamberlain, C., & Oakley, L. (2004) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001055.pub2 · Cited by 622
Clinical expertise in the era of evidence-based medicine and patient choice
Haynes, R. B. (2002) · Evidence-Based Medicine · doi:10.1136/ebm.7.2.36 · Cited by 586
Schünemann, H. J., Jaeschke, R., Cook, D. J., Bria, W. F., El-Solh, A. A., Ernst, A., Fahy, B. F., Gould, M. K., Horan, K. L., Krishnan, J. A., et al. (2006) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.200602-197st · Cited by 577
Self-citationBhandari, M., Busse, J. W., Jackowski, D., Montori, V. M., Schünemann, H. J., Sprague, S., Mears, D., Schemitsch, E. H., Heels-Ansdell, D., & Devereaux, P. J. (2004) · Europe PMC (PubMed Central) · Cited by 551
Self-citationHelmets for preventing head and facial injuries in bicyclists
Thompson, D. C., Rivara, F., & Thompson, R. (1999) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001855 · Cited by 543
Interpreting treatment effects in randomised trials
Guyatt, G. H., Juniper, E. F., Walter, S. D., Griffith, L. E., & Goldstein, R. S. (1998) · BMJ · doi:10.1136/bmj.316.7132.690 · Cited by 516
Self-citationUsing Numerical Results from Systematic Reviews in Clinical Practice
McQuay, H. J., & Moore, R. A. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-126-9-199705010-00007 · Cited by 455
Credibility of claims of subgroup effects in randomised controlled trials: systematic review
Sun, X., Briel, M., Busse, J. W., You, J. J., Akl, E. A., Mejza, F., Bala, M. M., Bassler, D., Mertz, D., Diaz-Granados, N., et al. (2012) · BMJ · doi:10.1136/bmj.e1553 · Cited by 395
Self-citationβ-Blockers in Congestive Heart Failure: A Bayesian Meta-Analysis
Brophy, J. M., Joseph, L., & Rouleau, J. L. (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-7-200104030-00008 · Cited by 389
How to formulate research recommendations
Brown, P., Brunnhuber, K., Chalkidou, K., Chalmers, I., Clarke, M., Fenton, M., Forbes, C., Glanville, J., Hicks, N. J., Moody, J., et al. (2006) · BMJ · doi:10.1136/bmj.38987.492014.94 · Cited by 381
Pharmacological interventions for promoting smoking cessation during pregnancy
Coleman, T., Chamberlain, C., Davey, M.-A., Cooper, S. E., & Leonardi-Bee, J. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010078.pub2 · Cited by 357
Carotid endarterectomy for asymptomatic carotid stenosis
Chambers, B. R., & Donnan, G. (2005) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001923.pub2 · Cited by 353
Fundamentals of Clinical Trials
Rhoads, G. G. (1986) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1986.03380080101043 · Cited by 342
Friedrich, J. O., Adhikari, N. K., & Beyene, J. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-32 · Cited by 327
Numbers needed to treat derived from meta-analyses---sometimes informative, usually misleading
Smeeth, L., Haines, A., & Ebrahim, S. (1999) · BMJ · doi:10.1136/bmj.318.7197.1548 · Cited by 302
Measurement Properties and Interpretability of the Chronic Respiratory Disease Questionnaire (CRQ)
Schünemann, H. J., Puhan, M., Goldstein, R., Jaeschke, R., & Guyatt, G. H. (2005) · COPD: Journal of Chronic Obstructive Pulmonary Disease · doi:10.1081/copd-200050651 · Cited by 287
Self-citationZhang, Y., Coello, P. A., Guyatt, G. H., Yepes-Nuñez, J. J., Akl, E. A., Hazlewood, G., Pardo-Hernandez, H., Etxeandia-Ikobaltzeta, I., Qaseem, A., Williams, J. W., et al. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.05.011 · Cited by 285
Self-citationHawe, P., Shiell, A., Riley, T., & Gold, L. (2004) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2003.014415 · Cited by 283
Zhang, Y., Alonso-Coello, P., Guyatt, G. H., Yepes-Nuñez, J. J., Akl, E. A., Hazlewood, G., Pardo-Hernandez, H., Etxeandia-Ikobaltzeta, I., Qaseem, A., Williams, J. W., et al. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.01.013 · Cited by 281
Self-citationUsing systematic reviews in guideline development: The GRADE approach
Zhang, Y., Akl, E. A., & Schünemann, H. J. (2019) · Research Synthesis Methods · doi:10.1002/jrsm.1313 · Cited by 260
Self-citationUsing alternative statistical formats for presenting risks and risk reductions
Akl, E. A., Oxman, A. D., Herrin, J., Vist, G. E., Terrenato, I., Sperati, F., Costiniuk, C., Blank, D., & Schünemann, H. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006776.pub2 · Cited by 253
Self-citationAguilar, M. I., & Hart, R. (2005) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001927.pub2 · Cited by 252
Schünemann, H. J., Tugwell, P., Reeves, B. C., Akl, E. A., Santesso, N., Spencer, F. A., Shea, B., Wells, G., & Helfand, M. (2013) · Research Synthesis Methods · doi:10.1002/jrsm.1078 · Cited by 248
Self-citationCommentary—Goodbye M(C)ID! Hello MID, Where Do You Come From?
Schünemann, H. J., & Guyatt, G. H. (2005) · Health Services Research · doi:10.1111/j.1475-6773.2005.0k375.x · Cited by 247
Self-citationDevereaux, P. J., Choi, P. T.-L., El-Dika, S., Bhandari, M., Montori, V. M., Schünemann, H. J., Garg, A. X., Busse, J. W., Heels-Ansdell, D., Ghali, W. A., et al. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.03.017 · Cited by 209
Self-citationPharmacological interventions for promoting smoking cessation during pregnancy
Claire, R., Chamberlain, C., Davey, M.-A., Cooper, S. E., Berlin, I., Leonardi-Bee, J., & Coleman, T. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010078.pub3 · Cited by 188
Santesso, N., Carrasco-Labra, A., Langendam, M., Brignardello-Petersen, R., Mustafa, R. A., Heus, P., Lasserson, T., Opiyo, N., Kunnamo, I., Sinclair, D., et al. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.12.006 · Cited by 173
Self-citationSurgical interventions for lumbar disc prolapse
Gibson, J. A., & Waddell, G. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001350.pub4 · Cited by 170
Meta-analysis of flavonoids for the treatment of haemorrhoids
Alonso-Coello, P., Zhou, Q., Martinez-Zapata, M. J., Mills, E., Heels-Ansdell, D., Johanson, J. F., & Guyatt, G. (2006) · British Journal of Surgery · doi:10.1002/bjs.5378 · Cited by 169
Self-citationJohnston, B. C., Thorlund, K., Schünemann, H. J., Xie, F., Murad, M. H., Montori, V. M., & Guyatt, G. H. (2010) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-8-116 · Cited by 161
Self-citationKaranicolas, P. J., Smith, S. E., Kanbur, B., Davies, E., & Guyatt, G. H. (2008) · Annals of Surgery · doi:10.1097/sla.0b013e3181856024 · Cited by 160
Self-citationAn emerging consensus on grading recommendations?
Guyatt, G. H., Vist, G., Falck-Ytter, Y., Kunz, R., Magrini, N., & Schunemann, H. (2006) · BMJ Evidence-Based Medicine · doi:10.1136/ebm.11.1.2-a · Cited by 148
Self-citationCompression stockings for preventing deep vein thrombosis in airline passengers
Clarke, M. J., Broderick, C. A., Hopewell, S., Juszczak, E., & Eisinga, A. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004002.pub3 · Cited by 140
Schünemann, H. J., Fretheim, A., & Oxman, A. D. (2006) · Health Research Policy and Systems · doi:10.1186/1478-4505-4-25 · Cited by 126
Self-citationAkl, E. A., Gunukula, S. K., Barba, M., Yosuico, V. E. D., van Doormaal, F. F., Kuipers, S., Middeldorp, S., Dickinson, H. O., Bryant, A., & Schünemann, H. J. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006652.pub3 · Cited by 121
Self-citationFrom effect size into number needed to treat
Furukawa, T. A. (1999) · The Lancet · doi:10.1016/s0140-6736(99)01163-0 · Cited by 114
Mugford, M., Kingston, J., & Chalmers, I. (1989) · BMJ · doi:10.1136/bmj.299.6706.1003 · Cited by 111
Cost implications of different approaches to the prevention of respiratory distress syndrome.
Mugford, M., Piercy, J., & Chalmers, I. (1991) · Archives of Disease in Childhood · doi:10.1136/adc.66.7_spec_no.757 · Cited by 94
Aguilar, M. I., & Hart, R. G. (2008) · Stroke · doi:10.1161/strokeaha.107.500363 · Cited by 88
Schünemann, H. J. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.03.018 · Cited by 86
Self-citationAssessing equity in clinical practice guidelines
Dans, A. M. L., Dans, L. F., Oxman, A. D., Robinson, V. A., Acuin, J. M., Tugwell, P., Dennis, R., & Kang, D. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.10.008 · Cited by 76
Binary methods for continuous outcomes: A parametric alternative
Suissa, S. (1991) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(91)90035-8 · Cited by 74
Therapeutic touch for anxiety disorders
Robinson, J., Biley, F. C., & Dolk, H. M. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006240.pub2 · Cited by 47
The Know Your Body program: a review of evaluation studies.
Resnicow, K., CROSS, D. S., & Wynder, E. L. (1993) · PubMed Central · Cited by 45
Akl, E. A., Gunukula, S. K., Barba, M., Yosuico, V. E. D., van Doormaal, F. F., Kuipers, S., Middeldorp, S., Dickinson, H. O., Bryant, A., & Schünemann, H. J. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006652.pub2 · Cited by 31
Self-citationSchünemann, H. J. (2013) · Zeitschrift für Evidenz Fortbildung und Qualität im Gesundheitswesen · doi:10.1016/j.zefq.2013.05.002 · Cited by 12
Self-citationTherapeutic touch for anxiety disorders
Robinson, J., Biley, F., & Dolk, H. M. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006240 · Cited by 8
Confidence intervals for the number needed to treat
Cates, C. J., & Newcombe, R. G. (1999) · BMJ · doi:10.1136/bmj.318.7200.1764c · Cited by 7
A simple method for converting an odds ratio to effect size for use in meta-analysis
Chinn, S. (2000) · Statistics in Medicine · doi:10.1002/1097-0258(20001130)19:22<3127::aid-sim784>3.0.co;2-m
Cited by
The Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817
Self-citationPage, M. J., Moher, D., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n160 · Cited by 13,262
Self-citationKavalieratos, D., Corbelli, J., Zhang, D., Dionne-Odom, J. N., Ernecoff, N. C., Hanmer, J., Hoydich, Z. P., Ikejiani, D. Z., Klein-Fedyshin, M., Zimmermann, C., et al. (2016) · JAMA · doi:10.1001/jama.2016.16840 · Cited by 1,121
Variables associated with achievement in higher education: A systematic review of meta-analyses.
Schneider, M., & Preckel, F. (2017) · Psychological Bulletin · doi:10.1037/bul0000098 · Cited by 1,083
Imamura, F., O'Connor, L., Ye, Z., Mursu, J., Hayashino, Y., Bhupathiraju, S. N., & Forouhi, N. G. (2016) · British Journal of Sports Medicine · doi:10.1136/bjsports-2016-h3576rep · Cited by 956
Metadata
- Authors
- Schünemann, H. J., Vist, G. E., Higgins, J. P., Santesso, N., Deeks, J. J., Glasziou, P., Akl, E. A., Guyatt, G. H., & on behalf of the Cochrane GRADEing Methods Group
- Venue
- Cochrane Handbook for Systematic Reviews of Interventions
- Publisher
- Wiley
- Published
- 2019-09-20
- Pages
- 403-431
- OpenAlex
- W1598577731
- Cited by
- 595
- References
- 69
- Type
- other
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.