The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
When does a difference make a difference? Interpretation of number needed to treat, number needed to harm, and likelihood to be helped or harmed
Abstract
Although great effort is made in clinical trials to demonstrate statistical superiority of one intervention vs. another, insufficient attention is paid regarding the clinical relevance or clinical significance of the observed outcomes. Effect sizes are not always reported. Available absolute effect size measures include Cohen's d, area under the curve, success rate difference, attributable risk and number needed to treat (NNT). Of all of these measures, NNT is arguably the most clinically intuitive and helps relate effect size difference back to real-world concerns of clinical practice. This commentary reviews the formula for NNT, and proposes acceptable values for NNT and its analogue, number needed to harm (NNH), using examples from the medical literature. The concept of likelihood to be helped or harmed (LHH), calculated as the ratio of NNH to NNT, is used to illustrate trade-offs between benefits and harms. Additional considerations in interpreting NNT are discussed, including the importance of defining acceptable response, adverse outcomes of interest, the effect of time, and the importance of individual baseline characteristics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Citrome, L. (2010) · Postgraduate Medicine · doi:10.3810/pgm.2010.07.2174 · Cited by 226
Self-citation
Research works printed but not linked: 14
- Citrome, 2008, Compelling or irrelevant? Using number needed to treat can help decide, Acta Psychiatr Scand, 117, 412, 10.1111/j.1600-0447.2008.01194.x · DOI
- Citrome, 2010, Relative vs. absolute measures of benefit and risk: what's the difference?, Acta Psychiatr Scand, 121, 94, 10.1111/j.1600-0447.2009.01449.x · DOI
- Citrome, 2009, Quantifying risk: the role of absolute and relative measures in interpreting risk of adverse reactions from product labels of antipsychotic medications, Curr Drug Saf, 4, 229, 10.2174/157488609789006985 · DOI
- Citrome, 2008, Antipsychotics for the treatment of schizophrenia: likelihood to be helped or harmed, understanding proximal and distal benefits and risks, Expert Rev Neurother, 8, 1079, 10.1586/14737175.8.7.1079 · DOI
- Ketter, 2011, Treatments for bipolar disorder: can number needed to treat/harm help inform clinical decisions?, Acta Psychiatr Scand, 123, 175, 10.1111/j.1600-0447.2010.01645.x · DOI
- Srivastava, 2011, Clinical relevance of treatments for acute bipolar disorder: balancing therapeutic and adverse effects, Clin Ther, 33, B40, 10.1016/j.clinthera.2011.11.020 · DOI
- Citrome, 2012, Lurasidone for the acute treatment of adults with schizophrenia: what is the number needed to treat, number needed to harm, and likelihood to be helped or harmed?, Clin Schizophr Relat Psychoses, 6, 76, 10.3371/CSRP.6.2.5 · DOI
- Citrome, 2012, Vilazodone for major depressive disorder: a systematic review of the efficacy and safety profile for this newly approved antidepressant - what is the number needed to treat, number needed to harm and likelihood to be helped or harmed?, Int J Clin Pract, 66, 356, 10.1111/j.1742-1241.2011.02885.x · DOI · Paper page
- Citrome, 2012, Inhaled loxapine for agitation revisited: focus on effect sizes from 2 Phase III randomised controlled trials in persons with schizophrenia or bipolar disorder, Int J Clin Pract, 66, 318, 10.1111/j.1742-1241.2011.02890.x · DOI
- Cookson, 2006, Treatment benefits of duloxetine in major depressive disorder as assessed by number needed to treat, Int Clin Psychopharmacol, 21, 267, 10.1097/00004850-200609000-00004 · DOI
- A'Court, 2002, 10-minute consultation. Newly diagnosed hypertension, BMJ, 324, 1375, 10.1136/bmj.324.7350.1375 · doi:10.1136/bmj.324.7350.1375
- Kraemer, 2006, Size of treatment effects and their importance to clinical research and practice, Biol Psychiatry, 59, 990, 10.1016/j.biopsych.2005.09.014 · DOI · Paper page
- Zimmerman, 2012, Why do some depressed outpatients who are in remission according to the Hamilton Depression Rating Scale not consider themselves to be in remission?, J Clin Psychiatry, 73, 790, 10.4088/JCP.11m07203 · DOI
- Copay, 2007, Understanding the minimum clinically important difference: a review of concepts and methods, Spine J, 7, 541, 10.1016/j.spinee.2007.01.008 · DOI · Paper page
Cited by
Siskind, D., McCartney, L., Goldschlager, R., & Kisely, S. (2016) · British Journal of Psychiatry · doi:10.1192/bjp.bp.115.177261 · Cited by 601
Post-stroke depression: A 2020 updated review
Medeiros, G. C., Roy, D., Kontos, N., & Beach, S. R. (2020) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2020.06.011 · Cited by 587
Thiart, H., Lehr, D., Ebert, D. D., Berking, M., & Riper, H. (2015) · Scandinavian Journal of Work, Environment & Health · doi:10.5271/sjweh.3478 · Cited by 168
“NNT is an effect size that reflects clinical significance by comparing control and intervention groups on the frequency of a positive outcome (62).”
BackgroundNumber needed to treat (NNT) in clinical literature: an appraisal
Mendes, D., Alves, C., & Batel-Marques, F. (2017) · BMC Medicine · doi:10.1186/s12916-017-0875-8 · Cited by 169
Citrome, L. (2015) · International Journal of Clinical Practice · doi:10.1111/ijcp.12752 · Cited by 107
Self-citation
Metadata
- Authors
- Citrome, L., & Ketter, T. A.
- Venue
- International Journal of Clinical Practice
- Publisher
- Hindawi Limited
- Published
- 2013-04-11
- Volume
- 67
- Issue
- 5
- Pages
- 407-411
- ISSN
- 1368-5031 (ISSN-L)
- OpenAlex
- W2094916253
- Cited by
- 250
- References
- 1
- FWCI
- 13.48
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- doi.wiley.com/10.1002/tdm_license_1.1 (tdm, 873 d)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.