Number needed to treat is incorrect without proper time-related considerations
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
The number needed to treat (NNT) is a simple measure of a treatment's impact, increasingly reported in randomized trials and observational studies. Its calculation in studies involving varying follow-up times or recurrent outcomes has been criticized. We discuss the NNT in these contexts, illustrating using several published studies. The computation of the NNT is founded on the cumulative incidence of the outcome. Instead, several published studies use simple proportions that do not account for varying follow-up times, or use incidence rates per person-time. We show that these approaches can lead to erroneous values of the NNT and misleading interpretations. For example, after converting the incidence rate to a cumulative incidence, we show that a trial reporting a NNT of 4 "to prevent one exacerbation in 1 year" should have reported a NNT of 9. A survey of all papers reporting NNT, published in four major medical journals in 2009, found that 6 out of all 10 papers involving varying follow-up times did not correctly estimate the NNT. As the "number needed to treat" becomes increasingly used in complex studies and in the comparative effectiveness of therapies, its accurate estimation and interpretation become crucial to avoid erroneous clinical and public health decisions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Colhoun, H. M., Betteridge, D. J., Durrington, P. N., Hitman, G. A., W Neil, H. A., Livingstone, S. J., Thomason, M. J., Mackness, M. I., Charlton-Menys, V., & Fuller, J. H. (2004) · The Lancet · doi:10.1016/s0140-6736(04)16895-5 · Cited by 3,755
Treatment of hypertension in patients 80 years of age or older
Beckett, N. S., Peters, R., Fletcher, A. E., Staessen, J. A., Liu, L., Dumitrascu, D., Stoyanovsky, V., Antikainen, R. L., Nikitin, Y., Anderson, C., et al. (2008) · New England Journal of Medicine · doi:10.1056/nejmoa0801369 · Cited by 3,092
An Assessment of Clinically Useful Measures of the Consequences of Treatment
Laupacis, A., Sackett, D. L., & Roberts, R. S. (1988) · New England Journal of Medicine · doi:10.1056/nejm198806303182605 · Cited by 1,681
Incidence of hospitalized rhabdomyolysis in patients treated with lipid-lowering drugs
Graham, D. J. (2004) · JAMA · doi:10.1001/jama.292.21.2585 · Cited by 875
Once-daily valacyclovir to reduce the risk of transmission of genital herpes.
Corey, L., Wald, A., Patel, R., Sacks, S. L., Tyring, S. K., Warren, T., Douglas, J. M., Paavonen, J., Morrow, R. A., Beutner, K. R., et al. (2004) · New England Journal of Medicine · doi:10.1056/nejmoa035144 · Cited by 720
Calculating the number needed to treat for trials where the outcome is time to an event
Altman, D. G., & Andersen, P. K. (1999) · BMJ · doi:10.1136/bmj.319.7223.1492 · Cited by 710
Diet and Lifestyle Risk Factors Associated With Incident Hypertension in Women
Forman, J. P. (2009) · JAMA · doi:10.1001/jama.2009.1060 · Cited by 555
Effectiveness and Safety of Drug-Eluting Stents in Ontario
Tu, J. V., Bowen, J., Chiu, M., Ko, D. T., Austin, P. C., He, Y., Hopkins, R., Tarride, J.-E., Blackhouse, G., Lazzam, C., et al. (2007) · New England Journal of Medicine · doi:10.1056/nejmoa071076 · Cited by 383
Zinman, B., Harris, S. B., Neuman, J., Gerstein, H. C., Retnakaran, R. R., Raboud, J., Qi, Y., & Hanley, A. J. (2010) · The Lancet · doi:10.1016/s0140-6736(10)60746-5 · Cited by 235
Cited by
Mannan, M., Mamun, A., Doi, S., & Clavarino, A. (2016) · PLoS ONE · doi:10.1371/journal.pone.0157240 · Cited by 421
“where CIt is the cumulative incidence proportion of events at the end of the study and t is the duration of follow-up [44].”
BackgroundDransfield, M. T., Bourbeau, J., Jones, P. W., Hanania, N. A., Mahler, D. A., Vestbo, J., Wachtel, A., Martinez, F. J., Barnhart, F., Sanford, L., et al. (2013) · The Lancet Respiratory Medicine · doi:10.1016/s2213-2600(13)70040-7 · Cited by 345
Mannan, M., Mamun, A., Doi, S., & Clavarino, A. (2016) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2015.12.008 · Cited by 280
Number needed to treat (NNT) in clinical literature: an appraisal
Mendes, D., Alves, C., & Batel-Marques, F. (2017) · BMC Medicine · doi:10.1186/s12916-017-0875-8 · Cited by 169
Simms-Williams, N., Treves, N., Yin, H., Lu, S., Yu, O., Pradhan, R., Renoux, C., Suissa, S., & Azoulay, L. (2024) · BMJ · doi:10.1136/bmj-2023-078242 · Cited by 151
Self-citation
Metadata
- Authors
- Suissa, D., Brassard, P., Smiechowski, B., & Suissa, S.
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2012-01
- Volume
- 65
- Issue
- 1
- Pages
- 42-46
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W2055655128
- Cited by
- 73
- References
- 9
- FWCI
- 6.40
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Number needed to treat is incorrect without proper time-related considerations. https://app.cochat.ai/papers/10.1016/j.jclinepi.2011.04.009
- The paper
- Suissa, D., Brassard, P., Smiechowski, B., & Suissa, S. (2012). Number needed to treat is incorrect without proper time-related considerations. Journal of Clinical Epidemiology. https://doi.org/10.1016/j.jclinepi.2011.04.009
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.