Estimating the number needed to treat from continuous outcomes in randomised controlled trials: methodological challenges and worked example using data from the UK Back Pain Exercise and Manipulation (BEAM) trial
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Reporting numbers needed to treat (NNT) improves interpretability of trial results. It is unusual that continuous outcomes are converted to numbers of individual responders to treatment (i.e., those who reach a particular threshold of change); and deteriorations prevented are only rarely considered. We consider how numbers needed to treat can be derived from continuous outcomes; illustrated with a worked example showing the methods and challenges. METHODS: We used data from the UK BEAM trial (n = 1, 334) of physical treatments for back pain; originally reported as showing, at best, small to moderate benefits. Participants were randomised to receive 'best care' in general practice, the comparator treatment, or one of three manual and/or exercise treatments: 'best care' plus manipulation, exercise, or manipulation followed by exercise. We used established consensus thresholds for improvement in Roland-Morris disability questionnaire scores at three and twelve months to derive NNTs for improvements and for benefits (improvements gained+deteriorations prevented). RESULTS: At three months, NNT estimates ranged from 5.1 (95% CI 3.4 to 10.7) to 9.0 (5.0 to 45.5) for exercise, 5.0 (3.4 to 9.8) to 5.4 (3.8 to 9.9) for manipulation, and 3.3 (2.5 to 4.9) to 4.8 (3.5 to 7.8) for manipulation followed by exercise. Corresponding between-group mean differences in the Roland-Morris disability questionnaire were 1.6 (0.8 to 2.3), 1.4 (0.6 to 2.1), and 1.9 (1.2 to 2.6) points. CONCLUSION: In contrast to small mean differences originally reported, NNTs were small and could be attractive to clinicians, patients, and purchasers. NNTs can aid the interpretation of results of trials using continuous outcomes. Where possible, these should be reported alongside mean differences. Challenges remain in calculating NNTs for some continuous outcomes. TRIAL REGISTRATION: UK BEAM trial registration: ISRCTN32683578.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U.S. Department of Health and Human Services FDA Center for Drug Evaluation and Research, U.S. Department of Health and Human Services FDA Center for Biologics Evaluation and Research, & U.S. Department of Health and Human Services FDA Center for Devices and Radiological Health (2006) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-4-79 · Cited by 2,856
Kirsch, I., Deacon, B. J., Huedo-Medina, T. B., Scoboria, A., Moore, T. J., & Johnson, B. T. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050045 · Cited by 2,442
Selective publication of antidepressant trials and its influence on apparent efficacy
Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa065779 · Cited by 2,435
Ostelo, R. W. J. G., Deyo, R. A., Stratford, P., Waddell, G., Croft, P., Von Korff, M., Bouter, L. M., & de Vet, H. C. (2008) · Spine · doi:10.1097/brs.0b013e31815e3a10 · Cited by 2,009
Interpreting treatment effects in randomised trials
Guyatt, G. H., Juniper, E. F., Walter, S. D., Griffith, L. E., & Goldstein, R. S. (1998) · BMJ · doi:10.1136/bmj.316.7132.690 · Cited by 516
van der Roer, N., Ostelo, R. W. J. G., Bekkering, G. E., van Tulder, M. W., & de Vet, H. C. W. (2006) · Spine · doi:10.1097/01.brs.0000201293.57439.47 · Cited by 344
Kovacs, F. M., Abraira, V., Royuela, A., Corcoll, J., Alegre, L., Cano, A., Muriel, A., Zamora, J., Gil del Real, M. T., Gestoso, M., et al. (2007) · Spine · doi:10.1097/brs.0b013e31815b75ae · Cited by 211
Number needed to treat (NNT): estimation of a measure of clinical benefit
Walter, S. D. (2001) · Statistics in Medicine · doi:10.1002/sim.1173 · Cited by 80
Cited by
Aspiration and swallowing in Parkinson disease and rehabilitation with EMST: A randomized trial
Troche, M. S., Okun, M. S., Rosenbek, J. C., Musson, N., Fernandez, H. H., Rodriguez, R., Romrell, J., Pitts, T., Wheeler-Hegland, K. M., & Sapienza, C. M. (2010) · Neurology · doi:10.1212/wnl.0b013e3181fef115 · Cited by 410
Spinal Manipulative Therapy for Chronic Low-Back Pain: An Update of a Cochrane Review
Rubinstein, S. M., van Middelkoop, M., Assendelft, W. J. J., de Boer, M. R., & van Tulder, M. W. (2011) · Spine · doi:10.1097/brs.0b013e3182197fe1 · Cited by 306
Moreira, M. D. F., Gamboa, O. L., & Pinho Oliveira, M. A. (2022) · European Journal of Pain · doi:10.1002/ejp.1939 · Cited by 48
Tsai, H.-J., Yang, A. C., Zhu, J.-D., Hsu, Y.-Y., Hsu, T.-F., & Tsai, S.-J. (2022) · Journal of Personalized Medicine · doi:10.3390/jpm12030481 · Cited by 45
Systematic Reviews and Cancer Research: a Suggested Stepwise Approach
Kelley, G. A., & Kelley, K. S. (2018) · BMC Cancer · doi:10.1186/s12885-018-4163-6 · Cited by 13
Metadata
- Authors
- Froud, R., Eldridge, S., Lall, R., & Underwood, M.
- Venue
- BMC Medical Research Methodology
- Published
- 2009-06-11
- Volume
- 9
- Issue
- 1
- Pages
- 35-35
- ISSN
- 1471-2288 (ISSN-L)
- OpenAlex
- W2123374032
- Cited by
- 53
- References
- 8
- FWCI
- 4.10
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.