The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Simpson's paradox and calculation of number needed to treat from meta-analysis
Open accessAbstract
BACKGROUND: Calculation of numbers needed to treat (NNT) is more complex from meta-analysis than from single trials. Treating the data as if it all came from one trial may lead to misleading results when the trial arms are imbalanced. DISCUSSION: An example is shown from a published Cochrane review in which the benefit of nursing intervention for smoking cessation is shown by formal meta-analysis of the individual trial results. However if these patients were added together as if they all came from one trial the direction of the effect appears to be reversed (due to Simpson's paradox). Whilst NNT from meta-analysis can be calculated from pooled Risk Differences, this is unlikely to be a stable method unless the event rates in the control groups are very similar. Since in practice event rates vary considerably, the use a relative measure, such as Odds Ratio or Relative Risk is advocated. These can be applied to different levels of baseline risk to generate a risk specific NNT for the treatment. SUMMARY: The method used to calculate NNT from meta-analysis should be clearly stated, and adding the patients from separate trials as if they all came from one trial should be avoided.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“On the other hand, unlike risk ratios which “may be fairly independent of the patients’ baseline risk status,” ARR and NNT measures can be pooled together in meta-analyses if “the event rates in the control groups are very similar” [27].”
From Relative risk reduction: Misinformative measure in clinical trials and COVID-19 vaccine efficacy (2022) · cites this paper as [27]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Meta-analysis: Principles and procedures
Egger, M., Smith, G. D., & Phillips, A. N. (1997) · BMJ · doi:10.1136/bmj.315.7121.1533 · Cited by 2,415
Systematic Reviews in Health Care : Meta-Analysis in Context
Egger, M., Smith, G. D., & Altman, D. G. (2000) · Cited by 2,312
Systematic Reviews in Health Care: Meta‐analysis in Context
Pittler, M. (2010) · Focus on Alternative and Complementary Therapies · doi:10.1111/j.2042-7166.2002.tb05479.x · Cited by 1,639
Systematic Reviews in Health Care. Meta-analysis in Context.
Kleijnen, J., & Antes, G. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.3.697 · Cited by 1,374
Confidence intervals for the number needed to treat.
Altman, D. G. (1998) · BMJ · doi:10.1136/bmj.317.7168.1309 · Cited by 938
Nursing interventions for smoking cessation
Rice, V. H., & Stead, L. F. (2008) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001188.pub3 · Cited by 662
On Simpson's Paradox and the Sure-Thing Principle
Blyth, C. R. (1972) · Journal of the American Statistical Association · doi:10.1080/01621459.1972.10482387 · Cited by 640
Numbers needed to treat derived from meta-analyses---sometimes informative, usually misleading
Smeeth, L. L., Haines, A., & Ebrahim, S. B. J. (1999) · BMJ · doi:10.1136/bmj.318.7197.1548 · Cited by 299
Smoking Cessation in Hospitalized Patients
Miller, N. H. (1997) · Archives of Internal Medicine · doi:10.1001/archinte.1997.00440250059007 · Cited by 200
Effect Measures for Meta‒Analysis of Trials with Binary Outcomes
Deeks, J. J., & Altman, D. G. (2001) · doi:10.1002/9780470693926.ch16 · Cited by 176
Research works printed but not linked: 1
- Senn S: At Odds with reality. BMJ Rapid Response. [http://www.bmj.com/cgi/eletters/318/7197/1548#EL2]
Cited by
Sorted by citations
Items 201–250 of 250
Long-term Risk of Cardiovascular Events With Rosiglitazone: A Meta-analysis
Singh, S., Loke, Y. K., & Furberg, C. D. (2007) · JAMA · doi:10.1001/jama.298.10.1189 · Cited by 5
How to interpret the number needed to treat for clinicians
Chesnaye, N. C., Ortíz, A., van Diepen, M., Dekker, F. W., Zoccali, C., Tripepi, G. L., Jager, K. J., & Stel, V. S. (2025) · Nephrology Dialysis Transplantation · doi:10.1093/ndt/gfaf168 · Cited by 6
Meta-analysis for functions of heterogeneous multivariate effect sizes
Hafdahl, A. R. (2009) · Open Scholarship Institutional Repository (Washington University in St. Louis) · doi:10.7936/k7p55kj8 · Cited by 5
Data based medicine and clinical judgement
Healy, D., Mangin, D. A., & Antonuccio, D. O. (2013) · International Journal of Risk & Safety in Medicine · doi:10.3233/jrs-130588 · Cited by 5
Using Epidemiological Data to Address Psychological Questions about Pedestrian Behaviour
Dunbar, G. L. (2005) · Elsevier eBooks · doi:10.1016/b978-008044379-9/50157-6 · Cited by 5
Using Absolute Event Rates to See What Works in Cardiovascular Medicine
Bittl, J. A., & Maron, D. J. (2017) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2017.07.764 · Cited by 5
Tleyjeh, I. M., Abdulhak, A. A. B., Riaz, M. A., Garbati, M. A., Al-Tannir, M. A., Alasmari, F. A., Alghamdi, M. A. A., Khan, A. R., Erwin, P. J., Sutton, A. J., et al. (2013) · PLoS ONE · doi:10.1371/annotation/56f8945c-33f6-45bf-87ce-dd512f7c25b0 · Cited by 5
Sun, Y. M., Sun, M., Zeng, X., Je, L. X., & Guo, Z. S. (2024) · Acta Diabetologica · doi:10.1007/s00592-024-02413-y · Cited by 7
Interpretation of treatment effects in periodontal research: a note on the number needed to treat.
Stoner, J. A., & Payne, J. B. (2008) · PubMed · Cited by 4
Bahorik, A. L., Queen, C., Chen, S., Foster, L. J. J., & Bangs, R. L. (2015) · Journal of Social Work Practice in the Addictions · doi:10.1080/1533256x.2015.1027446 · Cited by 4
Nasiri, M. J., Fardsanei, F., Arshadi, M., Deihim, B., Khalili, F., Dadashi, M., Goudarzi, M., & Mirsaeidi, M. S. (2021) · New Microbes and New Infections · doi:10.1016/j.nmni.2021.100886 · Cited by 4
Cochrane review: Written action plans for asthma in children
Bhogal, S. K., Zemek, R. L., & Ducharme, F. M. (2007) · Evidence-Based Child Health A Cochrane Review Journal · doi:10.1002/ebch.131 · Cited by 4
Follmann, M., Sterry, W., & Rzany, B. B. (2005) · JDDG Journal der Deutschen Dermatologischen Gesellschaft · doi:10.1111/j.1610-0387.2005.05062.x · Cited by 4
Gordon, M. A. (2014) · University of Salford Institutional Repository (University of Salford) · Cited by 4
Anticoagulants for Atrial Fibrillation in Survivors of Intracranial Hemorrhage
Chi, K.-Y., Chang, Y., Lee, P., Rossi, R., Lin, Y.-S., Akman, Z., Varrias, D., Damluji, A. A., & Nanna, M. G. (2025) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2025.04.069 · Cited by 3
État de lieux des pratiques du dépistage des violences conjugales en Auvergne
Cillart, L., Parayre, I., Pereira, B., Desmartin, C., & Leymarie, M.-C. (2017) · Sages-Femmes · doi:10.1016/j.sagf.2017.08.004 · Cited by 3
Bittl, J. A. (2016) · Current Cardiology Reports · doi:10.1007/s11886-015-0683-8 · Cited by 3
Meral, Y., Boysan, M., Sandıkçı, T., Çalışkan, Y., Haşimoğlu, A., Doğangün, B., & Kadak, M. (2021) · Current Psychology · doi:10.1007/s12144-021-01959-2 · Cited by 3
Nigdelis, M. P., Lambrinoudaki, I. V., & Goulis, D. G. (2019) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2019.11.005 · Cited by 3
The use of ultrasound guidance for perioperative neuraxial and peripheral nerve blocks in children
Guay, J. M. Y., & Suresh, S. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011436 · Cited by 3
Vargas, J. A. H., Ballesteros, A. L., Solano, M. H., Valbuena‐Garcia, A. M., & Acuña, L. (2020) · Haemophilia · doi:10.1111/hae.14136 · Cited by 2
Interventions for helping people recognise early signs of recurrence in depression
Lenora, R., Kumar, A., Uphoff, E., Meader, N., & Furtado, V. A. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013383 · Cited by 2
Extended Dual Antiplatelet Therapy in Patients With Prior Myocardial Infarction
Bittl, J. A., Bates, E., & Kaul, S. (2016) · JAMA Cardiology · doi:10.1001/jamacardio.2016.2252 · Cited by 2
Number Needed to Treat: Overview
Bender, R. (2017) · Wiley StatsRef: Statistics Reference Online · doi:10.1002/9781118445112.stat04972.pub2 · Cited by 2
Sequential versus standard triple therapy for Helicobacter pylori eradication
Nyssen, O. P., McNicholl, A. G., Mégraud, F., Savarino, V., Oderda, G., Fallone, C. A., Fischbach, L. A., Bazzoli, F., & Gisbert, J. P. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009034 · Cited by 2
Gudi, S., Saini, D. K., Singh, G., Halladakeri, P., Shamshad, M., Tanin, M. J., Kumar, P., & Sharma, A. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.11.24.469810 · Cited by 2
Usefulness of statistics for establishing evidence‐based reproductive medicine
Sato, Y., Gosho, M., & Toshimori, K. (2011) · Reproductive Medicine and Biology · doi:10.1007/s12522-011-0106-5 · Cited by 1
The significance of NNT parameter for the evaluation of therapy effectiveness
Potemkowski, A. (2016) · Aktualności Neurologiczne · doi:10.15557/an.2016.0022 · Cited by 1
Quantitative Research in Healthcare Simulation: An Introduction and Discussion of Common Pitfalls
Calhoun, A. W., Hui, J., & Scerbo, M. W. (2019) · Springer eBooks · doi:10.1007/978-3-030-26837-4_21 · Cited by 1
Alsalemi, N., Sadowski, C., Elftouh, N., Kilpatrick, K., Houle, S. J. D., Leclerc, S., Fernandez, N., & Lafrance, J. (2024) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2023-100869
Interventions for helping people recognise early signs of recurrence in bipolar disorder
Gupta, S., Wright, L. A., Onwuchekwa, O., Meader, N., Kenny, R. P. W., Steele, R., Morriss, R. K., Alla, L. R., & Gupta, N. (2025) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd015343.pub2 · Cited by 1
Efficacy of the Treatments Used in Multiple Sclerosis: From Meta-analysis to Number Needed to Treat
Ruíz, A., Izquierdo‐Ayuso, G., Mascarell, G. N., Gálvez, A. C. M., Crespo, F. M., Sánchez, F. J., Correa, M., & Soler, N. G. (2016) · Clinical Neuropharmacology · doi:10.1097/wnf.0000000000000201 · Cited by 1
A Bootstrapping Assessment on A U.S. Education Indicator Construction Through Multiple Imputation
Wang, J. (2020) · Social Indicators Research · doi:10.1007/s11205-020-02507-4 · Cited by 1
Building a dose toxo-equivalence model from a Bayesian meta-analysis of published clinical trials
Sigworth, E. A., Rubinstein, S. M., Warner, J. L., Chen, Y., & Chen, Q. (2023) · The Annals of Applied Statistics · doi:10.1214/23-aoas1748 · Cited by 1
Using Ticagrelor to Prevent Recurrent Type 1 and Type 2 Myocardial Infarctions: Boon or Bane?
Bittl, J. A. (2018) · Journal of the American Heart Association · doi:10.1161/jaha.118.010996 · Cited by 1
Simpson's Paradox in Psychology
Mangalam, M. (2022) · doi:10.1093/obo/9780199828340-0301 · Cited by 1
Kanukula, R., Page, M. J., Turner, S., & McKenzie, J. E. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4621570 · Cited by 1
Response from the authors: As-needed ICS/formoterol or as-needed SABA in mild asthma?
Papi, A. A., Ferreira, D. S., Tonia, T., & Schleich, F. (2024) · European Respiratory Journal · doi:10.1183/13993003.00395-2024 · Cited by 1
Long-acting beta2-agonists for chronic obstructive pulmonary disease: serious adverse events
Brożek, J., Akl, E. A., Jaeschke, R., Terrenato, I., Cilenti, V., Cazzola, M., Fabbri, L. M., O’Byrne, P. M., Guyatt, G. H., & Schünemann, H. J. (2008) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007200
Hassanein, M., & Carbone, D. P. (2014) · Lung Cancer · doi:10.1002/9781118468791.ch5
Best of N Contests: Implications of Simpson's Paradox in Tennis
Wright, B. (2012)
Long-acting beta2-agonists for chronic obstructive pulmonary disease: serious adverse events
Brożek, J., Akl, E. A., Jaeschke, R., Terrenato, I., Cilenti, V., Cazzola, M., Fabbri, L. M., O’Byrne, P. M., & Guyatt, G. H. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007200.pub2
Number Needed to Treat: Overview
Bender, R. (2014) · Wiley StatsRef: Statistics Reference Online · doi:10.1002/9781118445112.stat04972
Hedlin, H., Tobback, E., Lee, J., Wang, Y., Dragoni, I., Anthony, D. C., Dhaliwal, K., Norrie, J. D., Halford, S. E. R., Gotés, J., et al. (2024) · medRxiv · doi:10.1101/2024.05.15.24307072
Zhou, C., Fabiano, N., Wong, S., Højlund, M., Shorr, R., Sabé, M., Campana, M., Hyde, J., Brandt, V. C., Cortese, S., et al. (2026) · The Canadian Journal of Psychiatry · doi:10.1177/07067437261457224
Metabolic syndrome and obstructive sleep apnea: two sides of the same coin
Lacki, O., & Iftikhar, I. H. (2026) · SLEEP · doi:10.1093/sleep/zsag173
Metadata
- Authors
- Cates, C. J.
- Corresponding author
- Cates, Christopher J
- ORCID
- Cates, Christopher J
- Venue
- BMC Medical Research Methodology
- Published
- 2002-01-25
- Volume
- 2
- Issue
- 1
- Pages
- 1-1
- ISSN
- 1471-2288 (ISSN-L)
- PMC
- PMC65632
- OpenAlex
- W1576173198
- Cited by
- 251
- References
- 17
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 7 · 2023: 3 · 2022: 3 · 2021: 20 · 2020: 13 · 2019: 14 · 2018: 16 · 2017: 22 · 2016: 23 · 2015: 8 · 2014: 13 · 2013: 13 · 2012: 10
- FWCI
- 10.16
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- BMC Medical Research Methodology (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion, other-oa)
- PubMed Central (publishedVersion, other-oa)
- PubMed (publishedVersion)
- St George's Online Research Archive (St George's University of London) (acceptedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- Simpson's paradox, number needed to treat, meta-analysis, risk difference, odds ratio, relative risk, baseline risk, smoking cessation, nursing interventions
- MeSH terms
- Clinical Trials as Topic, Data Interpretation, Statistical, Humans, Statistics as Topic, Meta-Analysis as Topic, Reproducibility of Results, Bias, Odds Ratio, Smoking Cessation, Sample Size
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review