The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Can trial sequential monitoring boundaries reduce spurious inferences from meta-analyses?
Abstract
BACKGROUND: Results from apparently conclusive meta-analyses may be false. A limited number of events from a few small trials and the associated random error may be under-recognized sources of spurious findings. The information size (IS, i.e. number of participants) required for a reliable and conclusive meta-analysis should be no less rigorous than the sample size of a single, optimally powered randomized clinical trial. If a meta-analysis is conducted before a sufficient IS is reached, it should be evaluated in a manner that accounts for the increased risk that the result might represent a chance finding (i.e. applying trial sequential monitoring boundaries). METHODS: We analysed 33 meta-analyses with a sufficient IS to detect a treatment effect of 15% relative risk reduction (RRR). We successively monitored the results of the meta-analyses by generating interim cumulative meta-analyses after each included trial and evaluated their results using a conventional statistical criterion (alpha = 0.05) and two-sided Lan-DeMets monitoring boundaries. We examined the proportion of false positive results and important inaccuracies in estimates of treatment effects that resulted from the two approaches. RESULTS: Using the random-effects model and final data, 12 of the meta-analyses yielded P > alpha = 0.05, and 21 yielded P </= alpha = 0.05. False positive interim results were observed in 3 out of 12 meta-analyses with P > alpha = 0.05. The monitoring boundaries eliminated all false positives. Important inaccuracies in estimates were observed in 6 out of 21 meta-analyses using the conventional P </= alpha = 0.05 and 0 out of 21 using the monitoring boundaries. CONCLUSIONS: Evaluating statistical inference with trial sequential monitoring boundaries when meta-analyses fall short of a required IS may reduce the risk of false positive results and important inaccurate effect estimates.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
9 retracted
Assertive community treatment for people with severe mental disorders
Marshall, M., & Lockwood, A. (1998) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001089 · Cited by 589
RetractedDoppler ultrasound for fetal assessment in high risk pregnancies
Alfirevic, Z., & Neilson, J. P. (1996) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000073 · Cited by 231
RetractedContinuous electronic heart rate monitoring for fetal assessment during labor
Thacker, S., Stroup, D., & Chang, M. (2001) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000063 · Cited by 222
RetractedInterventions for preventing or improving the outcome of delivery at or beyond term
Crowley, P. (1997) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000170 · Cited by 145
RetractedPharmacological interventions for non-ulcer dyspepsia
Moayyedi, P., Shelly, S., Deeks, J. J., Delaney, B., Innes, M., & Forman, D. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001960.pub3 · Cited by 99
RetractedDrugs versus placebo for dysthymia
de Lima, M. S., Moncrieff, J., & Soares, B. G. (2003) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001130 · Cited by 82
RetractedDaya, S., & Gunby, J. L. (2000) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002810 · Cited by 47
RetractedPharmacological interventions for non-ulcer dyspepsia
Moayyedi, P., Soo, S., Deeks, J. J., Delaney, B. C., Innes, M. A., & Forman, D. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001960.pub4 · Cited by 36
RetractedDrugs versus placebo for dysthymia
de Lima, M. S., Moncrieff, J., & Soares, B. G. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001130.pub2 · Cited by 17
RetractedQuantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Self-citationSchulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702
Self-citationMoher, D., Pham, B., Jones, A., Cook, D. J., Jadad, A. R., Moher, M., Tugwell, P., & Klassen, T. P. (1998) · The Lancet · doi:10.1016/s0140-6736(98)01085-x · Cited by 3,560
A Multiple Testing Procedure for Clinical Trials
O'Brien, P. C., & Fleming, T. R. (1979) · Biometrics · doi:10.2307/2530245 · Cited by 3,311
Nicotine replacement therapy for smoking cessation
Stead, L. F., Perera, R., Bullen, C., Mant, D., Hartmann-Boyce, J., Cahill, K., & Lancaster, T. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000146.pub4 · Cited by 2,464
Discrete sequential boundaries for clinical trials
GORDON LAN, K. K., & DEMETS, D. L. (1983) · Biometrika · doi:10.1093/biomet/70.3.659 · Cited by 2,310
Kjaergard, L. L., Villumsen, J., & Gluud, C. (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-135-11-200112040-00010 · Cited by 2,283
Self-citationPhysician advice for smoking cessation
Stead, L. F., Buitrago, D., Preciado, N., Sanchez, G., Hartmann-Boyce, J., & Lancaster, T. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000165.pub4 · Cited by 1,955
Trial sequential analysis may establish when firm evidence is reached in cumulative meta-analysis
Wetterslev, J., Thorlund, K., Brok, J., & Gluud, C. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.03.013 · Cited by 1,881
Self-citationChan, A.-W., Hróbjartsson, A., Haahr, M. T., Gøtzsche, P. C., & Altman, D. G. (2004) · JAMA · doi:10.1001/jama.291.20.2457 · Cited by 1,845
Garg, R. (1995) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1995.03520420066040 · Cited by 1,771
Statistical Methods in Medical Research
Lachenbruch, P. A. (1972) · Technometrics · doi:10.1080/00401706.1972.10488903 · Cited by 1,703
Sterne, J. A. C. (2001) · BMJ · doi:10.1136/bmj.322.7280.226 · Cited by 1,466
Uncertainty in heterogeneity estimates in meta-analyses
Ioannidis, J. P. A., Patsopoulos, N. A., & Evangelou, E. (2007) · BMJ · doi:10.1136/bmj.39343.408449.80 · Cited by 1,254
Self-citationColloids versus crystalloids for fluid resuscitation in critically ill patients
Perel, P., Roberts, I., & Ker, K. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000567.pub6 · Cited by 1,115
Anti-fibrinolytic use for minimising perioperative allogeneic blood transfusion
Henry, D. A., Carless, P. A., Moxey, A. J., O’Connell, D. L., Stokes, B., Fergusson, D. A., & Ker, K. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001886.pub4 · Cited by 1,065
Nicotine replacement therapy for smoking cessation
Silagy, C., Lancaster, T., Stead, L., Mant, D., & Fowler, G. (2004) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000146.pub2 · Cited by 972
Brok, J., Thorlund, K., Wetterslev, J., & Gluud, C. (2009) · International Journal of Epidemiology · doi:10.1093/ije/dyn188 · Cited by 917
Self-citationInterventions for smoking cessation in hospitalised patients
Rigotti, N. A., Clair, C., Munafò, M. R., & Stead, L. F. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001837.pub3 · Cited by 751
Carroli, G., & Mignini, L. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000081.pub2 · Cited by 701
Why do we need some large, simple randomized trials?
Yusuf, S., Collins, R., & Peto, R. (1984) · Statistics in Medicine · doi:10.1002/sim.4780030421 · Cited by 699
The power of statistical tests for moderators in meta-analysis
Hedges, L. V., & Pigott, T. D. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.4.426 · Cited by 672
Ioannidis, J. P. A. (1998) · JAMA · doi:10.1001/jama.279.4.281 · Cited by 632
Self-citationChan, A.-W., & Altman, D. G. (2005) · BMJ · doi:10.1136/bmj.38356.424606.8f · Cited by 613
Support for breastfeeding mothers
Britton, C., McCormick, F. M., Renfrew, M. J., Wade, A., & King, S. E. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001141.pub3 · Cited by 567
Dickersin, K. (2003) · JAMA · doi:10.1001/jama.290.4.516 · Cited by 512
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2019) · CHANCE · doi:10.1080/09332480.2019.1579573 · Cited by 463
Self-citationDevereaux, P. J., Beattie, W. S., Choi, P. T.-L., Badner, N. H., Guyatt, G. H., Villar, J. C., Cinà, C. S., Leslie, K., Jacka, M. J., Montori, V. M., et al. (2005) · BMJ · doi:10.1136/bmj.38503.623646.8f · Cited by 438
Self-citationOvercoming the limitations of current meta-analysis of randomised controlled trials
Pogue, J., & Yusuf, S. (1998) · The Lancet · doi:10.1016/s0140-6736(97)08461-4 · Cited by 428
Meta-analysis of randomised controlled trials
Kelly, C. P. (1997) · The Lancet · doi:10.1016/s0140-6736(05)63834-2 · Cited by 382
Anticoagulants for acute ischaemic stroke
Sandercock, P. A., Counsell, C., & Kamal, A. K. (2008) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000024.pub3 · Cited by 346
Carroli, G., & Belizan, J. (1999) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000081 · Cited by 339
Cardiac rupture, mortality and the timing of thrombolytic therapy: A meta-analysis
Honan, M. B., Harrell, F. E., Reimer, K. A., Califf, R. M., Mark, D. B., Pryor, D. B., & Hlatky, M. A. (1990) · Journal of the American College of Cardiology · doi:10.1016/0735-1097(90)90586-e · Cited by 278
Calcium antagonists in patients with aneurysmal subarachnoid hemorrhage: A systematic review
Feigin, V. L., Rinkel, G. J. E., Algra, A., Vermeulen, M., & van Gijn, J. (1998) · Neurology · doi:10.1212/wnl.50.4.876 · Cited by 271
Physician advice for smoking cessation
Silagy, C., & Stead, L. (2001) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000165 · Cited by 218
Malone, D., Marriott, S. V. L., Newton-Howes, G., Simmonds, S., & Tyrer, P. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000270.pub2 · Cited by 209
Putting clinical trials into context
Young, C., & Horton, R. (2005) · The Lancet · doi:10.1016/s0140-6736(05)66846-8 · Cited by 185
Risperidone versus typical antipsychotic medication for schizophrenia
Hunter, R., Kennedy, E., Song, F., Gadon, L., & Irving, C. B. (2003) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000440 · Cited by 183
Effect sizes in cumulative meta-analyses of mental health randomized trials evolved over time
Trikalinos, T. A., Churchill, R., Ferri, M., Leucht, S., Tuunainen, A., Wahlbeck, K., & Ioannidis, J. P. A. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.02.018 · Cited by 177
Self-citationUmbilical artery catheters in the newborn: effects of position of the catheter tip
Barrington, K. J. (1999) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000505 · Cited by 152
Stopping rules and estimation problems in clinical trials
Hughes, M. D., & Pocock, S. (1988) · Statistics in Medicine · doi:10.1002/sim.4780071204 · Cited by 127
Colloids versus crystalloids for fluid resuscitation in critically ill patients
Alderson, P., Schierhout, G., Roberts, I., & Bunn, F. (2000) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000567 · Cited by 111
Required sample size and nonreplicability thresholds for heterogeneous genetic associations
Moonesinghe, R., Khoury, M. J., Liu, T., & Ioannidis, J. P. A. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0705554105 · Cited by 107
Self-citationPharmacotherapy for hypertension in the elderly
Mulrow, C. D., Lau, J., Cornell, J., & Brand, M. (1998) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000028 · Cited by 106
Anti-fibrinolytic use for minimising perioperative allogeneic blood transfusion
Henry, D. A., Moxey, A. J., Carless, P. A., O’Connell, D. L., McClelland, B., Henderson, K., Sly, K. A., Laupacis, A., & Fergusson, D. A. (1999) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001886 · Cited by 95
The fading of reported effectiveness. A meta-analysis of randomised controlled trials
Gehr, B., Weiß, C., & Porzsolt, F. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-25 · Cited by 90
Siersma, V., Als-Nielsen, B. E. T., Chen, W., Hilden, J., Gluud, L. L., & Gluud, C. N. (2006) · Statistics in Medicine · doi:10.1002/sim.2752 · Cited by 86
Self-citationCurrent controversies in data monitoring for clinical trials
Pocock, S. (2006) · Clinical Trials · doi:10.1177/1740774506073467 · Cited by 84
Interventions for smoking cessation in hospitalised patients
Rigotti, N. A., Munafo, M. R., Murphy, M., & Stead, L. (2002) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001837 · Cited by 81
Uncertainty of the time of first significance in random effects cumulative meta-analysis
Berkey, C. S., Mosteller, F. C., Lau, J., & Antman, E. M. (1996) · Controlled Clinical Trials · doi:10.1016/s0197-2456(96)00014-1 · Cited by 77
Anticoagulants for acute ischaemic stroke
Gubitz, G., Counsell, C., Sandercock, P. A., & Signorini, D. (1999) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000024 · Cited by 60
Interventions for preventing or improving the outcome of delivery at or beyond term
Crowley, P. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000170.pub2 · Cited by 50
Progestagens for endometrial cancer
Martin-Hirsch, P. P., Jarvis, G. G., Kitchener, H. C., & Lilford, R. J. (1999) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001040 · Cited by 46
Oral corticosteroids for acute exacerbations of chronic obstructive pulmonary disease
Wood-Baker, R. R., Walters, E. H., & Gibson, P. G. (2001) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001288 · Cited by 46
Randomized Trials Stopped Early for Benefit: A Systematic Review
Montori, V. M., Devereaux, P. J., Adhikari, N. K. J., Burns, K. E. A., Eggert, C. H., Briel, M., Lacchetti, C., Leung, T. W., Darling, E., Bryant, D. M., et al. (2005) · JAMA · doi:10.1001/jama.294.17.2203 · Cited by 26
Self-citationRisperidone versus typical antipsychotic medication for schizophrenia
Carpenter, W. T. (2000) · Current Psychiatry Reports · doi:10.1007/s11920-000-0017-3 · Cited by 16
Support for breastfeeding mothers.
Anderson, T. E. (1999) · PubMed · Cited by 5
Cited by
Trial Sequential Analysis in systematic reviews with meta-analysis
Wetterslev, J., Jakobsen, J. C., & Gluud, C. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0315-7 · Cited by 1,189
Self-citationBrok, J., Thorlund, K., Gluud, C., & Wetterslev, J. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.10.007 · Cited by 1,113
Self-citationEstimating required information size by quantifying diversity in random-effects model meta-analyses
Wetterslev, J., Thorlund, K., Brok, J., & Gluud, C. (2009) · BMC Medical Research Methodology · doi:10.1186/1471-2288-9-86 · Cited by 938
Self-citationBrok, J., Thorlund, K., Wetterslev, J., & Gluud, C. (2009) · International Journal of Epidemiology · doi:10.1093/ije/dyn188 · Cited by 917
Self-citationBjelakovic, G., Nikolova, D., Gluud, L. L., Simonetti, R. G., & Gluud, C. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007176.pub2 · Cited by 924
Self-citation
Metadata
- Authors
- Thorlund, K., Devereaux, P. J., Wetterslev, J., Guyatt, G., Ioannidis, J. P. A., Thabane, L., Gluud, L.-L., Als-Nielsen, B., & Gluud, C.
- Venue
- International Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2008-09-29
- Volume
- 38
- Issue
- 1
- Pages
- 276-286
- ISSN
- 0300-5771 (ISSN-L)
- 1464-3685
- OpenAlex
- W2110970000
- Cited by
- 833
- References
- 68
- FWCI
- 29.97
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.