The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Can trial sequential monitoring boundaries reduce spurious inferences from meta-analyses?
Abstract
BACKGROUND: Results from apparently conclusive meta-analyses may be false. A limited number of events from a few small trials and the associated random error may be under-recognized sources of spurious findings. The information size (IS, i.e. number of participants) required for a reliable and conclusive meta-analysis should be no less rigorous than the sample size of a single, optimally powered randomized clinical trial. If a meta-analysis is conducted before a sufficient IS is reached, it should be evaluated in a manner that accounts for the increased risk that the result might represent a chance finding (i.e. applying trial sequential monitoring boundaries). METHODS: We analysed 33 meta-analyses with a sufficient IS to detect a treatment effect of 15% relative risk reduction (RRR). We successively monitored the results of the meta-analyses by generating interim cumulative meta-analyses after each included trial and evaluated their results using a conventional statistical criterion (alpha = 0.05) and two-sided Lan-DeMets monitoring boundaries. We examined the proportion of false positive results and important inaccuracies in estimates of treatment effects that resulted from the two approaches. RESULTS: Using the random-effects model and final data, 12 of the meta-analyses yielded P > alpha = 0.05, and 21 yielded P </= alpha = 0.05. False positive interim results were observed in 3 out of 12 meta-analyses with P > alpha = 0.05. The monitoring boundaries eliminated all false positives. Important inaccuracies in estimates were observed in 6 out of 21 meta-analyses using the conventional P </= alpha = 0.05 and 0 out of 21 using the monitoring boundaries. CONCLUSIONS: Evaluating statistical inference with trial sequential monitoring boundaries when meta-analyses fall short of a required IS may reduce the risk of false positive results and important inaccurate effect estimates.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
9 retracted
Assertive community treatment for people with severe mental disorders
Marshall, M., & Lockwood, A. (1998) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001089 · Cited by 589
RetractedDoppler ultrasound for fetal assessment in high risk pregnancies
Alfirevic, Z., & Neilson, J. P. (1996) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000073 · Cited by 231
RetractedContinuous electronic heart rate monitoring for fetal assessment during labor
Thacker, S., Stroup, D., & Chang, M. (2001) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000063 · Cited by 222
RetractedInterventions for preventing or improving the outcome of delivery at or beyond term
Crowley, P. (1997) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000170 · Cited by 145
RetractedPharmacological interventions for non-ulcer dyspepsia
Moayyedi, P., Shelly, S., Deeks, J. J., Delaney, B., Innes, M., & Forman, D. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001960.pub3 · Cited by 99
RetractedDrugs versus placebo for dysthymia
de Lima, M. S., Moncrieff, J., & Soares, B. G. (2003) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001130 · Cited by 82
RetractedDaya, S., & Gunby, J. L. (2000) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002810 · Cited by 47
RetractedPharmacological interventions for non-ulcer dyspepsia
Moayyedi, P., Soo, S., Deeks, J. J., Delaney, B. C., Innes, M. A., & Forman, D. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001960.pub4 · Cited by 36
RetractedDrugs versus placebo for dysthymia
de Lima, M. S., Moncrieff, J., & Soares, B. G. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001130.pub2 · Cited by 17
RetractedQuantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Cited by
Trial Sequential Analysis in systematic reviews with meta-analysis
Wetterslev, J., Jakobsen, J. C., & Gluud, C. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0315-7 · Cited by 1,189
Self-citationBrok, J., Thorlund, K., Gluud, C., & Wetterslev, J. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.10.007 · Cited by 1,113
Self-citationEstimating required information size by quantifying diversity in random-effects model meta-analyses
Wetterslev, J., Thorlund, K., Brok, J., & Gluud, C. (2009) · BMC Medical Research Methodology · doi:10.1186/1471-2288-9-86 · Cited by 938
Self-citationBrok, J., Thorlund, K., Wetterslev, J., & Gluud, C. (2009) · International Journal of Epidemiology · doi:10.1093/ije/dyn188 · Cited by 917
Self-citationBjelakovic, G., Nikolova, D., Gluud, L. L., Simonetti, R. G., & Gluud, C. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007176.pub2 · Cited by 924
Self-citationPsychological therapies for people with borderline personality disorder.
Stoffers-Winterling, J. M., Völlm, B. A., Rücker, G., Timmer, A., Huband, N., & Lieb, K. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005652.pub2 · Cited by 895
Thresholds for the cost–effectiveness of interventions: alternative approaches
Marseille, E., Larson, B., Kazi, D. S., Kahn, J. G., & Rosen, S. (2015) · Bulletin of the World Health Organization · doi:10.2471/blt.14.138206 · Cited by 851
Jakobsen, J. C., Wetterslev, J., Winkel, P., Lange, T., & Gluud, C. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-120 · Cited by 704
“We agree with such risks, but all things considered we do argue that a conservative scenario is more ethically defensible compared to the present-day practice of implementing interventions based on weak evidence [9,25,44,45,52,79].”
BackgroundSelf-citationVitamin D supplementation for prevention of mortality in adults
Bjelakovic, G., Gluud, L. L., Nikolova, D., Whitfield, K., Wetterslev, J., Simonetti, R. G., Bjelakovic, M., & Gluud, C. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007470.pub3 · Cited by 695
Self-citationVirtual reality training for surgical trainees in laparoscopic surgery
Nagendran, M., Gurusamy, K. S., Aggarwal, R., Loizidou, M., & Davidson, B. R. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006575.pub3 · Cited by 593
Surgical versus endoscopic treatment of bile duct stones
Dasari, B. V., Tan, C. J., Gurusamy, K. S., Martin, D. J., Kirk, G., McKie, L., Diamond, T., & Taylor, M. A. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003327.pub4 · Cited by 522
Homocysteine lowering interventions for preventing cardiovascular events
Martí-Carvajal, A. J., Solà, I., Lathyris, D., & Salanti, G. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006612.pub2 · Cited by 520
Psychological therapies for people with borderline personality disorder
Storebø, O. J., Stoffers-Winterling, J. M., Völlm, B. A., Kongerslev, M. T., Mattivi, J. T., Jørgensen, M. S., Faltinsen, E., Todorovac, A., Sales, C. P., Callesen, H. E., et al. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012955.pub2 · Cited by 450
Holst, L. B., Petersen, M. W., Haase, N., Perner, A., & Wetterslev, J. (2015) · BMJ · doi:10.1136/bmj.h1354 · Cited by 426
Self-citationEvolution of Heterogeneity (I2) Estimates and Their 95% Confidence Intervals in Large Meta-Analyses
Thorlund, K., Imberger, G., Johnston, B. C., Walsh, M., Awad, T., Thabane, L., Gluud, C., Devereaux, P. J., & Wetterslev, J. (2012) · PLoS ONE · doi:10.1371/journal.pone.0039471 · Cited by 423
Self-citationWikkelsø, A., Wetterslev, J., Møller, A. M., & Afshari, A. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007871.pub3 · Cited by 400
Self-citationBarbarawi, M., Kheiri, B., Zayed, Y., Barbarawi, O., Dhillon, H., Swaid, B., Yelangi, A., Sundus, S., Bachuwa, G., Alkotob, M. L., et al. (2019) · JAMA Cardiology · doi:10.1001/jamacardio.2019.1870 · Cited by 376
Validating, augmenting and refining genome-wide association signals
Ioannidis, J. P. A., Thomas, G., & Daly, M. J. (2009) · Nature Reviews Genetics · doi:10.1038/nrg2544 · Cited by 375
Self-citationJakobsen, J. C., Katakam, K. K., Schou, A., Hellmuth, S. G., Stallknecht, S. E., Leth-Møller, K., Iversen, M., Banke, M. B., Petersen, I. J., Klingenberg, S. L., et al. (2017) · BMC Psychiatry · doi:10.1186/s12888-016-1173-2 · Cited by 366
Self-citationAutologous platelet-rich plasma for treating chronic wounds
Martinez-Zapata, M. J., Martí-Carvajal, A. J., Solà, I., Expósito, J. A., Bolíbar, I., Rodríguez, L., Garcia, J., & Zaror, C. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006899.pub3 · Cited by 367
Mills, E. J., WU, P., Chong, G., Ghement, I., Singh, S., Akl, E. A., Eyawo, O., Guyatt, G., Berwanger, O., & Briel, M. (2011) · QJM · doi:10.1093/qjmed/hcq165 · Cited by 338
Self-citationMethylphenidate for children and adolescents with attention deficit hyperactivity disorder (ADHD)
Storebø, O. J., Ramstad, E., Krogh, H. B., Nilausen, T. D., Skoog, M., Holmskov, M., Rosendal, S., Groth, C., Magnusson, F. L., Moreira-Maia, C. R., et al. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009885.pub2 · Cited by 347
Self-citationEarly versus delayed laparoscopic cholecystectomy for people with acute cholecystitis
Gurusamy, K. S., Davidson, C., Gluud, C., & Davidson, B. R. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005440.pub3 · Cited by 327
Self-citationAfshari, A., Wikkelsø, A., Brok, J., Møller, A. M., & Wetterslev, J. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007871.pub2 · Cited by 323
Self-citationEfficacy and safety of sugammadex versus neostigmine in reversing neuromuscular blockade in adults
Hristovska, A.-M., Duch, P., Allingstrup, M., & Afshari, A. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012763 · Cited by 319
Thorlund, K., Imberger, G., Walsh, M., Chu, R., Gluud, C., Wetterslev, J., Guyatt, G., Devereaux, P. J., & Thabane, L. (2011) · PLoS ONE · doi:10.1371/journal.pone.0025491 · Cited by 319
Self-citationChavez-Tapia, N. C., Barrientos-Gutierrez, T., Tellez-Avila, F., Soares-Weiser, K., Mendez-Sanchez, N., Gluud, C., & Uribe, M. (2011) · Alimentary Pharmacology & Therapeutics · doi:10.1111/j.1365-2036.2011.04746.x · Cited by 304
Self-citationAntibiotic prophylaxis for cirrhotic patients with upper gastrointestinal bleeding
Chavez-Tapia, N. C., Barrientos-Gutierrez, T., Tellez-Avila, F. I., Soares-Weiser, K., & Uribe, M. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002907.pub2 · Cited by 304
Inhaled nitric oxide for acute respiratory distress syndrome (ARDS) in children and adults
Gebistorf, F., Karam, O., Wetterslev, J., & Afshari, A. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002787.pub3 · Cited by 298
Self-citationSystematic Review of Randomized Trials on Vasoconstrictor Drugs for Hepatorenal Syndrome
Gluud, L. L., Christensen, K., Christensen, E., & Krag, A. (2010) · Hepatology · doi:10.1002/hep.23286 · Cited by 296
Self-citationHemmingsen, B., Lund, S. S., Gluud, C., Vaag, A., Almdal, T. P., & Wetterslev, J. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008143.pub4 · Cited by 291
Self-citationPatel, A., Laffan, M. A., Waheed, U., & Brett, S. J. (2014) · BMJ · doi:10.1136/bmj.g4561 · Cited by 291
Meta-Analysis in Genome-Wide Association Studies
Zeggini, E., & Ioannidis, J. P. (2009) · Pharmacogenomics · doi:10.2217/14622416.10.2.191 · Cited by 283
Self-citationMills (2010) · Clinical Epidemiology · doi:10.2147/clep.s9242 · Cited by 281
Imberger, G., Thorlund, K., Gluud, C., & Wetterslev, J. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-011890 · Cited by 277
Self-citationHomocysteine-lowering interventions for preventing cardiovascular events
Martí-Carvajal, A. J., Solà, I., Lathyris, D., & Dayer, M. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006612.pub5 · Cited by 275
Ursodeoxycholic acid for primary biliary cirrhosis
Rudic, J. S., Poropat, G., Krstic, M. N., Bjelakovic, G., & Gluud, C. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000551.pub3 · Cited by 270
Self-citationTransarterial (chemo)embolisation for unresectable hepatocellular carcinoma
Oliveri, R. S., Wetterslev, J., & Gluud, C. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004787.pub2 · Cited by 268
Self-citationEPMA, Golubnitschaja, O., & Costigliola, V. (2012) · EPMA Journal · doi:10.1186/1878-5085-3-14 · Cited by 267
Weibel, S., Jokinen, J., Pace, N. L., Schnabel, A., Hollmann, M. W., Hahnenkamp, K., Eberhart, L. H. J., Poepping, D. M., Afshari, A., & Kranke, P. (2016) · British Journal of Anaesthesia · doi:10.1093/bja/aew101 · Cited by 266
Empirical Evaluation of Very Large Treatment Effects of Medical Interventions
Pereira, T. V., Horwitz, R. I., & Ioannidis, J. P. A. (2012) · JAMA · doi:10.1001/jama.2012.13444 · Cited by 257
Self-citationStorebø, O. J., Krogh, H. B., Ramstad, E., Moreira-Maia, C. R., Holmskov, M., Skoog, M., Nilausen, T. D., Magnusson, F. L., Zwi, M., Gillies, D., et al. (2015) · BMJ · doi:10.1136/bmj.h5203 · Cited by 209
Self-citationSample size and power considerations in network meta-analysis
Thorlund, K., & Mills, E. J. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-41 · Cited by 197
Self-citationBjelakovic, G., Nikolova, D., & Gluud, C. (2013) · PLoS ONE · doi:10.1371/journal.pone.0074558 · Cited by 183
Interventions for paracetamol (acetaminophen) overdose
Chiew, A. L., Gluud, C., Brok, J., & Buckley, N. A. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003328.pub3 · Cited by 170
Self-citationPereira, T. V., & Ioannidis, J. P. A. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.12.012 · Cited by 160
Self-citationStorebø, O. J., Skoog, M., Damm, D., Thomsen, P. H., Simonsen, E., & Gluud, C. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008223.pub2 · Cited by 149
Self-citationPharmacological interventions for benzodiazepine discontinuation in chronic benzodiazepine users
Baandrup, L., Ebdrup, B. H., Rasmussen, J. Ø., Lindschou, J., Gluud, C., & Glenthøj, B. Y. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011481.pub2 · Cited by 128
Self-citationStokes, C. S., Gluud, L. L., Casper, M., & Lammert, F. (2014) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2013.11.031 · Cited by 118
Self-citationHomocysteine-lowering interventions for preventing cardiovascular events
Martí-Carvajal, A. J., Solà, I., & Lathyris, D. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006612.pub4 · Cited by 113
Panagiotou, O. A., Contopoulos-Ioannidis, D. G., & Ioannidis, J. P. A. (2013) · BMJ · doi:10.1136/bmj.f707 · Cited by 89
Self-citationPutzu, A., Daems, A.-M., Lopez-Delgado, J. C., Giordano, V. F., & Landoni, G. (2019) · Critical Care Medicine · doi:10.1097/ccm.0000000000003700 · Cited by 77
Sjövall, F., Perner, A., & Hylander Møller, M. (2017) · Journal of Infection · doi:10.1016/j.jinf.2016.11.013 · Cited by 64
Jakobsen, J. C., Hansen, J. L., Simonsen, S., Simonsen, E., & Gluud, C. (2012) · Psychological Medicine · doi:10.1017/s0033291711002236 · Cited by 63
Self-citationPersson, F., Lindhardt, M., Rossing, P., & Parving, H.-H. (2016) · Journal of the Renin-Angiotensin-Aldosterone System · doi:10.1177/1470320316652047 · Cited by 54
Gurusamy, K. S., Vaughan, J., Toon, C. D., & Davidson, B. R. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008261.pub2 · Cited by 51
Control interventions in randomised trials among people with mental health disorders
Faltinsen, E., Todorovac, A., Staxen Bruun, L., Hróbjartsson, A., Gluud, C., Kongerslev, M. T., Simonsen, E., & Storebø, O. J. (2022) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000050.pub2 · Cited by 40
Self-citationArulkumaran, N., Khpal, M., Tam, K., Baheerathan, A., Corredor, C., & Singer, M. (2020) · Critical Care Medicine · doi:10.1097/ccm.0000000000004267 · Cited by 36
Living systematic review: new inputs and challenges
Vergara-Merino, L., Verdejo, C., Carrasco, C., & Vargas-Peirano, M. (2020) · Medwave · doi:10.5867/medwave.2020.11.8092 · Cited by 18
Prospective approaches to accumulating evidence
Thomas, J., Askie, L. M., Berlin, J. A., Elliott, J. H., Ghersi, D., Simmonds, M., Takwoingi, Y., Tierney, J. F., & Higgins, J. P. (2019) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9781119536604.ch22 · Cited by 26
Placebo, usual care and wait-list interventions for all mental health disorders
Faltinsen, E., Todorovac, A., Hróbjartsson, A., Gluud, C., Kongerslev, M. T., Simonsen, E., & Storebø, O. J. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000050 · Cited by 9
Self-citation
Metadata
- Authors
- Thorlund, K., Devereaux, P. J., Wetterslev, J., Guyatt, G., Ioannidis, J. P. A., Thabane, L., Gluud, L.-L., Als-Nielsen, B., & Gluud, C.
- Venue
- International Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2008-09-29
- Volume
- 38
- Issue
- 1
- Pages
- 276-286
- ISSN
- 0300-5771 (ISSN-L)
- 1464-3685
- OpenAlex
- W2110970000
- Cited by
- 833
- References
- 68
- FWCI
- 29.97
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.