The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Apparently conclusive meta-analyses may be inconclusive—Trial sequential analysis adjustment of random error risk due to repetitive testing of accumulating data in apparently conclusive neonatal meta-analyses
Abstract
BACKGROUND: Random error may cause misleading evidence in meta-analyses. The required number of participants in a meta-analysis (i.e. information size) should be at least as large as an adequately powered single trial. Trial sequential analysis (TSA) may reduce risk of random errors due to repetitive testing of accumulating data by evaluating meta-analyses not reaching the information size with monitoring boundaries. This is analogous to sequential monitoring boundaries in a single trial. METHODS: We selected apparently conclusive (P </= 0.05) Cochrane neonatal meta-analyses. We applied heterogeneity-adjusted and unadjusted TSA on these meta-analyses by calculating the information size, the monitoring boundaries, and the cumulative Z-statistic after each trial. We identified the proportion of meta-analyses that did not reach the required information size and the proportion of these meta-analyses in which the Z-curve did not cross the monitoring boundaries. RESULTS: Of 54 apparently conclusive meta-analyses, 39 (72%) did not reach the heterogeneity-adjusted information size required to accept or reject an intervention effect of 25% relative risk reduction. Of these 39, 19 meta-analyses (49%) were considered inconclusive, because the cumulative Z-curve did not cross the monitoring boundaries. The median number of participants required to reach the required information size was 1591 (range, 339-6149). TSA without heterogeneity adjustment largely confirmed these results. CONCLUSIONS: Many apparently conclusive Cochrane neonatal meta-analyses may become inconclusive when the statistical analyses take into account the risk of random error due to repetitive testing.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Formulas containing hydrolysed protein for prevention of allergy and food intolerance in infants
Osborn, D. A., & Sinn, J. K. H. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003664.pub3 · Cited by 260
RetractedMeta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702
Moher, D., Pham, B., Jones, A., Cook, D. J., Jadad, A. R., Moher, M., Tugwell, P., & Klassen, T. P. (1998) · The Lancet · doi:10.1016/s0140-6736(98)01085-x · Cited by 3,560
A Multiple Testing Procedure for Clinical Trials
O'Brien, P. C., & Fleming, T. R. (1979) · Biometrics · doi:10.2307/2530245 · Cited by 3,311
Wood, L., Egger, M., Gluud, L. L., Schulz, K. F., Jüni, P., Altman, D. G., Gluud, C., Martin, R. M., Wood, A. J. G., & Sterne, J. A. C. (2008) · BMJ · doi:10.1136/bmj.39465.451748.ad · Cited by 2,538
Self-citation
Cited by
Trial Sequential Analysis in systematic reviews with meta-analysis
Wetterslev, J., Jakobsen, J. C., & Gluud, C. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0315-7 · Cited by 1,189
Self-citationEstimating required information size by quantifying diversity in random-effects model meta-analyses
Wetterslev, J., Thorlund, K., Brok, J., & Gluud, C. (2009) · BMC Medical Research Methodology · doi:10.1186/1471-2288-9-86 · Cited by 938
Self-citationBjelakovic, G., Nikolova, D., Gluud, L. L., Simonetti, R. G., & Gluud, C. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007176.pub2 · Cited by 924
Self-citationPsychological therapies for people with borderline personality disorder.
Stoffers-Winterling, J. M., Völlm, B. A., Rücker, G., Timmer, A., Huband, N., & Lieb, K. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005652.pub2 · Cited by 895
Can trial sequential monitoring boundaries reduce spurious inferences from meta-analyses?
Thorlund, K., Devereaux, P. J., Wetterslev, J., Guyatt, G., Ioannidis, J. P. A., Thabane, L., Gluud, L.-L., Als-Nielsen, B., & Gluud, C. (2009) · International Journal of Epidemiology · doi:10.1093/ije/dyn179 · Cited by 833
Self-citationA meta-analysis of randomized controlled trials: Efficacy of selenium treatment for sepsis
Li, S., Tang, T., Guo, P., Zou, Q., Ao, X., Hu, L., & Tan, L. (2019) · Medicine · doi:10.1097/md.0000000000014733 · Cited by 802
Vitamin D supplementation for prevention of mortality in adults
Bjelakovic, G., Gluud, L. L., Nikolova, D., Whitfield, K., Wetterslev, J., Simonetti, R. G., Bjelakovic, M., & Gluud, C. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007470.pub3 · Cited by 695
Self-citationVirtual reality training for surgical trainees in laparoscopic surgery
Nagendran, M., Gurusamy, K. S., Aggarwal, R., Loizidou, M., & Davidson, B. R. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006575.pub3 · Cited by 593
Gabapentin for chronic neuropathic pain in adults
Wiffen, P. J., Derry, S., Bell, R. F., Rice, A. S., Tölle, T. R., Phillips, T., & Moore, R. A. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007938.pub4 · Cited by 561
Huusom, L., Secher, N., Pryds, O., Whitfield, K., Gluud, C., & Brok, J. (2011) · BJOG: An International Journal of Obstetrics & Gynaecology · doi:10.1111/j.1471-0528.2010.02782.x · Cited by 532
Self-citationUpdated Meta-analysis of Probiotics for Preventing Necrotizing Enterocolitis in Preterm Neonates
Deshpande, G., Rao, S., Patole, S., & Bulsara, M. (2010) · Pediatrics · doi:10.1542/peds.2009-1301 · Cited by 531
Surgical versus endoscopic treatment of bile duct stones
Dasari, B. V., Tan, C. J., Gurusamy, K. S., Martin, D. J., Kirk, G., McKie, L., Diamond, T., & Taylor, M. A. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003327.pub4 · Cited by 522
Homocysteine lowering interventions for preventing cardiovascular events
Martí-Carvajal, A. J., Solà, I., Lathyris, D., & Salanti, G. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006612.pub2 · Cited by 520
Psychological therapies for people with borderline personality disorder
Storebø, O. J., Stoffers-Winterling, J. M., Völlm, B. A., Kongerslev, M. T., Mattivi, J. T., Jørgensen, M. S., Faltinsen, E., Todorovac, A., Sales, C. P., Callesen, H. E., et al. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012955.pub2 · Cited by 450
Bergman, P., Lindh, Å. U., Björkhem-Bergman, L., & Lindh, J. D. (2013) · PLoS ONE · doi:10.1371/journal.pone.0065835 · Cited by 429
Holst, L. B., Petersen, M. W., Haase, N., Perner, A., & Wetterslev, J. (2015) · BMJ · doi:10.1136/bmj.h1354 · Cited by 426
Self-citationWikkelsø, A., Wetterslev, J., Møller, A. M., & Afshari, A. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007871.pub3 · Cited by 400
Self-citationJakobsen, J. C., Katakam, K. K., Schou, A., Hellmuth, S. G., Stallknecht, S. E., Leth-Møller, K., Iversen, M., Banke, M. B., Petersen, I. J., Klingenberg, S. L., et al. (2017) · BMC Psychiatry · doi:10.1186/s12888-016-1173-2 · Cited by 366
Self-citationPregabalin for neuropathic pain in adults
Derry, S., Bell, R. F., Straube, S., Wiffen, P. J., Aldington, D., & Moore, R. A. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007076.pub3 · Cited by 364
Methylphenidate for children and adolescents with attention deficit hyperactivity disorder (ADHD)
Storebø, O. J., Ramstad, E., Krogh, H. B., Nilausen, T. D., Skoog, M., Holmskov, M., Rosendal, S., Groth, C., Magnusson, F. L., Moreira-Maia, C. R., et al. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009885.pub2 · Cited by 347
Self-citationEarly versus delayed laparoscopic cholecystectomy for people with acute cholecystitis
Gurusamy, K. S., Davidson, C., Gluud, C., & Davidson, B. R. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005440.pub3 · Cited by 327
Self-citationAfshari, A., Wikkelsø, A., Brok, J., Møller, A. M., & Wetterslev, J. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007871.pub2 · Cited by 323
Self-citationEfficacy and safety of sugammadex versus neostigmine in reversing neuromuscular blockade in adults
Hristovska, A.-M., Duch, P., Allingstrup, M., & Afshari, A. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012763 · Cited by 319
Thorlund, K., Imberger, G., Walsh, M., Chu, R., Gluud, C., Wetterslev, J., Guyatt, G., Devereaux, P. J., & Thabane, L. (2011) · PLoS ONE · doi:10.1371/journal.pone.0025491 · Cited by 319
Self-citationHemmingsen, B., Gimenez-Perez, G., Mauricio, D., Roqué i Figuls, M., Metzendorf, M.-I., & Richter, B. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003054.pub4 · Cited by 316
Inhaled nitric oxide for acute respiratory distress syndrome (ARDS) in children and adults
Gebistorf, F., Karam, O., Wetterslev, J., & Afshari, A. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002787.pub3 · Cited by 298
Self-citationHemmingsen, B., Lund, S. S., Gluud, C., Vaag, A., Almdal, T. P., & Wetterslev, J. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008143.pub4 · Cited by 291
Self-citationMills (2010) · Clinical Epidemiology · doi:10.2147/clep.s9242 · Cited by 281
Imberger, G., Thorlund, K., Gluud, C., & Wetterslev, J. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-011890 · Cited by 277
Self-citationHomocysteine-lowering interventions for preventing cardiovascular events
Martí-Carvajal, A. J., Solà, I., Lathyris, D., & Dayer, M. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006612.pub5 · Cited by 275
Opioids for cancer pain - an overview of Cochrane reviews
Wiffen, P. J., Wee, B., Derry, S., Bell, R. F., & Moore, R. A. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012592.pub2 · Cited by 271
Storebø, O. J., Krogh, H. B., Ramstad, E., Moreira-Maia, C. R., Holmskov, M., Skoog, M., Nilausen, T. D., Magnusson, F. L., Zwi, M., Gillies, D., et al. (2015) · BMJ · doi:10.1136/bmj.h5203 · Cited by 209
Self-citationSample size and power considerations in network meta-analysis
Thorlund, K., & Mills, E. J. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-41 · Cited by 197
Self-citationBjelakovic, G., Nikolova, D., & Gluud, C. (2013) · PLoS ONE · doi:10.1371/journal.pone.0074558 · Cited by 183
Interventions for paracetamol (acetaminophen) overdose
Chiew, A. L., Gluud, C., Brok, J., & Buckley, N. A. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003328.pub3 · Cited by 170
Self-citationStorebø, O. J., Skoog, M., Damm, D., Thomsen, P. H., Simonsen, E., & Gluud, C. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008223.pub2 · Cited by 149
Self-citationPharmacological interventions for benzodiazepine discontinuation in chronic benzodiazepine users
Baandrup, L., Ebdrup, B. H., Rasmussen, J. Ø., Lindschou, J., Gluud, C., & Glenthøj, B. Y. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011481.pub2 · Cited by 128
Self-citationStokes, C. S., Gluud, L. L., Casper, M., & Lammert, F. (2014) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2013.11.031 · Cited by 118
Homocysteine-lowering interventions for preventing cardiovascular events
Martí-Carvajal, A. J., Solà, I., & Lathyris, D. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006612.pub4 · Cited by 113
Preventive Treatments for Psychosis: Umbrella Review (Just the Evidence)
Fusar-Poli, P., Davies, C., Solmi, M., Brondino, N., De Micheli, A., Kotlicka-Antczak, M., Shin, J. I., & Radua, J. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00764 · Cited by 108
Ultrasound Guidance Facilitates Radial Artery Catheterization
Gu, W.-J., Wu, X.-D., Wang, F., Ma, Z.-L., & Gu, X.-P. (2016) · Chest · doi:10.1378/chest.15-1784 · Cited by 109
Putzu, A., Daems, A.-M., Lopez-Delgado, J. C., Giordano, V. F., & Landoni, G. (2019) · Critical Care Medicine · doi:10.1097/ccm.0000000000003700 · Cited by 77
Jørgensen, M. S., Storebø, O. J., Stoffers-Winterling, J. M., Faltinsen, E., Todorovac, A., & Simonsen, E. (2021) · PLOS ONE · doi:10.1371/journal.pone.0245331 · Cited by 78
Hemmingsen, B., Sonne, D. P., Metzendorf, M.-I., & Richter, B. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012204.pub2 · Cited by 63
Holmskov, M., Storebø, O. J., Moreira-Maia, C. R., Ramstad, E., Magnusson, F. L., Krogh, H. B., Groth, C., Gillies, D., Zwi, M., Skoog, M., et al. (2017) · PLOS ONE · doi:10.1371/journal.pone.0178187 · Cited by 58
Self-citationGurusamy, K. S., Vaughan, J., Toon, C. D., & Davidson, B. R. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008261.pub2 · Cited by 51
Control interventions in randomised trials among people with mental health disorders
Faltinsen, E., Todorovac, A., Staxen Bruun, L., Hróbjartsson, A., Gluud, C., Kongerslev, M. T., Simonsen, E., & Storebø, O. J. (2022) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000050.pub2 · Cited by 40
Self-citationZhu, T. (2023) · Pain Physician Journal · doi:10.36076/ppj.2023.26.e761 · Cited by 42
Arulkumaran, N., Khpal, M., Tam, K., Baheerathan, A., Corredor, C., & Singer, M. (2020) · Critical Care Medicine · doi:10.1097/ccm.0000000000004267 · Cited by 36
Antibiotic therapy for adults with neurosyphilis
Buitrago-Garcia, D., Martí-Carvajal, A. J., Jimenez, A., Conterno, L. O., & Pardo, R. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011399.pub2 · Cited by 30
Prospective approaches to accumulating evidence
Thomas, J., Askie, L. M., Berlin, J. A., Elliott, J. H., Ghersi, D., Simmonds, M., Takwoingi, Y., Tierney, J. F., & Higgins, J. P. (2019) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9781119536604.ch22 · Cited by 26
Valkenburg, C., Van der Weijden, F., & Slot, D. E. (2019) · International Journal of Dental Hygiene · doi:10.1111/idh.12364 · Cited by 15
Placebo, usual care and wait-list interventions for all mental health disorders
Faltinsen, E., Todorovac, A., Hróbjartsson, A., Gluud, C., Kongerslev, M. T., Simonsen, E., & Storebø, O. J. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000050 · Cited by 9
Self-citation
Metadata
- Authors
- Brok, J., Thorlund, K., Wetterslev, J., & Gluud, C.
- Venue
- International Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2008-09-29
- Volume
- 38
- Issue
- 1
- Pages
- 287-298
- ISSN
- 0300-5771 (ISSN-L)
- 1464-3685
- OpenAlex
- W2138188443
- Cited by
- 917
- References
- 63
- FWCI
- 19.11
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.