The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Apparently conclusive meta-analyses may be inconclusive—Trial sequential analysis adjustment of random error risk due to repetitive testing of accumulating data in apparently conclusive neonatal meta-analyses
Abstract
BACKGROUND: Random error may cause misleading evidence in meta-analyses. The required number of participants in a meta-analysis (i.e. information size) should be at least as large as an adequately powered single trial. Trial sequential analysis (TSA) may reduce risk of random errors due to repetitive testing of accumulating data by evaluating meta-analyses not reaching the information size with monitoring boundaries. This is analogous to sequential monitoring boundaries in a single trial. METHODS: We selected apparently conclusive (P </= 0.05) Cochrane neonatal meta-analyses. We applied heterogeneity-adjusted and unadjusted TSA on these meta-analyses by calculating the information size, the monitoring boundaries, and the cumulative Z-statistic after each trial. We identified the proportion of meta-analyses that did not reach the required information size and the proportion of these meta-analyses in which the Z-curve did not cross the monitoring boundaries. RESULTS: Of 54 apparently conclusive meta-analyses, 39 (72%) did not reach the heterogeneity-adjusted information size required to accept or reject an intervention effect of 25% relative risk reduction. Of these 39, 19 meta-analyses (49%) were considered inconclusive, because the cumulative Z-curve did not cross the monitoring boundaries. The median number of participants required to reach the required information size was 1591 (range, 339-6149). TSA without heterogeneity adjustment largely confirmed these results. CONCLUSIONS: Many apparently conclusive Cochrane neonatal meta-analyses may become inconclusive when the statistical analyses take into account the risk of random error due to repetitive testing.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Formulas containing hydrolysed protein for prevention of allergy and food intolerance in infants
Osborn, D. A., & Sinn, J. K. H. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003664.pub3 · Cited by 260
RetractedMeta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702
Moher, D., Pham, B., Jones, A., Cook, D. J., Jadad, A. R., Moher, M., Tugwell, P., & Klassen, T. P. (1998) · The Lancet · doi:10.1016/s0140-6736(98)01085-x · Cited by 3,560
A Multiple Testing Procedure for Clinical Trials
O'Brien, P. C., & Fleming, T. R. (1979) · Biometrics · doi:10.2307/2530245 · Cited by 3,311
Wood, L., Egger, M., Gluud, L. L., Schulz, K. F., Jüni, P., Altman, D. G., Gluud, C., Martin, R. M., Wood, A. J. G., & Sterne, J. A. C. (2008) · BMJ · doi:10.1136/bmj.39465.451748.ad · Cited by 2,538
Self-citationDiscrete sequential boundaries for clinical trials
GORDON LAN, K. K., & DEMETS, D. L. (1983) · Biometrika · doi:10.1093/biomet/70.3.659 · Cited by 2,310
Kjaergard, L. L., Villumsen, J., & Gluud, C. (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-135-11-200112040-00010 · Cited by 2,283
Self-citationBjelakovic, G., Nikolova, D., Gluud, L. L., Simonetti, R. G., & Gluud, C. (2007) · JAMA · doi:10.1001/jama.297.8.842 · Cited by 2,275
Self-citationTrial sequential analysis may establish when firm evidence is reached in cumulative meta-analysis
Wetterslev, J., Thorlund, K., Brok, J., & Gluud, C. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.03.013 · Cited by 1,881
Self-citationChan, A.-W., Hróbjartsson, A., Haahr, M. T., Gøtzsche, P. C., & Altman, D. G. (2004) · JAMA · doi:10.1001/jama.291.20.2457 · Cited by 1,845
Uncertainty in heterogeneity estimates in meta-analyses
Ioannidis, J. P. A., Patsopoulos, N. A., & Evangelou, E. (2007) · BMJ · doi:10.1136/bmj.39343.408449.80 · Cited by 1,254
Brok, J., Thorlund, K., Gluud, C., & Wetterslev, J. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.10.007 · Cited by 1,113
Self-citationMcGettigan, P., & Henry, D. (2006) · JAMA · doi:10.1001/jama.296.13.jrv60011 · Cited by 1,096
Methods for combining randomized clinical trials: Strengths and limitations
Demets, D. L. (1987) · Statistics in Medicine · doi:10.1002/sim.4780060325 · Cited by 1,027
Epidemiology and reporting characteristics of systematic reviews.
Moher, D., Tetzlaff, J., Tricco, A. C., Sampson, M., & Altman, D. G. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040078 · Cited by 891
Can trial sequential monitoring boundaries reduce spurious inferences from meta-analyses?
Thorlund, K., Devereaux, P. J., Wetterslev, J., Guyatt, G., Ioannidis, J. P. A., Thabane, L., Gluud, L.-L., Als-Nielsen, B., & Gluud, C. (2009) · International Journal of Epidemiology · doi:10.1093/ije/dyn179 · Cited by 833
Self-citationEarly versus delayed selective surfactant treatment for neonatal respiratory distress syndrome
Bahadue, F. L., & Soll, R. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001456.pub2 · Cited by 556
Nitric oxide for respiratory failure in infants born at or near term
Barrington, K. J., Finer, N., Pennaforte, T., & Altit, G. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000399.pub3 · Cited by 528
Dickersin, K. (2003) · JAMA · doi:10.1001/jama.290.4.516 · Cited by 512
Prophylactic intravenous indomethacin for preventing mortality and morbidity in preterm infants
Fowlie, P. W., Davis, P. G., & McGuire, W. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000174.pub2 · Cited by 480
The effectiveness and cost-effectiveness of prophylactic removal of wisdom teeth.
Song, O'Meara, Wilson, Golder, & Kleijnen (2000) · Health Technology Assessment · doi:10.3310/hta4150 · Cited by 478
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2019) · CHANCE · doi:10.1080/09332480.2019.1579573 · Cited by 463
Publication and Related Biases
Song, F., Eastwood, A., Gilbody, S., Duley, L., & Sutton, A. (2001) · The Advanced Handbook of Methods in Evidence Based Healthcare · doi:10.4135/9781848608344.n21 · Cited by 455
Devereaux, P. J., Beattie, W. S., Choi, P. T.-L., Badner, N. H., Guyatt, G. H., Villar, J. C., Cinà, C. S., Leslie, K., Jacka, M. J., Montori, V. M., et al. (2005) · BMJ · doi:10.1136/bmj.38503.623646.8f · Cited by 438
Overcoming the limitations of current meta-analysis of randomised controlled trials
Pogue, J., & Yusuf, S. (1998) · The Lancet · doi:10.1016/s0140-6736(97)08461-4 · Cited by 428
Publication and related biases.
Song, Eastwood, Gilbody, Duley, & Sutton (2000) · Health Technology Assessment · doi:10.3310/hta4100 · Cited by 427
Spiegelhalter, D. J., Myles, J. P., Jones, D. R., & Abrams, K. R. (1999) · BMJ · doi:10.1136/bmj.319.7208.508 · Cited by 421
Pogue, J. M., & Yusuf, S. (1997) · Controlled Clinical Trials · doi:10.1016/s0197-2456(97)00051-2 · Cited by 415
Restricted versus liberal water intake for preventing morbidity and mortality in preterm infants
Bell, E. F., & Acarregui, M. J. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000503.pub3 · Cited by 381
Cumulative meta-analysis of clinical trials builds evidence for exemplary medical care
Lau, J., Schmid, C. H., & Chalmers, T. C. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00106-z · Cited by 356
Extracorporeal membrane oxygenation for severe respiratory failure in newborn infants
Mugford, M., Elbourne, D., & Field, D. (2008) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001340.pub2 · Cited by 244
Moja, L. P., Telaro, E., D'Amico, R., Moschetti, I., Coe, L., & Liberati, A. (2005) · BMJ · doi:10.1136/bmj.38414.515938.8f · Cited by 239
Soll, R., & Özek, E. (1997) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000511 · Cited by 226
Continuous distending pressure for respiratory distress in preterm infants
Ho, J. J., Subramaniam, P., Henderson-Smart, D. J., & Davis, P. G. (2002) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002271 · Cited by 197
Synthetic surfactant for respiratory distress syndrome in preterm infants
Soll, R. (1998) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001149 · Cited by 194
Caffeine versus theophylline for apnea in preterm infants
Henderson-Smart, D. J., & Steer, P. A. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000273.pub2 · Cited by 187
Vitamin A supplementation for preventing morbidity and mortality in very low birthweight infants
Darlow, B., & Graham, P. (2002) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000501 · Cited by 185
Putting clinical trials into context
Young, C., & Horton, R. (2005) · The Lancet · doi:10.1016/s0140-6736(05)66846-8 · Cited by 185
Prophylactic intravenous indomethacin for preventing mortality and morbidity in preterm infants
Fowlie, P. W., & Davis, P. G. (2002) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000174 · Cited by 179
Prophylactic vitamin K for vitamin K deficiency bleeding in neonates
Puckett, R. M., & Offringa, M. (2000) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002776 · Cited by 163
Jespersen, C. M., Als-Nielsen, B., Damgaard, M., Hansen, J. F., Hansen, S., Helø, O. H., Hildebrandt, P., Hilden, J., Jensen, G. B., Kastrup, J., et al. (2006) · BMJ · doi:10.1136/bmj.38666.653600.55 · Cited by 160
Self-citationNitric oxide for respiratory failure in infants born at or near term
Finer, N., & Barrington, K. (2001) · The Cochrane Database of Systematic Reviews (Complete Reviews) · doi:10.1002/14651858.cd000399 · Cited by 158
Umbilical artery catheters in the newborn: effects of position of the catheter tip
Barrington, K. J. (1999) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000505 · Cited by 152
Hepatology may have problems with putative surrogate outcome measures
Gluud, C. N., Brok, J. S., Gong, Y., & Koretz, R. L. (2007) · Journal of Hepatology · doi:10.1016/j.jhep.2007.01.003 · Cited by 148
Self-citationAskie, L., & Henderson‐Smart, D. (2001) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001077 · Cited by 131
Rudy, E. B., Lucke, J. F., Whitman, G. R., & Davidson, L. J. (2001) · Cited by 121
Why do doctors use treatments that do not work?
Doust, J. A., & Mar, C. D. (2004) · BMJ · doi:10.1136/bmj.328.7438.474 · Cited by 111
Current controversies in data monitoring for clinical trials
Pocock, S. (2006) · Clinical Trials · doi:10.1177/1740774506073467 · Cited by 84
Uncertainty of the time of first significance in random effects cumulative meta-analysis
Berkey, C. S., Mosteller, F. C., Lau, J., & Antman, E. M. (1996) · Controlled Clinical Trials · doi:10.1016/s0197-2456(96)00014-1 · Cited by 77
Hu, M., Cappelleri, J. C., & Lan, K. K. G. (2007) · Clinical Trials · doi:10.1177/1740774507081219 · Cited by 61
The design of multicentre trials
Fedorov, V. V., & Jones, B. C. (2005) · Statistical Methods in Medical Research · doi:10.1191/0962280205sm399oa · Cited by 56
Caffeine versus theophylline for apnea in preterm infants
Steer, P. A., & Henderson-Smart, D. J. (1998) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000273 · Cited by 51
Mechanical ventilation for newborn infants with respiratory failure due to pulmonary disease
Henderson-Smart, D. J., Wilkinson, A. R., & Raynes‐Greenow, C. H. (2002) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002770 · Cited by 50
Peripheral retinal ablation for threshold retinopathy of prematurity in preterm infants
Andersen, C. C., & Phelps, D. L. (1999) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001693 · Cited by 32
Soy formula for prevention of allergy and food intolerance in infants
Osborn, D., & Sinn, J. K. H. (2004) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003741.pub2 · Cited by 30
Randomized Trials Stopped Early for Benefit: A Systematic Review
Montori, V. M., Devereaux, P. J., Adhikari, N. K. J., Burns, K. E. A., Eggert, C. H., Briel, M., Lacchetti, C., Leung, T. W., Darling, E., Bryant, D. M., et al. (2005) · JAMA · doi:10.1001/jama.294.17.2203 · Cited by 26
Meta-analysis: is moving the goal post the answer?
Egger, M., Smith, G. D., & Sterne, J. A. C. (1998) · The Lancet · doi:10.1016/s0140-6736(05)78914-5 · Cited by 14
Brok, J. S., Greisen, G. O., Jacobsen, T., Gluud, L. L., & Gluud, C. N. (2006) · Acta Paediatrica · doi:10.1111/j.1651-2227.2006.00035.x · Cited by 6
Self-citation
Cited by
Trial Sequential Analysis in systematic reviews with meta-analysis
Wetterslev, J., Jakobsen, J. C., & Gluud, C. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0315-7 · Cited by 1,189
Self-citationEstimating required information size by quantifying diversity in random-effects model meta-analyses
Wetterslev, J., Thorlund, K., Brok, J., & Gluud, C. (2009) · BMC Medical Research Methodology · doi:10.1186/1471-2288-9-86 · Cited by 938
Self-citationBjelakovic, G., Nikolova, D., Gluud, L. L., Simonetti, R. G., & Gluud, C. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007176.pub2 · Cited by 924
Self-citationPsychological therapies for people with borderline personality disorder.
Stoffers-Winterling, J. M., Völlm, B. A., Rücker, G., Timmer, A., Huband, N., & Lieb, K. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005652.pub2 · Cited by 895
Can trial sequential monitoring boundaries reduce spurious inferences from meta-analyses?
Thorlund, K., Devereaux, P. J., Wetterslev, J., Guyatt, G., Ioannidis, J. P. A., Thabane, L., Gluud, L.-L., Als-Nielsen, B., & Gluud, C. (2009) · International Journal of Epidemiology · doi:10.1093/ije/dyn179 · Cited by 833
Self-citation
Metadata
- Authors
- Brok, J., Thorlund, K., Wetterslev, J., & Gluud, C.
- Venue
- International Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2008-09-29
- Volume
- 38
- Issue
- 1
- Pages
- 287-298
- ISSN
- 0300-5771 (ISSN-L)
- 1464-3685
- OpenAlex
- W2138188443
- Cited by
- 917
- References
- 63
- FWCI
- 19.11
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.