CoChat

A meta‐epidemiological study to examine the association between bias and treatment effects in neonatal trials

Bialy, Liza, Vandermeer, Ben, Lacaze‐Masmonteil, Thierry, Dryden, Donna M., Hartling, Lisa · 2014 · Evidence-Based Child Health: A Cochrane Review Journal
Cited by 46

The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.

Abstract

Background: Randomized controlled trials are considered the gold standard for evidence on therapeutic interventions; however, they are susceptible to bias. The objectives of this observational study were to describe the methodological quality of neonatal randomized controlled trials and quantify the bias related to specific methodological and study‐level characteristics. Methods: Twenty‐five systematic reviews yielding 208 neonatal trials were included. Two independent reviewers assessed risk of bias (RoB) on seven domains consisting of nine items. For each domain, meta‐analyses with at least one high/unclear and one low risk study were included in the analysis. For the primary outcome within each meta‐analysis a ratio of odds ratios with a 95% confidence interval was generated. The ratio of odds ratios for each meta‐analysis were combined using meta‐analytic techniques with inverse‐variance weighting and a random effects model to obtain a summary ratio of odds ratio. Results: None of the studies had an overall low RoB. Most studies had a low RoB for the domain of incomplete outcome data (89%), while 63%, 55% and 46% of trials had low RoB for sequence generation, other sources of bias, and blinding of outcome assessors, respectively. For all other domains (allocation concealment, blinding of parents and investigators and selective outcome reporting), the majority of trials were assessed as unclear. Selective outcome reporting was rated as unclear RoB for 55% and high for 42% of studies. The only domain that showed a statistically significant association with the treatment effect was selective outcome reporting: trials at unclear/high risk of bias for this domain significantly overestimated the treatment effects compared with those assessed at low risk of bias (ROR = 1.87, 95% confidence interval: 1.26–2.78). Conclusions: This observational study of a sample of neonatal trials showed that most were at high risk of bias, indicating that there is room for improvement in the design, conduct and reporting of neonatal trials to ensure valid results for the most clinically important outcomes. We did not find an association between most risk of bias domains and effect estimates; however, we found that randomized controlled trials at high risk for selective outcome reporting were associated with overestimates of treatment benefits. These results need to be confirmed in larger samples.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1002/ebch.1985

Cites

18 of 18 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Cited by

See all 46

Metadata

Authors
Bialy, L., Vandermeer, B., Lacaze‐Masmonteil, T., Dryden, D. M., & Hartling, L.
Venue
Evidence-Based Child Health: A Cochrane Review Journal
Publisher
Wiley
Published
2014-12
Volume
9
Issue
4
Pages
1052-1059
ISSN
1557-6272 (ISSN-L)
OpenAlex
W1596348198
Cited by
46
References
18
FWCI
2.88
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.