CoChat
Sign Up
Cited by 295Meta-analysis and systematic reviewsStatistical Methods in Clinical TrialsStatistical Methods in Epidemiology

The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.

Small studies may overestimate the effect sizes in critical care meta-analyses: a meta-epidemiological study

Open access
Zhang, Zhongheng, Xu, Xiao, Ni, Hongying·2013·Critical Care
DOI 10.1186/cc11919PMC PMC4056100
Open this paper in CoChat — free accountOpen PDF

Abstract

INTRODUCTION: Small-study effects refer to the fact that trials with limited sample sizes are more likely to report larger beneficial effects than large trials. However, this has never been investigated in critical care medicine. Thus, the present study aimed to examine the presence and extent of small-study effects in critical care medicine. METHODS: Critical care meta-analyses involving randomized controlled trials and reported mortality as an outcome measure were considered eligible for the study. Component trials were classified as large (≥100 patients per arm) and small (<100 patients per arm) according to their sample sizes. Ratio of odds ratio (ROR) was calculated for each meta-analysis and then RORs were combined using a meta-analytic approach. ROR<1 indicated larger beneficial effect in small trials. Small and large trials were compared in methodological qualities including sequence generating, blinding, allocation concealment, intention to treat and sample size calculation. RESULTS: A total of 27 critical care meta-analyses involving 317 trials were included. Of them, five meta-analyses showed statistically significant RORs <1, and other meta-analyses did not reach a statistical significance. Overall, the pooled ROR was 0.60 (95% CI: 0.53 to 0.68); the heterogeneity was moderate with an I2 of 50.3% (chi-squared = 52.30; P = 0.002). Large trials showed significantly better reporting quality than small trials in terms of sequence generating, allocation concealment, blinding, intention to treat, sample size calculation and incomplete follow-up data. CONCLUSIONS: Small trials are more likely to report larger beneficial effects than large trials in critical care medicine, which could be partly explained by the lower methodological quality in small trials. Caution should be practiced in the interpretation of meta-analyses involving small trials.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/cc11919

Cites

41 of 41 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

1 retracted

Flagged first, then by citations

Research works printed but not linked: 1

  1. Zarychanski R, Turgeon AF, Fergusson DA, Cook DJ, Hébert P, Bagshaw SM, Monsour D, McIntyre L: Renal outcomes and mortality following hydroxyethyl starch resuscitation of critically ill patients: systematic review and meta-analysis of randomized trials. Open Med 2009, 3: e196-209.

Cited by

Sorted by citations

See all 295

Related

See all

Metadata

Authors
Zhang, Z., Xu, X., & Ni, H.
Affiliations
Jinhua Central Hospital (CN)
Corresponding author
Zhang, Zhongheng
ORCID
Venue
Critical Care
Publisher
Springer Science and Business Media LLC
Published
2013-01-09
Volume
17
Issue
1
Pages
R2-R2
ISSN
1364-8535 (ISSN-L)
DOI
10.1186/cc11919
PMC
PMC4056100
OpenAlex
W2066676890
Cited by
295
References
41
Citations by year
2026: 16 · 2025: 18 · 2024: 24 · 2023: 26 · 2022: 30 · 2021: 27 · 2020: 27 · 2019: 27 · 2018: 22 · 2017: 20 · 2016: 19 · 2015: 14 · 2014: 17 · 2013: 8
FWCI
21.05
Type
journal article
Language
en
Open access
Licence
Locations
  • Critical Care (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Keywords
small-study effects, sample size, effect size overestimation, mortality, methodological quality of trials, allocation concealment, blinding, incomplete follow-up, meta-epidemiology
MeSH terms
Critical Care, Humans, Epidemiologic Studies, Randomized Controlled Trials as Topic

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review