Planning future studies based on the conditional power of a meta‐analysis
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Systematic reviews often provide recommendations for further research. When meta‐analyses are inconclusive, such recommendations typically argue for further studies to be conducted. However, the nature and amount of future research should depend on the nature and amount of the existing research. We propose a method based on conditional power to make these recommendations more specific. Assuming a random‐effects meta‐analysis model, we evaluate the influence of the number of additional studies, of their information sizes and of the heterogeneity anticipated among them on the ability of an updated meta‐analysis to detect a prespecified effect size. The conditional powers of possible design alternatives can be summarized in a simple graph which can also be the basis for decision making. We use three examples from the Cochrane Database of Systematic Reviews to demonstrate our strategy. We demonstrate that if heterogeneity is anticipated, it might not be possible for a single study to reach the desirable power no matter how large it is. Copyright © 2012 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Trial sequential analysis may establish when firm evidence is reached in cumulative meta-analysis
Wetterslev, J., Thorlund, K., Brok, J., & Gluud, C. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.03.013 · Cited by 1,881
Meta‐Analysis Of Controlled Clinical Trials
Whitehead, A. (2002) · doi:10.1002/0470854200 · Cited by 827
The power of statistical tests in meta-analysis
Hedges, L. V., & Pigott, T. D. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.3.203 · Cited by 716 · cited 1×
“[11] described a simple formula to determine the current (unconditional) power of a meta-analysis.”
BackgroundSample sizes for clinical trials with normal data.
Julious, S. A. (2004) · Statistics in Medicine · doi:10.1002/sim.1783 · Cited by 605
A rational framework for decision making by the National Institute for Clinical Excellence (NICE)
Claxton, K., Sculpher, M., & Drummond, M. (2002) · The Lancet · doi:10.1016/s0140-6736(02)09832-x · Cited by 456
Pogue, J. M., & Yusuf, S. (1997) · Controlled Clinical Trials · doi:10.1016/s0197-2456(97)00051-2 · Cited by 415 · cited 1×
“Several authors have proposed sequential approaches to meta-analysis [2, 23–25], and although these approaches do not lead directly to recommendations on planning future studies, they can be used in combination with our method to control the overall type I error rate at the final analysis.”
MethodClarke, M., Hopewell, S., & Chalmers, L. (2007) · Journal of the Royal Society of Medicine · doi:10.1258/jrsm.100.4.187 · Cited by 59
Cited by
Plea for routinely presenting prediction intervals in meta-analysis.
IntHout, J., Ioannidis, J. P. A., Rovers, M. M., & Goeman, J. J. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010247 · Cited by 2,264
Trial Sequential Analysis in systematic reviews with meta-analysis
Wetterslev, J., Jakobsen, J. C., & Gluud, C. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0315-7 · Cited by 1,189
Jakobsen, J. C., Wetterslev, J., Winkel, P., Lange, T., & Gluud, C. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-120 · Cited by 704
“Because of this risk of circular reasoning, ideally, it is, necessary to adjust the required information size by applying a penalty for the weight of data from former systematic reviews (or trials) [51,78].”
BackgroundResultInfluentialPower analysis for random-effects meta-analysis
Jackson, D., & Turner, R. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1240 · Cited by 619
Small studies are more heterogeneous than large ones: a meta-meta-analysis
IntHout, J., Ioannidis, J. P. A., Borm, G. F., & Goeman, J. J. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.03.017 · Cited by 314
“[16] showed that in case of cumulative meta-analysis, it is more powerful to add several small studies than one or a few large studies because the between-study heterogeneity can be estimated more precisely when more studies, either small or large, are available.”
Background
Metadata
- Authors
- Roloff, V., Higgins, J. P. T., & Sutton, A. J.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2012-07-11
- Volume
- 32
- Issue
- 1
- Pages
- 11-24
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2075496146
- Cited by
- 68
- References
- 7
- FWCI
- 5.66
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Planning future studies based on the conditional power of a meta‐analysis. https://app.cochat.ai/papers/10.1002/sim.5524
- The paper
- Roloff, V., Higgins, J. P. T., & Sutton, A. J. (2013). Planning future studies based on the conditional power of a meta‐analysis. Statistics in Medicine. https://doi.org/10.1002/sim.5524
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.