The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Critical interpretation of Cochran's Q test depends on power and prior assumptions about heterogeneity
Abstract
We describe how an appropriate interpretation of the Q-test depends on its power to detect a given typical amount of between-study variance (τ(2)) as well as prior beliefs on heterogeneity. We illustrate these concepts in an evaluation of 1011 meta-analyses of clinical trials with ⩾4 studies and binary outcomes. These concepts can be seen as an application of the Bayes theorem. Across the 1011 meta-analyses, power to detect typical heterogeneity was low in most situations. Thus, usually a non-significant Q test did not change perceptibly prior convictions on heterogeneity. Conversely, significant results for the Q test typically augmented considerably the probability of heterogeneity. The posterior probability of heterogeneity depends on what τ(2) we want to detect. With the same approach, one may also estimate the posterior probability for the presence of heterogeneity that is large enough to annul statistically significant summary effects; that is half the average within-study variance of the combined studies; and that is able to change the summary effect estimate of the meta-analysis by 20%. The discussed analyses are exploratory, and may depend heavily on prior assumptions when power for the Q-test is low. Statistical heterogeneity in meta-analyses should be cautiously interpreted considering the power to detect a specific τ(2) and prior assumptions about the presence of heterogeneity. Copyright © 2010 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The combination of estimates from different experiments
Cochran, W. G. (1954) · Biometrics · doi:10.2307/3001666 · Cited by 5,380
Assessing heterogeneity in meta-analysis: Q statistic or I² index?
Huedo-Medina, T. B., Sánchez-Meca, J., Marín-Martínez, F., & Botella, J. (2006) · Psychological Methods · doi:10.1037/1082-989x.11.2.193 · Cited by 4,256
Interpretation of tests of heterogeneity and bias in meta-analysis
Ioannidis, J. P. A. (2008) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2008.00986.x · Cited by 696
Self-citationHeterogeneous views on heterogeneity
Patsopoulos, N. A., Evangelou, E., & Ioannidis, J. P. (2009) · International Journal of Epidemiology · doi:10.1093/ije/dyn235 · Cited by 35
Self-citation
Cited by
Demystifying trial networks and network meta-analysis
Mills, E. J., Thorlund, K., & Ioannidis, J. P. A. (2013) · BMJ · doi:10.1136/bmj.f2914 · Cited by 742
Self-citationMeta-analysis methods for genome-wide association studies and beyond
Evangelou, E., & Ioannidis, J. P. A. (2013) · Nature Reviews Genetics · doi:10.1038/nrg3472 · Cited by 596
Self-citationPrevalence and outcomes of incidental imaging findings: umbrella review
O’Sullivan, J. W., Muntinga, T., Grigg, S., & Ioannidis, J. P. A. (2018) · BMJ · doi:10.1136/bmj.k2387 · Cited by 339
Self-citationMeta-Analysis and Systematic Review Assessing the Efficacy of Dialectical Behavior Therapy (DBT)
Panos, P. T., Jackson, J. W., Hasan, O., & Panos, A. (2014) · Research on Social Work Practice · doi:10.1177/1049731513503047 · Cited by 299
Excess Significance Bias in the Literature on Brain Volume Abnormalities
Ioannidis, J. P. A. (2011) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2011.28 · Cited by 299
Self-citation
Metadata
- Authors
- Pereira, T. V., Patsopoulos, N. A., Salanti, G., & Ioannidis, J. P. A.
- Venue
- Research Synthesis Methods
- Publisher
- Wiley
- Published
- 2010-04
- Volume
- 1
- Issue
- 2
- Pages
- 149-161
- ISSN
- 1759-2879 (ISSN-L)
- OpenAlex
- W1991247706
- Cited by
- 160
- References
- 4
- FWCI
- 4.63
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Critical interpretation of Cochran's Q test depends on power and prior assumptions about heterogeneity. https://app.cochat.ai/papers/10.1002/jrsm.13
- The paper
- Pereira, T. V., Patsopoulos, N. A., Salanti, G., & Ioannidis, J. P. A. (2010). Critical interpretation of Cochran's Q test depends on power and prior assumptions about heterogeneity. Research Synthesis Methods. https://doi.org/10.1002/jrsm.13
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.