GOSH – a graphical display of study heterogeneity
The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Estimates from individual studies included in a meta‐analysis often are not in agreement, giving rise to statistical heterogeneity. In such cases, exploration of the causes of heterogeneity can advance knowledge by formulating novel hypotheses. We present a new method for visualizing between‐study heterogeneity using combinatorial meta‐analysis. The method is based on performing separate meta‐analyses on all possible subsets of studies in a meta‐analysis. We use the summary effect sizes and other statistics produced by the all‐subsets meta‐analyses to generate graphs that can be used to investigate heterogeneity, identify influential studies, and explore subgroup effects. This graphical approach complements alternative graphical explorations of data. We apply the method to numerous biomedical examples, to allow readers to develop intuition on the interpretation of the all‐subsets graphical display. The proposed graphical approach may be useful for exploratory data analysis in systematic reviews. Copyright © 2012 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
The combination of estimates from different experiments
Cochran, W. G. (1954) · Biometrics · doi:10.2307/3001666 · Cited by 5,380
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
How should meta‐regression analyses be undertaken and interpreted?
Thompson, S. G., & Higgins, J. P. T. (2002) · Statistics in Medicine · doi:10.1002/sim.1187 · Cited by 3,026
Outlier and influence diagnostics for meta-analysis
Viechtbauer, W., & Cheung, M. W.-L. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.11 · Cited by 2,949
A Re-Evaluation of Random-Effects Meta-Analysis
Higgins, J. P. T., Thompson, S. G., & Spiegelhalter, D. J. (2009) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2008.00552.x · Cited by 2,569
meta-analysis bias in location and selection of studies
Egger, M., & Smith, G. D. (1998) · BMJ · doi:10.1136/bmj.316.7124.61 · Cited by 1,374
Cumulative Meta-Analysis of Therapeutic Trials for Myocardial Infarction
Lau, J., Antman, E. M., Jimenez-Silva, J., Kupelnick, B., Mosteller, F., & Chalmers, T. C. (1992) · New England Journal of Medicine · doi:10.1056/nejm199207233270406 · Cited by 1,140
Berger, J. S., Roncaglioni, M. C., Avanzini, F., Pangrazzi, I., Tognoni, G., & Brown, D. L. (2006) · JAMA · doi:10.1001/jama.295.3.306 · Cited by 789
Meta-Analyst: software for meta-analysis of binary, continuous and diagnostic data
Wallace, B. C., Schmid, C. H., Lau, J., & Trikalinos, T. A. (2009) · BMC Medical Research Methodology · doi:10.1186/1471-2288-9-80 · Cited by 659
Self-citationSumming up evidence: one answer is not always enough
Lau, J., Ioannidis, J. P., & Schmid, C. H. (1998) · The Lancet · doi:10.1016/s0140-6736(97)08468-7 · Cited by 655
Jadad, A. R., Cook, D. J., Jones, A., Klassen, T. P., Tugwell, P., Moher, M., & Moher, D. (1998) · JAMA · doi:10.1001/jama.280.3.278 · Cited by 534
Teo, K. K., Yusuf, S., Collins, R., Held, P. H., & Peto, R. (1991) · BMJ · doi:10.1136/bmj.303.6816.1499 · Cited by 331
Higgins, J. P., & Spiegelhalter, D. J. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.1.96 · Cited by 121
A new approach to outliers in meta-analysis
Baker, R., & Jackson, D. (2007) · Health Care Management Science · doi:10.1007/s10729-007-9041-8 · Cited by 90
Magnesium in acute myocardial infarction
Yusuf, S., & Flather, M. D. (1995) · BMJ · doi:10.1136/bmj.310.6982.751 · Cited by 79
A random effects variance shift model for detecting and accommodating outliers in meta-analysis
Gumedze, F. N., & Jackson, D. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-19 · Cited by 62
Cited by
Jahrami, H. A., Alhaj, O. A., Humood, A. M., Alenezi, A. F., Fekih-Romdhane, F., AlRasheed, M. M., Saif, Z. Q., Bragazzi, N. L., Pandi-Perumal, S. R., BaHammam, A. S., et al. (2022) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2022.101591 · Cited by 335
Roffarello, A. M., & De Russis, L. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3571810 · Cited by 137
“To further explore patterns of heterogeneity in our sample, we also conducted a Graphic Display of Heterogeneity (GOSH) analysis [168], through which the same meta-analysis model is itted to all possible subsets of the included studies.”
MethodArntz, F., Markov, A., Behm, D. G., Behrens, M., Negra, Y., Nakamura, M., Moran, J., & Chaabene, H. (2023) · Sports Medicine · doi:10.1007/s40279-022-01806-9 · Cited by 82
Problematic smartphone use and academic achievement: A systematic review and meta-analysis
Paterna, A., Alcaraz-Ibáñez, M., Aguilar-Parra, J. M., Salavera, C., Demetrovics, Z., & Griffiths, M. D. (2024) · Journal of Behavioral Addictions · doi:10.1556/2006.2024.00014 · Cited by 83
Pabst, A., Proksch, S., Médé, B., Comstock, D. C., Ross, J. M., & Balasubramaniam, R. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104587 · Cited by 68
Metadata
- Authors
- Olkin, I., Dahabreh, I. J., & Trikalinos, T. A.
- Venue
- Research Synthesis Methods
- Publisher
- Wiley
- Published
- 2012-09
- Volume
- 3
- Issue
- 3
- Pages
- 214-223
- ISSN
- 1759-2879 (ISSN-L)
- 1759-2887
- OpenAlex
- W1854833362
- Cited by
- 267
- References
- 17
- FWCI
- 0.71
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.