The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
A graphical method for exploring heterogeneity in meta‐analyses: application to a meta‐analysis of 65 trials
Abstract
Heterogeneity can be a major component of meta‐analyses and by virtue of that fact warrants investigation. Classic analysis methods, such as meta‐regression, are used to explore the sources of heterogeneity. However, it may be difficult to apply such a method in complex cases or in the absence of an a priori hypothesis. This paper presents a graphical method to identify trials, groups of trials or groups of patients that are sources of heterogeneity. The contribution of these trials to the overall result can also be evaluated with this method. Each trial is represented by a dot on a 2D graph. The X‐axis represents the contribution of the trial to the overall Cochran Q‐test for heterogeneity. The Y‐axis represents the influence of the trial, defined as the standardized squared difference between the treatment effects estimated with and without the trial. This approach has been applied to data from the Meta‐Analysis of Chemotherapy in Head and Neck Cancer (MACH‐NC) comprising 10850 patients in 65 randomized trials. The graphical method allowed us to identify trials that contributed considerably to the overall heterogeneity and had a strong influence on the overall result. It also provided useful information for the interpretation of heterogeneity in this meta‐analysis. The proposed graphical method identifies trials that account for most of the heterogeneity without having to explore all possible sources of heterogeneity by subgroup analyses. This method can also be applied to identify types of patients that explain heterogeneity in the treatment effect. Copyright © 2002 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
The combination of estimates from different experiments
Cochran, W. G. (1954) · Biometrics · doi:10.2307/3001666 · Cited by 5,380
Research works printed but not linked: 8
- 10.1016/S0140-6736(00)90011-4 · DOI · Paper page
- 10.1002/sim.4780080202 · DOI · Paper page
- 10.1002/(SICI)1097-0258(19980430)17:8<841::AID-SIM781>3.0.CO;2-D · DOI · Paper page
- 10.1002/sim.4780070807 · DOI · Paper page
- Early Breast Cancer Trialists Collaborative Group, 1990, Treatment of early breast cancer
- 10.1002/(SICI)1097-0258(19960330)15:6<619::AID-SIM188>3.0.CO;2-A · DOI
- 10.1002/(SICI)1097-0258(19970415)16:7<753::AID-SIM494>3.0.CO;2-G · DOI
- Sargent DJ, 2000, Meta‐Analysis in Medicine and Health Policy, 255
Cited by
Lai, M.-C., Kassee, C., Besney, R., Bonato, S., Hull, L., Mandy, W., Szatmari, P., & Ameis, S. H. (2019) · The Lancet Psychiatry · doi:10.1016/s2215-0366(19)30289-5 · Cited by 1,892
Magill, M., & Ray, L. A. (2009) · Journal of Studies on Alcohol and Drugs · doi:10.15288/jsad.2009.70.516 · Cited by 694
Interpretation of tests of heterogeneity and bias in meta-analysis
Ioannidis, J. P. A. (2008) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2008.00986.x · Cited by 696
Martinengo, L., Olsson, M., Bajpai, R., Soljak, M., Upton, Z., Schmidtchen, A., Car, J., & Järbrink, K. (2019) · Annals of Epidemiology · doi:10.1016/j.annepidem.2018.10.005 · Cited by 686
McMullan, R. D., Berle, D., Arnáez, S., & Starcevic, V. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.11.037 · Cited by 436
Magill, M., Ray, L., Kiluk, B., Hoadley, A., Bernstein, M., Tonigan, J. S., & Carroll, K. (2019) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000447 · Cited by 315
Dechartres, A., Boutron, I., Trinquart, L., Charles, P., & Ravaud, P. (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-1-201107050-00006 · Cited by 307
Danopoulos, E., Jenner, L. C., Twiddy, M., & Rotchell, J. M. (2020) · Environmental Health Perspectives · doi:10.1289/ehp7171 · Cited by 302
“In fl uence diagnostics included the I 2 and Q values (Baujat et al. 2002) and the contribution to the pooled e ff ect size (Viechtbauer and Cheung 2010).”
Self-Compassion and Coping: a Meta-Analysis
Ewert, C., Vater, A., & Schröder-Abé, M. (2021) · Mindfulness · doi:10.1007/s12671-020-01563-8 · Cited by 270
Moitra, M., Santomauro, D., Degenhardt, L., Collins, P. Y., Whiteford, H., Vos, T., & Ferrari, A. (2021) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2021.02.053 · Cited by 252
EEG power spectral measures of cognitive workload: A meta‐analysis
Chikhi, S., Matton, N., & Blanchet, S. (2022) · Psychophysiology · doi:10.1111/psyp.14009 · Cited by 258
Mazeas, A., Duclos, M., Pereira, B., & Chalabaev, A. (2022) · Journal of Medical Internet Research · doi:10.2196/26779 · Cited by 222
Graphical displays for meta-analysis: An overview with suggestions for practice
Anzures‐Cabrera, J., & Higgins, J. P. T. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.6 · Cited by 233
Gagnier, J. J., Moher, D., Boon, H., Beyene, J., & Bombardier, C. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-111 · Cited by 222
Cognitive remediation for negative symptoms of schizophrenia: A network meta-analysis
Cella, M., Preti, A., Edwards, C., Dow, T., & Wykes, T. (2017) · Clinical Psychology Review · doi:10.1016/j.cpr.2016.11.009 · Cited by 215
ten Hoorn, S., de Back, T. R., Sommeijer, D. W., & Vermeulen, L. (2022) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djab106 · Cited by 203
Beaudry, G., Yu, R., Perry, A. E., & Fazel, S. (2021) · The Lancet Psychiatry · doi:10.1016/s2215-0366(21)00170-x · Cited by 196
Abraha, I., Cherubini, A., Cozzolino, F., De Florio, R., Luchetta, M. L., Rimland, J. M., Folletti, I., Marchesi, M., Germani, A., Orso, M., et al. (2015) · BMJ · doi:10.1136/bmj.h2445 · Cited by 165
Neutrophil-to-lymphocyte ratio in schizophrenia: A systematic review and meta-analysis
Karageorgiou, V., Milas, G. P., & Michopoulos, I. (2019) · Schizophrenia Research · doi:10.1016/j.schres.2018.12.017 · Cited by 163
The Prevalence of Self-injurious Behaviour in Autism: A Meta-analytic Study
Steenfeldt-Kristensen, C., Jones, C. A., & Richards, C. (2020) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-020-04443-1 · Cited by 150
Newell, V., Phillips, L., Jones, C., Townsend, E., Richards, C., & Cassidy, S. (2023) · Molecular Autism · doi:10.1186/s13229-023-00544-7 · Cited by 143
Roffarello, A. M., & De Russis, L. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3571810 · Cited by 137
Guida, P., Mastro, F., Scrascia, G., Whitlock, R., & Paparella, D. (2014) · The Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/j.jtcvs.2014.07.039 · Cited by 126
Oliveira Silva, G., Oliveira, F. S. E., Coelho, A. S. G., Cavalcante, A. M. R. Z., Vieira, F. V. M., Fonseca, L. M. M., Campbell, S. H., & Aredes, N. D. A. (2022) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2022.104282 · Cited by 91
Effects of psychological interventions on competitive anxiety in sport: A meta-analysis
Ong, N. C. H., & Chua, J. H. E. (2021) · Psychology of Sport and Exercise · doi:10.1016/j.psychsport.2020.101836 · Cited by 91
Mayo, O., Lavidor, M., & Gordon, I. (2021) · Physiology & Behavior · doi:10.1016/j.physbeh.2021.113391 · Cited by 73
Pabst, A., Proksch, S., Médé, B., Comstock, D. C., Ross, J. M., & Balasubramaniam, R. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104587 · Cited by 68
Claus, B. B., Stahlschmidt, L., Dunford, E., Major, J., Harbeck-Weber, C., Bhandari, R. P., Baerveldt, A., Neß, V., Grochowska, K., Hübner-Möhler, B., et al. (2022) · Pain · doi:10.1097/j.pain.0000000000002636 · Cited by 59
Tunç, H., Morris, P. G., Kyranides, M. N., McArdle, A., McConachie, D., & Williams, J. (2023) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2023.02.004 · Cited by 40
Grigolon, R. B., Trevizol, A. P., Gerchman, F., Bambokian, A. D., Magee, T., McIntyre, R. S., Gomes, F. A., Brietzke, E., & Mansur, R. B. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.03.032 · Cited by 35
Effects of mindfulness-based programs on competitive anxiety in sports: A meta-analysis
Wang, X., Nasiruddin, N. J. B. M., Ji, S., Gao, X., Hassan, M. Z. B., Dong, D., & Samsudin, S. B. (2024) · Current Psychology · doi:10.1007/s12144-024-05648-8 · Cited by 18
Pinto, L. F. B., Medrado, B. D., Pedrosa, V. B., & Brito, L. F. (2025) · Journal of Animal Breeding and Genetics · doi:10.1111/jbg.12874 · Cited by 17
Zhang, Z., Hu, T., Huang, P., Yang, M., Huang, Z., Xia, Y., Zhang, X., Zhang, X., & Ni, G. (2023) · Frontiers in Neuroscience · doi:10.3389/fnins.2023.1097830 · Cited by 15
Pontiroli, A., Centofanti, L., Le Roux, C., Magnani, S., Tagliabue, E., & Folli, F. (2023) · Nutrients · doi:10.3390/nu15040940 · Cited by 13
Hunter, H., de Gracia Hahn, D., Duret, A., Im, Y. R., Cheah, Q., Dong, J., Fairey, M., Hjalmarsson, C., Li, A., Lim, H. K., et al. (2020) · eLife · doi:10.7554/elife.56573 · Cited by 12
Schincariol, A., Otgaar, H., Greene, C. M., Murphy, G., Riesthuis, P., Mangiulli, I., & Battista, F. (2024) · Memory, Mind & Media · doi:10.1017/mem.2024.14 · Cited by 8
The effectiveness of implementation intentions in children: A systematic review and meta‐analysis
Breitwieser, J., & Reinelt, T. (2026) · British Journal of Psychology · doi:10.1111/bjop.70065 · Cited by 1
Metadata
- Authors
- Baujat, B., Mahé, C., Pignon, J., & Hill, C.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2002-09-10
- Volume
- 21
- Issue
- 18
- Pages
- 2641-2652
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2085452046
- Cited by
- 744
- References
- 2
- FWCI
- 3.59
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- onlinelibrary.wiley.com/termsAndConditions#vor (vor)
- doi.wiley.com/10.1002/tdm_license_1.1 (tdm, 4739 d)
- Funders
- Fondation pour la Recherche Médicale
- Banque Nationale de Paris
- Smithkline and Beecham
- European Commission (961321)
- Programme Hospitalier de Recherche Clinique (IDF 95013)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.