Cited by 1,017Meta-analysis and systematic reviewsStatistical Methods in EpidemiologyDelphi Technique in Research

The DOI matches its Crossref record; 31 of the 32 references it cites were found in a registry or an index.

Systematic Review: Why sources of heterogeneity in meta-analysis should be investigated

Open access

Thompson, S G·1994·BMJ

DOI 10.1136/bmj.309.6965.1351PMC PMC2541868

Open this paper in CoChat — free account

Abstract

Although meta-analysis is now well established as a method of reviewing evidence, an uncritical use of the technique can be very misleading. One common problem is the failure to investigate appropriately the sources of heterogeneity, in particular the clinical differences between the studies included. This paper distinguishes between the concepts of clinical and statistical heterogeneity and exemplifies the importance of investigating heterogeneity by using published meta-analyses of epidemiological studies of serum cholesterol concentration and clinical trials of its reduction. Although not without some dangers of speculative conclusions, prompted by overzealous inspection of the data to hand, a sensible investigation of sources of heterogeneity should increase both the scientific and the clinical relevance of the results of meta-analyses.

Integrity signals

Registry

Crossref · 10.1136/bmj.309.6965.1351

Cites

31 of 31 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

The text we found for this paper looks like another document, so its claims and self-check weren’t run. The registry and citation checks still apply.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The text we found for this paper looks like another document, so the self-check wasn’t run.

Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
Practical Statistics for Medical Research.
Walter, S., & Altman, D. G. (1992) · Biometrics · doi:10.2307/2532320 · Cited by 11,666
Practical Statistics for Medical Research
Altman, D. G. (1990) · doi:10.1201/9780429258589 · Cited by 10,668
Practical Statistics for Medical Research.
Bartko, J. J., & Altman, D. G. (1992) · Journal of the American Statistical Association · doi:10.2307/2290246 · Cited by 4,834
Blood pressure, stroke, and coronary heart disease *1Part 1, prolonged differences in blood pressure: prospective observational studies corrected for the regression dilution bias
MACMAHON, S. (1990) · The Lancet · doi:10.1016/0140-6736(90)90878-9 · Cited by 4,253
COLLABORATIVE OVERVIEW OF RANDOMIZED TRIALS OF ANTIPLATELET THERAPY .1. PREVENTION OF DEATH, MYOCARDIAL-INFARCTION, AND STROKE BY PROLONGED ANTIPLATELET THERAPY IN VARIOUS CATEGORIES OF PATIENTS
Altman, R., Carreras, L., Díaz, R. S., Figueroa, E. B., Paolasso, E., Parodi, J. C., Cade, J. F., Donnan, G. A., Eadie, M. J., Gavaghan, T. P., et al. (1994) · Cited by 3,322
Publication bias in clinical research
Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991) · The Lancet · doi:10.1016/0140-6736(91)90201-y · Cited by 3,109
Systemic treatment of early breast cancer by hormonal, cytotoxic, or immune therapy
Early Breast Cancer Trialist's Collaborative Group (1992) · The Lancet · doi:10.1016/0140-6736(92)90997-h · Cited by 2,169
By how much and how quickly does reduction in serum cholesterol concentration lower risk of ischaemic heart disease?
Law, M., Wald, N., & Thompson, S. (1994) · British medical journal · doi:10.1136/bmj.308.6925.367 · Cited by 1,306
Analysis and interpretation of treatment effects in subgroups of patients in randomized clinical trials
Yusuf, S. (1991) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1991.03470010097038 · Cited by 1,014

Show all 32 references

Research works printed but not linked: 4

Oxman A .Preparing and maintaining systematic reviews. In: Sackett D , ed Cochrane Collaboration Handbook.Section VI. Oxford:Cochrane Collaboration,1994.
Meier, 1987, Meta-analysis of clinical trials as a scientific discipline [commentary]., Statist Med, 6, 329, 10.1002/sim.4780060322 · DOI
10.1136/bmj.308.6921.81 · DOI
Schulz KF Chalmers I Hayes RJ Altman DG .Empirical evidence of bias: dimensions of methodologic quality are associated with estimates of treatment effects in 250 controlled trials from 33 meta-analyses. JAMA (in press).

Sorted by citations

Items 101–200 of 1,000

An initial meta-analysis of acceptance and commitment therapy for treating substance use disorders
Lee, E. B., An, W., Levin, M. E., & Twohig, M. P. (2015) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2015.08.004 · Cited by 271
The risk of catheter-related bloodstream infection with femoral venous catheters as compared to subclavian and internal jugular venous catheters
Marik, P. E., Flemmer, M. C., & Harrison, W. (2012) · Critical Care Medicine · doi:10.1097/ccm.0b013e318255d9bc · Cited by 273
Multidimensional Geriatric Assessment: Back to the Future Multidimensional Preventive Home Visit Programs for Community-Dwelling Older Adults: A Systematic Review and Meta-Analysis of Randomized Controlled Trials
Huss, A., Stuck, A. E., Rubenstein, L. Z., Egger, M., & Clough‐Gorr, K. M. (2008) · The Journals of Gerontology Series A · doi:10.1093/gerona/63.3.298 · Cited by 272
How to review the evidence: systematic identification and review of the scientific literature
Glasziou, P., Irwig, L., Bain, C., & Colditz, G. A. (2000) · Cited by 267
Meta‐analysis of continuous outcome data from individual patients
Higgins, J. P. T., Whitehead, A., Turner, R., Omar, R., & Thompson, S. G. (2001) · Statistics in Medicine · doi:10.1002/sim.918 · Cited by 266
Performance of statistical methods for meta-analysis when true study effects are non-normally distributed: A simulation study
Kontopantelis, E., & Reeves, D. (2010) · Statistical Methods in Medical Research · doi:10.1177/0962280210392008 · Cited by 264
The Test of Lasègue
Devillé, W. L. J. M., van der Windt, D., Dzaferagić, A., Bezemer, P. D., & Bouter, L. M. (2000) · Spine · doi:10.1097/00007632-200005010-00016 · Cited by 264
Association between TCF7L2gene polymorphisms and susceptibility to Type 2 Diabetes Mellitus: a large Human Genome Epidemiology (HuGE) review and meta-analysis
Yu, T., Lin, Y., Zhang, Y., Yang, J., Zhang, Y., Liu, H., & Zhang, B. (2009) · BMC Medical Genetics · doi:10.1186/1471-2350-10-15 · Cited by 267
Microbiome meta-analysis and cross-disease comparison enabled by the SIAMCAT machine learning toolbox
Wirbel, J., Zych, K., Essex, M., Karcher, N., Kartal, E., Salazar, G., Bork, P., Sunagawa, S., & Zeller, G. (2021) · Genome Biology · doi:10.1186/s13059-021-02306-1 · Cited by 269
Diagnostic hysteroscopy in abnormal uterine bleeding: a systematic review and meta‐analysis
van Dongen, H., de Kroon, C. D., Jacobi, C., Trimbos, J. B., & Jansen, F. W. (2007) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/j.1471-0528.2007.01326.x · Cited by 258
The effect of endometriosis on in vitro fertilisation outcome: a systematic review and meta‐analysis
Harb, H., Gallos, I. D., Chu, J., HARB, M. D. D. Y. M. H., & Coomarasamy, A. (2013) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.12366 · Cited by 269
Methods for Exploring Heterogeneity in Meta-Analysis
Song, F., Sheldon, T., Sutton, A. J., Abrams, K. R., & Jones, D. R. (2001) · Evaluation & the Health Professions · doi:10.1177/016327870102400203 · Cited by 253
The Efficacy and Safety of Sibutramine for Weight Loss
Arterburn, D. E., Crane, P. K., & Veenstra, D. L. (2004) · Archives of Internal Medicine · doi:10.1001/archinte.164.9.994 · Cited by 255
Principles of and Procedures for Systematic Reviews
Egger, M., & Smith, G. D. (2001) · Wiley eBooks · doi:10.1002/9780470693926.ch2 · Cited by 255
Efficacy of light therapy in nonseasonal depression: A systematic review
EVEN, C., Schroder, C. M., Friedman, S., & Rouillon, F. (2007) · Journal of Affective Disorders · doi:10.1016/j.jad.2007.09.008 · Cited by 258
Direct thrombin inhibitors in acute coronary syndromes: principal results of a meta-analysis based on individual patients' data
(2002) · The Lancet · doi:10.1016/s0140-6736(02)07495-0 · Cited by 248
Prophylaxis with Fluoroquinolones for Bacterial Infections in Neutropenic Patients: A Meta-Analysis
Cruciani, M., Rampazzo, R., Malena, M., Lazzarini, L., Todeschini, G., Messori, A., & Concia, E. (1996) · Clinical Infectious Diseases · doi:10.1093/clinids/23.4.795 · Cited by 249
Systematic reviews and meta-analyses of randomized trials: principles and pitfalls
da Costa, B. R., & Jüni, P. (2014) · European Heart Journal · doi:10.1093/eurheartj/ehu424 · Cited by 250
Meta-regression detected associations between heterogeneous treatment effects and study-level, but not patient-level, factors
Schmid, C. H., Stark, P. C., Berlin, J. A., Landais, P., & Lau, J. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2003.12.001 · Cited by 245
The effect of cetylpyridinium chloride‐containing mouth rinses as adjuncts to toothbrushing on plaque and parameters of gingival inflammation: a systematic review
Haps, S., Slot, D. E., Berchier, C., & van der Weijden, G. A. (2008) · International Journal of Dental Hygiene · doi:10.1111/j.1601-5037.2008.00344.x · Cited by 243
Conservative Treatment of Sciatica: A Systematic Review
Vroomen, P. C. A. J., de Krom, M. C. T. F. M., Slofstra, P. D., & Knottnerus, J. A. (2000) · Journal of Spinal Disorders · doi:10.1097/00002517-200012000-00001 · Cited by 236
The meta-analysis of genome-wide association studies
Thompson, J. R., Attia, J., & Minelli, C. (2011) · Briefings in Bioinformatics · doi:10.1093/bib/bbr020 · Cited by 251
Improving the Quality of Reports of Meta-Analyses of Randomised Controlled Trials: The QUOROM Statement
Moher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F. (2000) · Oncology Research and Treatment · doi:10.1159/000055014 · Cited by 235
Dairy Products Consumption and Risk of Type 2 Diabetes: Systematic Review and Dose-Response Meta-Analysis
Gao, D., Ning, N., Wang, C., Wang, Y., Li, Q., Meng, Z., Liu, Y., & Li, Q. (2013) · PLoS ONE · doi:10.1371/journal.pone.0073965 · Cited by 232
Meditation therapy for anxiety disorders
Krisanaprakornkit, T., Sriraj, W., Piyavhatkul, N., & Laopaiboon, M. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004998.pub2 · Cited by 240
Employer Drug Benefit Plans and Spending on Prescription Drugs
Joyce, G. (2002) · JAMA · doi:10.1001/jama.288.14.1733 · Cited by 230
Body Iron Stores and Heme-Iron Intake in Relation to Risk of Type 2 Diabetes: A Systematic Review and Meta-Analysis
Zhao, Z., Li, S., Liu, G., Yan, F., Ma, X., Huang, Z., & Tian, H. (2012) · PLoS ONE · doi:10.1371/journal.pone.0041641 · Cited by 227
Investigating underlying risk as a source of heterogeneity in meta-analysis
Thompson, S. G., Smith, T. C., & Sharp, S. J. (1997) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19971215)16:23 · Cited by 227
Risk of recurrent stillbirth: systematic review and meta-analysis
Lamont, K., Scott, N., Jones, G., & Bhattacharya, S. (2015) · British medical journal · doi:10.1136/bmj.h3080 · Cited by 214
Systematic review and meta-analysis of the association between complementary factor H Y402H polymorphisms and age-related macular degeneration
Thakkinstian, A., Han, P., McEvoy, M., Smith, W. T., Hoh, J. J., Magnússon, K. P., Zhang, K., & Attia, J. (2006) · Human Molecular Genetics · doi:10.1093/hmg/ddl220 · Cited by 227
Investigating clinical heterogeneity in systematic reviews: a methodologic review of guidance in the literature
Gagnier, J. J., Moher, D., Boon, H., Beyene, J., & Bombardier, C. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-111 · Cited by 222
Performance of the quick Sequential (sepsis-related) Organ Failure Assessment score as a prognostic tool in infected patients outside the intensive care unit: a systematic review and meta-analysis
Song, J., Sin, C., Park, H. K., Shim, S. R., & Lee, J. H. (2018) · Critical Care · doi:10.1186/s13054-018-1952-x · Cited by 234
Systematic review of the evidence underlying the association between mineral metabolism disturbances and risk of all-cause mortality, cardiovascular mortality and cardiovascular events in chronic kidney disease
Covic, A. C., Kothawala, P., Bernal, M., Robbins, S., Chalian, A., & Goldsmith, D. J. A. (2008) · Nephrology Dialysis Transplantation · doi:10.1093/ndt/gfn613 · Cited by 219
Meta‐analysis of heterogeneously reported trials assessing change from baseline
Abrams, K. R., Gillies, C., & Lambert, P. C. (2005) · Statistics in Medicine · doi:10.1002/sim.2423 · Cited by 215
Language of publication restrictions in systematic reviews gave different results depending on whether the intervention was conventional or complementary
Pham, B., Klassen, T. P., Lawson, M. L., & Moher, D. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.08.021 · Cited by 206
Mejora de la calidad de los informes de los metaanálisis de los ensayos clínicos controlados: el acuerdo QUOROM
Moher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F. (2000) · Revista Española de Salud Pública · doi:10.1590/s1135-57272000000200002 · Cited by 213
Meta-Analysis of Molecular Association Studies: Vitamin D Receptor Gene Polymorphisms and BMD as a Case Study
Thakkinstian, A., D’Este, C. A., Eisman, J. A., Nguyen, T. V., & Attia, J. (2004) · Journal of Bone and Mineral Research · doi:10.1359/jbmr.0301265 · Cited by 209
How big is the burden of visual loss caused by age related macular degeneration in the United Kingdom?
Owen, C. G. (2003) · British Journal of Ophthalmology · doi:10.1136/bjo.87.3.312 · Cited by 211
Meta-Analysis: Angiotensin-Receptor Blockers in Chronic Heart Failure and High-Risk Acute Myocardial Infarction
Lee, V. C., Rhew, D. C., Dylan, M. L., Badamgarav, E., Braunstein, G. D., & Weingarten, S. R. (2004) · Annals of Internal Medicine · doi:10.7326/0003-4819-141-9-200411020-00011 · Cited by 210
A metaanalysis of 18F‐2‐deoxy‐2‐fluoro‐D‐glucose positron emission tomography in the staging and restaging of patients with lymphoma
Isasi, C. R., Lu, P., & Blaufox, M. D. (2005) · Cancer · doi:10.1002/cncr.21253 · Cited by 207
Diabetes care in general practice: meta-analysis of randomised control trialsCommentary: Meta-analysis is a blunt and potentially misleading instrument for analysing models of service delivery
Griffin, S. J., & Greenhalgh, T. (1998) · BMJ · doi:10.1136/bmj.317.7155.390 · Cited by 198
Efficacy of Methylphenidate for Adults with Attention-Deficit Hyperactivity Disorder: A Meta-Regression Analysis
Castells, X., Ramos-Quiroga, J. A., Rigau, D., Bosch, R., Nogueira, M., Vidal, X., & Casas, M. (2011) · CNS Drugs · doi:10.2165/11539440-000000000-00000 · Cited by 197
Methods for Summarizing the Risk Associations of Quantitative Variables in Epidemiologic Studies in a Consistent Form
Chêne, G., & Thompson, S. G. (1996) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a008971 · Cited by 195
Estimation of the predictive power of the model in mixed‐effects meta‐regression: A simulation study
López-López, J. A., Marín‐Martínez, F., Sánchez‐Meca, J., Noortgate, W. V. D., & Viechtbauer, W. (2013) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/bmsp.12002 · Cited by 196
Evidence-Based Medicine, Systematic Reviews, and Guidelines in Interventional Pain Management: Part 3: Systematic Reviews and Meta-Analyses of Randomized Trials
Manchikanti, L. (2009) · Pain Physician · doi:10.36076/ppj.2009/12/35 · Cited by 187
Comprehensive literature review and statistical considerations for GWAS meta-analysis
Begum, F., Ghosh, D., Tseng, G. C., & Feingold, E. (2012) · Nucleic Acids Research · doi:10.1093/nar/gkr1255 · Cited by 179
Seizure Outcomes Following the Use of Generic versus Brand-Name Antiepileptic Drugs
Kesselheim, A. S., Stedman, M. R., Bubrick, E. J., Gagne, J. J., Misono, A. S., Lee, J. L.-Y., Brookhart, M. A., Avorn, J., & Shrank, W. H. (2010) · Drugs · doi:10.2165/10898530-000000000-00000 · Cited by 190
Transvaginal cervical length measurement for prediction of preterm birth in women with threatened preterm labor: a meta‐analysis
Sotiriadis, A., Papatheodorou, S., Kavvadias, A., & Makrydimas, G. (2009) · Ultrasound in Obstetrics and Gynecology · doi:10.1002/uog.7457 · Cited by 190
Comparison of four heterogeneity measures for meta‐analysis
Lin, L. (2019) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.13159 · Cited by 186
A critical review of methods for the assessment of patient-level interactions in individual participant data meta-analysis of randomized trials, and guidance for practitioners
Fisher, D. J., Copas, A. J., Tierney, J. F., & Parmar, M. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.11.016 · Cited by 180
Association of genetic polymorphisms in the base excision repair pathway with lung cancer risk: A meta-analysis
Kiyohara, C., Takayama, K., & Nakanishi, Y. (2006) · Lung Cancer · doi:10.1016/j.lungcan.2006.08.009 · Cited by 182
A meta-analysis of FDG-PET for the evaluation of breast cancer recurrence and metastases
Isasi, C. R., Moadel, R. M., & Blaufox, M. D. (2005) · Breast Cancer Research and Treatment · doi:10.1007/s10549-004-3291-7 · Cited by 181
Developing clinically valid practice guidelines
Grimshaw, J., Eccles, M., & Russell, I. T. (1995) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.1995.tb00006.x · Cited by 180
Systematic review of efficacy of cognitive behaviour therapies in childhood and adolescent depressive disorder
Harrington, R., Whittaker, J., Shoebridge, P., & Campbell, F. (1998) · British medical journal · doi:10.1136/bmj.316.7144.1559 · Cited by 200
Efficacy and toxicity of methotrexate (MTX) monotherapy versus MTX combination therapy with non-biological disease-modifying antirheumatic drugs in rheumatoid arthritis: a systematic review and meta-analysis
Katchamart, W., Trudeau, J., Phumethum, V., & Bombardier, C. (2008) · Annals of the Rheumatic Diseases · doi:10.1136/ard.2008.099861 · Cited by 177
Psychological impact of predicting individuals’ risks of illness: a systematic review
Shaw, C., Abrams, K. R., & Marteau, T. M. (1999) · Social Science & Medicine · doi:10.1016/s0277-9536(99)00244-0 · Cited by 174
Can meta-analysis help target interventions at individuals most likely to benefit?
Thompson, S. G., & Higgins, J. P. (2005) · The Lancet · doi:10.1016/s0140-6736(05)70200-2 · Cited by 174
Self-citation
The accuracy of the enzyme-linked immunosorbent assay D -dimer test in the diagnosis of pulmonary embolism: A meta-analysis
Brown, M. D., Rowe, B. H., Reeves, M. J., Bermingham, J. M., & Goldhaber, S. Z. (2002) · Annals of Emergency Medicine · doi:10.1067/mem.2002.124755 · Cited by 173
The relation between treatment benefit and underlying risk in meta-analysis
Sharp, S. J., Thompson, S. G., & Altman, D. G. (1996) · BMJ · doi:10.1136/bmj.313.7059.735 · Cited by 172
Efficacy of Bronchodilator Therapy in Bronchiolitis
Kellner, J. D. (1996) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/archpedi.1996.02170360056009 · Cited by 170
Meta-analysis: Diagnostic Performance of Low-Radiation-Dose Coronary Computed Tomography Angiography
von Ballmoos, M. C. W., Haring, B., Juillerat, P., & Alkadhi, H. (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-154-6-201103150-00007 · Cited by 169
The effect of interventions to prevent cardiovascular disease in patients with type 2 diabetes mellitus
Huang, E. S., Meigs, J. B., & Singer, D. E. (2001) · The American Journal of Medicine · doi:10.1016/s0002-9343(01)00978-0 · Cited by 163
Meta-analysis of randomized controlled trials on cognitive effects of Bacopa monnieri extract
Kongkeaw, C., Dilokthornsakul, P., Thanarangsarit, P., Limpeanchob, N., & Norman Scholfield, C. (2014) · Journal of Ethnopharmacology · doi:10.1016/j.jep.2013.11.008 · Cited by 188
Systematic review and meta-analysis: techniques and a guide for the academic surgeon.
Phan, K. H., Tian, D. H., Cao, C. Q., Black, D. A., & Yan, T. D. (2015) · PubMed Central · doi:10.3978/j.issn.2225-319x.2015.02.04 · Cited by 167
An alternative model for bivariate random-effects meta-analysis when the within-study correlations are unknown
Riley, R. D., Thompson, J. R., & Abrams, K. R. (2007) · Biostatistics · doi:10.1093/biostatistics/kxm023 · Cited by 167
More Than Numbers: The Power of Graphs in Meta-Analysis
Bax, L., Ikeda, N., Fukui, N., Yaju, Y., Tsuruta, H., & Moons, K. G. M. (2008) · American Journal of Epidemiology · doi:10.1093/aje/kwn340 · Cited by 166
Meta-analysis of Cephalosporin Versus Penicillin Treatment of Group A Streptococcal Tonsillopharyngitis in Children
Casey, J. R., & Pichichero, M. E. (2004) · PEDIATRICS · doi:10.1542/peds.113.4.866 · Cited by 164
Defined-Formula Diets versus Steroids in the Treatment of Active Crohn's Disease A Meta-Analysis
Messori, A., Trallori, G., D'Albasio, G., Milla, M., Vannozzi, G., & Pacini, F. (1996) · Scandinavian Journal of Gastroenterology · doi:10.3109/00365529609004877 · Cited by 164
Antioxidants are not identical and their effects are not uniform over the population (2009)
Hemilä, H. (2009) · doi:10.13140/2.1.4426.0641 · Cited by 164
Occupational exposure and sinonasal cancer: a systematic review and meta-analysis
Binazzi, A., Ferrante, P., & Marinaccio, A. (2015) · BMC Cancer · doi:10.1186/s12885-015-1042-2 · Cited by 169
Antidepressants versus placebo for people with bulimia nervosa
Bacaltchuk, J., & Hay, P. P. (2003) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003391 · Cited by 161
Treatment of Acute Otitis Media With a Shortened Course of Antibiotics
Kozyrskyj, A. L., Hildes-Ripstein, G. E., Longstaffe, S. E. A., Wincott, J. L., SITAR, D. S., Klassen, T. P., & Moffatt, M. E. K. (1998) · JAMA · doi:10.1001/jama.279.21.1736 · Cited by 160
Pharmacotherapy for anxiety disorders in children and adolescents
Ipser, J., Stein, D. J., Hawkridge, S. M., & Hoppe, L. J. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005170.pub2 · Cited by 171
Demystifying fixed and random effects meta-analysis
Nikolakopoulou, A., Mavridis, D., & Salanti, G. (2014) · Evidence-Based Mental Health · doi:10.1136/eb-2014-101795 · Cited by 157
The expectation effect and cardiac pacing for refractory vasovagal syncope
Sud, S., Massel, D., Klein, G. J., Leong-Sit, P., Yee, R., Skanes, A. C., Gula, L. J., & Krahn, A. D. (2007) · The American Journal of Medicine · doi:10.1016/j.amjmed.2006.05.046 · Cited by 151
Pain prevalence and its determinants after spinal cord injury: A systematic review
van Gorp, S., Kessels, A. G. H., Joosten, E. A. J., van Kleef, M., & Patijn, J. (2014) · European Journal of Pain · doi:10.1002/ejp.522 · Cited by 158
Systematic review: association of shift length, protected sleep time, and night float with patient care, residents' health, and education
Reed, D. A., Fletcher, K. E., & Arora, V. M. (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-153-12-201012210-00010 · Cited by 149
Updated Method Guidelines for Cochrane Musculoskeletal Group Systematic Reviews and Metaanalyses
Ghogomu, E. A. T., Maxwell, L. J., Buchbinder, R., Rader, T., Pardo, J. P., Johnston, R. V., Christensen, R., Rutjes, A. W., Winzenberg, T. M., Singh, J. A., et al. (2013) · The Journal of Rheumatology · doi:10.3899/jrheum.121306 · Cited by 153
Metaan: Random-effects Meta-analysis
Kontopantelis, E., & Reeves, D. (2010) · The Stata Journal Promoting communications on statistics and Stata · doi:10.1177/1536867x1001000307 · Cited by 150
Systematic review of the impact of beta blockers on mortality and hospital admissions in heart failure
Shibata, M. C., Flather, M. D., & Wang, D. (2001) · European Journal of Heart Failure · doi:10.1016/s1388-9842(01)00144-1 · Cited by 150
Cue exposure therapy for the treatment of alcohol use disorders: a meta-analytic review
Mellentin, A. I., Skøt, L., Nielsen, B., Schippers, G. M., Nielsen, A. S., Stenager, E., & Juhl, C. (2017) · Clinical Psychology Review · doi:10.1016/j.cpr.2017.07.006 · Cited by 149
Atraumatic restorative treatment versus amalgam restoration longevity: a systematic review
Mickenautsch, S., Yengopal, V., & Banerjee, A. (2009) · Clinical Oral Investigations · doi:10.1007/s00784-009-0335-8 · Cited by 148
Oxime therapy and outcomes in human organophosphate poisoning: An evaluation using meta-analytic techniques
Peter, J. V., Moran, J. L., & Graham, P. L. (2006) · Critical Care Medicine · doi:10.1097/01.ccm.0000198325.46538.ad · Cited by 148
Impact of support on the effectiveness of written cognitive behavioural self-help: a systematic review and meta-analysis of randomised controlled trials
Farrand, P., & Woodford, J. (2013) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.11.001 · Cited by 125
Evidence‐based sample size calculations based upon updated meta‐analysis
Sutton, A. J., Cooper, N. J., Jones, D. R., Lambert, P. C., Thompson, J. R., & Abrams, K. R. (2006) · Statistics in Medicine · doi:10.1002/sim.2704 · Cited by 147
A comparison of electronically-delivered and face to face cognitive behavioural therapies in depressive disorders: A systematic review and meta-analysis
Luo, C., Sanger, N., Singhal, N., Pattrick, K., Shams, I., Shahid, H., Hoang, P., Schmidt, J., Lee, J., Haber, S., et al. (2020) · eClinicalMedicine · doi:10.1016/j.eclinm.2020.100442 · Cited by 167
The impact of polyol-containing chewing gums on dental caries
Deshpande, A., & Jadad, A. R. (2008) · The Journal of the American Dental Association · doi:10.14219/jada.archive.2008.0102 · Cited by 145
A simulation study comparing properties of heterogeneity measures in meta‐analyses
Mittlböck, M., & Heinzl, H. (2006) · Statistics in Medicine · doi:10.1002/sim.2692 · Cited by 143
Effectiveness of acute postoperative pain management
Michel, M. Z., & Sanders, M. K. (2003) · British Journal of Anaesthesia · doi:10.1093/bja/aeg601 · Cited by 143
Dabigatran versus enoxaparin for prevention of venous thromboembolism after hip or knee arthroplasty: A pooled analysis of three trials
Friedman, R. J., Dahl, O. E., Rosencher, N., Caprini, J. A., Kurth, A. A., Francis, C. W., Clemens, A., Hantel, S., Schnee, J. M., & Eriksson, B. I. (2010) · Thrombosis Research · doi:10.1016/j.thromres.2010.03.021 · Cited by 141
Theophylline for Prevention of Contrast-Induced Nephropathy
Bagshaw, S. M. (2005) · Archives of Internal Medicine · doi:10.1001/archinte.165.10.1087 · Cited by 137
Etanercept, infliximab and adalimumab for the treatment of psoriatic arthritis: a systematic review and economic evaluation
Rodgers, M., Epstein, D. M., Bojke, L., Yang, H., Craig, D., Fonseca, T., Myers, L., Bruce, I. N., Chalmers, R. J. G., Bujkiewicz, S., et al. (2011) · Health Technology Assessment · doi:10.3310/hta15100 · Cited by 137
Meta-Analysis Using Multilevel Models with an Application to the Study of Class Size Effects
Goldstein, H., Yang, M., Omar, R., Turner, R., & Thompson, S. G. (2000) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.1111/1467-9876.00200 · Cited by 137
Acetylcysteine in the Prevention of Contrast-Induced Nephropathy
Bagshaw, S. M., McAlister, F. A., Manns, B., & Ghali, W. A. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.2.161 · Cited by 132
Systematic Review and Meta-Analysis of the Association Between Complement Component 3 and Age-related Macular Degeneration: A HuGE Review and Meta-Analysis
Thakkinstian, A., McKay, G. J., McEvoy, M., Chakravarthy, U., Chakrabarti, S., Silvestri, G., Kaur, I., Li, X., & Attia, J. (2011) · American Journal of Epidemiology · doi:10.1093/aje/kwr025 · Cited by 133
Large-scale replication and heterogeneity in Parkinson disease genetic loci
Sharma, M., Ioannidis, J. P. A., Aasly, J. O., Annesi, G., Brice, A., Broeckhoven, C. V., Bertram, L., Bozi, M., Crosiers, D., Clarke, C. E., et al. (2012) · Neurology · doi:10.1212/wnl.0b013e318264e353 · Cited by 132
Short-course antibiotics for acute otitis media
Kozyrskyj, A. L., Klassen, T. P., MOFFATT, M. E. K., & Harvey, K. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001095.pub2 · Cited by 129
Biliary stenting versus bypass surgery for the palliation of malignant distal bile duct obstruction: A meta-analysis
Taylor, M. C., McLeod, R. S., & Langer, B. (2000) · Liver Transplantation · doi:10.1053/lv.2000.5196 · Cited by 131
Clinical implications of clopidogrel non-response in cardiovascular patients: a systematic review and meta-analysis
COMBESCURE, C., Fontana, P., Mallouk, N., Berdagué, P., Labruyère, C., Barazer, I., Gris, J., Laporte, S., Fabbro-Péray, P., & Reny, J. (2010) · Journal of Thrombosis and Haemostasis · doi:10.1111/j.1538-7836.2010.03809.x · Cited by 127
Acamprosate for the treatment of alcohol dependence
Boothby, L. A., & Doering, P. L. (2005) · Clinical Therapeutics · doi:10.1016/j.clinthera.2005.06.015 · Cited by 127

Authors: Thompson, S. G.
Affiliations: London School of Hygiene & Tropical Medicine (GB)
Corresponding author: Thompson, S G
ORCID: Thompson, S G
Venue: BMJ
Publisher: BMJ
Published: 1994-11-19
Volume: 309
Issue: 6965
Pages: 1351-1355
ISSN: 0007-1447 (ISSN-L)
0959-8138
1468-5833
DOI: 10.1136/bmj.309.6965.1351
PMC: PMC2541868
OpenAlex: W1511524925
Cited by: 1,017
References: 32
Citations by year: 2026: 23 · 2025: 35 · 2024: 38 · 2023: 29 · 2022: 30 · 2021: 47 · 2020: 38 · 2019: 32 · 2018: 36 · 2017: 26 · 2016: 24 · 2015: 24 · 2014: 31 · 2013: 48 · 2012: 51
FWCI: 3.70
Type: journal article
Language: en
Open access: green
www.ncbi.nlm.nih.gov
Licence: www.bmj.com/company/legal-information/terms-conditions/legal-information/tdm-licencepolicy (tdm)
Locations: BMJ (publishedVersion)
PubMed Central (publishedVersion)
PubMed (publishedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Social Sciences › Sociology and Political Science › Delphi Technique in Research
Keywords: meta-analysis heterogeneity, clinical heterogeneity, statistical heterogeneity, serum cholesterol, cholesterol lowering, meta-analysis methodology, overfitting
MeSH terms: Adult, Aged, Aging, Cholesterol, Clinical Trials as Topic, Humans, Middle Aged, Neoplasms, Research Design, Meta-Analysis as Topic, Randomized Controlled Trials as Topic, Risk Assessment

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Systematic Review: Why sources of heterogeneity in meta-analysis should be investigated

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks