Meta-analysis: Unresolved issues and future developments
Open accessAbstract
In our patient-authored series, Marije Klein reminds healthcare professionals how important casual conversations can be in creating or destroying patients’ confidence and sense of safety. For more information about the series, contact Rosamund Snow, patient editor, rsnow@bmj.com.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
An explicit recommendation to search for and include unpublished studies was given in several articles, with the argument that the results of unpublished studies may differ systematically from published studies.
“An explicit recommendation to search for and include unpublished studies was given in several articles [34, 48, 50, 61, 96], with the argument that the results of unpublished studies may differ systematically from published studies.”
From Methods to systematically review and meta-analyse observational studies: a systematic scoping review of recommendations (2018) · cites this paper as [96]
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722 · see citing works
Self-citationPractical Statistics for Medical Research.
Walter, S., & Altman, D. G. (1992) · Biometrics · doi:10.2307/2532320 · Cited by 11,665 · see citing works
Wasserman, S. S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,347 · see citing works
Practical Statistics for Medical Research.
Bartko, J. J., & Altman, D. G. (1992) · Journal of the American Statistical Association · doi:10.2307/2290246 · Cited by 4,834 · see citing works
The Handbook of Research Synthesis.
Howel, D., Cooper, H., & Hedges, L. V. (1995) · Biometrics · doi:10.2307/2533295 · Cited by 3,657 · see citing works
Improving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127 · see citing works
Fibrinolytic Therapy Trialists' (FTT) Collaborative Group (1994) · The Lancet · doi:10.1016/s0140-6736(94)91161-4 · Cited by 2,727 · see citing works
EFFECTIVENESS OF INTRAVENOUS THROMBOLYTIC TREATMENT IN ACUTE MYOCARDIAL INFARCTION
GRUPPOITALIANOPERLOSTUDIODELL (1986) · The Lancet · doi:10.1016/s0140-6736(86)92368-8 · Cited by 2,626 · see citing works
Yusuf, S., Zucker, D. M., Passamani, E. R., Peduzzi, P. N., Takaro, T., Fisher, L. D., Kennedy, J. W., Davis, K. B., Killip, T., Norris, R. M., et al. (1994) · The Lancet · doi:10.1016/s0140-6736(94)91963-1 · Cited by 2,129 · see citing works
Effectiveness and Efficiency: Random Reflections on Health Services
L'Etang, H. (1973) · Public Health · doi:10.1016/s0033-3506(73)80082-4 · Cited by 1,905 · see citing works
The Handbook of Research Synthesis.
Light, R. J., Cooper, H., & Hedges, L. V. (1994) · Journal of the American Statistical Association · doi:10.2307/2291021 · Cited by 1,880 · see citing works
Statistical Methods in Medical Research
Lachenbruch, P. A., & Armitage, P. (1972) · Technometrics · doi:10.2307/1266938 · Cited by 1,547 · see citing works
Antman, E. M. (1992) · JAMA · doi:10.1001/jama.268.2.240 · Cited by 1,535 · see citing works
Thrombolysis for acute ischaemic stroke
Wardlaw, J. M., Murray, V., Berge, E., & del Zoppo, G. J. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000213.pub3 · Cited by 1,460 · see citing works
<i>meta-analysis</i> bias in location and selection of studies
Egger, M., & Smith, G. D. (1998) · BMJ · doi:10.1136/bmj.316.7124.61 · Cited by 1,374 · see citing works
Self-citationLaw, M., Wald, N., & Thompson, S. (1994) · British medical journal · doi:10.1136/bmj.308.6925.367 · Cited by 1,306 · see citing works
(1977) · Annals of Internal Medicine · doi:10.7326/0003-4819-86-6-835_3 · Cited by 1,160 · see citing works
Meta-Analysis, Decision Analysis, and Cost-Effectiveness Analysis
Petitti, D. B. (1999) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195133646.001.0001 · Cited by 928 · see citing works
Petitti, D. B. (1994) · Medical Entomology and Zoology · Cited by 871 · see citing works
Meta-analysis of the literature or of individual patient data: is there a difference?
Stewart, L. A., & Parmar, M. (1993) · The Lancet · doi:10.1016/0140-6736(93)93004-k · Cited by 771 · see citing works
Yusuf, S., Collins, R., Peto, R., Furberg, C. D., Stampfer, M. J., Goldhaber, S. Z., & Hennekens, C. H. (1985) · European Heart Journal · doi:10.1093/oxfordjournals.eurheartj.a061905 · Cited by 568 · see citing works
Egger, M., & Smith, G. D. (1995) · BMJ · doi:10.1136/bmj.310.6982.752 · Cited by 508 · see citing works
Self-citationScience of urinary incontinence
Malone‐Lee, J., Wagg, A., Mundy, A. R., Fry, C. H., Lincoln, J., & NAYLOR, A. M. (1994) · The Lancet · doi:10.1016/s0140-6736(94)91344-7 · Cited by 497 · see citing works
Takaro, T., Hultgren, H. N., Lipton, M. J., & Detre, K. M. (1976) · PubMed · Cited by 491 · see citing works
IMPROVED SURVIVAL AFTER EARLY THROMBOLYSIS IN ACUTE MYOCARDIAL INFARCTION
Simoons, M. L., Brand, M. V. D., de Zwaan, C., et al. (1985) · The Lancet · doi:10.1016/s0140-6736(85)90584-7 · Cited by 451 · see citing works
Selective serotonin reuptake inhibitors: meta-analysis of efficacy and acceptability.
Song, F., Freemantle, N., Sheldon, T. A., House, A., Watson, P., Long, A., & Mason, J. (1993) · BMJ · doi:10.1136/bmj.306.6879.683 · Cited by 399 · cited 1× · see citing works
“…trial participants taking selective serotonin uptake inhibitors and those taking conventional antidepressants as an indicator of therapeutic success 15 : patients who stop taking their treatment because of inefficacy or side effects are the ones who are not benefiting, and thus the class of drug…”
BackgroundShould Unpublished Data Be Included in Meta-analyses?: Current Convictions and Controversies
Cook, D. J. (1993) · JAMA · doi:10.1001/jama.1993.03500210049030 · Cited by 259 · see citing works
Effect of Intravenous Streptokinase on Acute Myocardial Infarction
Stampfer, M. J., Goldhaber, S. Z., Yusuf, S., Peto, R., & Hennekens, C. H. (1982) · New England Journal of Medicine · doi:10.1056/nejm198211043071904 · Cited by 202 · see citing works
Nylenna, M. (1994) · JAMA · doi:10.1001/jama.272.2.149 · Cited by 161 · see citing works
Meta-analysis by the confidence profile method
Eddy, D. M. (1992) · Cited by 144 · see citing works
Mandel, E. M., Rockette, H. E., Bluestone, C. D., Paradise, J. L., & Nozza, R. J. (1987) · New England Journal of Medicine · doi:10.1056/nejm198702193160803 · Cited by 144 · see citing works
MeWAnalysis by the Confidence Profile Method: The Statistical Synthesis of Evidence
Lenth, R. V. (1993) · Technometrics · doi:10.1080/00401706.1993.10485067 · Cited by 121 · see citing works
Clarke, M. J., & Stewart, L. A. (1994) · BMJ · doi:10.1136/bmj.309.6960.1007 · Cited by 117 · see citing works
Doing more good than harm : the evaluation of health care interventions
Warren, K. S., Mosteller, F. C., & L.W. Frohlich Charitable Trust (1993) · DigitalGeorgetown (Georgetown University Library) · Cited by 94 · see citing works
Antimicrobial therapy for otitis media with effusion ('secretory' otitis media).
Cantekin, E. I., McGuire, T. W., & Griffith, T. (1991) · PubMed · Cited by 55 · see citing works
Lilienfeld, D. E., & Stolley, P. D. (1995) · Biometrics · doi:10.2307/2533364 · Cited by 53 · see citing works
The case for failed meta‐analyses
Naylor, C. D. (1995) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.1995.tb00018.x · Cited by 34 · see citing works
Rennie, D. (1991) · JAMA · doi:10.1001/jama.1991.03470230091037 · Cited by 31 · see citing works
Effective and acceptable treatment for depression.
Nakielny, J. (1993) · BMJ · doi:10.1136/bmj.306.6885.1125-b · Cited by 16 · see citing works
Presentation The emergence of a new species: The professional meta-analyst
Rosendaal, F. R. (1994) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)90074-4 · Cited by 10 · see citing works
Hanji, M. B. (2017) · Apple Academic Press eBooks · doi:10.4324/9781315366234-17 · Cited by 5 · see citing works
Meta-analysis and data synthesis in medical research
Smith, G., Egger, M., & Phillips, A. (1997) · Cited by 5 · see citing works
Self-citation(1991) · The Lancet · doi:10.1016/0140-6736(91)91173-r · Cited by 5 · see citing works
From the Overview to the Patient: How To Interpret Meta-analysis Data
Gelber, R. D., & Goldhirsch, A. (1993) · Recent results in cancer research/Recent Results in Cancer Research · doi:10.1007/978-3-642-84745-5_24 · Cited by 4 · see citing works
Effective and acceptable treatment for depression.
Madeley, P., & Wattis, J. P. (1993) · BMJ · doi:10.1136/bmj.306.6885.1126-a · Cited by 4 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Chan, A.-W., Hróbjartsson, A., Haahr, M. T., Gøtzsche, P. C., & Altman, D. G. (2004) · JAMA · doi:10.1001/jama.291.20.2457 · Cited by 1,845 · see citing works
<i>Meta-analysis:</i> Potentials and promise
Egger, M., & Smith, G. D. (1997) · BMJ · doi:10.1136/bmj.315.7119.1371 · Cited by 646 · see citing works
Self-citationBias in clinical intervention research.
Gluud, L. L. (2006) · American Journal of Epidemiology · doi:10.1093/aje/kwj069 · Cited by 636 · see citing works
Mueller, M., D’Addario, M., Egger, M., Cevallos, M., Dekkers, O., Mugglin, C., & Scott, P. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0495-9 · Cited by 400 · see citing works
Self-citationTaylor, M. J., Freemantle, N., Geddes, J. R., & Bhagwagar, Z. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.11.1217 · Cited by 406 · see citing works
Self-Talk and Sports Performance: A Meta-Analysis
Hatzigeorgiadis, A., Zourbanos, N., Galanis, E., & Theodorakis, Y. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691611413136 · Cited by 361 · see citing works
Ferguson, C. J., & Kilburn, J. (2010) · Psychological Bulletin · doi:10.1037/a0018566 · Cited by 311 · see citing works
Meta-analysis. Beyond the grand mean?
Smith, G. D., Egger, M., & Phillips, A. N. (1997) · BMJ · doi:10.1136/bmj.315.7122.1610 · Cited by 174 · see citing works
Self-citationProblems in the Design and Reporting of Trials of Antifungal Agents Encountered During Meta-analysis
Johansen, H. K. (1999) · JAMA · doi:10.1001/jama.282.18.1752 · Cited by 128 · see citing works
Basic concepts in meta-analysis: a primer for clinicians
KHOSHDEL, A., ATTIA, J., & CARNEY, S. L. (2006) · International Journal of Clinical Practice · doi:10.1111/j.1742-1241.2006.01078.x · Cited by 55 · see citing works
Carbamazepine for schizophrenia
Leucht, S., Helfer, B., Dold, M., Kissling, W., & McGrath, J. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001258.pub3 · Cited by 82 · see citing works
Tak, L. M., Meijer, A., Manoharan, A., de Jonge, P., & Rosmalen, J. G. M. (2010) · Psychosomatic Medicine · doi:10.1097/psy.0b013e3181d714e1 · Cited by 23 · see citing works
- Authors
- Smith, G. D., & Egger, M.
- Affiliations
- University of Bristol (GB)
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 1998-01-17
- Volume
- 316
- Issue
- 7126
- Pages
- 221-225
- ISSN
- 0007-1447 (ISSN-L)
- 0959-8138
- 1468-5833
- PMC
- PMC2665427
- OpenAlex
- W2087857295
- Cited by
- 175
- References
- 46
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 1 · 2023: 2 · 2022: 2 · 2021: 1 · 2020: 3 · 2019: 3 · 2018: 4 · 2017: 3 · 2016: 3 · 2015: 7 · 2014: 5 · 2013: 5 · 2012: 2
- FWCI
- 28.31
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- BMJ (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- HighWire Press Open Archive (submittedVersion)
- Topics
- Health Sciences › Health Professions › General Health Professions › Patient-Provider Communication in Healthcare
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Health Professions › Emergency Medical Services › Patient Safety and Medication Errors
- Keywords
- patient safety, patient confidence, patient perspectives, healthcare communication, patient-provider relationship
- MeSH terms
- Data Collection, Data Interpretation, Statistical, Decision Making, Meta-Analysis as Topic, Information Storage and Retrieval
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
