Meta-analysis and structured literature review in radiology1
Abstract
The overall goal of a systematic review or meta-analysis is to combine results of previous studies to arrive at summary conclusions about a body of research. In radiology, systematic reviews or meta-analyses can be used to calculate a summary estimate of effect size of a treatment that used imaging data to assess outcomes in observational or randomized controlled clinical trials, estimate the clinical effectiveness of an imaging-guided therapy procedure, evaluate the summary diagnostic accuracy of an imaging test, or synthesize results of economic evaluations that used imaging data. This article outlines the general concepts of structured literature reviews and discusses the approaches for conducting a meta-analysis in radiology, emphasizing the methods available for data synthesis and handling heterogeneity between and among studies.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Many considered heterogeneity important for the decision whether to pool the data.
“Many considered heterogeneity important for the decision whether to pool the data [34, 36, 47, 55, 56, 66, 101, 103].”
From Methods to systematically review and meta-analyse observational studies: a systematic scoping review of recommendations (2018) · cites this paper as [103]
Authors recommended not to pool if heterogeneity is too high, and use statistical measures of heterogeneity to choose between random-effects and fixed-effect models.
“Authors recommended not to pool if heterogeneity is too high [35, 38, 47, 85, 103], and use statistical measures of heterogeneity to choose between random-effects (in case of heterogeneity) and fixed-effect models [55, 66].”
From Methods to systematically review and meta-analyse observational studies: a systematic scoping review of recommendations (2018) · cites this paper as [103]
Cites
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763 · see citing works
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856 · see citing works
Assessing the quality of reports of randomized clinical trials: Is blinding necessary?
Jadad, A. R., Moore, R. A., Carroll, D., Jenkinson, C., Reynolds, D. J. M., Gavaghan, D. J., & McQuay, H. J. (1996) · Controlled Clinical Trials · doi:10.1016/0197-2456(95)00134-4 · Cited by 17,582 · see citing works
Cost-Effectiveness in Health and Medicine
(1996) · doi:10.1093/oso/9780195108248.001.0001 · Cited by 7,193 · see citing works
Evidence-Based Medicine: How to Practice and Teach EBM
Sackett, D. L. (2000) · Cited by 5,950 · see citing works
Beta blockade during and after myocardial infarction: An overview of the randomized trials
Yusuf, S., Peto, R., Lewis, J., Collins, R., & Sleight, P. (1985) · Progress in Cardiovascular Diseases · doi:10.1016/s0033-0620(85)80003-7 · Cited by 3,205 · see citing works
Quantitative Synthesis in Systematic Reviews
Lau, J., Ioannidis, J. P. A., & Schmid, C. H. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-9-199711010-00008 · Cited by 2,517 · see citing works
Systematic Reviews in Health Care : Meta-Analysis in Context
Egger, M., Smith, G. D., & Altman, D. G. (2000) · Cited by 2,312 · see citing works
Users' Guides to the Medical Literature
Jaeschke, R. (1994) · JAMA · doi:10.1001/jama.1994.03510330081039 · Cited by 2,220 · see citing works
Deeks, J. J., Altman, D. G., & Bradburn, M. J. (2001) · Systematic Reviews in Health Care · doi:10.1002/9780470693926.ch15 · Cited by 2,163 · see citing works
The Hazards of Scoring the Quality of Clinical Trials for Meta-analysis
Jüni, P. (1999) · JAMA · doi:10.1001/jama.282.11.1054 · Cited by 1,981 · see citing works
The Handbook of Research Synthesis.
Light, R. J., Cooper, H., & Hedges, L. V. (1994) · Journal of the American Statistical Association · doi:10.2307/2291021 · Cited by 1,880 · see citing works
Clinical Epidemiology: The Essentials.
(1991) · Annals of Internal Medicine · doi:10.7326/0003-4819-114-9-825_10 · Cited by 1,838 · see citing works
Guidelines for authors and peer reviewers of economic submissions to the BMJ
Drummond, M. F., & Jefferson, T. O. (1996) · BMJ · doi:10.1136/bmj.313.7052.275 · Cited by 1,827 · see citing works
Hulley, S. B. (1997) · Cited by 1,753 · see citing works
Systematic Reviews in Health Care: Meta‐Analysis in Context
(2001) · doi:10.1002/9780470693926 · Cited by 1,693 · see citing works
Moses, L. E., Shapiro, D. E., & Littenberg, B. (1993) · Statistics in Medicine · doi:10.1002/sim.4780121403 · Cited by 1,405 · see citing works
Systematic Reviews in Health Care. Meta-analysis in Context.
Kleijnen, J., & Antes, G. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.3.697 · Cited by 1,373 · see citing works
Review papers : The statistical basis of meta-analysis
Fleiss, J. (1993) · Statistical Methods in Medical Research · doi:10.1177/096228029300200202 · Cited by 1,284 · see citing works
Users' Guides to the Medical Literature
Jaeschke, R. (1994) · JAMA · doi:10.1001/jama.1994.03510290071040 · Cited by 1,055 · see citing works
Methods for combining randomized clinical trials: Strengths and limitations
DeMets, D. L. (1987) · Statistics in Medicine · doi:10.1002/sim.4780060325 · Cited by 1,027 · see citing works
Davies, H. T. O., Crombie, I. K., & Tavakoli, M. (1998) · BMJ · doi:10.1136/bmj.316.7136.989 · Cited by 991 · see citing works
Likelihood ratios with confidence: Sample size estimation for diagnostic test studies
Simel, D. L., Samsa, G. P., & Matchar, D. B. (1991) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(91)90128-v · Cited by 932 · see citing works
Meta-Analysis, Decision Analysis, and Cost-Effectiveness Analysis
Petitti, D. B. (1999) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195133646.001.0001 · Cited by 928 · see citing works
Clinical epidemiology: The essentials
Valagussa, P. (1988) · Controlled Clinical Trials · doi:10.1016/0197-2456(88)90054-2 · Cited by 922 · see citing works
A random‐effects regression model for meta‐analysis
Berkey, C. S., Hoaglin, D. C., Mosteller, F. C., & Colditz, G. A. (1995) · Statistics in Medicine · doi:10.1002/sim.4780140406 · Cited by 882 · see citing works
Petitti, D. B. (1994) · Medical Entomology and Zoology · Cited by 871 · see citing works
Estimation of a Common Effect Parameter from Sparse Follow-Up Data
Greenland, S., & Robins, J. M. (1985) · Biometrics · doi:10.2307/2530643 · Cited by 798 · see citing works
Guidelines for Meta-analyses Evaluating Diagnostic Tests
Irwig, L., Tosteson, A. N. A., Gatsonis, C., Lau, J., Colditz, G. A., Chalmers, T. C., & Mosteller, F. (1994) · Annals of Internal Medicine · doi:10.7326/0003-4819-120-8-199404150-00008 · Cited by 754 · see citing works
A general parametric approach to the meta‐analysis of randomized clinical trials
Whitehead, A., & Whitehead, J. (1991) · Statistics in Medicine · doi:10.1002/sim.4780101105 · Cited by 750 · see citing works
Incorporating variations in the quality of individual randomized trials into meta-analysis
Detsky, A. S., Naylor, C. D., O'Rourke, K., McGeer, A. J., & L'Abbé, K. A. (1992) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(92)90085-2 · Cited by 640 · see citing works
INTERPRETATION AND CHOICE OF EFFECT MEASURES IN EPIDEMIOLOGIC ANALYSES1
Greenland, S. (1987) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a114593 · Cited by 546 · see citing works
Moher, D., Fortin, P. R., Jadad, A. R., Jüni, P., Klassen, T. P., LeLorier, J., Liberati, A., Penna, A., & Linde, K. (1996) · The Lancet · doi:10.1016/s0140-6736(96)90538-3 · Cited by 539 · see citing works
Thompson, S. G., & Pocock, S. (1991) · The Lancet · doi:10.1016/0140-6736(91)91975-z · Cited by 489 · see citing works
Does blinding of readers affect the results of meta-analyses?
Berlin, J. A. (1997) · The Lancet · doi:10.1016/s0140-6736(05)62352-5 · Cited by 478 · see citing works
Meta-analytic methods for diagnostic test accuracy
Irwig, L., Macaskill, P., Glasziou, P., & Fahey, M. T. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00099-c · Cited by 467 · see citing works
Exploring sources of heterogeneity in systematic reviews of diagnostic tests
Lijmer, J. G., Bossuyt, P. M., & Heisterkamp, S. H. (2002) · Statistics in Medicine · doi:10.1002/sim.1185 · Cited by 446 · see citing works
Estimating Diagnostic Accuracy from Multiple Conflicting Reports
Littenberg, B., & Moses, L. E. (1993) · Medical Decision Making · doi:10.1177/0272989x9301300408 · Cited by 425 · see citing works
A comparison of statistical methods for combining event rates from clinical trials
Berlin, J. A., Laird, N. M., Sacks, H. S., & Chalmers, T. C. (1989) · Statistics in Medicine · doi:10.1002/sim.4780080202 · Cited by 420 · see citing works
Evaluation of old and new tests of heterogeneity in epidemiologic meta-analysis
Takkouche, B., Cadarso-Suarez, C., & Spiegelman, D. (1999) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a009981 · Cited by 380 · see citing works
Statistical Methods in Meta-Analysis
Petitti, D. B. (1999) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195133646.003.07 · Cited by 287 · see citing works
A General Regression Methodology for ROC Curve Estimation
Tosteson, A. N. A., & Begg, C. B. (1988) · Medical Decision Making · doi:10.1177/0272989x8800800309 · Cited by 274 · see citing works
Systematic reviews of trials and other studies.
Sutton, A. J., Abrams, K. R., Jones, D. R., Sheldon, T., & Сонг (1998) · Health Technology Assessment · doi:10.3310/hta2190 · Cited by 268 · see citing works
Hedges, J. R. (1989) · Journal of Emergency Medicine · doi:10.1016/0736-4679(89)90395-8 · Cited by 256 · see citing works
Systematic Reviews in Health Care
Loo, L. K. (2002) · Annals of Internal Medicine · doi:10.7326/0003-4819-137-7-200210010-00035 · Cited by 254 · see citing works
Physiotherapy exercises and back pain: a blinded review.
Koes, B. W., Bouter, L. M., Beckerman, H., van der Heijden, G. J. M. G., & Knipschild, P. G. (1991) · BMJ · doi:10.1136/bmj.302.6792.1572 · Cited by 238 · see citing works
Deeks, J. J., Bracken, M. B., Sinclair, J. C., Davies, H. T. O., Tavakoli, M., & Crombie, I. K. (1998) · BMJ · doi:10.1136/bmj.317.7166.1155a · Cited by 225 · see citing works
Problems and Limitations in Conducting Systematic Reviews
Egger, M., Dickersin, K., & Smith, G. D. (2001) · Wiley eBooks · doi:10.1002/9780470693926.ch3 · Cited by 206 · see citing works
Sensitivity analysis and diagnostics.
Greenhouse, J. B., & Iyengar, S. (1994) · Cited by 195 · see citing works
Sackett, D. L., Deeks, J. J., & Altman, D. G. (1996) · BMJ Evidence-Based Medicine · doi:10.1136/ebm.1996.1.164 · Cited by 178 · see citing works
Effect Measures for Meta‒Analysis of Trials with Binary Outcomes
Deeks, J. J., & Altman, D. G. (2001) · doi:10.1002/9780470693926.ch16 · Cited by 176 · see citing works
Systematic reviews : synthesis of best evidence for health care decisions
Mulrow, C. D., & Cook, D. J. (1998) · American College of Physicians eBooks · Cited by 172 · see citing works
Bias in the one‐step method for pooling study results
Greenland, S., & Salván, A. (1990) · Statistics in Medicine · doi:10.1002/sim.4780090307 · Cited by 165 · see citing works
Estimating Time to Conduct a Meta-analysis From Number of Citations Retrieved
Allen, I. E. (1999) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.282.7.634 · Cited by 163 · see citing works
A Meta-analytic Method for Summarizing Diagnostic Test Performances
Midgette, A. S., Stukel, T. A., & Littenberg, B. (1993) · Medical Decision Making · doi:10.1177/0272989x9301300313 · Cited by 156 · see citing works
Greenland, S. (1994) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a117250 · Cited by 150 · see citing works
The inadequacy of binary models for the clinical reality of three-zone diagnostic decisions
Feinstein, A. R. (1990) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(90)90064-v · Cited by 89 · see citing works
Users' Guides to the Medical Literature
(2002) · Archives of Ophthalmology · doi:10.1001/archopht.120.6.873 · Cited by 88 · see citing works
Assessing the appropriateness of combining economic data from multinational clinical trials
Cook, J. R., Drummond, M., Glick, H. A., & Heyse, J. F. (2003) · Statistics in Medicine · doi:10.1002/sim.1389 · Cited by 75 · see citing works
Kardaun, J. W. P. F., & Kardaun, O. J. W. F. (1990) · Methods of Information in Medicine · doi:10.1055/s-0038-1634759 · Cited by 74 · see citing works
Treatment of Early-Stage Breast Cancer in the Elderly
Carter, K. J., Ritchey, N. P., Castro, F., Caccamo, L. P., Kessler, E., Erickson, B. A., & Gawdyda, L. (1998) · Medical Decision Making · doi:10.1177/0272989x9801800210 · Cited by 56 · see citing works
A METHOD FOR DETERMINING THE SIZE OF INTERNAL PILOT STUDIES
Sandvik, L., Erikssen, J., Mowinckel, P., & Rødland, E. A. (1996) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19960730)15:14 · Cited by 54 · see citing works
Issues in combining independent estimates of the sensitivity and specificity of a diagnostic test.
De, S. (1995) · PubMed · Cited by 45 · see citing works
Combining estimates of the odds ratio: the state of the art
Emerson, J. D. (1994) · Statistical Methods in Medical Research · doi:10.1177/096228029400300204 · Cited by 42 · see citing works
Systematic Reviews: Synthesis of Best Evidence for Health Care Decisions
Horowitz, D. A. (1998) · Annals of Internal Medicine · doi:10.7326/0003-4819-129-9-199811010-00047 · Cited by 40 · see citing works
The clinical importance of early stopping of randomized trials in cancer treatments
Souhami, R. L. (1994) · Statistics in Medicine · doi:10.1002/sim.4780131303 · Cited by 27 · see citing works
Using Systematic Reviews for Economic Evaluation
Mugford, M. (2001) · doi:10.1002/9780470693926.ch23 · Cited by 22 · see citing works
The Cochrane Collaboration in the 20th Century
Antes, G., & Oxman, A. D. (2001) · doi:10.1002/9780470693926.ch25 · Cited by 20 · see citing works
Walshe, R. (2009) · Innere Medizin · doi:10.1016/b978-3-437-42831-9.10006-3 · Cited by 19 · see citing works
Completeness of reporting of trials published in languages other than English
Sandford, P. (1996) · The Lancet · doi:10.1016/s0140-6736(96)91393-8 · Cited by 13 · see citing works
Methodological Quality of Economic Modelling Studies
Jefferson, T., & Demicheli, V. (1998) · PharmacoEconomics · doi:10.2165/00019053-199814030-00002 · Cited by 13 · see citing works
Physiotherapy exercises and back pain.
Koes, B. W., Bouter, L. M., Beckerman, H., et al. (1991) · BMJ · doi:10.1136/bmj.303.6806.853 · Cited by 13 · see citing works
(1987) · Journal of Perinatal Medicine · doi:10.1515/jpme.1987.15.s1.126 · Cited by 3 · see citing works
Petitti, D. B. (1999) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195133646.003.03 · Cited by 1 · see citing works
Explaining heterogeneity in meta-analysis: a comparison of methods
Thompson, S. G., & Sharp, S. J. (1999) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19991030)18:20
Flagged first, then by citations
Cited by
Sorted by citations
Mueller, M., D’Addario, M., Egger, M., Cevallos, M., Dekkers, O., Mugglin, C., & Scott, P. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0495-9 · Cited by 400 · see citing works
- Authors
- Doria, A. S.
- Affiliations
- University of Toronto (CA)
- Corresponding author
- Doria, Andrea S.
- ORCID
- Doria, Andrea S.
- Venue
- Academic Radiology
- Publisher
- Elsevier BV
- Published
- 2005-04
- Volume
- 12
- Issue
- 4
- Pages
- 399-408
- ISSN
- 1076-6332 (ISSN-L)
- OpenAlex
- W2039636399
- Cited by
- 9
- References
- 77
- Citations by year
- 2018: 1 · 2014: 1 · 2013: 1
- FWCI
- 0.35
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Academic Radiology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiology practices and education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- meta-analysis, systematic reviews, radiology, data synthesis, heterogeneity, diagnostic accuracy, image-guided therapy, economic evaluation, treatment effect size
- MeSH terms
- Humans, Radiology, Review Literature as Topic, Meta-Analysis as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
