On combining dose—response data from epidemiological studies by meta‐analysis
Abstract
Using data from a meta‐analysis of the effects of oestrogen replacement therapy on the development of breast cancer, we compared alternative methods for combining dose—response slopes from epidemiological studies. We evaluated issues related both to summarizing data from single studies and to combining results from multiple studies. Findings related to the analysis of individual dose—response studies include: (1) a method of weighing studies that gives greater influence to dose—response slopes that conform to the linear relation of relative risk to duration can lead to large differences in calculated weights as a function of non‐linearity; (2) a regression model using a variable‐intercept resulted in a mean dose—response slope that increased as much as threefold when compared with the values obtained with a zero‐intercept model. When combining results from multiple studies, we found: (1) calculating standard errors of mean dose—response slopes by methods that allow for both among‐study and within‐study variability (a random‐effects type model) gave values different from a method that assumes homogeneity and equal within‐study precision (a fixed‐effects model); (2) the random‐effects model gives mean and standard error results most similar to a bootstrap resampling method as increasing heterogeneity is observed (however, this model could give biased mean estimates compared with the bootstrap method); (3) a components‐of‐variance model compares favourably with the bootstrap and is easier to apply than the random‐effects model. Based on these findings, we recommend the use of methods which incorporate heterogeneity to guard against underestimating the standard error. However, caution is urged because bias in point estimates can occur if extreme heterogeneity is present. Two other observations affect the interpretation of data combined from multiple studies. First, inclusion into a model of quality scores assigned by blinded reviewers had little effect on the mean dose—response slope and its standard error. Second, the number of studies required to achieve desired statistical power, varies with effect size.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Other topics included meta-regression, while few articles focused on more specific statistical issues, such as dose-response analysis, credibility ceilings, bias adjustment, hierarchical models, or regression bias.
“Other topics included meta-regression, while few articles focused on more specific statistical issues, such as dose-response analysis [81, 109, 111, 113], credibility ceilings [110], bias adjustment [112], hierarchical models [117], or regression bias [108].”
From Methods to systematically review and meta-analyse observational studies: a systematic scoping review of recommendations (2018) · cites this paper as [111]
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. E., & Cohen, J. (1989) · Technometrics · doi:10.2307/1270020 · Cited by 99,588 · see citing works
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552 · see citing works
Applied Linear Statistical Models.
Lorenz, F. O., Neter, J., Wasserman, W., & Kutner, M. (1986) · Journal of the American Statistical Association · doi:10.2307/2289108 · Cited by 5,566 · see citing works
The combination of estimates from different experiments
Cochran, W. G. (1954) · Biometrics · doi:10.2307/3001666 · Cited by 5,380 · see citing works
QUANTITATIVE METHODS IN THE REVIEW OF EPIDEMIOLOGIC LITERATURE1
GREENLAND, S. (1987) · Epidemiologic Reviews · doi:10.1093/oxfordjournals.epirev.a036298 · Cited by 1,644 · see citing works
Dixon, W. J. (1953) · Biometrics · doi:10.2307/3001634 · Cited by 872 · see citing works
A Meta-analysis of the Effect of Estrogen Replacement Therapy on the Risk of Breast Cancer
STEINBERG, K. K. (1991) · JAMA · doi:10.1001/jama.1991.03460150089030 · Cited by 629 · see citing works
Self-citationFleiss, J. L., & Gross, A. J. (1991) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(91)90261-7 · Cited by 404 · see citing works
Emerson, J. D., Burdick, E., Hoaglin, D. C., Mosteller, F. C., & Chalmers, T. C. (1990) · Controlled Clinical Trials · doi:10.1016/0197-2456(90)90175-2 · Cited by 241 · see citing works
Considerations for the meta-analysis of randomized clinical trials
Boissel, J., Blanchard, J., Panak, E., Peyrieux, J., & Sacks, H. S. (1989) · Controlled Clinical Trials · doi:10.1016/0197-2456(89)90067-6 · Cited by 119 · see citing works
Nonparametric Estimation of Standard Errors
Farewell, V. T. (2014) · Wiley StatsRef: Statistics Reference Online · doi:10.1002/9781118445112.stat00466 · Cited by 1 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Quantitative Synthesis in Systematic Reviews
Lau, J., Ioannidis, J. P. A., & Schmid, C. H. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-9-199711010-00008 · Cited by 2,517 · see citing works
Rimm, E. B., Williams, P., Fosher, K., Criqui, M., & Stampfer, M. J. (1999) · BMJ · doi:10.1136/bmj.319.7224.1523 · Cited by 1,360 · see citing works
Mueller, M., D’Addario, M., Egger, M., Cevallos, M., Dekkers, O., Mugglin, C., & Scott, P. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0495-9 · Cited by 400 · see citing works
A Quality-Effects Model for Meta-Analysis
Doi, S. A. R., & Thalib, L. (2008) · Epidemiology · doi:10.1097/ede.0b013e31815c24e7 · Cited by 272 · see citing works
Holt, S., Herxheimer, A., Suder, A., Weatherall, M., Cheng, S., Shirtcliffe, P., & Beasley, R. (2001) · BMJ · doi:10.1136/bmj.323.7307.253 · Cited by 224 · see citing works
Vaginal douching and adverse health effects: a meta-analysis.
Zhang, J., Thomas, A. G., & Leybovich, E. (1997) · American Journal of Public Health · doi:10.2105/ajph.87.7.1207 · Cited by 206 · see citing works
A meta-analysis of estrogen replacement therapy and risk of epithelial ovarian cancer
Coughlin, S. S., Giustozzi, A. G., Smith, S. J., & Lee, N. C. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00179-1 · Cited by 119 · see citing works
Self-citationThe Role of Meta-analysis in the Regulatory Process for Foods, Drugs, and Devices
Berlin, J. A. (1999) · JAMA · doi:10.1001/jama.281.9.830 · Cited by 101 · see citing works
Lee, A. S. Y., Kee, W. D. N., & Gin, T. (2004) · Anesthesia & Analgesia · doi:10.1213/01.ane.0000096183.49619.fc · Cited by 96 · see citing works
Systematic reviews of trials and other studies.
Sutton, A. J., Abrams, K. R., Jones, D. R. H., Sheldon, T., & Song, F. (1998) · PubMed · Cited by 79 · see citing works
Parametric and nonparametric bootstrap methods for meta-analysis
Noortgate, W. V. D., & Onghena, P. (2005) · Behavior Research Methods · doi:10.3758/bf03206394 · Cited by 61 · see citing works
Glišić, M., Raguindin, P. F., Gemperli, A., Taneri, P. E., Salvador, D., Voortman, T., Marques-Vidal, P. M., Papatheodorou, S., Kunutsor, S. K., Bano, A., et al. (2023) · Public health reviews · doi:10.3389/phrs.2023.1605454 · Cited by 56 · see citing works
Menopause Research and The Dominance of the Biomedical Model 1984-1994
Rostosky, S. S., & Travis, C. B. (1996) · Psychology of Women Quarterly · doi:10.1111/j.1471-6402.1996.tb00471.x · Cited by 52 · see citing works
Snow, L. C., & Michael, E. (2002) · Medical and Veterinary Entomology · doi:10.1046/j.1365-2915.2002.00396.x · Cited by 36 · see citing works
Tweedie, R. L., & Mengersen, K. L. (1995) · Statistics in Medicine · doi:10.1002/sim.4780140514 · Cited by 35 · see citing works
Modelling study quality in meta-analysis
Tritchler, D. (1999) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19990830)18:16 · Cited by 30 · see citing works
Meta‐analysis in Stata using gllamm
Bagos, P. G. (2015) · Research Synthesis Methods · doi:10.1002/jrsm.1157 · Cited by 25 · see citing works
COMBINING ENVIRONMENTAL INFORMATION. II: ENVIRONMENTAL EPIDEMIOLOGY AND TOXICOLOGY
Piegorsch, W. W., & Cox, L. H. (1996) · Environmetrics · doi:10.1002/(sici)1099-095x(199605)7:3 · Cited by 25 · see citing works
Meta‐analysis for dose—response models
DuMouchel, W. (1995) · Statistics in Medicine · doi:10.1002/sim.4780140524 · Cited by 24 · see citing works
Phillips, C. J. C. (2005) · Animal Welfare · doi:10.1017/s0962728600029663 · Cited by 15 · see citing works
Empirical evaluation of meta‐analytic approaches for nutrient and health outcome dose‐response data
Yu, W. W., Schmid, C. H., Lichtenstein, A. H., Lau, J., & Trikalinos, T. A. (2013) · Research Synthesis Methods · doi:10.1002/jrsm.1084 · Cited by 14 · see citing works
Synthesis of Evidence from Epidemiological Studies with Interval-Censored Exposure Due to Grouping
Cook, R. J., Brumback, B., Wigg, M., & RYAN, L. M. (2001) · Biometrics · doi:10.1111/j.0006-341x.2001.00671.x · Cited by 10 · see citing works
Understanding Meta-Analysis in Cancer Epidemiology: Dietary Fat and Breast Cancer
Harrison, R. A., & Waterbor, J. W. (1999) · Cancer Detection and Prevention · doi:10.1046/j.1525-1500.1999.09916.x · Cited by 10 · see citing works
Bao, C., Wang, K., Ding, Y., & Kong, J. (2019) · Frontiers in Oncology · doi:10.3389/fonc.2019.01298 · Cited by 5 · see citing works
Stroup, D. F., & Thacker, S. B. (2005) · Encyclopedia of Biostatistics · doi:10.1002/0470011815.b2a03083 · Cited by 2 · see citing works
Self-citationMeta‐analysis and multilevel models
Congdon, P. D. (2014) · Wiley series in probability and statistics · doi:10.1002/9781118895047.ch5
El metanálisis: un método de estadística de integración
García, H. I. G. (1997) · IATREIA · doi:10.17533/udea.iatreia.3617
Stroup, D. F., & Thacker, S. B. (2014) · Wiley StatsRef: Statistics Reference Online · doi:10.1002/9781118445112.stat05179
Self-citation
- Authors
- Smith, S. J., Caudill, S. L. P., Steinberg, K. K., & Thacker, S. B.
- Affiliations
- Centers for Disease Control and Prevention (US)
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 1995-03-15
- Volume
- 14
- Issue
- 5-7
- Pages
- 531-544
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2041753036
- Cited by
- 28
- References
- 11
- Citations by year
- 2023: 1 · 2019: 1 · 2018: 1 · 2015: 1 · 2014: 2 · 2013: 1
- FWCI
- 4.69
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Statistics in Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Health Sciences › Medicine › Endocrinology, Diabetes and Metabolism › Menopause: Health Impacts and Treatments
- Keywords
- estrogen replacement therapy, breast cancer, dose-response slope, random effects models, fixed effects model, bootstrapping, heterogeneity, standard error estimation, statistical power
- MeSH terms
- Analysis of Variance, Breast Neoplasms, Data Interpretation, Statistical, Dose-Response Relationship, Drug, Epidemiologic Methods, Female, Humans, Menopause, Regression Analysis, Meta-Analysis as Topic, Models, Statistical, Estrogen Replacement Therapy, Case-Control Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review