Guidelines for Application of Metaanalysis in Environmental Epidemiology
Abstract
The use of meta-analysis in environmental epidemiology can enhance the value of epidemiologic data in debates about environmental health risks. Meta-analysis may be particularly useful to formally examine sources of heterogeneity, to clarify the relationship between environmental exposures and health effects, and to generate information beyond that provided by individual studies or a narrative review. However, meta-analysis may not be useful when the relationship between exposure and disease is obvious, when there are only a few studies of the key health outcomes, or when there is substantial confounding or other biases which cannot be adjusted for in the analysis. Recent increases in the use of meta-analysis in environmental epidemiology have highlighted the need for guidelines for the application of the technique. Guidelines, in the form of desirable and undesirable attributes, are presented in this paper for various components of a meta-analysis including study identification and selection; data extraction and analysis; and interpretation, presentation, and communication of results. Also discussed are the appropriateness of the use of meta-analysis in environmental health studies and when meta-analysis should or should not be used.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Sixteen articles (17%) provided recommendations on the key item "protocol development", with publication dates between 1994 and 2015 (median year 2009).
“Sixteen articles (17%) provided recommendations on the key item “protocol development” (Table 3), [29–44] with publication dates between 1994 and 2015 (median year of publication 2009).”
From Methods to systematically review and meta-analyse observational studies: a systematic scoping review of recommendations (2018) · cites this paper as [34]
Further reasons mentioned for writing a protocol were to ensure replicability and to document all procedures used in the review.
“Further reasons mentioned were to ensure replicability [34], and to document all procedures used in the review [31].”
From Methods to systematically review and meta-analyse observational studies: a systematic scoping review of recommendations (2018) · cites this paper as [34]
The majority of articles discussed aspects general to systematic reviews including advantages and limitations of different literature sources and databases, search tools, the importance of identifying unpublished studies, literature searching techniques including how to build a search string and reporting.
“The majority of articles discussed aspects general to systematic reviews including advantages and limitations of different literature sources and databases, search tools, the importance of identifying unpublished studies, literature searching techniques including how to build a search string and reporting [12, 29, 33–36, 46, 48, 50, 51, 53, 54, 57, 59–62, 67, 68].”
From Methods to systematically review and meta-analyse observational studies: a systematic scoping review of recommendations (2018) · cites this paper as [34]
Thirty-three articles (35%) made recommendations about the key item "search strategy", with publication dates between 1995 and 2016 (median year 2007).
“Thirty-three articles (35%) made recommendations about the key item “search strategy” [12, 29, 30, 33–36, 38, 39, 43, 46–51, 53–69], with publication dates between 1995 and 2016 (median year of publication 2007).”
From Methods to systematically review and meta-analyse observational studies: a systematic scoping review of recommendations (2018) · cites this paper as [34]
Nine articles (10%) made recommendations on how to perform data extraction, with publication dates between 1995 and 2016 (median year 2009).
“Nine articles (10%) made recommendations on how to perform data extraction [29, 33–35, 38, 43, 47, 48, 74], with publication dates between 1995 and 2016 (median year of publication 2009).”
From Methods to systematically review and meta-analyse observational studies: a systematic scoping review of recommendations (2018) · cites this paper as [34]
Twenty-two articles (24%) provided recommendations on the key item "study eligibility", with publication dates between 1995 and 2016 (median year 2009).
“Twenty-two articles (24%) provided recommendations on the key item “study eligibility”, [12, 29, 30, 33, 34, 37–39, 41–43, 46–48, 54, 55, 61, 65, 70–73] with publication dates between 1995 and 2016 (median year of publication 2009).”
From Methods to systematically review and meta-analyse observational studies: a systematic scoping review of recommendations (2018) · cites this paper as [34]
Twenty-five (27%) articles gave recommendations on item "considering different study designs", with publication dates between 1995 and 2016 (median year 2007).
“Twenty-five (27%) articles gave recommendations on item “considering different study designs” [8, 29, 34, 35, 37–39, 42, 44, 49, 51, 56, 61, 65, 70, 73, 75, 76, 77–83], with publication dates between 1995 and 2016 (median year of publication 2007).”
From Methods to systematically review and meta-analyse observational studies: a systematic scoping review of recommendations (2018) · cites this paper as [34]
Recommendations were made mainly on two topics: whether different study designs should be included in a systematic review; and whether different study designs should be analysed together in a single meta-analysis.
“Recommendations were made mainly on 2 topics: whether different study designs should be included in a systematic review; [29, 34, 37–39, 49, 56, 65, 73, 75] and whether different study designs should be analysed together in a single meta-analysis [8, 34, 35, 37, 38, 42, 49, 51, 56, 61, 70, 75–78].”
From Methods to systematically review and meta-analyse observational studies: a systematic scoping review of recommendations (2018) · cites this paper as [34]
Several articles recommended that the data should be extracted by two independent reviewers to avoid errors, or that blinding those assessing methodological quality to the names of the authors, their institutions and the names of journals would lead to more consistent extraction.
“Several articles recommended that the data should be extracted by two independent reviewers to avoid errors [29, 33], or that blinding those assessing methodological quality to the names of the authors, their institutions and the names of journals would lead to more consistent extraction [29, 34].”
From Methods to systematically review and meta-analyse observational studies: a systematic scoping review of recommendations (2018) · cites this paper as [34]
Some authors agreed that study design should be investigated as a potential source of between study heterogeneity, and others recommended presenting meta-analyses for each study type alongside results from an overall meta-analysis.
“Some authors agreed that study design should be investigated as a potential source of between study heterogeneity [8, 34, 42, 77], and others recommended presenting meta-analyses for each study type alongside results from an overall meta-analysis [42, 83].”
From Methods to systematically review and meta-analyse observational studies: a systematic scoping review of recommendations (2018) · cites this paper as [34]
Twenty (22%) articles reported on item "publication bias", with publication dates between 1994 and 2012 (median year 2001).
“Twenty (22%) articles reported on item “publication bias” [16, 29, 33, 34, 36, 46, 48–50, 55, 56, 61, 70, 78, 85, 95–99], with publication dates between 1994 and 2012 (median year of publication 2001).”
From Methods to systematically review and meta-analyse observational studies: a systematic scoping review of recommendations (2018) · cites this paper as [34]
An explicit recommendation to search for and include unpublished studies was given in several articles, with the argument that the results of unpublished studies may differ systematically from published studies.
“An explicit recommendation to search for and include unpublished studies was given in several articles [34, 48, 50, 61, 96], with the argument that the results of unpublished studies may differ systematically from published studies.”
From Methods to systematically review and meta-analyse observational studies: a systematic scoping review of recommendations (2018) · cites this paper as [34]
Thirty-nine articles (42%) made recommendations on the assessment of quality and risk of bias of individual studies, with publication dates between 1994 and 2016 (median year 2009).
“Thirty-nine articles (42%) made recommendations on the assessment of quality and risk of bias of individual studies, [12, 16, 29, 30, 32–35, 37, 38, 43, 47–50, 52–54, 56, 64–66, 70, 71, 73, 75, 77, 82, 84–94] with publication dates between 1994 and 2016 (median year of publication 2009).”
From Methods to systematically review and meta-analyse observational studies: a systematic scoping review of recommendations (2018) · cites this paper as [34]
Some authors suggested that results should be combined in a single meta-analysis only in the absence of marked heterogeneity.
“Some authors suggested that results should be combined in a single meta-analysis only in the absence of marked heterogeneity [34, 51].”
From Methods to systematically review and meta-analyse observational studies: a systematic scoping review of recommendations (2018) · cites this paper as [34]
Some authors suggested that the inclusion of unpublished studies could also introduce bias due to poor methodological quality of non-peer reviewed articles.
“However, some authors suggested that the inclusion of unpublished studies could also introduce bias due to poor methodological quality on non-peer reviewed articles: “the quality of unpublished reports must be closely scrutinized since they presumably have not undergone the same kind of peer review as published literature” [34].”
From Methods to systematically review and meta-analyse observational studies: a systematic scoping review of recommendations (2018) · cites this paper as [34]
Thirty-nine articles (42%) provided recommendations on heterogeneity and its assessment, with publication dates between 1994 and 2016 (median year 2006).
“Thirty-nine articles (42%) provided recommendations on heterogeneity and its assessment, [8, 12, 16, 29, 30, 33, 34, 36, 38, 39, 41–44, 47, 49–52, 54–56, 61, 66, 70, 72, 77, 82, 85, 87, 98, 100–107] with publication dates between 1994 and 2016 (median year of publication 2006).”
From Methods to systematically review and meta-analyse observational studies: a systematic scoping review of recommendations (2018) · cites this paper as [34]
One common recommendation was to explore heterogeneity in sensitivity analyses, comparing studies stratified by design or clinical features.
“One common recommendation was to explore heterogeneity in sensitivity analyses, comparing studies stratified by design or clinical features [12, 16, 29, 34, 39, 51, 55, 56, 66, 77, 85, 100, 102].”
From Methods to systematically review and meta-analyse observational studies: a systematic scoping review of recommendations (2018) · cites this paper as [34]
Fifty-two articles (56%) provided recommendations on the statistical analysis in the context of meta-analysis of observational studies, with publication dates between 1994 and 2016 (median year 2006).
“Fifty-two articles (56%), provided recommendations on the statistical analysis in the context of meta-analysis of observational studies [8, 12, 16, 29–31, 33–36, 38, 41–44, 47, 48, 52, 54–56, 61, 66, 70, 72, 73, 77, 79–83, 85, 87, 96, 100, 101, 103–105, 107–118], with publication dates between 1994 and 2016 (median year of publication 2006).”
From Methods to systematically review and meta-analyse observational studies: a systematic scoping review of recommendations (2018) · cites this paper as [34]
The use of a random-effects model for meta-analysis of observational studies by default was frequently recommended.
“Second, the use of a random-effects model for meta-analysis of observational studies by default was frequently recommended [8, 16, 29, 34, 70, 77, 100, 101].”
From Methods to systematically review and meta-analyse observational studies: a systematic scoping review of recommendations (2018) · cites this paper as [34]
Many considered heterogeneity important for the decision whether to pool the data.
“Many considered heterogeneity important for the decision whether to pool the data [34, 36, 47, 55, 56, 66, 101, 103].”
From Methods to systematically review and meta-analyse observational studies: a systematic scoping review of recommendations (2018) · cites this paper as [34]
Cites
Still being checked.
Cited by
Sorted by citations
Publication bias in meta-analysis its causes and consequences
Thornton, A. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00161-4 · Cited by 1,291 · see citing works
Mortality Risk Reduction Associated With Smoking Cessation in Patients With Coronary Heart Disease
Critchley, J., & Capewell, S. (2003) · JAMA · doi:10.1001/jama.290.1.86 · Cited by 1,086 · see citing works
Meta-analysis of the relationship between Helicobacter pylori seropositivity and gastric cancer
Huang, J., Sridhar, S., Chen, Y., & Hunt, R. H. (1998) · Gastroenterology · doi:10.1016/s0016-5085(98)70422-6 · Cited by 944 · see citing works
Huang, J.-Q., Sridhar, S., & Hunt, R. H. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07273-2 · Cited by 897 · see citing works
Mueller, M., D’Addario, M., Egger, M., Cevallos, M., Dekkers, O., Mugglin, C., & Scott, P. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0495-9 · Cited by 400 · see citing works
Insulin and Risk of Cardiovascular Disease
Ruige, J. B., Assendelft, W. J., Dekker, J. M., Kostense, P. J., Heine, R. J., & Bouter, L. M. (1998) · Circulation · doi:10.1161/01.cir.97.10.996 · Cited by 393 · see citing works
Severe mental illness and criminal victimization: a systematic review
Maniglio, R. (2008) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2008.01300.x · Cited by 360 · see citing works
Smoking cessation for the secondary prevention of coronary heart disease
Critchley, J., & Capewell, S. (2003) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003041.pub2 · Cited by 342 · see citing works
RetractedHealth effects associated with smokeless tobacco: a systematic review
Critchley, J. (2003) · Thorax · doi:10.1136/thorax.58.5.435 · Cited by 340 · see citing works
Mortality in Parkinson's disease: A systematic review and meta‐analysis
Macleod, A. D., Taylor, K. S. M., & Counsell, C. E. (2014) · Movement Disorders · doi:10.1002/mds.25898 · Cited by 328 · see citing works
Review of the epidemiologic literature on EMF and Health.
Ahlbom, I. C., Cardis, E., Green, A., Linet, M. S., Savitz, D. A., Swerdlow, A. J., & ICNIRP (International Commission for Non-Ionizing Radiation Protection) Standing Committee on Epidemiology (2001) · Environmental Health Perspectives · doi:10.1289/ehp.109-1240626 · Cited by 262 · see citing works
Self-citationBenjamin, D. K., Poole, C., Steinbach, W. J., Rowen, J. L., & Walsh, T. J. (2003) · PEDIATRICS · doi:10.1542/peds.112.3.634 · Cited by 232 · see citing works
Troponin-Based Risk Stratification of Patients With Acute Nonmassive Pulmonary Embolism
Jiménez, D., Uresandi, F., Otero, R., Lobo, J. L., Monréal, M., Sánchez, D. M., Zamora, J., Muriel, A., Aujesky, D., & Yusen, R. D. (2009) · CHEST Journal · doi:10.1378/chest.09-0608 · Cited by 194 · see citing works
Schelonka, R. L., Katz, B., Waites, K. B., & Benjamin, D. K. (2005) · The Pediatric Infectious Disease Journal · doi:10.1097/01.inf.0000190632.31565.83 · Cited by 172 · see citing works
Nieminen, P. A., Lehtiniemi, H., Vähäkangas, K., Huusko, A., & Rautio, A. (2022) · Epidemiology Biostatistics and Public Health · doi:10.2427/8854 · Cited by 169 · see citing works
Fatima, S. H., Rothmore, P., Giles, L. C., Varghese, B. M., & Bi, P. (2021) · Environment International · doi:10.1016/j.envint.2021.106384 · Cited by 174 · see citing works
Evidence-based toxicology: a comprehensive framework for causation
Guzelian, P. S., Victoroff, M. S., Halmes, N. C., James, R. C., & Guzelian, C. P. (2005) · Human & Experimental Toxicology · doi:10.1191/0960327105ht517oa · Cited by 151 · see citing works
Petti, S., Masood, M., & Scully, C. (2013) · PLoS ONE · doi:10.1371/journal.pone.0078999 · Cited by 144 · see citing works
Scott, C. S., & Jinot, J. (2011) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph8114238 · Cited by 110 · see citing works
Interpreting Epidemiologic Research: Lessons From Studies of Childhood Cancer
Linet, M. S., Wacholder, S., & Zahm, S. H. (2003) · PEDIATRICS · doi:10.1542/peds.112.s1.218 · Cited by 99 · see citing works
Gatto, N. M., Kelsh, M. A., Ha, D., Suh, M., & Proctor, D. M. (2010) · Cancer Epidemiology · doi:10.1016/j.canep.2010.03.013 · Cited by 98 · see citing works
Gaudreau, J., Gagnon, P. R., Roy, M., Harel, F., & Tremblay, A. (2005) · Psychosomatics · doi:10.1176/appi.psy.46.4.302 · Cited by 85 · see citing works
Enhancing the evidence base for health impact assessment: Figure 1
Mindell, J. S., Boaz, A., Joffe, M., Curtis, S., & Birley, M. (2004) · Journal of Epidemiology & Community Health · doi:10.1136/jech.2003.012401 · Cited by 81 · see citing works
Dose–response meta-analysis of silica and lung cancer
Lacasse, Y., Martin, S., Gagné, D., & Lakhal, L. (2009) · Cancer Causes & Control · doi:10.1007/s10552-009-9296-0 · Cited by 82 · see citing works
Methods for assessing the extent of exposure and effects of air pollution.
Krzyżanowski, M. (1997) · Occupational and Environmental Medicine · doi:10.1136/oem.54.3.145 · Cited by 78 · see citing works
Systematic reviews of trials and other studies.
Sutton, A. J., Abrams, K. R., Jones, D. R. H., Sheldon, T., & Song, F. (1998) · PubMed · Cited by 79 · see citing works
The impact of child sexual abuse on the course of bipolar disorder: a systematic review
Maniglio, R. (2013) · Bipolar Disorders · doi:10.1111/bdi.12050 · Cited by 74 · see citing works
Prevalence of child sexual abuse among adults and youths with bipolar disorder: A systematic review
Maniglio, R. (2013) · Clinical Psychology Review · doi:10.1016/j.cpr.2013.03.002 · Cited by 67 · see citing works
Meta-analyses of non-Hodgkin's lymphoma and farming
Khuder, S., Schaub, E. A., & Keller‐Byrne, J. E. (1998) · Scandinavian Journal of Work Environment & Health · doi:10.5271/sjweh.318 · Cited by 67 · see citing works
Gadsby, J. G., & Flowerdew, M. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000210.pub2 · Cited by 61 · see citing works
Meta‐analysis: Key features, potentials and misunderstandings
Dekkers, O. M. (2018) · Research and Practice in Thrombosis and Haemostasis · doi:10.1002/rth2.12153 · Cited by 56 · see citing works
Smoking cessation for the secondary prevention of coronary heart disease
Critchley, J., & Capewell, S. (2000) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003041 · Cited by 55 · see citing works
RetractedMobile phone use and risk of intracranial tumors: A consistency analysis
Lagorio, S., & Röösli, M. (2013) · Bioelectromagnetics · doi:10.1002/bem.21829 · Cited by 53 · see citing works
Peters, J., & Mengersen, K. L. (2008) · Evaluation & the Health Professions · doi:10.1177/0163278708324438 · Cited by 52 · see citing works
Systematic Reviews and Meta-Analysis: A Structured Review of the Methodological Literature
Sutton, A. J., Jones, D. R. H., Abrams, K. R., Sheldon, T., & Song, F. (1999) · Journal of Health Services Research & Policy · doi:10.1177/135581969900400112 · Cited by 51 · see citing works
Mortality Risk Reduction Associated With Smoking Cessation in Patients With Coronary Heart Disease
Critchley, J., & Capewell, S. (2007) · Cited by 50 · see citing works
Teta, M. J., Sielken, R. L., & Valdez‐Flores, C. (1999) · Risk Analysis · doi:10.1023/a:1007086728854 · Cited by 46 · see citing works
Stieb, D. M., Smith-Doiron, M. H., Blagden, P. A., & Burnett, R. T. (2005) · Journal of Toxicology and Environmental Health · doi:10.1080/15287390590936120 · Cited by 46 · see citing works
Occupational Trichloroethylene Exposure and Kidney Cancer
Kelsh, M. A., Alexander, D. D., Mink, P. J., & Mandel, J. H. (2009) · Epidemiology · doi:10.1097/ede.0b013e3181c30e92 · Cited by 45 · see citing works
Occupational trichloroethylene exposure and non-Hodgkin’s lymphoma: a meta-analysis and review
Mandel, J. H., Kelsh, M. A., Mink, P. J., Alexander, D. D., Kalmes, R. M., Weingart, M., Yost, L., & Goodman, M. G. (2006) · Occupational and Environmental Medicine · doi:10.1136/oem.2005.022418 · Cited by 45 · see citing works
Residential magnetic fields and childhood leukemia: a meta-analysis.
Wartenberg, D. E. (1998) · American Journal of Public Health · doi:10.2105/ajph.88.12.1787 · Cited by 42 · see citing works
Self-citationMeta-analysis of Multiple Myeloma and Benzene Exposure.
Sonoda, T., Nagata, Y., Mori, M., Ishida, T., & Imai, K. (2001) · Journal of Epidemiology · doi:10.2188/jea.11.249 · Cited by 36 · see citing works
Difficulties in assessing the relationship between passive smoking and lung cancer
Lee, P. N. (1998) · Statistical Methods in Medical Research · doi:10.1177/096228029800700204 · Cited by 36 · see citing works
Morris, R. D., Morgan, L. L., & Davis, D. L. (2015) · IEEE Access · doi:10.1109/access.2015.2478701 · Cited by 35 · see citing works
Self-citationA meta-analysis of occupational trichloroethylene exposure and liver cancer
Alexander, D. D., Kelsh, M. A., Mink, P. J., Mandel, J. H., Basu, R., & Weingart, M. (2007) · International Archives of Occupational and Environmental Health · doi:10.1007/s00420-007-0201-4 · Cited by 35 · see citing works
Smoking cessation for the secondary prevention of coronary heart disease
Critchley, J., & Capewell, S. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003041.pub3 · Cited by 35 · see citing works
RetractedGoldbohm, R. A., Tielemans, E., Heederik, D. J. J., Rubingh, C. M., Dekkers, S., Willems, M. I., & Kroese, E. D. (2006) · Regulatory Toxicology and Pharmacology · doi:10.1016/j.yrtph.2006.01.007 · Cited by 32 · see citing works
Association between the XRCC1 Polymorphisms and Glioma Risk: A Meta-Analysis of Case-Control Studies
Jiang, L., Fang, X., Bao, Y., Zhou, J., Shen, X., Ding, M., Chen, Y., Hu, G., & Lu, Y. (2013) · PLoS ONE · doi:10.1371/journal.pone.0055597 · Cited by 31 · see citing works
Sheehan, M., Lam, J., Navas-Acien, A., & Chang, H. H. (2016) · Environment International · doi:10.1016/j.envint.2016.02.016 · Cited by 27 · see citing works
Bereza, B. G., Machado, M., Ravindran, A. V., & Einarson, T. R. (2012) · The Canadian Journal of Psychiatry · doi:10.1177/070674371205700805 · Cited by 29 · see citing works
Meta-analysis in occupational epidemiology: a review of practice
McElvenny, D. M. (2004) · Occupational Medicine · doi:10.1093/occmed/kqh049 · Cited by 28 · see citing works
Flowerdew, M., & Gadsby, J. G. (1997) · Complementary Therapies in Medicine · doi:10.1016/s0965-2299(97)80029-5 · Cited by 28 · see citing works
Starr, T. B. (2001) · Toxicological Sciences · doi:10.1093/toxsci/64.1.7 · Cited by 28 · see citing works
Principles for evaluating health risks to reproduction associated with exposure to chemicals
Foster, P. M. D. (2001) · Cited by 27 · see citing works
Health aspects of extra-aural noise research.
Babisch, W. (2004) · PubMed · Cited by 26 · see citing works
Meta-analysis of Hodgkin's disease among farmers
Khuder, S., Mutgi, A. B., Schaub, E. A., & Tano, B. (1999) · Scandinavian Journal of Work Environment & Health · doi:10.5271/sjweh.457 · Cited by 26 · see citing works
Sheehan, M. C., & Lam, J. (2015) · Current Environmental Health Reports · doi:10.1007/s40572-015-0062-z · Cited by 24 · see citing works
Petti, S., Mohd, M., & Scully, C. M. (2011) · Cancer Epidemiology · doi:10.1016/j.canep.2011.09.009 · Cited by 24 · see citing works
Nieminen, P. A., Lehtiniemi, H., Huusko, A., Vähäkangas, K., & Rautio, A. (2012) · Chemosphere · doi:10.1016/j.chemosphere.2012.11.019 · Cited by 24 · see citing works
McCann, J., Kheifets, L., & Rafferty, C. (1998) · Environmental Health Perspectives · doi:10.1289/ehp.106-1533493 · Cited by 23 · see citing works
Rethinking Meta‐Analysis: Applications for Air Pollution Data and Beyond
Goodman, J. E., Boyce, C. P., Sax, S. N., Beyer, L. A., & Prueitt, R. L. (2015) · Risk Analysis · doi:10.1111/risa.12405 · Cited by 20 · see citing works
Revisiting the Association between Environmental Tobacco Smoke Exposure and Lung Cancer Risk
Lee, P. N., Fry, J., & Forey, B. (2000) · Indoor and Built Environment · doi:10.1159/000064243 · Cited by 32 · see citing works
Fayerweather, W. E. (2007) · Journal of Occupational and Environmental Hygiene · doi:10.1080/15459620701335035 · Cited by 19 · see citing works
Evidence-based toxicology: Strait is the gate, but the road is worth taking
Silbergeld, E. K. (2013) · ALTEX · doi:10.14573/altex.2013.1.067 · Cited by 19 · see citing works
Trichloroethylene Health Risk Assessment: A New and Improved Process
Maull, E. A., Cogliano, V. J., Scott, C. S., Barton, H. A., Fisher, J. W., Greenberg, M. S., Rhomberg, L. R., & Sorgen, S. P. (1997) · Drug and Chemical Toxicology · doi:10.3109/01480549709003900 · Cited by 19 · see citing works
Blettner, M., & Schlattmann, P. (2005) · Springer eBooks · doi:10.1007/978-3-540-26577-1_21 · Cited by 17 · see citing works
Prenatal exposure to ambient air pollutants and congenital heart defects: An umbrella review
Michel, S., Atmakuri, A., & Ehrenstein, O. S. V. (2023) · Environment International · doi:10.1016/j.envint.2023.108076 · Cited by 16 · see citing works
Factors Associated with Hurricane Evacuation: A Statistical Meta-Analysis of Studies, 1999-2018
Karaye, I. M., Taylor, N., Perez-Patron, M. J., Thompson, C. M., & Horney, J. A. (2021) · Disaster Medicine and Public Health Preparedness · doi:10.1017/dmp.2021.24 · Cited by 15 · see citing works
Interspecies extrapolation in environmental exposure standard setting: A Bayesian synthesis approach
Jones, D. R. H., Peters, J., Rushton, L., Sutton, A. J., & Abrams, K. R. (2009) · Regulatory Toxicology and Pharmacology · doi:10.1016/j.yrtph.2009.01.011 · Cited by 14 · see citing works
Gadsby, J. G., & Flowerdew, M. (1997) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000210 · Cited by 14 · see citing works
RetractedEMF Risk Perception and Communication
Repacholi, M. H., & Muc, A. M. (1999) · Cited by 13 · see citing works
Brown, T. T., & Qaqish, R. B. (2007) · AIDS · doi:10.1097/qad.0b013e3282703837 · Cited by 13 · see citing works
Wu, S., Wang, J., Guo, Q., Lan, H., Zhang, J., Wang, L., Janne, E., Luo, X., Wang, Q., Song, Y., et al. (2021) · Intelligent Medicine · doi:10.1016/j.imed.2021.12.001 · Cited by 12 · see citing works
Wilson, J. W., Jones, I. W., Maiden, D. L., & Goldhagen, P. (2003) · NASA Technical Reports Server (NASA) · Cited by 12 · see citing works
A Metal-Analysis and Risk Assessment of Heavy Metal Uptake in Common Garden Vegetables
LeCoultre, T. D., & Scheuerman, P. R. (2001) · Digital Commons - East Tennessee State University (East Tennessee State University) · Cited by 11 · see citing works
Lee, P. N., & Roe, F. J. C. (1999) · Human and Ecological Risk Assessment An International Journal · doi:10.1080/10807039991289671 · Cited by 11 · see citing works
Angelis, G. D., Caldora, M., Santaquilani, M., Scipione, R., & Verdecchia, A. (2001) · Radiation Research · doi:10.1667/0033-7587(2001)156[0689:hrfref]2.0.co;2 · Cited by 11 · see citing works
Meta-analysis of stray voltage on dairy cattle
Erdreich, L. S., Alexander, D. D., Wagner, M. E., & Reinemann, D. J. (2009) · Journal of Dairy Science · doi:10.3168/jds.2008-1979 · Cited by 8 · see citing works
Angelis, G. D., Caldora, M., Santaquilani, M., Scipione, R., & Verdecchia, A. (2002) · Advances in Space Research · doi:10.1016/s0273-1177(02)00261-2 · Cited by 6 · see citing works
Mu, W., Huang, Y., Chaumont, A., Létourneau, I., El‐Chaâr, D., Xia, T., & Wen, S. W. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-038309 · Cited by 5 · see citing works
Epidemiology and Cancer Risk Assessment
Gibb, H. J. (2004) · doi:10.1201/9780367803056-4 · Cited by 5 · see citing works
Self-citationEpidemiologische und statistische Methoden der Risikoabschätzung
Behrens, T., Pigeot, I., & Ahrens, W. (2009) · Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz · doi:10.1007/s00103-009-0971-9 · Cited by 4 · see citing works
Peters, J., Sutton, A. J., Jones, D. R. H., Abrams, K. R., & Rushton, L. (2008) · Human and Ecological Risk Assessment An International Journal · doi:10.1080/10807030802494592 · Cited by 4 · see citing works
Epidemiologie in der Arbeitswelt
Ahrens, W., Behrens, T., Mester, B., & Schmeißer, N. (2008) · Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz · doi:10.1007/s00103-008-0455-3 · Cited by 4 · see citing works
Climate Change and Health - A Systemic Review of Low and High Temperature Effects on Mortality
Lim, Y., & Kim, H. (2011) · Korean Journal of Environmental Health Sciences · doi:10.5668/jehs.2011.37.6.397 · Cited by 3 · see citing works
Blettner, M., Krahn, U., & Schlattmann, P. (2013) · Springer eBooks · doi:10.1007/978-0-387-09834-0_21 · Cited by 3 · see citing works
(2009) · Journal of Policy Analysis and Management · doi:10.1002/pam.20451 · Cited by 3 · see citing works
Meyer-Baron, M., Schäper, M., & van Thriel, C. (2014) · NeuroToxicology · doi:10.1016/j.neuro.2014.03.002 · Cited by 2 · see citing works
Burstyn, I., & Kromhout, H. (2008) · Journal of Occupational and Environmental Hygiene · doi:10.1080/15459620802111525 · Cited by 2 · see citing works
Somogyi, A., Gori, G. B., & Appel, K. E. (1999) · Elsevier eBooks · doi:10.1016/b978-012473270-4/50109-7 · Cited by 2 · see citing works
Epidemiological methods for attributing illness
Hodgson, S., & Khaw, F.-M. (2010) · CRC Press eBooks · doi:10.1201/b13390-5 · Cited by 1 · see citing works
How to MERGE Environmental Information using Meta-Analysis
Zawadzki, J. J. (2012) · Cited by 1 · see citing works
Epidemiologische Studien als Teil des HTA-Bewertungsprozesses
Behrens, T., & Ahrens, W. (2006) · Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz · doi:10.1007/s00103-005-1222-3 · Cited by 1 · see citing works
Radiation-Related Risk Analysis for Atmospheric Flight Civil Aviation Flight Personnel
DeAngelis, G., & Wilson, J. W. (2003) · NASA Technical Reports Server (NASA) · Cited by 1 · see citing works
Occupational Electric and Magnetic Field Exposure and Brain Cancer
Raabe, G. K., & Wong, O. (1996) · Journal of Occupational and Environmental Medicine · doi:10.1097/00043764-199607000-00001 · Cited by 1 · see citing works
Self-citationRevisiting the Association between Environmental Tobacco Smoke Exposure and Lung Cancer Risk
Lee, P. N., Forey, B. A., & Fry, J. S. (2002) · Indoor and Built Environment · doi:10.1177/1420326x0201100102 · Cited by 1 · see citing works
Epidemiology And Cancer Risk Assessment
Gibb, H. J. (1996) · CRC Press eBooks · doi:10.1201/9781439821978.ch1.2 · Cited by 1 · see citing works
Self-citationHaque, M. F. (2010) · Queen Mary Research Online (Queen Mary University of London) · Cited by 1 · see citing works
Meta‐Analysis in Nonclinical Risk Assessment
Jones, D. R. H., Sutton, A. J., & Peters, J. (2008) · Encyclopedia of Quantitative Risk Analysis and Assessment · doi:10.1002/9780470061596.risk0718
- Authors
- Blair, A., Burg, J., Foran, J., Gibb, H., Greenland, S., Morris, R., Raabe, G., Savitz, D., Teta, J., Wartenberg, D., Wong, O., & Zimmerman, R.
- Affiliations
- National Institutes of Health (US)
- University of North Carolina at Chapel Hill (US)
- Venue
- Regulatory Toxicology and Pharmacology
- Publisher
- Elsevier BV
- Published
- 1995-10
- Volume
- 22
- Issue
- 2
- Pages
- 189-197
- ISSN
- 0273-2300 (ISSN-L)
- OpenAlex
- W2004112009
- Cited by
- 109
- References
- 0
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 1 · 2023: 1 · 2022: 1 · 2021: 3 · 2020: 1 · 2018: 3 · 2016: 1 · 2015: 3 · 2014: 5 · 2013: 7 · 2012: 5
- FWCI
- 7.81
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Regulatory Toxicology and Pharmacology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Physical Sciences › Environmental Science › Health, Toxicology and Mutagenesis › Health, Environment, Cognitive Aging
- Keywords
- meta-analysis, environmental epidemiology, environmental health risk, heterogeneity, exposure-disease relationship, study selection, data extraction, confounding, bias, reporting guidelines, interpretation of results
- MeSH terms
- Environmental Exposure, Epidemiologic Methods, Meta-Analysis as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review