Systematic Review and Evidence Integration for Literature-Based Environmental Health Science Assessments
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index; 4 of the 28 sources its claims cite were checked for support.
Abstract
Background: Systematic-review methodologies provide objectivity and transparency to the process of collecting and synthesizing scientific evidence in reaching conclusions on specific research questions. There is increasing interest in applying these procedures to address environmental health questions. Objectives: The goal was to develop a systematic-review framework to address environmental health questions by extending approaches developed for clinical medicine to handle the breadth of data relevant to environmental health sciences (e.g., human, animal, and mechanistic studies). Methods: The Office of Health Assessment and Translation (OHAT) adapted guidance from authorities on systematic-review and sought advice during development of the OHAT Approach through consultation with technical experts in systematic review and human health assessments, as well as scientific advisory groups and the public. The method was refined by considering expert and public comments and through application to case studies. Results and Discussion: Here we present a seven-step framework for systematic review and evidence integration for reaching hazard identification conclusions: 1) problem formulation and protocol development, 2) search for and select studies for inclusion, 3) extract data from studies, 4) assess the quality or risk of bias of individual studies, 5) rate the confidence in the body of evidence, 6) translate the confidence ratings into levels of evidence, and 7) integrate the information from different evidence streams (human, animal, and “other relevant data” including mechanistic or in vitro studies) to develop hazard identification conclusions. Conclusion: The principles of systematic review can be successfully applied to environmental health questions to provide greater objectivity and transparency to the process of developing conclusions. Citation: Rooney AA, Boyles AL, Wolfe MS, Bucher JR, Thayer KA. 2014. Systematic review and evidence integration for literature-based environmental health science assessments. Environ Health Perspect 122:711–718; http://dx.doi.org/10.1289/ehp.1307972
Overview
CoChat Summary
TL;DR
This paper presents the OHAT seven-step framework for systematic review and evidence integration in environmental health assessments, extending clinical systematic-review methods to human, animal, and other relevant data. The approach is designed to improve objectivity, transparency, and consistency in hazard identification conclusions.
Key findings
- The OHAT framework is a flexible seven-step process: 1) problem formulation and protocol development, 2) search for and select studies, 3) extract data, 4) assess study quality/risk of bias, 5) rate confidence in the body of evidence, 6) translate confidence ratings into levels of evidence, and 7) integrate evidence streams to develop hazard identification conclusions.
- In applying the OHAT Approach to case studies, steps 2–4 were the most time intensive: selecting studies, extracting data, and assessing the quality of individual studies.
- The framework defines five hazard identification conclusion categories: known, presumed, suspected, not classifiable, and not identified as a hazard to humans.
- The paper states that high confidence means further research is very unlikely to change the apparent relationship, while very low confidence means further research is very likely to change it; for a conclusion of evidence of no health effect, the paper says this is reached only when there is high confidence.
Methods
- The authors developed the OHAT Approach by adapting guidance from authoritative systematic-review groups and consulting technical experts, scientific advisory groups, and the public; the method was refined through comments and application to case studies.
- The framework was built to cover human, animal, and other relevant data (including mechanistic or in vitro studies) in literature-based environmental health evaluations.
- The paper describes the method as a seven-step systematic-review and evidence-integration protocol, including prespecified procedures for study selection, data extraction, risk-of-bias assessment, confidence rating, and evidence integration.
Limitations
- The paper states that systematic-review methods may add time and investment to literature-based evaluations, and notes that steps 2–4 were the most time intensive.
- It also says that the scientific judgments used in confidence ratings are inherently subjective; this is the paper’s own stated limitation.
- Evident from the text: the framework is not a report of results from an empirical study with a sample, so there are no quantitative effect estimates or outcome findings to assess here.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
3 Valid · 0 Not valid · 16 Not checked · 52 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“It includes all of the recommended elements for conducting and reporting a systematic review [outlined in the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) statement (Moher et al. 2009)].”
§ Systematic Review and Evidence Integration for Literature-Based Environmental Health Science Assessments > Results
What the sources say
- Partly supportedcites Moher et al. 2009 matched to “Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement” (2009) sourceExperimental — accuracy not yet measured
Section 4 (The PRISMA Statement) confirms that PRISMA outlines recommended elements — a 27-item checklist plus a four-phase flow diagram — but frames them strictly as reporting guidance: 'The aim of the PRISMA Statement is to help authors improve the reporting of systematic reviews and meta-analyses,' and explicitly adds that 'the PRISMA checklist is not a quality assessment instrument to gauge the quality of a systematic review.' The dedicated section 'Conduct and Reporting Research Are Distinct Concepts' maintains that distinction (noting only that the two are closely intertwined for systematic reviews), so the claim's 'elements for conducting and reporting' overstates the source on the 'conducting' half; Table 1 likewise lists 'Checklist of items to include when reporting a systematic review or meta-analysis.' Whether OHAT covers all of those elements is the citing authors' own comparison, not something this source addresses. (LLM, conf=0.75)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
In the paper
“In applying the OHAT Approach to case studies (NTP 2013a, 2013f), the NTP found that steps 2–4 were the most time intensive: selecting studies, extracting data, and assessing the quality of individual studies.”
§ Systematic Review and Evidence Integration for Literature-Based Environmental Health Science Assessments > Discussion
What the sources say
- Not checked yetcites NTP 2013a, 2013f
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Therefore, these studies will usually have all four features and receive an initial rating of “high confidence.””
§ Systematic Review and Evidence Integration for Literature-Based Environmental Health Science Assessments > Results > Step 5: Rate the Confidence in the Body of Evidence
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“Therefore, it is worth noting that a single well-conducted study may provide evidence of toxicity or a health effect associated with exposure to the substance in question [e.g., see Germolec (2009) and Foster (2009) for explanations of the NTP levels of evidence for determination of “toxicity” for individual studies].”
§ Systematic Review and Evidence Integration for Literature-Based Environmental Health Science Assessments > Results > Step 5: Rate the Confidence in the Body of Evidence
What the sources say
- Not checked yetcites Germolec (2009)
- Not checked yetcites Foster (2009)
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The principles of systematic review can be successfully applied to environmental health questions to provide greater objectivity and transparency to the process of developing conclusions.”
§ Systematic Review and Evidence Integration for Literature-Based Environmental Health Science Assessments > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
7 more claims
Create a free account to see all 71 claims and to verify the 23 references still open.
- Probably not a substantial claim. 54
- It may state two separate claims as one. 16
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The study design is sometimes made explicit in the key elements (e.g. 'PICO'-type questions may be stated as 'PICOD' or 'PICOS' in the scientific literature, where 'D' (design) or 'S' (study) indicates that study design is being considered) [11].”
From Eligibility screening in evidence synthesis of environmental management topics (2017) · cites this paper as [11]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“such methods have only recently been developed and utilized in environmental health sciences [23–30].”
From A Systematic Review and Meta-Analysis of Multiple Airborne Pollutants and Autism Spectrum Disorder (2016) · cites this paper as [29]
The cited source says what the claim attributes to it.
In the citing paper
“To ensure reliability of the eligibility screening process, articles providing guidance on conducting systematic reviews in environmental research [2, 11, 12] and health research [14, 15, 18] recommend that eligibility screening should be performed where possible by at least two people.”
From Eligibility screening in evidence synthesis of environmental management topics (2017) · cites this paper as [11]
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Dermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.005 · Cited by 19,575
GRADE guidelines: 1. Introduction—GRADE evidence profiles and summary of findings tables
Guyatt, G., Oxman, A. D., Akl, E. A., Kunz, R., Vist, G., Brozek, J., Norris, S., Falck-Ytter, Y., Glasziou, P., & deBeer, H. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.04.026 · Cited by 10,681
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578
GRADE guidelines: 3. Rating the quality of evidence
Balshem, H., Helfand, M., Schünemann, H. J., Oxman, A. D., Kunz, R., Brozek, J., Vist, G. E., Falck-Ytter, Y., Meerpohl, J., & Norris, S. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.07.015 · Cited by 8,285
The environment and disease: association or causation?
Hill, A. B. (2015) · Journal of the Royal Society of Medicine · doi:10.1177/0141076814562718 · Cited by 7,285
Research works printed but not linked: 2
- CLARITY Group at McMaster University. 2013. Systematic and Literature Review Resources. Instruments.Available: http://www.evidencepartners.com/resources/ [accessed 15 January 2013].
- NRC (National Research Council). 2013b. Project Title: Review of the IRIS Process.Available: http://www8.nationalacademies.org/cp/projectview.aspx?key=49458 [accessed 1 November 2013].
Cited by
Items 201–300 of 463
Beronius, A., Hanberg, A., Zilliacus, J., & Rudén, C. (2014) · Current Opinion in Pharmacology · doi:10.1016/j.coph.2014.08.005 · Cited by 28
Latzman, N. E., Casanueva, C. E., Brinton, J., & Forman‐Hoffman, V. L. (2019) · Campbell Systematic Reviews · doi:10.1002/cl2.1049 · Cited by 28
More, S. J., Bambidis, V., Benford, D., Bragard, C., Hernández, A. F., Bennekou, S. H., Koutsoumanis, K., Machera, K. A., Naegeli, H., Nielsen, S. S., et al. (2020) · EFSA Journal · doi:10.2903/j.efsa.2020.6221 · Cited by 27
The health impacts of ambient air pollution in Australia: a systematic literature review
Walter, C. M., Schneider‐Futschik, E. K., Lansbury, N., Sly, P. D., Head, B. W., & Knibbs, L. D. (2021) · Internal Medicine Journal · doi:10.1111/imj.15415 · Cited by 27
Röösli, M., Dongus, S., Jalilian, H., Feychting, M., Eyers, J. E., Esu, E., Oringanje, C. M., Meremikwu, M. M., & Bosch‐Capblanch, X. (2021) · Environment International · doi:10.1016/j.envint.2021.106852 · Cited by 27
Methyl methacrylate and respiratory sensitisation: a comprehensive review
Pemberton, M., & Kimber, I. (2022) · Critical Reviews in Toxicology · doi:10.1080/10408444.2022.2064267 · Cited by 27
Zwanenburg, P. R., Timmermans, F. W., Timmer, A. S., Middelkoop, E., Tol, B. T., Lapid, O., Obdeijn, M. C., Gans, S. L., & Boermeester, M. A. (2020) · Wound Repair and Regeneration · doi:10.1111/wrr.12858 · Cited by 27
Risk and Protective Factors in the COVID-19 Pandemic: A Rapid Evidence Map
Elmore, R., Schmidt, L., Lam, J., Howard, B. E., Tandon, A., Norman, C. R., Phillips, J., Shah, M., Patel, S. A., Albert, T., et al. (2020) · Frontiers in Public Health · doi:10.3389/fpubh.2020.582205 · Cited by 27
Dekant, W., & Bridges, J. W. (2016) · Regulatory Toxicology and Pharmacology · doi:10.1016/j.yrtph.2016.09.009 · Cited by 27
Waspe, J., Bui, T. T., Dishaw, L. V., Kraft, A. D., Luke, A., & Beronius, A. (2020) · Environment International · doi:10.1016/j.envint.2020.106103 · Cited by 26
Antioxidant and Anti-Inflammatory Effects of Genus Gynura: A Systematic Review
Tan, J. N., Saffian, S. M., Buang, F., Jubri, Z., Jantan, I., Husain, K., & Fauzi, N. M. (2020) · Frontiers in Pharmacology · doi:10.3389/fphar.2020.504624 · Cited by 27
Liu, J., Chen, Y., Liu, D., Ye, F., Sun, Q., Huang, Q., Dong, J., Pei, T., He, Y., & Zhang, Q. (2023) · Environmental Science and Pollution Research · doi:10.1007/s11356-023-26831-7 · Cited by 26
Xiao, F., An, Z., Lv, J., Sun, X., Sun, H., Liu, Y., Liu, X., & Guo, H. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1173101 · Cited by 26
Examining the relationship between urban liveability and gender-based violence: A systematic review.
Alderton, A., Henry, N., Foster, S. A., & Badland, H. M. (2020) · Health & Place · doi:10.1016/j.healthplace.2020.102365 · Cited by 26
Can Exercise Counteract Cancer Cachexia? A Systematic Literature Review and Meta-Analysis
Niels, T., Tomanek, A., Freitag, N., & Schumann, M. (2020) · Integrative Cancer Therapies · doi:10.1177/1534735420940414 · Cited by 26
Ontology-based data integration for advancing toxicological knowledge
Boyles, R., Thessen, A., Waldrop, A., & Haendel, M. A. (2019) · Current Opinion in Toxicology · doi:10.1016/j.cotox.2019.05.005 · Cited by 26
Pophof, B., Burns, J., Danker‐Hopfe, H., Dorn, H., Egblomassé-Roidl, C., Eggert, T., Fuks, K. B., Henschenmacher, B., Kühne, J., Sauter, C., et al. (2021) · Environment International · doi:10.1016/j.envint.2021.106783 · Cited by 25
Short-term exposure to air pollution and infant mortality: A systematic review and meta-analysis
Luben, T. J., Wilkie, A. A., Krajewski, A. K., Njie, F., Park, K., Zelasky, S., & Rappazzo, K. M. (2023) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2023.165522 · Cited by 25
Roth, N., & Ciffroy, P. (2016) · Environment International · doi:10.1016/j.envint.2016.07.011 · Cited by 25
Wikoff, D. S., Rager, J. E., Chappell, G. A., Fitch, S., Haws, L. C., & Borghoff, S. J. (2018) · Toxicological Sciences · doi:10.1093/toxsci/kfy279 · Cited by 25
McPartland, J., Shaffer, R. M., Fox, M. A., Nachman, K. E., Burke, T. A., & Denison, R. A. (2022) · Environmental Health Perspectives · doi:10.1289/ehp9649 · Cited by 25
Evidence-based approaches in toxicology: their origins, challenges, and future directions
Härtung, T., & Tsaioun, K. (2024) · Evidence-Based Toxicology · doi:10.1080/2833373x.2024.2421187 · Cited by 24
Lake, E. A., Karras, J., Marks, G. B., & Cowie, C. T. (2025) · PLoS ONE · doi:10.1371/journal.pone.0320048 · Cited by 24
Boogaard, H., Atkinson, R. W., Brook, J. R., Chang, H. H., Hoek, G., Hoffmann, B. H., Sagiv, S. K., Samoli, E., Smargiassi, A., Szpiro, A. A., et al. (2023) · Environmental Health Perspectives · doi:10.1289/ehp11532 · Cited by 24
Benke, G., Abramson, M. J., Brzozek, C., McDonald, S. J., Kelsall, H. L., Sanagou, M., Zeleke, B. M., Kaufman, J., Brennan, S., Verbeek, J. H. A. M., et al. (2024) · Environment International · doi:10.1016/j.envint.2024.108779 · Cited by 24
Human cost burden of exposure to endocrine disrupting chemicals. A critical review
Bond, G. G., & Dietrich, D. R. (2017) · Archives of Toxicology · doi:10.1007/s00204-017-1985-y · Cited by 24
Cook, J., Lehne, C., Weiland, A., Archid, R., Ritze, Y., Bauer, K., Zipfel, S., Penders, J., Enck, P., & Mack, I. (2020) · Nutrients · doi:10.3390/nu12082396 · Cited by 24
Boonhat, H., & Lin, R. (2020) · Environment International · doi:10.1016/j.envint.2020.106090 · Cited by 24
Rafiee, A., Ospina, M. B., Pitt, T. M., & Quémerais, B. (2022) · Environmental Research · doi:10.1016/j.envres.2022.114152 · Cited by 24
Lai, K. Y., Bauermeister, S., & Sarkar, C. (2026) · npj Mental Health Research · doi:10.1038/s44184-026-00190-w · Cited by 23
Effects of exposure to environmental pollutants on mitochondrial DNA copy number: a meta-analysis
Avilés-Ramírez, C., Moreno‐Godínez, M. E., Bonner, M. R., Parra‐Rojas, I., Flores‐Alfaro, E., Ramírez, M., Huerta‐Beristain, G., & Ramírez‐Vargas, M. A. (2022) · Environmental Science and Pollution Research · doi:10.1007/s11356-022-19967-5 · Cited by 23
Cao, N., Zhou, H., Du, Y., Li, X., Chu, X., & Li, B. (2022) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2022.160244 · Cited by 23
Cawley, M. A., Beardslee, R., Beverly, B., Hotchkiss, A. K., Kirrane, E. F., Sams, R. L., Varghese, A., Wignall, J., & Cowden, J. (2019) · Environment International · doi:10.1016/j.envint.2019.105228 · Cited by 23
Escrivá, L., Zilliacus, J., Hessel, E. V. S., & Beronius, A. (2021) · Environmental Health · doi:10.1186/s12940-021-00731-0 · Cited by 22
Authority, E. F. S. (2018) · EFSA Supporting Publications · doi:10.2903/sp.efsa.2018.en-1396 · Cited by 22
New approach methods for testing chemicals for endocrine disruption potential
Judson, R., Friedman, K. P., Houck, K. A., Mansouri, K., Browne, P., & Kleinstreuer, N. (2018) · Current Opinion in Toxicology · doi:10.1016/j.cotox.2018.10.002 · Cited by 22
Ren, X., Zhang, T., Chen, X., Wei, X., Tian, Y., Li, G., Zhang, X., Zhang, W., You, Z., Wang, S., et al. (2020) · Aging · doi:10.18632/aging.103620 · Cited by 21
Sosso, F. A. E., Matos, E., & Papadopoulos, D. (2023) · Sleep Health · doi:10.1016/j.sleh.2023.08.021 · Cited by 21
(CONTAM), E. P. O. C. I. T. F. C., Knutsen, H. K., Åkesson, A., Bampidis, V., Bignami, M., Bodin, L., Degen, G. H., Hernández, A. F., Hofer, T. P., Högstrand, C., et al. (2025) · EFSA Journal · doi:10.2903/j.efsa.2025.9393 · Cited by 21
Matta, K., Ploteau, S., Coumoul, X., Koual, M., Bizec, B. L., Antignac, J., & Cano-Sancho, G. (2019) · Environment International · doi:10.1016/j.envint.2018.12.063 · Cited by 21
Reviews in environmental health: How systematic are they?
Sutton, P., Chartres, N., Rayasam, S. D. G., Daniels, N., Lam, J., Maghrbi, E., & Woodruff, T. J. (2021) · Environment International · doi:10.1016/j.envint.2021.106473 · Cited by 21
Kenny, R. P. W., Barron, E., Adesanya, A. M., Richmond, C., Beyer, F. R., Calderón, C., Rankin, J. M., Toledano, M. B., Feychting, M., Pearce, M. S., et al. (2021) · Environment International · doi:10.1016/j.envint.2021.106968 · Cited by 21
Using systematic review in occupational safety and health
Howard, J., Piacentino, J. D., MacMahon, K. L., & Schulte, P. A. (2017) · American Journal of Industrial Medicine · doi:10.1002/ajim.22771 · Cited by 21
Rafiee, A., Faridi, S., Sly, P. D., Stone, L., Kennedy, L. P., & Mahabee-Gittens, E. M. (2024) · Environmental Research · doi:10.1016/j.envres.2024.119827 · Cited by 20
(2015) · PubMed Central · Cited by 20
Xu, K., Li, Z., Qiao, J.-C., Wang, S., Xie, P., Zong, Z., & Hu, C. (2023) · Environmental Pollution · doi:10.1016/j.envpol.2023.122439 · Cited by 20
Whaley, P., Blaauboer, B. J., Brozek, J., Hubal, E. A. C., Hair, K., Kacew, S., Knudsen, T. B., Kwiatkowski, C. F., Mellor, D. T., Olshan, A. F., et al. (2021) · ALTEX · doi:10.14573/altex.2106111 · Cited by 20
Self-citationRevisiting miRNA-21 as a Therapeutic Strategy for Myocardial Infarction: A Systematic Review
Sothivelr, V., Hasan, M. Y., Saffian, S. M., Zainalabidin, S., Ugusman, A., & Mahadi, M. K. (2022) · Journal of Cardiovascular Pharmacology · doi:10.1097/fjc.0000000000001305 · Cited by 19
Prenatal exposure to ambient air pollutants and congenital heart defects: An umbrella review
Michel, S., Atmakuri, A., & Ehrenstein, O. S. V. (2023) · Environment International · doi:10.1016/j.envint.2023.108076 · Cited by 19
Holman, D. M., Buchanan, N. D., & on behalf of the Cancer Prevention During Early Life Expert Group (2016) · PEDIATRICS · doi:10.1542/peds.2015-4268c · Cited by 19
Shen, C., Zhang, K., Shi, J., Yang, J., Wang, Y., Li, Z., Dai, H., & Yang, W. (2024) · Toxicology Letters · doi:10.1016/j.toxlet.2024.02.002 · Cited by 18
A systematic review and meta-analysis of the impact of triclosan exposure on human semen quality
Adegbola, C. A., Akhigbe, T. M., Adeogun, A. E., Tvrdá, E., Pizent, A., & Akhigbe, R. E. (2024) · Frontiers in Toxicology · doi:10.3389/ftox.2024.1469340 · Cited by 18
Business process management systems in port processes: a systematic literature review
Martín‐Navarro, A., Sancho, M. P. L., & Medina-Garrido, J. A. (2020) · International Journal of Agile Systems and Management · doi:10.1504/ijasm.2020.109245 · Cited by 18
Razek, A. (2023) · Applied Sciences · doi:10.3390/app13031265 · Cited by 18
Li, X., Li, J., Zhou, J., Ayada, I., Pan, Q., van der Laan, L. J. W., & Li, P. (2025) · Environmental Research · doi:10.1016/j.envres.2025.122623 · Cited by 17
Evaluation of Khat (Catha edulis) Use as a Risk Factor of Cancer: A Systematic Review
Chong, Z. X., Ho, W. Y., Yan, P., & Alshagga, M. A. (2020) · Asian Pacific Journal of Cancer Prevention · doi:10.31557/apjcp.2020.21.4.881 · Cited by 17
The Problem of Biased Data and Potential Solutions for Health and Environmental Assessments
Suter, G. W., & Cormier, S. M. (2014) · Human and Ecological Risk Assessment An International Journal · doi:10.1080/10807039.2014.974499 · Cited by 17
Tabnjh, A. K., Alizadehgharib, S., Campus, G., & Lingström, P. (2025) · Frontiers in Oral Health · doi:10.3389/froh.2025.1569806 · Cited by 16
In vitroevaluation of plants as storage media for avulsed teeth: A systematic review
Resende, K. K. M., Faria, G. P., Longo, D. L., Martins, L. J. O., & Costa, C. R. R. (2019) · Dental Traumatology · doi:10.1111/edt.12501 · Cited by 16
Nyadanu, S. D., Tessema, G. A., Mullins, B. J., Kumi-Boateng, B., Bell, M. L., & Pereira, G. F. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17228658 · Cited by 16
Ceresnie, M. S., Patel, J., Lim, H. W., & Kohli, I. (2022) · Photochemical & Photobiological Sciences · doi:10.1007/s43630-022-00318-9 · Cited by 16
Systematic Reviews in Toxicology
Wikoff, D. S., & Miller, G. W. (2018) · Toxicological Sciences · doi:10.1093/toxsci/kfy109 · Cited by 16
More, S. J., Bampidis, V., Benford, D., Bragard, C., Hernández, A. F., Bennekou, S. H., Koutsoumanis, K. P., Lambré, C., Machera, K. A., Mennes, W. C., et al. (2024) · EFSA Journal · doi:10.2903/j.efsa.2024.8866 · Cited by 16
Zhong, G., Li, Z., Jones, K. C., & Zhu, Y. B. (2025) · The Lancet Planetary Health · doi:10.1016/s2542-5196(25)00114-7 · Cited by 15
Does ozone inhalation cause adverse metabolic effects in humans? A systematic review
LaKind, J. S., Burns, C. J., Pottenger, L. H., Naiman, D. Q., Goodman, J. E., & Marchitti, S. A. (2021) · Critical Reviews in Toxicology · doi:10.1080/10408444.2021.1965086 · Cited by 15
Mortality associated with fine particulate and its components: A systematic review and meta-analysis
Karimi, B., & Samadi, S. (2023) · Atmospheric Pollution Research · doi:10.1016/j.apr.2023.101648 · Cited by 15
Wikoff, D. S., Urban, J. D., Fitch, S., & Haws, L. C. (2018) · International Journal of Toxicology · doi:10.1177/1091581818754330 · Cited by 15
Pega, F., Momen, N. C., Gagliardi, D., Bero, L. A., Boccuni, F., Chartres, N., Descatha, A., Dzhambov, A. M., Godderis, L., Loney, T., et al. (2022) · Environment International · doi:10.1016/j.envint.2022.107136 · Cited by 15
Bline, A. P., Ellis, L. B., Pelch, K. E., Lam, J., Sen, Ś., Zlatnik, M. G., & Varshavsky, J. (2024) · Environment International · doi:10.1016/j.envint.2024.108711 · Cited by 14
Does pyrethroid exposure lower human semen quality? a systematic review and meta-analysis
Akhigbe, R. E., Oyedokun, P. A., Akhigbe, T. M., Hassan, S. A., Oladipo, A. A., & Hughes, J. R. (2024) · Frontiers in Toxicology · doi:10.3389/ftox.2024.1395010 · Cited by 14
Senerth, E., Whaley, P., Akl, E. A., Beverly, B., Alonso‐Coello, P., Rooney, A. A., Schünemann, H. J., Thayer, K. A., Tsaioun, K., & Morgan, R. L. (2025) · Environment International · doi:10.1016/j.envint.2025.109314 · Cited by 14
Self-citationHatem, G., Faria, A. M., Pinto, M. B., Teixeira, J. P., Salamova, A., Costa, C., & Madureira, J. (2025) · Environmental Pollution · doi:10.1016/j.envpol.2025.125830 · Cited by 14
Shang, X., Zhang, R., Zheng, J., Luo, Y., Guo, K., Zhou, Q., Xu, G., Zhang, N., Xue, H., Wang, H., et al. (2025) · Eurosurveillance · doi:10.2807/1560-7917.es.2025.30.11.2400375 · Cited by 14
FIGO committee opinion: Environmental drivers of gynecologic and reproductive health
DeNicola, N. G., Zhang, J., Hasenburg, A., Schwab, R. M., Gupta, K., Decena, D. C. D., Edna, F., Graham, D., Morris, E., & Dao, B. (2025) · International Journal of Gynecology & Obstetrics · doi:10.1002/ijgo.70547 · Cited by 14
Benke, G., Abramson, M. J., Zeleke, B. M., Kaufman, J., Karipidis, K., Kelsall, H. L., McDonald, S. J., Brzozek, C., Feychting, M., & Brennan, S. (2021) · Environment International · doi:10.1016/j.envint.2021.106972 · Cited by 14
Taylor, K. W., Howdeshell, K. L., Bommarito, P. A., Sibrizzi, C. A., Blain, R. B., Magnuson, K., Lemeris, C., Tracy, W., Baird, D. D., Jackson, C. L., et al. (2023) · Environment International · doi:10.1016/j.envint.2023.108307 · Cited by 14
Self-citationSystematic review in chemical risk assessment — A chemical industry perspective
Pease, C., & Gentry, R. (2015) · Environment International · doi:10.1016/j.envint.2015.12.007 · Cited by 14
Joca, L., Sacks, J. D., Moore, D., Lee, J. S., Sams, R. L., & Cowden, J. (2016) · Environment International · doi:10.1016/j.envint.2016.01.011 · Cited by 14
A cross-disciplinary evaluation of evidence for multipollutant effects on cardiovascular disease
Luben, T. J., Buckley, B. J., Patel, M. M., Stevens, T., Coffman, E., Rappazzo, K. M., Owens, E. O., Hines, E. P., Moore, D., Painter, K., et al. (2017) · Environmental Research · doi:10.1016/j.envres.2017.11.008 · Cited by 14
Wu, T., Zhang, Z., Lin, L., Liu, R.-Y., & Bei, B.-T. (2021) · World Journal of Surgical Oncology · doi:10.1186/s12957-021-02324-0 · Cited by 13
Published review of closed-system drug-transfer devices: Limitations and implications
McDiarmid, M. A., Polovich, M., Power, L. A., Connor, T. H., & Kienle, P. C. (2018) · American Journal of Health-System Pharmacy · doi:10.2146/ajhp180631 · Cited by 13
Evaluating endocrine disrupting chemicals: A perspective on the novel assessments in CLARITY‐BPA
Howdeshell, K. L., Beverly, B., Blain, R. B., Goldstone, A. E., Hartman, P. A., Lemeris, C., Newbold, R. R., Rooney, A. A., & Bucher, J. R. (2023) · Birth Defects Research · doi:10.1002/bdr2.2238 · Cited by 13
Self-citationTing, M., Afshar, P., Adhami, A., Braid, S. M., & Suzuki, J. B. (2018) · International Journal of Implant Dentistry · doi:10.1186/s40729-018-0137-3 · Cited by 13
Stephens, M. L., Akgün-Ölmez, S. G., Hoffmann, S., de Vries, R. B. M., Flick, B., Härtung, T., Lalu, M. M., Maertens, A., Witters, H. E., Wright, R. A., et al. (2019) · Toxicological Sciences · doi:10.1093/toxsci/kfz128 · Cited by 13
Paterson, A., Franco, V., Patel, S., & Foschi, F. (2020) · Imaging Science in Dentistry · doi:10.5624/isd.2020.50.3.183 · Cited by 13
Vandenberg, L. N., & Pelch, K. E. (2021) · Endocrine Metabolic & Immune Disorders - Drug Targets · doi:10.2174/1871530321666211005163614 · Cited by 13
Dietz, A., Gomolka, M., Moertl, S., & Subedi, P. (2020) · Journal of Personalized Medicine · doi:10.3390/jpm11010003 · Cited by 13
FIGO committee opinion: Environmental drivers of obstetric health and early childhood development
DeNicola, N. G., Lasher, E. G., BakenRa, A., Joglekar, R., Zhang, J., Hasenburg, A., Gupta, K., Decena, D. C. D., Edna, F., Graham, D., et al. (2025) · International Journal of Gynecology & Obstetrics · doi:10.1002/ijgo.70549 · Cited by 12
Mikkonen, A., Martin, N., Dourson, M. L., Hinwood, A. L., & Johnson, M. S. (2020) · Environmental Toxicology and Chemistry · doi:10.1002/etc.4931 · Cited by 12
AlMekkawi, M., Maqbali, M. A. H. A., ElKhalil, R., Ibrahim, R. K., Aldawsari, A. N., Qatouni, F., Sherif, M., Pandarakutty, S., Nalubega, S., Raj, A. R. A., et al. (2025) · BMJ Open · doi:10.1136/bmjopen-2025-101478 · Cited by 11
Colzin, S., Crépet, A., Wies, B., Rocabois, A., Margaux, S., Simon, P., Jean, J., Redaelli, M., Kortenkamp, A., Rousselle, C., et al. (2024) · International Journal of Hygiene and Environmental Health · doi:10.1016/j.ijheh.2023.114311 · Cited by 11
Michel, S., Atmakuri, A., & Ehrenstein, O. S. V. (2024) · Environmental Health · doi:10.1186/s12940-024-01069-z · Cited by 11
Carlson, L. M., Champagne, F. A., Cory‐Slechta, D. A., Dishaw, L. V., Faustman, E. M., Mundy, W. R., Segal, D., Sobin, C. A., Starkey, C., Taylor, M., et al. (2020) · Neurotoxicology and Teratology · doi:10.1016/j.ntt.2020.106865 · Cited by 11
Vachon, J., Pagé‐Larivière, F., Sirard, M., Rodríguez, M. J., Levallois, P., & Campagna, C. (2018) · Toxicological Sciences · doi:10.1093/toxsci/kfy050 · Cited by 11
NTP Research Report on the Scoping Review of Paraquat Dichloride Exposure and Parkinson’s Disease
Boyd, W. A., Blain, R. B., Skuce, C. R., Thayer, K. A., & Rooney, A. A. (2020) · doi:10.22427/ntp-rr-16 · Cited by 11
Self-citationKim, H. R., Kim, J. W., Lee, J., Kim, Y., Lim, J., Baek, Y.-W., Shin, S.-K., Ha, M., Cheong, H., & Chung, K. H. (2024) · Epidemiology and Health · doi:10.4178/epih.e2024060 · Cited by 10
Senerth, E., Tangri, N., Krammer, L., Gaby, V., Whaley, P., Johnson, G. T., Tsaioun, K., & Morgan, R. L. (2024) · Evidence-Based Toxicology · doi:10.1080/2833373x.2024.2443410 · Cited by 10
Improving Concordance in Environmental Epidemiology: A Three-Part Proposal
LaKind, J. S., Goodman, M. G., Makris, S. L., & Mattison, D. R. (2015) · Journal of Toxicology and Environmental Health Part B · doi:10.1080/10937404.2015.1051612 · Cited by 10
Evidence-based causation in toxicology: A 10-year retrospective
James, R., Britt, J. K., Halmes, N. C., & Guzelian, P. (2015) · Human & Experimental Toxicology · doi:10.1177/0960327115601767 · Cited by 10
Metadata
- Authors
- Rooney, A. A., Boyles, A. L., Wolfe, M. S., Bucher, J. R., & Thayer, K. A.
- Affiliations
- National Institutes of Health (US)
- Corresponding author
- Rooney, Andrew A.
- Venue
- Environmental Health Perspectives
- Publisher
- American Chemical Society (ACS)
- Published
- 2014-04-22
- Volume
- 122
- Issue
- 7
- Pages
- 711-718
- ISSN
- 0091-6765 (ISSN-L)
- 1552-9924
- PMC
- PMC4080517
- OpenAlex
- W2066218383
- Semantic Scholar
- f30c4b27530fb3fa34898432b9850e3fbcdbde0e
- Cited by
- 434
- References
- 31
- Citations by year
- 2026: 34 · 2025: 33 · 2024: 43 · 2023: 34 · 2022: 39 · 2021: 53 · 2020: 40 · 2019: 29 · 2018: 33 · 2017: 25 · 2016: 31 · 2015: 28 · 2014: 12
- FWCI
- 8.81
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- public-domain
- creativecommons.org/licenses/by/4.0/ (vor, 1347 d)
- Locations
- Environmental Health Perspectives (publishedVersion, public-domain)
- Europe PMC (PubMed Central) (publishedVersion, public-domain)
- PubMed Central (publishedVersion, public-domain)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Environmental Science › Health, Toxicology and Mutagenesis › Health, Environment, Cognitive Aging
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- systematic reviews, evidence integration, environmental health risk assessment, hazard identification, level of evidence, confidence in evidence, risk of bias assessment, mechanistic studies, animal studies, human subjects research
- MeSH terms
- Systematic Reviews as Topic, Animals, Environmental Health, Humans, United States, Evidence-Based Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
