CoChat

Systematic Review and Evidence Integration for Literature-Based Environmental Health Science Assessments

Open access

The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index; 4 of the 28 sources its claims cite were checked for support.

Abstract

Background: Systematic-review methodologies provide objectivity and transparency to the process of collecting and synthesizing scientific evidence in reaching conclusions on specific research questions. There is increasing interest in applying these procedures to address environmental health questions. Objectives: The goal was to develop a systematic-review framework to address environmental health questions by extending approaches developed for clinical medicine to handle the breadth of data relevant to environmental health sciences (e.g., human, animal, and mechanistic studies). Methods: The Office of Health Assessment and Translation (OHAT) adapted guidance from authorities on systematic-review and sought advice during development of the OHAT Approach through consultation with technical experts in systematic review and human health assessments, as well as scientific advisory groups and the public. The method was refined by considering expert and public comments and through application to case studies. Results and Discussion: Here we present a seven-step framework for systematic review and evidence integration for reaching hazard identification conclusions: 1) problem formulation and protocol development, 2) search for and select studies for inclusion, 3) extract data from studies, 4) assess the quality or risk of bias of individual studies, 5) rate the confidence in the body of evidence, 6) translate the confidence ratings into levels of evidence, and 7) integrate the information from different evidence streams (human, animal, and “other relevant data” including mechanistic or in vitro studies) to develop hazard identification conclusions. Conclusion: The principles of systematic review can be successfully applied to environmental health questions to provide greater objectivity and transparency to the process of developing conclusions. Citation: Rooney AA, Boyles AL, Wolfe MS, Bucher JR, Thayer KA. 2014. Systematic review and evidence integration for literature-based environmental health science assessments. Environ Health Perspect 122:711–718; http://dx.doi.org/10.1289/ehp.1307972

Overview

CoChat Summary

TL;DR

This paper presents the OHAT seven-step framework for systematic review and evidence integration in environmental health assessments, extending clinical systematic-review methods to human, animal, and other relevant data. The approach is designed to improve objectivity, transparency, and consistency in hazard identification conclusions.

Key findings

  • The OHAT framework is a flexible seven-step process: 1) problem formulation and protocol development, 2) search for and select studies, 3) extract data, 4) assess study quality/risk of bias, 5) rate confidence in the body of evidence, 6) translate confidence ratings into levels of evidence, and 7) integrate evidence streams to develop hazard identification conclusions.
  • In applying the OHAT Approach to case studies, steps 2–4 were the most time intensive: selecting studies, extracting data, and assessing the quality of individual studies.
  • The framework defines five hazard identification conclusion categories: known, presumed, suspected, not classifiable, and not identified as a hazard to humans.
  • The paper states that high confidence means further research is very unlikely to change the apparent relationship, while very low confidence means further research is very likely to change it; for a conclusion of evidence of no health effect, the paper says this is reached only when there is high confidence.

Methods

  • The authors developed the OHAT Approach by adapting guidance from authoritative systematic-review groups and consulting technical experts, scientific advisory groups, and the public; the method was refined through comments and application to case studies.
  • The framework was built to cover human, animal, and other relevant data (including mechanistic or in vitro studies) in literature-based environmental health evaluations.
  • The paper describes the method as a seven-step systematic-review and evidence-integration protocol, including prespecified procedures for study selection, data extraction, risk-of-bias assessment, confidence rating, and evidence integration.

Limitations

  • The paper states that systematic-review methods may add time and investment to literature-based evaluations, and notes that steps 2–4 were the most time intensive.
  • It also says that the scientific judgments used in confidence ratings are inherently subjective; this is the paper’s own stated limitation.
  • Evident from the text: the framework is not a report of results from an empirical study with a sample, so there are no quantitative effect estimates or outcome findings to assess here.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1289/ehp.1307972

Cites

31 of 31 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 The OHAT Approach for systematic review and evidence integration for literature-based environmental health science assessments.
Figure 1 The OHAT Approach for systematic review and evidence integration for literature-based environmental health science assessments.CC0 · PubMed Central

Verification

Claims the paper makes

3 Valid · 0 Not valid · 16 Not checked · 52 Own results and interpretations

7 more claims

Create a free account to see all 71 claims and to verify the 23 references still open.

See all claims — free account
  • Probably not a substantial claim. 54
  • It may state two separate claims as one. 16

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Research works printed but not linked: 2

  1. CLARITY Group at McMaster University. 2013. Systematic and Literature Review Resources. Instruments.Available: http://www.evidencepartners.com/resources/ [accessed 15 January 2013].
  2. NRC (National Research Council). 2013b. Project Title: Review of the IRIS Process.Available: http://www8.nationalacademies.org/cp/projectview.aspx?key=49458 [accessed 1 November 2013].

Cited by

See all 463

Metadata

Authors
Rooney, A. A., Boyles, A. L., Wolfe, M. S., Bucher, J. R., & Thayer, K. A.
Affiliations
National Institutes of Health (US)
Corresponding author
Rooney, Andrew A.
Venue
Environmental Health Perspectives
Published
2014-04-22
Volume
122
Issue
7
Pages
711-718
ISSN
  • 0091-6765 (ISSN-L)
  • 1552-9924
OpenAlex
W2066218383
Cited by
434
References
31
Citations by year
2026: 34 · 2025: 33 · 2024: 43 · 2023: 34 · 2022: 39 · 2021: 53 · 2020: 40 · 2019: 29 · 2018: 33 · 2017: 25 · 2016: 31 · 2015: 28 · 2014: 12
FWCI
8.81
Type
journal article
Language
en
Open access
Locations
  • Environmental Health Perspectives (publishedVersion, public-domain)
  • Europe PMC (PubMed Central) (publishedVersion, public-domain)
  • PubMed Central (publishedVersion, public-domain)
  • PubMed (publishedVersion)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Physical Sciences › Environmental Science › Health, Toxicology and Mutagenesis › Health, Environment, Cognitive Aging
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Keywords
systematic reviews, evidence integration, environmental health risk assessment, hazard identification, level of evidence, confidence in evidence, risk of bias assessment, mechanistic studies, animal studies, human subjects research
MeSH terms
Systematic Reviews as Topic, Animals, Environmental Health, Humans, United States, Evidence-Based Medicine

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.