Systematic evidence maps as a novel tool to support evidence-based decision-making in chemicals policy and risk management
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
BACKGROUND: While systematic review (SR) methods are gaining traction as a method for providing a reliable summary of existing evidence for health risks posed by exposure to chemical substances, it is becoming clear that their value is restricted to a specific range of risk management scenarios - in particular, those which can be addressed with tightly focused questions and can accommodate the time and resource requirements of a systematic evidence synthesis. METHODS: The concept of a systematic evidence map (SEM) is defined and contrasted to the function and limitations of systematic review (SR) in the context of risk management decision-making. The potential for SEMs to facilitate evidence-based decision-making are explored using a hypothetical example in risk management priority-setting. The potential role of SEMs in reference to broader risk management workflows is characterised. RESULTS: SEMs are databases of systematically gathered research which characterise broad features of the evidence base. Although not intended to substitute for the evidence synthesis element of systematic reviews, SEMs provide a comprehensive, queryable summary of a large body of policy relevant research. They provide an evidence-based approach to characterising the extent of available evidence and support forward looking predictions or trendspotting in the chemical risk sciences. In particular, SEMs facilitate the identification of related bodies of decision critical chemical risk information which could be further analysed using SR methods, and highlight gaps in the evidence which could be addressed with additional primary studies to reduce uncertainties in decision-making. CONCLUSIONS: SEMs have strong and growing potential as a high value tool in resource efficient use of existing research in chemical risk management. They can be used as a critical precursor to efficient deployment of high quality SR methods for characterising chemical health risks. Furthermore, SEMs have potential, at a large scale, to support the sort of evidence summarisation and surveillance methods which would greatly increase the resource efficiency, transparency and effectiveness of regulatory initiatives such as EU REACH and US TSCA.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A typology of reviews: an analysis of 14 review types and associated methodologies
Grant, M. J., & Booth, A. (2009) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2009.00848.x · Cited by 10,817
A methodology for systematic mapping in environmental sciences
James, K. L., Randall, N. P., & Haddaway, N. R. (2016) · Environmental Evidence · doi:10.1186/s13750-016-0059-6 · Cited by 769 · cited 3×
“To facilitate this exploration, the output of a SEM takes the form of a queryable database (Clapton et al., 2009; James et al., 2016) as opposed to the lengthy and technical documents which form the main output of a systematic review.”
BackgroundMethodInfluentialBorah, R., Brown, A. W., Capers, P. L., & Kaiser, K. A. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-012545 · Cited by 737 · cited 1×
“Evidence from medical systematic reviews indicates it takes on average approximately 70weeks to progress a systematic review from protocol registration in the PROSPERO registry (National Institute for Health Research, 2018) to publication of the final systematic review (Borah et al., 2017).”
BackgroundO’Mara-Eves, A., Thomas, J., McNaught, J., Miwa, M., & Ananiadou, S. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-5 · Cited by 681
A brief history of research synthesis
Chalmers, I., Hedges, L. V., & Cooper, H. (2002) · Evaluation & the Health Professions · doi:10.1177/0163278702025001003 · Cited by 552
Rooney, A. A., Boyles, A. L., Wolfe, M. S., Bucher, J. R., & Thayer, K. A. (2014) · Environmental Health Perspectives · doi:10.1289/ehp.1307972 · Cited by 434
Self-citationWoodruff, T. J., & Sutton, P. (2014) · Environmental Health Perspectives · doi:10.1289/ehp.1307175 · Cited by 427 · cited 4×
“This is evidenced by the increasing number of systematic reviews published in the field (Whaley and Halsall, 2016), the establishment of collaborations and workgroups dedicated to development and dissemination of environmental health systematic review methodology (Morgan et al., 2016; NTP, 2015; Woodruff and Sutton, 2…”
BackgroundInfluentialPredicting the time needed for environmental systematic reviews and systematic maps
Haddaway, N. R., & Westgate, M. J. (2019) · Conservation Biology · doi:10.1111/cobi.13231 · Cited by 120
Rapid reviews may produce different results to systematic reviews: a meta-epidemiological study
Marshall, I. J., Marshall, R., Wallace, B. C., Brassey, J., & Thomas, J. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.12.015 · Cited by 95 · cited 1×
“to transparently and robustly synthesise all available data in answer to a research question) aligns well with the needs of chemicals policy, conflicts between the practicalities associated with the methodology and those associated with regulatory frameworks hinder their wider uptake, and/or the production of reviews…”
BackgroundA primer on systematic reviews in toxicology
Hoffmann, S., de Vries, R. B. M., Stephens, M. L., Beck, N. B., Dirven, H. A. A. M., Fowle, J. R., Goodman, J. E., Hartung, T., Kimber, I., Lalu, M. M., et al. (2017) · Archives of Toxicology · doi:10.1007/s00204-017-1980-3 · Cited by 85
Self-citation
Cited by
Olker, J. H., Elonen, C. M., Pilli, A., Anderson, A., Kinziger, B., Erickson, S., Skopinski, M., Pomplun, A., LaLone, C. A., Russom, C. L., et al. (2022) · Environmental Toxicology and Chemistry · doi:10.1002/etc.5324 · Cited by 301
DeLuca, N. M., Angrish, M., Wilkins, A., Thayer, K., & Cohen Hubal, E. A. (2021) · Environment International · doi:10.1016/j.envint.2020.106308 · Cited by 122
“Literature inventory summaries from this extracted data will be used to create evidence maps organized by PFAS species and exposure media type to 1) identify gaps in the literature and future research needs for assessments, and 2) produce user-friendly outputs for the body of literature (Wolffe et al., 2019).”
MethodPelch, K. E., & Kwiatkowski, C. F. (2022) · Environmental Health Perspectives · doi:10.1289/ehp10743 · Cited by 3
“PFAS-150 follows many of the best practices for conducting SR and SEM, including a clear statement of objectives, a comprehensive literature search that interrogates diverse data repositories (including gray literature), and a structured format for organizing extracted study details.(5,17) Therefore, we believe the da…”
BackgroundMethodMeta-epidemiology and reporting characteristics of mapping reviews: a scoping review
Li, Y., Ghogomu, E., Khalil, H., Hui, X., E, F., Campbell, F., Li, X., Gaarder, M., Nduku, P. M., White, H., et al. (2025) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2024.111648 · Cited by 2
Metadata
- Authors
- Wolffe, T. A. M., Whaley, P., Halsall, C., Rooney, A. A., & Walker, V. R.
- Venue
- Environment International
- Publisher
- Elsevier BV
- Published
- 2019-09
- Volume
- 130
- Pages
- 104871
- ISSN
- 0160-4120 (ISSN-L)
- OpenAlex
- W2953997642
- Cited by
- 119
- References
- 12
- FWCI
- 10.85
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.