A primer on systematic reviews in toxicology
Open accessThe DOI matches its Crossref record; 64 of the 65 references it cites were found in a registry or an index.
Abstract
Systematic reviews, pioneered in the clinical field, provide a transparent, methodologically rigorous and reproducible means of summarizing the available evidence on a precisely framed research question. Having matured to a well-established approach in many research fields, systematic reviews are receiving increasing attention as a potential tool for answering toxicological questions. In the larger framework of evidence-based toxicology, the advantages and obstacles of, as well as the approaches for, adapting and adopting systematic reviews to toxicology are still being explored. To provide the toxicology community with a starting point for conducting or understanding systematic reviews, we herein summarized available guidance documents from various fields of application. We have elaborated on the systematic review process by breaking it down into ten steps, starting with planning the project, framing the question, and writing and publishing the protocol, and concluding with interpretation and reporting. In addition, we have identified the specific methodological challenges of toxicological questions and have summarized how these can be addressed. Ultimately, this primer is intended to stimulate scientific discussions of the identified issues to fuel the development of toxicology-specific methodology and to encourage the application of systematic review methodology to toxicological issues.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


![Fig. 3 Representative summary table (a) for the risk of bias assessment [green cells with (plus): low risk of bias; yellow cells with (question mark): unknown risk of bias; red cells with (hyphen): high risk of bias] and representative summary (b) of risk of bias analysis across studies (reproduced from Wever et al. 2015)](https://figures.cochat.ai/paper-figures/6b692986979e400d8a94a9dde8342177/a-primer-on-systematic-reviews-in-toxicology-figure-3.jpg)
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Over the last years, however, the number of systematic reviews in these latter fields has been steadily increasing (Hoffmann et al., 2017;Whaley et al., 2016); where we have a rudimentary count of them, they are showing exponential growth (Whaley et al., 2016).”
From Toward good in vitro reporting standards (2019) · cites this paper as Hoffmann et al., 2017
Experimental — accuracy not yet measuredIn the citing paper
“Despite similarities in the general structure of the review, the ‘roadmap’ of systematic reviews of observational studies is less standardised [17]”
From COSMOS-E: Guidance on conducting systematic reviews and meta-analyses of observational studies of etiology (2019) · cites this paper as [17]
In the citing paper
“Especially in the field of toxicology, mechanistic evidence plays an important role in causal inference”
From COSMOS-E: Guidance on conducting systematic reviews and meta-analyses of observational studies of etiology (2019) · cites this paper as [17]
In the citing paper
“Clearly, understanding pathways requires more than quickly searching for a few articles that support the hypothesis ('cherry picking') [17].”
From COSMOS-E: Guidance on conducting systematic reviews and meta-analyses of observational studies of etiology (2019) · cites this paper as [17]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · cited 2×
“2 (Moher et al. 2009).”
MethodPreferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
PRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
Scoping studies: advancing the methodology
Levac, D., Colquhoun, H., & O'Brien, K. K. (2010) · Implementation Science · doi:10.1186/1748-5908-5-69 · Cited by 15,268 · cited 1×
“Scoping may range from a simple nonsystematic search in one or two databases to a more formalized, resource intensive scoping review (described in Levac et al. 2010 and in Peters et al. 2015).”
BackgroundGRADE guidelines: 3. Rating the quality of evidence
Balshem, H., Helfand, M., Schünemann, H. J., Oxman, A. D., Kunz, R., Brozek, J., Vist, G. E., Falck-Ytter, Y., Meerpohl, J., & Norris, S. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.07.015 · Cited by 8,285
Guidance for conducting systematic scoping reviews
Peters, M. D. J., Godfrey, C. M., Khalil, H., McInerney, P., Parker, D., & Soares, C. B. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000050 · Cited by 7,472
Cochrane Handbook for Systematic Reviews of Interventions Version 5.0.1. The Cochrane Collaboration
Higgins, J. P. T., Green, S. R., & Higgins, J. P. T. (2008) · Cited by 7,171
Improving bioscience research reporting: The ARRIVE guidelines for reporting animal research
Kilkenny, C., Browne, W. J., Cuthill, I. C., Emerson, M., & Altman, D. G. (2010) · Journal of Pharmacology and Pharmacotherapeutics · doi:10.4103/0976-500x.72351 · Cited by 6,277
Research works printed but not linked: 2
- CEE (2013) Guidelines for systematic reviews in environmental management. Version 4.2, http://www.environmentalevidence.org/wp-content/uploads/2017/01/Review-guidelines-version-4.2-final-update.pdf . Accessed 13 Feb 2017
- TCEQ (Texas Commission on Environmental Quality) (2014) TCEQ recommendations for systematic review and evidence integration. http://www.tceq.com/assets/public/implementation/tox/dsd/proposed/nov14/systematic_review.pdf . Accessed 13 Feb 2017
Cited by
Overview of known plastic packaging-associated chemicals and their hazards
Groh, K. J., Backhaus, T., Carney-Almroth, B., Geueke, B., Inostroza, P. A., Lennquist, A., Leslie, H. A., Maffini, M., Slunge, D., Trasande, L., et al. (2019) · Science of The Total Environment · doi:10.1016/j.scitotenv.2018.10.015 · Cited by 913
Dekkers, O. M., Vandenbroucke, J. P., Cevallos, M., Renehan, A. G., Altman, D. G., & Egger, M. (2019) · PLOS Medicine · doi:10.1371/journal.pmed.1002742 · Cited by 525
Adverse outcome pathways: opportunities, limitations and open questions
Leist, M., Ghallab, A., Graepel, R., Marchan, R., Hassan, R., Bennekou, S. H., Limonciel, A., Vinken, M., Schildknecht, S., Waldmann, T., et al. (2017) · Archives of Toxicology · doi:10.1007/s00204-017-2045-3 · Cited by 394
Toxicity testing in the 21st century: progress in the past decade and future perspectives
Krewski, D., Andersen, M. E., Tyshenko, M. G., Krishnan, K., Hartung, T., Boekelheide, K., Wambaugh, J. F., Jones, D., Whelan, M., Thomas, R., et al. (2020) · Archives of Toxicology · doi:10.1007/s00204-019-02613-4 · Cited by 383
Olker, J. H., Elonen, C. M., Pilli, A., Anderson, A., Kinziger, B., Erickson, S., Skopinski, M., Pomplun, A., LaLone, C. A., Russom, C. L., et al. (2022) · Environmental Toxicology and Chemistry · doi:10.1002/etc.5324 · Cited by 301
Metadata
- Authors
- Hoffmann, S., de Vries, R. B. M., Stephens, M. L., Beck, N. B., Dirven, H. A. A. M., Fowle, J. R., Goodman, J. E., Hartung, T., Kimber, I., Lalu, M. M., Thayer, K., Whaley, P., Wikoff, D., & Tsaioun, K.
- Affiliations
- Johns Hopkins University (US)
- American Chemistry Council (US)
- Norwegian Institute of Public Health (NO)
- University of Pittsburgh at Titusville (US)
- Gradient (United States) (US)
- University of Manchester (GB)
- University of Ottawa (CA)
- Environmental Protection Agency (US)
- Lancaster University (GB)
- ToxStrategies LLC (United States) (US)
- Corresponding author
- Tsaioun, Katya
- ORCID
- Venue
- Archives of Toxicology
- Published
- 2017-05-13
- Volume
- 91
- Issue
- 7
- Pages
- 2551-2575
- ISSN
- 0340-5761 (ISSN-L)
- 1432-0738
- PMC
- PMC5489636
- OpenAlex
- W2612847450
- Cited by
- 85
- References
- 65
- Citations by year
- 2026: 5 · 2025: 7 · 2024: 5 · 2023: 5 · 2022: 13 · 2021: 18 · 2020: 10 · 2019: 10 · 2018: 9 · 2017: 3
- FWCI
- 2.16
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- Locations
- Archives of Toxicology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- BIBSYS Brage (BIBSYS (Norway)) (submittedVersion)
- Lancaster EPrints (Lancaster University) (submittedVersion)
- NORA - Norwegian Open Research Archives (submittedVersion, other-oa)
- Research Explorer (The University of Manchester) (submittedVersion, cc-by)
- Radboud Repository (Radboud University) (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- Funders
- U.S. Environmental Protection Agency
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Nursing › Research and Theory › Methodologies in Health Research and Practice
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- systematic reviews, evidence-based toxicology, research question formulation
- MeSH terms
- Toxicology, Meta-Analysis as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A primer on systematic reviews in toxicology. https://app.cochat.ai/papers/10.1007/s00204-017-1980-3
- The paper
- Hoffmann, S., de Vries, R. B. M., Stephens, M. L., Beck, N. B., Dirven, H. A. A. M., Fowle, J. R., Goodman, J. E., Hartung, T., Kimber, I., Lalu, M. M., Thayer, K., Whaley, P., Wikoff, D., & Tsaioun, K. (2017). A primer on systematic reviews in toxicology. Archives of Toxicology. https://doi.org/10.1007/s00204-017-1980-3
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.