Facilitating healthcare decisions by assessing the certainty in the evidence from preclinical animal studies
Open accessThe DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index.
Abstract
Laboratory animal studies are used in a wide range of human health related research areas, such as basic biomedical research, drug research, experimental surgery and environmental health. The results of these studies can be used to inform decisions regarding clinical research in humans, for example the decision to proceed to clinical trials. If the research question relates to potential harms with no expectation of benefit (e.g., toxicology), studies in experimental animals may provide the only relevant or controlled data and directly inform clinical management decisions. Systematic reviews and meta-analyses are important tools to provide robust and informative evidence summaries of these animal studies. Rating how certain we are about the evidence could provide important information about the translational probability of findings in experimental animal studies to clinical practice and probably improve it. Evidence summaries and certainty in the evidence ratings could also be used (1) to support selection of interventions with best therapeutic potential to be tested in clinical trials, (2) to justify a regulatory decision limiting human exposure (to drug or toxin), or to (3) support decisions on the utility of further animal experiments. The Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) approach is the most widely used framework to rate the certainty in the evidence and strength of health care recommendations. Here we present how the GRADE approach could be used to rate the certainty in the evidence of preclinical animal studies in the context of therapeutic interventions. We also discuss the methodological challenges that we identified, and for which further work is needed. Examples are defining the importance of consistency within and across animal species and using GRADE's indirectness domain as a tool to predict translation from animal models to humans.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Considering the difference and the leading clinical research, the SYRCLE group developed a framework definition of preclinical PICO, where ‘Population’ includes animal species and strain and any method of inducing a disease model, and several outcomes can be considered [8].”
From PICO entity extraction for preclinical animal literature. (2022) · cites this paper as [8]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Dermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,451
GRADE: an emerging consensus on rating quality of evidence and strength of recommendations
Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39489.470347.ad · Cited by 23,305
Self-citationGRADE guidelines: 1. Introduction—GRADE evidence profiles and summary of findings tables
Guyatt, G., Oxman, A. D., Akl, E. A., Kunz, R., Vist, G., Brozek, J., Norris, S., Falck-Ytter, Y., Glasziou, P., & deBeer, H. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.04.026 · Cited by 10,681
Self-citationGrading quality of evidence and strength of recommendations
(2004) · BMJ · doi:10.1136/bmj.328.7454.1490 · Cited by 8,477
Self-citationGRADE guidelines: 3. Rating the quality of evidence
Balshem, H., Helfand, M., Schünemann, H. J., Oxman, A. D., Kunz, R., Brozek, J., Vist, G. E., Falck-Ytter, Y., Meerpohl, J., & Norris, S. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.07.015 · Cited by 8,285 · cited 1×
“The optimal application of GRADE requires an up-to-date and well-conducted SR of animal studies [18, 25].”
MethodSelf-citationImproving Bioscience Research Reporting: The ARRIVE Guidelines for Reporting Animal Research
Kilkenny, C., Browne, W. J., Cuthill, I. C., Emerson, M., & Altman, D. G. (2010) · PLoS Biology · doi:10.1371/journal.pbio.1000412 · Cited by 7,300
Improving bioscience research reporting: The ARRIVE guidelines for reporting animal research
Kilkenny, C., Browne, W. J., Cuthill, I. C., Emerson, M., & Altman, D. G. (2010) · Journal of Pharmacology and Pharmacotherapeutics · doi:10.4103/0976-500x.72351 · Cited by 6,277
Cochrane Handbook for Systematic Reviews of Interventions
Tarsilla, M. (2010) · Journal of MultiDisciplinary Evaluation · doi:10.56645/jmde.v6i14.284 · Cited by 5,178
SYRCLE’s risk of bias tool for animal studies
Hooijmans, C. R., Rovers, M. M., de Vries, R. B., Leenaars, M., Ritskes-Hoitinga, M., & Langendam, M. W. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-43 · Cited by 4,415 · cited 2×
“In the probiotics for pancreatitis example, risk of bias was assessed with SYRCLE’s risk of bias tool [4].”
MethodSelf-citation
Research works printed but not linked: 4
- RB de Vries, 2014, Updated version of the Embase search filter for animal studies, Lab Anim, 48, 88
- P Alonso-Coello, GRADE Evidence to Decision frameworks: 1. Introduction, BMJ
- P Alonso-Coello, GRADE Evidence to Decision frameworks: 2. Clinical practice guidelines, BMJ
- HJ Schunemann, 2012, [Diagnostic accuracy and linked evidence—testing the chain], Zeitschrift fur Evidenz, Fortbildung und Qualitat im Gesundheitswesen, 106, 153
Cited by
Brozek, J. L., Canelo-Aybar, C., Akl, E. A., Bowen, J. M., Bucher, J., Chiu, W. A., Cronin, M., Djulbegovic, B., Falavigna, M., Guyatt, G. H., et al. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.09.018 · Cited by 331
“It has been applied to rating the certainty of evidence for management interventions, health care— related tests and strategies [32,33], prognostic information [34], evidence from animal studies [35], use of resources and cost-effectiveness evaluations [36], and values and preferences [37,38].”
MethodSelf-citationDeep learning tools for advancing drug discovery and development
Nag, S., Baidya, A. T. K., Mandal, A., Mathew, A. T., Das, B., Devi, B., & Kumar, R. (2022) · 3 Biotech · doi:10.1007/s13205-022-03165-8 · Cited by 174
“The molecules with optimized ADMET properties are then further evaluated for their effectiveness using suitable animal models (Hooijmans et al. 2018).”
BackgroundThe (misleading) role of animal models in drug development
Härtung, T. (2024) · Frontiers in Drug Discovery · doi:10.3389/fddsv.2024.1355044 · Cited by 116
Martínez-Calderón, J., Flores-Cortés, M., Morales‐Asencio, J. M., Fernández-Sánchez, M., & Luque-Suárez, A. (2020) · Journal of Orthopaedic and Sports Physical Therapy · doi:10.2519/jospt.2020.9319 · Cited by 100
Currie, G. L., Angel-Scott, H. N., Colvin, L., Cramond, F., Hair, K., Khandoker, L., Liao, J., Macleod, M. R., McCann, S., Morland, R., et al. (2019) · PLoS Biology · doi:10.1371/journal.pbio.3000243 · Cited by 87
Self-citation
Metadata
- Authors
- Hooijmans, C. R., de Vries, R. B. M., Ritskes-Hoitinga, M., Rovers, M. M., Leeflang, M. M., IntHout, J., Wever, K. E., Hooft, L., de Beer, H., Kuijpers, T., Macleod, M. R., Sena, E. S., ter Riet, G., Morgan, R. L., Thayer, K. A., Rooney, A. A., Guyatt, G. H., Schünemann, H. J., Langendam, M. W., & on behalf of the GRADE Working Group
- Affiliations
- Radboud University Medical Center (NL)
- Amsterdam UMC Location University of Amsterdam (NL)
- University Medical Center Utrecht (NL)
- Dutch College of General Practitioners (NL)
- University of Edinburgh (GB)
- McMaster University (CA)
- United States Department of Health and Human Services (US)
- Corresponding author
- Langendam, Miranda W.
- ORCID
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2018-01-11
- Volume
- 13
- Issue
- 1
- Pages
- e0187271
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC5764235
- OpenAlex
- W2784327403
- Cited by
- 176
- References
- 60
- Citations by year
- 2026: 45 · 2025: 23 · 2024: 22 · 2023: 17 · 2022: 24 · 2021: 15 · 2020: 13 · 2019: 13 · 2018: 4
- FWCI
- 8.57
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- public-domain
- creativecommons.org/publicdomain/zero/1.0/ (vor)
- Locations
- PLoS ONE (publishedVersion, public-domain)
- Europe PMC (PubMed Central) (publishedVersion, public-domain)
- PubMed Central (publishedVersion, public-domain)
- PubMed (publishedVersion)
- Pure Amsterdam UMC (submittedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
- Figshare (submittedVersion, cc-by)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, other-oa)
- Radboud Repository (Radboud University) (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- Funders
- Ministerie van Volksgezondheid, Welzijn en Sport (321200)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Veterinary › Small Animals › Animal testing and alternatives
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- preclinical animal studies, GRADE, translational research, animal-to-human extrapolation, indirectness, toxicology, evidence-based medicine
- MeSH terms
- Animals, Decision Making, Delivery of Health Care, Humans, Evidence-Based Medicine, Models, Animal, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Facilitating healthcare decisions by assessing the certainty in the evidence from preclinical animal studies. https://app.cochat.ai/papers/10.1371/journal.pone.0187271
- The paper
- Hooijmans, C. R., de Vries, R. B. M., Ritskes-Hoitinga, M., Rovers, M. M., Leeflang, M. M., IntHout, J., Wever, K. E., Hooft, L., de Beer, H., Kuijpers, T., Macleod, M. R., Sena, E. S., ter Riet, G., Morgan, R. L., Thayer, K. A., Rooney, A. A., Guyatt, G. H., Schünemann, H. J., Langendam, M. W., & on behalf of the GRADE Working Group. (2018). Facilitating healthcare decisions by assessing the certainty in the evidence from preclinical animal studies. PLOS ONE. https://doi.org/10.1371/journal.pone.0187271
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.