Student or educator? Sign up with your school email and get 6 months of Pro free.

The DOI matches its Crossref record; 88 of the 88 references it cites were found in a registry or an index; 12 of the 39 sources its claims cite were checked for support.

Animal to human translation: a systematic scoping review of reported concordance rates

Open access

Abstract

Drug development is currently hampered by high attrition rates; many developed treatments fail during clinical testing. Part of the attrition may be due to low animal-to-human translational success rates; so-called “translational failure”. As far as we know, no systematic overview of published translational success rates exists. The following research question was examined: “What is the observed range of the animal-to-human translational success (and failure) rates within the currently available empirical evidence?”. We searched PubMed and Embase on 16 October 2017. We included reviews and all other types of “umbrella”-studies of meta-data quantitatively comparing the translational results of studies including at least two species with one being human. We supplemented our database searches with additional strategies. All abstracts and full-text papers were screened by two independent reviewers. Our scoping review comprises 121 references, with various units of measurement: compound or intervention (k = 104), study/experiment (k = 10), and symptom or event (k = 7). Diagnostic statistics corresponded with binary and continuous definitions of successful translation. Binary definitions comprise percentages below twofold error, percentages accurately predicted, and predictive values. Quantitative definitions comprise correlation/regression (r 2 ) and meta-analyses (percentage overlap of 95% confidence intervals). Translational success rates ranged from 0 to 100%. The wide range of translational success rates observed in our study might indicate that translational success is unpredictable; i.e. it might be unclear upfront if the results of primary animal studies will contribute to translational knowledge. However, the risk of bias of the included studies was high, and much of the included evidence is old, while newer models have become available. Therefore, the reliability of the cumulative evidence from current papers on this topic is insufficient. Further in-depth “umbrella”-studies of translational success rates are still warranted. These are needed to evaluate the probabilistic evidence for predictivity of animal studies for the human situation more reliably, and to determine which factors affect this process.

Overview

CoChat Summary

TL;DR

This systematic scoping review of 121 references found that reported animal-to-human translational success rates ranged from 0% to 100%, with no clear differences by definition, unit of analysis, research category, species, source, or publication date. The authors conclude the cumulative evidence is inconclusive because of high risk of bias and poor reporting, and that further umbrella studies are warranted.

Key findings

  • Across 121 included references, translational success rates ranged from 0% to 100%; binary definitions ranged from 0% to 93%, and continuous definitions from 0% to 100%.
  • Units of measurement were compound/intervention (k = 104), study/experiment (k = 10), and symptom/event (k = 7); event-based studies ranged from 7% to 74%, while the other units spanned 0–100%.
  • No clear differences were observed between toxicology, PKPD, and efficacy studies, between species, by paper source, or between binary and continuous definitions; studies with n > 200 were all toxicology studies using binary definitions.
  • Risk of bias was overall unclear; high risk of funding bias was scored for 81 of 121 references, high risk for underpowered studies for 30 of 121, and specific eligibility criteria were described in 31 of 121 references (26%) and limitations in 37 of 121 (31%).

Methods

  • Systematic scoping review searching PubMed and Embase on 16 October 2017, supplemented by reference-list screening and contacting experts/authors; included reviews and umbrella studies quantitatively comparing at least two species with one being human, yielding 121 references.
  • Two independent reviewers screened titles/abstracts and full texts, resolving discrepancies by discussion; the protocol was posted on the SYRCLE website on 27 December 2017 after searches but before paper selection.
  • All translation values were expressed as percentages using binary definitions (fold error, accuracy, PPV/NPV) or continuous definitions (r², percentage overlap of 95% CIs); data were tabulated and visualised in R version 3.5.0 with histograms and boxplots, and risk of bias/PRISMA reporting was assessed.

Limitations

  • Stated by the authors: the search used MeSH/title words only, omitted modelling/scaling terms, was performed in October 2017, and stopped snowballing after second-line reference lists; data extraction/analysis were unblinded; included measures used different definitions; datasets overlapped; dosing and event incidence were often disregarded; publication bias and high/unclear risk of bias limit the evidence, which is old and should be considered hypothesis-generating only.
  • Evident from the text: the included studies are highly heterogeneous in definitions, units, and diagnostic statistics, many included references did not claim to be systematic reviews and showed poor PRISMA compliance, and the authors did not perform a quantitative meta-analysis of the reported rates.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1186/s12967-019-1976-2

Cites

88 of 88 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Fig. 1 Flow scheme of papers
Fig. 1 Flow scheme of papersCC BY · PubMed Central
Fig. 2 Histogram of the translational success rates (%) in the included studies
Fig. 2 Histogram of the translational success rates (%) in the included studiesCC BY · PubMed Central
Fig. 3 Reported translational success rates (%) by type of definition of translational success (binary vs. continuous diagnostic statistics). DefType type of definition
Fig. 3 Reported translational success rates (%) by type of definition of translational success (binary vs. continuous diagnostic statistics). DefType type of definitionCC BY · PubMed Central
Fig. 4 Reported translational success rates (%) by analysis unit
Fig. 4 Reported translational success rates (%) by analysis unitCC BY · PubMed Central
Fig. 5 Reported translational success rates (%) by calculators: the original authors vs. the meta-reviewers
Fig. 5 Reported translational success rates (%) by calculators: the original authors vs. the meta-reviewersCC BY · PubMed Central
Fig. 6 Reported translational success rates (%) by broadly defined research category. Eff efficacy, PKPD pharmacokinetics or pharmacodynamics, tox toxicology
Fig. 6 Reported translational success rates (%) by broadly defined research category. Eff efficacy, PKPD pharmacokinetics or pharmacodynamics, tox toxicologyCC BY · PubMed Central
Fig. 7 Reported translational success rates (%) by species. NA information on species not available
Fig. 7 Reported translational success rates (%) by species. NA information on species not availableCC BY · PubMed Central
Fig. 8 Reported translational success rates (%) by study size. K = the number of included compounds/interventions, studies/experiments, or symptoms/events
Fig. 8 Reported translational success rates (%) by study size. K = the number of included compounds/interventions, studies/experiments, or symptoms/eventsCC BY · PubMed Central
Fig. 9 Reported translational success rates (%) by paper source
Fig. 9 Reported translational success rates (%) by paper sourceCC BY · PubMed Central
Fig. 10 Reported translational success rates (%) by publication date
Fig. 10 Reported translational success rates (%) by publication dateCC BY · PubMed Central
Fig. 11 Summary of risk of bias of the included studies. Numbers are absolute values
Fig. 11 Summary of risk of bias of the included studies. Numbers are absolute valuesCC BY · PubMed Central

Verification

Claims the paper makes

8 Valid · 5 Not valid · 15 Not checked · 94 Own results and interpretations

41 more claims

Create a free account to see all 122 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 46
  • It may state two separate claims as one. 47

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

2 of 2

Citations

Cites

Show all 88 references

Research works printed but not linked: 2

  1. Shanks N, Greek CR. Animal model in light of evolution. Boca Raton: BrownWalker Press; 2009.
  2. Menon JM, Kouwenaar C, Stafleu F, De Vries RBM, Ritskes-Hoitinga, Meijboom FLB, et al. Quantification of translational success: rates of concordance between the results of animal experiments and human trials—a systematized review [protocol posted online on http://www.SYRCLE.nl ]. Nijmegen: SYRCLE; 2017.

Cited by

See all 314

Metadata

Authors
Leenaars, C. H. C., Kouwenaar, C., Stafleu, F. R., Bleich, A., Ritskes-Hoitinga, M., De Vries, R. B. M., & Meijboom, F. L. B.
Affiliations
  • Utrecht University (NL)
  • Medizinische Hochschule Hannover (DE)
  • Radboud University Medical Center (NL)
Corresponding author
Leenaars, Cathalijn H. C.
Venue
Journal of Translational Medicine
Published
2019-07-15
Volume
17
Issue
1
Pages
223-223
ISSN
1479-5876 (ISSN-L)
OpenAlex
W2960989010
Cited by
314
References
88
Citations by year
2026: 55 · 2025: 38 · 2024: 56 · 2023: 50 · 2022: 55 · 2021: 36 · 2020: 21 · 2019: 2
FWCI
7.30
Type
journal article
Language
en
Open access
Licence
Locations
  • Journal of Translational Medicine (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Radboud Repository (Radboud University) (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
  • Utrecht University Repository (Utrecht University) (submittedVersion, other-oa)
  • Radboud Repository (Radboud University) (submittedVersion, other-oa)
Funders
  • ZonMW (40-42600-98-417)
  • NWO (313-99-310)
  • the Federal State of Lower Saxony (R2N)
Topics
  • Health Sciences › Veterinary › Small Animals › Animal testing and alternatives
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
Keywords
animal-to-human translation, translational failure, drug attrition, animal models, species comparison, risk of bias
MeSH terms
Animals, Humans, Periodicals as Topic, Risk, Publication Bias, Translational Research, Biomedical

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-07, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-07 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Animal to human translation: a systematic scoping review of reported concordance rates. https://app.cochat.ai/papers/10.1186/s12967-019-1976-2
The paper
Leenaars, C. H. C., Kouwenaar, C., Stafleu, F. R., Bleich, A., Ritskes-Hoitinga, M., De Vries, R. B. M., & Meijboom, F. L. B. (2019). Animal to human translation: a systematic scoping review of reported concordance rates. Journal of Translational Medicine. https://doi.org/10.1186/s12967-019-1976-2

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.