The next step in translational research: lessons learned from the first preclinical randomized controlled trial
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
For years, low reproducibility of preclinical trials and poor translation of promising preclinical therapies to the clinic have posed major challenges to translational research in most biomedical fields. To overcome the limitations that stand between experimental and clinical research, international consortia have attempted to establish standardized guidelines for study design and for reporting the resulting data. In addition, multicenter preclinical randomized controlled trials (p RCT s) have been proposed as a suitable tool for ‘bridging the gap’ between experimental research and clinical trials. We recently reported the design and results of the first such p RCT in which we confirmed the feasibility of using a coordinated approach with standardized protocols in collaboration with independent multinational research centers. However, despite its successes, this first p RCT also had several difficulties, particularly with respect to following the protocols established in the study design and analyzing the data. Here, we review our experiences performing the study, and we analyze and discuss the lessons learned from performing the first p RCT. Moreover, we provide suggestions regarding how obstacles can be overcome to improve the performance and outcome of future p RCT studies. image Translational research is hampered by low reproducibility of preclinical studies and countless failed clinical trials. International consortia have proposed preclinical multicenter trials as an intermediate step to overcome this ‘translational roadblock’. We have recently performed the first such preclinical randomized controlled trial (pRCT) by adopting key elements of clinical study design to preclinical research. In this review, we discuss the lessons learned from this trial and provide suggestions how to optimize future pRCTs. This article is part of the 60th Anniversary special issue.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641
Improving bioscience research reporting: The ARRIVE guidelines for reporting animal research
Kilkenny, C., Browne, W. J., Cuthill, I. C., Emerson, M., & Altman, D. G. (2010) · Journal of Pharmacology and Pharmacotherapeutics · doi:10.4103/0976-500x.72351 · Cited by 6,277
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979
Believe it or not: how much can we rely on published data on potential drug targets?
Prinz, F., Schlange, T., & Asadullah, K. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439-c1 · Cited by 1,888 · cited 1×
“…international consortia in response to the ‘replication crisis’, several reports have been published regarding deficiencies with respect to reproducibility among research centers and a lack of robust preclinical results in academic research (Prinz et al. 2011; Begley and Ellis 2012; Perrin 2014).”
BackgroundThe interplay between the intestinal microbiota and the brain
Collins, S. M., Surette, M., & Bercik, P. (2012) · Nature Reviews Microbiology · doi:10.1038/nrmicro2876 · Cited by 1,611 · cited 1×
“…in rodents depends largely on the chow, breeder source and housing conditions – demonstrated that environmental factors (particularly, the microbiota) are potential confounders in animal experiments, including models of brain disease (Claesson et al. 2012; Collins et al. 2012; Wekerle et al. 2013).”
BackgroundIncreasing value and reducing waste in research design, conduct, and analysis
Ioannidis, J. P. A., Greenland, S., Hlatky, M. A., Khoury, M. J., Macleod, M. R., Moher, D., Schulz, K. F., & Tibshirani, R. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62227-8 · Cited by 1,597
Biomedical research: increasing value, reducing waste.
Macleod, M. R., Michie, S., Roberts, I., Dirnagl, U., Chalmers, I., Ioannidis, J. P. A., Salman, R. A.-S., Chan, A.-W., & Glasziou, P. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62329-6 · Cited by 1,003
Translational research: crossing the valley of death
Butler, D. (2008) · Nature · doi:10.1038/453840a · Cited by 712
Preclinical research: Make mouse studies work
Perrin, S. (2014) · Nature · doi:10.1038/507423a · Cited by 668 · cited 1×
“…international consortia in response to the ‘replication crisis’, several reports have been published regarding deficiencies with respect to reproducibility among research centers and a lack of robust preclinical results in academic research (Prinz et al. 2011; Begley and Ellis 2012; Perrin 2014).”
BackgroundThe poor availability of psychological research data for reanalysis.
Wicherts, J. M., Borsboom, D., Kats, J., & Molenaar, D. (2006) · American Psychologist · doi:10.1037/0003-066x.61.7.726 · Cited by 543
Evaluation of excess significance bias in animal studies of neurological diseases
Tsilidis, K. K., Panagiotou, O. A., Sena, E. S., Aretouli, E., Evangelou, E., Howells, D. W., Salman, R. A.-S., Macleod, M. R., & Ioannidis, J. P. A. (2013) · PLoS Biology · doi:10.1371/journal.pbio.1001609 · Cited by 295
Distinguishing between exploratory and confirmatory preclinical research will improve translation
Kimmelman, J., Mogil, J. S., & Dirnagl, U. (2014) · PLoS Biology · doi:10.1371/journal.pbio.1001863 · Cited by 236 · cited 3×
“Most importantly, study design of a pRCT is a confirmatory study by its nature in contrast to most preclinical singly center trials with an exploratory study design (Kimmelman et al. 2014).”
BackgroundInfluentialBringing rigour to translational medicine
Howells, D. W., Sena, E. S., & Macleod, M. R. (2014) · Nature Reviews Neurology · doi:10.1038/nrneurol.2013.232 · Cited by 130
Hutton, B., Salanti, G., Chaimani, A., Caldwell, D. M., Schmid, C., Thorlund, K., Mills, E., Catalá-López, F., Turner, L., Altman, D. G., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0092508 · Cited by 105 · cited 1×
“Although combining results obtained from several studies seems an attractive approach for validating treatment efficacy, differences with respect to design, reporting, and methodologies often preclude the ability to integrate the results (Egger et al. 1997; Hutton et al. 2014).”
ResultMaysami, S., Wong, R., Pradillo, J. M., Denes, A., Dhungana, H., Malm, T., Koistinaho, J., Orset, C., Rahman, M., Rubio, M., et al. (2016) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1177/0271678x15606714 · Cited by 84 · cited 3×
“Thus, participating researchers should be instructed to follow a highly detailed protocol, particularly given the recent multicenter trial in experimental stroke in which the individual centers did not adhere sufficiently to the defined study protocol (Maysami et al. 2015).”
BackgroundInfluential
Cited by
Yang, L., Han, B., Zhang, Z., Wang, S., Bai, Y., Zhang, Y., Tang, Y., Du, L., Xu, L., Wu, F., et al. (2020) · Circulation · doi:10.1161/circulationaha.120.045765 · Cited by 376
Short-Chain Fatty Acids Improve Poststroke Recovery via Immunological Mechanisms
Sadler, R., Cramer, J. V., Heindl, S., Kostidis, S., Betz, D., Zuurbier, K. R., Northoff, B. H., Heijink, M., Goldberg, M. P., Plautz, E. J., et al. (2020) · The Journal of Neuroscience · doi:10.1523/jneurosci.1359-19.2019 · Cited by 335
Self-citationSchulz, J. B., Cookson, M. R., & Hausmann, L. (2016) · Journal of Neurochemistry · doi:10.1111/jnc.13844 · Cited by 52
Enhancing reproducibility: Failures from Reproducibility Initiatives underline core challenges
Mullane, K., & Williams, M. (2017) · Biochemical Pharmacology · doi:10.1016/j.bcp.2017.04.008 · Cited by 28
Hunniford, V. T., Grudniewicz, A., Fergusson, D. A., Montroy, J., Grigor, E., Lansdell, C., Lalu, M. M., & On behalf of The Canadian Critical Care Translational Biology Group (2023) · eLife · doi:10.7554/elife.76300 · Cited by 26
“This will inform and optimize future multicenter preclinical studies by producing a synthesis of current practices and outcomes, while also identifying knowledge gaps and areas for improvement ( Dirnagl and Fisher, 2012 ; Llovera and Liesz, 2016 ; Fernández-Jiménez and Ibanez, 2015 ).”
Metadata
- Authors
- Llovera, G., & Liesz, A.
- Venue
- Journal of Neurochemistry
- Publisher
- Wiley
- Published
- 2016-03-10
- Volume
- 139
- Issue
- S2
- Pages
- 271-279
- ISSN
- 0022-3042 (ISSN-L)
- 1471-4159
- OpenAlex
- W2295651440
- Cited by
- 56
- References
- 15
- FWCI
- 7.07
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.