The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
The Significance of Meaning: Why Do Over 90% of Behavioral Neuroscience Results Fail to Translate to Humans, and What Can We Do to Fix It?
Open accessAbstract
The vast majority of drugs entering human trials fail. This problem (called "attrition") is widely recognized as a public health crisis, and has been discussed openly for the last two decades. Multiple recent reviews argue that animals may be just too different physiologically, anatomically, and psychologically from humans to be able to predict human outcomes, essentially questioning the justification of basic biomedical research in animals. This review argues instead that the philosophy and practice of experimental design and analysis is so different in basic animal work and human clinical trials that an animal experiment (as currently conducted) cannot reasonably predict the outcome of a human trial. Thus, attrition does reflect a lack of predictive validity of animal experiments, but it would be a tragic mistake to conclude that animal models cannot show predictive validity. A variety of contributing factors to poor validity are reviewed. The need to adopt methods and models that are highly specific (i.e., which can identify true negative results) in order to complement the current preponderance of highly sensitive methods (which are prone to false positive results) is emphasized. Concepts in biomarker-based medicine are offered as a potential solution, and changes in the use of animal models required to embrace a translational biomarker-based approach are outlined. In essence, this review advocates a fundamental shift, where we treat every aspect of an animal experiment that we can as if it was a clinical trial in a human population. However, it is unrealistic to expect researchers to adopt a new methodology that cannot be empirically justified until a successful human trial. "Validation with known failures" is proposed as a solution. Thus new methods or models can be compared against existing ones using a drug that has translated (a known positive) and one that has failed (a known negative). Current methods should incorrectly identify both as effective, but a more specific method should identify the negative compound correctly. By using a library of known failures we can thereby empirically test the impact of suggested solutions such as enrichment, controlled heterogenization, biomarker-based models, or reverse-translated measures.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Subramanian, A., Tamayo, P., Mootha, V. K., Mukherjee, S., Ebert, B. L., Gillette, M. A., Paulovich, A., Pomeroy, S. L., Golub, T. R., Lander, E. S., et al. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0506580102 · Cited by 53,625
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
The control of the false discovery rate in multiple testing under dependency
Benjamini, Y., & Yekutieli, D. (2001) · The Annals of Statistics · doi:10.1214/aos/1013699998 · Cited by 10,490
Improving Bioscience Research Reporting: The ARRIVE Guidelines for Reporting Animal Research
Kilkenny, C., Browne, W. J., Cuthill, I. C., Emerson, M., & Altman, D. G. (2010) · PLoS Biology · doi:10.1371/journal.pbio.1000412 · Cited by 7,300
Improving bioscience research reporting: The ARRIVE guidelines for reporting animal research
Kilkenny, C., Browne, W. J., Cuthill, I. C., Emerson, M., & Altman, D. G. (2010) · Journal of Pharmacology and Pharmacotherapeutics · doi:10.4103/0976-500x.72351 · Cited by 6,277
The Endophenotype Concept in Psychiatry: Etymology and Strategic Intentions
Gottesman, I. I., & Gould, T. D. (2003) · American Journal of Psychiatry · doi:10.1176/appi.ajp.160.4.636 · Cited by 5,615
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 3×
“In fact, a similar theme can be seen regardless of the particular focus of papers in the recent literature: from publication bias (Ioannidis 2005; Prinz et al. 2011; Sena et al. 2010); to adopting human clinical practices such as blinding (Kilkenny et al. 2009; Macleod et al. 2008; Muhlhausler et…”
Can the pharmaceutical industry reduce attrition rates?
Kola, I., & Landis, J. (2004) · Nature Reviews Drug Discovery · doi:10.1038/nrd1470 · Cited by 4,167
How to improve R&D productivity: the pharmaceutical industry's grand challenge
Paul, S. M., Mytelka, D. S., Dunwiddie, C. T., Persinger, C. C., Munos, B. H., Lindborg, S. R., & Schacht, A. L. (2010) · Nature Reviews Drug Discovery · doi:10.1038/nrd3078 · Cited by 3,566
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979
Believe it or not: how much can we rely on published data on potential drug targets?
Prinz, F., Schlange, T., & Asadullah, K. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439-c1 · Cited by 1,888
Alzheimer’s disease drug-development pipeline: Few candidates, frequent failures
Cummings, J. L., Morstorf, T., & Zhong, K. (2014) · Alzheimer's Research & Therapy · doi:10.1186/alzrt269 · Cited by 1,744
Phenotypic plasticity and the epigenetics of human disease
Feinberg, A. P. (2007) · Nature · doi:10.1038/nature05919 · Cited by 1,613
Dissociation in prefrontal cortex of affective and attentional shifts
Dias, R., Robbins, T. W., & Roberts, A. C. (1996) · Nature · doi:10.1038/380069a0 · Cited by 1,527 · cited 2×
“More complex cognitive tasks can be implemented using automated apparatuses, such as touchscreens for primates (Dias et al. 1996) or automated mazes attached to the home cage for rodents (Pioli et al.”
BackgroundMoy, S. S., Nadler, J. J., Perez, A., Barbaro, R. P., Johns, J. M., Magnuson, T. R., Piven, J., & Crawley, J. N. (2004) · Genes, Brain and Behavior · doi:10.1111/j.1601-1848.2004.00076.x · Cited by 1,522
Medial Frontal Cortex Mediates Perceptual Attentional Set Shifting in the Rat
Birrell, J. M., & Brown, V. J. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-11-04320.2000 · Cited by 1,421
Can Animal Models of Disease Reliably Inform Human Studies?
van der Worp, H. B., Howells, D. W., Sena, E. S., Porritt, M. J., Rewell, S., O'Collins, V., & Macleod, M. R. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000245 · Cited by 1,354
Sequence Variants in SLITRK1 Are Associated with Tourette's Syndrome
Abelson, J. F., Kwan, K. Y., O'Roak, B. J., Baek, D. Y., Stillman, A. A., Morgan, T. M., Mathews, C. A., Pauls, D. L., Rašin, M.-R., Gunel, M., et al. (2005) · Science · doi:10.1126/science.1116502 · Cited by 940
Olfactory exposure to males, including men, causes stress and related analgesia in rodents
Sorge, R. E., Martin, L. J., Isbester, K. A., Sotocinal, S. G., Rosen, S., Tuttle, A. H., Wieskopf, J. S., Acland, E. L., Dokova, A., Kadoura, B., et al. (2014) · Nature Methods · doi:10.1038/nmeth.2935 · Cited by 905
Gene-targeting studies of mammalian behavior: is it the mutation or the background genotype?
Gerlai, R. (1996) · Trends in Neurosciences · doi:10.1016/s0166-2236(96)20020-7 · Cited by 881
Erroneous analyses of interactions in neuroscience: A problem of significance
Nieuwenhuis, S., Forstmann, B. U., & Wagenmakers, E.-J. (2011) · Nature Neuroscience · doi:10.1038/nn.2886 · Cited by 864
Kilkenny, C., Parsons, N., Kadyszewski, E., Festing, M. F. W., Cuthill, I. C., Fry, D., Hutton, J., & Altman, D. G. (2009) · PLoS ONE · doi:10.1371/journal.pone.0007824 · Cited by 860
Cognitive bias and affective state
Harding, E. J., Paul, E. S., & Mendl, M. (2004) · Nature · doi:10.1038/427312a · Cited by 835
Social networks, social support, and survival after breast cancer diagnosis
Kroenke, C. H., Kubzansky, L. D., Schernhammer, E. S., Holmes, M. D., & Kawachi, I. (2006) · Journal of Clinical Oncology · doi:10.1200/jco.2005.04.2846 · Cited by 792
Automated apparatus for quantitation of social approach behaviors in mice
Nadler, J. J., Moy, S. S., Dold, G., Trang, D., Simmons, N., Perez, A., Young, N. B., Barbaro, R. P., Piven, J., Magnuson, T. R., et al. (2004) · Genes, Brain and Behavior · doi:10.1111/j.1601-183x.2004.00071.x · Cited by 775
Biological response to stress: implications for animal welfare.
Moberg, G. P. (2000) · The biology of animal stress: basic principles and implications for animal welfare. · doi:10.1079/9780851993591.0001 · Cited by 768
Publication bias in reports of animal stroke studies leads to major overstatement of efficacy
Sena, E. S., van der Worp, H. B., Bath, P. M. W., Howells, D. W., & Macleod, M. R. (2010) · PLoS Biology · doi:10.1371/journal.pbio.1000344 · Cited by 600
A review of brain aromatase cytochrome P450
LEPHART, E. (1996) · Brain Research Reviews · doi:10.1016/0165-0173(96)00002-1 · Cited by 505
Ideal homes? Housing effects on rodent brain and behaviour
Würbel, H. (2001) · Trends in Neurosciences · doi:10.1016/s0166-2236(00)01718-5 · Cited by 471
Hematopoietic origin of pathological grooming in Hoxb8 mutant mice
Chen, S.-K., Tvrdik, P., Peden, E., Cho, S., Wu, S., Spangrude, G., & Capecchi, M. R. (2010) · Cell · doi:10.1016/j.cell.2010.03.055 · Cited by 450
Grant, J. E., Odlaug, B. L., & Won Kim, S. (2009) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2009.60 · Cited by 424
Hoxb8 Is Required for Normal Grooming Behavior in Mice
Greer, J. M., & Capecchi, M. R. (2002) · Neuron · doi:10.1016/s0896-6273(01)00564-5 · Cited by 401
Shmelkov, S. V., Hormigo, A., Jing, D., Proenca, C. C., Bath, K. G., Milde, T., Shmelkov, E., Kushner, J. S., Baljevic, M., Dincheva, I., et al. (2010) · Nature Medicine · doi:10.1038/nm.2125 · Cited by 361
Macleod, M. R., van der Worp, H. B., Sena, E. S., Howells, D. W., Dirnagl, U., & Donnan, G. A. (2008) · Stroke · doi:10.1161/strokeaha.108.515957 · Cited by 319
GARNER, J., THOGERSON, C., WURBEL, H., MURRAY, J., & MENCH, J. (2006) · Behavioural Brain Research · doi:10.1016/j.bbr.2006.06.002 · Cited by 147
Whole animal experiments should be more like human randomized controlled trials
Muhlhausler, B. S., Bloomfield, F. H., & Gillman, M. W. (2013) · PLoS Biology · doi:10.1371/journal.pbio.1001481 · Cited by 105
From Animal Models to Model Animals
Insel, T. R. (2007) · Biological Psychiatry · doi:10.1016/j.biopsych.2007.10.001 · Cited by 98
Yee, J. R., Cavigelli, S. A., Delgado, B., & McClintock, M. K. (2008) · Psychosomatic Medicine · doi:10.1097/psy.0b013e31818425fb · Cited by 96
Reverse translational strategies for developing animal models of bipolar disorder
Malkesman, O., Austin, D. R., Chen, G., & Manji, H. K. (2009) · Disease Models & Mechanisms · doi:10.1242/dmm.001628 · Cited by 70
Cited by
Updating Animal Welfare Thinking: Moving beyond the “Five Freedoms” towards “A Life Worth Living”
Mellor, D. (2016) · Animals · doi:10.3390/ani6030021 · Cited by 948
PREPARE: guidelines for planning animal research and testing
Smith, A. J., Clutton, R. E., Lilley, E., Hansen, K. E. A., & Brattelid, T. (2018) · Laboratory Animals · doi:10.1177/0023677217724823 · Cited by 587
Reproducibility of animal research in light of biological variation
Voelkl, B., Altman, N. S., Forsman, A., Forstmeier, W., Gurevitch, J., Jaric, I., Karp, N. A., Kas, M. J., Schielzeth, H., Van de Casteele, T., et al. (2020) · Nature Reviews Neuroscience · doi:10.1038/s41583-020-0313-3 · Cited by 390
Animal to human translation: a systematic scoping review of reported concordance rates
Leenaars, C. H. C., Kouwenaar, C., Stafleu, F. R., Bleich, A., Ritskes-Hoitinga, M., De Vries, R. B. M., & Meijboom, F. L. B. (2019) · Journal of Translational Medicine · doi:10.1186/s12967-019-1976-2 · Cited by 314
Carbone, L., & Austin, J. (2016) · PLOS ONE · doi:10.1371/journal.pone.0155001 · Cited by 191
Metadata
- Authors
- Garner, J. P.
- Venue
- ILAR Journal
- Publisher
- Oxford University Press (OUP)
- Published
- 2014-12-20
- Volume
- 55
- Issue
- 3
- Pages
- 438-456
- ISSN
- 1084-2020 (ISSN-L)
- OpenAlex
- W2078662547
- Cited by
- 221
- References
- 40
- FWCI
- 15.34
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.