The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Reliability, robustness, and reproducibility in mouse behavioral phenotyping: a cross-laboratory study
Open accessAbstract
Establishing standard operating procedures (SOPs) as tools for the analysis of behavioral phenotypes is fundamental to mouse functional genomics. It is essential that the tests designed provide reliable measures of the process under investigation but most importantly that these are reproducible across both time and laboratories. For this reason, we devised and tested a set of SOPs to investigate mouse behavior. Five research centers were involved across France, Germany, Italy, and the UK in this study, as part of the EUMORPHIA program. All the procedures underwent a cross-validation experimental study to investigate the robustness of the designed protocols. Four inbred reference strains (C57BL/6J, C3HeB/FeJ, BALB/cByJ, 129S2/SvPas), reflecting their use as common background strains in mutagenesis programs, were analyzed to validate these tests. We demonstrate that the operating procedures employed, which includes open field, SHIRPA, grip-strength, rotarod, Y-maze, prepulse inhibition of acoustic startle response, and tail flick tests, generated reproducible results between laboratories for a number of the test output parameters. However, we also identified several uncontrolled variables that constitute confounding factors in behavioral phenotyping. The EUMORPHIA SOPs described here are an important start-point for the ongoing development of increasingly robust phenotyping platforms and their application in large-scale, multicentre mouse phenotyping programs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A METHOD FOR DETERMINING LOSS OF PAIN SENSATION
D'AMOUR, F. E., & SMITH, D. L. (1941) · The Journal of Pharmacology and Experimental Therapeutics · doi:10.1016/s0022-3565(25)03823-6 · Cited by 3,231
Dunham, N. W., & Miya, T. S. (1957) · Journal of the American Pharmaceutical Association (Scientific ed.) · doi:10.1002/jps.3030460322 · Cited by 1,716
Genetics of Mouse Behavior: Interactions with Laboratory Environment
Crabbe, J. C., Wahlsten, D., & Dudek, B. C. (1999) · Science · doi:10.1126/science.284.5420.1670 · Cited by 1,666
Crawley, J. N., Belknap, J. K., Collins, A., Crabbe, J. C., Frankel, W., Henderson, N., Hitzemann, R. J., Maxson, S. C., Miner, L. L., Silva, A. J., et al. (1997) · Psychopharmacology · doi:10.1007/s002130050327 · Cited by 1,372
Crawley, J. N. (1999) · Brain Research · doi:10.1016/s0006-8993(98)01258-x · Cited by 761
Carola, V., D'Olimpio, F., Brunamonti, E., Mangia, F., & Renzi, P. (2002) · Behavioural Brain Research · doi:10.1016/s0166-4328(01)00452-1 · Cited by 735
Nolan, P. M., Peters, J., Strivens, M., Rogers, D., Hagan, J., Spurr, N., Gray, I. C., Vizor, L., Brooker, D., Whitehill, E., et al. (2000) · Nature Genetics · doi:10.1038/78140 · Cited by 654
Self-citationThe Comprehensive Knockout Mouse Project Consortium (2004) · Nature Genetics · doi:10.1038/ng0904-921 · Cited by 608
The use of behavioral test batteries: Effects of training history
McIlwain, K. L., Merriweather, M. Y., Yuva-Paylor, L. A., & Paylor, R. (2001) · Physiology & Behavior · doi:10.1016/s0031-9384(01)00528-5 · Cited by 579
Sarter, M., Bodewitz, G., & Stephens, D. N. (1988) · Psychopharmacology · doi:10.1007/bf00212843 · Cited by 530
Behavioral phenotyping strategies for mutant mice
Crawley, J. N. (2008) · Neuron · doi:10.1016/j.neuron.2008.03.001 · Cited by 439
Strain and gender differences in the behavior of mouse lines commonly used in transgenic studies
Võikar, V., Kõks, S., Vasar, E., & Rauvala, H. (2001) · Physiology & Behavior · doi:10.1016/s0031-9384(00)00405-4 · Cited by 416
A method for the routine assessment of fore- and hindlimb grip strength of rats and mice.
Oa, M., Ha, T., Wc, B., & Mt, R. (1979) · PubMed · Cited by 415
Inbred strain differences in prepulse inhibition of the mouse startle response
Paylor, R., & Crawley, J. N. (1997) · Psychopharmacology · doi:10.1007/s002130050333 · Cited by 379
Chesler, E. J., Wilson, S. G., Lariviere, W. R., Rodriguez-Zas, S. L., & Mogil, J. S. (2002) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(02)00103-3 · Cited by 331
Models of Nociception: Hot‐Plate, Tail‐Flick, and Formalin Tests in Rodents
Bannon, A. W., & Malmberg, A. B. (2007) · Current Protocols in Neuroscience · doi:10.1002/0471142301.ns0809s41 · Cited by 316
Rogers, D. C., Jones, D. N. C., Nelson, P. R., Jones, C. M., Quilter, C. A., Robinson, T. L., & Hagan, J. J. (1999) · Behavioural Brain Research · doi:10.1016/s0166-4328(99)00072-8 · Cited by 294
Meziane, H., Ouagazzal, A. ‐., Aubert, L., Wietrzych, M., & Krezel, W. (2007) · Genes, Brain and Behavior · doi:10.1111/j.1601-183x.2006.00249.x · Cited by 259
Self-citationThe use of behavioral test batteries, II: Effect of test interval
PAYLOR, R., SPENCER, C., YUVAPAYLOR, L., & PIEKEDAHL, S. (2006) · Physiology & Behavior · doi:10.1016/j.physbeh.2005.09.002 · Cited by 243
Behaviour and the standardization fallacy
Würbel, H. (2000) · Nature Genetics · doi:10.1038/81541 · Cited by 234
Neurobehavioral assessment in the information age
Tecott, L. H., & Nestler, E. J. (2004) · Nature Neuroscience · doi:10.1038/nn1225 · Cited by 217
Võikar, V., Vasar, E., & Rauvala, H. (2004) · Genes, Brain and Behavior · doi:10.1046/j.1601-183x.2003.0044.x · Cited by 211
Behavioral and physiological mouse assays for anxiety: a survey in nine mouse strains
Bouwknecht, J. A., & Paylor, R. (2002) · Behavioural Brain Research · doi:10.1016/s0166-4328(02)00200-0 · Cited by 209
Rogers, D. C., Peters, J., Martin, J. E., Ball, S., Nicholson, S. J., Witherden, A. S., Hafezparast, M., Latcham, J., Robinson, T. L., Quilter, C. A., et al. (2001) · Neuroscience Letters · doi:10.1016/s0304-3940(01)01885-7 · Cited by 199 · cited 1×
“The SHIRPA battery consists of a comprehensive observational phenotypic analysis of the mouse based on a systematic assessment of behavioral and neurological parameters (30, 35 ).”
MethodThe European dimension for the mouse genome mutagenesis program
The European Mouse Mutagenesis Consortium (2004) · Nature Genetics · doi:10.1038/ng0904-925 · Cited by 197
Effects of cytotoxic hippocampal lesions in mice on a cognitive test battery
Deacon, R. M. J., Bannerman, D. M., Kirby, B. P., Croucher, A., & Rawlins, J. N. P. (2002) · Behavioural Brain Research · doi:10.1016/s0166-4328(01)00451-x · Cited by 189
Phenomics: fiction or the future?
Gerlai, R. (2002) · Trends in Neurosciences · doi:10.1016/s0166-2236(02)02250-6 · Cited by 183
Influence of task parameters on rotarod performance and sensitivity to ethanol in mice
Rustay, N. R., Wahlsten, D., & Crabbe, J. C. (2003) · Behavioural Brain Research · doi:10.1016/s0166-4328(02)00376-5 · Cited by 182
Behavioral phenotyping enhanced – beyond (environmental) standardization
Würbel, H. (2002) · Genes, Brain and Behavior · doi:10.1046/j.1601-1848.2001.00006.x · Cited by 182
GALSWORTHY, M., AMREIN, I., KUPTSOV, P., POLETAEVA, I., ZINN, P., RAU, A., VYSSOTSKI, A., & LIPP, H. (2005) · Behavioural Brain Research · doi:10.1016/j.bbr.2004.06.021 · Cited by 171
Standardizing tests of mouse behavior: Reasons, recommendations, and reality
Wahlsten, D. (2001) · Physiology & Behavior · doi:10.1016/s0031-9384(01)00527-3 · Cited by 165
EMPReSS: standardized phenotype screens for functional annotation of the mouse genome
The Eumorphia Consortium, Brown, S. D. M., Chambon, P., & de Angelis, M. H. (2005) · Nature Genetics · doi:10.1038/ng1105-1155 · Cited by 159
Self-citationBehavior and mutagenesis screens: The importance of baseline analysis of inbred strains
Tarantino, L. M., Gould, T. J., Druhan, J. P., & Bucan, M. (2000) · Mammalian Genome · doi:10.1007/s003350010107 · Cited by 158
Ducottet, C., & Belzung, C. (2004) · Behavioural Brain Research · doi:10.1016/j.bbr.2004.05.018 · Cited by 152
Augustsson, H., & Meyerson, B. J. (2004) · Physiology & Behavior · doi:10.1016/j.physbeh.2004.03.014 · Cited by 146
Differences among eight inbred strains of mice in motor ability and motor learning on a rotorod
Leussis, M. P., Kusek, G. K., Bolivar, V. J., & Flaherty, L. (2003) · Genes Brain & Behavior · doi:10.1034/j.1601-183x.2003.00028.x · Cited by 146
Behavioural performance in three substrains of mouse strain 129
Montkowski, A., Poettig, M., Mederer, A., & Holsboer, F. (1997) · Brain Research · doi:10.1016/s0006-8993(97)00370-3 · Cited by 145
Measuring pain in the (knockout) mouse: big challenges in a small mammal
Wilson, S. G., & Mogil, J. S. (2001) · Behavioural Brain Research · doi:10.1016/s0166-4328(01)00281-9 · Cited by 132
Wolfer, D. P., Müller, U., Stagljar, M., & Lipp, H. (1997) · Brain Research · doi:10.1016/s0006-8993(97)00673-2 · Cited by 129
Ouagazzal, A., Jenck, F., & Moreau, J.-L. (2001) · Psychopharmacology · doi:10.1007/s002130100763 · Cited by 126
Self-citationWall, P. M., & Messier, C. (2002) · Psychopharmacology · doi:10.1007/s00213-001-0979-9 · Cited by 121
The fallacy of behavioral phenotyping without standardisation
van der Staay, F. J., & Steckler, T. (2002) · Genes Brain & Behavior · doi:10.1046/j.1601-1848.2001.00007.x · Cited by 98
Understanding Mammalian Genetic Systems: The Challenge of Phenotyping in the Mouse
Brown, S. D. M., Hancock, J. M., & Gates, H. (2006) · PLoS Genetics · doi:10.1371/journal.pgen.0020118 · Cited by 88
Self-citationMorice, É., Denis, C., Giros, B., & Nosten‐Bertrand, M. (2004) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2004.03465.x · Cited by 85
Dissecting complex behaviours in the post-genomic era
Kas, M. J., & van Ree, J. M. (2004) · Trends in Neurosciences · doi:10.1016/j.tins.2004.04.011 · Cited by 69
Dam, D. V., Vloeberghs, E., Abramowski, D., Staufenbiel, M., & Deyn, P. P. D. (2005) · CNS Spectrums · doi:10.1017/s1092852900010051 · Cited by 67
Infralimbic D2 receptor influences on anxiety-like behavior and active memory/attention in CD-1 mice
Wall, P. M., Blanchard, R. J., Yang, M., & Blanchard, D. C. (2003) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/s0278-5846(02)00356-1 · Cited by 58
Effects of Dynorphin A (1-13) on Carbon Monoxide-Induced Delayed Amnesia in Mice
Hiramatsu, M., Sasaki, M., NABESHIMA, T., & Kameyama, T. (1997) · Pharmacology Biochemistry and Behavior · doi:10.1016/s0091-3057(96)00159-1 · Cited by 54
Gene-environment interactions differentially affect mouse strain behavioral parameters
Tucci, V., Lad, H. V., Parker, A., Polley, S., Brown, S. D. M., & Nolan, P. M. (2006) · Mammalian Genome · doi:10.1007/s00335-006-0075-x · Cited by 46
Self-citationBouwknecht, J. A., van der Gugten, J., Groenink, L., Olivier, B., & Paylor, R. E. (2004) · European Journal of Pharmacology · doi:10.1016/j.ejphar.2004.04.036 · Cited by 45
Mogil, J. S., Nessim, L., & Wilson, S. G. (1999) · Neuroscience Letters · doi:10.1016/s0304-3940(99)00012-9 · Cited by 34
A new method for quantitative grip strength evaluation
van Riezen, H., & Boersma, L. (1969) · European Journal of Pharmacology · doi:10.1016/0014-2999(69)90197-6 · Cited by 20
Behavioral and Neurological Phenotyping in the Mouse
Tucci, V., Blanco, G., & Nolan, P. M. (2006) · Wiley eBooks · doi:10.1002/9783527611942.ch6 · Cited by 4
Self-citation
Cited by
The metabolic footprint of aging in mice
Houtkooper, R. H., Argmann, C., Houten, S. M., Cantó, C., Jeninga, E. H., Andreux, P. A., Thomas, C., Doenlen, R., Schoonjans, K., & Auwerx, J. (2011) · Scientific Reports · doi:10.1038/srep00134 · Cited by 528
Self-citationEnvironmental standardization: cure or cause of poor reproducibility in animal experiments?
Richter, S. H., Garner, J. P., & Würbel, H. (2009) · Nature Methods · doi:10.1038/nmeth.1312 · Cited by 422
Cannabidiol attenuates seizures and social deficits in a mouse model of Dravet syndrome
Kaplan, J. S., Stella, N., Catterall, W. A., & Westenbroek, R. E. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1711351114 · Cited by 378
A Comprehensive Behavioral Test Battery to Assess Learning and Memory in 129S6/Tg2576 Mice
Wolf, A., Bauer, B., Abner, E. L., Ashkenazy-Frolinger, T., & Hartz, A. M. S. (2016) · PLOS ONE · doi:10.1371/journal.pone.0147733 · Cited by 281
“…in learning memory (Morris and radial arm water maze), working memory (alternation), object discrimination (novel object recognition), spatial memory (Morris and radial arm water maze), long-term memory (radial arm water maze), and episodic-like memory (radial arm water maze) [24, 29, 35, 51 – 53].”
BackgroundWeissbrod, A., Shapiro, A., Vasserman, G., Edry, L., Dayan, M., Yitzhaky, A., Hertzberg, L., Feinerman, O., & Kimchi, T. (2013) · Nature Communications · doi:10.1038/ncomms3018 · Cited by 235
Metadata
- Authors
- Mandillo, S., Tucci, V., Hölter, S. M., Meziane, H., Banchaabouchi, M. A., Kallnik, M., Lad, H. V., Nolan, P. M., Ouagazzal, A.-M., Coghill, E. L., Gale, K., Golini, E., Jacquot, S., Krezel, W., Parker, A., Riet, F., Schneider, I., Marazziti, D., Auwerx, J., Brown, S. D. M., Chambon, P., Rosenthal, N., Tocchini-Valentini, G., & Wurst, W.
- Venue
- Physiological Genomics
- Publisher
- American Physiological Society
- Published
- 2008-08
- Volume
- 34
- Issue
- 3
- Pages
- 243-255
- ISSN
- 1094-8341 (ISSN-L)
- 1531-2267
- OpenAlex
- W2145913238
- Cited by
- 282
- References
- 53
- FWCI
- 21.02
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.