The DOI matches its Crossref record; 79 of the 79 references it cites were found in a registry or an index.
Different data from different labs: Lessons from studies of gene–environment interaction
Open accessAbstract
It is sometimes supposed that standardizing tests of mouse behavior will ensure similar results in different laboratories. We evaluated this supposition by conducting behavioral tests with identical apparatus and test protocols in independent laboratories. Eight genetic groups of mice, including equal numbers of males and females, were either bred locally or shipped from the supplier and then tested on six behaviors simultaneously in three laboratories (Albany, NY; Edmonton, AB; Portland, OR). The behaviors included locomotor activity in a small box, the elevated plus maze, accelerating rotarod, visible platform water escape, cocaine activation of locomotor activity, and ethanol preference in a two‐bottle test. A preliminary report of this study presented a conventional analysis of conventional measures that revealed strong effects of both genotype and laboratory as well as noteworthy interactions between genotype and laboratory. We now report a more detailed analysis of additional measures and view the data for each test in different ways. Whether mice were shipped from a supplier or bred locally had negligible effects for almost every measure in the six tests, and sex differences were also absent or very small for most behaviors, whereas genetic effects were almost always large. For locomotor activity, cocaine activation, and elevated plus maze, the analysis demonstrated the strong dependence of genetic differences in behavior on the laboratory giving the tests. For ethanol preference and water escape learning, on the other hand, the three labs obtained essentially the same results for key indicators of behavior. Thus, it is clear that the strong dependence of results on the specific laboratory is itself dependent on the task in question. Our results suggest that there may be advantages of test standardization, but laboratory environments probably can never be made sufficiently similar to guarantee identical results on a wide range of tests in a wide range of labs. Interpretations of our results by colleagues in neuroscience as well as the mass media are reviewed. Pessimistic views, prevalent in the media but relatively uncommon among neuroscientists, of mouse behavioral tests as being highly unreliable are contradicted by our data. Despite the presence of noteworthy interactions between genotype and lab environment, most of the larger differences between inbred strains were replicated across the three labs. Strain differences of moderate effects size, on the other hand, often differed markedly among labs, especially those involving three 129‐derived strains. Implications for behavioral screening of targeted and induced mutations in mice are discussed. © 2003 Wiley Periodicals, Inc. J Neurobiol 54: 283–311, 2003
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Controlling the false discovery rate in behavior genetics research
Benjamini, Y., Drai, D., Elmer, G., Kafkafi, N., & Golani, I. (2001) · Behavioural Brain Research · doi:10.1016/s0166-4328(01)00297-2 · Cited by 4,146
Genetics of Mouse Behavior: Interactions with Laboratory Environment
Crabbe, J. C., Wahlsten, D., & Dudek, B. C. (1999) · Science · doi:10.1126/science.284.5420.1670 · Cited by 1,666
Self-citationCrawley, J. N., Belknap, J. K., Collins, A., Crabbe, J. C., Frankel, W., Henderson, N., Hitzemann, R. J., Maxson, S. C., Miner, L. L., Silva, A. J., et al. (1997) · Psychopharmacology · doi:10.1007/s002130050327 · Cited by 1,372
Self-citationIrwin, S. (1968) · Psychopharmacologia · doi:10.1007/bf00401402 · Cited by 1,234
A review of the validity and variability of the Elevated Plus-Maze as an animal model of anxiety
Hogg, S. (1996) · Pharmacology Biochemistry and Behavior · doi:10.1016/0091-3057(95)02126-4 · Cited by 1,164
Anxiety, defence and the elevated plus-maze
Rodgers, R. J., & Dalvi, A. (1997) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(96)00058-9 · Cited by 991
(2000) · Cited by 919
Bale, T. L., Contarino, A., Smith, G. W., Chan, R., Gold, L. H., Sawchenko, P. E., Koob, G. F., Vale, W. W., & Lee, K.-F. (2000) · Nature Genetics · doi:10.1038/74263 · Cited by 849
Rogers, D. C., Fisher, E. M. C., Brown, S. D. M., Peters, J., Hunter, A. J., & Martin, J. E. (1997) · Mammalian Genome · doi:10.1007/s003359900551 · Cited by 795
Reflex-ontogeny and behavioural development of the mouse
Fox, W. M. (1965) · Animal Behaviour · doi:10.1016/0003-3472(65)90041-2 · Cited by 697
Genetic variation among 129 substrains and its importance for targeted mutagenesis in mice
Simpson, E. M., Linder, C. C., Sargent, E. E., Davisson, M. T., Mobraaten, L. E., & Sharp, J. J. (1997) · Nature Genetics · doi:10.1038/ng0597-19 · Cited by 686
Alcohol and aldehyde dehydrogenase genotypes and alcoholism in Chinese men.
Thomasson, H. R., Edenberg, H. J., Crabb, D. W., L, X., Jerome, R. E., Li, T., Wang, S. P., Lin, Y. T., Lu, R., & Yin, S. (1991) · PubMed · Cited by 612
Coste, S. C., Kesterson, R. A., Heldwein, K. A., Stevens, S. L., Heard, A. D., Hollis, J. H., Murray, S. E., Hill, J. K., Pantely, G. A., Hohimer, A. R., et al. (2000) · Nature Genetics · doi:10.1038/74255 · Cited by 590
Self-citationThe use of behavioral test batteries: Effects of training history
McIlwain, K. L., Merriweather, M. Y., Yuva-Paylor, L. A., & Paylor, R. (2001) · Physiology & Behavior · doi:10.1016/s0031-9384(01)00528-5 · Cited by 579
Crawley, J. N., & Paylor, R. (1997) · Hormones and Behavior · doi:10.1006/hbeh.1997.1382 · Cited by 553
Deletion of Crhr2 reveals an anxiolytic role for corticotropin-releasing hormone receptor-2
Kishimoto, T., Radulovic, J., Radulovic, M., Lin, C. R., Schrick, C., Hooshmand, F., Hermanson, O., Rosenfeld, M. G., & Spiess, J. (2000) · Nature Genetics · doi:10.1038/74271 · Cited by 502
Gottlieb, G. (1998) · Psychological Review · doi:10.1037/0033-295x.105.4.792-802 · Cited by 489
Insensitivity of the analysis of variance to heredity-environment interaction
Wahlsten, D. (1990) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00077797 · Cited by 468
Self-citationDifferences in Alcohol Preference among Inbred Strains of Mice
McClearn, G. E., & Rodgers, D. A. (1959) · Quarterly Journal of Studies on Alcohol · doi:10.15288/qjsa.1959.20.691 · Cited by 454
Elevated alcohol consumption in null mutant mice lacking 5–HT1B serotonin receptors
Crabbe, J. C., Phillips, T. J., Feller, D. J., Hen, R., Wenger, C. D., Lessov, C. N., & Schafer, G. L. (1996) · Nature Genetics · doi:10.1038/ng0996-98 · Cited by 360
Self-citationIntelligence, heredity and environment
Vernon, P. E. (1979) · DigitalGeorgetown (Georgetown University Library) · Cited by 336
Intelligence, Heredity and Environment
(1996) · Cambridge University Press eBooks · doi:10.1017/cbo9781139174282 · Cited by 336
Rogers, D. C., Jones, D. N. C., Nelson, P. R., Jones, C. M., Quilter, C. A., Robinson, T. L., & Hagan, J. J. (1999) · Behavioural Brain Research · doi:10.1016/s0166-4328(99)00072-8 · Cited by 294
Localization of Genes Affecting Alcohol Drinking in Mice
Phillips, T. J., Crabbe, J. C., Metten, P., & Belknap, J. K. (1994) · Alcoholism: Clinical and Experimental Research · doi:10.1111/j.1530-0277.1994.tb00062.x · Cited by 291
Self-citationWhen Left-Handed Mice Live in Right-Handed Worlds
Collins, R. L. (1975) · Science · doi:10.1126/science.1111097 · Cited by 272
Borràs, E., Coutelle, C., Rosell, A., Fernández-Muixi, F., Broch, M., Crosas, B., Hjelmqvist, L., Lorenzo, A., Gutiérrez, C., Santos, M., et al. (2000) · Hepatology · doi:10.1053/he.2000.5978 · Cited by 256
Behaviour and the standardization fallacy
Würbel, H. (2000) · Nature Genetics · doi:10.1038/81541 · Cited by 234
Paigen, K., & Eppig, J. T. (2000) · Mammalian Genome · doi:10.1007/s003350010152 · Cited by 219
Genetic Contributions to Addiction
Crabbe, J. C. (2002) · Annual Review of Psychology · doi:10.1146/annurev.psych.53.100901.135142 · Cited by 203
Self-citationBehavioral phenotyping enhanced – beyond (environmental) standardization
Würbel, H. (2002) · Genes, Brain and Behavior · doi:10.1046/j.1601-1848.2001.00006.x · Cited by 182
Genes, interactions, and the development of behavior.
Johnston, T. D., & Edwards, L. (2002) · Psychological Review · doi:10.1037//0033-295x.109.1.26 · Cited by 181
Yerkes, R. M. (1907) · The Macmillan company eBooks · doi:10.5962/bhl.title.30106 · Cited by 177
Plomin, R. J., & Crabbe, J. C. (2000) · Psychological Bulletin · doi:10.1037/0033-2909.126.6.806 · Cited by 172
Self-citationTurri, M. G., Datta, S. R., DeFries, J., Henderson, N. D., & Flint, J. (2001) · Current Biology · doi:10.1016/s0960-9822(01)00206-8 · Cited by 169
Standardizing tests of mouse behavior: Reasons, recommendations, and reality
Wahlsten, D. (2001) · Physiology & Behavior · doi:10.1016/s0031-9384(01)00527-3 · Cited by 165
Self-citationGenetic basis of anxiety-like behaviour: a critical review
Clément, Y., Calatayud, F., & Belzung, C. (2002) · Brain Research Bulletin · doi:10.1016/s0361-9230(01)00637-2 · Cited by 164
Behavior and mutagenesis screens: The importance of baseline analysis of inbred strains
Tarantino, L. M., Gould, T. J., Druhan, J. P., & Bucan, M. (2000) · Mammalian Genome · doi:10.1007/s003350010107 · Cited by 158
Complications associated with genetic background effects in research using knockout mice
Phillips, T. J., Hen, R., & Crabbe, J. C. (1999) · Psychopharmacology · doi:10.1007/s002130051128 · Cited by 154
Self-citationSEE: a tool for the visualization and analysis of rodent exploratory behavior
Drai, D., & Golani, I. (2001) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(01)00022-7 · Cited by 150
The inheritance of behavior: behavioural differences in fifteen mouse strains.
Thompson, W. R. (1953) · Canadian Journal of Psychology/Revue Canadienne de Psychologie · doi:10.1037/h0083586 · Cited by 139
Pennisi, E. (2002) · Science · doi:10.1126/science.295.5557.1011 · Cited by 132
Electroconvulsive Thresholds of Inbred Mouse Strains
Frankel, W. N., Taylor, L. J., Beyer, B. J., Tempel, B. L., & White, H. S. (2001) · Genomics · doi:10.1006/geno.2001.6564 · Cited by 129
Genes, Experience, and Chance in Schizophrenia--Positioning for the 21st Century
Moldin, S. O., & Gottesman, I. I. (1997) · Schizophrenia Bulletin · doi:10.1093/schbul/23.4.547 · Cited by 124
Genetic influences on the behavior of mice can be obscured by laboratory rearing.
Henderson, N. D. (1970) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0029743 · Cited by 122
Modulation of the effects of cocaine by 5-HT1B receptors: a comparison of knockouts and antagonists
Castanon, N., Scearce-Levie, K. A., Lucas, J. J., Rocha, B. A. G., & Hen, R. (2000) · Pharmacology Biochemistry and Behavior · doi:10.1016/s0091-3057(00)00389-0 · Cited by 108
Self-citationMeasurement of alcohol preference in genetic experiments.
Fuller, J. L. (1964) · Journal of Comparative and Physiological Psychology · doi:10.1037/h0043100 · Cited by 101
Gene targeting: technical confounds and potential solutions in behavioral brain research
Gerlai, R. T. (2001) · Behavioural Brain Research · doi:10.1016/s0166-4328(01)00282-0 · Cited by 101
Aldehyde dehydrogenase isozyme variation and alcoholism in Japan
Harada, S., Agarwal, D. P., GOEDDE, H. W., & Ishikawa, B. (1983) · Pharmacology Biochemistry and Behavior · doi:10.1016/0091-3057(83)90163-6 · Cited by 99
The fallacy of behavioral phenotyping without standardisation
van der Staay, F. J., & Steckler, T. (2002) · Genes Brain & Behavior · doi:10.1046/j.1601-1848.2001.00007.x · Cited by 98
SINGLE-GENE INFLUENCES ON BRAIN AND BEHAVIOR
Wahłsten, D. (1999) · Annual Review of Psychology · doi:10.1146/annurev.psych.50.1.599 · Cited by 86
Harnessing the mouse to unravel the genetics of human disease
Phillips, T. J., Belknap, J. K., Hitzemann, R., Buck, K. J., Cunningham, C. L., & Crabbe, J. C. (2002) · Genes Brain & Behavior · doi:10.1046/j.1601-1848.2001.00011.x · Cited by 82
Self-citationDeveloping Standardized Behavioral Tests for Knockout and Mutant Mice
Brown, R. E., Stanford, L. E., & Schellinck, H. M. (2000) · ILAR Journal · doi:10.1093/ilar.41.3.163 · Cited by 76
List of transgenic and knockout mice: behavioral profiles
Bolivar, V. J., Cook, M. N., & Flaherty, L. A. (2000) · Mammalian Genome · doi:10.1007/s003350010051 · Cited by 76
Interstrain differences in aggressive behavior and exploratory activity of inbred mice.
Southwick, C. H., & Clark, L. H. (1968) · The Mouseion at the JAXlibrary (Jackson Laboratory) · Cited by 71
Boehm, S. L., Schafer, G. L., Phillips, T. J., Browman, K. E., & Crabbe, J. C. (2000) · Behavioral Neuroscience · doi:10.1037/0735-7044.114.2.401 · Cited by 70
Self-citationThe dancing mouse: A study in animal behavior.
Yerkes, R. M. (1907) · MacMillan Co eBooks · doi:10.1037/10935-000 · Cited by 68
Transgenic and knockout databases
Anagnostopoulos, A. V., Mobraaten, L. E., Sharp, J. J., & Davisson, M. T. (2001) · Physiology & Behavior · doi:10.1016/s0031-9384(01)00525-x · Cited by 64
Warburton, D. M. (2002) · Psychopharmacology · doi:10.1007/s00213-002-1119-x · Cited by 59
Motor learning in Ts65Dn mice, a model for Down syndrome
Hyde, L. A., Crnic, L. S., Pollock, A., & Bickford, P. C. (2000) · Developmental Psychobiology · doi:10.1002/1098-2302(2001)38:1<33::aid-dev3>3.0.co;2-0 · Cited by 58
Quantitative Genetics and Mouse Behavior
Wehner, J. M., Radcliffe, R. A., & Bowers, B. J. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.845 · Cited by 58
The invalid separation of effects of nature and nurture: Lessons from animal experimentation
Wahłsten, D., & Gottlieb, G. (1996) · Cambridge University Press eBooks · doi:10.1017/cbo9781139174282.007 · Cited by 56
Complex-trait genetics: emergence of multivariate strategies
Phillips, T. J., & Belknap, J. K. (2002) · Nature reviews. Neuroscience · doi:10.1038/nrn847 · Cited by 49
Self-citationEthanol intake is not elevated in male 5-HT1B receptor knockout mice
Bouwknecht, J. A., Hijzen, T. H., van der Gugten, J., Maes, R. A. A., Hen, R., & Olivier, B. (2000) · European Journal of Pharmacology · doi:10.1016/s0014-2999(00)00527-6 · Cited by 36
Self-citationTrans-NIH neuroscience initiatives on mouse phenotyping and mutagenesis
Moldin, S. O., Farmer, M. E., Chin, H. R., & Battey, J. F. (2001) · Mammalian Genome · doi:10.1007/s00335-001-4005-7 · Cited by 35
Wahłsten, D., Crabbe, J. C., & Dudek, B. C. (2001) · Behavioural Brain Research · doi:10.1016/s0166-4328(01)00283-2 · Cited by 33
Self-citationUse of Genetic Analyses to Refine Phenotypes Related to Alcohol Tolerance and Dependence
Crabbe, J. C. (2001) · Alcoholism Clinical and Experimental Research · doi:10.1111/j.1530-0277.2001.tb02211.x · Cited by 33
Self-citationMethods in Genomic Neuroscience
(2001) · CRC Press eBooks · doi:10.1201/9781420038477 · Cited by 30
Hierarchical strategy for phenotypic analysis in mice
Gold, L. H. (1999) · Psychopharmacology · doi:10.1007/s002130051127 · Cited by 24
Mouse genetic model for left-right hand usage: Context, direction, norms of reaction, and memory
Biddle, F. G., & Eales, B. A. (1999) · Genome · doi:10.1139/g99-078 · Cited by 21
Gene-Environment Interaction and Complex Behavior
Sokolowski, M. B., & Wahłsten, D. (2001) · CRC Press eBooks · doi:10.1201/9781420038477-2 · Cited by 19
Gene–Environment Interaction and Complex Behavior
Sokolowski, M. B., & Wahłsten, D. (2001) · Frontiers in neuroscience · doi:10.1201/9781420038477.sec1 · Cited by 16
Bowers, B. J., Collins, A. C., & Wehner, J. M. (2000) · Addiction Biology · doi:10.1080/13556210071261 · Cited by 14
Testing the Genetics of Behavior in Mice
Picciotto, M. R., & Self, D. W. (1999) · Science · doi:10.1126/science.285.5436.2067d · Cited by 13
Fickle Mice Highlight Test Problems
Enserink, M. (1999) · Science · doi:10.1126/science.284.5420.1599a · Cited by 11
Testing the genetics of behavior in mice.
Dawson, G. R., Flint, J., & Wilkinson, L. S. (1999) · PubMed · Cited by 11
Behavioral genetics: Anxiety under interrogation
Toye, A. A., & Cox, R. (2001) · Current Biology · doi:10.1016/s0960-9822(01)00285-8 · Cited by 8
Sapolsky, R. M. (2000) · The Sciences · doi:10.1002/j.2326-1951.2000.tb03474.x · Cited by 6
Cited by
The use of the elevated plus maze as an assay of anxiety-related behavior in rodents
Walf, A. A., & Frye, C. A. (2007) · Nature Protocols · doi:10.1038/nprot.2007.44 · Cited by 3,035
Cryan, J. F., Mombereau, C., & Vassout, A. (2005) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2005.03.009 · Cited by 1,674
The ascent of mouse: advances in modelling human depression and anxiety
Cryan, J. F., & Holmes, A. (2005) · Nature Reviews Drug Discovery · doi:10.1038/nrd1825 · Cited by 1,198
Forced swimming test in mice: A review of antidepressant activity
Petit-Demouliere, B., Chenu, F., & Bourin, M. (2005) · Psychopharmacology · doi:10.1007/s00213-004-2048-7 · Cited by 1,003
Zebrafish models for translational neuroscience research: from tank to bedside
Stewart, A. M., Braubach, O., Spitsbergen, J., Gerlai, R., & Kalueff, A. V. (2014) · Trends in Neurosciences · doi:10.1016/j.tins.2014.02.011 · Cited by 704
Metadata
- Authors
- Wahlsten, D., Metten, P., Phillips, T. J., Boehm, S. L., Burkhart‐Kasch, S., Dorow, J., Doerksen, S., Downing, C., Fogarty, J., Rodd‐Henricks, K., Hen, R., McKinnon, C. S., Merrill, C. M., Nolte, C., Schalomon, M., Schlumbohm, J. P., Sibert, J. R., Wenger, C. D., Dudek, B. C., & Crabbe, J. C.
- Venue
- Journal of Neurobiology
- Publisher
- Wiley
- Published
- 2002-12-16
- Volume
- 54
- Issue
- 1
- Pages
- 283-311
- ISSN
- 0022-3034 (ISSN-L)
- 1097-4695
- OpenAlex
- W2143344601
- Cited by
- 495
- References
- 79
- FWCI
- 7.51
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.