What exactly is ‘N’ in cell culture and animal experiments?
Open accessPublished version of a preprint
The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Abstract
Biologists determine experimental effects by perturbing biological entities or units. When done appropriately, independent replication of the entity-intervention pair contributes to the sample size (N) and forms the basis of statistical inference. If the wrong entity-intervention pair is chosen, an experiment cannot address the question of interest. We surveyed a random sample of published animal experiments from 2011 to 2016 where interventions were applied to parents and effects examined in the offspring, as regulatory authorities provide clear guidelines on replication with such designs. We found that only 22% of studies (95% CI = 17%-29%) replicated the correct entity-intervention pair and thus made valid statistical inferences. Nearly half of the studies (46%, 95% CI = 38%-53%) had pseudoreplication while 32% (95% CI = 26%-39%) provided insufficient information to make a judgement. Pseudoreplication artificially inflates the sample size, and thus the evidence for a scientific claim, resulting in false positives. We argue that distinguishing between biological units, experimental units, and observational units clarifies where replication should occur, describe the criteria for genuine replication, and provide concrete examples of in vitro, ex vivo, and in vivo experimental designs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

![Fig 2 Types of EUs. An EU can correspond to a BU of interest such as an animal (A); groups of BUs, when they are randomised by group or when the treatment is applied group-wise (B); or parts of a BU, where each animal forms the ‘recognisable subgroup’ (C). A less common example is when an experiment is divided into time periods that are randomly assigned to different treatment conditions and a measurement is taken during each time period. Note how the number of animals may differ from the sample size (N). The 2 experimental conditions are represented with syringes (white = control, black = treated). Adapted from Lazic [21]. BU, biological unit; EU, experimental unit.](https://figures.cochat.ai/paper-figures/0b39b9fac6df4c26ac33107b64e3b6e4/what-exactly-is-n-in-cell-culture-and-animal-experiments-figure-2.jpg)
![Fig 3 Three criteria for genuine replication. (1) EUs (animals) must be independently randomised to the treatment conditions. Double arrows indicate variability between EUs, and is constant when the EUs are homogeneous. This variability between the EUs is used to test for differences between treatments. If there are recognisable subgroups such as litters or sex, randomisation can be done within each subgroup. Variability will tend to be less between EUs in a subgroup (smaller arrows) than between subgroups. (2) The treatment must be independently applied to each EU and must not affect or spillover to adjacent EUs. The syringes represent the application of an intervention to the EUs (white = control, black = treated). (3) The EUs must not influence each other (dashed circles represent animals isolated from influencing each other), especially on the outcomes of interest. Adapted from Lazic [21]. EU, experimental unit.](https://figures.cochat.ai/paper-figures/6c56c236bddf4b719e2fc1b2c65921cd/what-exactly-is-n-in-cell-culture-and-animal-experiments-figure-3.jpg)
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Using countries as units in statistical tests may therefore lead to pseudo-replication, inflated sample size and misleading results as regards probability levels [50, 51]”
From Human fertility in relation to education, economy, religion, contraception, and family planning programs (2020) · cites this paper as [51]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“countries may not be statistically independent units.”
From Human fertility in relation to education, economy, religion, contraception, and family planning programs (2020) · cites this paper as [51]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Moreover, merely understanding what experimental unit was used by a particular lab could be challenging, due to the lack of standardized terminology to define this among researchers (Lazic et al., 2018;Vaux et al., 2012).”
From Estimating the replicability of Brazilian biomedical science (2025) · cites this paper as Lazic et al., 2018
The cited source says what the claim attributes to it.
In the citing paper
“This definition of an experiment is in accordance with published recommendations55 and 3R guidelines”
From Loss of electrical β-cell to δ-cell coupling underlies impaired hypoglycaemia-induced glucagon secretion in type-1 diabetes (2024) · cites this paper as [55]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Low power has three effects: first, within the experiment, real effects are more likely to be missed; second, when an effect is detected, this will often be an overestimation of the true effect size [24]; and finally, when low power is combined with publication bias, there is an increase in the false positive rate in the published literature [36].”
From Reporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0 (2020) · cites this paper as [24]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mixed effects models and extensions in ecology with R
Zuur, A. F., Ieno, E. N., Walker, N., Saveliev, A. A., & Smith, G. M. (2009) · Statistics for Biology and Health · doi:10.1007/978-0-387-87458-6 · Cited by 17,963
Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Hill, J. (2006) · doi:10.1017/cbo9780511790942 · Cited by 13,597
Generalized linear mixed models: a practical guide for ecology and evolution
Bolker, B. M., Brooks, M. E., Clark, C. J., Geange, S. W., Poulsen, J. R., Stevens, M. H. H., & White, J.-S. S. (2009) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2008.10.008 · Cited by 8,910
Pseudoreplication and the Design of Ecological Field Experiments
Hurlbert, S. H. (1984) · Ecological Monographs · doi:10.2307/1942661 · Cited by 8,377 · cited 1×
“The second type is replication that does not increase the sample size and is called pseudoreplication [3].”
BackgroundPower failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
Analysis of serial measurements in medical research.
Matthews, J. N., Altman, D. G., Campbell, M. J., & Royston, P. (1990) · BMJ · doi:10.1136/bmj.300.6719.230 · Cited by 3,136
Mixed Effects Models and Extensions in Ecology with R
Militino, A. F. (2010) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2010.00663_9.x · Cited by 1,657
Statistics for experimenters: design, innovation, and discovery
(2006) · Choice Reviews Online · doi:10.5860/choice.43-3429 · Cited by 1,644
International Conference on Harmonisation
Guy, R. C. (2014) · Encyclopedia of Toxicology · doi:10.1016/b978-0-12-386454-3.00861-7 · Cited by 1,478
Faraway, J. J. (2005) · Cited by 1,343
A call for transparent reporting to optimize the predictive value of preclinical research
Landis, S. C., Amara, S. G., Asadullah, K., Austin, C. P., Blumenstein, R., Bradley, E. W., Crystal, R. G., Darnell, R. B., Ferrante, R. J., Fillit, H., et al. (2012) · Nature · doi:10.1038/nature11556 · Cited by 1,196
Self-citationGallagher, C. (2007) · Journal of the American Statistical Association · doi:10.1198/jasa.2007.s238 · Cited by 1,070
arm: Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Su, Y.-S. (2007) · CRAN: Contributed Packages · doi:10.32614/cran.package.arm · Cited by 955
Kilkenny, C., Parsons, N., Kadyszewski, E., Festing, M. F. W., Cuthill, I. C., Fry, D., Hutton, J., & Altman, D. G. (2009) · PLoS ONE · doi:10.1371/journal.pone.0007824 · Cited by 860
A Dirty Dozen: Twelve P-Value Misconceptions
Goodman, S. (2008) · Seminars in Hematology · doi:10.1053/j.seminhematol.2008.04.003 · Cited by 680
Doing Bayesian Data Analysis: A Tutorial with R and BUGS
Barry, J. (2011) · Europe’s Journal of Psychology · doi:10.5964/ejop.v7i4.163 · Cited by 563 · cited 3×
“1, 4), main="", yaxt="n", xlab="Difference between groups", ylab="") lines(density(post_m6$groupVPA), lty=2, lwd=2, col="grey40") abline(v=0, lty=2) legend("topleft", lty=c(1,2), lwd=c(1,2), col=c("black","grey40"), legend=c("m5 (N=12)", "m6 (N=6)"))”
InfluentialDetecting and avoiding likely false‐positive findings – a practical guide
Forstmeier, W., Wagenmakers, E., & Parker, T. H. (2017) · Biological Reviews · doi:10.1111/brv.12315 · Cited by 436
The problem of pseudoreplication in neuroscientific studies: is it affecting your analysis?
Lazic, S. E. (2010) · BMC Neuroscience · doi:10.1186/1471-2202-11-5 · Cited by 381
Self-citationMacleod, M. R., van der Worp, H. B., Sena, E. S., Howells, D. W., Dirnagl, U., & Donnan, G. A. (2008) · Stroke · doi:10.1161/strokeaha.108.515957 · Cited by 319
Statistics Notes: Units of analysis
Altman, D. G., & Bland J, M. (1997) · BMJ · doi:10.1136/bmj.314.7098.1874 · Cited by 273
Prosser, J. I. (2010) · Environmental Microbiology · doi:10.1111/j.1462-2920.2010.02201.x · Cited by 251
Emergency medicine animal research: does use of randomization and blinding affect the results?
Bebarta, V., Luyten, D., & Heard, K. (2003) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2003.tb00056.x · Cited by 244
Dirty Dozen: Twelve P-Value Misconceptions
Goodman, T. (2008) · Cited by 238
Lazic, S. E., & Essioux, L. (2013) · BMC Neuroscience · doi:10.1186/1471-2202-14-37 · Cited by 237
Self-citationSelection of the experimental unit in teratology studies
Haseman, J. K., & Hogan, M. D. (1975) · Teratology · doi:10.1002/tera.1420120209 · Cited by 193
Lazic, S. E., & Essioux, L. (2016) · Cited by 182
Self-citationCasella, G. (2008) · Springer texts in statistics · doi:10.1007/978-0-387-75965-4 · Cited by 159
Vaux, D. L., Fidler, F., & Cumming, G. (2012) · The EMBO Reports · doi:10.1038/embor.2012.36 · Cited by 155
Statistical Principles for the Design of Experiments
Mead, R., Gilmour, S. G., & Mead, A. (2012) · Cambridge University Press eBooks · doi:10.1017/cbo9781139020879 · Cited by 139
Male and Female Mice Lacking Neuroligin-3 Modify the Behavior of Their Wild-Type Littermates
Kalbassi, S., Bachmann, S. O., Cross, E., Roberton, V. H., & Baudouin, S. J. (2017) · eneuro · doi:10.1523/eneuro.0145-17.2017 · Cited by 137 · cited 1×
“Neuroligin-3 knock-out littermates (a model of autism).(29) Here, EUs in one condition are affecting EUs in another.”
BackgroundKnow when your numbers are significant
Vaux, D. L. (2012) · Nature · doi:10.1038/492180a · Cited by 132
Principles: The need for better experimental design
Festing, M. F. W. (2003) · Trends in Pharmacological Sciences · doi:10.1016/s0165-6147(03)00159-7 · Cited by 110
Design and Analysis of Experiments, Second Edition
Hinkelmann, K. H., & Kempthorne, O. (2007) · John Wiley & Sons, Inc. eBooks · doi:10.1002/9780470191750 · Cited by 105
Pseudoreplication in experimental designs for the manipulation of seed germination treatments
Morrison, D. A., & Morris, E. C. (2000) · Austral Ecology · doi:10.1046/j.1442-9993.2000.01025.x · Cited by 97
APPLICATION OF STATISTICAL METHODS IN PHYSIOLOGY
Dunn, H. L. (1929) · Physiological Reviews · doi:10.1152/physrev.1929.9.2.275 · Cited by 80 · cited 1×
“Dunn discussed the distinction in 1929 [1], and papers and books warning of the genuine versus pseudoreplication distinction have appeared regularly (with four papers [17–20] and a book chapter [21] in the past year).”
BackgroundDesign and Analysis of Experiments, Volume 1: Introduction to Experimental Design
Toman, B., Hinkelman, K., & Kempthorne, O. (1995) · Technometrics · doi:10.2307/1269927 · Cited by 61
Pseudoreplication and Its Frequency in Olfactometric Laboratory Studies
Ramírez, C. C., Fuentes‐Contreras, E., Rodríguez, L. C., & Niemeyer, H. M. (2000) · Journal of Chemical Ecology · doi:10.1023/a:1005583624795 · Cited by 55
Experimental Design for Laboratory Biologists: Maximising Information and Improving Reproducibility
Lazic, S. E. (2016) · Cambridge University Press eBooks · doi:10.1017/9781139696647 · Cited by 47
Self-citationDesign and Analysis of Experiments, Volume 1: Introduction to Experimental Design.
Trout, J. R., Hinkelmann, K. H., & Kempthorne, O. (1995) · Journal of the American Statistical Association · doi:10.2307/2291182 · Cited by 37
Experimental Design for Laboratory Biologists: Maximising Information and Improving Reproducibility
Lazic, S. E. (2016) · Cited by 27
Self-citationColegrave, N., & Ruxton, G. D. (2017) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2016.1850 · Cited by 26
Pseudoreplication and the usage of biomarkers in ecotoxicological bioassays
Osório, F. H. T., Galvan, G. L., Marques, A. E. M. L., Santos, G. S., Pereira, L. S., da Silva, T. A., de Assis, H. C. S., Barbosa, R. V., & Cestari, M. M. (2017) · Environmental Toxicology and Chemistry · doi:10.1002/etc.3823 · Cited by 22
Who is who matters—The effects of pseudoreplication in stable isotope analyses
Mundry, R., & Oelze, V. M. (2015) · American Journal of Primatology · doi:10.1002/ajp.22499 · Cited by 18
Research works printed but not linked: 1
- OECD. Guideline for the testing of chemicals: Developmental neurotoxicity study. 2007; 1–26. http://www.oecd-ilibrary.org/test-no-426-developmental-neurotoxicity-study_5l4fg25mnkxs.pdf;jsessionid=12ic71yg7bopl.delta?contentType=/ns/Book&itemId=/content/book/9789264067394-en&containerItemId=/content/serial/20745788&accessItemIds=&mimeType=application/pdf. [cited 2018 Mar 26].
Cited by
Reporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0
Percie du Sert, N., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., Emerson, M., et al. (2020) · PLOS Biology · doi:10.1371/journal.pbio.3000411 · Cited by 2,677
“See [17,24,25] for further guidance on identifying experimental units.”
BackgroundSelf-citationSerdar, C. C., Cihan, M., Yücel, D., & Serdar, M. A. (2021) · Biochemia medica · doi:10.11613/bm.2021.010502 · Cited by 1,570
“suggested that almost half of the studies (46%) had mistaken pseudo replication (technical repeat) for genuine replication, while 32% did not provide sufficient information to enable evaluation of appropriateness of the sample size (53,54).”
BackgroundSuperPlots: Communicating reproducibility and variability in cell biology
Lord, S. J., Velle, K. B., Mullins, R. D., & Fritz-Laylin, L. K. (2020) · Journal of Cell Biology · doi:10.1083/jcb.202001064 · Cited by 718
Walter, J., Armet, A. M., Finlay, B. B., & Shanahan, F. (2020) · Cell · doi:10.1016/j.cell.2019.12.025 · Cited by 596
Yu, Z., Guindani, M., Grieco, S. F., Chen, L., Holmes, T. C., & Xu, X. (2022) · Neuron · doi:10.1016/j.neuron.2021.10.030 · Cited by 563
“The lesson from this example is that 494 the number of observational units is much larger than the number of experimental units (see 495 reference (Lazic et al., 2018) for helpful discussion).”
Background
Metadata
- Authors
- Lazic, S. E., Clarke-Williams, C. J., & Munafò, M. R.
- Affiliations
- AstraZeneca (United Kingdom) (GB)
- University of Bristol (GB)
- Corresponding author
- Lazic, Stanley E.
- Clarke-Williams, Charlie J.
- ORCID
- Lazic, Stanley E.
- Venue
- PLOS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2018-04-04
- Volume
- 16
- Issue
- 4
- Pages
- e2005282
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- PMC
- PMC5902037
- OpenAlex
- W2953238030
- Cited by
- 291
- References
- 43
- Citations by year
- 2026: 66 · 2025: 39 · 2024: 30 · 2023: 30 · 2022: 44 · 2021: 32 · 2020: 26 · 2019: 18 · 2018: 6
- FWCI
- 29.99
- Type
- journal article
- Language
- en
- Update notices
- new_version (2018-04-16)
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Biology (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Bristol Research (University of Bristol) (publishedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Explore Bristol Research (submittedVersion, cc-by)
- Funders
- United Kingdom Clinical Research Collaboration
- Cancer Research UK
- National Institute for Health and Care Research
- British Heart Foundation
- Medical Research Council (12013/6, MC_UU_12013/6)
- Economic and Social Research Council
- Topics
- Health Sciences › Veterinary › Small Animals › Animal testing and alternatives
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Philosophy of Biology and Scientific Explanation
- Keywords
- pseudoreplication, sample size, replication, animal experimentation, experimental units, statistical inference, false positives, cell culture
- MeSH terms
- Animals, Humans, Research Design, Statistics as Topic, Reproducibility of Results, Guidelines as Topic, Sample Size, Animal Experimentation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.