What exactly is ‘N’ in cell culture and animal experiments?
Open accessPublished version of a preprint
The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Abstract
Biologists determine experimental effects by perturbing biological entities or units. When done appropriately, independent replication of the entity-intervention pair contributes to the sample size (N) and forms the basis of statistical inference. If the wrong entity-intervention pair is chosen, an experiment cannot address the question of interest. We surveyed a random sample of published animal experiments from 2011 to 2016 where interventions were applied to parents and effects examined in the offspring, as regulatory authorities provide clear guidelines on replication with such designs. We found that only 22% of studies (95% CI = 17%-29%) replicated the correct entity-intervention pair and thus made valid statistical inferences. Nearly half of the studies (46%, 95% CI = 38%-53%) had pseudoreplication while 32% (95% CI = 26%-39%) provided insufficient information to make a judgement. Pseudoreplication artificially inflates the sample size, and thus the evidence for a scientific claim, resulting in false positives. We argue that distinguishing between biological units, experimental units, and observational units clarifies where replication should occur, describe the criteria for genuine replication, and provide concrete examples of in vitro, ex vivo, and in vivo experimental designs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

![Fig 2 Types of EUs. An EU can correspond to a BU of interest such as an animal (A); groups of BUs, when they are randomised by group or when the treatment is applied group-wise (B); or parts of a BU, where each animal forms the ‘recognisable subgroup’ (C). A less common example is when an experiment is divided into time periods that are randomly assigned to different treatment conditions and a measurement is taken during each time period. Note how the number of animals may differ from the sample size (N). The 2 experimental conditions are represented with syringes (white = control, black = treated). Adapted from Lazic [21]. BU, biological unit; EU, experimental unit.](https://figures.cochat.ai/paper-figures/0b39b9fac6df4c26ac33107b64e3b6e4/what-exactly-is-n-in-cell-culture-and-animal-experiments-figure-2.jpg)
![Fig 3 Three criteria for genuine replication. (1) EUs (animals) must be independently randomised to the treatment conditions. Double arrows indicate variability between EUs, and is constant when the EUs are homogeneous. This variability between the EUs is used to test for differences between treatments. If there are recognisable subgroups such as litters or sex, randomisation can be done within each subgroup. Variability will tend to be less between EUs in a subgroup (smaller arrows) than between subgroups. (2) The treatment must be independently applied to each EU and must not affect or spillover to adjacent EUs. The syringes represent the application of an intervention to the EUs (white = control, black = treated). (3) The EUs must not influence each other (dashed circles represent animals isolated from influencing each other), especially on the outcomes of interest. Adapted from Lazic [21]. EU, experimental unit.](https://figures.cochat.ai/paper-figures/6c56c236bddf4b719e2fc1b2c65921cd/what-exactly-is-n-in-cell-culture-and-animal-experiments-figure-3.jpg)
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Using countries as units in statistical tests may therefore lead to pseudo-replication, inflated sample size and misleading results as regards probability levels [50, 51]”
From Human fertility in relation to education, economy, religion, contraception, and family planning programs (2020) · cites this paper as [51]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“countries may not be statistically independent units.”
From Human fertility in relation to education, economy, religion, contraception, and family planning programs (2020) · cites this paper as [51]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Moreover, merely understanding what experimental unit was used by a particular lab could be challenging, due to the lack of standardized terminology to define this among researchers (Lazic et al., 2018;Vaux et al., 2012).”
From Estimating the replicability of Brazilian biomedical science (2025) · cites this paper as Lazic et al., 2018
The cited source says what the claim attributes to it.
In the citing paper
“This definition of an experiment is in accordance with published recommendations55 and 3R guidelines”
From Loss of electrical β-cell to δ-cell coupling underlies impaired hypoglycaemia-induced glucagon secretion in type-1 diabetes (2024) · cites this paper as [55]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Low power has three effects: first, within the experiment, real effects are more likely to be missed; second, when an effect is detected, this will often be an overestimation of the true effect size [24]; and finally, when low power is combined with publication bias, there is an increase in the false positive rate in the published literature [36].”
From Reporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0 (2020) · cites this paper as [24]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mixed effects models and extensions in ecology with R
Zuur, A. F., Ieno, E. N., Walker, N., Saveliev, A. A., & Smith, G. M. (2009) · Statistics for Biology and Health · doi:10.1007/978-0-387-87458-6 · Cited by 17,963
Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Hill, J. (2006) · doi:10.1017/cbo9780511790942 · Cited by 13,597
Generalized linear mixed models: a practical guide for ecology and evolution
Bolker, B. M., Brooks, M. E., Clark, C. J., Geange, S. W., Poulsen, J. R., Stevens, M. H. H., & White, J.-S. S. (2009) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2008.10.008 · Cited by 8,910
Pseudoreplication and the Design of Ecological Field Experiments
Hurlbert, S. H. (1984) · Ecological Monographs · doi:10.2307/1942661 · Cited by 8,377 · cited 1×
“The second type is replication that does not increase the sample size and is called pseudoreplication [3].”
BackgroundPower failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
Analysis of serial measurements in medical research.
Matthews, J. N., Altman, D. G., Campbell, M. J., & Royston, P. (1990) · BMJ · doi:10.1136/bmj.300.6719.230 · Cited by 3,136
Mixed Effects Models and Extensions in Ecology with R
Militino, A. F. (2010) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2010.00663_9.x · Cited by 1,657
Statistics for experimenters: design, innovation, and discovery
(2006) · Choice Reviews Online · doi:10.5860/choice.43-3429 · Cited by 1,644
International Conference on Harmonisation
Guy, R. C. (2014) · Encyclopedia of Toxicology · doi:10.1016/b978-0-12-386454-3.00861-7 · Cited by 1,478
Research works printed but not linked: 1
- OECD. Guideline for the testing of chemicals: Developmental neurotoxicity study. 2007; 1–26. http://www.oecd-ilibrary.org/test-no-426-developmental-neurotoxicity-study_5l4fg25mnkxs.pdf;jsessionid=12ic71yg7bopl.delta?contentType=/ns/Book&itemId=/content/book/9789264067394-en&containerItemId=/content/serial/20745788&accessItemIds=&mimeType=application/pdf. [cited 2018 Mar 26].
Cited by
Reporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0
Percie du Sert, N., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., Emerson, M., et al. (2020) · PLOS Biology · doi:10.1371/journal.pbio.3000411 · Cited by 2,677
“See [17,24,25] for further guidance on identifying experimental units.”
BackgroundSelf-citationSerdar, C. C., Cihan, M., Yücel, D., & Serdar, M. A. (2021) · Biochemia medica · doi:10.11613/bm.2021.010502 · Cited by 1,570
“suggested that almost half of the studies (46%) had mistaken pseudo replication (technical repeat) for genuine replication, while 32% did not provide sufficient information to enable evaluation of appropriateness of the sample size (53,54).”
BackgroundSuperPlots: Communicating reproducibility and variability in cell biology
Lord, S. J., Velle, K. B., Mullins, R. D., & Fritz-Laylin, L. K. (2020) · Journal of Cell Biology · doi:10.1083/jcb.202001064 · Cited by 718
Walter, J., Armet, A. M., Finlay, B. B., & Shanahan, F. (2020) · Cell · doi:10.1016/j.cell.2019.12.025 · Cited by 596
Yu, Z., Guindani, M., Grieco, S. F., Chen, L., Holmes, T. C., & Xu, X. (2022) · Neuron · doi:10.1016/j.neuron.2021.10.030 · Cited by 563
“The lesson from this example is that 494 the number of observational units is much larger than the number of experimental units (see 495 reference (Lazic et al., 2018) for helpful discussion).”
Background
Metadata
- Authors
- Lazic, S. E., Clarke-Williams, C. J., & Munafò, M. R.
- Affiliations
- AstraZeneca (United Kingdom) (GB)
- University of Bristol (GB)
- Corresponding author
- Lazic, Stanley E.
- Clarke-Williams, Charlie J.
- ORCID
- Lazic, Stanley E.
- Venue
- PLOS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2018-04-04
- Volume
- 16
- Issue
- 4
- Pages
- e2005282
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- PMC
- PMC5902037
- OpenAlex
- W2953238030
- Cited by
- 291
- References
- 43
- Citations by year
- 2026: 66 · 2025: 39 · 2024: 30 · 2023: 30 · 2022: 44 · 2021: 32 · 2020: 26 · 2019: 18 · 2018: 6
- FWCI
- 29.99
- Type
- journal article
- Language
- en
- Update notices
- new_version (2018-04-16)
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Biology (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Bristol Research (University of Bristol) (publishedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Explore Bristol Research (submittedVersion, cc-by)
- Funders
- United Kingdom Clinical Research Collaboration
- Cancer Research UK
- National Institute for Health and Care Research
- British Heart Foundation
- Medical Research Council (12013/6, MC_UU_12013/6)
- Economic and Social Research Council
- Topics
- Health Sciences › Veterinary › Small Animals › Animal testing and alternatives
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Philosophy of Biology and Scientific Explanation
- Keywords
- pseudoreplication, sample size, replication, animal experimentation, experimental units, statistical inference, false positives, cell culture
- MeSH terms
- Animals, Humans, Research Design, Statistics as Topic, Reproducibility of Results, Guidelines as Topic, Sample Size, Animal Experimentation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.