What exactly is ‘N’ in cell culture and animal experiments?
Open accessPublished version of a preprint
The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Abstract
Biologists determine experimental effects by perturbing biological entities or units. When done appropriately, independent replication of the entity-intervention pair contributes to the sample size (N) and forms the basis of statistical inference. If the wrong entity-intervention pair is chosen, an experiment cannot address the question of interest. We surveyed a random sample of published animal experiments from 2011 to 2016 where interventions were applied to parents and effects examined in the offspring, as regulatory authorities provide clear guidelines on replication with such designs. We found that only 22% of studies (95% CI = 17%-29%) replicated the correct entity-intervention pair and thus made valid statistical inferences. Nearly half of the studies (46%, 95% CI = 38%-53%) had pseudoreplication while 32% (95% CI = 26%-39%) provided insufficient information to make a judgement. Pseudoreplication artificially inflates the sample size, and thus the evidence for a scientific claim, resulting in false positives. We argue that distinguishing between biological units, experimental units, and observational units clarifies where replication should occur, describe the criteria for genuine replication, and provide concrete examples of in vitro, ex vivo, and in vivo experimental designs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

![Fig 2 Types of EUs. An EU can correspond to a BU of interest such as an animal (A); groups of BUs, when they are randomised by group or when the treatment is applied group-wise (B); or parts of a BU, where each animal forms the ‘recognisable subgroup’ (C). A less common example is when an experiment is divided into time periods that are randomly assigned to different treatment conditions and a measurement is taken during each time period. Note how the number of animals may differ from the sample size (N). The 2 experimental conditions are represented with syringes (white = control, black = treated). Adapted from Lazic [21]. BU, biological unit; EU, experimental unit.](https://figures.cochat.ai/paper-figures/0b39b9fac6df4c26ac33107b64e3b6e4/what-exactly-is-n-in-cell-culture-and-animal-experiments-figure-2.jpg)
![Fig 3 Three criteria for genuine replication. (1) EUs (animals) must be independently randomised to the treatment conditions. Double arrows indicate variability between EUs, and is constant when the EUs are homogeneous. This variability between the EUs is used to test for differences between treatments. If there are recognisable subgroups such as litters or sex, randomisation can be done within each subgroup. Variability will tend to be less between EUs in a subgroup (smaller arrows) than between subgroups. (2) The treatment must be independently applied to each EU and must not affect or spillover to adjacent EUs. The syringes represent the application of an intervention to the EUs (white = control, black = treated). (3) The EUs must not influence each other (dashed circles represent animals isolated from influencing each other), especially on the outcomes of interest. Adapted from Lazic [21]. EU, experimental unit.](https://figures.cochat.ai/paper-figures/6c56c236bddf4b719e2fc1b2c65921cd/what-exactly-is-n-in-cell-culture-and-animal-experiments-figure-3.jpg)
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Using countries as units in statistical tests may therefore lead to pseudo-replication, inflated sample size and misleading results as regards probability levels [50, 51]”
From Human fertility in relation to education, economy, religion, contraception, and family planning programs (2020) · cites this paper as [51]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“countries may not be statistically independent units.”
From Human fertility in relation to education, economy, religion, contraception, and family planning programs (2020) · cites this paper as [51]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Moreover, merely understanding what experimental unit was used by a particular lab could be challenging, due to the lack of standardized terminology to define this among researchers (Lazic et al., 2018;Vaux et al., 2012).”
From Estimating the replicability of Brazilian biomedical science (2025) · cites this paper as Lazic et al., 2018
The cited source says what the claim attributes to it.
In the citing paper
“This definition of an experiment is in accordance with published recommendations55 and 3R guidelines”
From Loss of electrical β-cell to δ-cell coupling underlies impaired hypoglycaemia-induced glucagon secretion in type-1 diabetes (2024) · cites this paper as [55]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Low power has three effects: first, within the experiment, real effects are more likely to be missed; second, when an effect is detected, this will often be an overestimation of the true effect size [24]; and finally, when low power is combined with publication bias, there is an increase in the false positive rate in the published literature [36].”
From Reporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0 (2020) · cites this paper as [24]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mixed effects models and extensions in ecology with R
Zuur, A. F., Ieno, E. N., Walker, N., Saveliev, A. A., & Smith, G. M. (2009) · Statistics for Biology and Health · doi:10.1007/978-0-387-87458-6 · Cited by 17,963
Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Hill, J. (2006) · doi:10.1017/cbo9780511790942 · Cited by 13,597
Generalized linear mixed models: a practical guide for ecology and evolution
Bolker, B. M., Brooks, M. E., Clark, C. J., Geange, S. W., Poulsen, J. R., Stevens, M. H. H., & White, J.-S. S. (2009) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2008.10.008 · Cited by 8,910
Pseudoreplication and the Design of Ecological Field Experiments
Hurlbert, S. H. (1984) · Ecological Monographs · doi:10.2307/1942661 · Cited by 8,377 · cited 1×
“The second type is replication that does not increase the sample size and is called pseudoreplication [3].”
BackgroundPower failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
Analysis of serial measurements in medical research.
Matthews, J. N., Altman, D. G., Campbell, M. J., & Royston, P. (1990) · BMJ · doi:10.1136/bmj.300.6719.230 · Cited by 3,136
Mixed Effects Models and Extensions in Ecology with R
Militino, A. F. (2010) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2010.00663_9.x · Cited by 1,657
Statistics for experimenters: design, innovation, and discovery
(2006) · Choice Reviews Online · doi:10.5860/choice.43-3429 · Cited by 1,644
International Conference on Harmonisation
Guy, R. C. (2014) · Encyclopedia of Toxicology · doi:10.1016/b978-0-12-386454-3.00861-7 · Cited by 1,478
Research works printed but not linked: 1
- OECD. Guideline for the testing of chemicals: Developmental neurotoxicity study. 2007; 1–26. http://www.oecd-ilibrary.org/test-no-426-developmental-neurotoxicity-study_5l4fg25mnkxs.pdf;jsessionid=12ic71yg7bopl.delta?contentType=/ns/Book&itemId=/content/book/9789264067394-en&containerItemId=/content/serial/20745788&accessItemIds=&mimeType=application/pdf. [cited 2018 Mar 26].
Cited by
Reporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0
Percie du Sert, N., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., Emerson, M., et al. (2020) · PLOS Biology · doi:10.1371/journal.pbio.3000411 · Cited by 2,677
“See [17,24,25] for further guidance on identifying experimental units.”
BackgroundSelf-citationSerdar, C. C., Cihan, M., Yücel, D., & Serdar, M. A. (2021) · Biochemia medica · doi:10.11613/bm.2021.010502 · Cited by 1,570
“suggested that almost half of the studies (46%) had mistaken pseudo replication (technical repeat) for genuine replication, while 32% did not provide sufficient information to enable evaluation of appropriateness of the sample size (53,54).”
BackgroundSuperPlots: Communicating reproducibility and variability in cell biology
Lord, S. J., Velle, K. B., Mullins, R. D., & Fritz-Laylin, L. K. (2020) · Journal of Cell Biology · doi:10.1083/jcb.202001064 · Cited by 718
Walter, J., Armet, A. M., Finlay, B. B., & Shanahan, F. (2020) · Cell · doi:10.1016/j.cell.2019.12.025 · Cited by 596
Yu, Z., Guindani, M., Grieco, S. F., Chen, L., Holmes, T. C., & Xu, X. (2022) · Neuron · doi:10.1016/j.neuron.2021.10.030 · Cited by 563
“The lesson from this example is that 494 the number of observational units is much larger than the number of experimental units (see 495 reference (Lazic et al., 2018) for helpful discussion).”
BackgroundReporting animal research: Explanation and Elaboration for the ARRIVE guidelines 2019
Percie du Sert, N., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., Emerson, M., et al. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/703355 · Cited by 559
“Low power has three effects: first, within the experiment, real effects are more likely to be missed; second, where an effect is detected, this will often be an over-estimation of the true effect size [25]; and finally, when low power is combined with publication bias, there is an increase in the false positive rate i…”
BackgroundGötmark, F., & Andersson, M. (2020) · BMC Public Health · doi:10.1186/s12889-020-8331-7 · Cited by 230
Goedhart, J. (2021) · Molecular Biology of the Cell · doi:10.1091/mbc.e20-09-0583 · Cited by 180
“For instance, it should be clear whether data are paired, how many technical and biological replicates are plotted, and how “n” is defined for different conditions (Naegle et al. , 2015; Lazic et al. , 2018).”
Gatto, L., Aebersold, R., Cox, J., Demichev, V., Derks, J., Emmott, E., Franks, A. M., Ivanov, A. R., Kelly, R. T., Khoury, L., et al. (2023) · Nature Methods · doi:10.1038/s41592-023-01785-3 · Cited by 173
Perioperative Neurocognitive Disorder: State of the Preclinical Science
Eckenhoff, R. G., Maze, M., Xie, Z., Culley, D. J., Goodlin, S. J., Zuo, Z., Wei, H., Whittington, R. A., Terrando, N., Orser, B. A., et al. (2020) · Anesthesiology · doi:10.1097/aln.0000000000002956 · Cited by 177
Mixed Models Offer No Freedom from Degrees of Freedom
Arnqvist, G. (2020) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2019.12.004 · Cited by 135
Nutrient Composition and Fatty Acid and Protein Profiles of Selected Fish By-Products
Kandyliari, A., Mallouchos, A., Papandroulakis, N., Golla, J. P., Lam, T. T., Sakellari, A., Karavoltsos, S., Vasiliou, V., & Kapsokefalou, M. (2020) · Foods · doi:10.3390/foods9020190 · Cited by 140
“Pooling of samples masks the potential variations between individuals [48].”
BackgroundVõikar, V., & Gaburro, S. (2020) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2020.575434 · Cited by 140
Calibrating the Scientific Ecosystem Through Meta-Research
Hardwicke, T. E., Serghiou, S., Janiaud, P., Danchev, V., Crüwell, S., Goodman, S. N., & Ioannidis, J. P. A. (2020) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-031219-041104 · Cited by 98
“…description of experimental units, not reporting data exclusions) Avey et al. 2016, Carp 2012, Glasziou et al. 2014, Hardwicke et al. 2018, Lazic et al. 2018, Strasak et al. 2007, Vasilevsky et al. 2013, Weissgerber et al. 2018 Incomplete reporting of outcomes (e.g., not reporting effect…”
Prime-seq, efficient and powerful bulk RNA sequencing
Janjic, A., Wange, L. E., Bagnoli, J., Geuder, J., Nguyen, P., Richter, D., Vieth, B., Vick, B., Jeremias, I., Ziegenhain, C., et al. (2022) · Genome biology · doi:10.1186/s13059-022-02660-8 · Cited by 103
“However, input amounts can be a limiting factor, sequencing costs have decreased and will further decrease, and low sample size is a central problem of reproducibility [17, 18].”
BackgroundCait, J., Cait, A., Scott, R. W., Winder, C. B., & Mason, G. J. (2022) · BMC Biology · doi:10.1186/s12915-021-01184-0 · Cited by 133
“Thus animal (rather than cage) was often used as the unit of replication, as is common in biomedical literature [87, 88].”
BackgroundGeneral Principles of Preclinical Study Design
Huang, W., du Sert, N. P., Vollert, J., & Rice, A. S. C. (2019) · Handbook of experimental pharmacology · doi:10.1007/164_2019_277 · Cited by 130
Replications in Comparative Cognition: What Should We Expect and How Can We Improve?
Farrar, B., Boeckle, M., & Clayton, N. (2020) · Animal Behavior and Cognition · doi:10.26451/abc.07.01.02.2020 · Cited by 89
“Note, the evidence is only overwhelming because of how inconsistent Megan’s behavior was with her not avoiding the trap, i.e., a p - value of .000000000135 ( 80/100 correct trials, with a null hypothesis as 50/100). see Lazic et al., 2018).”
Improving transparency and scientific rigor in academic publishing
Prager, E. M., Chambers, K. E., Plotkin, J. L., McArthur, D. L., Bandrowski, A. E., Bansal, N., Martone, M. E., Bergstrom, H. C., Bespalov, A., & Graf, C. (2019) · Journal of Neuroscience Research · doi:10.1002/jnr.24340 · Cited by 83
Pseudoreplication in physiology: More means less
Eisner, D. A. (2021) · The Journal of General Physiology · doi:10.1085/jgp.202012826 · Cited by 79
Why we need to report more than 'Data were Analyzed by t-tests or ANOVA'
Weissgerber, T. L., Garcia-Valencia, O., Garovic, V. D., Milic, N. M., & Winham, S. J. (2018) · eLife · doi:10.7554/elife.36163 · Cited by 76
Bóbbo, V. C. D., Engel, D. F., Jara, C. P., Mendes, N. F., Haddad-Tóvolli, R., do Prado, T. P., Sidarta-Oliveira, D., Morari, J., Velloso, L. A., & ARAUJO, E. P. D. (2021) · Journal of Neuroinflammation · doi:10.1186/s12974-021-02242-8 · Cited by 76
“For all experiments, sample size was determined taking into consideration recommendations published elsewhere [42].”
MethodChurch, J. S., Bannish, J. A. M., Adrian, L. A., Martinez, K. R., Henshaw, A., & Schwartzer, J. J. (2023) · Frontiers in Neuroscience · doi:10.3389/fnins.2023.1134080 · Cited by 80
“Given that mice were group housed with littermates, and the potential impact of litter-to-litter variations on microbiome, percent weight gain, serum SCFAs, and brain protein concentrations were evaluated using mixed-effects modeling to control for Type I error as a result of litter effects (Lazic and Essioux, 2013; L…”
MethodIndependence and generalizability in linguistics
Winter, B., & Grice, M. (2021) · Linguistics · doi:10.1515/ling-2019-0049 · Cited by 87
Hall, S. R., Rasmussen, S. A., Crittenden, E., Dawson, C. A., Bartlett, K. E., Westhorpe, A. P., Albulescu, L.-O., Kool, J., Gutiérrez, J. M., & Casewell, N. R. (2023) · Nature Communications · doi:10.1038/s41467-023-43510-w · Cited by 63
Improving transparency and scientific rigor in academic publishing
Prager, E. M., Chambers, K. E., Plotkin, J. L., McArthur, D. L., Bandrowski, A. E., Bansal, N., Martone, M. E., Bergstrom, H. C., Bespalov, A., & Graf, C. (2019) · Brain and Behavior · doi:10.1002/brb3.1141 · Cited by 60
A Bayesian predictive approach for dealing with pseudoreplication
Lazic, S. E., Mellor, J. R., Ashby, M. C., & Munafo, M. R. (2020) · Scientific Reports · doi:10.1038/s41598-020-59384-7 · Cited by 59
Self-citationLoss, C. M., Melleu, F. F., Domingues, K., Lino-de-Oliveira, C., & Viola, G. G. (2021) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2021.763428 · Cited by 44
“…Estimating Equations (GLM, GLMM, and GEE, respectively) fit distinct types of distribution (such as the Gaussian distribution) and correct for confounding factors (Shkedy et al., 2005a,b; Lazic and Essioux, 2013; Lazic, 2015, 2018; Bono et al., 2021; Eisner, 2021; Zimmerman et al., 2021).”
BackgroundInfluentialZhu, Z., Gao, S., Chen, C., Xu, W., Xiao, P., Chen, Z., Du, C., Chen, B., Gao, Y., Wang, C., et al. (2022) · Experimental & Molecular Medicine · doi:10.1038/s12276-022-00879-w · Cited by 48
3Rs Principle and Legislative Decrees to Achieve High Standard of Animal Research
Verderio, P., Lecchi, M., Ciniselli, C. M., Shishmani, B., Apolone, G., & Manenti, G. (2023) · Animals · doi:10.3390/ani13020277 · Cited by 58
“[27], the experimental units have to meet some conditions: (i) they must be independently randomized to the treatment conditions, (ii) they must not influence each other, especially the outcomes of interest, and (iii) the treatment must be independently applied to each EU.”
BackgroundAndrisse, S., Feng, M., Wang, Z., Awe, O., Yu, L., Zhang, H., Bi, S., Wang, H., Li, L., Joseph, S., et al. (2021) · The FASEB Journal · doi:10.1096/fj.202100961r · Cited by 47
Experimental Microbiomes: Models Not to Scale
Chevrette, M. G., Bratburd, J. R., Currie, C. R., & Stubbendieck, R. M. (2019) · mSystems · doi:10.1128/msystems.00175-19 · Cited by 46
“on diet or even water pH (49), and social, coprophagous animals like mice may necessitate cages as biological units of replication, rather than individuals (50, 51).”
BackgroundVorland, C. J., Brown, A. W., Dawson, J., Dickinson, S., Golzarri‐Arroyo, L., Hannon, B. A., Heo, M., Heymsfield, S. B., Jayawardene, W. P., Kahathuduwa, C. N., et al. (2021) · International Journal of Obesity · doi:10.1038/s41366-021-00909-z · Cited by 43
Designing, conducting, and reporting reproducible animal experiments
Wilson, E., Ramage, F. J., Wever, K. E., Sena, E. S., Macleod, M. R., & Currie, G. L. (2023) · Journal of Endocrinology · doi:10.1530/joe-22-0330 · Cited by 44
What is the optimum design for my animal experiment?
Karp, N. A., & Fry, D. (2021) · BMJ Open Science · doi:10.1136/bmjos-2020-100126 · Cited by 45
Chinn, G. A., Pearn, M. L., Vutskits, L., Mintz, C. D., Loepke, A. W., Lee, J., Chen, J., Bosnjak, Z. J., Brambrink, A. M., Jevtović‐Todorović, V., et al. (2020) · British Journal of Anaesthesia · doi:10.1016/j.bja.2020.01.011 · Cited by 38
“In primary cell culture experiments, at least two separate cultures should be investigated for true replication.(76) A best practice approach should apply to other methods commonly used, such as immunofluorescence, electron microscopy, and electrophysiology, and”
MethodKarp, N. A., Wilson, Z., Stalker, E., Mooney, L. M., Lazic, S. E., Zhang, B., & Hardaker, E. L. (2020) · Scientific Reports · doi:10.1038/s41598-020-62509-7 · Cited by 36
Self-citationA brief guide to statistical analysis of grouped data in preclinical research
Vorland, C. J., Golzarri‐Arroyo, L., & Allison, D. B. (2025) · Nature Metabolism · doi:10.1038/s42255-025-01323-9 · Cited by 33
Soto‐Mercado, V., Mendivil‐Perez, M., Velez‐Pardo, C., Lopera, F. J., & Jiménez-Del-Río, M. (2020) · PLoS ONE · doi:10.1371/journal.pone.0221669 · Cited by 33
“The data from individual replicate wells were averaged to yield a value of n = 1 for that experiment and this was repeated on three occasions blind to experimenter and/ or flow cytometer analyst for a final value of n = 3 [42].”
MethodQuintero-Espinosa, D. A., Sánchez-Hernández, S., Velez‐Pardo, C., Martín, F., & Jiménez-Del-Río, M. (2023) · International Journal of Molecular Sciences · doi:10.3390/ijms241310474 · Cited by 31
“, the biological and observational units [82]) were randomized to wells by simple randomization (sampling without replacement method), and then wells (i.”
Kroon, C., Breuer, L., Jones, L., An, J., Akan, A., Mohamed Ali, E. A., Busch, F., Fislage, M., Ghosh, B., Hellrigel-Holderbaum, M., et al. (2022) · PLOS Biology · doi:10.1371/journal.pbio.3001783 · Cited by 31
“Pseudoreplicates, which are sometimes called technical replicates, are not independent and do not increase sample size [25].”
BackgroundOlesen, S. W., & Gerardin, Y. (2020) · Journal of Crohn s and Colitis · doi:10.1093/ecco-jcc/jjaa170 · Cited by 30
Hill, T. G., Gao, R., Benrick, A., Kothegala, L., Rorsman, N., Santos, C., Acreman, S., Briant, L. J., Dou, H., Gandasi, N. R., et al. (2024) · Nature Metabolism · doi:10.1038/s42255-024-01139-z · Cited by 37
Insufficient transparency of statistical reporting in preclinical research: a scoping review
Gosselin, R. (2021) · Scientific Reports · doi:10.1038/s41598-021-83006-5 · Cited by 43
Conceptual and methodological flaws undermine claims of a link between the gut microbiome and autism
Mitchell, K. J., Dahly, D. L., & Bishop, D. (2025) · Neuron · doi:10.1016/j.neuron.2025.10.006 · Cited by 35
Vakili, R., Toroghian, M., & Torshizi, M. E. (2022) · Veterinary Medicine and Science · doi:10.1002/vms3.910 · Cited by 27
“All of the cell tests were performed with at least three completely independent replications on separate days according to the instruction for cell cultures (Lazic et al., 2018).”
MethodPhotobiomodulation of human gingival fibroblasts with diode laser - A systematic review
Bakshi, P. V., Setty, S. B., & Kulkarni, M. R. (2022) · Journal of Indian Society of Periodontology · doi:10.4103/jisp.jisp_90_21 · Cited by 34
“[20] However, there are no guidelines for researchers regarding the minimum number of repetitions that one should conduct to achieve valid results, and hence, there is the greatest need of opinion from experts in this field.”
Maternal Allergic Asthma Induces Prenatal Neuroinflammation
Tamayo, J. M., Rose, D. R., Church, J. S., Schwartzer, J. J., & Ashwood, P. (2022) · Brain Sciences · doi:10.3390/brainsci12081041 · Cited by 34
“To control for pseudoreplications and litter-to-litter variations, offspring brain cytokine measures were evaluated separately for male and female mice using multilevel modeling to control for type I error [32,33], with offspring as the level 1 measure nested in dams as the level 2 two variable.”
MethodVigli, D., Palombelli, G., Fanelli, S., Calamandrei, G., Canese, R., Mosca, L., Scattoni, M. L., & Ricceri, L. (2020) · Neuroscience · doi:10.1016/j.neuroscience.2020.05.009 · Cited by 32
Statistical review of animal trials—A guideline
Piper, S. K., Zocholl, D., Toelch, U., Roehle, R., Stroux, A., Hößler, J. C., Zinke, A., & Konietschke, F. (2022) · Biometrical Journal · doi:10.1002/bimj.202200061 · Cited by 37
“For an in-depth discussion of the differences between biological, experimental, and observational units, see Lazic et al. (2018).”
BackgroundKundrotas, G., Karabanovas, V., Plečkaitis, M., Juraleviciute, M., Steponkienė, S., Gudlevičienė, Ž., & Rotomskis, R. (2019) · Journal of Nanobiotechnology · doi:10.1186/s12951-019-0470-6 · Cited by 26
Controlling action potentials with magnetoelectric nanoparticles
Zhang, E., Shotbolt, M., Chang, C.-Y., Scott‐Vandeusen, A., Chen, S., Liang, P., Radu, D. R., & Khizroev, S. (2024) · Brain stimulation · doi:10.1016/j.brs.2024.08.008 · Cited by 29
“This approach with linear mixed effect models was chosen over more typical repeated measures ANOVA and linear regression to avoid assumptions of independence in the neurons, as several recent papers have noted that such assumptions can inflate p-values when neurons behave synchronously [64,65].”
MethodCerumen microbial community shifts between healthy and otitis affected dogs
Borriello, G., Paradiso, R., Catozzi, C., Brunetti, R., Roccabianca, P., Riccardi, M. G., Cecere, B., Lecchi, C., Fusco, G., Ceciliani, F., et al. (2020) · PLoS ONE · doi:10.1371/journal.pone.0241447 · Cited by 35
“Indeed psuedoreplication risks to inflate the evidence supporting a scientific claim by artificially enlarging the sample size and contributes to irreproducible results [42].”
Šefcová, M. A., Santacruz, F., Larrea-Álvarez, C. M., Vinueza-Burgos, C., Ortega-Paredes, D., Molina-Cuasapaz, G., Rodríguez, J., Calero‐Cáceres, W., Révajová, V., Fernández-Moreira, E., et al. (2021) · Animals · doi:10.3390/ani11123601 · Cited by 30
Franco, K.-D. C., Brakmann, I. C., Feoktistova, M., Panayotova‐Dimitrova, D., Gründer, S., & Tian, Y. (2022) · Pflügers Archiv - European Journal of Physiology · doi:10.1007/s00424-022-02781-w · Cited by 23
“To avoid pseudoreplication due to clustering of technical replicates from one biological replicate [28] and to account for the variable number of”
Šefcová, M. A., Ortega-Paredes, D., Larrea-Álvarez, C. M., Mina, I., Guapás, V., Ayala, D., Leoro-Garzón, P., Molina-Cuasapaz, G., Vinueza-Burgos, C., Révajová, V., et al. (2023) · Microorganisms · doi:10.3390/microorganisms11020256 · Cited by 26
“The animal was considered the experimental unit (EU), since they were independently allocated to treatment conditions and experimental interventions; moreover, each EU could not influence each other on the measured outcomes [29].”
BackgroundCollado, C. E., Hwang, S. J., & Hernández, R. (2024) · Frontiers in Plant Science · doi:10.3389/fpls.2024.1371702 · Cited by 23
“Because the plot acted as the experimental unit, N and the number of plots were equivalent to 12 (Lazic et al., 2018).”
BackgroundWalejko, J. M., Antolic, A. T., Koelmel, J. P., Garrett, T. J., Edison, A. S., & KELLER-WOOD, M. E. (2019) · American Journal of Physiology-Endocrinology and Metabolism · doi:10.1152/ajpendo.00386.2018 · Cited by 23
“05), values in all three regions were used in further analyses as independent replicates, defining cardiac tissue as our experimental unit (29).”
MethodMendivil‐Perez, M., Felizardo-Otalvaro, A. A., Jiménez-Del-Río, M., & Velez‐Pardo, C. (2023) · ACS Chemical Neuroscience · doi:10.1021/acschemneuro.3c00176 · Cited by 22
Cardon, Z. G., Peredo, E. L., Dohnalkova, A. C., Gershone, H. L., & Bezanilla, M. (2018) · Journal of Cell Science · doi:10.1242/jcs.212233 · Cited by 22
“As Lazic et al. (2017) (preprint) note, for clonal organisms (or cell culture lines), the idea of biological replicates is not straightforward.”
BackgroundSmalheiser, N. R., Graetz, E. E., Yu, Z., & Wang, J. (2021) · PLoS ONE · doi:10.1371/journal.pone.0243668 · Cited by 24
Church, J. S., Tamayo, J. M., Ashwood, P., & Schwartzer, J. J. (2020) · Brain Behavior and Immunity · doi:10.1016/j.bbi.2020.12.014 · Cited by 23
“To control for pseudoreplication and litter-to-litter variations, offspring measures were evaluated using multilevel modeling to control for Type I error (Lazic and Essioux 2013; Lazic et al. 2018).”
MethodHebron, K. E., Wan, X., Roth, J. S., Liewehr, D. J., Sealover, N. E., Frye, W. J. E., Kim, A., Stauffer, S., Perkins, O. L., Sun, W., et al. (2022) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-22-1646 · Cited by 25
Keubler, L. M., Talbot, S. R., Bleich, A., & Boyle, E. C. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105316 · Cited by 23
Visual speech differentially modulates beta, theta, and high gamma bands in auditory cortex
Ganesan, K., Plass, J., Beltz, A. M., Liu, Z., Grabowecky, M., Suzuki, S., Stacey, W. C., Wasade, V. S., Towle, V. L., Tao, J. X., et al. (2021) · European Journal of Neuroscience · doi:10.1111/ejn.15482 · Cited by 21
“This approach has been discussed extensively under the title of ‘ pseudoreplication ’ and can lead to spurious and poorly generalized results (for a discussion, see Aarts et al., 2014; Lazic, 2010; Lazic et al., 2018).”
Between two stools: preclinical research, reproducibility, and statistical design of experiments
Reynolds, P. S. (2022) · BMC Research Notes · doi:10.1186/s13104-022-05965-w · Cited by 23
Smoothy, J., Larcombe, A. N., Chivers, E. K., Matthews, V. B., & Gorman, S. (2019) · Respiratory Research · doi:10.1186/s12931-019-0976-3 · Cited by 22
Soto‐Mercado, V., Mendivil‐Perez, M., Velez‐Pardo, C., & Jiménez-Del-Río, M. (2021) · Biomolecules · doi:10.3390/biom11121845 · Cited by 18
“, the biological and observational unit [35] were randomized to wells by simple randomization (sampling without replacement method), and then wells (i.”
MethodDynamic Heterochromatin States in Anisotropic Nuclei of Cells on Aligned Nanofibers
Liu, W., Padhi, A., Zhang, X., Narendran, J., Anastasio, M. A., Nain, A. S., & Irudayaraj, J. (2022) · ACS Nano · doi:10.1021/acsnano.2c02660 · Cited by 21
To pool or not to pool: That is the question in microbial kinetics
van Boekel, M. A. J. S. (2021) · International Journal of Food Microbiology · doi:10.1016/j.ijfoodmicro.2021.109283 · Cited by 18
Hypertonic Dextrose Stimulates Chondrogenic Cells to Deposit Collagen and Proliferate
Johnston, E., Kou, Y., Junge, J. A., Chen, L., Kochan, A., Johnston, M., & Rabago, D. (2021) · Cartilage · doi:10.1177/19476035211014572 · Cited by 17
Should Psychology Journals Adopt Specialized Statistical Review?
Hardwicke, T. E., Frank, M. C., Vazire, S., & Goodman, S. N. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919858428 · Cited by 23
“…(e.g., not identifying statistical procedures, ambiguously describing experimental units, not reporting data exclusions) Hardwicke et al. (2018); Lazic, Clarke-Williams, and Munafò (2018) Incomplete reporting of outcomes (e.g., not reporting effect sizes, interval estimates, or standard…”
BackgroundSoto‐Mercado, V., Mendivil‐Perez, M., Jiménez-Del-Río, M., & Velez‐Pardo, C. (2020) · Journal of Alzheimer s Disease · doi:10.3233/jad-201045 · Cited by 19
“The data from individual replicate wells were averaged to yield a value of n = 1 for that experiment and this was repeated on three occasions blind to the experimenter and/ or flow cytometer analyst for a final value of n = 3 [35].”
MethodOptimizing homology-directed repair for gene editing: the potential of single-stranded DNA donors
Jin, Y.-Y., Zhang, P., & Liu, D. (2025) · Trends in Genetics · doi:10.1016/j.tig.2025.04.014 · Cited by 22
Examining litter specific variability in mice and its impact on neurodevelopmental studies
Valiquette, V., Guma, E., Cupo, L., Gallino, D., Anastassiadis, C., Snook, E., Devenyi, G. A., & Chakravarty, M. M. (2023) · NeuroImage · doi:10.1016/j.neuroimage.2023.119888 · Cited by 23
Cairns, J., Leonard, E., Khan, K., Parks, C., Maglennon, G. A., Zhang, B., Lazic, S. E., Ewart, L. C., & David, R. M. (2023) · Frontiers in Pharmacology · doi:10.3389/fphar.2023.1142581 · Cited by 16
“In both cases, the experimental unit (Lazic et al., 2018) was the circuit, and therefore the sample size was the number of circuits.”
BackgroundSelf-citationA Medium-Throughput System for In Vitro Oxidative Stress Assessment in IPEC-J2 Cells
Ayuso, M., Cruchten, S. J. M. V., & Ginneken, C. J. V. (2020) · International Journal of Molecular Sciences · doi:10.3390/ijms21197263 · Cited by 17
“This is a problem commonly found in cell culture and animal experiments that leads to biased results, lower variation and increased false positives [63].”
BackgroundTamayo, J. M., Osman, H. C., Schwartzer, J. J., Pinkerton, K. E., & Ashwood, P. (2023) · Journal of Neuroinflammation · doi:10.1186/s12974-023-02930-7 · Cited by 20
“…cytokine data were analyzed using linear-mixed effects modeling to control for the unexplained residual variance that could be originating from litter-to-litter variations due to the hierarchical data structure in which statistical independence of observation is violated [12, 61, 62, 107, 122].”
MethodGiraldo-Berrio, D., Mendivil‐Perez, M., Velez‐Pardo, C., & Jiménez-Del-Río, M. (2024) · Neurotoxicity Research · doi:10.1007/s12640-024-00705-3 · Cited by 15
“Cells (i.e., the biological and observational unit (Lazic et al. 2018) were randomized to wells by simple randomization (sampling without replacement method), and then wells (i.e., the experimental units) were randomized to treatments by a similar method.”
Weissgerber, T. L. (2021) · PLoS Biology · doi:10.1371/journal.pbio.3001073 · Cited by 13
Jakobsen, E., Andersen, J. V., Christensen, S. K., Siamka, O., Larsen, M. R., Waagepetersen, H. S., Aldana, B. I., & Bak, L. K. (2021) · Glia · doi:10.1002/glia.24072 · Cited by 12
“The replicating experiments within a given assay were performed independently of each other and on an individual batch of astrocytes or brain (experimental unit; EU); the amount of replicating experiments are noted in the respective figure legends as “N” (Lazic et al., 2018).”
MethodReporting In Vitro Experiments Responsibly – the RIVER RecommendationsPreprint
The RIVER working group (2023) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/x6aut · Cited by 25
Improving transparency and scientific rigor in academic publishing
Prager, E. M., Chambers, K. E., Plotkin, J. L., McArthur, D. L., Bandrowski, A. E., Bansal, N., Martone, M. E., Bergstrom, H. C., Bespalov, A., & Graf, C. (2018) · Cancer Reports · doi:10.1002/cnr2.1150 · Cited by 21
“In considering the sample size, one must ensure that the experimental units are independently allocated to the experimental condition, the application of the condition is applied independently to the unit, and the experimental units do not influence one another.(43) A significant concern in cell biology is determining…”
InfluentialEstimating the replicability of Brazilian biomedical science
Initiative, T. B. R., Amaral, O. B., Carneiro, C. F. D., Neves, K., Sampaio, A. P. W., Gomes, B. V., Abreu, M. B. D., Tan, P. B., Mota, G. P. S., Goulart, R. N., et al. (2025) · bioRxiv · doi:10.1101/2025.04.02.645026 · Cited by 13
“…was underestimated in the published results, due to elimination of outliers (Gress et al., 2018; Holman et al., 2016), incorrect labeling of error bars (Cumming et al., 2007; Vaux, 2004), or insufficient biological variation among experimental units (Lazic et al., 2018; Vaux et al., 2012).”
How thoughtful experimental design can empower biologists in the omics era
Wagner, M. R., & Kleiner, M. (2025) · Nature Communications · doi:10.1038/s41467-025-62616-x · Cited by 22
Population sampling affects pseudoreplication
Jordan, C. Y. (2018) · PLoS Biology · doi:10.1371/journal.pbio.2007054 · Cited by 13
Lopes, C. C. C., Rocha, E., Pereira, I. L., & Madureira, T. V. (2021) · Aquatic Toxicology · doi:10.1016/j.aquatox.2021.105819 · Cited by 15
Leis‐Filho, A. F., Lainetti, P. D. F., Kobayashi, P. E., Fonseca‐Alves, C. E., & Amorim, R. L. (2021) · Pharmaceutics · doi:10.3390/pharmaceutics13060897 · Cited by 12
Multilevel modeling in food science: A case study on heat-induced ascorbic acid degradation kinetics
van Boekel, M. A. J. S., & Roux, S. (2022) · Food Research International · doi:10.1016/j.foodres.2022.111565 · Cited by 12
Schickore, J. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009348966 · Cited by 13
Plant Sample Preparation for Metabolomics, Lipidomics, Ionomics, Fluxomics, and Peptidomics
da Silva, W. B., Hispagnol, G. F., Nunes, E. V. D. S., Castro‐Gamboa, I., & Pilon, A. C. (2025) · Separations · doi:10.3390/separations12020021 · Cited by 13
Soto‐Mercado, V., Mendivil‐Perez, M., Velez‐Pardo, C., & Jiménez-Del-Río, M. (2023) · Journal of Alzheimer s Disease · doi:10.3233/jad-220903 · Cited by 13
“This experimental design was performed as previously reported in [20] and based on the statistics considerations described in [36].”
Recommendations to improve use and reporting of statistics in animal experiments
Rowe, A. (2022) · Laboratory Animals · doi:10.1177/00236772221140669 · Cited by 15
“person, animal, litter, cage, holding pen, fish tank, culture dish or a well in a microtiter plate).(56) It is the smallest unit which can receive different treatments and should be the unit of statistical analysis.”
BackgroundGomez-Sequeda, N., Jiménez-Del-Río, M., & Velez‐Pardo, C. (2024) · ACS Chemical Neuroscience · doi:10.1021/acschemneuro.4c00472 · Cited by 10
Lera-Ramírez, M., Nédélec, F., & Tran, P. T. (2022) · eLife · doi:10.7554/elife.72630 · Cited by 13
Mendivil‐Perez, M., Velez‐Pardo, C., Lopera, F. J., Kosik, K. S., & Jiménez-Del-Río, M. (2023) · International Journal of Molecular Sciences · doi:10.3390/ijms24108957 · Cited by 10
Bonilla-Porras, A. R., Jiménez-Del-Río, M., & Velez‐Pardo, C. (2019) · Molecular Biology Reports · doi:10.1007/s11033-019-04897-2 · Cited by 11
Effects of amotosalen treatment on human platelet lysate bioactivity: A proof-of-concept study
Christensen, C., Jonsdottir-Buch, S. M., & Sigurjónsson, Ó. E. (2020) · PLoS ONE · doi:10.1371/journal.pone.0220163 · Cited by 12
Genuine replication and pseudoreplication
Lazic, S. E. (2022) · Nature Reviews Methods Primers · doi:10.1038/s43586-022-00114-w · Cited by 10
Self-citationA host of issues: pseudoreplication in host–microbiota studies
Reish, H. M., Dewey, L., & Kirschman, L. J. (2024) · Applied and Environmental Microbiology · doi:10.1128/aem.01033-24 · Cited by 11
Metadata
- Authors
- Lazic, S. E., Clarke-Williams, C. J., & Munafò, M. R.
- Affiliations
- AstraZeneca (United Kingdom) (GB)
- University of Bristol (GB)
- Corresponding author
- Lazic, Stanley E.
- Clarke-Williams, Charlie J.
- ORCID
- Lazic, Stanley E.
- Venue
- PLOS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2018-04-04
- Volume
- 16
- Issue
- 4
- Pages
- e2005282
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- PMC
- PMC5902037
- OpenAlex
- W2953238030
- Cited by
- 291
- References
- 43
- Citations by year
- 2026: 66 · 2025: 39 · 2024: 30 · 2023: 30 · 2022: 44 · 2021: 32 · 2020: 26 · 2019: 18 · 2018: 6
- FWCI
- 29.99
- Type
- journal article
- Language
- en
- Update notices
- new_version (2018-04-16)
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Biology (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Bristol Research (University of Bristol) (publishedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Explore Bristol Research (submittedVersion, cc-by)
- Funders
- United Kingdom Clinical Research Collaboration
- Cancer Research UK
- National Institute for Health and Care Research
- British Heart Foundation
- Medical Research Council (12013/6, MC_UU_12013/6)
- Economic and Social Research Council
- Topics
- Health Sciences › Veterinary › Small Animals › Animal testing and alternatives
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Philosophy of Biology and Scientific Explanation
- Keywords
- pseudoreplication, sample size, replication, animal experimentation, experimental units, statistical inference, false positives, cell culture
- MeSH terms
- Animals, Humans, Research Design, Statistics as Topic, Reproducibility of Results, Guidelines as Topic, Sample Size, Animal Experimentation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.