The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Sample Size, Statistical Power, and False Conclusions in Infant Looking‐Time Research
Open accessAbstract
Infant research is hard. It is difficult, expensive, and time‐consuming to identify, recruit, and test infants. As a result, ours is a field of small sample sizes. Many studies using infant looking time as a measure have samples of 8–12 infants per cell, and studies with more than 24 infants per cell are uncommon. This paper examines the effect of such sample sizes on statistical power and the conclusions drawn from infant looking‐time research. An examination of the state of the current literature suggests that most published looking‐time studies have low power, which leads in the long run to an increase in both false positive and false negative results. Three data sets with relatively large samples (>30 infants) were used to simulate experiments with smaller sample sizes; 1,000 random subsamples of 8, 12, 16, 20, and 24 infants from the overall samples were selected, making it possible to examine the systematic effect of sample size on the results. This approach revealed that despite clear results with the original large samples, the results with smaller subsamples were highly variable, yielding both false positive and false negative outcomes. Finally, a number of emerging possible solutions are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Lakens, D. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00863 · Cited by 10,303
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · cited 9×
“Gazes, Hampton, and Lourenco (2015) 32 F(1, 28) = 10.”
BackgroundMethodInfluentialSimmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Bayesian t tests for accepting and rejecting the null hypothesis
Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.2.225 · Cited by 3,688
New Effect Size Rules of Thumb
Sawilowsky, S. S. (2009) · Journal of Modern Applied Statistical Methods · doi:10.22237/jmasm/1257035100 · Cited by 3,254
How to Use a Monte Carlo Study to Decide on Sample Size and Determine Power
Muthén, L. K., & Muthén, B. O. (2002) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0904_8 · Cited by 2,362
Social evaluation by preverbal infants
Hamlin, J. K., Wynn, K., & Bloom, P. (2007) · Nature · doi:10.1038/nature06288 · Cited by 1,566
P-curve: A key to the file-drawer.
Simonsohn, U., Nelson, L. D., & Simmons, J. P. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0033242 · Cited by 1,500
Experimental methods: Between-subject and within-subject design
Charness, G., Gneezy, U., & Kuhn, M. A. (2012) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2011.08.009 · Cited by 1,469
The Extent and Consequences of P-Hacking in Science
Head, M. L., Holman, L., Lanfear, R., Kahn, A. T., & Jennions, M. D. (2015) · PLOS Biology · doi:10.1371/journal.pbio.1002106 · Cited by 1,388
What are the odds? A practical guide to computing and reporting Bayes factors
Jarosz, A. F., & Wiley, J. (2014) · The Journal of Problem Solving · doi:10.7771/1932-6246.1167 · Cited by 1,101
p -Curve and Effect Size: Correcting for Publication Bias Using Only Significant Results
Simonsohn, U., Nelson, L. D., & Simmons, J. P. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691614553988 · Cited by 717
Estimating sample size in functional MRI (fMRI) neuroimaging studies: Statistical power analyses
Desmond, J. E., & Glover, G. H. (2002) · Journal of Neuroscience Methods · doi:10.1016/s0165-0270(02)00121-8 · Cited by 716 · cited 1×
“…online DOI: 10.1111/infa.12186 THE OFFICIAL JOURNAL OF THE INTERNATIONAL CONGRESS OF INFANT STUDIES There have been discussions and debate about the issue of sample sizes in science broadly, and how decisions about sample size contribute to statistical power (see, e.g., Desmond & Glover, 2002).”
BackgroundInfluentialThe prevalence of statistical reporting errors in psychology (1985–2013)
Nuijten, M. B., Hartgerink, C. H. J., van Assen, M. A. L. M., Epskamp, S., & Wicherts, J. M. (2016) · Behavior Research Methods · doi:10.3758/s13428-015-0664-2 · Cited by 510
Performing high‐powered studies efficiently with sequential analyses
Lakens, D. (2014) · European Journal of Social Psychology · doi:10.1002/ejsp.2023 · Cited by 414
Fraley, R. C., & Vazire, S. (2014) · PLoS ONE · doi:10.1371/journal.pone.0109019 · Cited by 409
Lakens, D., & Evers, E. R. K. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691614528520 · Cited by 266 · cited 1×
“Others have explored the value of pcurving, or the evaluation of the distribution of p-values across a set of experiments (Lakens & Evers, 2014; Simonsohn, Nelson, & Simmons, 2014a,b).”
BackgroundUnderpowered samples, false negatives, and unconscious learning
Vadillo, M. A., Konstantinidis, E., & Shanks, D. R. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-015-0892-6 · Cited by 255
Outlier Removal and the Relation with Reporting Errors and Quality of Psychological Research
Bakker, M., & Wicherts, J. M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0103360 · Cited by 101
Article Commentary: On the Persistence of Low Power in Psychological Science
Vankov, I., Bowers, J., & Munafò, M. R. (2014) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2014.885986 · Cited by 82
Cited by
Quantifying Sources of Variability in Infancy Research Using the Infant-Directed-Speech Preference
The ManyBabies Consortium, Frank, M. C., Alcock, K. J., Arias-Trejo, N., Aschersleben, G., Baldwin, D., Barbu, S., Bergelson, E., Bergmann, C., Black, A. K., et al. (2020) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919900809 · Cited by 337
Psychological measurement and the replication crisis: Four sacred cows
Lilienfeld, S. O., & Strother, A. N. (2020) · Canadian Psychology / Psychologie canadienne · doi:10.1037/cap0000236 · Cited by 144
“For example, many studies in the infant looking-time literature rely on samples of eight to 12 participants per cell, rendering findings difficult to replicate (Oakes, 2017; see also Bergmann et al., 2018 for a discussion of low statistical power in infant and child language acquisition research).”
BackgroundColes, N. A., Hamlin, J. K., Sullivan, L. L., Parker, T. H., & Altschul, D. (2022) · Nature · doi:10.1038/d41586-022-00150-2 · Cited by 86
Pammi, M., Shah, P. S., Yang, L. K., Hagan, J., Aghaeepour, N., & Neu, J. (2025) · The Lancet Digital Health · doi:10.1016/j.landig.2025.01.007 · Cited by 60
Metadata
- Authors
- Oakes, L. M.
- Venue
- Infancy
- Publisher
- Wiley
- Published
- 2017-04-05
- Volume
- 22
- Issue
- 4
- Pages
- 436-469
- ISSN
- 1525-0008 (ISSN-L)
- 1532-7078
- OpenAlex
- W2604868994
- Cited by
- 248
- References
- 21
- FWCI
- 43.94
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.