The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
How many trials does it take to get a significant ERP effect? It depends
Open accessAbstract
In designing an ERP study, researchers must choose how many trials to include, balancing the desire to maximize statistical power and the need to minimize the length of the recording session. Recent studies have attempted to quantify the minimum number of trials needed to obtain reliable measures for a variety of ERP components. However, these studies have largely ignored other variables that affect statistical power in ERP studies, including sample size and effect magnitude. The goal of the present study was to determine whether and how the number of trials, number of participants, and effect magnitude interact to influence statistical power, thus providing a better guide for selecting an appropriate number of trials. We used a Monte Carlo approach to measure the probability of obtaining a statistically significant result when testing for (a) the presence of an ERP effect, (b) within‐participant condition differences in an ERP effect, and (c) between‐participants group differences in an ERP effect. Each of these issues was examined in the context of the error‐related negativity and the lateralized readiness potential. We found that doubling the number of trials recommended by previous studies led to more than a doubling of statistical power under many conditions. Thus, when determining the number of trials that should be included in a given study, researchers must consider the sample size, the anticipated effect magnitude, and the noise level, rather than relying solely on general recommendations about the number of trials needed to obtain a “stable” ERP waveform.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500
Delorme, A., & Makeig, S. (2004) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2003.10.009 · Cited by 24,371
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641
Effects of noise letters upon the identification of a target letter in a nonsearch task
Eriksen, B. A., & Eriksen, C. W. (1974) · Perception & Psychophysics · doi:10.3758/bf03203267 · Cited by 7,230
(2005) · Cited by 5,977
ERPLAB: an open-source toolbox for the analysis of event-related potentials
Lopez-Calderon, J., & Luck, S. J. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00213 · Cited by 2,584
Self-citationThe Oxford Handbook of Event-Related Potential Components
(2011) · doi:10.1093/oxfordhb/9780195374148.001.0001 · Cited by 2,263
Jung, T.-P., Makeig, S., Westerfield, M., Townsend, J., Courchesne, E., & Sejnowski, T. J. (2000) · Clinical Neurophysiology · doi:10.1016/s1388-2457(00)00386-2 · Cited by 1,322
Duncan, C. C., Barry, R. J., Connolly, J. F., Fischer, C., Michie, P. T., Näätänen, R., Polich, J., Reinvang, I., & Van Petten, C. (2009) · Clinical Neurophysiology · doi:10.1016/j.clinph.2009.07.045 · Cited by 1,191
Mass univariate analysis of event‐related brain potentials/fields I: A critical tutorial review
Groppe, D. M., Urbach, T. P., & Kutas, M. (2011) · Psychophysiology · doi:10.1111/j.1469-8986.2011.01273.x · Cited by 1,169
On the Asymptotic Accuracy of Efron's Bootstrap
Singh, K. (1981) · The Annals of Statistics · doi:10.1214/aos/1176345636 · Cited by 760
The stability of error‐related brain activity with increasing trials
Olvet, D. M., & Hajcak, G. (2009) · Psychophysiology · doi:10.1111/j.1469-8986.2009.00848.x · Cited by 453
The effects of electrode impedance on data quality and statistical significance in ERP recordings
Kappenman, E. S., & Luck, S. J. (2010) · Psychophysiology · doi:10.1111/j.1469-8986.2010.01009.x · Cited by 447
Self-citationKiesel, A., Miller, J., Jolicœur, P., & Brisson, B. (2008) · Psychophysiology · doi:10.1111/j.1469-8986.2007.00618.x · Cited by 424
Using the jackknife-based scoring method for measuring LRP onset effects in factorial designs
Ulrich, R., & Miller, J. O. (2001) · Psychophysiology · doi:10.1017/s0048577201000610 · Cited by 417
The lateralized readiness potential as an on-line measure of central response activation processes
Eimer, M. (1998) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03209424 · Cited by 275 · cited 1×
“The LRP is an ERP that is associated with the selection and preparation of a lateralized manual response (see Eimer, 1998; Smulders & Miller, 2012, for reviews).”
MethodOn the number of trials needed for P300
Cohen, J., & Polich, J. (1997) · International Journal of Psychophysiology · doi:10.1016/s0167-8760(96)00743-x · Cited by 252
The (±) Reference: Accuracy of Estimated Mean Components in Average Response Studies
Schimmel, H. (1967) · Science · doi:10.1126/science.157.3784.92 · Cited by 214
Pontifex, M. B., Scudder, M. R., Brown, M. L., O'Leary, K. C., Wu, C.-T., Themanson, J. R., & Hillman, C. H. (2010) · Psychophysiology · doi:10.1111/j.1469-8986.2010.00974.x · Cited by 201
The reliability of ERP components in the auditory oddball paradigm
SEGALOWITZ, S. J., & BARNES, K. L. (1993) · Psychophysiology · doi:10.1111/j.1469-8986.1993.tb02068.x · Cited by 181
Reliability of event-related potentials: The influence of number of trials and electrodes
Huffmeijer, R., Bakermans-Kranenburg, M. J., Alink, L. R. A., & van IJzendoorn, M. H. (2014) · Physiology & Behavior · doi:10.1016/j.physbeh.2014.03.008 · Cited by 162
On the number of trials needed for a stable feedback‐related negativity
Marco‐Pallares, J., Cucurell, D., Münte, T. F., Strien, N., & Rodriguez‐Fornells, A. (2011) · Psychophysiology · doi:10.1111/j.1469-8986.2010.01152.x · Cited by 158
Assessing the internal consistency of the event‐related potential: An example analysis
Thigpen, N., Kappenman, E. S., & Keil, A. (2016) · Psychophysiology · doi:10.1111/psyp.12629 · Cited by 138
Self-citationInternal Consistency of Event-Related Potentials Associated with Cognitive Control: N2/P3 and ERN/Pe
Rietdijk, W. J. R., Franken, I. H. A., & Thurik, R. (2014) · PLoS ONE · doi:10.1371/journal.pone.0102672 · Cited by 129
Larson, M. J., Baldwin, S. A., Good, D. A., & Fair, J. E. (2010) · Psychophysiology · doi:10.1111/j.1469-8986.2010.01022.x · Cited by 101
Fischer, A. G., Klein, T. A., & Ullsperger, M. (2017) · Psychophysiology · doi:10.1111/psyp.12863 · Cited by 83
Steele, V. R., Anderson, N. E., Claus, E. D., Bernat, E. M., Rao, V. R., Assaf, M., Pearlson, G. D., Calhoun, V. D., & Kiehl, K. A. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.02.046 · Cited by 82
Resampling approach to statistical inference: Bootstrapping from event-related potentials data
Nocera, F. D., & Ferlazzo, F. (2000) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03200793 · Cited by 81
Combating the scientific decline effect with confidence (intervals)
Groppe, D. M. (2016) · Psychophysiology · doi:10.1111/psyp.12616 · Cited by 24
Cited by
ERP CORE: An open resource for human event-related potential research
Kappenman, E. S., Farrens, J. L., Zhang, W., Stewart, A. X., & Luck, S. J. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2020.117465 · Cited by 223
Self-citationClayson, P. E., Baldwin, S. A., & Larson, M. J. (2021) · Psychophysiology · doi:10.1111/psyp.13762 · Cited by 84
Multimodal mechanisms of human socially reinforced learning across neurodegenerative diseases
Legaz, A., Abrevaya, S., Dottori, M., González Campo, C., Birba, A., Martorell Caro, M., Aguirre, J., Slachevsky, A., Aranguiz, R., Serrano, C., et al. (2022) · Brain · doi:10.1093/brain/awab345 · Cited by 34
LoTemplio, S. B., Lopes, C. L., McDonnell, A. S., Scott, E. E., Payne, B. R., & Strayer, D. L. (2023) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2023.1150244 · Cited by 25
Piatti, A., Van der Paelt, S., Warreyn, P., & Roeyers, H. (2021) · Research in Autism Spectrum Disorders · doi:10.1016/j.rasd.2021.101805 · Cited by 9
Metadata
- Authors
- Boudewyn, M. A., Luck, S. J., Farrens, J. L., & Kappenman, E. S.
- Venue
- Psychophysiology
- Publisher
- Wiley
- Published
- 2017-12-20
- Volume
- 55
- Issue
- 6
- Pages
- e13049-e13049
- ISSN
- 0048-5772 (ISSN-L)
- 1469-8986
- OpenAlex
- W2776946429
- Cited by
- 323
- References
- 29
- FWCI
- 7.44
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.