The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Mass univariate analysis of event‐related brain potentials/fields I: A critical tutorial review
Open accessAbstract
Event‐related potentials (ERPs) and magnetic fields (ERFs) are typically analyzed via ANOVAs on mean activity in a priori windows. Advances in computing power and statistics have produced an alternative, mass univariate analyses consisting of thousands of statistical tests and powerful corrections for multiple comparisons. Such analyses are most useful when one has little a priori knowledge of effect locations or latencies, and for delineating effect boundaries. Mass univariate analyses complement and, at times, obviate traditional analyses. Here we review this approach as applied to ERP/ERF data and four methods for multiple comparison correction: strong control of the familywise error rate (FWER) via permutation tests, weak control of FWER via cluster‐based permutation tests, false discovery rate control, and control of the generalized FWER. We end with recommendations for their use and introduce free MATLAB software for their implementation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Delorme, A., & Makeig, S. (2004) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2003.10.009 · Cited by 24,371
Feinleib, M., & Zar, J. H. (1975) · Journal of the American Statistical Association · doi:10.2307/2285423 · Cited by 12,680
The control of the false discovery rate in multiple testing under dependency
Benjamini, Y., & Yekutieli, D. (2001) · The Annals of Statistics · doi:10.1214/aos/1013699998 · Cited by 10,490
Oostenveld, R., Fries, P., Maris, E., & Schoffelen, J.-M. (2011) · Computational Intelligence and Neuroscience · doi:10.1155/2011/156869 · Cited by 10,323
Nonparametric statistical testing of EEG- and MEG-data
Maris, E., & Oostenveld, R. (2007) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2007.03.024 · Cited by 8,496
Biostatistical Analysis (2nd ed.).
Breen, T. J., & Zar, J. H. (1986) · Journal of the American Statistical Association · doi:10.2307/2289268 · Cited by 5,781
Randomization, Bootstrap and Monte Carlo Methods in Biology
Manly, B. F. J. (2018) · Chapman & Hall/CRC eBooks · doi:10.1201/9781315273075 · Cited by 4,194
Speed of processing in the human visual system
Thorpe, S., Fize, D., & Marlot, C. (1996) · Nature · doi:10.1038/381520a0 · Cited by 3,538
Adaptive linear step-up procedures that control the false discovery rate
Benjamini, Y., Krieger, A. M., & Yekutieli, D. (2006) · Biometrika · doi:10.1093/biomet/93.3.491 · Cited by 3,228
Circular analysis in systems neuroscience: the dangers of double dipping
Kriegeskorte, N., Simmons, W. K., Bellgowan, P. S. F., & Baker, C. I. (2009) · Nature Neuroscience · doi:10.1038/nn.2303 · Cited by 2,696
Shaffer, J. P. (1995) · Annual Review of Psychology · doi:10.1146/annurev.ps.46.020195.003021 · Cited by 1,960
Electrical Signs of Selective Attention in the Human Brain
Hillyard, S. A., Hink, R. F., Schwent, V. L., & Picton, T. W. (1973) · Science · doi:10.1126/science.182.4108.177 · Cited by 1,934
Randomization, Bootstrap and Monte Carlo Methods in Biology.
Kemp, A. W., & Manly, B. F. J. (1997) · Biometrics · doi:10.2307/2533527 · Cited by 1,927
Permutation tests for univariate or multivariate analysis of variance and regression
Anderson, M. J. (2001) · Canadian Journal of Fisheries and Aquatic Sciences · doi:10.1139/cjfas-58-3-626 · Cited by 1,495
Controlling the familywise error rate in functional neuroimaging: a comparative review
Nichols, T., & Hayasaka, S. (2003) · Statistical Methods in Medical Research · doi:10.1191/0962280203sm341ra · Cited by 1,218
Bullmore, E. T., Suckling, J., Overmeyer, S., Rabe-Hesketh, S., Taylor, E., & Brammer, M. J. (1999) · IEEE Transactions on Medical Imaging · doi:10.1109/42.750253 · Cited by 1,088
Large-Scale Simultaneous Hypothesis Testing: The Choice of a Null Hypothesis
Efron, B. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000000089 · Cited by 1,005
Event-Related Potentials: A Methods Handbook
Loiselle, D. L. (2006) · Neurology · doi:10.1212/01.wnl.0000217365.45426.9a · Cited by 766
Yekutieli, D., & Benjamini, Y. (1999) · Journal of Statistical Planning and Inference · doi:10.1016/s0378-3758(99)00041-5 · Cited by 753
Bentin, S., Mouchetant-Rostaing, Y., Giard, M. H., Echallier, J. F., & Pernier, J. (1999) · Journal of Cognitive Neuroscience · doi:10.1162/089892999563373 · Cited by 725
Statistical Parametric Mapping
Friston, K. J. (2003) · Neuroscience Databases · doi:10.1007/978-1-4615-1079-6_16 · Cited by 678
An alternative method for significance testing of waveform difference potentials
BLAIR, R. C., & KARNISKI, W. (1993) · Psychophysiology · doi:10.1111/j.1469-8986.1993.tb02075.x · Cited by 597
Permutation, Parametric, and Bootstrap Tests of Hypotheses
(2005) · Technometrics · doi:10.1198/tech.2005.s333 · Cited by 412
Controlling the number of false discoveries: application to high-dimensional genomic data
Korn, E. L., Troendle, J. F., McShane, L. M., & Simon, R. (2004) · Journal of Statistical Planning and Inference · doi:10.1016/s0378-3758(03)00211-8 · Cited by 248
Timecourse of neural signatures of object recognition
Johnson, J. S., & Olshausen, B. A. (2003) · Journal of Vision · doi:10.1167/3.7.4 · Cited by 235
Farcomeni, A. (2008) · Statistical Methods in Medical Research · doi:10.1177/0962280206079046 · Cited by 225
Everything You Never Wanted to Know about Circular Analysis, but Were Afraid to Ask
Kriegeskorte, N., Lindquist, M. A., Nichols, T. E., Poldrack, R. A., & Vul, E. (2010) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.2010.86 · Cited by 214
Mass univariate analysis of event‐related brain potentials/fields II: Simulation studies
Groppe, D. M., Urbach, T. P., & Kutas, M. (2011) · Psychophysiology · doi:10.1111/j.1469-8986.2011.01272.x · Cited by 212
Self-citationIdentifying reliable independent components via split-half comparisons
Groppe, D. M., Makeig, S., & Kutas, M. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.12.038 · Cited by 207
Self-citationPermutation, Parametric, and Bootstrap Tests of Hypotheses
Annis, D. H. (2005) · Journal of the American Statistical Association · doi:10.1198/jasa.2005.s48 · Cited by 195
FORMALIZED DATA SNOOPING BASED ON GENERALIZED ERROR RATES
Romano, J. P., Shaikh, A. M., & Wolf, M. (2008) · Econometric Theory · doi:10.1017/s0266466608080171 · Cited by 185
Hauk, O., Patterson, K., Woollams, A., Watling, L., Pulvermüller, F., & Rogers, T. T. (2006) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2006.18.5.818 · Cited by 162
Electrical and magnetic readings of mental functions
Marta Kutas, A., & Dale, A. M. (1997) · Cited by 149
False discovery rate and permutation test: An evaluation in ERP data analysis
Lage‐Castellanos, A., Martínez‐Montes, E., Hernandez-Cabrera, J. A., & Galán, L. (2009) · Statistics in Medicine · doi:10.1002/sim.3784 · Cited by 145
Gelman, A., & Weakliem, D. L. (2009) · American Scientist · doi:10.1511/2009.79.310 · Cited by 137
Posner, M. I., & Desimone, R. (1998) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(98)80137-2 · Cited by 125
Statistical parametric mapping for event-related potentials: I. Generic considerations
Kiebel, S. J., & Friston, K. J. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.02.012 · Cited by 115
Robustness of multiple testing procedures against dependence
Clarke, S., & Hall, P. (2009) · The Annals of Statistics · doi:10.1214/07-aos557 · Cited by 104
Statistical Analysis of fMRI Data
Woolrich, M. W., Beckmann, C. F., Nichols, T. E., & Smith, S. M. (2009) · Neuromethods · doi:10.1007/978-1-60327-919-2_7 · Cited by 67
Semantic Processing of Spoken Words in Alzheimer's Disease: An Electrophysiological Study
Revonsuo, A., Portin, R. I., Juottonen, K., & Rinne, J. O. (1998) · Journal of Cognitive Neuroscience · doi:10.1162/089892998562726 · Cited by 50
Stepwise normal theory multiple test procedures controlling the false discovery rate
Troendle, J. F. (2000) · Journal of Statistical Planning and Inference · doi:10.1016/s0378-3758(99)00145-7 · Cited by 48
New concepts of multiple tests and their use for evaluating high-dimensional EEG data
Hemmelmann, C., Horn, M., Süße, T., Vollandt, R., & Weiß, S. (2004) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2004.08.008 · Cited by 41
Groppe, D. M., Choi, M., Huang, T., Schilz, J., Topkins, B., Urbach, T. P., & Marta Kutas, A. (2010) · Brain Research · doi:10.1016/j.brainres.2010.09.003 · Cited by 38
Self-citationMultivariate tests for the evaluation of high-dimensional EEG data
Hemmelmann, C., Horn, M., Reiterer, S., Schack, B., Süße, T., & Weiß, S. (2004) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2004.04.013 · Cited by 30
Hemmelmann, C., Ziegler, A., Guiard, V., Weiß, S., Walther, M., & Vollandt, R. (2008) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2007.12.013 · Cited by 7
Cited by
ERPLAB: an open-source toolbox for the analysis of event-related potentials
Lopez-Calderon, J., & Luck, S. J. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00213 · Cited by 2,584
How to get statistically significant effects in any ERP experiment (and why you shouldn't)
Luck, S. J., & Gaspelin, N. (2017) · Psychophysiology · doi:10.1111/psyp.12639 · Cited by 1,195
Keil, A., Debener, S., Gratton, G., Junghöfer, M., Kappenman, E. S., Luck, S. J., Luu, P., Miller, G. A., & Yee, C. M. (2014) · Psychophysiology · doi:10.1111/psyp.12147 · Cited by 699
Sassenhagen, J., & Draschkow, D. (2019) · Psychophysiology · doi:10.1111/psyp.13335 · Cited by 545
Adults with autism overestimate the volatility of the sensory environment
Lawson, R. P., Mathys, C., & Rees, G. (2017) · Nature Neuroscience · doi:10.1038/nn.4615 · Cited by 470
Metadata
- Authors
- Groppe, D. M., Urbach, T. P., & Kutas, M.
- Venue
- Psychophysiology
- Publisher
- Wiley
- Published
- 2011-09-06
- Volume
- 48
- Issue
- 12
- Pages
- 1711-1725
- ISSN
- 0048-5772 (ISSN-L)
- 1469-8986
- OpenAlex
- W1605458923
- Cited by
- 1,169
- References
- 46
- FWCI
- 12.21
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.