CoChat

#EEGManyLabs: Investigating the replicability of influential EEG experiments

Open access
Pavlov, Yuri G., Adamian, Nika, Appelhoff, Stefan, Arvaneh, Mahnaz, Benwell, Christopher S.Y., Beste, Christian, Bland, Amy R., Bradford, Daniel E., Bublatzky, Florian, Busch, Niko A., Clayson, Peter E., Cruse, Damian, Czeszumski, Artur, Dreber, Anna, Dumas, Guillaume, Ehinger, Benedikt, Ganis, Giorgio, He, Xun, Hinojosa, José A., Huber-Huber, Christoph, Inzlicht, Michael, Jack, Bradley N., Johannesson, Magnus, Jones, Rhiannon, Kalenkovich, Evgenii, Kaltwasser, Laura, Karimi-Rouzbahani, Hamid, Keil, Andreas, König, Peter, Kouara, Layla, Kulke, Louisa, Ladouceur, Cecile D., Langer, Nicolas, Liesefeld, Heinrich R., Luque, David, MacNamara, Annmarie, Mudrik, Liad, Muthuraman, Muthuraman, Neal, Lauren B., Nilsonne, Gustav, Niso, Guiomar, Ocklenburg, Sebastian, Oostenveld, Robert, Pernet, Cyril R., Pourtois, Gilles, Ruzzoli, Manuela, Sass, Sarah M., Schaefer, Alexandre, Senderecka, Magdalena, Snyder, Joel S., Tamnes, Christian K., Tognoli, Emmanuelle, van Vugt, Marieke K., Verona, Edelyn, Vloeberghs, Robin, Welke, Dominik, Wessel, Jan R., Zakharov, Ilya, Mushtaq, Faisal · 2021 · Cortex
Cited by 127

The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.

Abstract

There is growing awareness across the neuroscience community that the replicability of findings about the relationship between brain activity and cognitive phenomena can be improved by conducting studies with high statistical power that adhere to well-defined and standardised analysis pipelines. Inspired by recent efforts from the psychological sciences, and with the desire to examine some of the foundational findings using electroencephalography (EEG), we have launched #EEGManyLabs, a large-scale international collaborative replication effort. Since its discovery in the early 20th century, EEG has had a profound influence on our understanding of human cognition, but there is limited evidence on the replicability of some of the most highly cited discoveries. After a systematic search and selection process, we have identified 27 of the most influential and continually cited studies in the field. We plan to directly test the replicability of key findings from 20 of these studies in teams of at least three independent laboratories. The design and protocol of each replication effort will be submitted as a Registered Report and peer-reviewed prior to data collection. Prediction markets, open to all EEG researchers, will be used as a forecasting tool to examine which findings the community expects to replicate. This project will update our confidence in some of the most influential EEG findings and generate a large open access database that can be used to inform future research practices. Finally, through this international effort, we hope to create a cultural shift towards inclusive, high-powered multi-laboratory collaborations.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.cortex.2021.03.013

Cites

33 of 33 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 33 references

Cited by

Metadata

Authors
Pavlov, Y. G., Adamian, N., Appelhoff, S., Arvaneh, M., Benwell, C. S. Y., Beste, C., Bland, A. R., Bradford, D. E., Bublatzky, F., Busch, N. A., Clayson, P. E., Cruse, D., Czeszumski, A., Dreber, A., Dumas, G., Ehinger, B., Ganis, G., He, X., Hinojosa, J. A., Huber-Huber, C., Inzlicht, M., Jack, B. N., Johannesson, M., Jones, R., Kalenkovich, E., Kaltwasser, L., Karimi-Rouzbahani, H., Keil, A., König, P., Kouara, L., Kulke, L., Ladouceur, C. D., Langer, N., Liesefeld, H. R., Luque, D., MacNamara, A., Mudrik, L., Muthuraman, M., Neal, L. B., Nilsonne, G., Niso, G., Ocklenburg, S., Oostenveld, R., Pernet, C. R., Pourtois, G., Ruzzoli, M., Sass, S. M., Schaefer, A., Senderecka, M., Snyder, J. S., Tamnes, C. K., Tognoli, E., van Vugt, M. K., Verona, E., Vloeberghs, R., Welke, D., Wessel, J. R., Zakharov, I., & Mushtaq, F.
Venue
Cortex
Publisher
Elsevier BV
Published
2021-11
Volume
144
Pages
213-229
ISSN
0010-9452 (ISSN-L)
OpenAlex
W3141370374
Cited by
127
References
33
FWCI
10.37
Type
journal article
Language
en
Open access
hybrid

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.