CoChat

Reproducibility in TMS–EEG studies: A call for data sharing, standard procedures and effective experimental control

Open access
Belardinelli, Paolo, Biabani, Mana, Blumberger, Daniel M., Bortoletto, Marta, Casarotto, Silvia, David, Olivier, Desideri, Debora, Etkin, Amit, Ferrarelli, Fabio, Fitzgerald, Paul B., Fornito, Alex, Gordon, Pedro C., Gosseries, Olivia, Harquel, Sylvain, Julkunen, Petro, Keller, Corey J., Kimiskidis, Vasilios K., Lioumis, Pantelis, Miniussi, Carlo, Rosanova, Mario, Rossi, Simone, Sarasso, Simone, Wu, Wei, Zrenner, Christoph, Daskalakis, Zafiris J., Rogasch, Nigel C., Massimini, Marcello, Ziemann, Ulf, Ilmoniemi, Risto J. · 2019 · Brain Stimulation
Cited by 137

The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.

Abstract

A recent study by Conde, Tomasevic et al. (2019) [[1]Conde V. Tomasevic L. Akopian I. Stanek K. Saturnino G.B. Thielscher A. et al.The non-transcranial TMS-evoked potential is an inherent source of ambiguity in TMS-EEG studies.Neuroimage. 2019; 185: 300-312https://doi.org/10.1016/j.neuroimage.2018.10.052Crossref PubMed Scopus (139) Google Scholar] puts a spotlight on the subtleties of experimental design and analysis of studies involving TMS-evoked EEG potentials (TEPs), specifically focusing on the challenge of disentangling genuine cortical responses to TMS from those resulting from concomitant sensory activation. This is a relevant topic that the TMS–EEG community has previously identified [[2]Ilmoniemi R.J. Kičić D. Methodology for combined TMS and EEG.Brain Topogr. 2010; 22: 233-248https://doi.org/10.1007/s10548-009-0123-4Crossref PubMed Scopus (256) Google Scholar] and addressed with different strategies [3Gordon P.C. Desideri D. Belardinelli P. Zrenner C. Ziemann U. Comparison of cortical EEG responses to realistic sham versus real TMS of human motor cortex.Brain Stimul. 2018; 11: 1322-1330https://doi.org/10.1016/j.brs.2018.08.003Abstract Full Text Full Text PDF PubMed Scopus (52) Google Scholar, 4Gosseries O. Sarasso S. Casarotto S. Boly M. Schnakers C. Napolitani M. et al.On the cerebral origin of EEG responses to TMS: insights from severe cortical lesions.Brain Stimul. 2015; 8: 142-149https://doi.org/10.1016/j.brs.2014.10.008Abstract Full Text Full Text PDF PubMed Scopus (57) Google Scholar, 5Herring J.D. Thut G. Jensen O. Bergmann T.O. Attention modulates TMS-locked alpha oscillations in the visual cortex.J Neurosci. 2015; 35: 14435-14447https://doi.org/10.1523/JNEUROSCI.1833-15.2015Crossref PubMed Scopus (116) Google Scholar, 6Nikouline V. Ruohonen J. Ilmoniemi R.J. The role of the coil click in TMS assessed with simultaneous EEG.Clin Neurophysiol. 1999; 110: 1325-1328https://doi.org/10.1016/S1388-2457(99)00070-XCrossref PubMed Scopus (195) Google Scholar]. Based on the similarity of the evoked EEG responses they obtained in real TMS at different sites and in sham conditions (auditory and somatosensory scalp stimulation), the authors of [[1]Conde V. Tomasevic L. Akopian I. Stanek K. Saturnino G.B. Thielscher A. et al.The non-transcranial TMS-evoked potential is an inherent source of ambiguity in TMS-EEG studies.Neuroimage. 2019; 185: 300-312https://doi.org/10.1016/j.neuroimage.2018.10.052Crossref PubMed Scopus (139) Google Scholar] inferred that TEPs can be significantly contaminated by the effects of concurrent, non-transcranial stimulation. We acknowledge this is a valuable reminder to the TMS-EEG community; however, we contend that another fundamental implication of the work by Conde, Tomasevic and colleagues [[1]Conde V. Tomasevic L. Akopian I. Stanek K. Saturnino G.B. Thielscher A. et al.The non-transcranial TMS-evoked potential is an inherent source of ambiguity in TMS-EEG studies.Neuroimage. 2019; 185: 300-312https://doi.org/10.1016/j.neuroimage.2018.10.052Crossref PubMed Scopus (139) Google Scholar] - only incidentally mentioned at the end of their discussion – is that the evoked responses they obtain from both real TMS and sham conditions are substantially different from the TEPs reported in many of the previous studies (see, for example [7Bonato C. Miniussi C. Rossini P.M. Transcranial magnetic stimulation and cortical evoked potentials: a TMS/EEG co-registration study.Clin Neurophysiol. 2006; 117: 1699-1707https://doi.org/10.1016/j.clinph.2006.05.006Crossref PubMed Scopus (228) Google Scholar, 8Casarotto S. Romero Lauro L.J. Bellina V. Casali A.G. Rosanova M. Pigorini A. et al.EEG responses to TMS are sensitive to changes in the perturbation parameters and repeatable over time.PLoS One. 2010; 5e10281https://doi.org/10.1371/journal.pone.0010281Crossref PubMed Scopus (146) Google Scholar, 9Mäki H. Ilmoniemi R.J. The relationship between peripheral and early cortical activation induced by transcranial magnetic stimulation.Neurosci Lett. 2010; 478: 24-28https://doi.org/10.1016/j.neulet.2010.04.059Crossref PubMed Scopus (72) Google Scholar, 10Paus T. Sipila P.K. Strafella A.P. Synchronization of neuronal activity in the human primary motor cortex by transcranial magnetic stimulation: an EEG study.J Neurophysiol. 2001; 86: 1983-1990https://doi.org/10.1152/jn.2001.86.4.1983Crossref PubMed Scopus (289) Google Scholar, 11Rosanova M. Casali A. Bellina V. Resta F. Mariotti M. Massimini M. Natural frequencies of human corticothalamic circuits.J Neurosci. 2009; 29: 7679-7685https://doi.org/10.1523/JNEUROSCI.0445-09.2009Crossref PubMed Scopus (441) Google Scholar]). This discrepancy offers a timely opportunity to focus on the issue of the reproducibility of TEPs across laboratories and, most important, can encourage a constructive debate within the whole TMS–EEG community towards the optimization of shared procedures to obtain genuine responses to TMS. In this vein, Fig. 1 directly compares the TEP

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.brs.2019.01.010

Cites

6 of 6 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Cited by

See all 137

Metadata

Authors
Belardinelli, P., Biabani, M., Blumberger, D. M., Bortoletto, M., Casarotto, S., David, O., Desideri, D., Etkin, A., Ferrarelli, F., Fitzgerald, P. B., Fornito, A., Gordon, P. C., Gosseries, O., Harquel, S., Julkunen, P., Keller, C. J., Kimiskidis, V. K., Lioumis, P., Miniussi, C., Rosanova, M., Rossi, S., Sarasso, S., Wu, W., Zrenner, C., Daskalakis, Z. J., Rogasch, N. C., Massimini, M., Ziemann, U., & Ilmoniemi, R. J.
Venue
Brain Stimulation
Publisher
Elsevier BV
Published
2019-05
Volume
12
Issue
3
Pages
787-790
ISSN
  • 1876-4754 (ISSN-L)
  • 1935-861X
OpenAlex
W2911639238
Cited by
137
References
6
FWCI
7.96
Type
journal article
Language
en
Open access
hybrid

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.