Reproducibility in TMS–EEG studies: A call for data sharing, standard procedures and effective experimental control
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
A recent study by Conde, Tomasevic et al. (2019) [[1]Conde V. Tomasevic L. Akopian I. Stanek K. Saturnino G.B. Thielscher A. et al.The non-transcranial TMS-evoked potential is an inherent source of ambiguity in TMS-EEG studies.Neuroimage. 2019; 185: 300-312https://doi.org/10.1016/j.neuroimage.2018.10.052Crossref PubMed Scopus (139) Google Scholar] puts a spotlight on the subtleties of experimental design and analysis of studies involving TMS-evoked EEG potentials (TEPs), specifically focusing on the challenge of disentangling genuine cortical responses to TMS from those resulting from concomitant sensory activation. This is a relevant topic that the TMS–EEG community has previously identified [[2]Ilmoniemi R.J. Kičić D. Methodology for combined TMS and EEG.Brain Topogr. 2010; 22: 233-248https://doi.org/10.1007/s10548-009-0123-4Crossref PubMed Scopus (256) Google Scholar] and addressed with different strategies [3Gordon P.C. Desideri D. Belardinelli P. Zrenner C. Ziemann U. Comparison of cortical EEG responses to realistic sham versus real TMS of human motor cortex.Brain Stimul. 2018; 11: 1322-1330https://doi.org/10.1016/j.brs.2018.08.003Abstract Full Text Full Text PDF PubMed Scopus (52) Google Scholar, 4Gosseries O. Sarasso S. Casarotto S. Boly M. Schnakers C. Napolitani M. et al.On the cerebral origin of EEG responses to TMS: insights from severe cortical lesions.Brain Stimul. 2015; 8: 142-149https://doi.org/10.1016/j.brs.2014.10.008Abstract Full Text Full Text PDF PubMed Scopus (57) Google Scholar, 5Herring J.D. Thut G. Jensen O. Bergmann T.O. Attention modulates TMS-locked alpha oscillations in the visual cortex.J Neurosci. 2015; 35: 14435-14447https://doi.org/10.1523/JNEUROSCI.1833-15.2015Crossref PubMed Scopus (116) Google Scholar, 6Nikouline V. Ruohonen J. Ilmoniemi R.J. The role of the coil click in TMS assessed with simultaneous EEG.Clin Neurophysiol. 1999; 110: 1325-1328https://doi.org/10.1016/S1388-2457(99)00070-XCrossref PubMed Scopus (195) Google Scholar]. Based on the similarity of the evoked EEG responses they obtained in real TMS at different sites and in sham conditions (auditory and somatosensory scalp stimulation), the authors of [[1]Conde V. Tomasevic L. Akopian I. Stanek K. Saturnino G.B. Thielscher A. et al.The non-transcranial TMS-evoked potential is an inherent source of ambiguity in TMS-EEG studies.Neuroimage. 2019; 185: 300-312https://doi.org/10.1016/j.neuroimage.2018.10.052Crossref PubMed Scopus (139) Google Scholar] inferred that TEPs can be significantly contaminated by the effects of concurrent, non-transcranial stimulation. We acknowledge this is a valuable reminder to the TMS-EEG community; however, we contend that another fundamental implication of the work by Conde, Tomasevic and colleagues [[1]Conde V. Tomasevic L. Akopian I. Stanek K. Saturnino G.B. Thielscher A. et al.The non-transcranial TMS-evoked potential is an inherent source of ambiguity in TMS-EEG studies.Neuroimage. 2019; 185: 300-312https://doi.org/10.1016/j.neuroimage.2018.10.052Crossref PubMed Scopus (139) Google Scholar] - only incidentally mentioned at the end of their discussion – is that the evoked responses they obtain from both real TMS and sham conditions are substantially different from the TEPs reported in many of the previous studies (see, for example [7Bonato C. Miniussi C. Rossini P.M. Transcranial magnetic stimulation and cortical evoked potentials: a TMS/EEG co-registration study.Clin Neurophysiol. 2006; 117: 1699-1707https://doi.org/10.1016/j.clinph.2006.05.006Crossref PubMed Scopus (228) Google Scholar, 8Casarotto S. Romero Lauro L.J. Bellina V. Casali A.G. Rosanova M. Pigorini A. et al.EEG responses to TMS are sensitive to changes in the perturbation parameters and repeatable over time.PLoS One. 2010; 5e10281https://doi.org/10.1371/journal.pone.0010281Crossref PubMed Scopus (146) Google Scholar, 9Mäki H. Ilmoniemi R.J. The relationship between peripheral and early cortical activation induced by transcranial magnetic stimulation.Neurosci Lett. 2010; 478: 24-28https://doi.org/10.1016/j.neulet.2010.04.059Crossref PubMed Scopus (72) Google Scholar, 10Paus T. Sipila P.K. Strafella A.P. Synchronization of neuronal activity in the human primary motor cortex by transcranial magnetic stimulation: an EEG study.J Neurophysiol. 2001; 86: 1983-1990https://doi.org/10.1152/jn.2001.86.4.1983Crossref PubMed Scopus (289) Google Scholar, 11Rosanova M. Casali A. Bellina V. Resta F. Mariotti M. Massimini M. Natural frequencies of human corticothalamic circuits.J Neurosci. 2009; 29: 7679-7685https://doi.org/10.1523/JNEUROSCI.0445-09.2009Crossref PubMed Scopus (441) Google Scholar]). This discrepancy offers a timely opportunity to focus on the issue of the reproducibility of TEPs across laboratories and, most important, can encourage a constructive debate within the whole TMS–EEG community towards the optimization of shared procedures to obtain genuine responses to TMS. In this vein, Fig. 1 directly compares the TEP
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breakdown of cortical effective connectivity during sleep
Massimini, M., Ferrarelli, F., Huber, R., Esser, S. K., Singh, H., & Tononi, G. (2005) · Science · doi:10.1126/science.1117256 · Cited by 1,534
Self-citationStratification of unresponsive patients by an independently validated index of brain complexity
Casarotto, S., Comanducci, A., Rosanova, M., Sarasso, S., Fecchio, M., Napolitani, M., Pigorini, A., G. Casali, A., Trimarchi, P. D., Boly, M., et al. (2016) · Annals of Neurology · doi:10.1002/ana.24779 · Cited by 487
Self-citationThe non-transcranial TMS-evoked potential is an inherent source of ambiguity in TMS-EEG studies
Conde, V., Tomasevic, L., Akopian, I., Stanek, K., Saturnino, G. B., Thielscher, A., Bergmann, T. O., & Siebner, H. R. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2018.10.052 · Cited by 343
The role of the coil click in TMS assessed with simultaneous EEG
Nikouline, V., Ruohonen, J., & Ilmoniemi, R. J. (1999) · Clinical Neurophysiology · doi:10.1016/s1388-2457(99)00070-x · Cited by 269
Self-citationBistability breaks-off deterministic responses to intracortical stimulation during non-REM sleep
Pigorini, A., Sarasso, S., Proserpio, P., Szymanski, C., Arnulfo, G., Casarotto, S., Fecchio, M., Rosanova, M., Mariotti, M., Lo Russo, G., et al. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.02.056 · Cited by 200
Self-citationRosanova, M., Fecchio, M., Casarotto, S., Sarasso, S., Casali, A. G., Pigorini, A., Comanducci, A., Seregni, F., Devalle, G., Citerio, G., et al. (2018) · Nature Communications · doi:10.1038/s41467-018-06871-1 · Cited by 167
Self-citation
Cited by
Recovery from disorders of consciousness: mechanisms, prognosis and emerging therapies
Edlow, B. L., Claassen, J., Schiff, N. D., & Greer, D. M. (2021) · Nature Reviews Neurology · doi:10.1038/s41582-020-00428-x · Cited by 731
Siebner, H. R., Funke, K., Aberra, A. S., Antal, A., Bestmann, S., Chen, R., Classen, J., Davare, M., Di Lazzaro, V., Fox, P. T., et al. (2022) · Clinical Neurophysiology · doi:10.1016/j.clinph.2022.04.022 · Cited by 566
Self-citationAssessing the mechanisms of brain plasticity by transcranial magnetic stimulation
Jannati, A., Oberman, L. M., Rotenberg, A., & Pascual-Leone, A. (2023) · Neuropsychopharmacology · doi:10.1038/s41386-022-01453-8 · Cited by 290
TMS combined with EEG: Recommendations and open issues for data collection and analysis
Hernandez-Pavon, J. C., Veniero, D., Bergmann, T. O., Belardinelli, P., Bortoletto, M., Casarotto, S., Casula, E. P., Farzan, F., Fecchio, M., Julkunen, P., et al. (2023) · Brain Stimulation · doi:10.1016/j.brs.2023.02.009 · Cited by 238
Self-citationLocal sleep-like cortical reactivity in the awake brain after focal injury
Sarasso, S., D’Ambrosio, S., Fecchio, M., Casarotto, S., Viganò, A., Landi, C., Mattavelli, G., Gosseries, O., Quarenghi, M., Laureys, S., et al. (2020) · Brain · doi:10.1093/brain/awaa338 · Cited by 128
Self-citation
Metadata
- Authors
- Belardinelli, P., Biabani, M., Blumberger, D. M., Bortoletto, M., Casarotto, S., David, O., Desideri, D., Etkin, A., Ferrarelli, F., Fitzgerald, P. B., Fornito, A., Gordon, P. C., Gosseries, O., Harquel, S., Julkunen, P., Keller, C. J., Kimiskidis, V. K., Lioumis, P., Miniussi, C., Rosanova, M., Rossi, S., Sarasso, S., Wu, W., Zrenner, C., Daskalakis, Z. J., Rogasch, N. C., Massimini, M., Ziemann, U., & Ilmoniemi, R. J.
- Venue
- Brain Stimulation
- Publisher
- Elsevier BV
- Published
- 2019-05
- Volume
- 12
- Issue
- 3
- Pages
- 787-790
- ISSN
- 1876-4754 (ISSN-L)
- 1935-861X
- OpenAlex
- W2911639238
- Cited by
- 137
- References
- 6
- FWCI
- 7.96
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Reproducibility in TMS–EEG studies: A call for data sharing, standard procedures and effective experimental control. https://app.cochat.ai/papers/10.1016/j.brs.2019.01.010
- The paper
- Belardinelli, P., Biabani, M., Blumberger, D. M., Bortoletto, M., Casarotto, S., David, O., Desideri, D., Etkin, A., Ferrarelli, F., Fitzgerald, P. B., Fornito, A., Gordon, P. C., Gosseries, O., Harquel, S., Julkunen, P., Keller, C. J., Kimiskidis, V. K., Lioumis, P., Miniussi, C., . . . Ilmoniemi, R. J. (2019). Reproducibility in TMS–EEG studies: A call for data sharing, standard procedures and effective experimental control. Brain Stimulation. https://doi.org/10.1016/j.brs.2019.01.010
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.