The climate of neurofeedback: scientific rigour and the perils of ideology
Open accessThe DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Sir, Over the last six decades, an in-group with ideological and financial stakes has been conducting sub-par research to develop an ostensibly effective clinical intervention: EEG-neurofeedback. More recently, however, a string of independent studies featuring increased scientific rigour and tighter experimental controls has challenged the foundation on which EEG-neurofeedback stands. Earlier this year, Brain published one of the most robust EEG-neurofeedback experiments to date (Schabus et al., 2017), which sparked a flurry of correspondence concerning the therapeutic value of neurofeedback (Fovet et al., 2017; Schabus, 2017); notably, a parallel discussion continues in Lancet Psychiatry (Micoulaud-Franchi and Fovet, 2016; Thibault and Raz, 2016a; Schönenberg et al., 2017). However, to effectively interpret the pro and con viewpoints, one must appreciate the peculiar culture surrounding the field of EEG-neurofeedback. The present breezy piece provides little-discussed yet highly relevant contextual information often absent from formal papers and technical reports. EEG-neurofeedback thrives in two major arenas: commercial and academic. The commercial branch includes private practitioners, equipment manufacturers, as well as other corporate and lucrative aspects of neurofeedback. Most of the research that fuels these commercial ventures comes from vanity presses and specialty associations, including the Institute for Neurofeedback and Research (ISNR), the Biofeedback Federation of Europe (BFE), the Association for Applied Psychophysiology and Biofeedback (AAPB), and the Biofeedback Certification International Alliance (BCIA), as well as private entities (e.g. EEGInfo.com). These associations publish everything from magazines for lay audiences to methodological textbooks for practitioners and research journals that rarely seek referees beyond their clique (e.g. NeuroRegulation). The leaders of these commercial organizations often have financial and ideological stakes in EEG-neurofeedback (Thibault and Raz, 2017). Moreover, they frequently promote and offer training for neurofeedback techniques that rarely receive attention outside the commercial sphere (e.g. QEEG, z-score training, LORETA feedback). Thus, these circles rely on research that shies away from standard scientific thoroughness. More than a decade ago, in a motion designed to separate themselves from commercial interests, the European branch of the ISNR split off to create the Society of Applied Neuroscience (SAN)—a more academic group focused on how EEG-neurofeedback works, rather than on promoting commercial products and services. We were invited to present at SAN’s most recent meeting in Greece and one of us (R.T.T.) attended. R.T.T. was surprised to hear the SAN president open the conference with a statement that the society aims to prove that neurofeedback works—a non-scientific starting point of a troublesome agenda. At the first neurofeedback workshop, a practitioner asked a volunteer to upregulate a subset of EEG waves known as the alpha band. After the practitioner displayed the data demonstrating ‘successful’ upregulation of alpha, R.T.T. pointed out an apparent contradiction: the volunteer actually misunderstood the instructions and was actively attempting to downregulate, not upregulate, alpha, but the audience seemed to neither notice nor care. The next day, when R.T.T. presented on the topic of psychosocial influences and the need for strong experimental controls, he received a response reflecting an all-too-common stance in the field: ‘Why don’t we focus on the more important issues?’ (e.g. identifying what bandwidth to train or specifying the presumed neurophysiological mechanisms). Many members of the neurofeedback community adhere to the premise that EEG-neurofeedback alters brain activity and that this neural modulation improves behaviour. However, we have systematically analysed some of the underlying problems with this tenet and found that expectation, suggestion, motivation, and other such factors likely drive the observed behavioural outcomes (Thibault et al., 2016, 2017). Subsequently, some practitioners have responded to our critical reports with a string of passionate communications: emails, non-peer-reviewed articles (Othmer, 2017), and YouTube videos (Othmer, 2016). To paraphrase the main point, albeit specious, that they put forward: ‘placebo effects alone cannot possibly explain the benefits of EEG-nf’. But the scientific evidence shows otherwise (Thibault et al., 2015; Raz and Harris, 2016). While EEG-neurofeedback experiments with positive findings abound, the absence of a formal registry makes it difficult, if not impossible, to identify how many negative findings fail to reach publication. In a first step to improve this state of affairs, Manuel Schabus recently set up an informal open repository for researchers to post their neurofeedback findings—be they positive or negative (http://decision.sbg.ac.at/limesurvey
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
How scientists fool themselves – and how they can stop
Nuzzo, R. (2015) · Nature · doi:10.1038/526182a · Cited by 296
The self-regulating brain and neurofeedback: experimental science and clinical promise
Thibault, R. T., Lifshitz, M., & Raz, A. (2016) · Cortex · doi:10.1016/j.cortex.2015.10.024 · Cited by 272 · cited 1×
“However, we have systematically analysed some of the underlying problems with this tenet and found that expectation, suggestion, motivation, and other such factors likely drive the observed behavioural outcomes (Thibault et al. , 2016, 2017).”
Self-citationThibault, R. T., Lifshitz, M., Birbaumer, N., & Raz, A. (2015) · Psychotherapy and Psychosomatics · doi:10.1159/000371714 · Cited by 112 · cited 2×
“But the scientific evidence shows otherwise (Thibault et al., 2015; Raz and Harris, 2016).”
Self-citation
Cited by
Ros, T., Enriquez-Geppert, S., Zotev, V., Young, K. D., Wood, G., Whitfield-Gabrieli, S., Wan, F., Vuilleumier, P., Vialatte, F., Van De Ville, D., et al. (2020) · Brain · doi:10.1093/brain/awaa009 · Cited by 399
Self-citationNeurofeedback for pain management: a systematic review
Roy, R., de la Vega, R., Jensen, M. P., & Miró, J. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.00671 · Cited by 77
Perez, T. M., Glue, P., Adhia, D. B., Navid, M. S., Zeng, J., Dillingham, P., Smith, M., Niazi, I. K., Young, C. K., & De Ridder, D. (2022) · Trials · doi:10.1186/s13063-022-06863-z · Cited by 8
Metadata
- Authors
- Thibault, R. T., Lifshitz, M., & Raz, A.
- Venue
- Brain
- Publisher
- Oxford University Press (OUP)
- Published
- 2017-12-06
- Volume
- 141
- Issue
- 2
- Pages
- e11-e11
- ISSN
- 0006-8950 (ISSN-L)
- 1460-2156
- OpenAlex
- W2772856686
- Cited by
- 44
- References
- 3
- FWCI
- 3.29
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.