CoChat

The climate of neurofeedback: scientific rigour and the perils of ideology

Open access
Thibault, Robert T, Lifshitz, Michael, Raz, Amir · 2018 · Brain
Cited by 44

The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.

Abstract

Sir, Over the last six decades, an in-group with ideological and financial stakes has been conducting sub-par research to develop an ostensibly effective clinical intervention: EEG-neurofeedback. More recently, however, a string of independent studies featuring increased scientific rigour and tighter experimental controls has challenged the foundation on which EEG-neurofeedback stands. Earlier this year, Brain published one of the most robust EEG-neurofeedback experiments to date (Schabus et al., 2017), which sparked a flurry of correspondence concerning the therapeutic value of neurofeedback (Fovet et al., 2017; Schabus, 2017); notably, a parallel discussion continues in Lancet Psychiatry (Micoulaud-Franchi and Fovet, 2016; Thibault and Raz, 2016a; Schönenberg et al., 2017). However, to effectively interpret the pro and con viewpoints, one must appreciate the peculiar culture surrounding the field of EEG-neurofeedback. The present breezy piece provides little-discussed yet highly relevant contextual information often absent from formal papers and technical reports. EEG-neurofeedback thrives in two major arenas: commercial and academic. The commercial branch includes private practitioners, equipment manufacturers, as well as other corporate and lucrative aspects of neurofeedback. Most of the research that fuels these commercial ventures comes from vanity presses and specialty associations, including the Institute for Neurofeedback and Research (ISNR), the Biofeedback Federation of Europe (BFE), the Association for Applied Psychophysiology and Biofeedback (AAPB), and the Biofeedback Certification International Alliance (BCIA), as well as private entities (e.g. EEGInfo.com). These associations publish everything from magazines for lay audiences to methodological textbooks for practitioners and research journals that rarely seek referees beyond their clique (e.g. NeuroRegulation). The leaders of these commercial organizations often have financial and ideological stakes in EEG-neurofeedback (Thibault and Raz, 2017). Moreover, they frequently promote and offer training for neurofeedback techniques that rarely receive attention outside the commercial sphere (e.g. QEEG, z-score training, LORETA feedback). Thus, these circles rely on research that shies away from standard scientific thoroughness. More than a decade ago, in a motion designed to separate themselves from commercial interests, the European branch of the ISNR split off to create the Society of Applied Neuroscience (SAN)—a more academic group focused on how EEG-neurofeedback works, rather than on promoting commercial products and services. We were invited to present at SAN’s most recent meeting in Greece and one of us (R.T.T.) attended. R.T.T. was surprised to hear the SAN president open the conference with a statement that the society aims to prove that neurofeedback works—a non-scientific starting point of a troublesome agenda. At the first neurofeedback workshop, a practitioner asked a volunteer to upregulate a subset of EEG waves known as the alpha band. After the practitioner displayed the data demonstrating ‘successful’ upregulation of alpha, R.T.T. pointed out an apparent contradiction: the volunteer actually misunderstood the instructions and was actively attempting to downregulate, not upregulate, alpha, but the audience seemed to neither notice nor care. The next day, when R.T.T. presented on the topic of psychosocial influences and the need for strong experimental controls, he received a response reflecting an all-too-common stance in the field: ‘Why don’t we focus on the more important issues?’ (e.g. identifying what bandwidth to train or specifying the presumed neurophysiological mechanisms). Many members of the neurofeedback community adhere to the premise that EEG-neurofeedback alters brain activity and that this neural modulation improves behaviour. However, we have systematically analysed some of the underlying problems with this tenet and found that expectation, suggestion, motivation, and other such factors likely drive the observed behavioural outcomes (Thibault et al., 2016, 2017). Subsequently, some practitioners have responded to our critical reports with a string of passionate communications: emails, non-peer-reviewed articles (Othmer, 2017), and YouTube videos (Othmer, 2016). To paraphrase the main point, albeit specious, that they put forward: ‘placebo effects alone cannot possibly explain the benefits of EEG-nf’. But the scientific evidence shows otherwise (Thibault et al., 2015; Raz and Harris, 2016). While EEG-neurofeedback experiments with positive findings abound, the absence of a formal registry makes it difficult, if not impossible, to identify how many negative findings fail to reach publication. In a first step to improve this state of affairs, Manuel Schabus recently set up an informal open repository for researchers to post their neurofeedback findings—be they positive or negative (http://decision.sbg.ac.at/limesurvey

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/brain/awx330

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 3 references

Cited by

See all 44

Metadata

Authors
Thibault, R. T., Lifshitz, M., & Raz, A.
Venue
Brain
Published
2017-12-06
Volume
141
Issue
2
Pages
e11-e11
ISSN
  • 0006-8950 (ISSN-L)
  • 1460-2156
OpenAlex
W2772856686
Cited by
44
References
3
FWCI
3.29
Type
journal article
Language
en
Open access
bronze

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The climate of neurofeedback: scientific rigour and the perils of ideology. https://app.cochat.ai/papers/10.1093/brain/awx330
The paper
Thibault, R. T., Lifshitz, M., & Raz, A. (2018). The climate of neurofeedback: scientific rigour and the perils of ideology. Brain. https://doi.org/10.1093/brain/awx330

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.