Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 16 of the 17 references it cites were found in a registry or an index.

Noisy but not placebo: defining metrics for effects of neurofeedback

Abstract

Sir, We carefully followed the controversial discussion (Fovet et al., 2017; Schabus, 2017; Schabus et al., 2017; Thibault and Raz, 2017) on the specificity of neurofeedback. This scientific dispute reveals a long overdue effort of the neuroscience community to agree on standards of how to analyse neurofeedback training. Here, we comment on pitfalls concerning terminology and methodology when claiming a placebo effect of neurofeedback. Schabus and colleagues (2017) and a subsequent commentary (Thibault and Raz, 2017) concluded that there is a lack of sound methodology in neurofeedback studies and that effects of neurofeedback training on clinical symptoms is nothing more than placebo. This has been questioned by Fovet et al. (2017) criticizing an overgeneralization of null findings and a lack of consideration of neurophysiological mechanisms. In his most recent reply, Schabus (2017) presented additional data to support his original claims. These data show an increase in physical quality of life (QoL) ratings across training sessions for real as well as sham neurofeedback. A steeper increase for the subdomain social QoL only occurred between subsequent real neurofeedback sessions when considering data taken from a previous single-blind study (Schabus et al., 2014). Schabus suggested that this reanalysis would support a major placebo impact of perceived care overshadowing neurofeedback itself. While we welcome the call for carefully designed double-blind studies, two things are worth mentioning here. First, the value of assessing QoL ratings in limited samples is at best questionable. QoL is a multidimensional construct with little insights on fluctuations over time and across individuals (Brown et al., 2000). The noisy nature of this kind of data is especially evident in the social subdomain presented (cf. Fig. 1, right panel; Schabus, 2017). Whether the ‘trend towards increased perceived social QoL’ between two subsequent sessions of real neurofeedback reflects a true effect for the single-blind study thus remains unclear. In clinical populations, particularly in heterogenous groups like insomnia patients, one should carefully check for variations occurring within an untreated ‘natural history’ group that could be misinterpreted as placebo (Price et al., 2008). The second, more critical, issue is about how to define and check for ‘placebo’. We acknowledge that any treatment, especially those involving an active effort of individuals, may include some form of participant-experimenter interaction. Neurofeedback training in fact is known to include psychological factors like control beliefs (Witte et al., 2013), strategies (Kober et al., 2013) or motivation (Kleih et al., 2010). This is not surprising for a self-regulatory effort and should not be mistaken as ‘placebo’. In our view, the terminology placebo for unspecific effects during neurofeedback is misleading. Originally defined in pharmacology as an ‘inert remedy’, Price et al. (2008) rightfully noted a paradox for most neuroscientific studies: inert agents do not cause an effect and neurofeedback undoubtedly is an active rather than a passive experimental setting. Instead of a mere bias, unspecific factors are represented in neural substrates that affect our brains and behaviours. Price et al. (2008) nicely summarized literature suggesting that placebo may be similar to simpler forms of learning, like classical conditioning. We believe this is the key point indeed: sham neurofeedback resembles many features of real neurofeedback and thus may also involve an active learning process. The difference to real neurofeedback then is the missing specificity and contingency of the feedback loop. We therefore fundamentally disagree with Schabus’ warning that sham neurofeedback would be problematic as it could lead to learned helplessness. Our own work has shown a neurofeedback control network overlapping for real and sham neurofeedback (Ninaus et al., 2013). Participants of this study did not uncover the sham feedback but rather indicated comparable levels of control belief. Conversely, we strongly endorse sham neurofeedback compared to providing real feedback of frequencies close by. Given the arbitrary limits of frequency bands and first indications of non-specific effects across bands (Kober et al., 2017), it is not an adequate control to use feedback of nearby frequencies. Well-designed studies are clearly needed for assessing neurofeedback training. In this respect, we do not see how Fovet et al. (2017) discredited double-blind studies as ‘premature’, as commented by Schabus (2017). Instead, both authors highlighted how important it is to understand the neurophysiological mechanisms behind neurofeedback. Surprisingly, Schabus directly criticized one of our recent studies attempting to clarify the link between neurophysiological and behavioural changes associated with neurofeedback training (Kober et al., 2015). His argument was that only systematic changes in

Overview

Integrity signals

Registry

Crossref · 10.1093/brain/awy060

Cites

16 of 16 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 17 references

Cited by

See all 40

Metadata

Authors
Witte, M., Kober, S. E., & Wood, G.
Affiliations
University of Graz (AT)
Corresponding author
Witte, Matthias
Venue
Brain
Published
2018-03-13
Volume
141
Issue
5
Pages
e40-e40
ISSN
  • 0006-8950 (ISSN-L)
  • 1460-2156
OpenAlex
W2793147776
Cited by
36
References
17
Citations by year
2026: 3 · 2025: 3 · 2024: 1 · 2023: 3 · 2022: 10 · 2021: 6 · 2020: 4 · 2019: 3 · 2018: 3
Type
journal article
Language
en
Open access
closed
Locations
  • Brain (publishedVersion)
  • PubMed (publishedVersion)
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Pain Management and Placebo Effect
  • Life Sciences › Neuroscience › Neurology › Transcranial Magnetic Stimulation Studies
Keywords
placebo effect, sham neurofeedback, quality of life, social quality of life, insomnia, natural history, neurophysiological mechanisms, treatment specificity, reanalysis critique
MeSH terms
Attention Deficit Disorder with Hyperactivity, Double-Blind Method, Humans, Sleep Initiation and Maintenance Disorders, Treatment Outcome, Neurofeedback

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Noisy but not placebo: defining metrics for effects of neurofeedback. https://app.cochat.ai/papers/10.1093/brain/awy060
The paper
Witte, M., Kober, S. E., & Wood, G. (2018). Noisy but not placebo: defining metrics for effects of neurofeedback. Brain. https://doi.org/10.1093/brain/awy060

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.