The DOI matches its Crossref record; 16 of the 17 references it cites were found in a registry or an index.
Noisy but not placebo: defining metrics for effects of neurofeedback
Abstract
Sir, We carefully followed the controversial discussion (Fovet et al., 2017; Schabus, 2017; Schabus et al., 2017; Thibault and Raz, 2017) on the specificity of neurofeedback. This scientific dispute reveals a long overdue effort of the neuroscience community to agree on standards of how to analyse neurofeedback training. Here, we comment on pitfalls concerning terminology and methodology when claiming a placebo effect of neurofeedback. Schabus and colleagues (2017) and a subsequent commentary (Thibault and Raz, 2017) concluded that there is a lack of sound methodology in neurofeedback studies and that effects of neurofeedback training on clinical symptoms is nothing more than placebo. This has been questioned by Fovet et al. (2017) criticizing an overgeneralization of null findings and a lack of consideration of neurophysiological mechanisms. In his most recent reply, Schabus (2017) presented additional data to support his original claims. These data show an increase in physical quality of life (QoL) ratings across training sessions for real as well as sham neurofeedback. A steeper increase for the subdomain social QoL only occurred between subsequent real neurofeedback sessions when considering data taken from a previous single-blind study (Schabus et al., 2014). Schabus suggested that this reanalysis would support a major placebo impact of perceived care overshadowing neurofeedback itself. While we welcome the call for carefully designed double-blind studies, two things are worth mentioning here. First, the value of assessing QoL ratings in limited samples is at best questionable. QoL is a multidimensional construct with little insights on fluctuations over time and across individuals (Brown et al., 2000). The noisy nature of this kind of data is especially evident in the social subdomain presented (cf. Fig. 1, right panel; Schabus, 2017). Whether the ‘trend towards increased perceived social QoL’ between two subsequent sessions of real neurofeedback reflects a true effect for the single-blind study thus remains unclear. In clinical populations, particularly in heterogenous groups like insomnia patients, one should carefully check for variations occurring within an untreated ‘natural history’ group that could be misinterpreted as placebo (Price et al., 2008). The second, more critical, issue is about how to define and check for ‘placebo’. We acknowledge that any treatment, especially those involving an active effort of individuals, may include some form of participant-experimenter interaction. Neurofeedback training in fact is known to include psychological factors like control beliefs (Witte et al., 2013), strategies (Kober et al., 2013) or motivation (Kleih et al., 2010). This is not surprising for a self-regulatory effort and should not be mistaken as ‘placebo’. In our view, the terminology placebo for unspecific effects during neurofeedback is misleading. Originally defined in pharmacology as an ‘inert remedy’, Price et al. (2008) rightfully noted a paradox for most neuroscientific studies: inert agents do not cause an effect and neurofeedback undoubtedly is an active rather than a passive experimental setting. Instead of a mere bias, unspecific factors are represented in neural substrates that affect our brains and behaviours. Price et al. (2008) nicely summarized literature suggesting that placebo may be similar to simpler forms of learning, like classical conditioning. We believe this is the key point indeed: sham neurofeedback resembles many features of real neurofeedback and thus may also involve an active learning process. The difference to real neurofeedback then is the missing specificity and contingency of the feedback loop. We therefore fundamentally disagree with Schabus’ warning that sham neurofeedback would be problematic as it could lead to learned helplessness. Our own work has shown a neurofeedback control network overlapping for real and sham neurofeedback (Ninaus et al., 2013). Participants of this study did not uncover the sham feedback but rather indicated comparable levels of control belief. Conversely, we strongly endorse sham neurofeedback compared to providing real feedback of frequencies close by. Given the arbitrary limits of frequency bands and first indications of non-specific effects across bands (Kober et al., 2017), it is not an adequate control to use feedback of nearby frequencies. Well-designed studies are clearly needed for assessing neurofeedback training. In this respect, we do not see how Fovet et al. (2017) discredited double-blind studies as ‘premature’, as commented by Schabus (2017). Instead, both authors highlighted how important it is to understand the neurophysiological mechanisms behind neurofeedback. Surprisingly, Schabus directly criticized one of our recent studies attempting to clarify the link between neurophysiological and behavioural changes associated with neurofeedback training (Kober et al., 2015). His argument was that only systematic changes in
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“the importance targeted EEG-learning assessments in NFB trials has been emphasized by researchers [120–126]”
Citations
Cites
A Comprehensive Review of the Placebo Effect: Recent Advances and Current Thought
Price, D. D., Finniss, D. G., & Benedetti, F. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.113006.095941 · Cited by 1,146
Motivation modulates the P300 amplitude during brain–computer interface use
Kleih, S. C., Nijboer, F., Halder, S., & Kübler, A. (2010) · Clinical Neurophysiology · doi:10.1016/j.clinph.2010.01.034 · Cited by 258
Learning to modulate one’s own brain activity: The effect of spontaneous mental strategies
Kober, S. E., Witte, M., Ninaus, M., Neuper, C., & Wood, G. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00695 · Cited by 225
Self-citationTowards an Ontology of Cognitive Control
Lenartowicz, A., Kalar, D. J., Congdon, E., & Poldrack, R. A. (2010) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2010.01100.x · Cited by 179
Witte, M., Kober, S. E., Ninaus, M., Neuper, C., & Wood, G. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00478 · Cited by 167
Self-citationKober, S. E., Witte, M., Stangl, M., Väljamäe, A., Neuper, C., & Wood, G. M. D. O. (2014) · Clinical Neurophysiology · doi:10.1016/j.clinph.2014.03.031 · Cited by 164
Self-citationBetter than sham? A double-blind placebo-controlled neurofeedback study in primary insomnia
Schabus, M., Griessenberger, H., Gnjezda, M.-T., Heib, D. P. J., Wisłowska, M., & Hoedlmoser, K. (2017) · Brain · doi:10.1093/brain/awx011 · Cited by 164
The psychology of neurofeedback: Clinical intervention even if applied placebo.
Thibault, R. T., & Raz, A. (2017) · American Psychologist · doi:10.1037/amp0000118 · Cited by 149
Neural substrates of cognitive control under the belief of getting neurofeedback training
Ninaus, M., Kober, S. E., Witte, M., Koschutnig, K., Stangl, M., Neuper, C., & Wood, G. M. D. O. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00914 · Cited by 144
Self-citation
Cited by
Ros, T., Enriquez-Geppert, S., Zotev, V., Young, K. D., Wood, G., Whitfield-Gabrieli, S., Wan, F., Vuilleumier, P., Vialatte, F., Van De Ville, D., et al. (2020) · Brain · doi:10.1093/brain/awaa009 · Cited by 399
“, 2017a, b) and Brain (Fovet et al., 2017; Schabus, 2017, 2018; Schabus et al., 2017; Thibault et al., 2017, 2018; Witte et al., 2018) discuss the theoretical arguments and empirical data backing the involvement of these two mechanisms.”
Self-citationSimoes, J. P., Daoud, E., Shabbir, M., Amanat, S., Assouly, K. K. S., Biswas, R., Casolani, C., Dode, A., Enzler, F., Jacquemin, L., et al. (2021) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2021.647285 · Cited by 57
Neurofeedback: Principles, appraisal, and outstanding issues
Papo, D. (2018) · European Journal of Neuroscience · doi:10.1111/ejn.14312 · Cited by 42
Kober, S. E., Witte, M., Grinschgl, S., Neuper, C., & Wood, G. M. D. O. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.07.025 · Cited by 42
“Hence, successful NF training performance was defined as a linear increase or decrease of SMR power across the NF runs within one NF training session that differs significantly from zero (Gruzelier, 2014b; Kober et al., 2015c; Witte et al., 2018).”
Self-citationBerger, L. M., Wood, G. M. D. O., & Kober, S. E. (2022) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2022.952261 · Cited by 40
“Participants can be motivated for the training sessions and feel confident to succeed in increasing the relevant frequency band powers regardless of the feedback visualization method (Witte et al., 2018).”
BackgroundSelf-citation
Metadata
- Authors
- Witte, M., Kober, S. E., & Wood, G.
- Affiliations
- University of Graz (AT)
- Corresponding author
- Witte, Matthias
- Venue
- Brain
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-03-13
- Volume
- 141
- Issue
- 5
- Pages
- e40-e40
- ISSN
- 0006-8950 (ISSN-L)
- 1460-2156
- OpenAlex
- W2793147776
- Semantic Scholar
- 9e477712844f41aac18b285bee1129f3287c10e3
- Cited by
- 36
- References
- 17
- Citations by year
- 2026: 3 · 2025: 3 · 2024: 1 · 2023: 3 · 2022: 10 · 2021: 6 · 2020: 4 · 2019: 3 · 2018: 3
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Brain (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
- Life Sciences › Neuroscience › Cognitive Neuroscience › Pain Management and Placebo Effect
- Life Sciences › Neuroscience › Neurology › Transcranial Magnetic Stimulation Studies
- Keywords
- placebo effect, sham neurofeedback, quality of life, social quality of life, insomnia, natural history, neurophysiological mechanisms, treatment specificity, reanalysis critique
- MeSH terms
- Attention Deficit Disorder with Hyperactivity, Double-Blind Method, Humans, Sleep Initiation and Maintenance Disorders, Treatment Outcome, Neurofeedback
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Noisy but not placebo: defining metrics for effects of neurofeedback. https://app.cochat.ai/papers/10.1093/brain/awy060
- The paper
- Witte, M., Kober, S. E., & Wood, G. (2018). Noisy but not placebo: defining metrics for effects of neurofeedback. Brain. https://doi.org/10.1093/brain/awy060
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.