Noisy but not placebo: defining metrics for effects of neurofeedback
The DOI matches its Crossref record; 16 of the 17 references it cites were found in a registry or an index.
Abstract
Sir, We carefully followed the controversial discussion (Fovet et al., 2017; Schabus, 2017; Schabus et al., 2017; Thibault and Raz, 2017) on the specificity of neurofeedback. This scientific dispute reveals a long overdue effort of the neuroscience community to agree on standards of how to analyse neurofeedback training. Here, we comment on pitfalls concerning terminology and methodology when claiming a placebo effect of neurofeedback. Schabus and colleagues (2017) and a subsequent commentary (Thibault and Raz, 2017) concluded that there is a lack of sound methodology in neurofeedback studies and that effects of neurofeedback training on clinical symptoms is nothing more than placebo. This has been questioned by Fovet et al. (2017) criticizing an overgeneralization of null findings and a lack of consideration of neurophysiological mechanisms. In his most recent reply, Schabus (2017) presented additional data to support his original claims. These data show an increase in physical quality of life (QoL) ratings across training sessions for real as well as sham neurofeedback. A steeper increase for the subdomain social QoL only occurred between subsequent real neurofeedback sessions when considering data taken from a previous single-blind study (Schabus et al., 2014). Schabus suggested that this reanalysis would support a major placebo impact of perceived care overshadowing neurofeedback itself. While we welcome the call for carefully designed double-blind studies, two things are worth mentioning here. First, the value of assessing QoL ratings in limited samples is at best questionable. QoL is a multidimensional construct with little insights on fluctuations over time and across individuals (Brown et al., 2000). The noisy nature of this kind of data is especially evident in the social subdomain presented (cf. Fig. 1, right panel; Schabus, 2017). Whether the ‘trend towards increased perceived social QoL’ between two subsequent sessions of real neurofeedback reflects a true effect for the single-blind study thus remains unclear. In clinical populations, particularly in heterogenous groups like insomnia patients, one should carefully check for variations occurring within an untreated ‘natural history’ group that could be misinterpreted as placebo (Price et al., 2008). The second, more critical, issue is about how to define and check for ‘placebo’. We acknowledge that any treatment, especially those involving an active effort of individuals, may include some form of participant-experimenter interaction. Neurofeedback training in fact is known to include psychological factors like control beliefs (Witte et al., 2013), strategies (Kober et al., 2013) or motivation (Kleih et al., 2010). This is not surprising for a self-regulatory effort and should not be mistaken as ‘placebo’. In our view, the terminology placebo for unspecific effects during neurofeedback is misleading. Originally defined in pharmacology as an ‘inert remedy’, Price et al. (2008) rightfully noted a paradox for most neuroscientific studies: inert agents do not cause an effect and neurofeedback undoubtedly is an active rather than a passive experimental setting. Instead of a mere bias, unspecific factors are represented in neural substrates that affect our brains and behaviours. Price et al. (2008) nicely summarized literature suggesting that placebo may be similar to simpler forms of learning, like classical conditioning. We believe this is the key point indeed: sham neurofeedback resembles many features of real neurofeedback and thus may also involve an active learning process. The difference to real neurofeedback then is the missing specificity and contingency of the feedback loop. We therefore fundamentally disagree with Schabus’ warning that sham neurofeedback would be problematic as it could lead to learned helplessness. Our own work has shown a neurofeedback control network overlapping for real and sham neurofeedback (Ninaus et al., 2013). Participants of this study did not uncover the sham feedback but rather indicated comparable levels of control belief. Conversely, we strongly endorse sham neurofeedback compared to providing real feedback of frequencies close by. Given the arbitrary limits of frequency bands and first indications of non-specific effects across bands (Kober et al., 2017), it is not an adequate control to use feedback of nearby frequencies. Well-designed studies are clearly needed for assessing neurofeedback training. In this respect, we do not see how Fovet et al. (2017) discredited double-blind studies as ‘premature’, as commented by Schabus (2017). Instead, both authors highlighted how important it is to understand the neurophysiological mechanisms behind neurofeedback. Surprisingly, Schabus directly criticized one of our recent studies attempting to clarify the link between neurophysiological and behavioural changes associated with neurofeedback training (Kober et al., 2015). His argument was that only systematic changes in
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“the importance targeted EEG-learning assessments in NFB trials has been emphasized by researchers [120–126]”
Citations
Cites
A Comprehensive Review of the Placebo Effect: Recent Advances and Current Thought
Price, D. D., Finniss, D. G., & Benedetti, F. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.113006.095941 · Cited by 1,146
Motivation modulates the P300 amplitude during brain–computer interface use
Kleih, S. C., Nijboer, F., Halder, S., & Kübler, A. (2010) · Clinical Neurophysiology · doi:10.1016/j.clinph.2010.01.034 · Cited by 258
Learning to modulate one’s own brain activity: The effect of spontaneous mental strategies
Kober, S. E., Witte, M., Ninaus, M., Neuper, C., & Wood, G. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00695 · Cited by 225
Self-citationTowards an Ontology of Cognitive Control
Lenartowicz, A., Kalar, D. J., Congdon, E., & Poldrack, R. A. (2010) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2010.01100.x · Cited by 179
Witte, M., Kober, S. E., Ninaus, M., Neuper, C., & Wood, G. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00478 · Cited by 167
Self-citationKober, S. E., Witte, M., Stangl, M., Väljamäe, A., Neuper, C., & Wood, G. M. D. O. (2014) · Clinical Neurophysiology · doi:10.1016/j.clinph.2014.03.031 · Cited by 166
Self-citationBetter than sham? A double-blind placebo-controlled neurofeedback study in primary insomnia
Schabus, M., Griessenberger, H., Gnjezda, M.-T., Heib, D. P. J., Wislowska, M., & Hoedlmoser, K. (2017) · Brain · doi:10.1093/brain/awx011 · Cited by 144
The psychology of neurofeedback: Clinical intervention even if applied placebo.
Thibault, R. T., & Raz, A. (2017) · American Psychologist · doi:10.1037/amp0000118 · Cited by 127
Enhancing sleep quality and memory in insomnia using instrumental sensorimotor rhythm conditioning
Schabus, M., Heib, D. P. J., Lechinger, J., Griessenberger, H., Klimesch, W., Pawlizki, A., Kunz, A. B., Sterman, B. M., & Hoedlmoser, K. (2013) · Biological Psychology · doi:10.1016/j.biopsycho.2013.02.020 · Cited by 126
Cited by
Ros, T., Enriquez-Geppert, S., Zotev, V., Young, K. D., Wood, G., Whitfield-Gabrieli, S., Wan, F., Vuilleumier, P., Vialatte, F., Van De Ville, D., et al. (2020) · Brain · doi:10.1093/brain/awaa009 · Cited by 399
“, 2017a, b) and Brain (Fovet et al., 2017; Schabus, 2017, 2018; Schabus et al., 2017; Thibault et al., 2017, 2018; Witte et al., 2018) discuss the theoretical arguments and empirical data backing the involvement of these two mechanisms.”
Self-citationSimoes, J. P., Daoud, E., Shabbir, M., Amanat, S., Assouly, K. K. S., Biswas, R., Casolani, C., Dode, A., Enzler, F., Jacquemin, L., et al. (2021) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2021.647285 · Cited by 57
Neurofeedback: Principles, appraisal, and outstanding issues
Papo, D. (2019) · European Journal of Neuroscience · doi:10.1111/ejn.14312 · Cited by 42
Kober, S. E., Witte, M., Grinschgl, S., Neuper, C., & Wood, G. M. D. O. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.07.025 · Cited by 42
“Hence, successful NF training performance was defined as a linear increase or decrease of SMR power across the NF runs within one NF training session that differs significantly from zero (Gruzelier, 2014b; Kober et al., 2015c; Witte et al., 2018).”
Self-citationBerger, L. M., Wood, G. M. D. O., & Kober, S. E. (2022) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2022.952261 · Cited by 40
“Participants can be motivated for the training sessions and feel confident to succeed in increasing the relevant frequency band powers regardless of the feedback visualization method (Witte et al., 2018).”
BackgroundSelf-citationHampson, M., Ruíz, S., & Ushiba, J. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.116473 · Cited by 36
“Furthermore, the mechanism of action of neurofeedback are not well understood and debate remains regarding the specificity of its effects (Fovet et al., 2017; Schabus, 2017; Schabus et al., 2017; Thibault et al., 2017; Witte et al., 2018).”
Session Frequency Matters in Neurofeedback Training of Athletes
Domingos, C., Peralta, M., Prazeres, P., Nan, W., Rosa, A. C., & Pereira, J. G. (2021) · Applied Psychophysiology and Biofeedback · doi:10.1007/s10484-021-09505-3 · Cited by 34
Neurofeedback and neural self-regulation: a new perspective based on allostasis
Mirifar, A., Keil, A., & Ehrlenspiel, F. (2022) · Reviews in the Neurosciences · doi:10.1515/revneuro-2021-0133 · Cited by 35
Neurofeedback for insomnia: Current state of research
Lambert-Beaudet, F., Journault, W.-G., Provençal, A. R., & Bastien, C. (2021) · World Journal of Psychiatry · doi:10.5498/wjp.v11.i10.897 · Cited by 28
Chen, T., & Lin, I. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.01.175 · Cited by 29
Alpha down-regulation neurofeedback training effects on implicit motor learning and consolidation
Nan, W., Yang, L., Wan, F., Zhu, F., & Hu, Y. S. (2020) · Journal of Neural Engineering · doi:10.1088/1741-2552/ab7c1b · Cited by 22
Neurofeedback and attention modulate somatosensory alpha oscillations but not pain perception
Hohn, V. D., Tiemann, L., Bott, F. S., May, E. S., Fritzen, C., Nickel, M. M., Ávila, C. G., & Ploner, M. (2025) · PLoS Biology · doi:10.1371/journal.pbio.3002972 · Cited by 20
“Consequently, a surge of EEG-based neurofeedback approaches is currently observed, and their results and perspectives are lively and controversially discussed [21–26].”
Neurofeedback: A challenge for integrative clinical neurophysiological studies
Micoulaud‐Franchi, J., Jeunet, C., & Lotte, F. (2020) · Neurophysiologie Clinique · doi:10.1016/j.neucli.2020.01.001 · Cited by 19
Reply: Noisy but not placebo: defining metrics for effects of neurofeedback
Schabus, M. (2018) · Brain · doi:10.1093/brain/awy061 · Cited by 16
“In the following we will address the main points raised by Witte et al. (2018): (i) Witte and colleagues correctly mention that in our ear- lier response (Schabus, 2017) we showed ‘an increase in physical quality-of-life (QoL) ratings across trainings sessions for real as well as sham NFT’.”
BackgroundAn Exploratory Study of Training Intensity in EEG Neurofeedback
Esteves, I., Nan, W., Alves, C., Calapez, A., Melicio, F. M., & Rosa, A. C. (2021) · Neural Plasticity · doi:10.1155/2021/8881059 · Cited by 16
“[44], it might be the case that the training does not directly translate into a steady increase of the feedback parameter over time.”
BackgroundJoie: a Joy-based Brain-Computer Interface (BCI)
Vujic, A., Nisal, S., & Maes, P. (2023) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3586183.3606761 · Cited by 11
“The neuro-science community believes neurofeedback is susceptible to placebo, motivating us to control for it [59].”
BackgroundInfra-Low Frequency Neurofeedback in Tension-Type Headache: A Cross-Over Sham-Controlled Study
Arina, G. A., Dobrushina, O. R., Shvetsova, E. T., Osina, E., Meshkov, G. A., Aziatskaya, G., Trofimova, A. K., Efremova, I. N., Martunov, S. E., & Nikolaeva, V. V. (2022) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2022.891323 · Cited by 12
“, 2017), intense interpersonal debates are ongoing around the possible role of placebo effects in neurofeedback interventions (Fovet et al., 2017; Witte et al., 2018).”
BackgroundPrillinger, K., Radev, S. T., Doganay, K., Poustka, L., & Konicar, L. (2022) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2022.838080 · Cited by 10
Perez, T. M., Glue, P., Adhia, D. B., Navid, M. S., Zeng, J., Dillingham, P., Smith, M., Niazi, I. K., Young, C. K., & De Ridder, D. (2022) · Trials · doi:10.1186/s13063-022-06863-z · Cited by 8
Spontaneous Modulation of Standard EEG Frequency Bands During a Neurofeedback‐Like Task
Maaz, J., Paban, V., Waroquier, L., & Rey, A. (2025) · Psychophysiology · doi:10.1111/psyp.70163 · Cited by 6
“However, sham protocols also include non-specific factors that are more general to the EEG-NF procedure, such as time on task and the repeated exposure to the fluctuations of the same sensory feedback (Ros et al. 2020; Witte et al. 2018).”
InfluentialIwama, S., Zhang, Y., & Ushiba, J. (2022) · eNeuro · doi:10.1523/eneuro.0145-22.2022 · Cited by 6
Simoes, J. P., Daoud, E., Shabbir, M., Amanat, S., Assouly, K. K. S., Biswas, R., Casolani, C., Dode, A., Enzler, F., Jacquemin, L., et al. (2021) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2021.730758 · Cited by 6
Xiong, K., Wan, M., Cai, D., & Nan, W. (2024) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2024.112301 · Cited by 5
Spontaneous Modulation of Alpha Power During a Neurofeedback Session Without Instructions
Maaz, J., Paban, V., Waroquier, L., & Rey, A. (2026) · Psychophysiology · doi:10.1111/psyp.70285 · Cited by 4
“Indeed, these effects addressed important methodological issues which did not receive enough consideration so far (Chiasson et al. 2023; Hasslinger et al. 2022; Witte et al. 2018).”
Alpha power increases spontaneously during a neurofeedback session
Maaz, J., Waroquier, L., Dia, A., Paban, V., & Rey, A. (2026) · Communications Psychology · doi:10.1038/s44271-026-00431-w · Cited by 4
“More importantly, to operationalise EEG modulation, a key but often overlooked complication is the non-stationarity of EEG rhythms 19 .”
Marcu, G. M., Dumbravă, A., Bacila, C. I., Szekely‐Copîndean, R. D., & Zăgrean, A. (2023) · Applied Psychophysiology and Biofeedback · doi:10.1007/s10484-023-09610-5 · Cited by 4
“…et al., 2017; Schönenberg et al., 2017a; Schönenberg et al., 2017b; Thibault & Raz, 2016b; Thibault & Raz, 2016a; Micoulaud-Franchi & Fovet, 2016) and Brain (Schabus et al., 2017; Thibault et al., 2017; Schabus, 2017; Fovet et al., 2017; Thibault et al., 2018; Schabus, 2018; Witte et al., 2018).”
Perez, T. M., Adhia, D. B., Glue, P., Zeng, J., Dillingham, P. W., Navid, M. S., Niazi, I. K., Young, C. K., Smith, M. L., & Ridder, D. J. M. K. D. (2025) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-025-01279-z · Cited by 4
“…essential for a valid evaluation of EEG neuro-feedback’s specificity (Arns et al., 2014; Kerson, 2013; Sher-lin et al., 2011; Szewczyk et al., 2018; Witte et al., 2018; Zuberer et al., 2015), was noticeably absent in the trials presented as proof of wholly nonspecific effects (Pigott et al.,…”
Perez, T. M., Mathew, J., Glue, P., Adhia, D. B., & Ridder, D. D. (2022) · Frontiers in Neuroscience · doi:10.3389/fnins.2022.821136 · Cited by 3
Recovering Hidden Responder Groups in Individuals Receiving Neurofeedback for Tinnitus
Riha, C., Güntensperger, D., Kleinjung, T., & Meyer, M. E. (2022) · Frontiers in Neuroscience · doi:10.3389/fnins.2022.867704 · Cited by 2
Review of rehabilitation and auditory tests for hearing disorders
難聴対策委員会, 日., Kakigi, A., Suzuki, M., Sone, M., Kawase, T., Sakata, T., Sakata, H., Takumi, Y., Naito, Y., Fujioka, M., et al. (2023) · AUDIOLOGY JAPAN · doi:10.4295/audiology.66.169 · Cited by 2
Les enjeux de recherche du neurofeedback dans le trouble insomnie chronique
Micoulaud‐Franchi, J., Daudet, C., & Bioulac, S. (2019) · Médecine du Sommeil · doi:10.1016/j.msom.2019.05.005 · Cited by 3
Perez, T. M., Glue, P., Adhia, D. B., Mathew, J., & Ridder, D. D. (2021) · NeuroRegulation · doi:10.15540/nr.8.1.22 · Cited by 3
Koomen, A. P., Keeser, D., & Verhagen-Schouten, S. (2021) · Applied Neuroscience and Mental Health · doi:10.31739/anamh.2021.1.30 · Cited by 1
Fouillen, M. (2019) · theses.fr (ABES) · doi:10.70675/ec35d9e0z34a6z48bez87c6z2ba094ce6352 · Cited by 4
Saulnier, R., Spiluttini, B., Cuq, E. T., & Benchenane, K. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.12.27.522035
“Nevertheless, success of 12-15Hz SMR-based neurofeedback is a still highly controversial topic (Fovet et al., 2017; Schabus, 2018, 2017; Schabus et al., 2017; Thibault et al., 2017; Witte et al., 2018).”
BackgroundTinnitus : psychoacoustics and development of a bitherapy
Daoud, E. (2022) · theses.fr (ABES) · doi:10.70675/e0421484zc98cz40d8z9e79z289e82803dbb
Non-specific increase in alpha power during a neurofeedback session targeting its downregulation
Maaz, J., Dia, A., Waroquier, L., Paban, V., & Rey, A. (2026) · Imaging Neuroscience · doi:10.1162/imag.a.1258
“Furthermore, these diverse non-specific confounds have been argued to influence brain outcomes as well ( Maaz et al., 2025; Witte et al., 2018).”
Fu, R., Iglesias-Fuster, J., Zweerings, J., Keller, M., Kühne, S., Valdés-Sosa, M. J., Cong, F., & Mathiak, K. (2026) · NeuroImage · doi:10.1016/j.neuroimage.2026.122119
Metadata
- Authors
- Witte, M., Kober, S. E., & Wood, G.
- Affiliations
- University of Graz (AT)
- Corresponding author
- Witte, Matthias
- Venue
- Brain
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-03-13
- Volume
- 141
- Issue
- 5
- Pages
- e40-e40
- ISSN
- 0006-8950 (ISSN-L)
- 1460-2156
- OpenAlex
- W2793147776
- Semantic Scholar
- 9e477712844f41aac18b285bee1129f3287c10e3
- Cited by
- 36
- References
- 17
- Citations by year
- 2026: 3 · 2025: 3 · 2024: 1 · 2023: 3 · 2022: 10 · 2021: 6 · 2020: 4 · 2019: 3 · 2018: 3
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Brain (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
- Life Sciences › Neuroscience › Cognitive Neuroscience › Pain Management and Placebo Effect
- Life Sciences › Neuroscience › Neurology › Transcranial Magnetic Stimulation Studies
- Keywords
- placebo effect, sham neurofeedback, quality of life, social quality of life, insomnia, natural history, neurophysiological mechanisms, treatment specificity, reanalysis critique
- MeSH terms
- Attention Deficit Disorder with Hyperactivity, Double-Blind Method, Humans, Sleep Initiation and Maintenance Disorders, Treatment Outcome, Neurofeedback
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.