Control freaks: Towards optimal selection of control conditions for fMRI neurofeedback studies
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
fMRI Neurofeedback research employs many different control conditions. Currently, there is no consensus as to which control condition is best, and the answer depends on what aspects of the neurofeedback-training design one is trying to control for. These aspects can range from determining whether participants can learn to control brain activity via neurofeedback to determining whether there are clinically significant effects of the neurofeedback intervention. Lack of consensus over criteria for control conditions has hampered the design and interpretation of studies employing neurofeedback protocols. This paper presents an overview of the most commonly employed control conditions currently used in neurofeedback studies and discusses their advantages and disadvantages. Control conditions covered include no control, treatment-as-usual, bidirectional-regulation control, feedback of an alternative brain signal, sham feedback, and mental-rehearsal control. We conclude that the selection of the control condition(s) should be determined by the specific research goal of the study and best procedures that effectively control for relevant confounding factors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · cited 1×
“As explained in Button et al (2013)(93), adequately powered studies are needed to ensure reproducibility of results.”
Process evaluation of complex interventions: Medical Research Council guidance
Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., Moore, L., O'Cathain, A., Tinati, T., Wight, D., et al. (2015) · BMJ · doi:10.1136/bmj.h1258 · Cited by 6,204
Control over brain activation and pain learned by using real-time functional MRI
deCharms, R. C., Maeda, F., Glover, G. H., Ludlow, D., Pauly, J. M., Soneji, D., Gabrieli, J. D. E., & Mackey, S. C. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0505210102 · Cited by 876 · cited 3×
“In this study, autonomic tone feedback (including measures of skin conductance, heart rate, and respiration) associated with decreased arousal and increased relaxation was significantly less effective at reducing perception of pain than neurofeedback from the anterior cingulate cortex (41).”
InfluentialFurukawa, T. A., Noma, H., Caldwell, D. M., Honyashiki, M., Shinohara, K., Imai, H., Chen, P., Hunot, V., & Churchill, R. (2014) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12275 · Cited by 521 · cited 1×
“For example, participants in the control group may be motivated to stay depressed so they are still eligible when the wait period is over (18).”
Real-time fMRI neurofeedback: Progress and challenges
Sulzer, J., Haller, S., Scharnowski, F., Weiskopf, N., Birbaumer, N., Blefari, M. L., Bruehl, A. B., Cohen, L. G., deCharms, R. C., Gassert, R., et al. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.03.033 · Cited by 453 · cited 2×
“Unfortunately, the sample was very small (only 4-8 participants in each group) and the authors were unable to replicate their results (89).”
Self-citationTeuber, H. L. (1955) · Annual Review of Psychology · doi:10.1146/annurev.ps.06.020155.001411 · Cited by 402
Young, K. D., Siegle, G. J., Zotev, V., Phillips, R., Misaki, M., Yuan, H., Drevets, W. C., & Bodurka, J. (2017) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2017.16060637 · Cited by 331 · cited 4×
“When designing this type of control condition, it is important that the control ROI is matched to the target ROI in terms of either tissue composition, number of voxels, and/or temporal signal-to-noise ratio so that accurate and reliable detection of activation is possible and different results are not due to one regi…”
InfluentialSelf-citationThe self-regulating brain and neurofeedback: experimental science and clinical promise
Thibault, R. T., Lifshitz, M., & Raz, A. (2016) · Cortex · doi:10.1016/j.cortex.2015.10.024 · Cited by 272 · cited 1×
“2 Ethical Concerns: Research using sham or alternative ROI feedback has raised ethical concerns for researchers (36, 85-87).”
Advances in fMRI Real-Time Neurofeedback
Watanabe, T., Sasaki, Y., Shibata, K., & Kawato, M. (2017) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2017.09.010 · Cited by 242
Scheinost, D., Stoica, T., Saksa, J., Papademetris, X., Constable, R. T., Pittenger, C., & Hampson, M. (2013) · Translational Psychiatry · doi:10.1038/tp.2013.24 · Cited by 201 · cited 1×
“A more common approach, particularly in clinical populations, is to use one control group that receives a placebo-controlled form of feedback and is also matched for the instructed or suggested mental strategies to try during feedback (33, 54, 94).”
Self-citationWatts, S. E., Turnell, A., Kladnitski, N., Newby, J. M., & Andrews, G. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.12.025 · Cited by 188 · cited 1×
“This includes information about who provided the treatment, what the treatment consisted of, number and duration of sessions, and the country and standard of health care provided (17).”
Plastic modulation of PTSD resting‐state networks and subjective wellbeing by EEG neurofeedback
Kluetsch, R. C., Ros, T., Théberge, J., Frewen, P. A., Calhoun, V. D., Schmahl, C., Jetly, R., & Lanius, R. A. (2014) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12229 · Cited by 183 · cited 1×
“2 Ethical Concerns: Research using sham or alternative ROI feedback has raised ethical concerns for researchers (36, 85-87).”
Multivoxel neurofeedback selectively modulates confidence without changing perceptual performance
Cortese, A., Amano, K., Koizumi, A., Kawato, M., & Lau, H. (2016) · Nature Communications · doi:10.1038/ncomms13669 · Cited by 157 · cited 2×
“This control condition can be used for between- as well as within-group designs, and it has been successfully used in biofeedback, magnetoencephalography (MEG)-, EEG-, and fMRI-neurofeedback studies (20-22, 24-31).”
Real-time fMRI links subjective experience with brain activity during focused attention
Garrison, K. A., Scheinost, D., Worhunsky, P. D., Elwafi, H. M., Thornhill, T. A., Thompson, E., Saron, C., Desbordes, G., Kober, H., Hampson, M., et al. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.05.030 · Cited by 154
Self-citationReal‐time f MRI neurofeedback in adolescents with attention deficit hyperactivity disorder
Alegria, A. A., Wulff, M., Brinson, H., Barker, G. J., Norman, L. J., Brandeis, D., Stahl, D., David, A. S., Taylor, E., Giampietro, V., et al. (2017) · Human Brain Mapping · doi:10.1002/hbm.23584 · Cited by 151
Koizumi, A., Amano, K., Cortese, A., Shibata, K., Yoshida, W., Seymour, B., Kawato, M., & Lau, H. (2016) · Nature Human Behaviour · doi:10.1038/s41562-016-0006 · Cited by 133 · cited 1×
“Another example comes from Koizumi et al., in which participants were reinforced when their brain activity reflected a pattern in the visual cortex associated with a fearful stimulus in the absence of stimulus presentation (92).”
fMRI neurofeedback facilitates anxiety regulation in females with spider phobia
Zilverstand, A., Sorger, B., Sarkheil, P., & Goebel, R. (2015) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2015.00148 · Cited by 133 · cited 1×
“The mental-rehearsal control condition can be implemented both inside (57, 59, 60, 62-80) and outside the MRI scanner (e.g., 41, 81, 82-84 ).”
Self-citationMicoulaud-Franchi, J.-A., McGonigal, A., Lopez, R., Daudet, C., Kotwas, I., & Bartolomei, F. (2015) · Neurophysiologie Clinique/Clinical Neurophysiology · doi:10.1016/j.neucli.2015.10.077 · Cited by 111
Marx, A.-M., Ehlis, A.-C., Furdea, A., Holtmann, M., Banaschewski, T., Brandeis, D., Rothenberger, A., Gevensleben, H., Freitag, C. M., Fuchsenberger, Y., et al. (2015) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.01038 · Cited by 101 · cited 1×
“MEG and fNIRS neurofeedback are still in the early phases of development and testing, with many studies identifying as pilot studies that do not include any control condition(20, 97-99), though some have included a sham feedback control (48, 100, 101), or more complex designs (102).”
Zilverstand, A., Sorger, B., Slaats-Willemse, D., Kan, C. C., Goebel, R., & Buitelaar, J. K. (2017) · PLoS ONE · doi:10.1371/journal.pone.0170795 · Cited by 96
Down-regulation of amygdala activation with real-time fMRI neurofeedback in a healthy female sample
Paret, C., Kluetsch, R., Ruf, M., Demirakca, T., Hoesterey, S., Ende, G., & Schmahl, C. (2014) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2014.00299 · Cited by 95
Control of nucleus accumbens activity with neurofeedback
Greer, S. M., Trujillo, A. J., Glover, G. H., & Knutson, B. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.03.073 · Cited by 92
Real-time fMRI neurofeedback with War Veterans with chronic PTSD: a feasibility study
Gerin, M. I., Fichtenholtz, H., Roy, A., Walsh, C. J., Krystal, J. H., Southwick, S., & Hampson, M. (2016) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2016.00111 · Cited by 84
Self-citationfMRI feedback enhances emotion regulation as evidenced by a reduced amygdala response
Sarkheil, P., Zilverstand, A., Kilian-Hütten, N., Schneider, F., Goebel, R., & Mathiak, K. (2015) · Behavioural Brain Research · doi:10.1016/j.bbr.2014.11.027 · Cited by 77
Cited by
Ros, T., Enriquez-Geppert, S., Zotev, V., Young, K. D., Wood, G., Whitfield-Gabrieli, S., Wan, F., Vuilleumier, P., Vialatte, F., Van De Ville, D., et al. (2020) · Brain · doi:10.1093/brain/awaa009 · Cited by 399
Self-citationRibeiro, T. F., Carriello, M. A., de Paula, E. P., Garcia, A. C., Rocha, G. L. D., & Teive, H. A. G. (2023) · Frontiers in Neuroscience · doi:10.3389/fnins.2023.1195066 · Cited by 13
Perez, T. M., Glue, P., Adhia, D. B., Navid, M. S., Zeng, J., Dillingham, P., Smith, M., Niazi, I. K., Young, C. K., & De Ridder, D. (2022) · Trials · doi:10.1186/s13063-022-06863-z · Cited by 8
“Importantly, this type of control allows matching of rewards and performance across sham and genuine conditions, thereby controlling as much as possible the learning context and degree of motivation [213] while theoretically severing the operant conditioning aspect of EEG-NFB.”
Background
Metadata
- Authors
- Sorger, B., Scharnowski, F., Linden, D. E. J., Hampson, M., & Young, K. D.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2019-02
- Volume
- 186
- Pages
- 256-265
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2900125791
- Cited by
- 215
- References
- 25
- FWCI
- 10.79
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.