Improving effect size estimation and statistical power with multi-echo fMRI and its impact on understanding the neural systems supporting mentalizing
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Functional magnetic resonance imaging (fMRI) research is routinely criticized for being statistically underpowered due to characteristically small sample sizes and much larger sample sizes are being increasingly recommended. Additionally, various sources of artifact inherent in fMRI data can have detrimental impact on effect size estimates and statistical power. Here we show how specific removal of non-BOLD artifacts can improve effect size estimation and statistical power in task-fMRI contexts, with particular application to the social-cognitive domain of mentalizing/theory of mind. Non-BOLD variability identification and removal is achieved in a biophysical and statistically principled manner by combining multi-echo fMRI acquisition and independent components analysis (ME-ICA). Without smoothing, group-level effect size estimates on two different mentalizing tasks were enhanced by ME-ICA at a median rate of 24% in regions canonically associated with mentalizing, while much more substantial boosts (40-149%) were observed in non-canonical cerebellar areas. Effect size boosting occurs via reduction of non-BOLD noise at the subject-level and consequent reductions in between-subject variance at the group-level. Smoothing can attenuate ME-ICA-related effect size improvements in certain circumstances. Power simulations demonstrate that ME-ICA-related effect size enhancements enable much higher-powered studies at traditional sample sizes. Cerebellar effects observed after applying ME-ICA may be unobservable with conventional imaging at traditional sample sizes. Thus, ME-ICA allows for principled design-agnostic non-BOLD artifact removal that can substantially improve effect size estimates and statistical power in task-fMRI contexts. ME-ICA could mitigate some issues regarding statistical power in fMRI studies and enable novel discovery of aspects of brain organization that are currently under-appreciated and not well understood.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Does the autistic child have a “theory of mind” ?
Baron-Cohen, S., Leslie, A. M., & Frith, U. (1985) · Cognition · doi:10.1016/0010-0277(85)90022-8 · Cited by 8,599
Self-citationPower failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · cited 4×
“Low statistical power by definitionmeans that a studywill have less of a chance for detecting true effects, but also means that observed statistically significant effects are less likely to be true and will be more susceptible to the biasing impact of questionable research practices (Button et al., 2013; Ioannidis, 20…”
BackgroundInfluentialSimmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 2×
“Low statistical power by definitionmeans that a studywill have less of a chance for detecting true effects, but also means that observed statistically significant effects are less likely to be true and will be more susceptible to the biasing impact of questionable research practices (Button et al., 2013; Ioannidis, 20…”
BackgroundLarge-scale automated synthesis of human functional neuroimaging data.
Yarkoni, T., Poldrack, R. A., Nichols, T. E., Van Essen, D. C., & Wager, T. D. (2011) · Nature Methods · doi:10.1038/nmeth.1635 · Cited by 3,686 · cited 1×
“org) (Yarkoni et al., 2011) for the feature ‘mentalizing’.”
Representational similarity analysis-connecting the branches of systems neuroscience
Kriegeskorte, N. (2008) · Frontiers in Systems Neuroscience · doi:10.3389/neuro.06.004.2008 · Cited by 3,355
Development and neurophysiology of mentalizing
Frith, U., & Frith, C. D. (2003) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.2002.1218 · Cited by 2,306 · cited 1×
“We also evaluate the impact of the method on two sets of brain regions; ‘canonical’ regions typically highlighted as important in the neural systems for mentalizing (Frith and Frith, 2003; Lombardo et al., 2010b; Saxe and Powell, 2006; Schaafsma et al., 2015; Schurz et al., 2014; Spunt and Adolphs, 2014; van Overwalle…”
MethodBeyond mind-reading: multi-voxel pattern analysis of fMRI data
Norman, K. A., Polyn, S. M., Detre, G. J., & Haxby, J. V. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.07.005 · Cited by 2,271 · cited 1×
“Taking this hypothesis one step further, we also”
BackgroundFunctional topography in the human cerebellum: A meta-analysis of neuroimaging studies
STOODLEY, C., & SCHMAHMANN, J. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.08.039 · Cited by 2,183 · cited 1×
“particularly in the context of its potential role in higher-level cognition (Buckner, 2013; Schmahmann, 1997; Stoodley and Schmahmann, 2009; van Overwalle et al., 2014; Wang et al., 2014).”
BackgroundSocial cognition and the brain: A meta-analysis
Van Overwalle, F. (2009) · Human Brain Mapping · doi:10.1002/hbm.20547 · Cited by 1,792
Fractionating theory of mind: a meta-analysis of functional brain imaging studies
Schurz, M., Radua, J., Aichhorn, M., Richlan, F., & Perner, J. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2014.01.009 · Cited by 1,656
Schmahmann, J. D. (2019) · Neuroscience Letters · doi:10.1016/j.neulet.2018.07.005 · Cited by 1,625
Toward a second-person neuroscience
Schilbach, L., Timmermans, B., Reddy, V., Costall, A., Bente, G., Schlicht, T., & Vogeley, K. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000660 · Cited by 1,510
Resting-state fMRI in the human connectome project
Smith, S. M., Beckmann, C. F., Andersson, J., Auerbach, E. J., Bijsterbosch, J., Douaud, G., Duff, E., Feinberg, D. A., Griffanti, L., Harms, M. P., et al. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.05.039 · Cited by 1,502
Control of mental activities by internal models in the cerebellum
Ito, M. (2008) · Nature Reviews Neuroscience · doi:10.1038/nrn2332 · Cited by 1,356 · cited 2×
“Low statistical power by definition means that a study will have less of a chance for detecting true effects, but also means that observed statistically significant effects are less likely to be true and will be more susceptible to the biasing impact of questionable research practices (Button et al., 2013; Ioannidis,…”
BackgroundHypoplasia of cerebellar vermal lobules VI and VII in autism
Courchesne, E., Yeung-Courchesne, R., Hesselink, J. R., & Jernigan, T. L. (1988) · New England Journal of Medicine · doi:10.1056/nejm198805263182102 · Cited by 1,058
Dissociable Medial Prefrontal Contributions to Judgments of Similar and Dissimilar Others
Mitchell, J. P., Macrae, C. N., & Banaji, M. R. (2006) · Neuron · doi:10.1016/j.neuron.2006.03.040 · Cited by 1,023
Functional system and areal organization of a highly sampled individual human brain
Laumann, T. O., Gordon, E. M., Adeyemo, B., Snyder, A. Z., Joo, S. J., Chen, M.-Y., Gilmore, A. W., McDermott, K. B., Nelson, S. M., Dosenbach, N. U. F., et al. (2015) · Neuron · doi:10.1016/j.neuron.2015.06.037 · Cited by 911
It's the Thought That Counts: Specific Brain Regions for One Component of Theory of Mind
Saxe, R., & Powell, L. J. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01768.x · Cited by 815
Estimating sample size in functional MRI (fMRI) neuroimaging studies: Statistical power analyses
Desmond, J. E., & Glover, G. H. (2002) · Journal of Neuroscience Methods · doi:10.1016/s0165-0270(02)00121-8 · Cited by 716 · cited 1×
“While these recommendations are important to consider (Desmond and Glover, 2002; Friston, 2012; Lindquist et al., 2013; Mumford and Nichols, 2008; Yarkoni, 2009), other considerations such as dealing with substantial sources of non-BOLD noise inherent in fMRI data also need to be evaluated before the field assumes inc…”
BackgroundResting-state fMRI confounds and cleanup
Murphy, K., Birn, R. M., & Bandettini, P. A. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.04.001 · Cited by 666 · cited 1×
“The poor sensitivity of fMRI often arises from high levels of subject motion (often task correlated), cardiopulmonary physiology, or other types of imaging artifact (Murphy et al., 2013).”
BackgroundThe neural bases of empathic accuracy
Zaki, J., Weber, J., Bolger, N., & Ochsner, K. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0902666106 · Cited by 422
Integrated strategy for improving functional connectivity mapping using multiecho fMRI
Kundu, P., Brenowitz, N. D., Voon, V., Worbe, Y., Vértes, P. E., Inati, S. J., Saad, Z. S., Bandettini, P. A., & Bullmore, E. T. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1301725110 · Cited by 399
Self-citationAndrews-Hanna, J. R., Saxe, R., & Yarkoni, T. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.01.032 · Cited by 313
Lombardo, M. V., Chakrabarti, B., Bullmore, E. T., & Baron-Cohen, S. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.02.067 · Cited by 275
Self-citationAgainst hyperacuity in brain reading: Spatial smoothing does not hurt multivariate fMRI analyses?
Op de Beeck, H. P. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.02.047 · Cited by 275
Repetition suppression of ventromedial prefrontal activity during judgments of self and others
Jenkins, A. C., Macrae, C. N., & Mitchell, J. P. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0708785105 · Cited by 266
Mumford, J. A., & Nichols, T. E. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.07.061 · Cited by 252 · cited 1×
“While these recommendations are important to consider (Desmond and Glover, 2002; Friston, 2012; Lindquist et al., 2013; Mumford and Nichols, 2008; Yarkoni, 2009), other considerations such as dealing with substantial sources of non-BOLD noise inherent in fMRI data also need to be evaluated before the field assumes inc…”
BackgroundGweon, H., Dodell-Feder, D., Bedny, M., & Saxe, R. (2012) · Child Development · doi:10.1111/j.1467-8624.2012.01829.x · Cited by 206
Spatial smoothing hurts localization but not information: Pitfalls for brain mappers
Kamitani, Y., & Sawahata, Y. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.06.040 · Cited by 122
Validating the Why/How contrast for functional MRI studies of Theory of Mind
Spunt, R. P., & Adolphs, R. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.05.023 · Cited by 116
Cited by
Methods for cleaning the BOLD fMRI signal
Caballero-Gaudes, C., & Reynolds, R. C. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.12.018 · Cited by 542
Multi-echo fMRI: A review of applications in fMRI denoising and analysis of BOLD signals
Kundu, P., Voon, V., Balchandani, P., Lombardo, M. V., Poser, B. A., & Bandettini, P. A. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.03.033 · Cited by 321
Self-citationLoth, E., Charman, T., Mason, L., Tillmann, J., Jones, E. J. H., Wooldridge, C., Ahmad, J., Auyeung, B., Brogna, C., Ambrosino, S., et al. (2017) · Molecular Autism · doi:10.1186/s13229-017-0146-8 · Cited by 299
Self-citationAdvances in resting state fMRI acquisitions for functional connectomics
Raimondo, L., Oliveira, Ĺ. A. F., Heij, J., Priovoulos, N., Kundu, P., Leoni, R. F., & van der Zwaag, W. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118503 · Cited by 180
Self-citationIntranasal oxytocin enhances intrinsic corticostriatal functional connectivity in women
Bethlehem, R. A. I., Lombardo, M. V., Lai, M.-C., Auyeung, B., Crockford, S. K., Deakin, J., Soubramanian, S., Sule, A., Kundu, P., Voon, V, et al. (2017) · Translational Psychiatry · doi:10.1038/tp.2017.72 · Cited by 96
Self-citation
Metadata
- Authors
- Lombardo, M. V., Auyeung, B., Holt, R. J., Waldman, J., Ruigrok, A. N. V., Mooney, N., Bullmore, E. T., Baron-Cohen, S., & Kundu, P.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2016-11
- Volume
- 142
- Pages
- 55-66
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2951739059
- Cited by
- 76
- References
- 31
- FWCI
- 7.10
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.