The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Independence in ROI analysis: where is the voodoo?
Open accessAbstract
We discuss the effects of non-independence on region of interest (ROI) analysis of functional magnetic resonance imaging data, which has recently been raised in a prominent article by Vul et al. We outline the problem of non-independence, and use a previously published dataset to examine the effects of non-independence. These analyses show that very strong correlations (exceeding 0.8) can occur even when the ROI is completely independent of the data being analyzed, suggesting that the claims of Vul et al. regarding the implausibility of these high correlations are incorrect. We conclude with some recommendations to help limit the potential problems caused by non-independence.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fischl, B., Salat, D. H., Busa, E., Albert, M., Dieterich, M., Haselgrove, C., van der Kouwe, A., Killiany, R., Kennedy, D., Klaveness, S., et al. (2002) · Neuron · doi:10.1016/s0896-6273(02)00569-x · Cited by 8,610
Nonparametric permutation tests for functional neuroimaging: A primer with examples
Nichols, T. E., & Holmes, A. P. (2002) · Human Brain Mapping · doi:10.1002/hbm.1058 · Cited by 6,256
Thresholding of statistical maps in functional neuroimaging using the false discovery rate
Genovese, C. R., Lazar, N. A., & Nichols, T. (2002) · NeuroImage · doi:10.1006/nimg.2001.1037 · Cited by 4,923
Circular analysis in systems neuroscience: the dangers of double dipping
Kriegeskorte, N., Simmons, W. K., Bellgowan, P. S. F., & Baker, C. I. (2009) · Nature Neuroscience · doi:10.1038/nn.2303 · Cited by 2,696
The neural basis of loss aversion in decision-making under risk
Tom, S. M., Fox, C. R., Trepel, C., & Poldrack, R. A. (2007) · Science · doi:10.1126/science.1134239 · Cited by 1,733 · cited 2×
“Tom et al. (2007) presented subjects on each trial with 50/50 gain/loss gambles that parametrically varied the amount that could be gained or lost, and asked them to decide whether they would accept each gamble; the gambles were not resolved during scanning.”
InfluentialSelf-citationPuzzlingly High Correlations in fMRI Studies of Emotion, Personality, and Social Cognition
Vul, E., Harris, C., Winkielman, P., & Pashler, H. (2009) · Perspectives on Psychological Science · doi:10.1111/j.1745-6924.2009.01125.x · Cited by 1,475
Guidelines for reporting an fMRI study
Poldrack, R. A., Fletcher, P. C., Henson, R. N., Worsley, K. J., Brett, M., & Nichols, T. E. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.11.048 · Cited by 550 · cited 1×
“(5) Whatever analyses are performed should be described in detail in the methods section or Supplementary Materials (cf. Poldrack et al., 2008).”
Self-citationRobust group analysis using outlier inference
Woolrich, M. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.02.042 · Cited by 504 · cited 2×
“This problem is so prevalent that we now try to use robust analyses whenever possible (e.g. Wager et al., 2005; Woolrich, 2008), though there are some cases where robust analyses may not be feasible.”
Bennett, C., Miller, M., & Wolford, G. (2009) · NeuroImage · doi:10.1016/s1053-8119(09)71202-9 · Cited by 400
Cited by
Dysfunction of the prefrontal cortex in addiction: neuroimaging findings and clinical implications
Goldstein, R. Z., & Volkow, N. D. (2011) · Nature Reviews Neuroscience · doi:10.1038/nrn3119 · Cited by 2,749
Frontocingulate Dysfunction in Depression: Toward Biomarkers of Treatment Response
Pizzagalli, D. A. (2011) · Neuropsychopharmacology · doi:10.1038/npp.2010.166 · Cited by 945
Compassion training alters altruism and neural responses to suffering.
Weng, H. Y., Fox, A. S., Shackman, A. J., Stodola, D. E., Caldwell, J. Z. K., Olson, M. C., Rogers, G. M., & Davidson, R. J. (2013) · Psychological Science · doi:10.1177/0956797612469537 · Cited by 602
Baliki, M. N., Geha, P. Y., Fields, H. L., & Apkarian, A. V. (2010) · Neuron · doi:10.1016/j.neuron.2010.03.002 · Cited by 555
Oxytocin Attenuates Amygdala Reactivity to Fear in Generalized Social Anxiety Disorder
Labuschagne, I., Phan, K. L., Wood, A., Angstadt, M., Chua, P., Heinrichs, M., Stout, J. C., & Nathan, P. J. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2010.123 · Cited by 549
The principled control of false positives in neuroimaging
Bennett, C. M., Wolford, G. L., & Miller, M. B. (2009) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsp053 · Cited by 486
Desbordes, G., Negi, L. T., Pace, T. W. W., Wallace, B. A., Raison, C. L., & Schwartz, E. L. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00292 · Cited by 458
REM sleep depotentiates amygdala activity to previous emotional experiences
van der Helm, E., Yao, J., Dutt, S., Rao, V., Saletin, J. M., & Walker, M. P. (2011) · Current Biology · doi:10.1016/j.cub.2011.10.052 · Cited by 379
“(B) Corresponding scatterplot of the amygdala-gamma power relationship shown in (A), with R noted only for descriptive purposes [46, 47], with lower”
The impact of sleep deprivation on food desire in the human brain
Greer, S. M., Goldstein, A. N., & Walker, M. P. (2013) · Nature Communications · doi:10.1038/ncomms3259 · Cited by 375
“MNI Coordinates [x, y, z] were: amygdala (18, −12, −22)8; ventral striatum (−12, 12, −10) 39; Anterior cingulated cortex (15, 6, 38)40; Lateral orbital frontal cortex (−36, 42, −10) 41; and bilateral anterior insula (−31, 22, 11 & 36, 17, 0) 42.”
Sleep loss causes social withdrawal and loneliness
Ben Simon, E., & Walker, M. P. (2018) · Nature Communications · doi:10.1038/s41467-018-05377-0 · Cited by 352
The neural correlates of empathy: experience, automaticity, and prosocial behavior
Rameson, L. T., Morelli, S. A., & Lieberman, M. D. (2012) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00130 · Cited by 279
Bergmann, T. O., Mölle, M., Diedrichs, J., Born, J., & Siebner, H. R. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.10.036 · Cited by 228
A cry in the dark: depressed mothers show reduced neural activation to their own infant’s cry
Laurent, H. K., & Ablow, J. C. (2012) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsq091 · Cited by 224
“Finally, to visualize the data driving continuous depression effects, but not to perform new statistical tests (Poldrack and Mumford, 2009), spherical ROI’s (r1⁄4 3 mm) centered on activation peaks were used to compute percent signal change associated with sound stimuli (compared to rest) and generate illustrative fig…”
MethodThomas, C., & Baker, C. I. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2012.03.069 · Cited by 204
Bayesian Prediction and Evaluation in the Anterior Cingulate Cortex
Ide, J. S., Shenoy, P., Yu, A. J., & Li, C.-S. R. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.2201-12.2013 · Cited by 185
“To perform a robust region of interest (ROI) analysis, free from spurious correlations, we used a leave-six-out cross-validation approach (Poldrack and Mumford, 2009): always holding six subjects out of the group analysis (without repetition), we found a dACC cluster for each group of 60 subjects.”
MethodBen Simon, E., Rossi, A., Harvey, A. G., & Walker, M. P. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0754-8 · Cited by 177
The neural correlates of maternal sensitivity: an fMRI study
Musser, E. D., Kaiser-Laurent, H., & Ablow, J. C. (2012) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2012.04.003 · Cited by 177
“Finally, to visualize the data driving continuous behavior effects, but not to perform new statistical tests (Poldrack and Mumford, 2009), spherical ROIs (r = 4 mm) centered on activation peaks were used to compute percent signal change associated with sound stimuli (compared to rest) and generate illustrative figures…”
Altered neural reward and loss processing and prediction error signalling in depression
Ubl, B., Kuehner, C., Kirsch, P., Ruttorf, M., Diener, C., & Flor, H. (2015) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsu158 · Cited by 165
Top-down regulation of default mode activity in spatial visual attention
Wen, X., Liu, Y., Yao, L., & Ding, M. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.4939-12.2013 · Cited by 150
“False discovery rate (FDR) control was applied to correct for multiple comparisons (Bennett et al., 2009; Poldrack and Mumford, 2009).”
MethodAutomatic versus Choice-Dependent Value Representations in the Human Brain
Grueschow, M., Polania, R., Hare, T. A., & Ruff, C. C. (2015) · Neuron · doi:10.1016/j.neuron.2014.12.054 · Cited by 130
Farb, N. A. S., Anderson, A. K., Bloch, R. T., & Segal, Z. V. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.03.009 · Cited by 141
Avoidance of harm and anxiety: A role for the nucleus accumbens
Levita, L., Hoskin, R., & Champi, S. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.04.059 · Cited by 137
Maslowsky, J., Mogg, K., Bradley, B. P., McClure-Tone, E., Ernst, M., Pine, D. S., & Monk, C. S. (2010) · Journal of Child and Adolescent Psychopharmacology · doi:10.1089/cap.2009.0049 · Cited by 125
Self-Other Representation in the Social Brain Reflects Social Connection
Courtney, A. L., & Meyer, M. L. (2020) · The Journal of Neuroscience · doi:10.1523/jneurosci.2826-19.2020 · Cited by 115
Real-world stress resilience is associated with the responsivity of the locus coeruleus
Grueschow, M., Stenz, N., Thörn, H., Ehlert, U., Breckwoldt, J., Brodmann Maeder, M., Exadaktylos, A. K., Bingisser, R., Ruff, C. C., & Kleim, B. (2021) · Nature Communications · doi:10.1038/s41467-021-22509-1 · Cited by 116
Singleton, O., Hölzel, B. K., Vangel, M., Brach, N., Carmody, J., & Lazar, S. W. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00033 · Cited by 110
Protecting the self: The effect of social-evaluative threat on neural representations of self
Hughes, B. L., & Beer, J. S. (2013) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00343 · Cited by 101
Indiscriminate Amygdala Response to Mothers and Strangers After Early Maternal Deprivation
Olsavsky, A. K., Telzer, E. H., Shapiro, M., Humphreys, K. L., Flannery, J., Goff, B., & Tottenham, N. (2013) · Biological Psychiatry · doi:10.1016/j.biopsych.2013.05.025 · Cited by 99
“Initial analyses to decompose the interaction in the AFNI GLM used cluster-level statistics, but correlation analyses were performed with an anatomical ROI (defined by a right amygdala mask in the Talairach-Tournoux atlas implemented in AFNI) to avoid redundancy (54).”
MethodDifferent developmental trajectories for anticipation and receipt of reward during adolescence
Hoogendam, J. M., Kahn, R. S., Hillegers, M. H. J., van Buuren, M., & Vink, M. (2013) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2013.08.004 · Cited by 78
“Because these areas were predefined, the use of a lower statistical threshold was allowed (Poldrack and Mumford, 2009; Poldrack, 2007).”
Alahyane, N., Brien, D. C., Coe, B. C., Stroman, P. W., & Munoz, D. P. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.03.008 · Cited by 68
Tan, L. H., Chen, L., Yip, V., Chan, A. H. D., Yang, J., Gao, J.-H., & Siok, W. T. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0909623108 · Cited by 54
Puberty and functional brain development in humans: convergence in findings?
Dai, J., & Scherf, K. S. (2019) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2019.100690 · Cited by 51
Brain connectivity and behavioral changes in a spaceflight analog environment with elevated CO2
McGregor, H. R., Lee, J. K., Mulder, E. R., De Dios, Y. E., Beltran, N. E., Kofman, I. S., Bloomberg, J. J., Mulavara, A. P., & Seidler, R. D. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2020.117450 · Cited by 36
Metadata
- Authors
- Poldrack, R. A., & Mumford, J. A.
- Venue
- Social Cognitive and Affective Neuroscience
- Publisher
- Oxford University Press (OUP)
- Published
- 2009-06-01
- Volume
- 4
- Issue
- 2
- Pages
- 208-213
- ISSN
- 1749-5016 (ISSN-L)
- 1749-5024
- OpenAlex
- W1968101549
- Cited by
- 192
- References
- 9
- FWCI
- 12.33
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.