Consistency and variability in functional localisers
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
A critical assumption underlying the use of functional localiser scans is that the voxels identified as the functional region-of-interest (fROI) are essentially the same as those activated by the main experimental manipulation. Intra-subject variability in the location of the fROI violates this assumption, reducing the sensitivity of the analysis and biasing the results. Here we investigated consistency and variability in fROIs in a set of 45 volunteers. They performed two functional localiser scans to identify word- and object-sensitive regions of ventral and lateral occipito-temporal cortex, respectively. In the main analyses, fROIs were defined as the category-selective voxels in each region and consistency was measured as the spatial overlap between scans. Consistency was greatest when minimally selective thresholds were used to define "active" voxels (p<0.05 uncorrected), revealing that approximately 65% of the voxels were commonly activated by both scans. In contrast, highly selective thresholds (p<10(-4) to 10(-6)) yielded the lowest consistency values with less than 25% overlap of the voxels active in both scans. In other words, intra-subject variability was surprisingly high, with between one third and three quarters of the voxels in a given fROI not corresponding to those activated in the main task. This level of variability stands in striking contrast to the consistency seen in retinotopically-defined areas and has important implications for designing robust but efficient functional localiser scans.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Jenkinson, M., Bannister, P., Brady, M., & Smith, S. (2002) · NeuroImage · doi:10.1006/nimg.2002.1132 · Cited by 11,888
Distributed and overlapping representations of faces and objects in ventral temporal cortex
Haxby, J. V., Gobbini, M. I., Furey, M. L., Ishai, A., Schouten, J. L., & Pietrini, P. (2001) · Science · doi:10.1126/science.1063736 · Cited by 3,940
People thinking about thinking peopleThe role of the temporo-parietal junction in “theory of mind”
Saxe, R., & Kanwisher, N. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00230-1 · Cited by 2,316
Cohen, L., Dehaene, S., Naccache, L., Lehéricy, S., Dehaene-Lambertz, G., Hénaff, M.-A., & Michel, F. (2000) · Brain · doi:10.1093/brain/123.2.291 · Cited by 1,954
The visual word form area: expertise for reading in the fusiform gyrus
McCandliss, B. D., Cohen, L., & Dehaene, S. (2003) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(03)00134-7 · Cited by 1,489 · cited 1×
“This region is sometimes referred to as the " visual word form area " (Dehaene et al., 2005; McCandliss et al., 2003), although the term is misleading as it suggests a functional specificity which is not present (Price and Devlin, 2003, 2004 only voxels with at least a 20% chance of being grey…”
Language‐specific tuning of visual cortex? Functional properties of the Visual Word Form Area
Cohen, L., Lehéricy, S., Chochon, F., Lemer, C., Rivaud, S., & Dehaene, S. (2002) · Brain · doi:10.1093/brain/awf094 · Cited by 1,254 · cited 2×
“…the random effects level similar to previous studies (Cohen et al., 2002; Devlin et al., 2006), the activation was not reliable for individuals (see also Baker et al., 2007; Cohen et al., 2002; Vigneau et al., 2005) and therefore [words > rest] was used to identify reading-sensitive areas instead.”
Neuroimaging studies of word reading
Fiez, J. A., & Petersen, S. E. (1998) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.95.3.914 · Cited by 727
Understanding Other Minds: Linking Developmental Psychology and Functional Neuroimaging
Saxe, R., Carey, S., & Kanwisher, N. (2004) · Annual Review of Psychology · doi:10.1146/annurev.psych.55.090902.142044 · Cited by 726
Visually guided grasping produces fMRI activation in dorsal but not ventral stream brain areas
Culham, J. C., Danckert, S. L., Souza, J. F. X. D., Gati, J. S., Menon, R. S., & Goodale, M. A. (2003) · Experimental Brain Research · doi:10.1007/s00221-003-1591-5 · Cited by 637 · cited 1×
“…al., 2007; Levy et al., 2001; O'Craven and Kanwisher, 2000; Yovel et al., 2008), speech (Miller and D'Esposito, 2005; Szycik et al., 2008), objects (Culham et al., 2003; Eger et al., 2008; Haxby et al., 2001; Jiang et al., 2007; Kourtzi and Kanwisher, 2000; Levy et al., 2001; Yovel et al., 2008),…”
Shaywitz, B. A., Shaywitz, S. E., Blachman, B. A., Pugh, K. R., Fulbright, R. K., Skudlarski, P., Mencl, W. E., Constable, R. T., Holahan, J. M., Marchione, K. E., et al. (2004) · Biological Psychiatry · doi:10.1016/j.biopsych.2003.12.019 · Cited by 613
Cited by
fMRIPrep: A robust preprocessing pipeline for functional MRI
Esteban, O., Markiewicz, C. J., Blair, R. W., Moodie, C. A., Isik, A. I., Erramuzpe, A., Kent, J. D., Goncalves, M., DuPre, E., Snyder, M., et al. (2019) · Nature Methods · doi:10.1038/s41592-018-0235-4 · Cited by 3,905
Cluster failure: why fMRI inferences for spatial extent have inflated false-positive rates
Eklund, A., Nichols, T. E., & Knutsson, H. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1602413113 · Cited by 3,487
“The word and object processing experiment (36) was approved by the Berkshire National Health Service Research Ethics Committee.”
Assessing and tuning brain decoders: Cross-validation, caveats, and guidelines
Varoquaux, G., Raamana, P. R., Engemann, D. A., Hoyos-Idrobo, A., Schwartz, Y., & Thirion, B. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.10.038 · Cited by 792
The Interactive Account of ventral occipitotemporal contributions to reading
Price, C. J., & Devlin, J. T. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.04.001 · Cited by 720
Self-citationHow reliable are the results from functional magnetic resonance imaging?
Bennett, C. M., & Miller, M. B. (2010) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2010.05446.x · Cited by 577
Optimizing Functional Accuracy of TMS in Cognitive Studies: A Comparison of Methods
Sack, A. T., Cohen Kadosh, R., Schuhmann, T., Moerel, M., Walsh, V., & Goebel, R. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21126 · Cited by 443
Toward open sharing of task-based fMRI data: the OpenfMRI project
Poldrack, R. A., Barch, D. M., Mitchell, J. P., Wager, T. D., Wagner, A. D., Devlin, J. T., Cumba, C., Koyejo, O., & Milham, M. P. (2013) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2013.00012 · Cited by 342
Self-citationChen, X., Lu, B., & Yan, C. (2018) · Human Brain Mapping · doi:10.1002/hbm.23843 · Cited by 340
Frost, M. A., & Goebel, R. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.08.035 · Cited by 313
Rossion, B., Hanseeuw, B., & Dricot, L. (2012) · Brain and Cognition · doi:10.1016/j.bandc.2012.01.001 · Cited by 269
FMRIPrep: a robust preprocessing pipeline for functional MRI
Esteban, O., Markiewicz, C. J., Blair, R. W., Moodie, C. A., Isik, A. I., Erramuzpe, A., Kent, J. D., Goncalves, M., DuPre, E., Snyder, M., et al. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/306951 · Cited by 195
Progress toward openness, transparency, and reproducibility in cognitive neuroscience
Gilmore, R. O., Diaz, M. T., Wyble, B. A., & Yarkoni, T. (2017) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.13325 · Cited by 95
Engell, A. D., & McCarthy, G. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.02.025 · Cited by 77
“At the liberal threshold of z > 1.65, these face reliability results are roughly consistent with those reported for language localizers (Duncan et al., 2009).”
BackgroundMethodResultInfluentialReliable individual differences in fine-grained cortical functional architecture
Feilong, M., Nastase, S. A., Guntupalli, J. S., & Haxby, J. V. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.08.029 · Cited by 68
Leveraging shared connectivity to aggregate heterogeneous datasets into a common response space
Nastase, S. A., Liu, Y.-F., Hillman, H., Norman, K. A., & Hasson, U. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.116865 · Cited by 42
“However, fi ne-grained functional response topographies (e.g., Brett et al., 2002; Duncan et al., 2009; Frost and Goebel, 2012; Haxby et al., 2014; Zhen et al., 2015, 2017) and connectivity patterns (e.g., Langs et al., 2016; Braga and Buckner, 2017; Gordon et al., 2017; Bijsterbosch et al., 2019)…”
Reliability of single-subject neural activation patterns in speech production tasks
Frankford, S. A., Nieto-Castañón, A., Tourville, J. A., & Guenther, F. H. (2019) · doi:10.1101/807925 · Cited by 10
Metadata
- Authors
- Duncan, K. J., Pattamadilok, C., Knierim, I., & Devlin, J. T.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2009-07
- Volume
- 46
- Issue
- 4
- Pages
- 1018-1026
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2074315794
- Cited by
- 132
- References
- 22
- FWCI
- 3.20
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.