The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
False discovery rate revisited: FDR and topological inference using Gaussian random fields
Abstract
In this note, we revisit earlier work on false discovery rate (FDR) and evaluate it in relation to topological inference in statistical parametric mapping. We note that controlling the false discovery rate of voxels is not equivalent to controlling the false discovery rate of activations. This is a problem that is unique to inference on images, in which the underlying signal is continuous (i.e., signal which does not have a compact support). In brief, inference based on conventional voxel-wise FDR procedures is not appropriate for inferences on the topological features of a statistical parametric map (SPM), such as peaks or regions of activation. We describe the nature of the problem, illustrate it with some examples and suggest a simple solution based on controlling the false discovery rate of connected excursion sets within an SPM, characterised by their volume.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Voxel-Based Morphometry—The Methods
Ashburner, J., & Friston, K. J. (2000) · NeuroImage · doi:10.1006/nimg.2000.0582 · Cited by 8,676
Self-citationThresholding of statistical maps in functional neuroimaging using the false discovery rate
Genovese, C. R., Lazar, N. A., & Nichols, T. (2002) · NeuroImage · doi:10.1006/nimg.2001.1037 · Cited by 4,923
A three-dimensional statistical analysis for CBF activation studies in human brain
Worsley, K. J., Evans, A. C., Marrett, S., & Neelin, P. (1992) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1992.127 · Cited by 2,036
Assessing the significance of focal activations using their spatial extent
Friston, K. J., Worsley, K. J., Frackowiak, R. S. J., Mazziotta, J. C., & Evans, A. C. (1994) · Human Brain Mapping · doi:10.1002/hbm.460010306 · Cited by 1,907
Self-citationFrackowiak, R. S. J. (1997) · Cited by 1,795
Comparing Functional (PET) Images: The Assessment of Significant Change
Friston, K. J., Frith, C. D., Liddle, P. F., & Frackowiak, R. S. J. (1991) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1991.122 · Cited by 1,625
Self-citationControlling the familywise error rate in functional neuroimaging: a comparative review
Nichols, T., & Hayasaka, S. (2003) · Statistical Methods in Medical Research · doi:10.1191/0962280203sm341ra · Cited by 1,218
Machine vision: Theory, algorithms, practicalities
(1991) · CVGIP: Image Understanding · doi:10.1016/1049-9660(91)90080-9 · Cited by 851
Breakspear, M., Roberts, J. A., Terry, J. R., Rodrigues, S., Mahant, N., & Robinson, P. A. (2006) · Cerebral Cortex · doi:10.1093/cercor/bhj072 · Cited by 459
Cited by
Activation likelihood estimation meta-analysis revisited
Eickhoff, S. B., Bzdok, D., Laird, A. R., Kurth, F., & Fox, P. T. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.09.017 · Cited by 1,443
Ten simple rules for neuroimaging meta-analysis
Müller, V. I., Cieslik, E. C., Laird, A. R., Fox, P. T., Radua, J., Mataix-Cols, D., Tench, C. R., Yarkoni, T., Nichols, T. E., Turkeltaub, P. E., et al. (2018) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.11.012 · Cited by 805
Eickhoff, S. B., Nichols, T. E., Laird, A. R., Hoffstaedter, F., Amunts, K., Fox, P. T., Bzdok, D., & Eickhoff, C. R. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.04.072 · Cited by 683
“As previously pointed out, voxel-wise FDR correction, the type considered here and almost exclusively used in ALE analysis is not appropriate for inference on topological features such as regions of significant convergence of a smooth dataset (Chumbley and Friston, 2009).”
InfluentialGrootswagers, T., Wardle, S. G., & Carlson, T. A. (2017) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01068 · Cited by 727
Quantifying and exploring camouflaging in men and women with autism
Lai, M.-C., Lombardo, M. V., Ruigrok, A. N., Chakrabarti, B., Auyeung, B., Szatmari, P., Happé, F., Baron-Cohen, S., & MRC AIMS Consortium (2017) · Autism · doi:10.1177/1362361316671012 · Cited by 705
“Multiple comparison correction was performed at the cluster level by controlling topological false discovery rate (FDR) calculated under Gaussian Random Field Theory (Chumbley and Friston, 2009), using a cluster-forming voxel-level height threshold of p < 0.”
InfluentialCoSMoMVPA: Multi-Modal Multivariate Pattern Analysis of Neuroimaging Data in Matlab/GNU Octave
Oosterhof, N. N., Connolly, A. C., & Haxby, J. V. (2016) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2016.00027 · Cited by 658
Generative modeling of brain maps with spatial autocorrelation
Burt, J. B., Helmer, M., Shinn, M., Anticevic, A., & Murray, J. D. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.117038 · Cited by 528
Topological FDR for neuroimaging
Chumbley, J., Worsley, K., Flandin, G., & Friston, K. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.10.090 · Cited by 492
“A recent communication (Chumbley and Friston, 2009) proposed a solution based upon conditional p-values associated with the spatial extent of excursion sets above an arbitrary threshold (conditional on such a set existing).”
InfluentialSelf-citationOldham, S., Murawski, C., Fornito, A., Youssef, G., Yücel, M., & Lorenzetti, V. (2018) · Human Brain Mapping · doi:10.1002/hbm.24184 · Cited by 425
Janes, A. C., Pizzagalli, D. A., Richardt, S., Frederick, B. D., Chuzi, S., Pachas, G., Culhane, M. A., Holmes, A. J., Fava, M., Evins, A. E., et al. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2009.12.034 · Cited by 416
Bennett, C., Miller, M., & Wolford, G. (2009) · NeuroImage · doi:10.1016/s1053-8119(09)71202-9 · Cited by 400
“In the future other methods such as topological FDR (Chumbley and Friston, 2009) have the potential to further improve false positive control while minimizing the impact on statistical power.”
Methodvan Ewijk, H., Heslenfeld, D. J., Zwiers, M. P., Buitelaar, J. K., & Oosterlaan, J. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.01.003 · Cited by 377
Stelzer, J., Chen, Y., & Turner, R. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2012.09.063 · Cited by 372
“…tests at proximate spatial locations are known to be interdependent, mainly due to two facts: fi rst, the BOLD effects of interest are spatially widespread over several voxels (see Chumbley and Friston, 2009); second, local MVPA approaches introduce spatial correlations in the analyzing procedure.”
Reward Reduces Conflict by Enhancing Attentional Control and Biasing Visual Cortical Processing
Padmala, S., & Pessoa, L. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00011 · Cited by 362
Ansell, E. B., Rando, K., Tuit, K., Guarnaccia, J., & Sinha, R. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.11.022 · Cited by 354
Frontal Cortex and the Discovery of Abstract Action Rules
Badre, D., Kayser, A. S., & D'Esposito, M. (2010) · Neuron · doi:10.1016/j.neuron.2010.03.025 · Cited by 329
Biological sex affects the neurobiology of autism
Lai, M.-C., Lombardo, M. V., Suckling, J., Ruigrok, A. N. V., Chakrabarti, B., Ecker, C., Deoni, S. C. L., Craig, M. C., Murphy, D. G. M., Bullmore, E. T., et al. (2013) · Brain · doi:10.1093/brain/awt216 · Cited by 298
Altered Brain Activity in Unipolar Depression Revisited: Meta-analyses of Neuroimaging Studies
Müller, V. I., Cieslik, E. C., Serbanescu, I., Laird, A. R., Fox, P. T., & Eickhoff, S. B. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2016.2783 · Cited by 304
Brain correlates of hypnosis: A systematic review and meta-analytic exploration
Landry, M., Lifshitz, M., & Raz, A. (2017) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2017.02.020 · Cited by 323
Brain regions involved in human movement perception: A quantitative voxel‐based meta‐analysis
Grosbras, M., Beaton, S., & Eickhoff, S. B. (2012) · Human Brain Mapping · doi:10.1002/hbm.21222 · Cited by 284
Diffusion MRI of Structural Brain Plasticity Induced by a Learning and Memory Task
Blumenfeld-Katzir, T., Pasternak, O., Dagan, M., & Assaf, Y. (2011) · PLoS ONE · doi:10.1371/journal.pone.0020678 · Cited by 284
Brain activity during observation and motor imagery of different balance tasks: An fMRI study
Taube, W., Mouthon, M., Leukel, C., Hoogewoud, H.-M., Annoni, J.-M., & Keller, M. (2015) · Cortex · doi:10.1016/j.cortex.2014.09.022 · Cited by 275
Rae, C. L., Hughes, L. E., Anderson, M. C., & Rowe, J. B. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.3093-13.2015 · Cited by 274
Connectivity‐based parcellation: Critique and implications
Eickhoff, S. B., Thirion, B., Varoquaux, G., & Bzdok, D. (2015) · Human Brain Mapping · doi:10.1002/hbm.22933 · Cited by 273
A Hitchhiker's Guide to Functional Magnetic Resonance Imaging
Soares, J. M., Magalhães, R., Moreira, P. S., Sousa, A., Ganz, E., Sampaio, A., Alves, V., Marques, P., & Sousa, N. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00515 · Cited by 272
Implementation errors in the GingerALE Software: Description and recommendations
Eickhoff, S. B., Laird, A. R., Fox, P. M., Lancaster, J. L., & Fox, P. T. (2017) · Human Brain Mapping · doi:10.1002/hbm.23342 · Cited by 269
Predicting treatment response in social anxiety disorder from functional magnetic resonance imaging.
Doehrmann, O., Ghosh, S. S., Polli, F. E., Reynolds, G. O., Horn, F., Keshavan, A., Triantafyllou, C., Saygin, Z. M., Whitfield-Gabrieli, S., Hofmann, S. G., et al. (2013) · JAMA Psychiatry · doi:10.1001/2013.jamapsychiatry.5 · Cited by 262
Ng, T. H., Alloy, L. B., & Smith, D. V. (2019) · Translational Psychiatry · doi:10.1038/s41398-019-0644-x · Cited by 244
Rando, K., Hong, K.-I., Bhagwagar, Z., Li, C.-S. R., Bergquist, K., Guarnaccia, J., & Sinha, R. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2010.10020233 · Cited by 189
Deficits in predictive coding underlie hallucinations in schizophrenia
Horga, G., Schatz, K. C., Abi-Dargham, A., & Peterson, B. S. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.0200-14.2014 · Cited by 176
Van Dam, N. T., Rando, K., Potenza, M. N., Tuit, K., & Sinha, R. (2014) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.680 · Cited by 172
False positives in neuroimaging genetics using voxel-based morphometry data
Silver, M., Montana, G., & Nichols, T. E. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.08.049 · Cited by 146
Eng, G. K., Sim, K., & Chen, S.-H. A. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.03.002 · Cited by 148
Selection and stopping in voluntary action: A meta-analysis and combined fMRI study
Rae, C. L., Hughes, L. E., Weaver, C., Anderson, M. C., & Rowe, J. B. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.10.012 · Cited by 140
“NeuroImage xxx (2013) xxx–xxx Abbreviations: FDRc, false discovery rate cluster corrected; fMRI, functional magnetic resonance imaging; preSMA, pre-supplementary motor area; RT, reaction time; SSRT, stop signal reaction time.”
InfluentialPractical recommendations to conduct a neuroimaging meta-analysis for neuropsychiatric disorders
Tahmasian, M., Sepehry, A. A., Samea, F., Khodadadifar, T., Soltaninejad, Z., Javaheripour, N., Khazaie, H., Zarei, M., Eickhoff, S. B., & Eickhoff, C. R. (2019) · Human Brain Mapping · doi:10.1002/hbm.24746 · Cited by 126
Jung, W. H., Kang, D.-H., Kim, E., Shin, K. S., Jang, J. H., & Kwon, J. S. (2013) · NeuroImage: Clinical · doi:10.1016/j.nicl.2013.06.013 · Cited by 125
Caria, A., Venuti, P., & de Falco, S. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhr084 · Cited by 118
“During stimuli assessment and fMRI data acquisition, participants passively attended to the musical excerpts.”
Floris, D. L., Lai, M., Auer, T., Lombardo, M. V., Ecker, C., Chakrabarti, B., Wheelwright, S. J., Bullmore, E. T., Murphy, D. G. M., Baron‐Cohen, S., et al. (2016) · Human Brain Mapping · doi:10.1002/hbm.23023 · Cited by 108
“025 and by their number of expected voxels (spatial extent threshold) according to Gaussian Random Field Theory [Chumbley and Friston, 2009].”
MethodInfluentialCausal neural network of metamemory for retrospection in primates
Miyamoto, K., Osada, T., Setsuie, R., Takeda, M., Tamura, K., Adachi, Y., & Miyashita, Y. (2017) · Science · doi:10.1126/science.aal0162 · Cited by 106
Hutcheson, N. L., Sreenivasan, K. R., Deshpande, G., Reid, M. A., Hadley, J., White, D. M., Ver Hoef, L., & Lahti, A. C. (2015) · Human Brain Mapping · doi:10.1002/hbm.22714 · Cited by 79
Comparing connectomes across subjects and populations at different scales
Meskaldji, D. E., Fischi-Gomez, E., Griffa, A., Hagmann, P., Morgenthaler, S., & Thiran, J.-P. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.04.084 · Cited by 77
Fusar-Poli, P., Radua, J., Frascarelli, M., Mechelli, A., Borgwardt, S., Di Fabio, F., Biondi, M., Ioannidis, J. P. A., & David, S. P. (2014) · Human Brain Mapping · doi:10.1002/hbm.22384 · Cited by 56
“…not for those which used few correction could simply be explained by differences in power. r 3062 r Alternatively, the absence of a relationship between sample size and foci in studies applying an FDR correction could be related to some mis-use of FDR in neuroimaging [Chumbley and Friston, 2009].”
ResultVenuti, P., Caria, A., Esposito, G., De Pisapia, N., Bornstein, M. H., & de Falco, S. (2012) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2012.06.011 · Cited by 48
Ma, D., Holmes, H. E., Cardoso, M. J., Modat, M., Harrison, I. F., Powell, N. M., O’Callaghan, J. M., Ismail, O., Johnson, R. A., O’Neill, M. J., et al. (2019) · Frontiers in Neuroscience · doi:10.3389/fnins.2019.00011 · Cited by 36
Li, G., Hu, J., Zhang, S., Fan, W., Wen, L., Wang, G., & Zhang, D. (2020) · Frontiers in Endocrinology · doi:10.3389/fendo.2020.603279 · Cited by 32
Peng, H., Ning, Y., Zhang, Y., Yang, H., Zhang, L., He, Z., Li, Z., Wang, L., Lu, S., Zhou, J., et al. (2013) · Neuroscience Letters · doi:10.1016/j.neulet.2013.06.048 · Cited by 21
“05, DR-corrected, cluster size ≥ 500 voxels) [6].”
Funch Uhre, V., Melissa Larsen, K., Marc Herz, D., Baaré, W., Katrine Pagsberg, A., & Roman Siebner, H. (2022) · NeuroImage: Clinical · doi:10.1016/j.nicl.2022.103268 · Cited by 18
Integrative Bayesian analysis of neuroimaging-genetic data with application to cocaine dependence
Azadeh, S., Hobbs, B. P., Ma, L., Nielsen, D. A., Gerard Moeller, F., & Baladandayuthapani, V. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2015.10.033 · Cited by 12
Heckner, M. K., Cieslik, E. C., Eickhoff, S. B., Camilleri, J. A., Hoffstaedter, F., & Langner, R. (2020) · doi:10.1101/2020.07.15.204941
Metadata
- Authors
- CHUMBLEY, J., & FRISTON, K.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2009-01-01
- Volume
- 44
- Issue
- 1
- Pages
- 62-70
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2087880221
- Cited by
- 464
- References
- 26
- FWCI
- 9.58
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.