Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): use of a cluster-size threshold
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
The typical functional magnetic resonance (fMRI) study presents a formidable problem of multiple statistical comparisons (i.e., > 10,000 in a 128 x 128 image). To protect against false positives, investigators have typically relied on decreasing the per pixel false positive probability. This approach incurs an inevitable loss of power to detect statistically significant activity. An alternative approach, which relies on the assumption that areas of true neural activity will tend to stimulate signal changes over contiguous pixels, is presented. If one knows the probability distribution of such cluster sizes as a function of per pixel false positive probability, one can use cluster-size thresholds independently to reject false positives. Both Monte Carlo simulations and fMRI studies of human subjects have been used to verify that this approach can improve statistical power by as much as fivefold over techniques that rely solely on adjusting per pixel false positive probabilities.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For all analyses, we determined cluster-size thresholds using Monte Carlo simulations in AFNI’s 3DClustSim (http://afni.nimh.nih.gov/afni/) which allowed for improved assessment of functional activation and correction for multiple comparisons (Forman et al., 1995) based on a grey matter mask.”
From Self-referential processing during observation of a speech performance task in social anxiety disorder from pre- to post-treatment: Evidence of disrupted neural activation (2019) · cites this paper as Forman et al., 1995
In the citing paper
“Two criteria were employed in evaluating activations: (i) only regions with peak voxels of P < 0.001 were considered; (ii) only clusters of activation including k !6 voxels in which all voxels met an uncorrected threshold of P < 0.005 were considered, yielding a functional threshold equivalent of P < 0.001 according to cluster size significance level corrections (Forman et al., 1995).”
From Attending to the present: mindfulness meditation reveals distinct neural modes of self-reference (2007) · cites this paper as Forman et al., 1995
In the citing paper
“Cluster thresholding was applied to increase power in identifying heavily recruited neural areas while maintaining a reasonably low Type-I error rate (Forman et al., 1995).”
From Attending to the present: mindfulness meditation reveals distinct neural modes of self-reference (2007) · cites this paper as Forman et al., 1995
In the citing paper
“For all FC analyses, a double statistical threshold (voxel-wise p < 0.01 and cluster size ≥ 78 voxels, as determined by AlphaSim with 10,000 Monte Carlo simulations) was used to obtain an alpha < 0.05 (corrected for multiple comparisons) (see details on the procedure at http://afni.nimh.nih.gov/afni/doc/manual/AlphaSim and in [30]).”
From Structural and Functional Cerebral Correlates of Hypnotic Suggestibility (2014) · cites this paper as [30]
In the citing paper
“The resulting maps from all participants in the HFA group and all participants in the control group were averaged and these group-averaged t-maps were displayed on group composite anatomical images with a statistical threshold of p < .001, adjusted for multiple comparisons with a cluster-filter of 10 contiguous pixels (42).”
From The Neural Circuitry Mediating Shifts in Behavioral Response and Cognitive Set in Autism (2008) · cites this paper as [42]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Self-citationNumerical recipes in C: the art of scientific computing
(1993) · Choice Reviews Online · doi:10.5860/choice.30-5638 · Cited by 17,933
A three-dimensional statistical analysis for CBF activation studies in human brain
Worsley, K. J., Evans, A. C., Marrett, S., & Neelin, P. (1992) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1992.127 · Cited by 2,036
Assessing the significance of focal activations using their spatial extent
Friston, K. J., Worsley, K. J., Frackowiak, R. S. J., Mazziotta, J. C., & Evans, A. C. (1994) · Human Brain Mapping · doi:10.1002/hbm.460010306 · Cited by 1,907
Comparing Functional (PET) Images: The Assessment of Significant Change
Friston, K. J., Frith, C. D., Liddle, P. F., & Frackowiak, R. S. J. (1991) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1991.122 · Cited by 1,625
MRI-PET Registration with Automated Algorithm
Woods, R. P., Mazziotta, J. C., & R. Cherry, A. S. (1993) · Journal of Computer Assisted Tomography · doi:10.1097/00004728-199307000-00004 · Cited by 1,617
The Relationship between Global and Local Changes in PET Scans
Friston, K. J., Frith, C. D., Liddle, P. F., Dolan, R. J., Lammertsma, A. A., & Frackowiak, R. S. J. (1990) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1990.88 · Cited by 858
Activation of the prefrontal cortex in a nonspatial working memory task with functional MRI
Cohen, J. D., Forman, S. D., Braver, T. S., Casey, B. J., Servan‐Schreiber, D., & Noll, D. C. (1994) · Human Brain Mapping · doi:10.1002/hbm.460010407 · Cited by 576
Self-citationSpiral K‐space MR imaging of cortical activation
Noll, D. C., Cohen, J. D., Meyer, C. H., & Schneider, W. (1995) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.1880050112 · Cited by 254
Self-citationPoline, J.-B., & Mazoyer, B. M. (1993) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1993.57 · Cited by 155
Cited by
Items 901–1,000 of 1,095
Fear thou not: activity of frontal and temporal circuits in moments of real-life courage
Nili, U., Goldberg, H., Weizman, A., & Dudai, Y. (2010) · Neuron · doi:10.1016/j.neuron.2010.06.009 · Cited by 100
“…3, 4, and S1), we implemented a randomization technique to estimate a corrected cluster-level confidence for the entire volume (at a = 0.05) based on a method described by Forman et al. (1995) and Goebel et al. (2006) using the Brain Voyager Cluster-level Statistical Threshold Estimator Plugin.”
MethodInfluentialCisler, J. M., Steele, J. S., Lenow, J. K., Smitherman, S., Everett, B., Messias, E., & Kilts, C. D. (2014) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2013.09.013 · Cited by 100
“We controlled for whole-brain multiple corrections with cluster-level thresholding, with a corrected p .05 defined as 16 contiguous voxels surviving an uncorrected p .005 based on Monte Carlo simulations (Forman et al., 1995).”
MethodHow grossed out are you? The neural bases of emotion regulation from childhood to adolescence
Pitskel, N. B., Bolling, D. Z., Kaiser, M. D., Crowley, M. J., & Pelphrey, K. A. (2011) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2011.03.004 · Cited by 100
“05, corrected for multiple comparisons with a cluster threshold of 34 contiguous functional voxels (Forman et al., 1995; Xiong et al., 1995).”
Intrusive memories to traumatic footage: the neural basis of their encoding and involuntary recall
Clark, I. A., Holmes, E. A., Woolrich, M. W., & Mackay, C. E. (2016) · Psychological Medicine · doi:10.1017/s0033291715002007 · Cited by 100
“…(MNI) 152 standard space using FLAME (FMRIB’s Local Analysis of Mixed Effects) stage 1 (Beckmann et al. 2003; Woolrich et al. 2004; Woolrich, 2008). z-Statistic images were thresholded at z > 2.3 and a family-wise error corrected cluster significance threshold of p < 0.05 (Forman et al. 1995).”
MethodInfluentialCommon representation of pain and negative emotion in the midbrain periaqueductal gray
Buhle, J. T., Kober, H., Ochsner, K. N., Mende-Siedlecki, P., Weber, J., Hughes, B. L., Kross, E., Atlas, L. Y., McRae, K., & Wager, T. D. (2013) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nss038 · Cited by 100
“001 and k1⁄4 12 contiguous voxels, calculated using NeuroElf’s instantiation of AlphaSim (Forman et al., 1995).”
MethodInfluentialvan Meer, F., van der Laan, L. N., Adan, R. A. H., Viergever, M. A., & Smeets, P. A. M. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.09.069 · Cited by 112
Altered Resting-State Functional Connectivity in Cortical Networks in Psychopathy
Philippi, C. L., Pujara, M. S., Motzkin, J. C., Newman, J. P., Kiehl, K. A., & Koenigs, M. R. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.5010-14.2015 · Cited by 111
“As described above for the regressions, we used an FWE correction approach at the cluster level using a whole-brain mask to correct for multiple comparisons at the voxelwise level (Forman et al., 1995; Carp, 2012).”
BackgroundMethodInfluentialGrotegerd, D., Suslow, T., Bauer, J., Ohrmann, P., Arolt, V., Stuhrmann, A., Heindel, W. L., Kugel, H., & Dannlowski, U. (2012) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s00406-012-0329-4 · Cited by 107
Degradation of emotion processing ability in corticobasal syndrome and Alzheimer’s disease
Kumfor, F., Sapey-Triomphe, L.-A., Leyton, C. E., Burrell, J. R., Hodges, J. R., & Piguet, O. (2014) · Brain · doi:10.1093/brain/awu246 · Cited by 99
Fabiansson, E. C., Denson, T. F., Moulds, M. L., Grisham, J. R., & Schira, M. M. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.09.078 · Cited by 113
“Type I error was controlled for in all functional imaging using a cluster-size threshold (Forman et al., 1995).”
Re-evaluating dorsolateral prefrontal cortex activation during working memory in schizophrenia
Karlsgodt, K. H., Sanz, J., van Erp, T. G. M., Bearden, C. E., Nuechterlein, K. H., & Cannon, T. D. (2009) · Schizophrenia Research · doi:10.1016/j.schres.2008.12.025 · Cited by 100
“Cluster p-values were determined using a spatial smoothness estimation implemented in Feat (Jenkinson and Smith, 2001) (Forman et al., 1995) (Friston et al.”
InfluentialA common right fronto‐parietal network for numerosity and duration processing: An fMRI study
Dormal, V., Dormal, G., Joassin, F., & Pesenti, M. (2011) · Human Brain Mapping · doi:10.1002/hbm.21300 · Cited by 113
“Significant clusters exhibiting PPI-related IPS coupling were identified, with a threshold of P < 0.001 (uncorrected, with at least 10 contiguous voxels in the cluster; Forman et al., 1995].”
MethodInfluentialDouville, K. L., Woodard, J. L., Seidenberg, M., Miller, S. K., Leveroni, C. L., Nielson, K. A., Franczak, M. B., Antuono, P., & Rao, S. M. (2004) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2004.09.005 · Cited by 123
Fuzzy clustering of gradient‐echo functional MRI in the human visual cortex. Part II: Quantification
Moser, E., Diemling, M., & Baumgartner, R. (1997) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.1880070624 · Cited by 100
Interhemispheric visuo-motor integration in humans: the role of the superior parietal cortex
Iacoboni, M., & Zaidel, E. (2003) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2003.10.007 · Cited by 115
“To avoid false positives, only clusters bigger than 10 significantly activated voxels were considered (Forman et al., 1995).”
Regions of the MPFC differentially tuned to social and nonsocial affective evaluation
Harris, L. T., McClure, S. M., van den Bos, W., Cohen, J. D., & Fiske, S. T. (2007) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.7.4.309 · Cited by 100
Self-citationPhilippi, C. L., Motzkin, J. C., Pujara, M. S., & Koenigs, M. (2015) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2015.10.005 · Cited by 93
“To correct for multiple comparisons, we implemented a family-wise error (FWE) correction approach at the cluster level using a whole-brain mask (3dClustSim in AFNI) (Carp, 2012; Forman et al., 1995) and applied cluster-extent thresholding to our regression results.”
MethodDecoding Articulatory Features from fMRI Responses in Dorsal Speech Regions
Correia, J. M., Jansma, B. M. B., & Bonte, M. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.0977-15.2015 · Cited by 99
“%) after setting an initial vertex-level threshold ( p 0.05, uncorrected) and submitting the maps to a correction criterion based on the estimate of the spatial smoothness of the map (Forman et al., 1995; Goebel et al., 2006; Hagler et al., 2006).”
MethodInfluentialThe neural substrate of the ideomotor principle: An event-related fMRI analysis
Melcher, T., Weidema, M. A., Eenshuistra, R. M., Hommel, B., & Gruber, O. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.09.049 · Cited by 105
“After slightly lowering the statistical threshold to p b .005 (k ≥ 10), which can still be considered a reliable criterion (Forman et al., 1995), there was significant activation in the left posterior PFC (IFJ), left inferior and middle temporal gyrus, and in the left temporo-parietal cortex (TPJ).”
BackgroundWalter, H., Vasić, N., Höse, A., Spitzer, M., & Wolf, R. C. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.01.041 · Cited by 110
Common and distinct neural correlates of perceptual and memorial selection
Nee, D. E., & Jonides, J. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.01.005 · Cited by 99
“001 with a cluster extent of at least 20 suprathreshold voxels (Forman et al., 1995; Poline et al., 1997).”
BackgroundZilverstand, A., Sorger, B., Slaats-Willemse, D., Kan, C. C., Goebel, R., & Buitelaar, J. K. (2017) · PLoS ONE · doi:10.1371/journal.pone.0170795 · Cited by 96
“05 [47] and correcting for multiple comparisons using cluster-size thresholding with a cluster-level false positive rate of α = 0.”
Neural circuits of hierarchical visuo-spatial sequence processing
Bahlmann, J., Schubotz, R. I., Mueller, J. L., Koester, D., & Friederici, A. D. (2009) · Brain Research · doi:10.1016/j.brainres.2009.08.017 · Cited by 108
“The combination of voxel-based thresholds with a minimum cluster size has been argued to improve the statistical power (Forman et al., 1995).”
BackgroundThe neural networks underlying auditory sensory gating
MAYER, A., HANLON, F., FRANCO, A., TESHIBA, T., THOMA, R., CLARK, V, & CANIVE, J. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.08.025 · Cited by 98
“To minimize false positives, a parametric threshold corresponding to p .005 and a minimum cluster size of 440 µl were adopted for all resultant ANOVA maps (Forman et al., 1995).”
Neuroimaging Evidence of Motor Control and Pain Processing in the Human Midcingulate Cortex
Misra, G., & Coombes, S. A. (2014) · Cerebral Cortex · doi:10.1093/cercor/bhu001 · Cited by 113
“005 and clusters <567 mm(3) in volume (Forman et al. 1995).”
BackgroundFunctional neuroanatomy of human voluntary cough and sniff production
Simonyan, K., Saad, Z. S., Loucks, T. M. J., Poletto, C. J., & Ludlow, C. L. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.05.021 · Cited by 105
“The correction for multiple comparisons was made using Monte-Carlo simulations (Forman et al., 1995) that resulted in a voxelwise threshold of 0.001 and a minimum cluster size of eight contiguous voxels at a corrected p value of 0.034.”
MethodInfluentialA Bayesian Time-Course Model for Functional Magnetic Resonance Imaging Data
Genovese, C. R. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10474253 · Cited by 114
Assessment and optimization of functional MRI analyses
Xiong, J., Gao, J.-H., Lancaster, J. L., & Fox, P. T. (1996) · Human Brain Mapping · doi:10.1002/(sici)1097-0193(1996)4:3<153::aid-hbm1>3.0.co;2-2 · Cited by 97
Linguistic prominence and Broca's area: The influence of animacy as a linearization principle
Grewe, T., Bornkessel‐Schlesewsky, I., Zysset, S., Wiese, R., von Cramon, D. Y., & Schlesewsky, M. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.04.213 · Cited by 114
“To protect against false positive activations, only regions with a Z score greater than 3.1 ( P < 0.001 uncorrected) and with a volume greater than 162 mm 3 (6 measured voxels) were considered (Braver and Bongiolatti, 2002; Forman et al., 1995).”
BackgroundInfluentialDetection of deception using fMRI: Better than chance, but well below perfection
Monteleone, G., Phan, K. L., Nusbaum, H. C., Fitzgerald, D. A., Irick, J.-S., Fienberg, S. E., & Cacioppo, J. T. (2008) · Social Neuroscience · doi:10.1080/17470910801903530 · Cited by 104
“The volume X is then used as a selection criterion on the experimental data to obtain activity clusters that meet the corrected a level (Forman et al., 1995; Xiong, Gao, Lancaster, and Fox, 1995).”
MethodBrain Network Reconfiguration and Perceptual Decoupling During an Absorptive State of Consciousness
Hove, M. J., Stelzer, J., Nierhaus, T., Thiel, S. D., Gundlach, C., Margulies, D. S., Van Dijk, K. R. A., Turner, R., Keller, P. E., & Merker, B. (2016) · Cerebral Cortex · doi:10.1093/cercor/bhv137 · Cited by 97
“The results were corrected for multiple comparisons using cluster-size corrections based on Monte-Carlo simulations, using a voxel-wise z threshold of 2.33 with a significance level of P < 0.05 on cluster level (Forman et al. 1995; Poline et al. 1997).”
MethodInfluentialHesselmann, G., Hebart, M., & Malach, R. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.1556-11.2011 · Cited by 97
“…in the whole-brain statistical maps, we implemented a randomization technique to estimate a corrected cluster-level confidence for the entire volume (at 0.05, 1000 iterations) using the BrainVoyager Cluster-level Statistical Threshold Estimator Plugin (Forman et al., 1995; Goebel et al., 2006).”
MethodInfluentialFreud, E., Macdonald, S. N., Chen, J., Quinlan, D. J., Goodale, M. A., & Culham, J. C. (2017) · Cortex · doi:10.1016/j.cortex.2017.02.020 · Cited by 102
“5) and a second-level analysis was employed to generate t maps (t > 3.5; p < .005) with a cluster correction using a Monte Carlo simulation method (Forman et al., 1995) performed with the function AlphaSim in NeuroElf (http:// neuroelf.net/).”
MethodInfluentialNeurophysiological Effects of Trait Empathy in Music Listening
Wallmark, Z., Deblieck, C., & Iacoboni, M. (2018) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2018.00066 · Cited by 119
“…< 0.01, corrected for multiple Frontiers in Behavioral Neuroscience | www.frontiersin.org 5 April 2018 | Volume 12 | Article 66 comparisons using cluster-based Gaussian random field theory controlling family-wise error across the whole brain at p < 0.05 (Friston et al., 1994; Forman et al., 1995).”
MethodInfluentialAuditory orienting and inhibition of return in mild traumatic brain injury: A FMRI study
Mayer, A. R., Mannell, M. V., Ling, J., Elgie, R., Gasparovic, C., Phillips, J. P., Doezema, D., & Yeo, R. A. (2009) · Human Brain Mapping · doi:10.1002/hbm.20836 · Cited by 97
“…analyses, a significance threshold corresponding to P 0.005 was applied in combination with a minimum cluster size threshold of 0.384 ml (six native voxels) to minimize false positives, which resulted in a corrected P value of 0.05 based on 10,000 Monte Carlo simulations (Forman et al., 1995).”
MethodInfluentialSimonyan, K., Berman, B. D., Herscovitch, P., & Hallett, M. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.0407-13.2013 · Cited by 103
“…between spasmodic dysphonia patients and controls in RAC BP during resting were assessed using a voxelwise two-sample independent t test at an FWE-corrected value of p 0.017 with a minimal cluster size extent of 100 voxels as determined using Monte Carlo simulations in AFNI (Forman et al., 1995).”
MethodInfluentialHippocampal activations during encoding and retrieval in a verbal working memory paradigm
Karlsgodt, K. H., Shirinyan, D., van Erp, T. G. M., Cohen, M. S., & Cannon, T. D. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.01.038 · Cited by 115
“Resulting Z-statistic images were thresholded using clusters determined by Z>2.3 and a (corrected) cluster significance threshold of P=0.01 (Forman et al, 1995; Friston et al, 1994; Worsley et al, 1992).”
InfluentialPekkola, J., Laasonen, M. R., Ojanen, V., Autti, T. H., Jääskeläinen, I. P., Kujala, T., & Sams, M. E. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.09.069 · Cited by 106
Ferretti, A., Babiloni, C., Gratta, C. D., Caulo, M., Tartaro, A., Bonomo, L., Rossini, P. M., & Romani, G. L. (2003) · NeuroImage · doi:10.1016/j.neuroimage.2003.07.004 · Cited by 107
Neural Basis of Emotional Decision Making in Trait Anxiety
Xu, P., Gu, R., Broster, L. S., Wu, R., Van Dam, N. T., Jiang, Y., Fan, J., & Luo, Y.-J. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.1253-13.2013 · Cited by 97
“05, with a cluster-based correction for multiple comparisons using Gaussian random field theory (Worsley et al., 1992; Friston et al., 1994; Forman et al., 1995).”
MethodInfluentialInteraction between aging and neurodegeneration in amyotrophic lateral sclerosis
Tedeschi, G., Trojsi, F., Tessitore, A., Corbo, D., Sagnelli, A., Paccone, A., d’Ambrosio, A., Piccirillo, G., Cirillo, M., Cirillo, S., et al. (2010) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2010.07.011 · Cited by 102
Parental Education Predicts Corticostriatal Functionality in Adulthood
Gianaros, P. J., Manuck, S. B., Sheu, L. K., Kuan, D. C. H., Votruba-Drzal, E., Craig, A. E., & Hariri, A. R. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhq160 · Cited by 97
Raine, A., Park, S., Lencz, T., Bihrle, S., LaCasse, L., Widom, C. S., Al‐Dayeh, L., & Singh, M. (2001) · Aggressive Behavior · doi:10.1002/ab.4 · Cited by 97
Mobascher, A., Brinkmeyer, J., Warbrick, T., Musso, F., Wittsack, H. J., Stoermer, R., Saleh, A., Schnitzler, A., & Winterer, G. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.09.004 · Cited by 105
Regional specificity of aberrant thalamocortical connectivity in autism
Nair, A., Carper, R. A., Abbott, A. E., Chen, C. P., Solders, S., Nakutin, S., Datko, M. C., Fishman, I., & Müller, R. (2015) · Human Brain Mapping · doi:10.1002/hbm.22938 · Cited by 97
“Statistical maps were adjusted for multiple comparisons (c. 685 voxels within ipsilateral thalamus), using Monte Carlo simulation [Forman et al., 1995], to a corrected p 0.05.”
MethodInfluentialThe neural substrates for atypical planning and execution of word production in stuttering
Lu, C., Chen, C., Ning, N., Ding, G., Guo, T., Peng, D., Yang, Y., Li, K., & Lin, C. (2009) · Experimental Neurology · doi:10.1016/j.expneurol.2009.10.016 · Cited by 115
“01, minimum cluster threshold required N220 mm3) based on the results of a Monte Carlo simulation at the cluster level (Forman et al., 1995; Xiong et al., 1995).”
BackgroundMethodModulation of neural activity by angle of rotation during imagined spatial transformations
Keehner, M., Guerin, S. A., Miller, M. B., Turk, D. J., & Hegarty, M. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.06.043 · Cited by 111
“…that would reveal any regions that might be sensitive to the parametric modulations of mental rotation or perspective taking, while still maintaining a statistical threshold and voxel extent that would survive a corrected probability criterion for clusters (Forman et al., 1995; Xiong et al., 1995).”
BackgroundMethodInterleukin-6 gene (IL-6): a possible role in brain morphology in the healthy adult brain
Baune, B. T., Konrad, C., Grotegerd, D., Suslow, T., Birosova, E., Ohrmann, P., Bauer, J., Arolt, V., Heindel, W., Domschke, K., et al. (2012) · Journal of Neuroinflammation · doi:10.1186/1742-2094-9-125 · Cited by 96
Discrete neural substrates underlie complementary audiovisual speech integration processes
Stevenson, R. A., VanDerKlok, R. M., Pisoni, D. B., & James, T. W. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.12.063 · Cited by 95
“The cluster-threshold correction technique used here controls for false positives, with a relative sparing of statistical power (Forman et al., 1995; Thirion et al., 2007), and has been previously used to define mSTC (Stevenson et al., 2010, 2007; Stevenson and James, 2009).”
Oberndorfer, T. A., Kaye, W. H., Simmons, A. N., Strigo, I. A., & Matthews, S. C. (2011) · International Journal of Eating Disorders · doi:10.1002/eat.20750 · Cited by 95
"What" Precedes "Which": Developmental Neural Tuning in Face- and Place-Related Cortex
Scherf, K. S., Luna, B., Avidan, G., & Behrmann, M. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhq269 · Cited by 95
Haas, B. W., Constable, R. T., & Canli, T. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.04.027 · Cited by 104
“We applied a significance threshold of p .005 (uncorrected) and one-hundred contiguous voxel spatial extent, yielding a per-pixel false-discovery rate of approximately p<.000001 (Forman et al., 1995) for this analysis.”
Internally generated and directly cued task sets: an investigation with fMRI
Forstmann, B. U., Braß, M., Koch, I., & von Cramon, D. Y. (2004) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2004.08.008 · Cited by 108
Riccardi, P., Zald, D., Li, R., Park, S., Ansari, M. S., Dawant, B., Anderson, S., Woodward, N., Schmidt, D., Baldwin, R., et al. (2006) · American Journal of Psychiatry · doi:10.1176/ajp.2006.163.9.1639 · Cited by 95
The brain basis of social synchrony
Atzil, S., Hendler, T., & Feldman, R. (2014) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nst105 · Cited by 95
“net/) instantiation of AlphaSim (Forman et al., 1995).”
Leidy, H. J., Lepping, R. J., Savage, C. R., & Harris, C. T. (2011) · Obesity · doi:10.1038/oby.2011.108 · Cited by 94
“To identify significant activations in a priori regions, cluster-level statistical threshold was applied to correct for multiple comparisons (20,21).”
MethodQuadflieg, S., Mohr, A., Mentzel, H.-J., Miltner, W. H. R., & Straube, T. (2008) · Biological Psychology · doi:10.1016/j.biopsycho.2008.01.014 · Cited by 94
“We used the approach as implemented in Brain Voyager (Goebel et al., 2006) which is based on a 3D extension of the randomization procedure described by Forman et al. (1995) .”
MethodThe role of parietal cortex during sustained visual spatial attention
Thakral, P. P., & Slotnick, S. D. (2009) · Brain Research · doi:10.1016/j.brainres.2009.09.031 · Cited by 104
“For all contrasts in the present study, an individual voxel threshold of p < 0.01 was used, corrected for multiple comparisons to p < 0.001 by enforcing a cluster extent threshold (Poline and Mazoyer, 1993; Roland et al., 1993; Forman et al., 1995; Ledberg et al., 1998; Slotnick et al., 2003b).”
InfluentialThe neural networks underlying endogenous auditory covert orienting and reorienting
Mayer, A. R., Harrington, D. L., Adair, J. C., & Lee, R. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2005.10.050 · Cited by 104
Lee, W., Reeve, J., Xue, Y., & Xiong, J. (2012) · Neuroscience Research · doi:10.1016/j.neures.2012.02.010 · Cited by 93
“For correcting multiple comparison inferences in whole brain analyses, the cluster-wise threshold was employed based on Monte-Carlo simulations (Forman et al., 1995), which set a p value of .”
InfluentialPain and motor processing in the human cerebellum
Coombes, S. A., & Misra, G. (2015) · Pain · doi:10.1097/j.pain.0000000000000337 · Cited by 101
“005 and clusters with volume ,162 mm(3).(24) The P-value threshold and the cluster-extent threshold required to achieve the reported FWER were determined using AFNI’s 3dClustSim program, which took the average smoothness of the residual data sets and average cerebellum mask as inputs and created Monte Carlo simulation…”
MethodAlterations of white matter integrity related to motor activity in schizophrenia
Walther, S., Federspiel, A., Horn, H., Razavi, N., Wiest, R., Dierks, T., Strik, W., & Müller, T. J. (2011) · Neurobiology of Disease · doi:10.1016/j.nbd.2011.01.017 · Cited by 93
“Correction for multiple comparisons in these two correlation maps was achieved by cluster size threshold of 135 voxels, which corresponds to an overall p-value of 0.05 (estimated from Table 2 in Forman et al., 1995).”
MethodInfluentialDiekhoff, S., Uludaǧ, K., Sparing, R., Tittgemeyer, M., Çavuşoğlu, M., von Cramon, D. Y., & Grefkes, C. (2011) · Human Brain Mapping · doi:10.1002/hbm.21024 · Cited by 101
Tartaglia, M. C., Narayanan, S., & Arnold, D. L. (2008) · European Journal of Neurology · doi:10.1111/j.1468-1331.2008.02090.x · Cited by 104
The Hippocampus Supports Both Recollection and Familiarity When Memories Are Strong
Smith, C. N., Wixted, J. T., & Squire, L. R. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3438-11.2011 · Cited by 94
“A cluster correction technique was used to correct for multiple comparisons in all group-level analysis, and Monte Carlo simulations (AlphaSim software) were used to determine how large a cluster of voxels was needed to be statistically meaningful (p 0.05) (Forman et al., 1995; Xiong et al., 1995).”
MethodInfluentialImaging the impossible: an fMRI study of impossible causal relationships in magic tricks
Parris, B. A., Kuhn, G., Mizon, G. A., Benattayallah, A., & Hodgson, T. L. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.12.036 · Cited by 94
“000001 (Forman et al., 1995).”
Changes in the brain intrinsic organization in both on-task state and post-task resting state
Wang, Z., Liu, J., Zhong, N., Qin, Y., Zhou, H., & Li, K. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.04.051 · Cited by 102
“Here, we made use of a scheme of Monte-Carlo correction in detection of truly activated brain regions in functional studies (Forman et al., 1995; Ledberg et al., 1998; Xiong et al., 1995; AlphaSim program in AFNI software package: http://afni.nimh.nih.gov/).”
MethodPermutation tests for factorially designed neuroimaging experiments
Suckling, J., & Bullmore, E. (2004) · Human Brain Mapping · doi:10.1002/hbm.20027 · Cited by 94
“Nonparametric methods of hypothesis testing based on random resampling or permutation of the observed data have been described previously in the context of linear modelling of functional magnetic resonance imaging (fMRI) time series [Bullmore et al., 1996, 2001a; Forman et al., 1995; Locascio et al., 1997] as well as…”
BackgroundMethodSmoking impacts on prefrontal attentional network function in young adult brains
Musso, F., Bettermann, F., Vucurevic, G., Stoeter, P., Konrad, A., & Winterer, G. (2007) · Psychopharmacology · doi:10.1007/s00213-006-0499-8 · Cited by 93
“Registration of functional images to high-resolution structural images was carried out using FMRIB_s Linear Image Registration Tool (Forman et al. 1995; Jenkinson et al. 2002).”
MethodInfluentialPrenatal Drug Exposure Affects Neonatal Brain Functional Connectivity
Salzwedel, A. P., Grewen, K. M., Vachet, C., Gerig, G., Lin, W., & Gao, W. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.4333-14.2015 · Cited by 93
“Inclusion of a voxel in the whole-brain significant connectivity map was determined using the “combined approach” (Forman et al., 1995).”
MethodChanging channels: An fMRI study of aging and cross-modal attention shifts
Townsend, J., Adamo, M., & Haist, F. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.045 · Cited by 93
“05 (Forman et al. 1995).”
MethodObstructive Sleep Apnea and Age: A Double Insult to Brain Function?
Ayalon, L., Ancoli-Israel, S., & Drummond, S. P. A. (2010) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.200912-1805oc · Cited by 93
Optimal strategies for measuring diffusion in anisotropic systems by magnetic resonance imaging
Jones, D. K., Horsfield, M. A., & Simmons, A. (1999) · Magnetic Resonance in Medicine · doi:10.1002/(sici)1522-2594(199909)42:3<515::aid-mrm14>3.0.co;2-q · Cited by 1,403
Suzuki, H., Luby, J. L., Botteron, K. N., Dietrich, R., McAvoy, M. P., & Barch, D. M. (2014) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2014.04.013 · Cited by 92
“05 for the whole ROI mask.(72,73) This threshold/cluster-size requirement provides protection against type I error and was chosen based on Monte-Carlo simulations via”
Top-Down Engagement Modulates the Neural Expressions of Visual Expertise
Harel, A., Gilaie‐Dotan, S., Malach, R., & Bentin, S. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhp316 · Cited by 100
Functional Topography of Human Auditory Cortex
Leaver, A. M., & Rauschecker, J. P. (2016) · Journal of Neuroscience · doi:10.1523/jneurosci.0226-15.2016 · Cited by 105
“005, with a cluster correction of k 120 mm 3 ( pcorr 0.05 using Monte Carlo simulations; Forman et al., 1995).”
MethodInfluentialViolent offenders respond to provocations with high amygdala and striatal reactivity
da Cunha‐Bang, S., Fisher, P. M., Hjordt, L. V., Perfalk, E., Skibsted, A. P., Bock, C., Baandrup, A. O., Deen, M., Thomsen, C., Sestoft, D. M., et al. (2017) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsx006 · Cited by 107
“nih/gov/ afni) that uses a Monte Carlo simulation method to establish family-wise-error-corrected cluster extent thresholds unlikely to have occurred by chance (a< 0.05; Forman et al., 1995).”
MethodInfluentialCombination of event-related fMRI and diffusion tensor imaging in an infant with perinatal stroke
Seghier, M. L., Lazeyras, F., Zimine, S., Maier, S. E., Hanquinet, S., Delavelle, J., Volpe, J. J., & Hüppi, P. S. (2003) · NeuroImage · doi:10.1016/j.neuroimage.2003.09.015 · Cited by 104
“Voxels with Z scores above a defined threshold and at least surrounded by 4 pixels were considered as active (Forman et al., 1995).”
BackgroundStraube, T., Schmidt, S., Weiss, T., Mentzel, H., & Miltner, W. H. R. (2009) · Human Brain Mapping · doi:10.1002/hbm.20536 · Cited by 92
“We used the approach as implemented in Brain Voyager [Goebel et al., 2006] which is based on a 3D extension of the randomization procedure described by Forman et al. [1995] .”
MethodParallel contributions of distinct human memory systems during probabilistic learning
Dickerson, K. C., Li, J., & Delgado, M. R. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.10.080 · Cited by 92
AbdulSabur, N. Y., Xu, Y., Liu, S., Chow, H. M., Baxter, M., Carson, J., & Braun, A. R. (2014) · Cortex · doi:10.1016/j.cortex.2014.01.017 · Cited by 113
“The resulting student-t maps were thresholded with a voxel p-threshold of .01 and a cluster-size threshold of 67 voxels, corresponding to a family-wise error (FWE) of .05 based on Monte Carlo simulations (Forman et al., 1995).”
MethodCaldwell, J. A., Mu, Q., Smith, J. K., Mishory, A., Caldwell, J. L., Peters, G., Brown, D. L., & George, M. S. (2005) · Behavioral Neuroscience · doi:10.1037/0735-7044.119.3.694 · Cited by 92
Wittfoth, M., Schroder, C., Schardt, D. M., Dengler, R., Heinze, H.-J., & Kotz, S. A. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhp106 · Cited by 91
“001 uncorrected for multiple comparisons and 10 voxels spatial extent, which protects against false-positive results and provides an equivalent correction for multiple comparisons (Forman et al. 1995).”
InfluentialImpaired Activation in Cognitive Control Regions Predicts Reversal Learning in Schizophrenia
Culbreth, A. J., Gold, J. M., Cools, R., & Barch, D. M. (2016) · Schizophrenia Bulletin · doi:10.1093/schbul/sbv075 · Cited by 92
Becerra, L. R., Breiter, H. C., Stojanovic, M., Fishman, S., Edwards, A., Comite, A. R., Gonzalez, R. G., & Borsook, D. (1999) · Magnetic Resonance in Medicine · doi:10.1002/(sici)1522-2594(199905)41:5<1044::aid-mrm25>3.0.co;2-m · Cited by 326
The role of personal experience in the neural processing of action-related language
Lyons, I. M., Mattarella-Micke, A., Cieslak, M., Nusbaum, H. C., Small, S. L., & Beilock, S. L. (2009) · Brain and Language · doi:10.1016/j.bandl.2009.05.006 · Cited by 107
“…identified were subsequently cluster-level corrected for multiple comparisons using a Monte-Carlo simulation procedure with a family-wise false-positive rate of .01 (thus requiring 7 or more contiguous functional voxels to be considered significant at the whole-brain level) (Forman et al., 1995).”
Not All False Memories Are Created Equal: The Neural Basis of False Recognition
Garoff-Eaton, R. J. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhj101 · Cited by 91
Bosch, O. G., Rihm, J. S., Scheidegger, M., Landolt, H.-P., Stämpfli, P., Brakowski, J., Esposito, F., Rasch, B., & Seifritz, E. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1317010110 · Cited by 90
Cortical Plasticity During Three-Week Motor Skill Learning
Hluštík, P., Solodkin, A., Noll, D. C., & Small, S. L. (2004) · Journal of Clinical Neurophysiology · doi:10.1097/00004691-200405000-00006 · Cited by 107
Self-citationBrain activation when hearing one's own and others' names
Carmody, D. P., & Lewis, M. (2006) · Brain Research · doi:10.1016/j.brainres.2006.07.121 · Cited by 91
“A specific region was defined as active for a participant if five or more contiguous pixels were activated (Forman et al., 1995).”
BackgroundSomatosensory Gating and Recovery From Stroke Involving the Thalamus
Staines, R. W., Black, S. E., Graham, S. J., & McIlroy, W. E. (2002) · Stroke · doi:10.1161/01.str.0000032552.40405.40 · Cited by 88
BOHNING, D. E., SHASTRI, A., McGAVIN, L., McCONNELL, K. A., NAHAS, Z., LORBERBAUM, J. P., ROBERTS, D. R., & GEORGE, M. S. (2000) · Investigative Radiology · doi:10.1097/00004424-200011000-00005 · Cited by 92
Matthews, S. C., Simmons, A. N., Arce, E., & Paulus, M. P. (2005) · Neuroreport · doi:10.1097/00001756-200505120-00020 · Cited by 90
“This threshold adjustment method was based on Monte-Carlo simulations and was used to guard against identifying false positive areas of activation using a 6mm full-width at half-maximum Gaussian filter [17].”
MethodFunctional MRI evidence for a role of ventral prefrontal cortex in tinnitus
Seydell‐Greenwald, A., Leaver, A. M., Turesky, T. K., Morgan, S., Kim, H. J., & Rauschecker, J. P. (2012) · Brain Research · doi:10.1016/j.brainres.2012.08.052 · Cited by 96
Hummer, T. A., Wang, Y., Kronenberger, W. G., Mosier, K. M., Kalnin, A. J., Dunn, D. W., & Mathews, V. P. (2010) · Media Psychology · doi:10.1080/15213261003799854 · Cited by 90
“Monte Carlo simulations, using the estimated spatial correlation of residual data, determined that a minimum cluster size of 880 contiguous significant voxels created a cluster significant at p < .05 to control for multiple comparisons (Cox, 1996; Forman et al., 1995).”
BackgroundMethodNeural Mechanisms Underlying 5-HTTLPR-Related Sensitivity to Acute Stress
Drabant, E. M., Ramel, W., Edge, M. D., Hyde, L. W., Kuo, J. R., Goldin, P. R., Hariri, A. R., & Gross, J. J. (2012) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2011.10111699 · Cited by 90
“cluster-wise p-value that protects against false-positive detection of activation clusters (39).”
Wurm, M. F., Ariani, G., Greenlee, M. W., & Lingnau, A. (2015) · Cerebral Cortex · doi:10.1093/cercor/bhv169 · Cited by 115
Amplitude low-frequency oscillation abnormalities in the heroin users: A resting state fMRI study
Jiang, G., Qiu, Y., Xue-lin, Z., Han, L., Lv, X., Li, L., Lin, C., Zhuo, F., Hu, S., & Tian, J. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.04.004 · Cited by 95
“Threshold correction was done by using the AlphaSim program in AFNI, which applies Monte Carlo simulation to calculate the probability of false positive detection by taking into consideration both the individual voxel probability thresholding and cluster size (Forman et al., 1995).”
MethodAttentional bias for valenced stimuli as a function of personality in the dot-probe task
Amin, Z., Constable, R. T., & Canli, T. (2003) · Journal of Research in Personality · doi:10.1016/j.jrp.2003.09.011 · Cited by 88
Sohn, M.-H., Goode, A., Stenger, V. A., Carter, C. S., & Anderson, J. R. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0832374100 · Cited by 89
Metadata
- Authors
- Forman, S. D., Cohen, J. D., Fitzgerald, M., Eddy, W. F., Mintun, M. A., & Noll, D. C.
- Affiliations
- University of Pittsburgh (US)
- Corresponding author
- Forman, Steven D.
- Venue
- Magnetic Resonance in Medicine
- Publisher
- Wiley
- Published
- 1995-05
- Volume
- 33
- Issue
- 5
- Pages
- 636-647
- ISSN
- 0740-3194 (ISSN-L)
- 1522-2594
- OpenAlex
- W2044634376
- Cited by
- 3,202
- References
- 11
- Citations by year
- 2026: 27 · 2025: 26 · 2024: 30 · 2023: 36 · 2022: 45 · 2021: 55 · 2020: 64 · 2019: 75 · 2018: 96 · 2017: 137 · 2016: 140 · 2015: 188 · 2014: 203 · 2013: 213 · 2012: 242
- FWCI
- 14.83
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Magnetic Resonance in Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Functional Brain Connectivity Studies
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Advanced MRI Techniques and Applications
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Advanced Neuroimaging Techniques and Applications
- Keywords
- multiple comparisons, false positives, statistical power, fMRI activation detection, Monte Carlo simulation, cluster size distribution
- MeSH terms
- Brain, Data Interpretation, Statistical, False Positive Reactions, Humans, Magnetic Resonance Imaging, Monte Carlo Method, Probability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.