Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): use of a cluster-size threshold
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
The typical functional magnetic resonance (fMRI) study presents a formidable problem of multiple statistical comparisons (i.e., > 10,000 in a 128 x 128 image). To protect against false positives, investigators have typically relied on decreasing the per pixel false positive probability. This approach incurs an inevitable loss of power to detect statistically significant activity. An alternative approach, which relies on the assumption that areas of true neural activity will tend to stimulate signal changes over contiguous pixels, is presented. If one knows the probability distribution of such cluster sizes as a function of per pixel false positive probability, one can use cluster-size thresholds independently to reject false positives. Both Monte Carlo simulations and fMRI studies of human subjects have been used to verify that this approach can improve statistical power by as much as fivefold over techniques that rely solely on adjusting per pixel false positive probabilities.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For all analyses, we determined cluster-size thresholds using Monte Carlo simulations in AFNI’s 3DClustSim (http://afni.nimh.nih.gov/afni/) which allowed for improved assessment of functional activation and correction for multiple comparisons (Forman et al., 1995) based on a grey matter mask.”
From Self-referential processing during observation of a speech performance task in social anxiety disorder from pre- to post-treatment: Evidence of disrupted neural activation (2019) · cites this paper as Forman et al., 1995
In the citing paper
“Two criteria were employed in evaluating activations: (i) only regions with peak voxels of P < 0.001 were considered; (ii) only clusters of activation including k !6 voxels in which all voxels met an uncorrected threshold of P < 0.005 were considered, yielding a functional threshold equivalent of P < 0.001 according to cluster size significance level corrections (Forman et al., 1995).”
From Attending to the present: mindfulness meditation reveals distinct neural modes of self-reference (2007) · cites this paper as Forman et al., 1995
In the citing paper
“Cluster thresholding was applied to increase power in identifying heavily recruited neural areas while maintaining a reasonably low Type-I error rate (Forman et al., 1995).”
From Attending to the present: mindfulness meditation reveals distinct neural modes of self-reference (2007) · cites this paper as Forman et al., 1995
In the citing paper
“For all FC analyses, a double statistical threshold (voxel-wise p < 0.01 and cluster size ≥ 78 voxels, as determined by AlphaSim with 10,000 Monte Carlo simulations) was used to obtain an alpha < 0.05 (corrected for multiple comparisons) (see details on the procedure at http://afni.nimh.nih.gov/afni/doc/manual/AlphaSim and in [30]).”
From Structural and Functional Cerebral Correlates of Hypnotic Suggestibility (2014) · cites this paper as [30]
In the citing paper
“The resulting maps from all participants in the HFA group and all participants in the control group were averaged and these group-averaged t-maps were displayed on group composite anatomical images with a statistical threshold of p < .001, adjusted for multiple comparisons with a cluster-filter of 10 contiguous pixels (42).”
From The Neural Circuitry Mediating Shifts in Behavioral Response and Cognitive Set in Autism (2008) · cites this paper as [42]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Self-citationNumerical recipes in C: the art of scientific computing
(1993) · Choice Reviews Online · doi:10.5860/choice.30-5638 · Cited by 17,933
A three-dimensional statistical analysis for CBF activation studies in human brain
Worsley, K. J., Evans, A. C., Marrett, S., & Neelin, P. (1992) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1992.127 · Cited by 2,036
Assessing the significance of focal activations using their spatial extent
Friston, K. J., Worsley, K. J., Frackowiak, R. S. J., Mazziotta, J. C., & Evans, A. C. (1994) · Human Brain Mapping · doi:10.1002/hbm.460010306 · Cited by 1,907
Comparing Functional (PET) Images: The Assessment of Significant Change
Friston, K. J., Frith, C. D., Liddle, P. F., & Frackowiak, R. S. J. (1991) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1991.122 · Cited by 1,625
MRI-PET Registration with Automated Algorithm
Woods, R. P., Mazziotta, J. C., & R. Cherry, A. S. (1993) · Journal of Computer Assisted Tomography · doi:10.1097/00004728-199307000-00004 · Cited by 1,617
The Relationship between Global and Local Changes in PET Scans
Friston, K. J., Frith, C. D., Liddle, P. F., Dolan, R. J., Lammertsma, A. A., & Frackowiak, R. S. J. (1990) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1990.88 · Cited by 858
Activation of the prefrontal cortex in a nonspatial working memory task with functional MRI
Cohen, J. D., Forman, S. D., Braver, T. S., Casey, B. J., Servan‐Schreiber, D., & Noll, D. C. (1994) · Human Brain Mapping · doi:10.1002/hbm.460010407 · Cited by 576
Self-citationSpiral K‐space MR imaging of cortical activation
Noll, D. C., Cohen, J. D., Meyer, C. H., & Schneider, W. (1995) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.1880050112 · Cited by 254
Self-citationPoline, J.-B., & Mazoyer, B. M. (1993) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1993.57 · Cited by 155
Cited by
Items 501–600 of 1,095
Vasic, N., Walter, H., Sambataro, F., & Wolf, R. C. (2009) · Psychological Medicine · doi:10.1017/s0033291708004443 · Cited by 173
“The statistical threshold for these analyses was set at p<0.05 corrected for multiple comparisons using the false discovery rate (qFDR) (Genovese et al. 2002 ; Storey & Tibshirani, 2003) and a spatial contiguity criterion of 10 adjacent voxels (Forman et al. 1995).”
BackgroundMethodInfluentialAn fMRI study on mental pain and suicidal behavior
Reisch, T., Seifritz, E., Esposito, F., Wiest, R., Valach, L., & Michel, K. (2010) · Journal of Affective Disorders · doi:10.1016/j.jad.2010.03.005 · Cited by 173
Epstein, J. N., Casey, B. J., Tonev, S. T., Davidson, M. C., Reiss, A. L., Garrett, A., Hinshaw, S. P., Greenhill, L. L., Glover, G., Shafritz, K. M., et al. (2007) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2007.01761.x · Cited by 173
“A p level of .05 was used and multiple comparisons were corrected using a contiguity threshold of 5 acquisition-based voxels (Forman et al., 1995).”
MethodWu, X., Zou, Q., Hu, J., Tang, W., Mao, Y., Gao, L., Zhu, J., Jin, Y., Wu, X., Lu, L., et al. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.0415-15.2015 · Cited by 170
“We used a standard approach implemented in AFNI (AlphaSim; 10,000 Monte Carlo simulations) to correct for multiple comparisons (Forman et al., 1995; Wang et al., 2012; Zou et al., 2013).”
MethodIrish, M., Piguet, O., Hodges, J. R., & Hornberger, M. (2014) · Human Brain Mapping · doi:10.1002/hbm.22263 · Cited by 172
“Importantly, Monte Carlo simulations and experimental data demonstrate that cluster thresholding is an effective tool to reduce the probability of false positive findings without compromising the statistical power of the study [Forman et al., 1995].”
MethodCognitive Control Involved in Overcoming Prepotent Response Tendencies and Switching Between Tasks
Barber, A. D., & Carter, C. S. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhh189 · Cited by 172
“05 probability protection for the full 28 slice volume, using the correction method described by Forman et al. (1995). Only ROIs showing greater activation in the prepotent or switch”
MethodInfluentialWorking and long-term memory deficits in schizophrenia: Is there a common prefrontal mechanism?
Barch, D. M., Csernansky, J. G., Conturo, T., & Snyder, A. Z. (2002) · Journal of Abnormal Psychology · doi:10.1037//0021-843x.111.3.478 · Cited by 172
A Parametric Manipulation of Central Executive Functioning
Garavan, H. (2000) · Cerebral Cortex · doi:10.1093/cercor/10.6.585 · Cited by 172
Analysis and use of FMRI response delays
Saad, Z. S., Ropella, K. M., Cox, R. W., & DeYoe, E. A. (2001) · Human Brain Mapping · doi:10.1002/hbm.1026 · Cited by 172
Berkovich-Ohana, A., Dor-Ziderman, Y., Glicksohn, J., & Goldstein, A. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00912 · Cited by 171
“…using one-sample t-tests against the null hypothesis that the SC measures came from a continuous, normal distribution with a zero mean, and corrected for multiple comparisons based on a Monte Carlo simulation of random noise distribution (using AFNI’s 3dClustSim module) (Forman et al., 1995).”
MethodNeural correlates of implicit and explicit combinatorial semantic processing
Graves, W. W., Binder, J. R., Desai, R. H., Conant, L. L., & Seidenberg, M. S. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.06.055 · Cited by 171
“…maps for each participant were linearly resampled in standard stereotaxic space to a voxel size of 1 mm This standard method capitalizes on the fact that activated voxels tend to occur in clusters, and the larger the cluster, the less likely it is to occur by chance (Forman et al., 1995).”
MethodMaturing thalamocortical functional connectivity across development
Fair (2010) · Frontiers in Systems Neuroscience · doi:10.3389/fnsys.2010.00010 · Cited by 171
“For the voxelwise, fi xed effects maps, thresholding based on Monte Carlo simulation was implemented (Forman et al., 1995).”
MethodMaintenance and Manipulation in Spatial Working Memory: Dissociations in the Prefrontal Cortex
Glahn, D. C., Kim, J., Cohen, M. S., Poutanen, V.-P., Therman, S., Bava, S., Van Erp, T. G. M., Manninen, M., Huttunen, M., & Lönnqvist, J. (2002) · NeuroImage · doi:10.1006/nimg.2002.1161 · Cited by 171
“001) and extent (volume 608 mm(3)) of activation (Forman et al., 1995; Poline et al., 1997).”
BackgroundMethodInfluentialParry, A. M. M. (2003) · Brain · doi:10.1093/brain/awg284 · Cited by 172
“All group analyses were performed using a random-effects model, with Z (Gaussianized T) statistic images thresholded using clusters determined by Z > 2.0 and a (corrected) cluster signi®cance of P = 0.05 (Worsley et al., 1992; Friston et al., 1994; Forman et al., 1995).”
MethodInfluentialControl of shared representations relies on key processes involved in mental state attribution
Spengler, S., von Cramon, D. Y., & Brass, M. (2009) · Human Brain Mapping · doi:10.1002/hbm.20800 · Cited by 170
“To protect against false positive activations, we used a double-threshold approach, that is, combining a voxelbased threshold with a minimum cluster size [Forman et al., 1995].”
MethodGambling Severity Predicts Midbrain Response to Near-Miss Outcomes
Chase, H. W., & Clark, L. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.5758-09.2010 · Cited by 168
“These region-of-interest (ROI) analyses were thresholded at p 0.05 corrected for multiple comparisons using random field theory (Worsley et al., 1996), i.e., FWE corrected, with a cluster threshold of 10 voxels to reduce the rate of false positives (Forman et al., 1995).”
MethodInfluentialAbnormal Activation of the Primary Somatosensory Cortex in Spasmodic Dysphonia: An fMRI Study
Simonyan, K., & Ludlow, C. L. (2010) · Cerebral Cortex · doi:10.1093/cercor/bhq023 · Cited by 170
“The correction for multiple comparisons was performed using Monte Carlo simulations (Forman et al. 1995) that resulted in the identification of a minimum cluster size of 450 mm(3) at a voxelwise threshold of 0.”
MethodLepsien, J., Griffin, I. C., Devlin, J. T., & Nobre, A. C. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.02.026 · Cited by 168
“Significant activations were identified using cluster-based thresholding of statistical images with a height threshold of Z N 2.3 and a (corrected) spatial extent threshold of P b 0.01 ( Forman et al., 1995; Friston et al., 1994; Worsley et al., 1992).”
MethodInfluentialNeural correlates of automatic beliefs about gender and race
Knutson, K. M., Mah, L., Manly, C. F., & Grafman, J. (2007) · Human Brain Mapping · doi:10.1002/hbm.20320 · Cited by 169
“All reported PFC activations had probability values at the uncorrected P < 0.02 threshold with a cluster size threshold of 20; this corresponds to a per voxel false-positive P < 0.000001 [Forman et al., 1995].”
BackgroundInfluentialSumowski, J. F., Wylie, G. R., DeLuca, J., & Chiaravalloti, N. (2010) · Brain · doi:10.1093/brain/awp307 · Cited by 169
“This cluster threshold correction technique controls false positives while also sparing statistical power (Forman et al., 1995).”
BackgroundMusical Training Induces Functional Plasticity in Human Hippocampus
Herdener, M., Esposito, F., di Salle, F., Boller, C., Hilti, C. C., Habermeyer, B., Scheffler, K., Wetzel, S., Seifritz, E., & Cattapan-Ludewig, K. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4513-09.2010 · Cited by 168
A study of the cortical processing of ano-rectal sensation using functional MRI
Hobday, D. I., Aziz, Q., Thacker, N., Hollander, I., Jackson, A., & Thompson, D. G. (2001) · Brain · doi:10.1093/brain/124.2.361 · Cited by 168
“Only clusters of active pixels containing over three contiguous pixels were analysed so increasing the P value of the reported activations, and reducing the chance of a type one statistical error (Forman et al., 1995).”
BackgroundRaye, C. L., Johnson, M. K., Mitchell, K. J., Reeder, J. A., & Greene, E. J. (2002) · NeuroImage · doi:10.1006/nimg.2001.0983 · Cited by 168
Zhang, J. X., Leung, H.-C., & Johnson, M. K. (2003) · NeuroImage · doi:10.1016/j.neuroimage.2003.07.016 · Cited by 167
“Informed consent was obtained from all participants in accordance with a protocol approved by the Human Investigations Committee of the Yale University Medical School.”
MethodThe interaction of emotional and cognitive neural systems in emotionally guided response inhibition
Shafritz, K. M., Collins, S. H., & Blumberg, H. P. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2005.11.053 · Cited by 167
“Anatomical and BOLD images for each subject were transformed into standardized Talairach space (Talairach and Tournoux, 1988), and resulting maps were superimposed to create cluster-filtered (10 contiguous pixels) composite maps (Forman et al., 1995).”
MethodLu, C., Peng, D., Chen, C., Ning, N., Ding, G., Li, K., Yang, Y., & Lin, C. (2010) · Cortex · doi:10.1016/j.cortex.2009.02.017 · Cited by 167
“…was achieved by a voxelcluster threshold technique for an overall corrected level of significance (alpha) of .05 (individual voxel p< .01, minimum cluster threshold required¼ 300 mm3) based on the results of a Monte Carlo simulation at the cluster level (Forman et al., 1995; Xiong et al., 1995).”
MethodHolloway, I. D., Price, G. R., & Ansari, D. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.07.071 · Cited by 168
“Both of the resulting statistical maps were subsequently corrected for multiple comparisons using cluster-size thresholding (Forman et al., 1995; Goebel et al., 2006).”
MethodNeural correlates of trait anxiety in fear extinction
Sehlmeyer, C., Dannlowski, U., Schöning, S., Kugel, H., Pyka, M., Pfleiderer, B., Zwitserlood, P., Schiffbauer, H., Heindel, W., Arolt, V., et al. (2011) · Psychological Medicine · doi:10.1017/s0033291710001248 · Cited by 165
Kim, H., & Cabeza, R. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.3408-07.2007 · Cited by 165
“00001 per voxel according to Monte Carlo simulations of spatially correlated data (Forman et al., 1995).”
BackgroundMethodInfluentialExpertise-related deactivation of the right temporoparietal junction during musical improvisation
Berkowitz, A. L., & Ansari, D. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.08.042 · Cited by 164
“001, uncorrected, and were subsequently corrected for multiple comparisons using cluster-size thresholding (Forman et al., 1995; Goebel et al., 2006).”
MethodInfluentialFrontal–striatal circuitry activated by human peak-interval timing in the supra-seconds range
Hinton, S. C., & Meck, W. H. (2004) · Cognitive Brain Research · doi:10.1016/j.cogbrainres.2004.08.005 · Cited by 165
Altered brain activity during pain processing in fibromyalgia
BURGMER, M., POGATZKIZAHN, E., GAUBITZ, M., WESSOLECK, E., HEUFT, G., & PFLEIDERER, B. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.09.008 · Cited by 165
“To reduce the probability of false positive results due to the uncorrected p value, we set a contiguity threshold for cluster volumes of at least 10 voxels (Forman et al., 1995).”
MethodSilva, A. C., Lee, S.-P., Iadecola, C., & Kim, S.-G. (2000) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1097/00004647-200001000-00025 · Cited by 165
Burklund, L. J., Eisenberger, N. I., & Lieberman, M. D. (2007) · Social Neuroscience · doi:10.1080/17470910701391711 · Cited by 164
“…for multiple comparisons in the whole-brain analyses, we used an uncorrected p-value of .005 combined with a cluster size threshold of 10 voxels (Forman et al., 1995) for all limbic (e.g., amygdala, insula, ACC) and prefrontal cortical regions, as these regions have been shown to be involved…”
MethodAcute 5-HT Reuptake Blockade Potentiates Human Amygdala Reactivity
Bigos, K. L., Pollock, B. G., Aizenstein, H. J., Fisher, P. M., Bies, R. R., & Hariri, A. R. (2008) · Neuropsychopharmacology · doi:10.1038/npp.2008.52 · Cited by 164
“Because of our a priori directionally specific hypotheses and our use of a rigorous random-effects model, these statistical thresholds effectively control for type I error arising from multiple comparisons (Forman et al, 1995).”
MethodInsular and hippocampal gray matter volume reductions in patients with major depressive disorder
Stratmann, M., Konrad, C., Kugel, H., Krug, A., Schöning, S., Ohrmann, P., Uhlmann, C., Postert, C., Suslow, T., Heindel, W., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0102692 · Cited by 164
“001 with a cluster extend (k) empirically determined by Monte Carlo simulations (n = 1000 iterations), by means of AlphaSim procedure [44], implemented in the REST toolbox (http://www.”
MethodDistinct Neural Activity Associated with Focused-Attention Meditation and Loving-Kindness Meditation
Lee, T. M. C., Leung, M.-K., Hou, W.-K., Tang, J. C. Y., Yin, J., So, K.-F., Lee, C.-F., & Chan, C. C. H. (2012) · PLoS ONE · doi:10.1371/journal.pone.0040054 · Cited by 162
“05 [28].”
Reward processing in unipolar and bipolar depression: A functional MRI study
Redlich, R., Dohm, K., Grotegerd, D., Opel, N., Zwitserlood, P., Heindel, W., Arolt, V., Kugel, H., & Dannlowski, U. (2015) · Neuropsychopharmacology · doi:10.1038/npp.2015.110 · Cited by 164
Lee, W., & Reeve, J. (2013) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nss029 · Cited by 164
“…multiple comparison inferences in these whole-brain analyses, the cluster-wise threshold (corrected P 0.05) was employed based on Monte-Carlo simulations (Forman et al., 1995), which was determined by both voxel-wise threshold (P 0.005) and cluster size (n¼ 53, a minimum volume of 424 mm3).”
MethodInfluentialPrice, G. R., Mazzocco, M. M. M., & Ansari, D. (2013) · The Journal of Neuroscience · doi:10.1523/jneurosci.2936-12.2013 · Cited by 164
“, calculation versus digit matching correlated with PSAT scores), where no voxels survived correction using FDR, cluster-level correction (Forman et al., 1995; Goebel et al., 2006) was used to correct for multiple comparisons.”
MethodSehm, B., Kipping, J., Schäfer, A., Villringer, A., & Ragert, P. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00183 · Cited by 164
“3dClustSim was used for multiple comparison correction (Forman et al., 1995) and group-level z-maps were thresholded accordingly (p 0.05, cluster corrected, voxel-wise p 0.05, cluster size of 46 voxels as defined by Monte–Carlo simulation).”
MethodInfluentialHickok, G., Erhard, P., Kassubek, J., Helms-Tillery, A. K., Naeve-Velguth, S., Strupp, J. P., Strick, P. L., & Ugurbil, K. (2000) · Neuroscience Letters · doi:10.1016/s0304-3940(00)01143-5 · Cited by 164
Effects of estrogen variation on neural correlates of emotional response inhibition
Amin, Z., Epperson, C. N., Constable, R. T., & Canli, T. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.03.013 · Cited by 163
Flexibility in embodied lexical‐semantic representations
van Dam, W. O., van Dijk, M., Bekkering, H., & Rueschemeyer, S. (2012) · Human Brain Mapping · doi:10.1002/hbm.21365 · Cited by 164
“To achieve the desired correction for multiple comparisons, we calculated the probability associated with each cluster extent across 1,000 Monte Carlo simulations [Forman et al., 1995; Slotnick et al., 2003].”
Specialized Neural Systems Underlying Representations of Sequential Movements
Harrington, D. L., Rao, S. M., Haaland, K. Y., Bobholz, J. A., Mayer, A. R., Binder, J. R., & Cox, R. W. (2000) · Journal of Cognitive Neuroscience · doi:10.1162/08989290051137602 · Cited by 163
“2 ml was applied as an additional procedure for removing false positive activation foci from the brain maps (Forman et al., 1995).”
MethodPerthen, J. E., Lansing, A. E., Liau, J., Liu, T. T., & Buxton, R. B. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.10.049 · Cited by 162
“Voxels exhibiting CBF or BOLD activation were detected after correcting for multiple comparisons using the AFNI AlphaSim program (Cox, 1996; Forman et al., 1995), using an overall significance threshold of p = 0.05.”
InfluentialStice, E., Burger, K., & Yokum, S. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2012.11.028 · Cited by 162
Liu, F., Hu, M., Wang, S., Guo, W., Zhao, J., Li, J., Xun, G., Long, Z., Zhang, J., Wang, Y., et al. (2012) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2012.07.004 · Cited by 161
“This correction was performed by Monte Carlo simulations to calculate the probability of false-positive detection by considering both the individual voxel probability threshold and the cluster size (Forman et al., 1995).”
Prediction and interpretation of distributed neural activity with sparse models
CARROLL, M., CECCHI, G., RISH, I., GARG, R., & RAO, A. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.08.020 · Cited by 162
“Many existing techniques exist solely to attempt to extract these localized clusters directly, for instance by setting thresholds on the extent of crosscorrelation (Forman et al., 1995).”
Reduced Hippocampal Activity in Youth with Posttraumatic Stress Symptoms: An fMRI Study
Carrion, V. G., Haas, B. W., Garrett, A., Song, S., & Reiss, A. L. (2010) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsp112 · Cited by 162
“This combination of an activation threshold and a spatial extent threshold adequately protects against false positives and corresponds to a per-voxel false discovery rate of p¼ .00011 (Forman et al., 1995).”
BackgroundComputational Substrates of Social Value in Interpersonal Collaboration
Fareri, D. S., Chang, L. J., & Delgado, M. R. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.4775-14.2015 · Cited by 161
“This method of correction (Forman et al., 1995; Goebel et al., 2006) runs a series of Monte Carlo simulations on a given SPM to determine the likelihood that observed clusters of activation are significant and not false positives, resulting in a whole-brain corrected threshold of p 0.”
MethodSensitivity of prefrontal cortex to changes in target probability: a functional MRI study
Casey, B. J., Forman, S. D., Franzen, P., Berkowitz, A., Braver, T. S., Nystrom, L. E., Thomas, K. M., & Noll, D. C. (2001) · Human Brain Mapping · doi:10.1002/hbm.1022 · Cited by 160
“A 9 (subjects) 3 3 (high, moderate, and low target probabilities) ANOVA was performed on the pooled data with subject as a random factor, and areas of significant activation were identified that satisfied a contiguity threshold of three contiguous pixels with P , .005 [Forman et al., 1995].”
MethodSelf-citationNeural Correlates of Multisensory Perceptual Learning
Powers, A. R., Hevey, M. A., & Wallace, M. T. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.6138-11.2012 · Cited by 160
“For this analysis, cluster-size thresholding (Forman et al., 1995) was used for correction (SPM extension CorrClusTh, using the Newton–Raphson search method).”
MethodInvestigation into the neural correlates of emotional augmentation of clinical pain
Schweinhardt, P., Kalk, N., Wartolowska, K., Chessell, I., Wordsworth, P., & Tracey, I. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.12.016 · Cited by 160
“This cluster-based significance thresholding procedure provides a correction for multiple comparisons across the whole brain (Forman et al., 1995).”
The Literate Brain: The Relationship between Spelling and Reading
Rapp, B., & Lipka, K. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2010.21507 · Cited by 159
“If we focus on the results of Beeson et al. (2003) and Rapp and Hsieh (2002), we find convergence in that they both identify spelling-specific activation in the following left hemisphere areas: the fusiform gyrus, the precentral sulcus (BA 6), the posterior inferior/middle frontal gyrus, and the supplementary motor co…”
BackgroundMethodInfluentialProcessing of audiovisual speech in Broca's area
Ojanen, V., Möttönen, R., Pekkola, J., Jääskeläinen, I. P., Joensuu, R., Autti, T. H., & Sams, M. E. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.12.001 · Cited by 180
“…the statistical parametric images were thresholded at Z N 3.0 for subsequent clustering, and the cluster-wise significance threshold was set at P b 0.05, corrected for multiple comparisons across the entire acquisition volume (Forman et al., 1995; Friston et al., 1994; Worsley et al., 1992).”
BackgroundMethodInfluentialFriedman, L., Glover, G. H., Krenz, D., & Magnotta, V. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.03.062 · Cited by 158
Left-handedness and language lateralization in children
Szaflarski, J. P., Rajagopal, A., Altaye, M., Byars, A. W., Jacola, L., Schmithorst, V. J., Schapiro, M. B., Plante, E., & Holland, S. K. (2012) · Brain Research · doi:10.1016/j.brainres.2011.11.026 · Cited by 159
Bright, M. G., & Murphy, K. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.03.070 · Cited by 159
“S2.”
BackgroundInfluentialSchwedt, T. J., Chong, C. D., Chiang, C.-C., Baxter, L., Schlaggar, B. L., & Dodick, D. W. (2014) · Cephalalgia · doi:10.1177/0333102414526069 · Cited by 159
“005, cluster threshold corrected at 10 voxels (11).”
BackgroundAnterior insular cortex anticipates impending stimulus significance
Lovero, K. L., Simmons, A. N., Aron, J. L., & Paulus, M. P. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.12.070 · Cited by 158
“A threshold adjustment method based on Monte Carlo simulations was used to guard against identifying areas of false positive activation (Forman et al., 1995).”
MethodMöttönen, R., Calvert, G. A., Jääskeläinen, I. P., Matthews, P. M., Thesen, T., Tuomainen, J., & Sams, M. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2005.10.002 · Cited by 158
“The stimuli were presented 5, 6 or 7 s prior to the mid-point of the volume acquisition.”
BackgroundMemorability: A stimulus-driven perceptual neural signature distinctive from memory
Bainbridge, W. A., Dilks, D. D., & Oliva, A. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.01.063 · Cited by 158
“This map was then corrected for multiple comparisons using cluster-size thresholding at a level of α=0.05 (Forman et al., 1995; Goebel et al., 2006).”
InfluentialThe self across the senses: an fMRI study of self-face and self-voice recognition
Kaplan, J. T., Aziz-Zadeh, L., Uddin, L. Q., & Iacoboni, M. (2008) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsn014 · Cited by 157
“For our whole-brain analysis, statistical images were thresholded using clusters determined by Z > 2.3 and a corrected cluster size significance threshold of P¼ 0.05 (Worsley et al., 1992; Friston et al., 1994; Forman et al., 1995).”
MethodInfluentialIhssen, N., Cox, W. M., Wiggett, A., Fadardi, J. S., & Linden, D. E. J. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhq220 · Cited by 157
The nature of memory related activity in early visual areas
Slotnick, S. D., & Schacter, D. L. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.06.021 · Cited by 176
Selective activation of the nucleus accumbens during risk-taking decision making
Matthews, S. C., Simmons, A. N., Lane, S. D., & Paulus, M. P. (2004) · NeuroReport · doi:10.1097/00001756-200409150-00025 · Cited by 157
“This threshold adjustment method was based on Monte-Carlo simulations and was used to guard against identifying false positive areas of activation [19].”
MethodIdentifying the neural substrates of intrinsic motivation during task performance
Lee, W., & Reeve, J. (2017) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-017-0524-x · Cited by 180
McDermott, K. B., Jones, T. C., Petersen, S. E., Lageman, S. K., & Roediger, H. L. (2000) · Journal of Cognitive Neuroscience · doi:10.1162/08989290051137503 · Cited by 156
“005, and only regions with at least 10 contiguous voxels passing this threshold were considered (Forman et al., 1995).”
BackgroundMethodCombined Activation and Deactivation of Visual Cortex During Tactile Sensory Processing
Merabet, L. B., Swisher, J. D., McMains, S. A., Halko, M. A., Amedi, A., Pascual-Leone, A., & Somers, D. C. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00806.2006 · Cited by 156
Distinct cortical networks for the detection and identification of human body
Hodzic, A., Kaas, A. L., Muckli, L. F., Stirn, A. V., & Singer, W. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.01.027 · Cited by 185
“…between cortical areas devoted to the analysis of body related information: 1.) the processing of visual, body specific features (body-detection), 2.) the distinction between familiar and unfamiliar bodies (body-identification) and 3.) the distinction of one's own body (self-identification).”
BackgroundMethodInfluentialAbnormal thalamic function in patients with vestibular migraine
Russo, A., Marcelli, V., Esposito, F., Corvino, V., Marcuccio, L., Giannone, A., Conforti, R., Marciano, E., Tedeschi, G., & Tessitore, A. (2014) · Neurology · doi:10.1212/wnl.0000000000000496 · Cited by 163
“05.(19,20) Furthermore, for regions showing statistically significant differences Figure 1 Main effects of experimental vestibular stimulation in patients with VM and MwoA and HC”
BackgroundBernardi, G., Siclari, F., Yu, X., Zennig, C., Bellesi, M., Ricciardi, E., Cirelli, C., Ghilardi, M. F., Pietrini, P., & Tononi, G. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.4567-14.2015 · Cited by 155
“To enhance the power of the statistical tests for all EEG analyses and minimize potential false positive results we applied a minimum cluster-size threshold determined using a Monte-Carlo simulation (Forman et al., 1995) including the following steps (5000 repetitions): random activity generation (a value comprised be…”
MethodInfluentialNeural basis of the Stroop interference task: Response competition or selective attention?
MEAD, L. A., MAYER, A. R., BOBHOLZ, J. A., WOODLEY, S. J., CUNNINGHAM, J. M., HAMMEKE, T. A., & RAO, S. M. (2002) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617702860015 · Cited by 155
“In addition to at-deviate threshold, a minimum cluster size threshold of 200ml was applied to minimize false positives in the brain maps (Forman et al., 1995).”
MethodAttention and emotion: Does rating emotion alter neural responses to amusing and sad films?
Hutcherson, C. A., Goldin, P. R., Ochsner, K. N., Gabrieli, J. D., Barrett, L. F., & Gross, J. J. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.04.028 · Cited by 154
“…library, was employed to identify a joint voxel-wise threshold and cluster minimum volume threshold combination to set a cluster-wise P value of less than 0.05 corrected for multiple comparisons across the whole brain and in a priori specified anatomical regions of interest (Forman et al., 1995).”
MethodInfluentialThe neural basis of cognitive control: response selection and inhibition
Goghari, V. M., & MacDonald, A. W. (2009) · Brain and Cognition · doi:10.1016/j.bandc.2009.04.004 · Cited by 152
“Functional activations were considered over threshold if 8 contiguous voxels were activated at p 0.005 (df = 11) (Forman et al., 1995).”
InfluentialA Neural Region of Abstract Working Memory
Cowan, N., Li, D., Moffitt, A., Becker, T. M., Martin, E. A., Saults, J. S., & Christ, S. E. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2011.21625 · Cited by 153
“The resulting statistical maps were corrected for multiple comparisons using cluster-size thresholding (Goebel, Esposito, & Formisano, 2006; Forman et al., 1995), with a resulting α level equivalent of p < .05 (false discovery rate [FDR] corrected).”
Pavlovian Reward Prediction and Receipt in Schizophrenia: Relationship to Anhedonia
Dowd, E. C., & Barch, D. M. (2012) · PLoS ONE · doi:10.1371/journal.pone.0035622 · Cited by 154
“05 [39,40]; an approach equivalent to that employed by the Alphasim program in the AFNI software package.”
MethodReduced global functional connectivity of the medial prefrontal cortex in major depressive disorder
Murrough, J. W., Abdallah, C. G., Anticevic, A., Collins, K. A., Geha, P., Averill, L. A., Schwartz, J., DeWilde, K. E., Averill, C., Jia‐Wei Yang, G., et al. (2016) · Human Brain Mapping · doi:10.1002/hbm.23235 · Cited by 153
“Type I error correction was based on peak and cluster extent [Forman et al., 1995] ascertained via AFNI’s 3dClustSim using an estimate of smoothness through 3dFWHMx (uncorrected z-value> 2.58 and at least 88 or 23 contiguous voxels for whole-brain and VMPFC-restricted analyses respectively,…”
MethodInfluentialLi, L., Men, W.-W., Chang, Y.-K., Fan, M.-X., Ji, L., & Wei, G.-X. (2014) · PLoS ONE · doi:10.1371/journal.pone.0099222 · Cited by 153
“5 voxels [29–31].”
Frontostriatal Involvement in Task Switching Depends on Genetic Differences in D2 Receptor Density
Stelzel, C., Basten, U., Montag, C., Reuter, M., & Fiebach, C. J. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.1062-10.2010 · Cited by 153
“To protect the whole-brain analysis against falsepositive activations, we used a double-threshold approach, that is, combining a voxel-based threshold with a minimum cluster size (Forman et al., 1995).”
MethodUnawareness of deficits in Alzheimer’s disease: role of the cingulate cortex
Amanzio, M., Torta, D. M. E., Sacco, K., Cauda, F., D’Agata, F., Duca, S., Leotta, D., Palermo, S., & Geminiani, G. C. (2011) · Brain · doi:10.1093/brain/awr020 · Cited by 153
What difference does a year of schooling make?
Rosenberg-Lee, M., Barth, M., & Menon, V. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.05.013 · Cited by 153
“Monte Carlo simulations were implemented in MatLab using methods similar to AFNI's AlphaSim program (Forman et al., 1995; Ward, 2000).”
Atypical Cross Talk Between Mentalizing and Mirror Neuron Networks in Autism Spectrum Disorder
Fishman, I., Keown, C. L., Lincoln, A. J., Pineda, J. A., & Müller, R.-A. (2014) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.83 · Cited by 152
“05, using Monte Carlo simulation.(55) Summary connectivity scores and correlations with clinical measures.”
Increased Default Mode Network Connectivity in Individuals at High Familial Risk for Depression
Posner, J. E., Cha, J., Wang, Z., Talati, A., Warner, V., Gerber, A. J., Peterson, B. S., & Weissman, M. M. (2015) · Neuropsychopharmacology · doi:10.1038/npp.2015.342 · Cited by 168
“…application of a voxel level statistical threshold and cluster filter minimizes the false-positive identification of regions at any given threshold (Forman et al, 1995) because clustering can distinguish between true connectivity between regions and noise that has less tendency to cluster (Posner…”
BackgroundAge-related differences in brain activity during true and false memory retrieval
Dennis, N. A., Kim, H., & Cabeza, R. (2008) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2008.20096 · Cited by 152
“(The voxelwise probability for false positive activation within these regions is p = .00013; Forman et al., 1995.)”
BackgroundMethodInfluentialTask-Dependent Decoding of Speaker and Vowel Identity from Auditory Cortical Response Patterns
Bonte, M., Hausfeld, L., Scharke, W., Valente, G., & Formisano, E. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.4339-13.2014 · Cited by 152
“…applying a cluster-size threshold with an initial voxel-level threshold of p 0.01 (overall activity) or p 0.05 (task and stimulus contrasts) and submitting the maps to a wholebrain correction criterion based on the estimate of the map’s spatial smoothness (Forman et al., 1995; Goebel et al., 2006).”
MethodInfluentialPerceived quality of maternal care in childhood and structure and function of mothers' brain
Kim, P., Leckman, J. F., Mayes, L. C., Newman, M., Feldman, R., & Swain, J. E. (2010) · Developmental Science · doi:10.1111/j.1467-7687.2009.00923.x · Cited by 152
“The significance threshold of the activities was set at p < .01, and was corrected for multiple comparisons using the cluster filter (Forman et al., 1995; Goebel, Esposito & Formisano, 2006), such that only clusters larger than 833 mm 3 survived the correction.”
MethodNeural responses to acute cocaine administration in the human brain detected by fMRI
Kufahl, P. R., Li, Z., Risinger, R. C., Rainey, C. J., Wu, G., Bloom, A. S., & Li, S.-J. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.06.039 · Cited by 151
Qualitatively different coding of symbolic and nonsymbolic numbers in the human brain
Lyons, I. M., Ansari, D., & Beilock, S. L. (2014) · Human Brain Mapping · doi:10.1002/hbm.22641 · Cited by 166
“3a) were identified via the main effect of all dot numerosities greater than baseline, thresholded first voxelwise at P 0.005, and subsequently cluster-level corrected for multiple-comparisons using a Monte-Carlo simulation procedure [Forman et al., 1995] at a 0.01.”
MethodInfluentialHampstead, B. M., Stringer, A. Y., Stilla, R. F., Giddens, M., & Sathian, K. (2012) · Hippocampus · doi:10.1002/hipo.22006 · Cited by 151
“…activation maps for each contrast were corrected for multiple comparisons by imposing a cluster-volume threshold for contiguous voxels passing a voxelwise significance threshold of P 0.05, using BrainVoyager’s 3D extension of the 2D Monte Carlo simulation procedure (Forman et al., 1995).”
MethodInfluentialDeshpande, G., Hu, X. P., Stilla, R. F., & Sathian, K. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.01.044 · Cited by 162
“…the cerebral cortical volume (corrected p<0.05) by imposing a cluster-volume threshold for contiguous voxels that each passed a significance threshold of p<0.05, using a 3D extension (implemented in BrainVoyager QX) of the 2D Monte Carlo simulation procedure described by Forman et al. (1995).”
InfluentialRelation of obesity to neural activation in response to food commercials
Gearhardt, A. N., Yokum, S., Stice, E., Harris, J. L., & Brownell, K. D. (2014) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nst059 · Cited by 151
“Cluster level thresholds corrected for multiple comparisons were derived using a Monte Carlo simulations (10,000 iterations) of random noise distribution in the whole brain mask (3x3x3mm) using the 3dClustSim and 3dFWHMx modules in AFNI (Cox, 1996; Forman et al., 1995).”
MethodVikingstad, E. M., George, K., Johnson, A., & Cao, Y. (2000) · Journal of the Neurological Sciences · doi:10.1016/s0022-510x(00)00269-0 · Cited by 168
Adjusting the effect of nonstationarity in cluster-based and TFCE inference
Salimi‐Khorshidi, G., Smith, S. M., & Nichols, T. E. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.09.088 · Cited by 168
“Further modifications of this approach have been proposed for fMRI (Forman et al., 1995) and PET (Ledberg et al., 1998).”
MethodIntrinsic Fluctuations in Sustained Attention and Distractor Processing
Esterman, M., Rosenberg, M. D., & Noonan, S. K. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.2658-13.2014 · Cited by 150
“All resulting statistical maps were corrected for multiple comparisons using voxel-cluster Monte Carlo-type simulations (Forman et al., 1995), resulting in a corrected significance level of 0.05 (individualvoxel intensity threshold of p 0.01, cluster size of 54 contiguous voxels).”
MethodInfluentialYokum, S., & Stice, E. (2013) · International Journal of Obesity · doi:10.1038/ijo.2013.39 · Cited by 149
“This was accomplished by first estimating the inherent smoothness of the masked functional data with the 3dFWHMx module in AFNI (39).”
Aarts, E., Roelofs, A., & van Turennout, M. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.4400-07.2008 · Cited by 150
“001 at the voxel level with a minimum cluster size of 50 mm (3)/14 original voxels (Forman et al., 1995), uncorrected for multiple comparisons.”
InfluentialThe neural origins of specific and general memory: the role of the fusiform cortex
Garoff-Eaton, R. J., Slotnick, S. D., & Schacter, D. L. (2004) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2004.09.014 · Cited by 167
The “Narratives” fMRI dataset for evaluating models of naturalistic language comprehension
Nastase, S. A., Liu, Y.-F., Hillman, H., Zadbood, A., Hasenfratz, L., Keshavarzian, N., Chen, J., Honey, C. J., Yeshurun, Y., Regev, M., et al. (2021) · Scientific Data · doi:10.1038/s41597-021-01033-3 · Cited by 148
Metadata
- Authors
- Forman, S. D., Cohen, J. D., Fitzgerald, M., Eddy, W. F., Mintun, M. A., & Noll, D. C.
- Affiliations
- University of Pittsburgh (US)
- Corresponding author
- Forman, Steven D.
- Venue
- Magnetic Resonance in Medicine
- Publisher
- Wiley
- Published
- 1995-05
- Volume
- 33
- Issue
- 5
- Pages
- 636-647
- ISSN
- 0740-3194 (ISSN-L)
- 1522-2594
- OpenAlex
- W2044634376
- Cited by
- 3,202
- References
- 11
- Citations by year
- 2026: 27 · 2025: 26 · 2024: 30 · 2023: 36 · 2022: 45 · 2021: 55 · 2020: 64 · 2019: 75 · 2018: 96 · 2017: 137 · 2016: 140 · 2015: 188 · 2014: 203 · 2013: 213 · 2012: 242
- FWCI
- 14.83
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Magnetic Resonance in Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Functional Brain Connectivity Studies
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Advanced MRI Techniques and Applications
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Advanced Neuroimaging Techniques and Applications
- Keywords
- multiple comparisons, false positives, statistical power, fMRI activation detection, Monte Carlo simulation, cluster size distribution
- MeSH terms
- Brain, Data Interpretation, Statistical, False Positive Reactions, Humans, Magnetic Resonance Imaging, Monte Carlo Method, Probability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.