Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): use of a cluster-size threshold
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
The typical functional magnetic resonance (fMRI) study presents a formidable problem of multiple statistical comparisons (i.e., > 10,000 in a 128 x 128 image). To protect against false positives, investigators have typically relied on decreasing the per pixel false positive probability. This approach incurs an inevitable loss of power to detect statistically significant activity. An alternative approach, which relies on the assumption that areas of true neural activity will tend to stimulate signal changes over contiguous pixels, is presented. If one knows the probability distribution of such cluster sizes as a function of per pixel false positive probability, one can use cluster-size thresholds independently to reject false positives. Both Monte Carlo simulations and fMRI studies of human subjects have been used to verify that this approach can improve statistical power by as much as fivefold over techniques that rely solely on adjusting per pixel false positive probabilities.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For all analyses, we determined cluster-size thresholds using Monte Carlo simulations in AFNI’s 3DClustSim (http://afni.nimh.nih.gov/afni/) which allowed for improved assessment of functional activation and correction for multiple comparisons (Forman et al., 1995) based on a grey matter mask.”
From Self-referential processing during observation of a speech performance task in social anxiety disorder from pre- to post-treatment: Evidence of disrupted neural activation (2019) · cites this paper as Forman et al., 1995
In the citing paper
“Two criteria were employed in evaluating activations: (i) only regions with peak voxels of P < 0.001 were considered; (ii) only clusters of activation including k !6 voxels in which all voxels met an uncorrected threshold of P < 0.005 were considered, yielding a functional threshold equivalent of P < 0.001 according to cluster size significance level corrections (Forman et al., 1995).”
From Attending to the present: mindfulness meditation reveals distinct neural modes of self-reference (2007) · cites this paper as Forman et al., 1995
In the citing paper
“Cluster thresholding was applied to increase power in identifying heavily recruited neural areas while maintaining a reasonably low Type-I error rate (Forman et al., 1995).”
From Attending to the present: mindfulness meditation reveals distinct neural modes of self-reference (2007) · cites this paper as Forman et al., 1995
In the citing paper
“For all FC analyses, a double statistical threshold (voxel-wise p < 0.01 and cluster size ≥ 78 voxels, as determined by AlphaSim with 10,000 Monte Carlo simulations) was used to obtain an alpha < 0.05 (corrected for multiple comparisons) (see details on the procedure at http://afni.nimh.nih.gov/afni/doc/manual/AlphaSim and in [30]).”
From Structural and Functional Cerebral Correlates of Hypnotic Suggestibility (2014) · cites this paper as [30]
In the citing paper
“The resulting maps from all participants in the HFA group and all participants in the control group were averaged and these group-averaged t-maps were displayed on group composite anatomical images with a statistical threshold of p < .001, adjusted for multiple comparisons with a cluster-filter of 10 contiguous pixels (42).”
From The Neural Circuitry Mediating Shifts in Behavioral Response and Cognitive Set in Autism (2008) · cites this paper as [42]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Self-citationNumerical recipes in C: the art of scientific computing
(1993) · Choice Reviews Online · doi:10.5860/choice.30-5638 · Cited by 17,933
A three-dimensional statistical analysis for CBF activation studies in human brain
Worsley, K. J., Evans, A. C., Marrett, S., & Neelin, P. (1992) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1992.127 · Cited by 2,036
Assessing the significance of focal activations using their spatial extent
Friston, K. J., Worsley, K. J., Frackowiak, R. S. J., Mazziotta, J. C., & Evans, A. C. (1994) · Human Brain Mapping · doi:10.1002/hbm.460010306 · Cited by 1,907
Comparing Functional (PET) Images: The Assessment of Significant Change
Friston, K. J., Frith, C. D., Liddle, P. F., & Frackowiak, R. S. J. (1991) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1991.122 · Cited by 1,625
MRI-PET Registration with Automated Algorithm
Woods, R. P., Mazziotta, J. C., & R. Cherry, A. S. (1993) · Journal of Computer Assisted Tomography · doi:10.1097/00004728-199307000-00004 · Cited by 1,617
The Relationship between Global and Local Changes in PET Scans
Friston, K. J., Frith, C. D., Liddle, P. F., Dolan, R. J., Lammertsma, A. A., & Frackowiak, R. S. J. (1990) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1990.88 · Cited by 858
Activation of the prefrontal cortex in a nonspatial working memory task with functional MRI
Cohen, J. D., Forman, S. D., Braver, T. S., Casey, B. J., Servan‐Schreiber, D., & Noll, D. C. (1994) · Human Brain Mapping · doi:10.1002/hbm.460010407 · Cited by 576
Self-citationSpiral K‐space MR imaging of cortical activation
Noll, D. C., Cohen, J. D., Meyer, C. H., & Schneider, W. (1995) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.1880050112 · Cited by 254
Self-citationPoline, J.-B., & Mazoyer, B. M. (1993) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1993.57 · Cited by 155
Cited by
Nonparametric permutation tests for functional neuroimaging: A primer with examples
Nichols, T. E., & Holmes, A. P. (2002) · Human Brain Mapping · doi:10.1002/hbm.1058 · Cited by 6,256
Does Rejection Hurt? An fMRI Study of Social Exclusion
Eisenberger, N. I., Lieberman, M. D., & Williams, K. D. (2003) · Science · doi:10.1126/science.1089134 · Cited by 3,849
Cluster failure: why fMRI inferences for spatial extent have inflated false-positive rates
Eklund, A., Nichols, T. E., & Knutsson, H. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1602413113 · Cited by 3,487
“AFNI estimates FWE p-values with a simulation based procedure, 3dClustSim [8].”
Anterior Cingulate Cortex, Error Detection, and the Online Monitoring of Performance
Carter, C. S., Braver, T. S., Barch, D. M., Botvinick, M. M., Noll, D., & Cohen, J. D. (1998) · Science · doi:10.1126/science.280.5364.747 · Cited by 3,273
Self-citationGusnard, D. A., Akbudak, E., Shulman, G. L., & Raichle, M. E. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.071043098 · Cited by 2,997
Circular analysis in systems neuroscience: the dangers of double dipping
Kriegeskorte, N., Simmons, W. K., Bellgowan, P. S. F., & Baker, C. I. (2009) · Nature Neuroscience · doi:10.1038/nn.2303 · Cited by 2,696
“To its great credit, neuroimaging has developed rigorous methods for statistical mapping from the beginning.(7,8,9,10,11) Note that mapping the whole measurement volume avoids selection altogether: We can analyze and report results for all locations equally, while accounting for the multiple tests performed across loc…”
The Neural Bases of Cognitive Conflict and Control in Moral Judgment
Greene, J. D., Nystrom, L. E., Engell, A. D., Darley, J. M., & Cohen, J. D. (2004) · Neuron · doi:10.1016/j.neuron.2004.09.027 · Cited by 2,620
Self-citationGrasping the intentions of others with one's own mirror neuron system
Iacoboni, M., Molnar-Szakacs, I., Gallese, V., Buccino, G., Mazziotta, J. C., & Rizzolatti, G. (2005) · PLoS Biology · doi:10.1371/journal.pbio.0030079 · Cited by 2,044
“Z image statistics were performed with a threshold of Z = 2.3 at voxel level and a cluster level corrected for the whole brain at p , 0.05 [41, 42 ].”
MethodInfluentialConflict monitoring versus selection-for-action in anterior cingulate cortex
Botvinick, M., Nystrom, L. E., Fissell, K., Carter, C. S., & Cohen, J. D. (1999) · Nature · doi:10.1038/46035 · Cited by 2,044
Self-citationNeural mechanisms of empathy in humans: a relay from neural systems for imitation to limbic areas
Carr, L., Iacoboni, M., Dubeau, M.-C., Mazziotta, J. C., & Lenzi, G. L. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0935845100 · Cited by 1,978
Bartra, O., McGuire, J. T., & Kable, J. W. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.02.063 · Cited by 1,927
“Recent work (Eickhoff et al., 2012) indicates that coordinate-based meta-analyses can achieve considerably improved sensitivity by incorporating spatial clustering (cf. Forman et al., 1995).”
Mindfulness practice leads to increases in regional brain gray matter density
Hölzel, B. K., Carmody, J., Vangel, M., Congleton, C., Yerramsetti, S. M., Gard, T., & Lazar, S. W. (2011) · Psychiatry Research: Neuroimaging · doi:10.1016/j.pscychresns.2010.08.006 · Cited by 1,914
“006 preventing false positives seemed too conservative and leads to a substantial loss of statistical power (Forman et al., 1995; Friston et al., 1996).”
BackgroundMethodThe Neural Bases of Emotion Regulation: Reappraisal and Suppression of Negative Emotion
Goldin, P. R., McRae, K., Ramel, W., & Gross, J. J. (2008) · Biological Psychiatry · doi:10.1016/j.biopsych.2007.05.031 · Cited by 1,886
Temporal dynamics of brain activation during a working memory task
Cohen, J. D., Perlstein, W. M., Braver, T. S., Nystrom, L. E., Noll, D. C., Jonides, J., & Smith, E. E. (1997) · Nature · doi:10.1038/386604a0 · Cited by 1,876
Self-citationA Parametric Study of Prefrontal Cortex Involvement in Human Working Memory
Braver, T. S., Cohen, J. D., Nystrom, L. E., Jonides, J., Smith, E. E., & Noll, D. C. (1997) · NeuroImage · doi:10.1006/nimg.1996.0247 · Cited by 1,694
“Statistical maps of activity were generated for each slice (see below for details) and then thresholded for significance using a cluster-size algorithm that takes account of the spatial extent of activation in correcting for multiple comparisons (Forman et al., 1995).”
MethodSelf-citationCardiovascular fitness, cortical plasticity, and aging
Colcombe, S. J., Kramer, A. F., Erickson, K. I., Scalf, P., McAuley, E., Cohen, N. J., Webb, A., Jerome, G. J., Marquez, D. X., & Elavsky, S. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0400266101 · Cited by 1,648
Puzzlingly High Correlations in fMRI Studies of Emotion, Personality, and Social Cognition
Vul, E., Harris, C., Winkielman, P., & Pashler, H. (2009) · Perspectives on Psychological Science · doi:10.1111/j.1745-6924.2009.01125.x · Cited by 1,475
Right hemispheric dominance of inhibitory control: An event-related functional MRI study
Garavan, H., Ross, T. J., & Stein, E. A. (1999) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.96.14.8301 · Cited by 1,394
Meltzer, H. Y. (2003) · Archives of General Psychiatry · doi:10.1001/archpsyc.60.1.82 · Cited by 1,393
Etkin, A., Egner, T., Peraza, D. M., Kandel, E. R., & Hirsch, J. (2006) · Neuron · doi:10.1016/j.neuron.2006.07.029 · Cited by 1,360
“Group-level contrasts were thresholded within the amygdala at p = 0.005 (uncorrected) and a ten voxel spatial extent, which yielded an equivalent correction for multiple comparisons and enriched for larger activation clusters (Forman et al., 1995).”
MethodInfluentialNeural Correlates of Behavioral Preference for Culturally Familiar Drinks
McClure, S. M., Li, J., Tomlin, D., Cypert, K. S., Montague, L. M., & Montague, P. R. (2004) · Neuron · doi:10.1016/j.neuron.2004.09.019 · Cited by 1,353
“(Forman et al., 1995).”
Type I and Type II error concerns in fMRI research: re-balancing the scale
Lieberman, M. D., & Cunningham, W. A. (2009) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsp052 · Cited by 1,342
“One solution has been to jointly use intensity and spatial extent thresholds in the same analysis (‘intensity/cluster thresholding’; Forman et al., 1995 ).”
MethodAttending to the present: mindfulness meditation reveals distinct neural modes of self-reference
Farb, N. A. S., Segal, Z. V., Mayberg, H., Bean, J., McKeon, D., Fatima, Z., & Anderson, A. K. (2007) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsm030 · Cited by 1,307
The maturing architecture of the brain's default network
Fair, D. A., Cohen, A. L., Dosenbach, N. U. F., Church, J. A., Miezin, F. M., Barch, D. M., Raichle, M. E., Petersen, S. E., & Schlaggar, B. L. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0800376105 · Cited by 1,314
“For the voxelwise maps, a correction based on Monte Carlo simulation was implemented (51).”
MethodGalvan, A., Hare, T. A., Parra, C. E., Penn, J., Voss, H., Glover, G., & Casey, B. J. (2006) · Journal of Neuroscience · doi:10.1523/jneurosci.1062-06.2006 · Cited by 1,282
Oxytocin shapes the neural circuitry of trust and trust adaptation in humans
Baumgartner, T., Heinrichs, M., Vonlanthen, A., Fischbacher, U., & Fehr, E. (2008) · Neuron · doi:10.1016/j.neuron.2008.04.009 · Cited by 1,258
“005 combined with a clustersize threshold of 10 voxels (Forman et al., 1995).”
InfluentialCluster-extent based thresholding in fMRI analyses: Pitfalls and recommendations
Woo, C.-W., Krishnan, A., & Wager, T. D. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.12.058 · Cited by 1,253
“…distribution of the largest null cluster size under the global null hypotheses of no signal is typically estimated using theoretical methods (e.g., random field theory [RFT]; Worsley et al., 1992), Monte Carlo simulation (Forman et al., 1995), or nonparametric methods (Nichols and Holmes, 2002).”
MethodAmygdala–frontal connectivity during emotion regulation
Banks, S. J., Eddy, K. T., Angstadt, M., Nathan, P. J., & Phan, K. L. (2007) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsm029 · Cited by 1,187
“…PPIrelated amygdala coupling were identified with a threshold of P < 0.001 uncorrected (t > 3.85) with at least 10 contiguous voxels in the cluster (120 mm 3 ); the combination of the height-extent threshold effectively yields equivalent correction for multiple comparisons (Forman et al., 1995).”
MethodInfluentialLieberman, M. D., Eisenberger, N. I., Crockett, M. J., Tom, S. M., Pfeifer, J. H., & Way, B. M. (2007) · Psychological Science · doi:10.1111/j.1467-9280.2007.01916.x · Cited by 1,150
“The correction for multiple comparisons in whole-brain analyses was carried out using an uncorrected p value of .005 combined with a cluster-size threshold of 10 voxels (Forman et al., 1995).”
Detecting activations in PET and fMRI: levels of inference and power
Friston, K. J., Holmes, A., Poline, J.-B., Price, C. J., & Frith, C. D. (1996) · NeuroImage · doi:10.1006/nimg.1996.0074 · Cited by 1,148
Tracking the Hemodynamic Responses to Reward and Punishment in the Striatum
Delgado, M. R., Nystrom, L. E., Fissell, C., Noll, D. C., & Fiez, J. A. (2000) · Journal of Neurophysiology · doi:10.1152/jn.2000.84.6.3072 · Cited by 1,116
Self-citationA developmental functional MRI study of prefrontal activation during performance of a go-no-go task
Casey, B. J., Trainor, R. J., Orendi, J. L., Schubert, A. B., Nystrom, L. E., Giedd, J. N., Castellanos, F. X., Haxby, J. V., Noll, D. C., Cohen, J. D., et al. (1997) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1997.9.6.835 · Cited by 1,106
Self-citationBullmore, E. T., Suckling, J., Overmeyer, S., Rabe-Hesketh, S., Taylor, E., & Brammer, M. J. (1999) · IEEE Transactions on Medical Imaging · doi:10.1109/42.750253 · Cited by 1,088
Goebel, R., Esposito, F., & Formisano, E. (2006) · Human Brain Mapping · doi:10.1002/hbm.20249 · Cited by 1,053
Johnstone, T., van Reekum, C. M., Urry, H. L., Kalin, N. H., & Davidson, R. J. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2063-07.2007 · Cited by 1,051
“, 1994), is an alternative to voxel-based correction and is often more sensitive to activation when one can reasonably expect multiple contiguous activated voxels (Forman et al., 1995; Petersson et al., 1999).”
Anterior Cingulate Cortex and Response Conflict: Effects of Frequency, Inhibition and Errors
Braver, T. S. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.9.825 · Cited by 1,016
“For whole-brain exploratory analyses, statistical parametric maps of the voxel-wise F-values were thresholded for significance using a cluster-size algorithm ( Forman et al., 1995 ).”
MethodParsing executive processes: Strategic vs. evaluative functions of the anterior cingulate cortex
Carter, C. S., Macdonald, A. M., Botvinick, M., Ross, L. L., Stenger, V. A., Noll, D., & Cohen, J. D. (2000) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.97.4.1944 · Cited by 957
Self-citationCue-induced cocaine craving: neuroanatomical specificity for drug users and drug stimuli
Garavan, H., Pankiewicz, J., Bloom, A., Cho, J.-K., Sperry, L., Ross, T. J., Salmeron, B. J., Risinger, R., Kelley, D., & Stein, E. A. (2000) · American Journal of Psychiatry · doi:10.1176/appi.ajp.157.11.1789 · Cited by 931
“The advantages of combining a voxel-wise threshold with a minimum cluster size have been described elsewhere (25).”
BackgroundShmuel, A., Augath, M., Oeltermann, A., & Logothetis, N. K. (2006) · Nature Neuroscience · doi:10.1038/nn1675 · Cited by 898
Face processing occurs outside the fusiform ‘face area’ in autism: evidence from functional MRI
Pierce, K. (2001) · Brain · doi:10.1093/brain/124.10.2059 · Cited by 898
“Significance was established using a voxel-cluster threshold technique (Forman et al., 1995) for an overall alpha level of 0.05 (voxelwise P Ͻ 0.0001; cluster size ജ512 mm 3 ).”
MethodInfluentialImaging how attention modulates pain in humans using functional MRI
Bantick, S. J., Wise, R. G., Ploghaus, A., Clare, S., Smith, S. M., & Tracey, I. (2002) · Brain · doi:10.1093/brain/awf022 · Cited by 888
“The thresholding parameters used for the ®xed effects analysis were a Z-score threshold of 2.0 and a probability value of P = 0.05 for cluster signi®cance (Worsley et al., 1992; Friston et al., 1994; Forman et al., 1995).”
MethodInfluentialNeural correlates of dispositional mindfulness during affect labeling
Creswell, J. D., Way, B. M., Eisenberger, N. I., & Lieberman, M. D. (2007) · Psychosomatic Medicine · doi:10.1097/psy.0b013e3180f6171f · Cited by 835
“005 combined with a cluster size threshold of 10 voxels (22).”
BackgroundThe evolution of brain activation during temporal processing
Rao, S. M., Mayer, A. R., & Harrington, D. L. (2001) · Nature Neuroscience · doi:10.1038/85191 · Cited by 828
Neural mechanisms of transient and sustained cognitive control during task switching.
Braver, T. S., Reynolds, J. R., & Donaldson, D. I. (2003) · Neuron · doi:10.1016/s0896-6273(03)00466-5 · Cited by 826
Emotional arousal and activation of the visual cortex: An fMRI analysis
Lang, P. J., Bradley, M. M., Fitzsimmons, J. R., Cuthbert, B. N., Scott, J. D., Moulder, B., & Nangia, V. (1998) · Psychophysiology · doi:10.1017/s0048577298001991 · Cited by 800
Functional connectivity of the insula in the resting brain
Cauda, F., D'Agata, F., Sacco, K., Duca, S., Geminiani, G., & Vercelli, A. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.11.049 · Cited by 793
“05, cluster-level corrected using a Monte Carlo simulation (Forman et al., 1995; Goebel et al., 2006), see supporting online materials) for multiple comparisons (cluster threshold kN10 voxels in the native resolution).”
The role of ipsilateral premotor cortex in hand movement after stroke
Johansen-Berg, H., Rushworth, M. F. S., Bogdanovic, M. D., Kischka, U., Wimalaratna, S., & Matthews, P. M. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.222536799 · Cited by 783
A specific role for posterior dorsolateral striatum in human habit learning
Tricomi, E., Balleine, B. W., & O’Doherty, J. P. (2009) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2009.06796.x · Cited by 769
“For all contrasts, a voxelwise significance threshold of P 0.001 was used, along with a contiguity threshold of five voxels as a precaution against type-1 errors (Forman et al., 1995).”
MethodInfluentialBrain areas underlying visual mental imagery and visual perception: an fMRI study
Ganis, G., Thompson, W. L., & Kosslyn, S. M. (2004) · Cognitive Brain Research · doi:10.1016/j.cogbrainres.2004.02.012 · Cited by 765
“[16], and (b) determines the number of clusters of a given size that would be significant at a particular threshold due to chance.”
BackgroundDefault mode network mechanisms of transcranial magnetic stimulation in depression
Liston, C., Chen, A. C., Zebley, B. D., Drysdale, A. T., Gordon, R., Leuchter, B., Voss, H. U., Casey, B. J., Etkin, A., & Dubin, M. J. (2014) · Biological Psychiatry · doi:10.1016/j.biopsych.2014.01.023 · Cited by 763
“In all analyses, significant effects were identified using a cluster threshold to correct for multiple comparisons (51).”
MethodSmoothing and cluster thresholding for cortical surface-based group analysis of fMRI data
Hagler, D. J., Saygin, A. P., & Sereno, M. I. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.07.036 · Cited by 752
“, 2004), or Monte Carlo simulations (Poline and Mazoyer, 1993; Forman et al., 1995), for any number of uncorrected p-values.”
BackgroundMethodInfluentialPaulus, M. P., Rogalsky, C., Simmons, A., Feinstein, J. S., & Stein, M. B. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00251-9 · Cited by 745
“A threshold adjustment method based on Monte- Carlo simulations was used to guard against identifying false-positive areas of activation (Forman et al., 1995).”
MethodRegional aerobic glycolysis in the human brain
Vaishnavi, S. N., Vlassenko, A. G., Rundle, M. M., Snyder, A. Z., Mintun, M. A., & Raichle, M. E. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1010459107 · Cited by 738
“4, cluster >99 voxels) according to previously described methodology (15, 16).”
MethodSelf-citationFunctional neuroimaging of autobiographical memory
Cabeza, R., & St Jacques, P. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.02.005 · Cited by 736
Rombouts, S. A. R. B., Barkhof, F., Goekoop, R., Stam, C. J., & Scheltens, P. (2005) · Human Brain Mapping · doi:10.1002/hbm.20160 · Cited by 734
“Z (Gaussianized T/F) statistic images were thresholded using clusters of pixels with Z 3.1 and a corrected cluster significance threshold of P 0.05 [Forman et al., 1995; Friston et al., 1994; Worsley et al., 1992].”
MethodInfluentialPerceptions of moral character modulate the neural systems of reward during the trust game
Delgado, M. R., Frank, R. H., & Phelps, E. A. (2005) · Nature Neuroscience · doi:10.1038/nn1575 · Cited by 729
Moll, J., de Oliveira-Souza, R., Eslinger, P. J., Bramati, I. E., Mourão-Miranda, J., Andreiuolo, P. A., & Pessoa, L. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-07-02730.2002 · Cited by 721
“A minimum three-dimensional cluster extent threshold of 50– 100 mm 3 was used to protect against type I errors (Forman et al., 1995).”
MethodRossion, B. (2003) · Brain · doi:10.1093/brain/awg241 · Cited by 716
“Clusters size of >0.08 cm3 (>10 voxels; voxel size after normalization was 2 3 2 3 2 mm3) showing statistically signi®cant Z-score (typically Z-threshold = 3.0, at P < 0.002, uncorrected) in the faces±objects comparison were considered (Forman et al., 1995).”
BackgroundInfluentialPosterior cingulate cortex activation by emotional words: fMRI evidence from a valence decision task
Maddock, R. J., Garrett, A. S., & Buonocore, M. H. (2003) · Human Brain Mapping · doi:10.1002/hbm.10075 · Cited by 695
“Due to this imbalance in order and the significantly greater arousal ratings for the unpleasant than the pleasant words (Table I), no direct comparisons were made between pleasant and unpleasant words.”
BackgroundInfluentialA neural basis for the development of inhibitory control
Durston, S., Thomas, K. M., Yang, Y., Uluğ, A. M., Zimmerman, R. D., & Casey, B. J. (2002) · Developmental Science · doi:10.1111/1467-7687.00235 · Cited by 684
A shift from diffuse to focal cortical activity with development
Durston, S., Davidson, M. C., Tottenham, N., Galvan, A., Spicer, J., Fossella, J. A., & Casey, B. J. (2006) · Developmental Science · doi:10.1111/j.1467-7687.2005.00454.x · Cited by 692
“Regions of three or more contiguous voxels ( p < .01) were identified (Forman et al. , 1995).”
Social rejection shares somatosensory representations with physical pain
Kross, E., Berman, M. G., Mischel, W., Smith, E. E., & Wager, T. D. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1102693108 · Cited by 689
Etkin, A., Klemenhagen, K. C., Dudman, J. T., Rogan, M. T., Hen, R., Kandel, E. R., & Hirsch, J. (2004) · Neuron · doi:10.1016/j.neuron.2004.12.006 · Cited by 679
“100,000 (Eisenberger et al., 2003; Forman et al., 1995).”
Wise, R. G., Ide, K., Poulin, M. J., & Tracey, I. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.11.025 · Cited by 664
“01 was applied to the computed significance of that cluster (Forman et al., 1995; Friston et al., 1994; Worsley et al., 1992).”
MethodInfluentialNonstationary cluster-size inference with random field and permutation methods
Hayasaka, S., Phan, K. L., Liberzon, I., Worsley, K. J., & Nichols, T. E. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.01.041 · Cited by 661
“Different implementations of cluster-size tests have been developed, including simulation-based tests (Forman et al., 1995; Ledberg et al., 1998; Poline and Mazoyer, 1993; Roland et al., 1993), random field theory-based (RFT) tests (Cao and Worsley, 2001; Worsley et al.”
BackgroundMethodInfluentialAnterior cingulate cortex, conflict monitoring, and levels of processing
van Veen, V., Cohen, J. D., Botvinick, M. M., Stenger, V. A., & Carter, C. S. (2001) · NeuroImage · doi:10.1006/nimg.2001.0923 · Cited by 656
Self-citationMcRae, K., Gross, J. J., Weber, J., Robertson, E. R., Sokol-Hessner, P., Ray, R. D., Gabrieli, J. D. E., & Ochsner, K. N. (2012) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsr093 · Cited by 655
“For these contrasts, we utilized height and cluster size thresholding after establishing FWE thresholds using the alphasim procedure (Forman et al., 1995) at a significance level of P < 0.”
MethodInfluentialRelation of Prefrontal Cortex Dysfunction to Working Memory and Symptoms in Schizophrenia
Perlstein, W. M., Carter, C. S., Noll, D. C., & Cohen, J. D. (2001) · American Journal of Psychiatry · doi:10.1176/appi.ajp.158.7.1105 · Cited by 645
“These results complement previous findings of dorsolateral prefrontal cortex dysfunction using the n-back task (4, 31, 41).”
MethodResultSelf-citationThe Neural Bases of Distraction and Reappraisal
McRae, K., Hughes, B., Chopra, S., Gabrieli, J. D. E., Gross, J. J., & Ochsner, K. N. (2010) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21243 · Cited by 642
“AlphaSim takes into account the voxelwise and the cluster–volume thresholds to establish a clusterwise p value that protects against false-positive detection of activation clusters (Forman et al., 1995).”
Astafiev, S. V., Shulman, G. L., Stanley, C. M., Snyder, A. Z., Van Essen, D. C., & Corbetta, M. (2003) · The Journal of Neuroscience · doi:10.1523/jneurosci.23-11-04689.2003 · Cited by 640
“Statistical images were corrected for multiple comparisons over the entire brain ( p Ͻ 0.05), using a magnitude threshold derived from Monte-Carlo simulations that takes into account the number of contiguous activated voxels (Forman et al., 1995).”
MethodInfluentialShmuel, A., Yacoub, E., Pfeuffer, J., Van de Moortele, P.-F., Adriany, G., Hu, X., & Ugurbil, K. (2002) · Neuron · doi:10.1016/s0896-6273(02)01061-9 · Cited by 631
“Each scan started with a control period (30 s), cording to the cluster size threshold (Forman et al., 1995).typically followed by eight epochs of 16 s stimulus on and 21 s The procedure described above was applied in most parts of thestimulus off.”
MethodFunctional magnetic resonance imaging of symptom provocation in obsessive-compulsive disorder
Breiter, H. C. (1996) · Archives of General Psychiatry · doi:10.1001/archpsyc.1996.01830070041008 · Cited by 626
Differential patterns of striatal activation in young children with and without ADHD
Durston, S., Tottenham, N. T., Thomas, K. M., Davidson, M. C., Eigsti, I.-M., Yang, Y., Ulug, A. M., & Casey, B. J. (2003) · Biological Psychiatry · doi:10.1016/s0006-3223(02)01904-2 · Cited by 619
“In each analysis, regions of three or more contiguous voxels (p Ͻ .05 for each voxel in the cluster) were identified (Forman et al 1995).”
Selective Deficits in Prefrontal Cortex Function in Medication-Naive Patients With Schizophrenia
Barch, D. M., Carter, C. S., Braver, T. S., Sabb, F. W., MacDonald, A., Noll, D. C., & Cohen, J. D. (2001) · Archives of General Psychiatry · doi:10.1001/archpsyc.58.3.280 · Cited by 614
“Right temporal cortex 22 61 ˛39 16 9.32 2492 6 (50) 8 (57) Right temporal cortex 39 38 ˛74 18 7.20 645 5 ( 42 ) 4 (29)”
InfluentialSelf-citationIncreased Amygdala Activation to Angry and Contemptuous Faces in Generalized Social Phobia
Stein, M. B., Goldin, P. R., Sareen, J., Zorrilla, L. T. E., & Brown, G. G. (2002) · Archives of General Psychiatry · doi:10.1001/archpsyc.59.11.1027 · Cited by 592
“05.(55) This included a voxel-wise threshold of P<.”
Dissociating working memory from task difficulty in human prefrontal cortex
Barch, D. M., Braver, T. S., Nystrom, L. E., Forman, S. D., Noll, D. C., & Cohen, J. D. (1997) · Neuropsychologia · doi:10.1016/s0028-3932(97)00072-9 · Cited by 590
“clustersize algorithm [17].”
Self-citationEarly ‘visual’ cortex activation correlates with superior verbal memory performance in the blind
Amedi, A., Raz, N., Pianka, P., Malach, R., & Zohary, E. (2003) · Nature Neuroscience · doi:10.1038/nn1072 · Cited by 592
Fair, D. A., Schlaggar, B. L., Cohen, A. L., Miezin, F. M., Dosenbach, N. U. F., Wenger, K. K., Fox, M. D., Snyder, A. Z., Raichle, M. E., & Petersen, S. E. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2006.11.051 · Cited by 587
“A voxelwise correction based on Monte Carlo simulation was implemented to guard against false positives resulting from conducting a large number of statistical comparisons over many images (Forman et al., 1995).”
MethodAmygdala Response to Fearful Faces in Anxious and Depressed Children
Thomas, K. M. (2001) · Archives of General Psychiatry · doi:10.1001/archpsyc.58.11.1057 · Cited by 582
Modulation of Caudate Activity by Action Contingency
Tricomi, E. M., Delgado, M. R., & Fiez, J. A. (2004) · Neuron · doi:10.1016/s0896-6273(03)00848-1 · Cited by 574
“serves as a precaution against type 1 errors (Forman et al., 1995).”
BackgroundRisk-taking and the adolescent brain: Who is at risk?
Galvan, A., Hare, T., Voss, H., Glover, G., & Casey, B. J. (2007) · Developmental Science · doi:10.1111/j.1467-7687.2006.00579.x · Cited by 568
Depression, rumination and the default network
Berman, M. G., Peltier, S., Nee, D. E., Kross, E., Deldin, P. J., & Jonides, J. (2011) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsq080 · Cited by 568
“Results were thresholded at P 0.001 (uncorrected) at the voxel-level and corrected by using a cluster-size threshold of 26 voxels to produce a P 0.05 (corrected) threshold (Forman et al., 1995).”
BackgroundMethodInfluentialFine Modulation in Network Activation during Motor Execution and Motor Imagery
Solodkin, A., Hlustik, P., Chen, E. E., & Small, S. L. (2004) · Cerebral Cortex · doi:10.1093/cercor/bhh086 · Cited by 562
“A Monte Carlo simulation was performed to establish the appropriate correlation coefficient to achieve a whole brain alpha 0.05 (Forman et al., 1995).”
MethodInfluentialKincade, J. M., Abrams, R. A., Astafiev, S. V., Shulman, G. L., & Corbetta, M. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.0236-05.2005 · Cited by 561
“05), using a magnitude threshold derived from Monte Carlo simulations that takes into account the number of contiguous activated voxels (Forman et al., 1995).”
Altered brain response to verbal learning following sleep deprivation
Drummond, S. P. A., Brown, G. G., Gillin, J. C., Stricker, J. L., Wong, E. C., & Buxton, R. B. (2000) · Nature · doi:10.1038/35001068 · Cited by 557
“Significant activation was determined using a cluster threshold method to protect against type I error”
MethodCorrelation between motor improvements and altered fMRI activity after rehabilitative therapy
Johansen‐Berg, H., Dawes, H., Guy, C., Smith, S. M., Wade, D. T., & Matthews, P. M. (2002) · Brain · doi:10.1093/brain/awf282 · Cited by 558
“…gave a `recovery-weighted' Z score image for the group which was thresholded at Z > 3.1 and signi®cant clusters de®ned according to extent (at P < 0.005; corrected for multiple spatial comparisons according to random ®eld theory) (Worsley et al., 1992; Friston et al., 1994; Forman et al., 1995).”
MethodInfluentialThe role of prefrontal cortex and posterior parietal cortex in task switching
Sohn, M.-H., Ursu, S., Anderson, J. R., Stenger, V. A., & Carter, C. S. (2000) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.240460497 · Cited by 552
Remembering familiar people: the posterior cingulate cortex and autobiographical memory retrieval
Maddock, R. J., Garrett, A. S., & Buonocore, M. H. (2001) · Neuroscience · doi:10.1016/s0306-4522(01)00108-7 · Cited by 551
“Signi¢cant activation was de¢ned as a minimum of two contiguous suprathreshold pixels with a cluster-wise P 9 0.001 (assuming spatial autocorrelation equivalent to a Gaussian ¢lter of width 9 0.6 pixels) (Forman et al., 1995).”
MethodInfluentialWhat Does the Brain Tell Us About Trust and Distrust? Evidence from a Functional Neuroimaging Study
Dimoka, A. (2010) · MIS Quarterly · doi:10.2307/20721433 · Cited by 550
Neural pathways link social support to attenuated neuroendocrine stress responses
Eisenberger, N. I., Taylor, S. E., Gable, S. L., Hilmert, C. J., & Lieberman, M. D. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.01.038 · Cited by 543
“005 combined with a cluster size threshold of 10 voxels (Forman et al., 1995), a threshold that we have used regularly in previous investigations (Eisenberger et al.”
MethodInfluentialPhan, K. L., Fitzgerald, D. A., Nathan, P. J., & Tancer, M. E. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.08.012 · Cited by 539
Prefrontal cortical regulation of brainwide circuit dynamics and reward-related behavior
Ferenczi, E. A., Zalocusky, K. A., Liston, C., Grosenick, L., Warden, M. R., Amatya, D., Katovich, K., Mehta, H., Patenaude, B., Ramakrishnan, C., et al. (2016) · Science · doi:10.1126/science.aac9698 · Cited by 535
Shulman, G. L., Pope, D. L. W., Astafiev, S. V., McAvoy, M. P., Snyder, A. Z., & Corbetta, M. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.4085-09.2010 · Cited by 534
“for multiple comparisons using joint z-score/cluster size thresholds (Forman et al., 1995) corresponding to z 3.”
MethodInfluentialPeterson, B. S., Skudlarski, P., Gatenby, J. C., Zhang, H., Anderson, A. W., & Gore, J. C. (1999) · Biological Psychiatry · doi:10.1016/s0006-3223(99)00056-6 · Cited by 530
“Fortunately, our use of cluster filtering should have substantially reduced the rate of false positives in our post hoc significance testing ( Forman et al 1995 ).”
Masten, C. L., Eisenberger, N. I., Borofsky, L. A., Pfeifer, J. H., McNealy, K., Mazziotta, J. C., & Dapretto, M. (2009) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsp007 · Cited by 529
“…were initially thresholded at P 0.005 for magnitude (uncorrected for multiple comparisons), with a minimum cluster size threshold of 10 voxels (Forman et al., 1995), in order to examine all regions which have been found to be associated with social and emotional processing (e.g. prefrontal…”
BackgroundMethodInfluentialActivation of the visual cortex in motivated attention
Bradley, M. M., Sabatinelli, D., Lang, P. J., Fitzsimmons, J. R., King, W., & Desai, P. (2003) · Behavioral Neuroscience · doi:10.1037/0735-7044.117.2.369 · Cited by 528
“00001 , Forman et al .”
Turk-Browne, N. B., Scholl, B. J., Chun, M. M., & Johnson, M. K. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21131 · Cited by 523
“Using the cluster-size threshold plug-in for BrainVoyager, which takes into account spatial smoothness (based on Forman et al., 1995), 10,000 Monte Carlo simulations revealed that the true corrected alpha associated with this significance level and cluster threshold is p .001.”
Minding one’s emotions: Mindfulness training alters the neural expression of sadness.
Farb, N. A. S., Anderson, A. K., Mayberg, H., Bean, J., McKeon, D., & Segal, Z. V. (2010) · Emotion · doi:10.1037/a0017151 · Cited by 521
“05 (Forman et al., 1995).”
Fales, C. L., Barch, D. M., Rundle, M. M., Mintun, M. A., Snyder, A. Z., Cohen, J. D., Mathews, J., & Sheline, Y. I. (2008) · Biological Psychiatry · doi:10.1016/j.biopsych.2007.06.012 · Cited by 517
Self-citationNeural Representation of Subjective Value Under Risk and Ambiguity
Levy, I., Snell, J., Nelson, A. J., Rustichini, A., & Glimcher, P. W. (2010) · Journal of Neurophysiology · doi:10.1152/jn.00853.2009 · Cited by 505
“Calculation of significance values in the activation maps was based on the individual voxel significance and on the minimum cluster size (Forman et al. 1995 ).”
Metadata
- Authors
- Forman, S. D., Cohen, J. D., Fitzgerald, M., Eddy, W. F., Mintun, M. A., & Noll, D. C.
- Affiliations
- University of Pittsburgh (US)
- Corresponding author
- Forman, Steven D.
- Venue
- Magnetic Resonance in Medicine
- Publisher
- Wiley
- Published
- 1995-05
- Volume
- 33
- Issue
- 5
- Pages
- 636-647
- ISSN
- 0740-3194 (ISSN-L)
- 1522-2594
- OpenAlex
- W2044634376
- Cited by
- 3,202
- References
- 11
- Citations by year
- 2026: 27 · 2025: 26 · 2024: 30 · 2023: 36 · 2022: 45 · 2021: 55 · 2020: 64 · 2019: 75 · 2018: 96 · 2017: 137 · 2016: 140 · 2015: 188 · 2014: 203 · 2013: 213 · 2012: 242
- FWCI
- 14.83
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Magnetic Resonance in Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Functional Brain Connectivity Studies
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Advanced MRI Techniques and Applications
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Advanced Neuroimaging Techniques and Applications
- Keywords
- multiple comparisons, false positives, statistical power, fMRI activation detection, Monte Carlo simulation, cluster size distribution
- MeSH terms
- Brain, Data Interpretation, Statistical, False Positive Reactions, Humans, Magnetic Resonance Imaging, Monte Carlo Method, Probability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.