Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): use of a cluster-size threshold
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
The typical functional magnetic resonance (fMRI) study presents a formidable problem of multiple statistical comparisons (i.e., > 10,000 in a 128 x 128 image). To protect against false positives, investigators have typically relied on decreasing the per pixel false positive probability. This approach incurs an inevitable loss of power to detect statistically significant activity. An alternative approach, which relies on the assumption that areas of true neural activity will tend to stimulate signal changes over contiguous pixels, is presented. If one knows the probability distribution of such cluster sizes as a function of per pixel false positive probability, one can use cluster-size thresholds independently to reject false positives. Both Monte Carlo simulations and fMRI studies of human subjects have been used to verify that this approach can improve statistical power by as much as fivefold over techniques that rely solely on adjusting per pixel false positive probabilities.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For all analyses, we determined cluster-size thresholds using Monte Carlo simulations in AFNI’s 3DClustSim (http://afni.nimh.nih.gov/afni/) which allowed for improved assessment of functional activation and correction for multiple comparisons (Forman et al., 1995) based on a grey matter mask.”
From Self-referential processing during observation of a speech performance task in social anxiety disorder from pre- to post-treatment: Evidence of disrupted neural activation (2019) · cites this paper as Forman et al., 1995
In the citing paper
“Two criteria were employed in evaluating activations: (i) only regions with peak voxels of P < 0.001 were considered; (ii) only clusters of activation including k !6 voxels in which all voxels met an uncorrected threshold of P < 0.005 were considered, yielding a functional threshold equivalent of P < 0.001 according to cluster size significance level corrections (Forman et al., 1995).”
From Attending to the present: mindfulness meditation reveals distinct neural modes of self-reference (2007) · cites this paper as Forman et al., 1995
In the citing paper
“Cluster thresholding was applied to increase power in identifying heavily recruited neural areas while maintaining a reasonably low Type-I error rate (Forman et al., 1995).”
From Attending to the present: mindfulness meditation reveals distinct neural modes of self-reference (2007) · cites this paper as Forman et al., 1995
In the citing paper
“For all FC analyses, a double statistical threshold (voxel-wise p < 0.01 and cluster size ≥ 78 voxels, as determined by AlphaSim with 10,000 Monte Carlo simulations) was used to obtain an alpha < 0.05 (corrected for multiple comparisons) (see details on the procedure at http://afni.nimh.nih.gov/afni/doc/manual/AlphaSim and in [30]).”
From Structural and Functional Cerebral Correlates of Hypnotic Suggestibility (2014) · cites this paper as [30]
In the citing paper
“The resulting maps from all participants in the HFA group and all participants in the control group were averaged and these group-averaged t-maps were displayed on group composite anatomical images with a statistical threshold of p < .001, adjusted for multiple comparisons with a cluster-filter of 10 contiguous pixels (42).”
From The Neural Circuitry Mediating Shifts in Behavioral Response and Cognitive Set in Autism (2008) · cites this paper as [42]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Self-citationNumerical recipes in C: the art of scientific computing
(1993) · Choice Reviews Online · doi:10.5860/choice.30-5638 · Cited by 17,933
A three-dimensional statistical analysis for CBF activation studies in human brain
Worsley, K. J., Evans, A. C., Marrett, S., & Neelin, P. (1992) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1992.127 · Cited by 2,036
Assessing the significance of focal activations using their spatial extent
Friston, K. J., Worsley, K. J., Frackowiak, R. S. J., Mazziotta, J. C., & Evans, A. C. (1994) · Human Brain Mapping · doi:10.1002/hbm.460010306 · Cited by 1,907
Comparing Functional (PET) Images: The Assessment of Significant Change
Friston, K. J., Frith, C. D., Liddle, P. F., & Frackowiak, R. S. J. (1991) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1991.122 · Cited by 1,625
MRI-PET Registration with Automated Algorithm
Woods, R. P., Mazziotta, J. C., & R. Cherry, A. S. (1993) · Journal of Computer Assisted Tomography · doi:10.1097/00004728-199307000-00004 · Cited by 1,617
The Relationship between Global and Local Changes in PET Scans
Friston, K. J., Frith, C. D., Liddle, P. F., Dolan, R. J., Lammertsma, A. A., & Frackowiak, R. S. J. (1990) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1990.88 · Cited by 858
Activation of the prefrontal cortex in a nonspatial working memory task with functional MRI
Cohen, J. D., Forman, S. D., Braver, T. S., Casey, B. J., Servan‐Schreiber, D., & Noll, D. C. (1994) · Human Brain Mapping · doi:10.1002/hbm.460010407 · Cited by 576
Self-citationSpiral K‐space MR imaging of cortical activation
Noll, D. C., Cohen, J. D., Meyer, C. H., & Schneider, W. (1995) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.1880050112 · Cited by 254
Self-citationPoline, J.-B., & Mazoyer, B. M. (1993) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1993.57 · Cited by 155
Cited by
Items 601–700 of 1,095
Long-term consequences of childhood maltreatment: altered amygdala functional connectivity
Jedd, K., Hunt, R. H., Cicchetti, D., Hunt, E., Cowell, R. A., Rogosch, F. A., Toth, S. L., & Thomas, K. M. (2015) · Development and Psychopathology · doi:10.1017/s0954579415000954 · Cited by 149
“Group differences were tested at a voxel-wise significance threshold of Z ¼ 2.575 ( p , .005) with a cluster threshold of 10 contiguous raw voxels (552 mm3; Forman et al., 1995; Lieberman & Cunningham, 2009).”
BackgroundMethodInfluentialJohnson, M. K., Raye, C. L., Mitchell, K., Greene, E. J., Cunningham, W. A., & Sanislow, C. A. (2005) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/cabn.5.3.339 · Cited by 169
“001 (Forman et al., 1995).”
V1 Activation in Congenitally Blind Humans is Associated with Episodic Retrieval
Raz, N., Amedi, A., & Zohary, E. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhi026 · Cited by 149
“Significance levels were calculated taking into account the probability of a false detection for any given cluster (Forman et al., 1995) by a Monte Carlo simulation (AlphaSim, by B. Douglas Ward and R.W. Cox, 1996) using the combination of individual voxel probability threshold and a minimum…”
MethodBanca, P., Voon, V., Vestergaard, M. D., Philipiak, G., Almeida, I., Pocinho, F., Relvas, J., & Castelo-Branco, M. (2015) · Brain · doi:10.1093/brain/awu379 · Cited by 148
Dunn, J. P., Kessler, R. M., Feurer, I. D., Volkow, N. D., Patterson, B. W., Ansari, M. S., Li, R., Marks-Shulman, P., & Abumrad, N. N. (2012) · Diabetes Care · doi:10.2337/dc11-2250 · Cited by 148
“(20) were used to assess the significance of clusters of significant correlations.”
MethodEffect of Cognitive-Behavioral Therapy on Neural Correlates of Fear Conditioning in Panic Disorder
Kircher, T. T. J., Arolt, V., Jansen, A., Pyka, M., Reinhardt, I., Kellermann, T., Konrad, C., Lueken, U., Gloster, A. T., Gerlach, A. L., et al. (2012) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.07.026 · Cited by 167
Crosson, B., Sadek, J. R., Maron, L., Gökçay, D., Mohr, C. M., Auerbach, E. J., Freeman, A. J., Leonard, C. M., & Briggs, R. W. (2001) · Journal of Cognitive Neuroscience · doi:10.1162/089892901564225 · Cited by 148
“Similar to recommendations by Forman et al. (1995) , we used both a statistical probability threshold applied on a voxel by voxel basis and a clustersize threshold of contiguous voxels to identify regions of significant activity.”
Effects of Direct Social Experience on Trust Decisions and Neural Reward Circuitry
Fareri, D. S., Chang, L. J., & Delgado, M. R. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00148 · Cited by 147
“This method of correction (Forman et al., 1995; Goebel et al., 2006) runs a series of Monte Carlo simulations across the whole brain to assess the probability that observed significant clusters of activity are not false positives, leading to a corrected threshold of p < 0.05.”
MethodInfluentialSchweinsburg, A. D., McQueeny, T., Nagel, B. J., Eyler, L. T., & Tapert, S. F. (2010) · Alcohol · doi:10.1016/j.alcohol.2009.09.032 · Cited by 147
“To control for Type I error, we used a Monte Carlo simulation to determine the minimum cluster volume and statistical threshold of significant clusters (Forman et al., 1995).”
MethodMosconi, M. W., Mack, P. B., McCarthy, G., & Pelphrey, K. A. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.03.027 · Cited by 170
Category Learning Increases Discriminability of Relevant Object Dimensions in Visual Cortex
Folstein, J. R., Palmeri, T. J., & Gauthier, I. (2013) · Cerebral Cortex · doi:10.1093/cercor/bhs067 · Cited by 146
“01 was initially used to correct for multiple comparisons with Brain Voyager’s Cluster Threshold Estimator (Forman et al. 1995; Goebel et al. 2006), which uses a bootstrapping procedure to calculate the minimum cluster size that yields a corrected threshold of P < 0.”
MethodInfluentialEisenberger, N. I., Gable, S. L., & Lieberman, M. D. (2007) · Emotion · doi:10.1037/1528-3542.7.4.745 · Cited by 147
“All analyses were thresholded using an uncorrected p value of .005 combined with a cluster size threshold of 10 voxels (Forman et al., 1995).”
BackgroundMethodTwo Attentional Processes in the Parietal Lobe
Shulman, G. L. (2002) · Cerebral Cortex · doi:10.1093/cercor/12.11.1124 · Cited by 146
Oei, N. Y. L., Elzinga, B. M., Wolf, O. T., de Ruiter, M. B., Damoiseaux, J. S., Kuijer, J. P. A., Veltman, D. J., Scheltens, P., & Rombouts, S. A. R. B. (2007) · Brain Imaging and Behavior · doi:10.1007/s11682-007-9003-2 · Cited by 146
“Z (Gaussianised T/F) statistic images were thresholded at p<0.05 (cluster corrected) and z>3.1 (Forman et al. 1995; Friston et al. 1994; Worsley et al. 1992).”
BackgroundInfluentialBerkman, E. T., Burklund, L., & Lieberman, M. D. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.04.084 · Cited by 146
“An uncorrected p-value of 0.001 combined with a cluster size threshold of 10 voxels to control for multiple comparisons was used (Forman et al., 1995).”
MethodInfluentialChurch, J. A., Coalson, R. S., Lugar, H. M., Petersen, S. E., & Schlaggar, B. L. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhm228 · Cited by 146
“For all voxel-wise analyses, a correction based on a Monte Carlo simulation was implemented to guard against false positives that may result from conducting a large number of statistical comparisons over many images (Forman et al. 1995; McAvoy et al. 2001).”
MethodTamnes, C. K., Walhovd, K. B., Grydeland, H., Holland, D., Østby, Y., Dale, A. M., & Fjell, A. M. (2013) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00434 · Cited by 146
“Cluster size limits were estimated with synthesized Z Monte Carlo simulations (Forman et al., 1995) using a method based on AFNIʼs AlphaSim (Ward, 2000), with 10.”
MethodInfluentialImagined rotations of self versus objects: an fMRI study
Wraga, M., Shephard, J. M., Church, J. A., Inati, S., & Kosslyn, S. M. (2005) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2004.11.028 · Cited by 183
“0013 false positive rate for each statistical parametric map ( Forman et al., 1995).”
InfluentialNeural mechanisms of proactive interference-resolution
Nee, D. E., Jonides, J., & Berman, M. G. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.07.066 · Cited by 164
“001 uncorrected and restricted to regions demonstrating 5 contiguous supra-threshold voxels (Forman et al., 1995; Poline et al., 1997).”
Neural pathways in tactile object recognition
Deibert, E., Kraut, M., Kremen, S., & Hart, J. (1999) · Neurology · doi:10.1212/wnl.52.7.1413 · Cited by 146
Was it me or was it you? How the sense of agency originates from ideomotor learning revealed by fMRI
Spengler, S., von Cramon, D. Y., & Brass, M. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.01.047 · Cited by 145
Neural Correlates of Concreteness in Semantic Categorization
Pexman, P. M., Hargreaves, I. S., Edwards, J. D., Henry, L. C., & Goodyear, B. G. (2007) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2007.19.8.1407 · Cited by 145
“Z (Gaussianized T/F) statistic images were thresholded at p = .05 with a cluster size of at least 12 contiguous voxels, resulting in a corrected p value of .01 (Forman et al., 1995).”
Couto, B., Manes, F., Montañés, P., Matallana, D., Reyes, P., Velasquez, M., Yoris, A., Baez, S., & Ibáñez, A. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00467 · Cited by 144
“Following previous reports, statistical threshold was set at the p 0.05 voxel level, besides small-volume corrected (Grossman et al., 2004) and cluster size corrected (Forman et al., 1995).”
MethodInfluentialDrabant, E. M., Kuo, J. R., Ramel, W., Blechert, J., Edge, M. D., Cooper, J. R., Goldin, P. R., Hariri, A. R., & Gross, J. J. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.11.040 · Cited by 145
“To correct for multiple comparisons, AlphaSim, a Monte Carlo simulation bootstrapping program in the AFNI library (Cox, 1996), was employed to identify a joint probability consisting of a voxel-wise threshold and a minimum cluster volume threshold to establish a cluster-wise p-value that protects against false-positiv…”
Gaffrey, M. S., Kleinhans, N. M., Haist, F., Akshoomoff, N. A., Campbell, A., Courchesne, E., & Müller, R.-A. (2007) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2007.01.008 · Cited by 175
“To adjust for multiple comparisons, cluster significance was determined by Monte Carlo alpha simulations (Forman et al., 1995) for a corrected significance threshold of p .01 (within-group comparisons) and of p .05 (between-group comparisons).”
MethodKirwan, C. B., Wixted, J. T., & Squire, L. R. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.3456-08.2008 · Cited by 144
“…comparisons, and Monte Carlo simulations were used to determine how large a cluster of voxels was needed to be statistically meaningful ( p 0.05) (Forman et al., 1995; Xiong et al., 1995) within the volume of the MTL (minimum cluster extent of 33 contiguous voxels) and for the entire brain…”
BackgroundMethodInfluentialDelayed rather than decreased BOLD response as a marker for early Alzheimer's disease
Rombouts, S. A. R. B., Goekoop, R., Stam, C. J., Barkhof, F., & Scheltens, P. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.03.022 · Cited by 171
Wirth, M., Jann, K., Dierks, T., Federspiel, A., Wiest, R., & Horn, H. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.10.039 · Cited by 159
“001) using a cluster size extend threshold (BrainVoyager QX Plugin using Monte Carlo Simulations and based on the work of Forman et al., 1995) with the application of a Talairach mask.”
MethodAshkenazi, S., Rosenberg-Lee, M., Tenison, C., & Menon, V. (2012) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2011.09.006 · Cited by 143
Instructed smoking expectancy modulates cue‐elicited neural activity: A preliminary study
Wilson, S., Sayette, M., Delgado, M., & Fiez, J. (2005) · Nicotine & Tobacco Research · doi:10.1080/14622200500185520 · Cited by 143
“Main effect regions of activation comprising fewer than five contiguous voxels were not considered significant, to reduce the risk of false positives (Forman et al., 1995).”
BackgroundPaulus, M. P., Hozack, N., Frank, L. R., & Brown, G. G. (2002) · NeuroImage · doi:10.1006/nimg.2001.1031 · Cited by 153
“Seventh, a threshold adjustment method based on Monte Carlo simulations was used to guard against identifying false-positive areas of activation (Forman et al., 1995).”
MethodAn FMRI study of self-regulatory control and conflict resolution in adolescents with bulimia nervosa
Marsh, R., Horga, G., Wang, Z., Wang, P., Klahr, K. W., Berner, L. A., Walsh, B. T., & Peterson, B. S. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2011.11010094 · Cited by 142
The change of the brain activation patterns as children learn algebra equation solving
Qin, Y., Carter, C. S., Silk, E. M., Stenger, V. A., Fissell, K., Goode, A., & Anderson, J. R. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0401227101 · Cited by 142
Comte, M., Schön, D., Coull, J. T., Reynaud, E., Khalfa, S., Belzeaux, R., Ibrahim, E. C., Guedj, E., Blin, O., Weinberger, D. R., et al. (2016) · Cerebral Cortex · doi:10.1093/cercor/bhu185 · Cited by 142
Strakowski, S. M., Eliassen, J. C., Lamy, M., Cerullo, M. A., Allendorfer, J. B., Madore, M. R., Lee, J. H., Welge, J. A., DelBello, M. P., Fleck, D. E., et al. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.09.019 · Cited by 156
Dynamic modulation of intrinsic functional connectivity by transcranial direct current stimulation
Sehm, B., Schäfer, A., Kipping, J., Margulies, D., Conde, V., Taubert, M., Villringer, A., & Ragert, P. (2012) · Journal of Neurophysiology · doi:10.1152/jn.00606.2012 · Cited by 141
Dissociable brain mechanisms for processing social exclusion and rule violation
Bolling, D. Z., Pitskel, N. B., Deen, B., Crowley, M. J., McPartland, J. C., Mayes, L. C., & Pelphrey, K. A. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.10.049 · Cited by 142
“To correct for multiple comparisons, we used a cluster threshold of 35 contiguous voxels (Forman et al., 1995; Xiong et al., 1995).”
Spatial Bayesian Variable Selection With Application to Functional Magnetic Resonance Imaging
Smith, M. S., & Fahrmeir, L. (2007) · Journal of the American Statistical Association · doi:10.1198/016214506000001031 · Cited by 160
“In comparison, using the Ising prior cleans up many of these weak single-voxel activations and encourages formation of clusters, both of which are known features of activation maps in fMRI from very-high-quality acquisitions (Forman et al. 1995).”
MethodKaplan, J., Freedman, J., & Iacoboni, M. (2006) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2006.04.024 · Cited by 176
Improved image registration by using fourier interpolation
Eddyy, W. F., Fitzgerald, M., & Noll, D. C. (1996) · Magnetic Resonance in Medicine · doi:10.1002/mrm.1910360615 · Cited by 142
“17 for example), a registration procedure that induces low correlations is highly preferable.”
BackgroundSelf-citationAmygdala hyperactivation in untreated depressed individuals
Peluso, M. A. M., Glahn, D. C., Matsuo, K., Monkul, E. S., Najt, P., Zamarripa, F., Li, J., Lancaster, J. L., Fox, P. T., Gao, J.-H., et al. (2009) · Psychiatry Research: Neuroimaging · doi:10.1016/j.pscychresns.2009.03.006 · Cited by 141
“3 and a corrected cluster significance threshold of P=0.01 (Forman et al., 1995).”
InfluentialPaulus, M. P., Feinstein, J. S., Leland, D., & Simmons, A. N. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.12.055 · Cited by 141
“A threshold adjustment method based on Monte–Carlo simulations (Forman et al., 1995) was used, which determined that a voxel-wise a priori probability of one-sided P b 0.”
MethodInfluentialNeural systems underlying aversive conditioning in humans with primary and secondary reinforcers
Delgado, M. R., Jou, R. L., & Phelps, E. A. (2011) · Frontiers in Neuroscience · doi:10.3389/fnins.2011.00071 · Cited by 141
“This map was thresholded at p < 0.005 and used a cluster threshold with an extent of eight, suggesting that only clusters which are associated with a cluster level false positive rate of α = 0.05 are sufficient to remain in the analysis (Forman et al., 1995; Goebel et al., 2006).”
MethodInfluentialEmotion Speeds up Conflict Resolution: A New Role for the Ventral Anterior Cingulate Cortex?
Kanske, P., & Kotz, S. A. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhq157 · Cited by 141
“The advantages of combining a voxel-based threshold with a minimum cluster size have been described elsewhere (Forman et al. 1995).”
BackgroundAnticorrelated resting-state functional connectivity in awake rat brain
Liang, Z., King, J., & Zhang, N. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.08.009 · Cited by 138
“001) (Forman et al., 1995).”
MethodFunctional MRI statistical software packages: A comparative analysis
Gold, S., Christian, B., Arndt, S., Zeien, G., Cizadlo, T., Johnson, D. L., Flaum, M., & Andreasen, N. C. (1998) · Human Brain Mapping · doi:10.1002/(sici)1097-0193(1998)6:2<73::aid-hbm1>3.0.co;2-h · Cited by 139
“FIASCO determines the significance threshold based on cluster size [Forman et al., 1995].”
BackgroundMethodCardiorespiratory fitness: A predictor of cortical plasticity in multiple sclerosis
Prakash, R. S., Snook, E. M., Erickson, K. I., Colcombe, S. J., Voss, M. W., Motl, R. W., & Kramer, A. F. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.10.003 · Cited by 163
“The resulting statistical maps were thresholded using voxels with a z>4.1 and a (corrected) cluster significance threshold of p<0.01 (Worsley et al., 1992; Friston et al., 1994; Forman et al., 1995).”
MethodInfluentialObserving complex action sequences: The role of the fronto-parietal mirror neuron system
Molnar-Szakacs, I., Kaplan, J., Greenfield, P. M., & Iacoboni, M. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.07.035 · Cited by 155
“Z (Gaussianized T/F) statistic images were thresholded using clusters determined by Z > 2.3 and a (corrected) cluster significance threshold of P= 0.05 (Worsley et al., 1992; Friston et al., 1994; Forman et al., 1995).”
InfluentialPrefrontal Dynamics Underlying Rapid Instructed Task Learning Reverse with Practice
Cole, M. W., Bagic, A., Kass, R., & Schneider, W. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.1662-10.2010 · Cited by 139
fMRI Activation in the Human Frontal Eye Field Is Correlated With Saccadic Reaction Time
Connolly, J. D., Goodale, M. A., Goltz, H. C., & Munoz, D. P. (2005) · Journal of Neurophysiology · doi:10.1152/jn.00830.2004 · Cited by 139
“00, cluster of Ն10 mm 3 of activation) (Forman et al. 1995).”
BackgroundMannell, M. V., Franco, A. R., Calhoun, V. D., Cañive, J. M., Thoma, R. J., & Mayer, A. R. (2010) · Human Brain Mapping · doi:10.1002/hbm.20876 · Cited by 139
“For all group comparisons, the resulting statistical parametric maps were corrected at P 0.05 by applying a parametric threshold of P 0.005 in conjunction with a minimal cluster size of 0.480 mL [Forman et al., 1995].”
MethodInfluentialBrain Signal Variability Differentially Affects Cognitive Flexibility and Cognitive Stability
Armbruster-Genç, D. J. N., Ueltzhöffer, K., & Fiebach, C. J. (2016) · The Journal of Neuroscience · doi:10.1523/jneurosci.2517-14.2016 · Cited by 126
“005 (uncorrected) was combined with a non-arbitrary cluster-extent threshold (Forman et al., 1995).”
MethodInfluentialWolf, R. C., Vasic, N., Schonfeldt-Lecuona, C., Landwehrmeyer, G. B., & Ecker, D. (2007) · Brain · doi:10.1093/brain/awm210 · Cited by 138
“005, uncorrected at the voxel level with a spatial contiguity criterion of 25 voxels (Forman et al., 1995), was chosen for the main effect of group and all group-by-load interactions.”
fMRI activation during a language task in adolescents with ASD
KNAUS, T. A., SILVER, A. M., LINDGREN, K. A., HADJIKHANI, N., & TAGER-FLUSBERG, H. (2008) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617708081216 · Cited by 137
Freeman, J. B., Rule, N. O., Adams, R. B., & Ambady, N. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.04.038 · Cited by 154
“The minimum cluster size needed to maintain the false positive detection rate was empirically determined by aMonte Carlo simulation, accounting for spatial correlations in BOLD signal changes of neighboring voxels (Forman et al., 1995).”
Cognitive humor processing: Different logical mechanisms in nonverbal cartoons—an fMRI study
Samson, A. C., Zysset, S., & Huber, O. (2008) · Social Neuroscience · doi:10.1080/17470910701745858 · Cited by 137
“INC (Braver & Bongiolatti, 2002; Forman et al., 1995).”
Eye Position Signal Modulates a Human Parietal Pointing Region during Memory-Guided Movements
DeSouza, J. F. X., Dukelow, S. P., Gati, J. S., Menon, R. S., Andersen, R. A., & Vilis, T. (2000) · The Journal of Neuroscience · doi:10.1523/jneurosci.20-15-05835.2000 · Cited by 139
“Forman et al. (1995) showed that voxels that pass a cluster-size threshold of greater than three have increased confidence thresholds from a t test value of p , 0.005 to a corrected probability of less than p , 0.00001.”
BackgroundInfluentialHolmes, A. J., MacDonald, A. W., Carter, C. S., Barch, D. M., Stenger, V. A., & Cohen, J. D. (2005) · Schizophrenia Research · doi:10.1016/j.schres.2005.01.021 · Cited by 145
“To correct for multiple comparisons , images were thresholded at a p-value of p b 0.01 with a contiguity criterion of 8 voxels (Barch et al., 2001; Forman et al., 1995).”
BackgroundMethodInfluentialSelf-citationFunctional magnetic resonance imaging of the human brain
Kim, S., & Uǧurbil, K. (1997) · Journal of Neuroscience Methods · doi:10.1016/s0165-0270(97)02252-8 · Cited by 151
“Since activation is expected to be over several contiguous pixels, a minimum cluster size of activated pixels can also be used for a threshold (Forman et al., 1995).”
BackgroundSimon, D., Kaufmann, C., Müsch, K., Kischkel, E., & Kathmann, N. (2010) · Psychophysiology · doi:10.1111/j.1469-8986.2010.00980.x · Cited by 135
Burton, M. W., LoCasto, P. C., Krebs-Noble, D., & Gullapalli, R. P. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.02.024 · Cited by 135
Dissociable networks involved in spatial and temporal order source retrieval
Ekstrom, A. D., Copara, M. S., Isham, E. A., Wang, W.-C., & Yonelinas, A. P. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.02.033 · Cited by 135
“We performed whole brain contrasts constrained with Monte Carlo simulations in alpha-sim (Forman et al., 1995); a corrected pb .”
AN fMRI EXAMINATION OF VISUAL INTEGRATION IN SCHIZOPHRENIA
SILVERSTEIN, S. M., BERTEN, S., ESSEX, B., KOVÁCS, I., SUSMARAS, T., & LITTLE, D. M. (2009) · Journal of Integrative Neuroscience · doi:10.1142/s0219635209002113 · Cited by 136
“The application of an FDR controls the proportion of false positives only among those voxels that exceed the statistical threshold and therefore reduces the likelihood of Type I errors [17].”
BackgroundMethodBrain networks underlying mental imagery of auditory and visual information
Zvyagintsev, M., Clemens, B., Chechko, N., Mathiak, K. A., Sack, A. T., & Mathiak, K. (2013) · European Journal of Neuroscience · doi:10.1111/ejn.12140 · Cited by 138
Hampstead, B. M., Stringer, A. Y., Stilla, R. F., Deshpande, G., Hu, X., Moore, A. B., & Sathian, K. (2011) · Neurorehabilitation and Neural Repair · doi:10.1177/1545968310382424 · Cited by 136
“05, using a 3D extension (implemented in Brain Voyager QX) of the 2D Monte Carlo simulation procedure.(27) (Unless otherwise noted, the Results section only refers to activations surviving such correction for multiple comparisons.”
MethodPlurality and Resemblance in fMRI Data Analysis
Lange, N., Strother, S. C., Anderson, J. R., Nielsen, F. Å., Holmes, A. P., Kolenda, T., Savoy, R. L., & Hansen, L. K. (1999) · NeuroImage · doi:10.1006/nimg.1999.0472 · Cited by 153
Activity in the Fusiform Gyrus Predicts Conscious Perception of Rubin's Vase–Face Illusion
Andrews, T. J., Schluppeck, D., Homfray, D., Matthews, P. M., & Blakemore, C. (2002) · NeuroImage · doi:10.1006/nimg.2002.1243 · Cited by 156
“Z (Gaussianized T) statistic images were thresholded using resel (corrected Bonferroni) thresholding with a corrected significance threshold of P Ͻ 0.05 (Friston et al., 1995; Forman et al., 1995).”
InfluentialShah, S. G., Klumpp, H., Angstadt, M., Nathan, P. J., & Phan, K. L. (2009) · Journal of Psychiatry and Neuroscience · doi:10.1139/jpn.0939 · Cited by 137
“005, with an extent of greater than 10 contiguous voxels to balance between type I and type II errors.(28) Outside the ROIs defined a priori, we set the threshold at p < 0.”
Reward Region Responsivity Predicts Future Weight Gain and Moderating Effects of the TaqIA Allele
Stice, E., Burger, K. S., & Yokum, S. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.3607-14.2015 · Cited by 136
Hypnotic modulation of resting state fMRI default mode and extrinsic network connectivity
Demertzi, A., Soddu, A., Faymonville, M.-É., Bahri, M. A., Gosseries, O., Vanhaudenhuyse, A., Phillips, C. L. M., Maquet, P., Noirhomme, Q., Luxen, A., et al. (2011) · Progress in brain research · doi:10.1016/b978-0-444-53839-0.00020-x · Cited by 158
“This approach to correction for multiple comparisons is based on a 3D extension of the randomization procedure described by Forman and colleagues (Forman et al., 1995).”
MethodCorreia, J., Formisano, E., Valente, G., Hausfeld, L. G., Jansma, B. M., & Bonte, M. L. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.1302-13.2014 · Cited by 160
“Each univariate statistical map was corrected for multiple comparisons by applying a surface-based cluster size threshold with a falsepositive rate ( ) of 1% (Forman et al., 1995; Goebel et al., 2006; Hagler et al., 2006).”
MethodInfluentialStrigo, I. A., Matthews, S. C., Simmons, A. N., Oberndorfer, T., Klabunde, M., Reinhardt, L. E., & Kaye, W. H. (2013) · International Journal of Eating Disorders · doi:10.1002/eat.22045 · Cited by 135
“Monte-Carlo simulations was used to guard against identifying false-positive areas of activation.(55) Based on the”
MethodKessler, R. M., Woodward, N. D., Riccardi, P., Li, R., Ansari, M. S., Anderson, S., Dawant, B., Zald, D., & Meltzer, H. Y. (2009) · Biological Psychiatry · doi:10.1016/j.biopsych.2008.12.029 · Cited by 136
Oops! Resolving social dilemmas in frontotemporal dementia
Eslinger, P. J., Moore, P., Troiani, V., Antani, S., Cross, K., Kwok, S., & Grossman, M. (2006) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.2006.098228 · Cited by 136
The multimodal connectivity of the hippocampal complex in auditory and visual hallucinations
Amad, A., Cachia, A., Gorwood, P. A. P. M., Pins, D., Delmaire, C., Rolland, B., Mondino, M., Thomas, P., & Jardri, R. (2013) · Molecular Psychiatry · doi:10.1038/mp.2012.181 · Cited by 149
Cluster Analysis of Biomedical Image Time-Series
Wismüller, A., Lange, O., Dersch, D. R., Leinsinger, G. L., Hahn, K. M., Pütz, B., & Auer, D. P. (2002) · International Journal of Computer Vision · doi:10.1023/a:1013550313321 · Cited by 163
“For a detailed discussion of this issue, we refer to the relevant literature, e.g. Forman et al. (1995).”
BackgroundVoluntary Selection of Task Sets Revealed by Functional Magnetic Resonance Imaging
Forstmann, B. U., Brass, M., Koch, I., & von Cramon, D. Y. (2006) · Journal of Cognitive Neuroscience · doi:10.1162/089892906775990589 · Cited by 136
“09, uncorrected) and with a volume greater than 180 mm(3) (5 adjacent voxel; Forman et al., 1995).”
BackgroundInfluentialDe Raedt, R., Leyman, L., Baeken, C., Van Schuerbeek, P., Luypaert, R., Vanderhasselt, M.-A., & Dannlowski, U. (2010) · Biological Psychology · doi:10.1016/j.biopsycho.2010.09.015 · Cited by 135
The role of the preSMA and the rostral cingulate zone in internally selected actions
Mueller, V. A., Brass, M., Waszak, F., & Prinz, W. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.06.018 · Cited by 135
“corrected for multiple comparisons using a combination of individual voxel probability thresholding and minimum clustersize thresholding (Forman et al., 1995; Xiong et al., 1995).”
MethodAmphetamine-induced displacement of [18F] fallypride in striatum and extrastriatal regions in humans
Riccardi, P., Li, R., Ansari, M. S., Zald, D., Park, S., Dawant, B., Anderson, S., Doop, M., Woodward, N., Schoenberg, E., et al. (2006) · Neuropsychopharmacology · doi:10.1038/sj.npp.1300916 · Cited by 134
“Correction for multiple withinimage comparisons was made using the method of Forman et al (1995) as implemented in the Alpha-Sim program of the AFNI analysis program.”
MethodStice, E., Yokum, S., Burger, K., Epstein, L., & Smolen, A. (2012) · Journal of Neuroscience · doi:10.1523/jneurosci.1506-12.2012 · Cited by 134
“Cluster level thresholds corrected for multiple comparisons were derived using a Monte Carlo simulation of random noise distribution in the present data using the 3DClustSim module in AFNI (Forman et al., 1995; Cox, 1996).”
MethodSpatially filtering functional magnetic resonance imaging data
Lowe, M. J., & Sorenson, J. A. (1997) · Magnetic Resonance in Medicine · doi:10.1002/mrm.1910370514 · Cited by 135
“This is common in PET data (5) and has been studied in fMRI data (12).”
Generating original ideas: The neural underpinning of originality
Mayseless, N., Eran, A., & Shamay-Tsoory, S. G. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.05.030 · Cited by 134
“Activations were considered significant at the level of p b 0.05, correcting for FalseDiscover Rate (FDR) single voxel threshold combined with Brainvoyager's cluster level statistical threshold estimator (Forman et al., 1995; Goebel et al., 2006).”
MethodInfluentialEnhanced cue reactivity and fronto-striatal functional connectivity in cocaine use disorders
Wilcox, C. E., Teshiba, T. M., Merideth, F., Ling, J., & Mayer, A. R. (2011) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2011.01.009 · Cited by 133
“05) based on 10,000 Monte Carlo simulations (Forman et al., 1995).”
MethodBirn, R. M., Patriat, R., Phillips, M. L., Germain, A., & Herringa, R. J. (2014) · Depression and Anxiety · doi:10.1002/da.22291 · Cited by 134
“, cluster size thresholding).[36] The cluster threshold was 357 voxels (2 × 2 × 2 mm3) at an individual voxel threshold of P .”
BackgroundIntelligence is associated with the modular structure of intrinsic brain networks
Hilger, K., Ekman, M., Fiebach, C. J., & Basten, U. (2017) · Scientific Reports · doi:10.1038/s41598-017-15795-7 · Cited by 134
Chen, T. L., Babiloni, C., Ferretti, A., Perrucci, M. G., Romani, G. L., Rossini, P. M., Tartaro, A., & Gratta, C. D. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.01.020 · Cited by 140
“The correction for multiple comparisons was performed using a cluster-size thresholding algorithm (Forman et al., 1995) based on Monte Carlo simulations and implemented in the BrainVoyager QX software.”
MethodReady and waiting: Freezing as active action preparation under threat
Gladwin, T. E., Hashemi, M. M., van Ast, V., & Roelofs, K. (2016) · Neuroscience Letters · doi:10.1016/j.neulet.2016.03.027 · Cited by 133
Brain Mechanisms Supporting Discrimination of Sensory Features of Pain: A New Model
Oshiro, Y., Quevedo, A. S., McHaffie, J. G., Kraft, R. A., & Coghill, R. C. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.5538-08.2009 · Cited by 133
Implications of newborn amygdala connectivity for fear and cognitive development at 6-months-of-age
Graham, A. M., Buss, C., Rasmussen, J. M., Rudolph, M. D., Demeter, D. V., Gilmore, J. H., Styner, M., Entringer, S., Wadhwa, P. D., & Fair, D. A. (2016) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2015.09.006 · Cited by 122
“hresholding based on Monte Carlo simulation was implemented o account for multiple comparisons (Forman et al., 1995).”
MethodInfluentialfMRI neurofeedback facilitates anxiety regulation in females with spider phobia
Zilverstand, A., Sorger, B., Sarkheil, P., & Goebel, R. (2015) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2015.00148 · Cited by 133
Neural substrates of child irritability in typically developing and psychiatric populations
Perlman, S. B., Jones, B. M., Wakschlag, L. S., Axelson, D., Birmaher, B. B., & Phillips, M. L. (2015) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2015.07.003 · Cited by 147
Ebisch, S. J. H., Ferri, F., Salone, A., Perrucci, M. G., D'Amico, L., Ferro, F. M., Romani, G. L., & Gallese, V. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2010.21551 · Cited by 133
“This p value and an estimate of the spatial correlation of voxels were used as input in a Monte Carlo simulation to access the overall significance level and to determine a cluster size threshold (Cox, 1996; Forman et al., 1995).”
MethodCho, S., Metcalfe, A. W. S., Young, C. B., Ryali, S., Geary, D. C., & Menon, V. (2012) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00246 · Cited by 149
“Monte Carlo simulations were implemented in Matlab using methods similar to the AlphaSim procedure in AFNI (Nichols & Hayasaka, 2003; Ward, 2000; Forman et al., 1995).”
MethodAnalysis strategies for high-resolution UHF-fMRI data
Polimeni, J. R., Renvall, V., Zaretskaya, N., & Fischl, B. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2017.04.053 · Cited by 133
“However, in computationally intensive methods—such as Monte Carlo based-approaches (Forman et al., 1995) and permutation testing (Nichols and Holmes, 2002)—the processing time is expected to scale linearly.”
Spatial mixture modeling of fMRI data
Hartvig, N. V., & Jensen, J. L. (2000) · Human Brain Mapping · doi:10.1002/1097-0193(200012)11:4<233::aid-hbm10>3.0.co;2-f · Cited by 133
“, 1997] using Monte Carlo methods [Forman et al., 1995] and permutation methods [Bullmore et al.”
MethodGoldin, P. R., Hutcherson, C. A. C., Ochsner, K. N., Glover, G. H., Gabrieli, J. D. E., & Gross, J. J. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.03.018 · Cited by 146
“05 corrected for multiple comparisons (Forman et al., 1995).”
MethodInfluentialA Developmental fMRI Study of Self-Regulatory Control in Tourette’s Syndrome
Marsh, R., Zhu, H., Wang, Z., Skudlarski, P., & Peterson, B. S. (2007) · American Journal of Psychiatry · doi:10.1176/ajp.2007.164.6.955 · Cited by 132
“The combined application of a statistical threshold and cluster filter substantially reduces the false positive identification of activated pixels at any given threshold (27).”
BackgroundAyalon, L., Ancoli-Israel, S., Aka, A. A., McKenna, B. S., & Drummond, S. P. A. (2009) · Sleep · doi:10.1093/sleep/32.3.373 · Cited by 132
Functional–anatomical organization of predicate metaphor processing
CHEN, E., WIDICK, P., & CHATTERJEE, A. (2008) · Brain and Language · doi:10.1016/j.bandl.2008.06.007 · Cited by 132
“Based on modeled data from Forman et al. (1995), these values together approximately correspond to an equivalent voxel-level false positive rate of p < .”
Method
Metadata
- Authors
- Forman, S. D., Cohen, J. D., Fitzgerald, M., Eddy, W. F., Mintun, M. A., & Noll, D. C.
- Affiliations
- University of Pittsburgh (US)
- Corresponding author
- Forman, Steven D.
- Venue
- Magnetic Resonance in Medicine
- Publisher
- Wiley
- Published
- 1995-05
- Volume
- 33
- Issue
- 5
- Pages
- 636-647
- ISSN
- 0740-3194 (ISSN-L)
- 1522-2594
- OpenAlex
- W2044634376
- Cited by
- 3,202
- References
- 11
- Citations by year
- 2026: 27 · 2025: 26 · 2024: 30 · 2023: 36 · 2022: 45 · 2021: 55 · 2020: 64 · 2019: 75 · 2018: 96 · 2017: 137 · 2016: 140 · 2015: 188 · 2014: 203 · 2013: 213 · 2012: 242
- FWCI
- 14.83
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Magnetic Resonance in Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Functional Brain Connectivity Studies
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Advanced MRI Techniques and Applications
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Advanced Neuroimaging Techniques and Applications
- Keywords
- multiple comparisons, false positives, statistical power, fMRI activation detection, Monte Carlo simulation, cluster size distribution
- MeSH terms
- Brain, Data Interpretation, Statistical, False Positive Reactions, Humans, Magnetic Resonance Imaging, Monte Carlo Method, Probability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.