Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): use of a cluster-size threshold
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
The typical functional magnetic resonance (fMRI) study presents a formidable problem of multiple statistical comparisons (i.e., > 10,000 in a 128 x 128 image). To protect against false positives, investigators have typically relied on decreasing the per pixel false positive probability. This approach incurs an inevitable loss of power to detect statistically significant activity. An alternative approach, which relies on the assumption that areas of true neural activity will tend to stimulate signal changes over contiguous pixels, is presented. If one knows the probability distribution of such cluster sizes as a function of per pixel false positive probability, one can use cluster-size thresholds independently to reject false positives. Both Monte Carlo simulations and fMRI studies of human subjects have been used to verify that this approach can improve statistical power by as much as fivefold over techniques that rely solely on adjusting per pixel false positive probabilities.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For all analyses, we determined cluster-size thresholds using Monte Carlo simulations in AFNI’s 3DClustSim (http://afni.nimh.nih.gov/afni/) which allowed for improved assessment of functional activation and correction for multiple comparisons (Forman et al., 1995) based on a grey matter mask.”
From Self-referential processing during observation of a speech performance task in social anxiety disorder from pre- to post-treatment: Evidence of disrupted neural activation (2019) · cites this paper as Forman et al., 1995
In the citing paper
“Two criteria were employed in evaluating activations: (i) only regions with peak voxels of P < 0.001 were considered; (ii) only clusters of activation including k !6 voxels in which all voxels met an uncorrected threshold of P < 0.005 were considered, yielding a functional threshold equivalent of P < 0.001 according to cluster size significance level corrections (Forman et al., 1995).”
From Attending to the present: mindfulness meditation reveals distinct neural modes of self-reference (2007) · cites this paper as Forman et al., 1995
In the citing paper
“Cluster thresholding was applied to increase power in identifying heavily recruited neural areas while maintaining a reasonably low Type-I error rate (Forman et al., 1995).”
From Attending to the present: mindfulness meditation reveals distinct neural modes of self-reference (2007) · cites this paper as Forman et al., 1995
In the citing paper
“For all FC analyses, a double statistical threshold (voxel-wise p < 0.01 and cluster size ≥ 78 voxels, as determined by AlphaSim with 10,000 Monte Carlo simulations) was used to obtain an alpha < 0.05 (corrected for multiple comparisons) (see details on the procedure at http://afni.nimh.nih.gov/afni/doc/manual/AlphaSim and in [30]).”
From Structural and Functional Cerebral Correlates of Hypnotic Suggestibility (2014) · cites this paper as [30]
In the citing paper
“The resulting maps from all participants in the HFA group and all participants in the control group were averaged and these group-averaged t-maps were displayed on group composite anatomical images with a statistical threshold of p < .001, adjusted for multiple comparisons with a cluster-filter of 10 contiguous pixels (42).”
From The Neural Circuitry Mediating Shifts in Behavioral Response and Cognitive Set in Autism (2008) · cites this paper as [42]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Self-citationNumerical recipes in C: the art of scientific computing
(1993) · Choice Reviews Online · doi:10.5860/choice.30-5638 · Cited by 17,933
A three-dimensional statistical analysis for CBF activation studies in human brain
Worsley, K. J., Evans, A. C., Marrett, S., & Neelin, P. (1992) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1992.127 · Cited by 2,036
Assessing the significance of focal activations using their spatial extent
Friston, K. J., Worsley, K. J., Frackowiak, R. S. J., Mazziotta, J. C., & Evans, A. C. (1994) · Human Brain Mapping · doi:10.1002/hbm.460010306 · Cited by 1,907
Comparing Functional (PET) Images: The Assessment of Significant Change
Friston, K. J., Frith, C. D., Liddle, P. F., & Frackowiak, R. S. J. (1991) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1991.122 · Cited by 1,625
MRI-PET Registration with Automated Algorithm
Woods, R. P., Mazziotta, J. C., & R. Cherry, A. S. (1993) · Journal of Computer Assisted Tomography · doi:10.1097/00004728-199307000-00004 · Cited by 1,617
The Relationship between Global and Local Changes in PET Scans
Friston, K. J., Frith, C. D., Liddle, P. F., Dolan, R. J., Lammertsma, A. A., & Frackowiak, R. S. J. (1990) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1990.88 · Cited by 858
Activation of the prefrontal cortex in a nonspatial working memory task with functional MRI
Cohen, J. D., Forman, S. D., Braver, T. S., Casey, B. J., Servan‐Schreiber, D., & Noll, D. C. (1994) · Human Brain Mapping · doi:10.1002/hbm.460010407 · Cited by 576
Self-citationSpiral K‐space MR imaging of cortical activation
Noll, D. C., Cohen, J. D., Meyer, C. H., & Schneider, W. (1995) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.1880050112 · Cited by 254
Self-citationPoline, J.-B., & Mazoyer, B. M. (1993) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1993.57 · Cited by 155
Cited by
Items 701–800 of 1,095
The neural correlates of implicit and explicit self-relevant processing
Rameson, L. T., Satpute, A. B., & Lieberman, M. D. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.12.098 · Cited by 145
“005 with a cluster size threshold (k) of 15 voxels (Forman et al., 1995; Lieberman et al., 2009).”
Ryan, L., Cox, C. L., Hayes, S., & Nadel, L. (2008) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2008.02.030 · Cited by 144
“Using methods described by Forman et al. (1995), the statistical threshold was determined by considering both voxel-wise alpha and the extent of contiguous activation.”
MethodRogers, R., Wise, R. G., Painter, D. J., Longe, S. E., & Tracey, I. (2004) · Anesthesiology · doi:10.1097/00000542-200402000-00018 · Cited by 132
Morey, R. A., Petty, C. M., Cooper, D. A., LaBar, K. S., & McCarthy, G. (2008) · Psychiatry Research: Neuroimaging · doi:10.1016/j.pscychresns.2007.07.007 · Cited by 131
“…estimation techniques, FMRIB Local Analysis of Mixed Effects (FLAME) (Beckmann et al., 2003; Woolrich et al., 2004) with a conservative cluster mean threshold of Z N 2.3 and a cluster-corrected significance threshold of P b 0.05 (Worsley et al., 1992; Friston et al., 1993; Forman et al., 1995).”
MethodInfluentialTjandra, T., Brooks, J. C. W., Figueiredo, P., Wise, R. G., Matthews, P. M., & Tracey, I. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.04.021 · Cited by 146
“Random effects group analyses for BOLD and CBF for the group Z statistic images were thresholded using Z > 1.8 and a cluster significance threshold of P 0.05, corrected for multiple comparisons (Forman et al., 1995), to take into account the low SNR in CBF and a small sample size.”
BackgroundMethodInfluentialGerman, T. P., Niehaus, J. L., Roarty, M. P., Giesbrecht, B., & Miller, M. B. (2004) · Journal of Cognitive Neuroscience · doi:10.1162/0898929042947892 · Cited by 131
“We chose to use a threshold that would reveal any regions that might be sensitive to the covertly pretense condition while still maintaining a statistical threshold and voxel extent that would survive a corrected probability criterion for clusters (Forman et al., 1995; Xiong, Gao, Lancaster, & Fox, 1995).”
BackgroundMethodAmygdala response to facial expressions in children and adults
Thomas, K. M., Eccard, C. H., Drevets, W. C., Dahl, R. E., Whalen, P. J., Perrett, D. I., Ryan, N. D., & Casey, B. J. (2000) · NeuroImage · doi:10.1016/s1053-8119(00)91180-7 · Cited by 131
“Significant activations were defined by at least three contiguous voxels and a5 .05 ( Forman et al 1995 ).”
Apathy in Frontotemporal Dementia: Behavioral and Neuroimaging Correlates
Eslinger, P. J., Moore, P., Antani, S., Anderson, C., & Grossman, M. (2012) · Behavioural Neurology · doi:10.1155/2012/286427 · Cited by 131
Liljeholm, M., Tricomi, E., O'Doherty, J. P., & Balleine, B. W. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3354-10.2011 · Cited by 130
“All other areas were reported at p 0.05, using cluster size thresholding (CST) to adjust for multiple comparisons (Forman et al., 1995).”
MethodInfluentialCharacterizing heterogeneity in children with and without ADHD based on reward system connectivity
Costa Dias, T. G., Iyer, S. P., Carpenter, S. D., Cary, R. P., Wilson, V. B., Mitchell, S. H., Nigg, J. T., & Fair, D. A. (2015) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2014.12.005 · Cited by 130
“To account for multiple comparisons, thresholding based on Monte Carlo simulation was implemented (Forman et al., 1995).”
MethodInfluentialNeural and Behavioral Mechanisms of Impulsive Choice in Alcohol Use Disorder
Claus, E. D., Kiehl, K. A., & Hutchison, K. E. (2011) · Alcoholism: Clinical and Experimental Research · doi:10.1111/j.1530-0277.2011.01455.x · Cited by 129
“We used AlphaSim (Forman et al., 1995; Saad et al., 2006) to determine the minimum cluster size to reduce alpha to 0.01 when images were thresholded at p = 0.005.”
InfluentialA number-form area in the blind
Abboud, S., Maidenbaum, S., Dehaene, S., & Amedi, A. (2015) · Nature Communications · doi:10.1038/ncomms7026 · Cited by 151
“In all cases, the minimum significance level was set to p 0.05 corrected for multiple comparisons using the spatial extent method based on the theory of Gaussian random fields 60,61 .”
InfluentialRotarska-Jagiela, A., Oertel‐Knoechel, V., Martino, F. D., van de Ven, V. G., Formisano, E., Roebroeck, A. F., Rami, A., Schoenmeyer, R., Haenschel, C., Hendler, T., et al. (2009) · Psychiatry Research Neuroimaging · doi:10.1016/j.pscychresns.2009.03.002 · Cited by 147
“05 with a cluster size of at least 150 voxels using cluster-size thresholding as implemented in BrainVoyager (Forman et al., 1995).”
MethodInfluentialAltered baseline brain activity in type 2 diabetes: A resting-state fMRI study
Xia, W., Wang, S., Sun, Z., Bai, F., Zhou, Y., Yang, Y., Wang, P., Huang, Y., & Yuan, Y. (2013) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2013.05.012 · Cited by 142
“The parameters were: single voxel p value = 0.05, a minimum cluster size of 85 mm3, FWHM = 4 mm, within a gray matter mask corresponding to the AAL atlas (Forman et al., 1995).”
BackgroundMethodInfluentialFunctional Connectivity of the Posteromedial Cortex
Cauda, F., Geminiani, G., D'Agata, F., Sacco, K., Duca, S., Bagshaw, A. P., & Cavanna, A. E. (2010) · PLoS ONE · doi:10.1371/journal.pone.0013107 · Cited by 130
“Corrections for multiple comparisons were performed at the cluster level using a Monte Carlo simulation ([54,55], see supporting online materials, p,0.”
Do words hurt? Brain activation during the processing of pain-related words
Richter, M., Eck, J., Straube, T., Miltner, W. H. R., & Weiß, T. (2009) · Pain · doi:10.1016/j.pain.2009.08.009 · Cited by 158
“(1995) [7,10].”
MethodIannetti, G. D., Niazy, R. K., Wise, R. G., Jezzard, P., Brooks, J. C. W., Zambreanu, L., Vennart, W., Matthews, P. M., & Tracey, I. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.06.060 · Cited by 143
CALDWELL, L. C., SCHWEINSBURG, A. D., NAGEL, B. J., BARLETT, V. C., BROWN, S. A., & TAPERT, S. F. (2005) · Alcohol and Alcoholism · doi:10.1093/alcalc/agh134 · Cited by 130
“Type I error was controlled by requiring that voxels surpass a specified alpha value (α = 0.05, two-tailed) and form clusters >943 µl (Forman et al., 1995; Ward, 1997 ).”
MethodInfluentialSchaechter, J. D., & Perdue, K. L. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhm096 · Cited by 150
“Statistical activation maps were corrected for multiple comparisons by controlling for false positives using a combination of individual nodelevel probability and minimum cluster-size threshold (Forman et al. 1995).”
Neurofeedback-mediated self-regulation of the dopaminergic midbrain
Sulzer, J. S., Sitaram, R., Blefari, M. L., Kollias, S., Birbaumer, N., Stephan, K. E., Luft, A. R., & Gassert, R. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.05.115 · Cited by 134
Velanova, K., Wheeler, M. E., & Luna, B. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.1579-09.2009 · Cited by 129
Bugden, S., Price, G. R., McLean, D. A., & Ansari, D. (2012) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2012.04.001 · Cited by 147
An information-processing model of the BOLD response in symbol manipulation tasks
Anderson, J. R., Qin, Y., Sohn, M.-H., Stenger, V. A., & Carter, C. S. (2003) · Psychonomic Bulletin & Review · doi:10.3758/bf03196490 · Cited by 135
“The interaction was examined in each voxel, and the selected regions met the criteria of a minimum of six contiguous voxels with a significant interaction at p £ .01 ( Forman et al., 1995 ).”
MethodJoanisse, M. F., Zevin, J. D., & McCandliss, B. D. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhl124 · Cited by 129
“We ran a correction performance analysis (AlphaSim, Forman et al. 1995) to determine an appropriate contiguity threshold to control for multiple comparisons.”
The Short and Long of It: Neural Correlates of Temporal-order Memory for Autobiographical Events
St. Jacques, P., Rubin, D. C., LaBar, K. S., & Cabeza, R. (2008) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2008.20091 · Cited by 129
“discovery of voxels within each cluster (Forman et al., 1995).”
BackgroundMethodInfluentialMore Harm Than Good? How Messages That Interrupt Can Make Us Vulnerable
Jenkins, J. L., Anderson, B. B., Vance, A., Kirwan, C. B., & Eargle, D. (2016) · Information Systems Research · doi:10.1287/isre.2016.0644 · Cited by 154
“Corrections for multiple comparisons were determined through Monte Carlo simulations (Forman 1995).”
MethodReconstructing the spectrotemporal modulations of real-life sounds from fMRI response patterns
Santoro, R., Moerel, M., De Martino, F., Valente, G., Ugurbil, K., Yacoub, E., & Formisano, E. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1617622114 · Cited by 129
“To correct for multiple comparisons across stimulus features, we used a cluster-size threshold procedure (57).”
MethodRegional Brain Activation during Concurrent Implicit and Explicit Sequence Learning
Aizenstein, H. J. (2004) · Cerebral Cortex · doi:10.1093/cercor/bhg119 · Cited by 129
“The statistical maps were thresholded using a cluster-size algorithm (Forman et al., 1995).”
MethodKerestes, R., Ladouceur, C. D., Meda, S., Nathan, P. J., Blumberg, H. P., Maloney, K., Ruf, B., Saricicek, A., Pearlson, G. D., Bhagwagar, Z., et al. (2012) · Psychological Medicine · doi:10.1017/s0033291711001097 · Cited by 128
“Second, to correct for multiple tests within the search volume of each of the ROIs, we used AlphaSim, which served as a family-wise error (FWE) correction (p<0.05) using a spatial extent threshold (Forman et al. 1995).”
MethodInfluentialGoldin, P., Ziv, M., Jazaieri, H., & Gross, J. J. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00295 · Cited by 128
“We used AlphaSim, a Monte Carlo simulation bootstrapping program in the AFNI library, to protect against false positive cluster detection (Forman et al., 1995).”
MethodJedema, H. P., Gianaros, P. J., Greer, P. J., Kerr, D. D., Liu, S., Higley, J. D., Suomi, S. J., Olsen, A. S., Porter, J. N., Lopresti, B. J., et al. (2010) · Molecular Psychiatry · doi:10.1038/mp.2009.90 · Cited by 128
“A uthor M anuscript A uthor M anuscript A uthor M anuscript A uthor M anuscript false positive detection rate (FPR) (30) using these criteria and Monte Carlo simulations implemented in AlphaSim, which account for spatial correlations between volume changes in neighboring voxels (31).”
MethodInfluentialSpeech errors in progressive non-fluent aphasia
Ash, S., McMillan, C., Gunawardena, D., Avants, B., Morgan, B., Khan, A., Moore, P., Gee, J., & Grossman, M. (2010) · Brain and Language · doi:10.1016/j.bandl.2009.12.001 · Cited by 130
“0005 and only accepted clusters with an extent of 100 adjacent voxels because a cluster of this size would also demonstrate a consistent effect in a particular neuroanatomical distribution while minimizing false positives (Forman et al., 1995).”
BackgroundKim, H., Daselaar, S. M., & Cabeza, R. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.07.058 · Cited by 128
“00001 per voxel according to Monte Carlo simulations of spatially correlated data (Forman et al., 1995).”
InfluentialCortical depth‐dependent gradient‐echo and spin‐echo BOLD fMRI at 9.4T
Zhao, F., Wang, P., & Kim, S. (2004) · Magnetic Resonance in Medicine · doi:10.1002/mrm.10720 · Cited by 128
“A minimal cluster size for an active region of 3 pixels was further imposed, and the effective P-value was 1 10 (24).”
BackgroundASsociation of gsk3β polymorphisms with brain structural changes in major depressive disorder
Inkster, B., Nichols, T. E., Saemann, P. G., Auer, D. P., Holsboer, F., Muglia, P., & Matthews, P. M. (2009) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2009.70 · Cited by 127
Basho, S., Palmer, E. D., Rubio, M. A., Wulfeck, B., & Müller, R.-A. (2007) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2007.01.007 · Cited by 127
Mechanisms of Cognitive Control: The Functional Role of Task Rules
Dreisbach, G. (2012) · Current Directions in Psychological Science · doi:10.1177/0963721412449830 · Cited by 127
Stroop interference, hemodynamic response and aging: An event-related fMRI study
Zysset, S., Schroeter, M. L., Neumann, J., & von Cramon, D. Y. (2006) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2006.05.008 · Cited by 148
Brunetti, M., Belardinelli, P., Caulo, M., Gratta, C. D., Penna, S. D., Ferretti, A., Lucci, G., Moretti, A., Pizzella, V., Tartaro, A., et al. (2005) · Human Brain Mapping · doi:10.1002/hbm.20164 · Cited by 127
“These thresholds and an estimate of the spatial correlation of voxels [3dFWHM routine of AFNI package, Cox, 1996; Forman et al., 1995] were used as input in a Monte-Carlo simulation [AlphaSim routine of AFNI package, Cox, 1996; Forman et al., 1995] in order to assess the overall significance level…”
MethodAssociation of individual resting state EEG alpha frequency and cerebral blood flow
Jann, K., Koenig, T. W., Dierks, T., Boesch, C., & Federspiel, A. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.02.024 · Cited by 140
“05 and cluster size threshold estimation based on Monte Carlo Simulations (1000 iterations) was performed to correct for type I errors (Forman et al., 1995).”
MethodInfluentialDynamic activation of the anterior cingulate cortex during anticipatory anxiety
Straube, T., Schmidt, S. N. L., Weiß, T., Mentzel, H., & Miltner, W. H. R. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.10.022 · Cited by 143
“, 2006), which is based on a 3D extension of the randomization procedure described by Forman et al. (1995). Firstly, voxel-level threshold was set at Pb0.”
BackgroundMethodSalloum, J. B., Ramchandani, V. A., Bodurka, J., Rawlings, R., Momenan, R., George, D., & Hommer, D. W. (2007) · Alcoholism: Clinical and Experimental Research · doi:10.1111/j.1530-0277.2007.00447.x · Cited by 126
Craggs, J. G., Price, D. D., Verne, G. N., Perlstein, W. M., & Robinson, M. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.07.057 · Cited by 142
“As a precaution against Type I error, resultant statistical parameter maps (SPMs) were thresholded at pb .05, and had a spatial extent of 50 contiguous voxels; the combination of which established an imagewise p-value of .00002 and an effective pixelwise alpha of pb .0002 (Forman et al., 1995).”
MethodCortical activity during tactile exploration of objects in blind and sighted humans
Amedi, A., Raz, N., Azulay, H., Malach, R., & Zohary, E. (2010) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-2010-0503 · Cited by 125
“…for multiple comparisons using a cluster-size threshold adjustment, based on a Monte Carlo simulation approach extended to 3D data sets using the threshold size plug-in BrainVoyager QX ((Forman et al., 1995); for more details on implementation see (Amedi et al., 2005; Amedi et al., 2007)).”
MethodGestures Orchestrate Brain Networks for Language Understanding
Skipper, J. I., Goldin-Meadow, S., Nusbaum, H. C., & Small, S. L. (2009) · Current Biology · doi:10.1016/j.cub.2009.02.051 · Cited by 125
“05 by Monte Carlo simulation [38] and taking the intersection of active voxels for all conditions.”
Neural basis of egalitarian behavior
Dawes, C. T., Loewen, P. J., Schreiber, D. M., Simmons, A. N., Flagan, T., McElreath, R. L., Bokemper, S., Fowler, J. H., & Paulus, M. P. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1118653109 · Cited by 142
“A threshold adjustment method based on Monte-Carlo simulations was applied to prevent identification of false-positive areas of activation (29).”
MethodEffect of aerobic exercise on cancer‐associated cognitive impairment: A proof‐of‐concept RCT
Campbell, K. L., Kam, J. W. Y., Neil‐Sztramko, S. E., Liu Ambrose, T., Handy, T. C., Lim, H. J., Hayden, S., Hsu, L., Kirkham, A. A., Gotay, C. C., et al. (2018) · Psycho-Oncology · doi:10.1002/pon.4370 · Cited by 123
“74) and a minimum cluster size of 200 contiguous voxels was used.(34) The PSC of each of the 3 regions of interest was extracted and submitted to a multivariate analysis of covariance, which included a between‐subject factor of group (EX vs CON), end‐of‐study PSCs of all 3 regions of interest as dependent variables, a…”
MethodHow to Conduct a Functional Magnetic Resonance (fMRI) Study in Social Science Research1
Dimoka, A. (2012) · MIS Quarterly · doi:10.2307/41703482 · Cited by 145
Xiao, Z., Zhang, J. X., Wang, X., Wu, R., Hu, X., Weng, X., & Tan, L. H. (2005) · Human Brain Mapping · doi:10.1002/hbm.20105 · Cited by 125
“A voxel-wise intensity threshold (uncorrected P 0.005) and a spatial extent threshold (cluster size greater than 20 voxels) were combined to control for multiple comparisons [ Forman et al., 1995; Poline et al., 1997] in the generation of the t-maps.”
InfluentialIncreased cerebral activation after behavioral treatment for memory deficits in MS
Chiaravalloti, N. D., Wylie, G. R., Leavitt, V. M., & DeLuca, J. (2012) · Journal of Neurology · doi:10.1007/s00415-011-6353-x · Cited by 130
“This technique for setting the cluster threshold controls false positives while also sparing statistical power [23].”
MethodStrigo, I. A., Simmons, A. N., Matthews, S. C., Grimes, E. M., Allard, C. B., Reinhardt, L. E., Paulus, M. P., & Stein, M. B. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.03.034 · Cited by 136
Symbol processing in the left angular gyrus: Evidence from passive perception of digits
Price, G. R., & Ansari, D. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.05.035 · Cited by 137
“The resulting statistical maps were subsequently corrected for multiple comparisons using cluster size thresholding (Forman et al., 1995; Goebel et al., 2006).”
MethodUpregulation of emotion areas through neurofeedback with a focus on positive mood
Johnston, S. J., Linden, D. E. J., Healy, D. T., Goebel, R., Habes, I., & Boehm, S. G. (2010) · Cognitive Affective & Behavioral Neuroscience · doi:10.3758/s13415-010-0010-1 · Cited by 127
“cluster level (400 mm(3)) based on the Monte-Carlo simulation (Forman et al., 1996) implemented in BrainVoyager QX.”
MethodShih, P., Keehn, B., Oram, J. K., Leyden, K. M., Keown, C. L., & Müller, R.-A. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.03.040 · Cited by 123
Effect of lateralized temporal lobe epilepsy on the default mode network
Haneef, Z., Lenartowicz, A., Yeh, H. J., Engel, J., & Stern, J. M. (2012) · Epilepsy & Behavior · doi:10.1016/j.yebeh.2012.07.019 · Cited by 133
“uk/fsl) [20,21], which included head movement artifact removal [22], non-brain tissue elimination [23], regression using 6 motion parameters and their derivatives, high-pass filtering (100 s), spatial smoothing at 5 mm full-width half-maximum, and mean-based intensity normalization as described previously for resting…”
MethodKahn, I., Desai, M., Knoblich, U., Bernstein, J., Henninger, M., Graybiel, A. M., Boyden, E. S., Buckner, R. L., & Moore, C. I. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.0007-11.2011 · Cited by 123
“The cluster size and p value threshold were determined via Monte Carlo simulations performed in AFNI using AlphaSim (Forman et al., 1995; Xiong et al., 1995).”
Method“Silent event-related” fMRI reveals reduced sensorimotor activation in laryngeal dystonia
Haslinger, B., Erhard, P., Dresel, C., Castrop, F., Roettinger, M., & Ceballos-Baumann, A. O. (2005) · Neurology · doi:10.1212/01.wnl.0000184478.59063.db · Cited by 124
Schaechter, J. D., Perdue, K. L., & Wang, R. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.09.071 · Cited by 144
“…were corrected for multiple comparisons by controlling for false positives using a combination of individual node-level probability and minimum cluster size (Forman et al., 1995 ), values determined from Monte Carlo simulations (10,000 iterations) performed on synthesized white Gaussian noise data.”
MethodRusso, A., Tessitore, A., Esposito, F., Marcuccio, L., Giordano, A., Conforti, R., Truini, A., Paccone, A., d’Onofrio, F., & Tedeschi, G. (2012) · Journal of Neurology · doi:10.1007/s00415-012-6438-1 · Cited by 124
“and is thought to play a role in pain modulation and analgesia [26–29] as well as in attention and anticipation of”
BackgroundMethodThe Function of Words: Distinct Neural Correlates for Words Denoting Differently Manipulable Objects
Rueschemeyer, S., van Rooij, D., Lindemann, O., Willems, R. M., & Bekkering, H. (2009) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21310 · Cited by 141
“To protect against false-positive activation, a double threshold was applied, by which only voxels 1846 Journal of Cognitive Neuroscience Volume 22, Number 8 with a p < .005, uncorrected, and a volume exceeding 300 voxels were considered (Forman et al., 1995).”
BackgroundMethodSemantic memory activation in amnestic mild cognitive impairment
Woodard, J. L., Seidenberg, M., Nielson, K. A., Antuono, P., Guidotti, L., Durgerian, S., Zhang, Q., Lancaster, M., Hantke, N., Butts, A., et al. (2009) · Brain · doi:10.1093/brain/awp157 · Cited by 123
“05 based on 3000 Monte Carlo simulations (Forman et al., 1995).”
Structural and metabolic changes in language areas linked to formal thought disorder
Horn, H., Federspiel, A., Wirth, M., Müller, T. J., Wiest, R., Wang, J.-J., & Strik, W. (2009) · British Journal of Psychiatry · doi:10.1192/bjp.bp.107.045633 · Cited by 122
Schweinsburg, A. D., Schweinsburg, B. C., Cheung, E. H., Brown, G. G., Brown, S. A., & Tapert, S. F. (2005) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2005.01.009 · Cited by 141
Spisák, T., Spisák, Z., Zunhammer, M., Bingel, U., Smith, S. M., Nichols, T. E., & Kincses, Z. T. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2018.09.078 · Cited by 135
“…is usually spatially more or less extended (that is, clustered), sensitivity can be significantly boosted by relating the size of the activation cluster to the (empirical or theoretical) distribution of random clusters in an image of given smoothness (Forman et al., 1995; Friston et al., 1994b).”
BackgroundBrain mechanisms underlying perceptual causality
Fugelsang, J. A., Roser, M. E., Corballis, P. M., Gazzaniga, M. S., & Dunbar, K. N. (2005) · Cognitive Brain Research · doi:10.1016/j.cogbrainres.2004.12.001 · Cited by 140
Harlé, K. M., Chang, L. J., Wout‐Frank, M. V. ‘., & Sanfey, A. G. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.02.027 · Cited by 153
fMRI reveals alteration of spatial working memory networks across adolescence
SCHWEINSBURG, A. D., NAGEL, B. J., & TAPERT, S. F. (2005) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617705050757 · Cited by 123
“To control for Type I error when determining clusters that showed significant effects, we used a combination of t-statistic magnitude and cluster volume thresholding (Forman et al., 1995; Ward, 1997) by only interpreting clusters exceeding 943 microliters, equal to 22 contiguous significant (a , .”
MethodNeurocognitive contributions to verbal fluency deficits in frontotemporal lobar degeneration
Libon, D. J., McMillan, C., Gunawardena, D., Powers, C., Massimo, L., Khan, A., Morgan, B., Farag, C., Richmond, L., Weinstein, J., et al. (2009) · Neurology · doi:10.1212/wnl.0b013e3181b2a4f5 · Cited by 122
Burger, K. S., & Stice, E. (2012) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.111.027003 · Cited by 122
“05 corrected for multiple comparisons across the whole brain based on Monte Carlo simulations of random noise distribution with the use of the 3DClustSim module of the Analysis of Functional NeuroImages (29, 30).”
MethodInfluentialAssessments of Function and Biochemistry of the Anterior Cingulate Cortex in Schizophrenia
Reid, M. A., Stoeckel, L. E., White, D. M., Avsar, K. B., Bolding, M. S., Akella, N. S., Knowlton, R. C., den Hollander, J. A., & Lahti, A. C. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.04.013 · Cited by 121
“001 with an extent threshold of eight contiguous voxels (54) after small volume correction for the ROI.”
Identifying basal ganglia divisions in individuals using resting-state functional connectivity MRI
Barnes (2010) · Frontiers in System Neuroscience · doi:10.3389/fnsys.2010.00018 · Cited by 122
Functional Connectivity of the Amygdala in Early-Childhood-Onset Depression
Luking, K. R., Repovs, G., Belden, A. C., Gaffrey, M. S., Botteron, K. N., Luby, J. L., & Barch, D. M. (2011) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2011.07.019 · Cited by 122
Disentangling Representations of Object and Grasp Properties in the Human Brain
Fabbri, S., Stubbs, K. D., Cusack, R., & Culham, J. C. (2016) · Journal of Neuroscience · doi:10.1523/jneurosci.0313-16.2016 · Cited by 138
“005) with a cluster correction using a Monte Carlo simulation method (Forman et al., 1995) performed with the function AlphaSim in NeuroElf (http:// neuroelf.”
MethodInfluentialChallenging the cholinergic system in mild cognitive impairment: a pharmacological fMRI study
Goekoop, R., Rombouts, S. A. R. B., Jonker, C., Hibbel, A., Knol, D. L., Truyen, L., Barkhof, F., & Scheltens, P. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.08.006 · Cited by 140
“05 (Forman et al., 1995; Friston et al., 1994; Woolrich et al., 2004; Worsley et al., 1992).”
BackgroundIs left inferior frontal gyrus a general mechanism for selection?
Zhang, J. X., Feng, C., Fox, P. T., Gao, J., & Tan, L. H. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.06.006 · Cited by 130
“A voxelwise intensity threshold (P Forman et al., 1995; Poline et al., 1997).”
BackgroundVoss, J. L., Warren, D. E., Gonsalves, B. D., Federmeier, K. D., Tranel, D., & Cohen, N. J. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1100225108 · Cited by 121
“Regions exhibiting significant activity at the group level were identified via random-effects analysis with a combined voxel-wise and spatialextent threshold method incorporating Monte Carlo simulation (48).”
MethodMorton, J. B., Bosma, R. L., & Ansari, D. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.01.037 · Cited by 133
“05 (5%) bymeans of the cluster-thresholding procedure described earlier (Forman et al., 1995; Goebel et al., 2006).”
BackgroundMethodRamautar, J. R., Slagter, H. A., Kok, A., & Ridderinkhof, K. R. (2006) · Brain Research · doi:10.1016/j.brainres.2006.02.091 · Cited by 142
“The threshold adopted for the group analysis was set at P < 0.001 (uncorrected for multiple comparisons) combined with a spatial extent threshold of four contiguous voxels to protect against false positives (Forman et al., 1995; Poline et al., 1997).”
MethodInfluentialSelective attention modulates inferior frontal gyrus activity during action observation
Chong, T. T.-J., Williams, M. A., Cunnington, R., & Mattingley, J. B. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.11.030 · Cited by 118
“Clusters of fewer than four voxels were ignored (Forman et al., 1995).”
Aberrant connectivity of lateral prefrontal networks in presymptomatic Huntington's disease
Wolf, R. C., Sambataro, F., Vasić, N., Schönfeldt‐Lecuona, C., Ecker, D., & Landwehrmeyer, G. B. (2008) · Experimental Neurology · doi:10.1016/j.expneurol.2008.05.017 · Cited by 127
Progression of cortical thinning in early Parkinson's disease
Ibarretxe‐Bilbao, N., Junqué, C., Segura, B., Baggio, H. C., Martí, M. J., Valldeoriola, F., Bargalló, N., & TOLOSA, E. S. (2012) · Movement Disorders · doi:10.1002/mds.25240 · Cited by 141
Neural basis for impaired time reproduction in Parkinson's disease: An fMRI study
ELSINGER, C. L., RAO, S. M., ZIMBELMAN, J. L., REYNOLDS, N. C., BLINDAUER, K. A., & HOFFMANN, R. G. (2003) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617703970123 · Cited by 121
“A minimum cluster size threshold (150mL) was adopted to minimize false positive activation clusters from the maps (Forman et al., 1995).”
MethodImpaired sense of agency in functional movement disorders: An fMRI study
Nahab, F. B., Kundu, P., Maurer, C., Shen, Q., & Hallett, M. (2017) · PLOS ONE · doi:10.1371/journal.pone.0172502 · Cited by 120
“Statistical correction for multiple comparisons was set by rejecting spatial clusters smaller than would be expected by chance using Monte-Carlo simulations [28], given a voxel-wise falsepositive level of P< 0.”
MethodEffects of aging on transient and sustained successful memory encoding activity
Dennis, N. A., Daselaar, S. M., & Cabeza, R. E. L. (2006) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2006.07.006 · Cited by 149
COMT genotype predicts BOLD signal and noise characteristics in prefrontal circuits
Winterer, G., Musso, F., Vučurević, G., Stoeter, P., Konrad, A., Seker, B., Gallinat, J., Dahmen, N., & Weinberger, D. R. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.05.058 · Cited by 140
Nonlinear spatial normalization using basis functions
Ashburner, J., & Friston, K. J. (1999) · Human Brain Mapping · doi:10.1002/(sici)1097-0193(1999)7:4<254::aid-hbm4>3.0.co;2-g · Cited by 1,884
Investigation of the initial dip in fMRI at 7 Tesla
Yacoub, E. S., Shmuel, A., Pfeuffer, J., de Moortele, P. V., Adriany, G., Uǧurbil, K., & Hu, X. P. (2001) · NMR in Biomedicine · doi:10.1002/nbm.715 · Cited by 137
“The template for the positive response was generated by convolving the stimulation paradigm with a hemodynamic response function given by Friston et al.30 The negative response model was derived from a representative timecourse of the previously published data.15–19 An initial dip map was generated with a cross correl…”
InfluentialSimonyan, K., Ostuni, J., Ludlow, C. L., & Horwitz, B. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.4897-09.2009 · Cited by 121
“The correction for multiple comparisons was made using Monte-Carlo simulations (Forman et al., 1995) that resulted in a voxelwise threshold of 0.001 and a minimum cluster size of 506 mm 3 at a corrected p 0.05.”
InfluentialDistinct fMRI responses to laughter, speech, and sounds along the human peri-sylvian cortex
Meyer, M., Zysset, S., von Cramon, D. Y., & Alter, K. (2005) · Cognitive Brain Research · doi:10.1016/j.cogbrainres.2005.02.008 · Cited by 120
“001; uncorrected) and with a volume greater than 225 mm(3) (5 measured voxels) were considered [15,27] (Tables 1 and 2).”
BackgroundAtypical network connectivity for imitation in autism spectrum disorder
Shih, P., Shen, M., Öttl, B., Keehn, B., Gaffrey, M. S., & Müller, R.-A. (2010) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2010.05.035 · Cited by 120
Acceptance versus reappraisal: Behavioral, autonomic, and neural effects
Goldin, P. R., Moodie, C. A., & Gross, J. J. (2019) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-019-00690-7 · Cited by 120
Functional connectivity in BOLD and CBF data: Similarity and reliability of resting brain networks
Jann, K., Gee, D. G., Kilroy, E., Schwab, S., Smith, R. X., Cannon, T. D., & Wang, D. J. J. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.11.028 · Cited by 126
“This procedure estimates the distribution of random cluster sizes given a statistical map and threshold taking into consideration the spatial smoothness of the data (Bennett et al., 2009; Forman et al., 1995).”
MethodOrdinality and the Nature of Symbolic Numbers
Lyons, I. M., & Beilock, S. L. (2013) · Journal of Neuroscience · doi:10.1523/jneurosci.1775-13.2013 · Cited by 145
“Whole-brain results were thresholded first voxelwise at p 0.005, and subsequently cluster-level corrected for multiple-comparisons using a Monte-Carlo simulation procedure (Forman et al., 1995) at 0.01.”
MethodInfluentialVilliger, M., Estévez, N., Hepp‐Reymond, M., Kiper, D., Kollias, S., Eng, K., & Boendermaker, S. H. (2013) · PLoS ONE · doi:10.1371/journal.pone.0072403 · Cited by 124
Neural substrates of time perception and impulsivity
Wittmann, M., Simmons, A. N., Flagan, T., Lane, S. D., Wackermann, J., & Paulus, M. P. (2011) · Brain Research · doi:10.1016/j.brainres.2011.06.048 · Cited by 120
Estimating test‐retest reliability in functional MR imaging I: Statistical methodology
Genovese, C. R., Noll, D. C., & Eddy, W. F. (1997) · Magnetic Resonance in Medicine · doi:10.1002/mrm.1910380319 · Cited by 120
Self-citationMotion Class Dependency in Observers' Motor Areas Revealed by Functional Magnetic Resonance Imaging
Sakreida, K., Schubotz, R. I., Wolfensteller, U., & von Cramon, D. Y. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.4170-04.2005 · Cited by 120
“001; uncorrected) and with a volume 135 mm 3 (five contiguous voxels) were considered (Forman et al., 1995).”
BackgroundImagery of a moving object: The role of occipital cortex and human MT/V5+
Kaas, A. L., Weigelt, S., Roebroeck, A. F., Kohler, A., & Muckli, L. F. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.07.055 · Cited by 134
“05 using the cluster threshold method described earlier (Forman et al., 1995).”
InfluentialKim, J. H., Greenspan, J. D., Coghill, R. C., Ohara, S., & Lenz, F. A. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.0716-07.2007 · Cited by 119
“To minimize the impact of multiple comparisons, statistical probabilities of activations were calculated based on spatial extent of clusters of voxels exceeding a T 3.1 (Friston et al., 1994; Forman et al., 1995).”
MethodInfluentialSeidman, L. J., Breiter, H. C., Goodman, J. M., Goldstein, J. M., Woodruff, P. W. R., O'Craven, K., Savoy, R., Tsuang, M. T., & Rosen, B. R. (1998) · Neuropsychology · doi:10.1037//0894-4105.12.4.505 · Cited by 118
Metadata
- Authors
- Forman, S. D., Cohen, J. D., Fitzgerald, M., Eddy, W. F., Mintun, M. A., & Noll, D. C.
- Affiliations
- University of Pittsburgh (US)
- Corresponding author
- Forman, Steven D.
- Venue
- Magnetic Resonance in Medicine
- Publisher
- Wiley
- Published
- 1995-05
- Volume
- 33
- Issue
- 5
- Pages
- 636-647
- ISSN
- 0740-3194 (ISSN-L)
- 1522-2594
- OpenAlex
- W2044634376
- Cited by
- 3,202
- References
- 11
- Citations by year
- 2026: 27 · 2025: 26 · 2024: 30 · 2023: 36 · 2022: 45 · 2021: 55 · 2020: 64 · 2019: 75 · 2018: 96 · 2017: 137 · 2016: 140 · 2015: 188 · 2014: 203 · 2013: 213 · 2012: 242
- FWCI
- 14.83
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Magnetic Resonance in Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Functional Brain Connectivity Studies
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Advanced MRI Techniques and Applications
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Advanced Neuroimaging Techniques and Applications
- Keywords
- multiple comparisons, false positives, statistical power, fMRI activation detection, Monte Carlo simulation, cluster size distribution
- MeSH terms
- Brain, Data Interpretation, Statistical, False Positive Reactions, Humans, Magnetic Resonance Imaging, Monte Carlo Method, Probability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.