Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): use of a cluster-size threshold
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
The typical functional magnetic resonance (fMRI) study presents a formidable problem of multiple statistical comparisons (i.e., > 10,000 in a 128 x 128 image). To protect against false positives, investigators have typically relied on decreasing the per pixel false positive probability. This approach incurs an inevitable loss of power to detect statistically significant activity. An alternative approach, which relies on the assumption that areas of true neural activity will tend to stimulate signal changes over contiguous pixels, is presented. If one knows the probability distribution of such cluster sizes as a function of per pixel false positive probability, one can use cluster-size thresholds independently to reject false positives. Both Monte Carlo simulations and fMRI studies of human subjects have been used to verify that this approach can improve statistical power by as much as fivefold over techniques that rely solely on adjusting per pixel false positive probabilities.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For all analyses, we determined cluster-size thresholds using Monte Carlo simulations in AFNI’s 3DClustSim (http://afni.nimh.nih.gov/afni/) which allowed for improved assessment of functional activation and correction for multiple comparisons (Forman et al., 1995) based on a grey matter mask.”
From Self-referential processing during observation of a speech performance task in social anxiety disorder from pre- to post-treatment: Evidence of disrupted neural activation (2019) · cites this paper as Forman et al., 1995
In the citing paper
“Two criteria were employed in evaluating activations: (i) only regions with peak voxels of P < 0.001 were considered; (ii) only clusters of activation including k !6 voxels in which all voxels met an uncorrected threshold of P < 0.005 were considered, yielding a functional threshold equivalent of P < 0.001 according to cluster size significance level corrections (Forman et al., 1995).”
From Attending to the present: mindfulness meditation reveals distinct neural modes of self-reference (2007) · cites this paper as Forman et al., 1995
In the citing paper
“Cluster thresholding was applied to increase power in identifying heavily recruited neural areas while maintaining a reasonably low Type-I error rate (Forman et al., 1995).”
From Attending to the present: mindfulness meditation reveals distinct neural modes of self-reference (2007) · cites this paper as Forman et al., 1995
In the citing paper
“For all FC analyses, a double statistical threshold (voxel-wise p < 0.01 and cluster size ≥ 78 voxels, as determined by AlphaSim with 10,000 Monte Carlo simulations) was used to obtain an alpha < 0.05 (corrected for multiple comparisons) (see details on the procedure at http://afni.nimh.nih.gov/afni/doc/manual/AlphaSim and in [30]).”
From Structural and Functional Cerebral Correlates of Hypnotic Suggestibility (2014) · cites this paper as [30]
In the citing paper
“The resulting maps from all participants in the HFA group and all participants in the control group were averaged and these group-averaged t-maps were displayed on group composite anatomical images with a statistical threshold of p < .001, adjusted for multiple comparisons with a cluster-filter of 10 contiguous pixels (42).”
From The Neural Circuitry Mediating Shifts in Behavioral Response and Cognitive Set in Autism (2008) · cites this paper as [42]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Self-citationNumerical recipes in C: the art of scientific computing
(1993) · Choice Reviews Online · doi:10.5860/choice.30-5638 · Cited by 17,933
A three-dimensional statistical analysis for CBF activation studies in human brain
Worsley, K. J., Evans, A. C., Marrett, S., & Neelin, P. (1992) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1992.127 · Cited by 2,036
Assessing the significance of focal activations using their spatial extent
Friston, K. J., Worsley, K. J., Frackowiak, R. S. J., Mazziotta, J. C., & Evans, A. C. (1994) · Human Brain Mapping · doi:10.1002/hbm.460010306 · Cited by 1,907
Comparing Functional (PET) Images: The Assessment of Significant Change
Friston, K. J., Frith, C. D., Liddle, P. F., & Frackowiak, R. S. J. (1991) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1991.122 · Cited by 1,625
MRI-PET Registration with Automated Algorithm
Woods, R. P., Mazziotta, J. C., & R. Cherry, A. S. (1993) · Journal of Computer Assisted Tomography · doi:10.1097/00004728-199307000-00004 · Cited by 1,617
The Relationship between Global and Local Changes in PET Scans
Friston, K. J., Frith, C. D., Liddle, P. F., Dolan, R. J., Lammertsma, A. A., & Frackowiak, R. S. J. (1990) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1990.88 · Cited by 858
Activation of the prefrontal cortex in a nonspatial working memory task with functional MRI
Cohen, J. D., Forman, S. D., Braver, T. S., Casey, B. J., Servan‐Schreiber, D., & Noll, D. C. (1994) · Human Brain Mapping · doi:10.1002/hbm.460010407 · Cited by 576
Self-citationSpiral K‐space MR imaging of cortical activation
Noll, D. C., Cohen, J. D., Meyer, C. H., & Schneider, W. (1995) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.1880050112 · Cited by 254
Self-citationPoline, J.-B., & Mazoyer, B. M. (1993) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1993.57 · Cited by 155
Cited by
Items 401–500 of 1,095
Dysfunction of the social brain in schizophrenia is modulated by intention type: An fMRI study
Walter, H., Ciaramidaro, A., Adenzato, M., Vasic, N., Ardito, R. B., Erk, S., & Bara, B. G. (2009) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsn047 · Cited by 207
“As all regions included a priori defined regions of interests (Walter et al., 2004; Ciaramidaro et al., 2007) we chose an uncorrected threshold of P < 0.001 at the voxel level, corrected for extent (P < 0.05) at the cluster level (Forman et al., 1995).”
InfluentialThe Neural Circuitry Mediating Shifts in Behavioral Response and Cognitive Set in Autism
Shafritz, K. M., Dichter, G. S., Baranek, G. T., & Belger, A. (2008) · Biological Psychiatry · doi:10.1016/j.biopsych.2007.06.028 · Cited by 206
“.001, adjusted for multiple comparisons with a cluster-filter of 10 contiguous pixels (42).”
Maternal brain response to own baby‐cry is affected by cesarean section delivery
Swain, J. E., Tasgin, E., Mayes, L. C., Feldman, R., Todd Constable, R., & Leckman, J. F. (2008) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2008.01963.x · Cited by 206
“In order to test statistical significance with correction for multiple comparisons, whole-brain voxel-based spatial cluster filter thresholding was performed (Forman et al., 1995; Goebel, Esposito, & Formisano, 2006).”
Partially enhanced thalamocortical functional connectivity in autism
Mizuno, A., Villalobos, M. E., Davies, M. M., Dahl, B. C., & Müller, R.-A. (2006) · Brain Research · doi:10.1016/j.brainres.2006.05.064 · Cited by 206
Autistic traits are associated with diminished neural response to affective touch
Voos, A. C., Pelphrey, K. A., & Kaiser, M. D. (2013) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nss009 · Cited by 205
“In the individual touch condition relative to baseline contrasts, we corrected for multiple comparisons using cluster thresholds determined by the Brain Voyager QX Cluster-level Statistical Threshold Estimator plug-in (Forman et al., 1995; Goebel et al., 2006).”
MethodAnterior cingulate cortex: An fMRI analysis of conflict specificity and functional differentiation
Milham, M. P., & Banich, M. T. (2005) · Human Brain Mapping · doi:10.1002/hbm.20110 · Cited by 204
“For each contrast, group random-effects analyses were used to test if the individual participants’ PE values were reliably greater than 0 (P 0.0025; contiguity threshold 20 voxels) [Forman et al., 1995].”
MethodInfluentialMultiple testing corrections, nonparametric methods, and random field theory
Nichols, T. E. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.04.014 · Cited by 204
“In lieu of theoretical results, a Monte Carlo simulation approach was proposed first for PET (Poline & Mazoyer, 1993; Roland et al. , 1993) and then for fMRI (Forman et al. , 1995).”
BackgroundTrying to tell a tale: Discourse impairments in progressive aphasia and frontotemporal dementia
Ash, S., Moore, P., Antani, S., McCawley, G., Work, M., & Grossman, M. (2006) · Neurology · doi:10.1212/01.wnl.0000210435.72614.38 · Cited by 203
“Words per minute† 142 (24) 45 (22)‡ 81 (28)‡§ 90 (48)‡§”
Hippocampal brain-network coordination during volitional exploratory behavior enhances learning
Voss, J. L., Gonsalves, B. D., Federmeier, K. D., Tranel, D., & Cohen, N. J. (2011) · Nature Neuroscience · doi:10.1038/nn.2693 · Cited by 203
“001, and a cluster extent threshold of 31 contiguous supra-threshold voxels was determined by Monte Carlo simulatio”
MethodGraham, A. M., Rasmussen, J. M., Entringer, S., Ben Ward, E., Rudolph, M. D., Gilmore, J. H., Styner, M., Wadhwa, P. D., Fair, D. A., & Buss, C. (2019) · Biological Psychiatry · doi:10.1016/j.biopsych.2018.06.023 · Cited by 203
Hein, G., Doehrmann, O., Müller, N. G., Kaiser, J., Muckli, L., & Naumer, M. J. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.1740-07.2007 · Cited by 203
“Statistical maps were corrected for multiple comparisons using cluster-size thresholding (Forman et al., 1995; Goebel et al., 2006).”
MethodFunctional Parcellation of Attentional Control Regions of the Brain
Woldorff, M. G., Hazlett, C. J., Fichtenholtz, H. M., Weissman, D. H., Dale, A. M., & Song, A. W. (2004) · Journal of Cognitive Neuroscience · doi:10.1162/089892904322755638 · Cited by 203
“To reduce false positives from noise, these thresholds were used in conjunction with a cluster extent threshold of 11 contiguous voxels (Forman et al., 1995; Xiong, Gao, Lancaster, & Fox, 1995).”
MethodEmotional Arousal Can Impair Feature Binding in Working Memory
Mather, M., Mitchell, K. J., Raye, C. L., Novak, D. L., Greene, E. J., & Johnson, M. K. (2006) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2006.18.4.614 · Cited by 203
“M > H L 40, 42, 22, (2) LPi, GTs, (GPoC) À65 À34 26 3.57 14 L > H y All areas showed an Arousal  Time interaction with a minimum of six contiguous voxels, each significant at p .001 (Forman et al., 1995), except for the two marked with an asterisk (*) in the Experiment column where p .01.”
BackgroundMethodInfluentialPolli, F. E., Barton, J. J. S., Cain, M. S., Thakkar, K. N., Rauch, S. L., & Manoach, D. S. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0503657102 · Cited by 202
Reproducibility of fMRI Results across Four Institutions Using a Spatial Working Memory Task
Casey, B. J., Cohen, J. D., O'Craven, K., Davidson, R. J., Irwin, W., Nelson, C. A., Noll, D. C., Hu, X., Lowe, M. J., Rosen, B. R., et al. (1998) · NeuroImage · doi:10.1006/nimg.1998.0360 · Cited by 203
Self-citationArmbruster, D. J. N., Ueltzhöffer, K., Basten, U., & Fiebach, C. J. (2012) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00286 · Cited by 202
“The reasoning behind this is that voxel values in fMRI data are not independent from each other, which should result in spatially extended clusters of significantly activated voxels (Forman et al., 1995).”
BackgroundNir, Y., Hasson, U., Levy, I., Yeshurun, Y., & Malach, R. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2005.11.018 · Cited by 202
“1B) was based on the individual voxel significance and on the minimum cluster size of 50 mm(2) voxels (Forman et al., 1995).”
MethodEsposito, F., Tessitore, A., Giordano, A., De Micco, R., Paccone, A., Conforti, R., Pignataro, G., Annunziato, L., & Tedeschi, G. (2013) · Brain · doi:10.1093/brain/awt007 · Cited by 202
“Namely, an initial uncorrected threshold was applied (P = 0.01) to all voxels and, then, a minimum cluster size was calculated that protected against false-positive clusters at 5% after 500 Montecarlo simulations (Forman et al., 1995; Goebel et al., 2006).”
MethodInfluentialDurston, S. (2003) · NeuroImage · doi:10.1016/j.neuroimage.2003.08.004 · Cited by 202
“Regions of four or more contiguous voxels (P Ͻ 0.025, estimated correction P Ͻ .00025) were identified (Forman et al., 1995).”
BackgroundInfluentialDoes cerebrovascular disease affect the coupling between neuronal activity and local haemodynamics?
Rossini, P. M. (2004) · Brain · doi:10.1093/brain/awh012 · Cited by 202
“Statistical activation maps were thresholded with a voxel-wise P 0.0005 and a minimum cluster size of three voxels (Forman et al., 1995).”
MethodInfluentialTemporal lobe functional activity and connectivity in young adult APOE ɛ4 carriers
Dennis, N. A., Browndyke, J. N., Stokes, J., Need, A., Burke, J. R., Welsh‐Bohmer, K. A., & Cabeza, R. (2010) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2009.07.003 · Cited by 201
Bush, G., Spencer, T. J., Holmes, J., Shin, L. M., Valera, E. M., Seidman, L. J., Makris, N., Surman, C., Aleardi, M., Mick, E., et al. (2008) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2007.16 · Cited by 201
“8) [54-126] 90.”
Baumgartner, T. (2008) · Frontiers in Human Neuroscience · doi:10.3389/neuro.09.008.2008 · Cited by 201
“The correction for multiple comparison in wholebrain analyses was carried out using an uncorrected p value of either 0.001 or 0.005 combined with a cluster-size threshold of 10 voxels (Forman et al., 1995).”
MethodInfluentialPerformance Feedback Drives Caudate Activation in a Phonological Learning Task
Tricomi, E., Delgado, M. R., McCandliss, B. D., McClelland, J. L., & Fiez, J. A. (2006) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2006.18.6.1029 · Cited by 199
“001; this contiguity threshold serves as a precaution against type 1 errors (Forman et al., 1995).”
BackgroundThe Statistical Analysis of Functional MRI Data
(2008) · Statistics for Biology and Health · doi:10.1007/978-0-387-78191-4 · Cited by 191
Posner, J., Marsh, R., Maia, T. V., Peterson, B. S., Gruber, A., & Simpson, H. B. (2014) · Human Brain Mapping · doi:10.1002/hbm.22371 · Cited by 197
“…application of a voxel level statistical threshold and cluster filter minimizes the false-positive identification of regions at any given threshold [Forman et al., 1995] because clustering can distinguish between true connectivity between regions, and noise that has less tendency to cluster.”
BackgroundThe neural processes underlying self-agency
Nahab, F. B., Kundu, P., Gallea, C., Kakareka, J., Pursley, R., Pohida, T., Miletta, N., Friedman, J., & Hallett, M. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhq059 · Cited by 197
“The statistical correction for multiple comparisons was set by rejecting spatial clusters smaller than what would be expected by chance using Monte-Carlo simulations (Forman et al. 1995), given a voxel-wise false-positive level of P < 0.”
MethodInfluentialReddy, H. (2002) · Brain · doi:10.1093/brain/awf283 · Cited by 197
“Activation maps were calculated using Student's unpaired t-test, and cluster detection was performed on all voxels above Z = 6.0 to determine clusters signi®cantly activated (P < 0.01) (Forman et al., 1995; Poline et al., 1997).”
MethodInfluentialFusiform function in children with an Autism Spectrum Disorder is a matter of ‘who’
Pierce, K., & Redcay, E. (2008) · Biological Psychiatry · doi:10.1016/j.biopsych.2008.05.013 · Cited by 196
Neural representation of interval encoding and decision making
Harrington, D. L., Boyd, L. A., Mayer, A. R., Sheltraw, D. M., Lee, R. R., Huang, M., & Rao, S. M. (2004) · Cognitive Brain Research · doi:10.1016/j.cogbrainres.2004.01.010 · Cited by 195
Cannon, T. D., Glahn, D. C., Kim, J., Van Erp, T. G. M., Karlsgodt, K., Cohen, M. S., Nuechterlein, K. H., Bava, S., & Shirinyan, D. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.10.1071 · Cited by 196
“05) of activation.(38,39) To make the results from these group comparisons comparable to others in the literature, the common space brain was normalized into a standard stereotactic space.”
ResultSalomons, T. V., Johnstone, T., Backonja, M.-M., Shackman, A. J., & Davidson, R. J. (2007) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2007.19.6.993 · Cited by 195
“Z (Gaussianized T/F) statistic images were thresholded at a voxelwise p < .01, with a cluster-based correction for multiple comparisons using Gaussian random field theory (Forman et al., 1995; Friston, Worsley, Frakowiak, Mazziotta, & Evans, 1994; Worsley, Evans, Marrett, & Neelin, 1992).”
MethodAnticipation of emotionally aversive visual stimuli activates right insula
Simmons, A., Matthews, S. C., Stein, M. B., & Paulus, M. P. (2004) · NeuroReport · doi:10.1097/00001756-200410050-00024 · Cited by 195
“A threshold adjustment method based on Monte-Carlo simulations was used to guard against identifying false positive areas of activation [17].”
MethodZhao, F., Zhao, T., Zhou, L., Wu, Q., & Hu, X. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.07.063 · Cited by 194
“3 and a cluster size threshold of 4 were used to threshold the functional connectivity maps (p<4×10, taking into account the reduced degrees of freedom in the low-pass filtered data) (Forman et al., 1995; Press et al., 1992).”
MethodInfluentialEmotion-Modulated Performance and Activity in Left Dorsolateral Prefrontal Cortex.
Herrington, J. D., Mohanty, A., Koven, N. S., Fisher, J. E., Stewart, J. L., Banich, M. T., Webb, A. G., Miller, G. A., & Heller, W. (2005) · Emotion · doi:10.1037/1528-3542.5.2.200 · Cited by 195
“This combination of thresholds results in a false positive probability of .00001 for each voxel (Forman et al., 1995, p. 642, Table 2).”
BackgroundCROSSON, B., BENEFIELD, H., CATO, M. A., SADEK, J. R., MOORE, A. B., WIERENGA, C. E., GOPINATH, K., SOLTYSIK, D., BAUER, R. M., AUERBACH, E. J., et al. (2003) · Journal of the International Neuropsychological Society · doi:10.1017/s135561770397010x · Cited by 195
“(This approach to defining cluster size and probability thresholds was derived from the work of Bullmore et al., 1996, and Forman et al., 1995.)”
MethodHayes, J. P., LaBar, K. S., McCarthy, G., Selgrade, E., Nasser, J., Dolcos, F., & Morey, R. A. (2011) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2010.10.007 · Cited by 195
“05 was imposed to protect against false positive detection of activation clusters (Forman et al., 1995; Friston et al., 1993; Worsley et al., 1992).”
Medial cortex activity, self-reflection and depression
Johnson, M. K., Nolen-Hoeksema, S., Mitchell, K. J., & Levin, Y. (2009) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsp022 · Cited by 194
A comparison of statistical methods for detecting context-modulated functional connectivity in fMRI
Cisler, J. M., Bush, K., & Steele, J. S. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.09.018 · Cited by 192
“…to identify voxels with significant contextmodulated FC with the seed region consisted of one-sample t-tests using cluster-level thresholding,with a corrected p b .05 cluster defined as 17 contiguous voxels surviving an uncorrected p b 0.005 based on Monte Carlo simulations (Forman et al., 1995).”
MethodInfluentialAberrant functional connectivity in autism: Evidence from low-frequency BOLD signal fluctuations
Noonan, S. K., Haist, F., & Müller, R.-A. (2009) · Brain Research · doi:10.1016/j.brainres.2008.12.076 · Cited by 194
“A combined voxel-cluster threshold was used to correct for multiple comparisons (Forman et al., 1995), resulting in a corrected significance level of α = 0.”
InfluentialOxytocin receptor gene methylation: converging multilevel evidence for a role in social anxiety
Ziegler, C., Dannlowski, U., Bräuer, D., Stevens, S., Laeger, I., Wittmann, H., Kugel, H., Dobel, C., Hurlemann, R., Reif, A., et al. (2015) · Neuropsychopharmacology · doi:10.1038/npp.2015.2 · Cited by 193
Color of Scents: Chromatic Stimuli Modulate Odor Responses in the Human Brain
Österbauer, R. A., Matthews, P. M., Jenkinson, M., Beckmann, C. F., Hansen, P. C., & Calvert, G. A. (2005) · Journal of Neurophysiology · doi:10.1152/jn.00555.2004 · Cited by 193
Mayer, J. S., Roebroeck, A., Maurer, K., & Linden, D. E. J. (2010) · Human Brain Mapping · doi:10.1002/hbm.20850 · Cited by 192
“To correct for multiple comparisons we performed a cluster-size thresholding [Forman et al., 1995] that makes use of a Monte Carlo simulation (1,000 iterations).”
MethodCompensatory recruitment after sleep deprivation and the relationship with performance
Drummond, S. P. A., Meloy, M. J., Yanagi, M. A., Orff, H. J., & Brown, G. G. (2005) · Psychiatry Research: Neuroimaging · doi:10.1016/j.pscychresns.2005.06.007 · Cited by 192
“For both approaches, we used a cluster threshold method to protect against Type I error (Forman et al., 1995).”
MethodAmboni, M., Tessitore, A., Esposito, F., Santangelo, G., Picillo, M., Vitale, C., Giordano, A., Erro, R., de Micco, R., Corbo, D., et al. (2015) · Journal of Neurology · doi:10.1007/s00415-014-7591-5 · Cited by 192
“html) with default parameters incorporating the DARTEL toolbox, which was used to obtain a highdimensional normalization protocol [41].”
BackgroundMethodMay, J. C., Delgado, M. R., Dahl, R. E., Stenger, V. A., Ryan, N. D., Fiez, J. A., & Carter, C. S. (2004) · Biological Psychiatry · doi:10.1016/j.biopsych.2003.11.008 · Cited by 192
Wise, R. (2002) · NeuroImage · doi:10.1006/nimg.2002.1146 · Cited by 192
Wei, G., & Luo, J. (2010) · Brain Research · doi:10.1016/j.brainres.2009.08.014 · Cited by 191
Neural Correlates of Working Memory Performance in Primary Insomnia
Drummond, S. P. A., Walker, M., Almklov, E., Campos, M., Anderson, D. E., & Straus, L. D. (2013) · Sleep · doi:10.5665/sleep.2952 · Cited by 191
“The omnibus MANOVA for subjective perceptions of performance was not significant [F(4,37) = 1.”
BackgroundTrait Anxiety Modulates the Neural Efficiency of Inhibitory Control
Basten, U., Stelzel, C., & Fiebach, C. J. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00003 · Cited by 191
“This approach is based on the assumption that meaningful activation in fMRI is spatially clustered and that this clustering provides protection against Type 1 error (Forman et al., 1995).”
BackgroundStaines, W. R., Graham, S. J., Black, S. E., & McIlroy, W. E. (2002) · NeuroImage · doi:10.1006/nimg.2001.0953 · Cited by 189
Deficient Activity in the Neural Systems That Mediate Self-regulatory Control in Bulimia Nervosa
Marsh, R., Steinglass, J. E., Gerber, A. J., Graziano O’Leary, K., Wang, Z., Murphy, D., Walsh, B. T., & Peterson, B. S. (2009) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2008.504 · Cited by 190
Moses-Kolko, E. L., Perlman, S. B., Wisner, K. L., James, J., Saul, A. T., & Phillips, M. L. (2010) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2010.09081235 · Cited by 190
Sinha, R., Lacadie, C., Skudlarski, P., Fulbright, R. K., Rounsaville, B. J., Kosten, T. R., & Wexler, B. E. (2005) · Psychopharmacology · doi:10.1007/s00213-005-0147-8 · Cited by 190
“Combining the significance threshold with a cluster filter is a conservative and yet efficient way to examine the data (Forman et al. 1995).”
BackgroundDistributed changes in default-mode resting-state connectivity in multiple sclerosis
Bonavita, S., Gallo, A., Sacco, R., Corte, M. D., Bisecco, A., Docimo, R., Lavorgna, L., Corbo, D., Costanzo, A. D., Tortora, F., et al. (2011) · Multiple Sclerosis Journal · doi:10.1177/1352458510394609 · Cited by 188
“05 applied to all voxels, a minimum cluster size was calculated that protected against false positive clusters at 5% after 500 Montecarlo simulations.(27) Individual ICA z-scores were also extracted from DMN regions identified in the above analyses and used in linear correlation analyses with T2-LL volumes (see below)…”
MethodComprehending Prehending: Neural Correlates of Processing Verbs with Motor Stems
Rüschemeyer, S.-A., Brass, M., & Friederici, A. D. (2007) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2007.19.5.855 · Cited by 188
“To protect against falsepositive activation a double threshold was applied, by which only regions with a Z score exceeding 3.09 ( p .001, uncorrected) and a volume exceeding five voxels (135 mm3) were considered (Forman et al., 1995).”
BackgroundMethodInfluentialUddin, L. Q., Menon, V., Young, C. B., Ryali, S., Chen, T., Khouzam, A., Minshew, N. J., & Hardan, A. Y. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.07.014 · Cited by 187
Aizenstein, H. J., Butters, M. A., Wu, M., Mazurkewicz, L. M., Stenger, V. A., Gianaros, P. J., Becker, J. T., Reynolds, C. F., & Carter, C. S. (2009) · The American Journal of Geriatric Psychiatry · doi:10.1097/jgp.0b013e31817b60af · Cited by 187
Meltzer, J. A., Negishi, M., Mayes, L. C., & Constable, R. T. (2007) · Clinical Neurophysiology · doi:10.1016/j.clinph.2007.07.023 · Cited by 187
“To correct for multiple comparisons across voxels, a minimum cluster size threshold was adopted (Forman et al., 1995).”
MethodLeidy, H. J., Ortinau, L. C., Douglas, S. M., & Hoertel, H. A. (2013) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.112.053116 · Cited by 187
“To identify significant activations in a priori regions, a clusterlevel statistical threshold was applied to correct for multiple comparisons (22, 23).”
MethodDynamics of language reorganization after left temporo-parietal and frontal stroke
Stockert, A., Wawrzyniak, M., Klingbeil, J., Wrede, K., Kümmerer, D., Hartwigsen, G., Kaller, C. P., Weiller, C., & Saur, D. (2020) · Brain · doi:10.1093/brain/awaa023 · Cited by 183
Barch, D. M., Sabb, F. W., Carter, C. S., Braver, T. S., Noll, D. C., & Cohen, J. D. (1999) · NeuroImage · doi:10.1006/nimg.1999.0500 · Cited by 186
Self-citationStatistical limitations in functional neuroimaging II. Signal detection and statistical inference
Petersson, K. M., Nichols, T. E., Poline, J.-B., & Holmes, A. P. (1999) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1999.0478 · Cited by 186
“Other simulation approaches using the suprathreshold cluster size statistic have also been described for PET (Roland et al. 1993; Ledberg et al. 1998) and fMRI data (Forman et al. 1995).”
BackgroundMethodInfluentialHohmeister, J., Kroll, A., Wollgarten-Hadamek, I., Zohsel, K., Demirakça, S., Flor, H., & Hermann, C. (2010) · Pain · doi:10.1016/j.pain.2010.04.004 · Cited by 187
“[33], a cluster size criterion of k P 10 was defined as a means to control the probability of false positives.”
BackgroundPERLSTEIN, W. M., COLE, M. A., DEMERY, J. A., SEIGNOUREL, P. J., DIXIT, N. K., LARSON, M. J., & BRIGGS, R. W. (2004) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617704105110 · Cited by 185
“Voxel-wise statistical maps were generated for each pattern of interest and then thresholded for significance using a cluster-size algorithm that protects against an inflation of the false-positive rate with multiple comparisons (Forman et al., 1995).”
Method“Thinking about Not-Thinking”: Neural Correlates of Conceptual Processing during Zen Meditation
Pagnoni, G., Cekic, M., & Guo, Y. (2008) · PLoS ONE · doi:10.1371/journal.pone.0003083 · Cited by 186
“These values were determined by a Monte Carlo simulation of the cluster size distribution under the null hypothesis [63] to yield a familywise error rate of a,0.”
MethodLeung, H.-C., & Cai, W. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2837-07.2007 · Cited by 185
Response-Selection-Related Parietal Activation during Number Comparison
Göbel, S. M., Johansen-Berg, H., Behrens, T., & Rushworth, M. F. S. (2004) · Journal of Cognitive Neuroscience · doi:10.1162/0898929042568442 · Cited by 185
“Cluster detection was applied to the group Z (Gaussianized T ) statistic images determined by Z > 2.7 and a corrected cluster extent significance threshold of p = .01 (Forman et al., 1995; Friston, Worsley, Frackowiak, Mazziotta, & Evans, 1994; Worsley, Evans, Marrett, & Neelin, 1992).”
MethodInfluentialAnhedonia and Emotional Experience in Schizophrenia: Neural and Behavioral Indicators
Dowd, E. C., & Barch, D. M. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2009.10.020 · Cited by 184
Eslinger, P. J., Moore, P., Anderson, C., & Grossman, M. (2011) · Journal of Neuropsychiatry · doi:10.1176/appi.neuropsych.23.1.74 · Cited by 184
“05, corrected for multiple comparisons in this neuroanatomic distribution.(41) Regression-analyses related IRI Perspective-Taking and Empathic Concern scores to gray-matter atrophy derived from contrast of cortical atrophy in the bvFTD group with the control subjects.”
MethodThe emergence of the unmarked: A new perspective on the language‐specific function of Broca's area
Grewe, T., Bornkessel, I., Zysset, S., Wiese, R., von Cramon, D. Y., & Schlesewsky, M. (2005) · Human Brain Mapping · doi:10.1002/hbm.20154 · Cited by 184
“To protect against false positive activations, only regions with a z score greater than 3.1 (P 0.001 uncorrected) and with a volume greater than 216 mm3 (6 measured voxels) were considered [Braver and Bongiolatti, 2002; Forman et al., 1995].”
BackgroundMethodInfluentialWatson, A., El-Deredy, W., Iannetti, G. D., Lloyd, D., Tracey, I., Vogt, B. A., Nadeau, V., & Jones, A. K. P. (2009) · Pain · doi:10.1016/j.pain.2009.04.003 · Cited by 184
“The use of a combined height and cluster threshold is a standard and generally accepted method to solve the problem of multiple comparisons with functional imaging data [11,12,48].”
The Left Posterior Superior Temporal Gyrus Participates Specifically in Accessing Lexical Phonology
Graves, W. W., Grabowski, T. J., Mehta, S., & Gupta, P. (2008) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2008.20113 · Cited by 183
“It is based on a technique employed by McDermott, Petersen, Watson, and Ojemann (2003), who used Monte Carlo simulations on random noise following a method described by Forman et al. (1995).”
MethodPfefferbaum, A., Sullivan, E. V., Hedehus, M., Lim, K. O., Adalsteinsson, E., & Moseley, M. (2000) · Magnetic Resonance in Medicine · doi:10.1002/1522-2594(200008)44:2<259::aid-mrm13>3.0.co;2-6 · Cited by 595
Knowing When to Stop: The Brain Mechanisms of Chasing Losses
Campbell-Meiklejohn, D. K., Woolrich, M. W., Passingham, R. E., & Rogers, R. D. (2008) · Biological Psychiatry · doi:10.1016/j.biopsych.2007.05.014 · Cited by 182
Catarino, A., Andrade, A., Churches, O., Wagner, A. P., Baron-Cohen, S., & Ring, H. (2013) · Molecular Autism · doi:10.1186/2040-2392-4-1 · Cited by 183
“frequency clusters, increasing the likelihood of these differences being meaningful [69], correction for multiple comparisons was still performed.”
BackgroundRoth, R. M., Saykin, A. J., Flashman, L. A., Pixley, H. S., West, J. D., & Mamourian, A. C. (2007) · Biological Psychiatry · doi:10.1016/j.biopsych.2006.12.007 · Cited by 181
Reynolds, J. R., West, R., & Braver, T. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhn164 · Cited by 181
The large-Scale Organization of “Visual” Streams Emerges Without Visual Experience
Striem-Amit, E., Dakwar, O., Reich, L., & Amedi, A. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhr253 · Cited by 181
“The minimum significance level of all results presented in the study was set to P < 0.05 taking into account the probability of a false detection for any given cluster (Forman et al. 1995), thus correcting for multiple comparisons.”
MethodResultInfluentialTabert, M. H., Borod, J. C., Tang, C. Y., Lange, G., Wei, T. C., Johnson, R., Nusbaum, A. O., & Buchsbaum, M. S. (2001) · Neuropsychologia · doi:10.1016/s0028-3932(00)00157-3 · Cited by 181
“001 and the 4-pixel cluster-size constraint are thought to be adequate corrections for multiple comparisons [42], our resampling criterion was more conservative.”
Sentence Reading: A Functional MRI Study at 4 Tesla
Bavelier, D., Corina, D., Jezzard, P., Padmanabhan, S., Clark, V. P., Karni, A., Prinster, A., Braun, A., Lalwani, A., Rauschecker, J. P., et al. (1997) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1997.9.5.664 · Cited by 181
“The effects of spatial filtering on such a distribution of activation deserves consideration (Forman et al., 1995; Friston, Worsley, Frackowiak, Mazziotta, & Evans, 1994; Poline & Mazoyer, 1993).”
BackgroundCosta Dias, T. G., Wilson, V. B., Bathula, D. R., Iyer, S. P., Mills, K. L., Thurlow, B. L., Stevens, C. A., Musser, E. D., Carpenter, S. D., Grayson, D. S., et al. (2013) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2012.10.015 · Cited by 180
“To account for multiple comparisons, thresholding based on Monte Carlo simulation was implemented (Forman et al., 1995).”
MethodBurton, H., Diamond, J. B., & McDermott, K. B. (2003) · Journal of Neurophysiology · doi:10.1152/jn.00279.2003 · Cited by 180
“…obtain t-statistics per voxel, which were converted to normally distributed z-scores and corrected for multiple comparisons across the entire brain volume using distributions obtained from prior Monte Carlo simulations on random noise patterns [based on methods described in Forman et al. (1995)].”
MethodSpecific Brain Networks during Explicit and Implicit Decoding of Emotional Prosody
Frühholz, S., Ceravolo, L., & Grandjean, D. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhr184 · Cited by 179
“The study was approved by the local ethics committee.”
BackgroundMethodInfluentialWeissman, D. H., Giesbrecht, B., Song, A. W., Mangun, G. R., & Woldorff, M. G. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00167-8 · Cited by 178
“Using the atlas of Talaraich and Tournoux (1988), we isolated 255 dACC voxels within this activated region, each of which was reliably activated by targets, F(11,143) 3.06, P 0.001, and part of a cluster consisting of 10 or more activated voxels (Forman et al., 1995; Xiong et al., 1995).”
MethodInfluentialGraves, W. W., Grabowski, T. J., Mehta, S., & Gordon, J. K. (2007) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2007.19.4.617 · Cited by 178
“This combination of uncorrected p value and spatial extent threshold is based on that derived by McDermott, Petersen, Watson, and Ojemann (2003), who used Monte Carlo simulations on random noise following a method described by Forman et al. (1995). The thresholded results of the parametric analyses were then used as i…”
Cortical activity to vibrotactile stimulation: An fMRI study in blind and sighted individuals
Burton, H., Sinclair, R. J., & McLaren, D. G. (2004) · Human Brain Mapping · doi:10.1002/hbm.20064 · Cited by 178
“The t-statistic maps for each individual were converted to equally probable z-scores that were thresholded on the basis of Monte Carlo simulations [Forman et al., 1995] at a multiple-comparisons corrected false-detection rate of P 0.05 (z 4) over at least 6 contiguous, face-connected voxels.”
MethodInfluentialRight anterior temporal lobe dysfunction underlies theory of mind impairments in semantic dementia
Irish, M., Hodges, J. R., & Piguet, O. (2014) · Brain · doi:10.1093/brain/awu003 · Cited by 176
“This cluster thresholding approach has been demonstrated to be an effective tool to reduce the risk of false positive findings without compromising the statistical power of the study (Forman et al., 1995) and thus allows us confidence in our findings.”
Gerber, A. J., Posner, J., Gorman, D., Colibazzi, T., Yu, S., Wang, Z., Kangarlu, A., Zhu, H., Russell, J., & Peterson, B. S. (2008) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2008.02.032 · Cited by 177
“3, for a sample of 10 subjects) conjointly with a minimum cluster size of 30 voxels to control for multiple comparisons and minimize Type I error (Forman et al., 1995).”
BackgroundMethodInfluentialNeural networks underlying endogenous and exogenous visual–spatial orienting
Mayer, A. R., Dorflinger, J. M., Rao, S. M., & Seidenberg, M. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.06.027 · Cited by 177
“To minimize false positives, a minimum cluster size of 0.25 ml was also required ( Forman et al., 1995 ).”
BackgroundInfluentialBrain mechanisms underlying the impact of attachment-related stress on social cognition
Nolte, T., Bolling, D. Z., Hudac, C. M., Fonagy, P., Mayes, L., & Pelphrey, K. A. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00816 · Cited by 176
Rising Sound Intensity: An Intrinsic Warning Cue Activating the Amygdala
Bach, D. R., Schachinger, H., Neuhoff, J. G., Esposito, F., Salle, F. D., Lehmann, C., Herdener, M., Scheffler, K., & Seifritz, E. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhm040 · Cited by 176
“Volunteers who participated in the psychoacoustic experiment were not enrolled in the fMRI study.”
MethodMukai, I., Kim, D., Fukunaga, M., Japee, S., Marrett, S., & Ungerleider, L. G. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.3002-07.2007 · Cited by 176
“The p values of the results of the voxelwise multiple comparisons were corrected using a familywise correction (Forman et al., 1995) by setting the individual Figure 2.”
InfluentialPrenatal Alcohol Exposure Affects Frontal–Striatal BOLD Response During Inhibitory Control
Fryer, S. L., Tapert, S. F., Mattson, S. N., Paulus, M. P., Spadoni, A. D., & Riley, E. P. (2007) · Alcoholism: Clinical and Experimental Research · doi:10.1111/j.1530-0277.2007.00443.x · Cited by 176
“The size of the cluster threshold was determined by a Monte-Carlo simulationbased algorithm using a 4 mm connectivity radius to define areas of contiguous activation (Forman et al., 1995).”
MethodAtypical involvement of frontostriatal systems during sensorimotor control in autism
Takarae, Y., Minshew, N. J., Luna, B., & Sweeney, J. A. (2007) · Psychiatry Research: Neuroimaging · doi:10.1016/j.pscychresns.2007.03.008 · Cited by 171
“A contiguity threshold for the whole brain (Forman et al., 1995) was used (minimum of 67 contiguous Fig.”
MethodChepenik, L. G., Raffo, M., Hampson, M., Lacadie, C., Wang, F., Jones, M. M., Pittman, B., Skudlarski, P., & Blumberg, H. P. (2010) · Psychiatry Research: Neuroimaging · doi:10.1016/j.pscychresns.2010.04.002 · Cited by 175
“05 and cluster sizeN20 adjacent pixels (Forman et al., 1995).”
Acute Stress Influences Neural Circuits of Reward Processing
Porcelli, A. J., Lewis, A. H., & Delgado, M. R. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00157 · Cited by 175
“Correction Correction for multiple comparisons was verified through the use of cluster-size thresholding (Forman et al., 1995; Goebel et al., 2006).”
The Grid Method for In‐plane Displacement and Strain Measurement: A Review and Analysis
Grédiac, M., Sur, F., & Blaysat, B. (2016) · Strain · doi:10.1111/str.12182 · Cited by 177
“Interestingly, a similar problem arises in positron emission tomography (PET), a functional magnetic resonance imaging (FMRI), also affected by a correlated noise (see, for instance, [178]).”
BackgroundWolf, R. C., Plichta, M. M., Sambataro, F., Fallgatter, A. J., Jacob, C., Lesch, K., Herrmann, M. J., Schönfeldt‐Lecuona, C., Connemann, B. J., Grön, G., et al. (2009) · Human Brain Mapping · doi:10.1002/hbm.20665 · Cited by 170
“Being a priori driven, the statistical threshold for this between-group comparison was set at P 0.005, and a spatial contiguity criterion of 25 adjacent voxels [Forman et al., 1995].”
BackgroundInfluentialAmygdala reactivity to emotional faces predicts improvement in major depression
Canli, T., Cooney, R. E., Goldin, P., Shah, M., Sivers, H., Thomason, M. E., Whitfield-Gabrieli, S., Gabrieli, J. D. E., & Gotlib, I. H. (2005) · NeuroReport · doi:10.1097/01.wnr.0000174407.09515.cc · Cited by 174
“0005 (extrapolated from Forman and colleagues [16]).”
Metadata
- Authors
- Forman, S. D., Cohen, J. D., Fitzgerald, M., Eddy, W. F., Mintun, M. A., & Noll, D. C.
- Affiliations
- University of Pittsburgh (US)
- Corresponding author
- Forman, Steven D.
- Venue
- Magnetic Resonance in Medicine
- Publisher
- Wiley
- Published
- 1995-05
- Volume
- 33
- Issue
- 5
- Pages
- 636-647
- ISSN
- 0740-3194 (ISSN-L)
- 1522-2594
- OpenAlex
- W2044634376
- Cited by
- 3,202
- References
- 11
- Citations by year
- 2026: 27 · 2025: 26 · 2024: 30 · 2023: 36 · 2022: 45 · 2021: 55 · 2020: 64 · 2019: 75 · 2018: 96 · 2017: 137 · 2016: 140 · 2015: 188 · 2014: 203 · 2013: 213 · 2012: 242
- FWCI
- 14.83
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Magnetic Resonance in Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Functional Brain Connectivity Studies
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Advanced MRI Techniques and Applications
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Advanced Neuroimaging Techniques and Applications
- Keywords
- multiple comparisons, false positives, statistical power, fMRI activation detection, Monte Carlo simulation, cluster size distribution
- MeSH terms
- Brain, Data Interpretation, Statistical, False Positive Reactions, Humans, Magnetic Resonance Imaging, Monte Carlo Method, Probability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.