Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): use of a cluster-size threshold
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
The typical functional magnetic resonance (fMRI) study presents a formidable problem of multiple statistical comparisons (i.e., > 10,000 in a 128 x 128 image). To protect against false positives, investigators have typically relied on decreasing the per pixel false positive probability. This approach incurs an inevitable loss of power to detect statistically significant activity. An alternative approach, which relies on the assumption that areas of true neural activity will tend to stimulate signal changes over contiguous pixels, is presented. If one knows the probability distribution of such cluster sizes as a function of per pixel false positive probability, one can use cluster-size thresholds independently to reject false positives. Both Monte Carlo simulations and fMRI studies of human subjects have been used to verify that this approach can improve statistical power by as much as fivefold over techniques that rely solely on adjusting per pixel false positive probabilities.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For all analyses, we determined cluster-size thresholds using Monte Carlo simulations in AFNI’s 3DClustSim (http://afni.nimh.nih.gov/afni/) which allowed for improved assessment of functional activation and correction for multiple comparisons (Forman et al., 1995) based on a grey matter mask.”
From Self-referential processing during observation of a speech performance task in social anxiety disorder from pre- to post-treatment: Evidence of disrupted neural activation (2019) · cites this paper as Forman et al., 1995
In the citing paper
“Two criteria were employed in evaluating activations: (i) only regions with peak voxels of P < 0.001 were considered; (ii) only clusters of activation including k !6 voxels in which all voxels met an uncorrected threshold of P < 0.005 were considered, yielding a functional threshold equivalent of P < 0.001 according to cluster size significance level corrections (Forman et al., 1995).”
From Attending to the present: mindfulness meditation reveals distinct neural modes of self-reference (2007) · cites this paper as Forman et al., 1995
In the citing paper
“Cluster thresholding was applied to increase power in identifying heavily recruited neural areas while maintaining a reasonably low Type-I error rate (Forman et al., 1995).”
From Attending to the present: mindfulness meditation reveals distinct neural modes of self-reference (2007) · cites this paper as Forman et al., 1995
In the citing paper
“For all FC analyses, a double statistical threshold (voxel-wise p < 0.01 and cluster size ≥ 78 voxels, as determined by AlphaSim with 10,000 Monte Carlo simulations) was used to obtain an alpha < 0.05 (corrected for multiple comparisons) (see details on the procedure at http://afni.nimh.nih.gov/afni/doc/manual/AlphaSim and in [30]).”
From Structural and Functional Cerebral Correlates of Hypnotic Suggestibility (2014) · cites this paper as [30]
In the citing paper
“The resulting maps from all participants in the HFA group and all participants in the control group were averaged and these group-averaged t-maps were displayed on group composite anatomical images with a statistical threshold of p < .001, adjusted for multiple comparisons with a cluster-filter of 10 contiguous pixels (42).”
From The Neural Circuitry Mediating Shifts in Behavioral Response and Cognitive Set in Autism (2008) · cites this paper as [42]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Self-citationNumerical recipes in C: the art of scientific computing
(1993) · Choice Reviews Online · doi:10.5860/choice.30-5638 · Cited by 17,933
A three-dimensional statistical analysis for CBF activation studies in human brain
Worsley, K. J., Evans, A. C., Marrett, S., & Neelin, P. (1992) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1992.127 · Cited by 2,036
Assessing the significance of focal activations using their spatial extent
Friston, K. J., Worsley, K. J., Frackowiak, R. S. J., Mazziotta, J. C., & Evans, A. C. (1994) · Human Brain Mapping · doi:10.1002/hbm.460010306 · Cited by 1,907
Comparing Functional (PET) Images: The Assessment of Significant Change
Friston, K. J., Frith, C. D., Liddle, P. F., & Frackowiak, R. S. J. (1991) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1991.122 · Cited by 1,625
MRI-PET Registration with Automated Algorithm
Woods, R. P., Mazziotta, J. C., & R. Cherry, A. S. (1993) · Journal of Computer Assisted Tomography · doi:10.1097/00004728-199307000-00004 · Cited by 1,617
The Relationship between Global and Local Changes in PET Scans
Friston, K. J., Frith, C. D., Liddle, P. F., Dolan, R. J., Lammertsma, A. A., & Frackowiak, R. S. J. (1990) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1990.88 · Cited by 858
Activation of the prefrontal cortex in a nonspatial working memory task with functional MRI
Cohen, J. D., Forman, S. D., Braver, T. S., Casey, B. J., Servan‐Schreiber, D., & Noll, D. C. (1994) · Human Brain Mapping · doi:10.1002/hbm.460010407 · Cited by 576
Self-citationSpiral K‐space MR imaging of cortical activation
Noll, D. C., Cohen, J. D., Meyer, C. H., & Schneider, W. (1995) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.1880050112 · Cited by 254
Self-citationPoline, J.-B., & Mazoyer, B. M. (1993) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1993.57 · Cited by 155
Cited by
Items 1,001–1,095 of 1,095
Lacey, S., Flueckiger, P., Stilla, R., Lava, M., & Sathian, K. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.10.081 · Cited by 88
“…(corrected p<0.05) was achieved by imposing a threshold for the volume of clusters comprising contiguous voxels that passed a voxel-wise threshold of p<0.05, using a 3D extension (implemented in BrainVoyager QX) of the 2D Monte Carlo simulation procedure described by Forman et al. (1995).”
InfluentialGilbert, A. R., Akkal, D., Almeida, J. R. C., Mataix-Cols, D., Kalas, C., Devlin, B., Birmaher, B., & Phillips, M. L. (2009) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/chi.0b013e3181b2163c · Cited by 86
Perinatal maternal depressive symptoms alter amygdala functional connectivity in girls
Soe, N. N., Wen, D. J., Poh, J. S., Chong, Y., Broekman, B. F., Chen, H., Shek, L. P., Tan, K. H., Gluckman, P. D., Fortier, M. V., et al. (2018) · Human Brain Mapping · doi:10.1002/hbm.23873 · Cited by 86
“…significant when p-value was less than 0.001 at individual voxels and cluster size was greater than 28 voxels that was determined via Monte Carlo simulation using the new version of 3dFWHMx and 3dClustSim with option of ACF in AFNI (Forman et al., 1995) at a corrected cluster p .05/12 (50.0042).”
MethodInfluentialAnterior insula reactivity during certain decisions is associated with neuroticism
Feinstein, J. S., Stein, M. B., & Paulus, M. P. (2006) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsl016 · Cited by 85
“A threshold adjustment method based on Monte Carlo simulations was used to guard against identifying false positive areas of activation (Forman et al., 1995).”
MethodKastman, E. K., Willette, A. A., Coe, C. L., Bendlin, B. B., Kosmatka, K. J., McLaren, D. G., Xu, G., Canu, E., Field, A. S., Alexander, A. L., et al. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.0835-10.2010 · Cited by 85
“Multiple-comparison correction was performed using estimates from a Monte Carlo simulation with Al- phaSim (http://afni.nimh.nih.gov/pub/dist/doc/manual/AlphaSim.pdf) to achieve a corrected cluster-level 0.05 (Forman et al., 1995).”
InfluentialComplementary roles of human hippocampal subregions during retrieval of spatiotemporal context
Copara, M. S., Hassan, A. S., Kyle, C. T., Libby, L. A., Ranganath, C., & Ekstrom, A. D. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.5341-13.2014 · Cited by 85
“We used a voxelwise p value of 0.01, which resulted in a cluster threshold of k 16 and a corrected p value of p 0.05 (Forman et al., 1995).”
InfluentialEarly life stress is associated with default system integrity and emotionality during infancy
Graham, A. M., Pfeifer, J. H., Fisher, P. A., Carpenter, S., & Fair, D. A. (2015) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12409 · Cited by 84
“Thresholding based on Monte Carlo simulation was implemented to account for multiple comparisons (Forman et al., 1995).”
MethodSchechter, D. S., Moser, D. A., Wang, Z., Marsh, R., Hao, X., Duan, Y., Yu, S., Gunter, B., Murphy, D., McCaw, J., et al. (2012) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsr069 · Cited by 84
Qin, S., Cousijn, H., Rijpkema, M., Luo, J., Franke, B., Hermans, E. J., & Fernández, G. (2012) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2012.00016 · Cited by 83
“…error of mean. an unbiased, anatomically defined, gray matter mask of the PFC covering the entire prefrontal areas, by using non-stationary suprathreshold cluster-size approach based on Monte-Carlo simulations (Forman et al., 1995; Ward, 2000; Nichols and Hayasaka, 2003; Hayasaka et al., 2004).”
BackgroundMethodInfluentialInteroceptive awareness moderates neural activity during decision-making
Werner, N. S., Schweitzer, N., Meindl, T., Duschek, S., Kambeitz, J., & Schandry, R. (2013) · Biological Psychology · doi:10.1016/j.biopsycho.2013.09.002 · Cited by 80
Thaler, L., Milne, J. L., Arnott, S. R., Kish, D., & Goodale, M. A. (2014) · Journal of Neurophysiology · doi:10.1152/jn.00501.2013 · Cited by 81
“To control the rate of type I errors in the statistical map, we applied a cluster size threshold (Forman et al. 1995).”
MethodEarly development of subcortical regions involved in non-cued attention switching
Casey, B. J., Davidson, M. C., Hara, Y., Thomas, K. M., Martinez, A., Galvan, A., Halperin, J. M., Rodríguez‐Aranda, C. E., & Tottenham, N. (2004) · Developmental Science · doi:10.1111/j.1467-7687.2004.00377.x · Cited by 80
“Significant regions of MR signal change were identified by F ratios with p .01 and a cluster size of 5 voxels minimum (estimated corrected p < .00002, Forman et al., 1995) in the scanned plane (coronal).”
Marsh, R., Horga, G., Parashar, N., Wang, Z., Peterson, B. S., & Simpson, H. B. (2014) · Biological Psychiatry · doi:10.1016/j.biopsych.2013.02.004 · Cited by 79
“The combined application of a statistical threshold and cluster filter minimizes the false-positive identification of activated regions at any given threshold (42), because clustering can distinguish between true regions of activation that tend to occur over adjacent voxels and noise that has less tendency to cluster.”
Brain networks subserving the extraction of sentence information and its encoding to memory
Hasson, U., Nusbaum, H. C., & Small, S. L. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhm016 · Cited by 75
“Threshold parameters were determined by Monte Carlo simulations (Forman et al. 1995) using AFNI’s ALPHASIM routine.”
MethodDefault-Mode Network Abnormalities in Pediatric Posttraumatic Stress Disorder
Patriat, R., Birn, R. M., Keding, T. J., & Herringa, R. J. (2016) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2016.01.010 · Cited by 78
“Multiple comparison correction was performed using Monte Carlo simulation, which incorporates the estimated data smoothness to establish the likelihood of false-positive results of different cluster sizes.(33) The cluster threshold was 152 voxels at a voxelwise threshold of p 1⁄4 .”
MethodGoldin, P. R., Ziv, M., Jazaieri, H., Weeks, J., Heimberg, R. G., & Gross, J. J. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.08.005 · Cited by 77
Out of touch with reality? Social perception in first-episode schizophrenia
Ebisch, S. J. H., Salone, A., Ferri, F., De Berardis, D., Romani, G. L., Ferro, F. M., & Gallese, V. (2013) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nss012 · Cited by 77
Siep, N., Tonnaer, F., van de Ven, V., Arntz, A., Raine, A., & Cima, M. (2019) · Brain Imaging and Behavior · doi:10.1007/s11682-018-9945-6 · Cited by 77
Fronto-limbic circuitry in euthymic bipolar disorder: Evidence for prefrontal hyperactivation
Robinson, J. L., Monkul, E. S., Tordesillas-Gutiérrez, D., Franklin, C., Bearden, C. E., Fox, P. T., & Glahn, D. C. (2008) · Psychiatry Research: Neuroimaging · doi:10.1016/j.pscychresns.2007.12.004 · Cited by 75
Ziv, M., Goldin, P. R., Jazaieri, H., Hahn, K. S., & Gross, J. J. (2013) · Biology of Mood & Anxiety Disorders · doi:10.1186/2045-5380-3-20 · Cited by 74
“To correct for multiple comparisons, AlphaSim, a Monte Carlo simulation bootstrapping program in the AFNI library, was used to protect against false positives [27].”
MethodThe role of arousal in the spontaneous regulation of emotions in healthy aging: a fMRI investigation
Dolcos, S., Katsumi, Y., & Dixon, R. A. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00681 · Cited by 73
“…when used in conjunction, the statistical and extent thresholds used for the current analyses offer the best balance between Type I and II errors and result in a statistical value that is within the acceptable criterion for publication (Forman et al., 1995; Lieberman and Cunningham, 2009).”
BackgroundFunctional Connectivity Disruption in Neonates with Prenatal Marijuana Exposure
Grewen, K., Salzwedel, A. P., & Gao, W. (2015) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2015.00601 · Cited by 72
“Significance was determined using a combined approach (Forman et al., 1995), which imposes a minimum p-value (i.e., p 0.01) and cluster size (32 voxels) threshold to correct for multiple comparisons (α 0.05) at the whole-brain level.”
MethodInfluentialFrontoparietal mechanisms supporting attention to location and intensity of painful stimuli
Lobanov, O. V., Quevedo, A. S., Hadsel, M. S., Kraft, R. A., & Coghill, R. C. (2013) · Pain · doi:10.1016/j.pain.2013.05.030 · Cited by 65
“These t values were then converted to Z scores to allow P values to be calculated on the basis of Gaussian random field theory [16,19,66].”
Methodvan de Ven, V., Esposito, F., & Christoffels, I. K. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.05.057 · Cited by 72
“The between-subject group maps were thresholded at t(11)=3.1 (one-sided, P≤0.005, uncorrected), which were then each corrected at the voxel-cluster level at a false-positive rate of α=0.05 (Forman et al., 1995; Goebel et al., 2006).”
InfluentialThe aftermath of 9/11: Effect of intensity and recency of trauma on outcome.
Ganzel, B., Casey, B. J., Glover, G., Voss, H. U., & Temple, E. (2007) · Emotion · doi:10.1037/1528-3542.7.2.227 · Cited by 72
“For all analyses, results were reported as significant if they met a voxel-wise threshold of p .001, with clusters of 20 or more contiguous voxels ( Forman, Cohen, Fitzgerald, Eddy, Mintun, & Noll, 1995 ).”
MethodDambacher, F., Sack, A. T., Lobbestael, J., Arntz, A., Brugman, S., & Schuhmann, T. (2014) · European Journal of Neuroscience · doi:10.1111/ejn.12425 · Cited by 71
“0001 and 1000 Monte Carlo simulation iterations in order to correct for multiple comparisons (Forman et al., 1995), resulting in a cluster threshold of five voxels.”
BackgroundMethodInfluentialPain is associated with short leukocyte telomere length in women with fibromyalgia
Hassett, A. L., Epel, E., Clauw, D. J., Harris, R. E., Harte, S. E., Kairys, A., Buyske, S., & Williams, D. A. (2012) · The Journal of Pain · doi:10.1016/j.jpain.2012.07.003 · Cited by 70
“001 were considered significant and survived multiple comparisons based on calculations performed by the Alphasim software toolbox.(26) Regions of interest showing a significant relationship between gray matter volume and telomere length were extracted and analyzed using SPSS version 19 (SPSS Inc, Chicago, IL).”
MethodFrank, G. K., Wagner, A., Achenbach, S., McConaha, C., Skovira, K., Aizenstein, H., Carter, C. S., & Kaye, W. H. (2006) · International Journal of Eating Disorders · doi:10.1002/eat.20210 · Cited by 68
“(uncorrected for multiple comparisons), 7-voxel minimum cluster size to correct for multiple comparisons.(18) The SPSS statistical software package(19) was used for demographic”
MethodLanguage Hemispheric Dominance in Patients with Congenital Lesions of Eloquent Brain
Vikingstad, E. M., Cao, Y., Thomas, A. J., Johnson, A. F., Malik, G. M., & Welch, K. M. A. (2000) · Neurosurgery · doi:10.1227/00006123-200009000-00004 · Cited by 68
“Activated pixels were identified by a combination of complex temporal cross correlation with sine and cosine waves having the periodicity of task performance (1, 22), and cluster size thresholding (15) resulting in an estimated falsepositive rate of less than 0.”
MethodIntrinsic connectivity networks within cerebellum and beyond in eating disorders
Amianto, F., D’Agata, F., Lavagnino, L., Caroppo, P., Abbate-Daga, G., Righi, D., Scarone, S., Bergui, M., Mortara, P., & Fassino, S. (2013) · The Cerebellum · doi:10.1007/s12311-013-0471-1 · Cited by 64
“05 cluster-size threshold [30].”
The neural coding of feedback learning across child and adolescent development
Peters, S., Braams, B. R., Raijmakers, M. E. J., Koolschijn, P. C. M. P., & Crone, E. A. (2014) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00594 · Cited by 65
“We used a 10-voxel spatial extent combined with a stringent FWE-corrected intensity threshold to produce a desirable balance between Types I and II error rates (Bennett,Wolford, &Miller, 2009; Forman et al., 1995).”
MethodRepetition suppression for spoken sentences and the effect of task demands
Hasson, U., Nusbaum, H. C., & Small, S. L. (2006) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2006.18.12.2013 · Cited by 61
“05, corrected) on the basis of 1000 Monte Carlo simulations (Forman et al., 1995).”
Tricomi, E., & Fiez, J. A. (2012) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/s13415-011-0077-3 · Cited by 64
“A voxel-wise significance threshold of p < .001 was used to identify additional ROIs; a contiguity threshold of 41 voxels was also applied as a precaution against Type I errors (Forman et al., 1995).”
Norbury, R., Selvaraj, S., Taylor, M. J., Harmer, C., & Cowen, P. J. (2010) · Psychological Medicine · doi:10.1017/s0033291709990596 · Cited by 62
“1994)] is an alternative to voxel-based correction and may be more sensitive to activation under conditions where one can assume multiple contiguous activated voxels (Forman et al. 1995).”
MethodDisrupted Amygdala Reactivity in Depressed 4- to 6-Year-Old Children
Gaffrey, M. S., Barch, D. M., Singer, J., Shenoy, R., & Luby, J. L. (2013) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2013.04.009 · Cited by 62
“ROI and whole-brain analyses were corrected for multiple comparisons using combined p value/cluster size thresholds determined using Monte Carlo simulations.(39,40) Thresholds were z 1⁄4 2.”
Taking Action in the Face of Threat: Neural Synchronization Predicts Adaptive Coping
Collins, K. A., Mendelsohn, A., Cain, C. K., & Schiller, D. (2014) · The Journal of Neuroscience · doi:10.1523/jneurosci.2152-14.2014 · Cited by 61
“To correct for multiple comparisons, we used Alphasim as implemented in Neuroelf to identify a cluster size threshold ensuring an FWE rate of p 0.05 (Forman et al., 1995; Bennett et al., 2009), corresponding to an uncorrected statistical threshold of p 0.0001 and a cluster size threshold of 15…”
BackgroundMethodInfluentialIncreased working memory-related brain activity in middle-aged women with cognitive complaints
Dumas, J. A., Kutz, A. M., McDonald, B. C., Naylor, M. R., Pfaff, A. C., Saykin, A. J., & Newhouse, P. A. (2013) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2012.08.013 · Cited by 61
Neural and behavioral correlates of negative self‐focused thought associated with depression
Philippi, C. L., Cornejo, M. D., Frost, C. P., Walsh, E. C., Hoks, R. M., Birn, R., & Abercrombie, H. C. (2018) · Human Brain Mapping · doi:10.1002/hbm.24003 · Cited by 60
“To correct for multiple comparisons, we implemented a family-wise error (FWE) correction approach at the cluster level using a whole-brain mask (3dClustSim in AFNI version updated August 2016; Carp, 2012; Forman et al., 1995) and applied cluster-extent thresholding.”
MethodYarkoni, T., Gray, J. R., Chrastil, E. R., Barch, D. M., Green, L., & Braver, T. S. (2005) · Cognitive Brain Research · doi:10.1016/j.cogbrainres.2005.01.013 · Cited by 59
“05 [20,39].”
Endogenous control and task representation: an fMRI study in algebraic problem-solving
Stocco, A., & Anderson, J. R. (2008) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2008.20089 · Cited by 59
Visual-motor functional connectivity in preschool children emerges after handwriting experience
Vinci-Booher, S., James, T. W., & James, K. H. (2016) · Trends in Neuroscience and Education · doi:10.1016/j.tine.2016.07.006 · Cited by 58
“05 significance levels through Monte Carlo simulations iterated 1000 times [51].”
MethodInkster, B., Rao, A. W., Ridler, K., Nichols, T. E., Saemann, P. G., Auer, D. P., Holsboer, F., Tozzi, F., Muglia, P., Merlo-Pich, E., et al. (2011) · Journal of Neuroimaging · doi:10.1111/j.1552-6569.2010.00515.x · Cited by 56
Willette, A. A., Bendlin, B. B., McLaren, D. G., Canu, E., Kastman, E. K., Kosmatka, K. J., Xu, G., Field, A. S., Alexander, A. L., Colman, R. J., et al. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.03.015 · Cited by 55
“Analyses were corrected for multiple comparisons at the cluster level using Monte Carlo simulations, in the Analysis of Functional NeuroImages (AFNI) package AlphaSim, to derive a cluster-corrected P value less than 0.05 (Forman et al., 1995).”
MethodInfluentialVercammen, A., Morris, R., Green, M. J., Lenroot, R., Kulkarni, J., Carr, V. J., Weickert, C. S., & Weickert, T. W. (2012) · Journal of Psychiatry and Neuroscience · doi:10.1503/jpn.110088 · Cited by 54
Wolf, R. C., Thomann, P. A., Sambataro, F., Vasic, N., Schmid, M., & Wolf, N. D. (2012) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s00406-012-0303-1 · Cited by 54
Structural and Functional Cerebral Correlates of Hypnotic Suggestibility
Huber, A., Lui, F., Duzzi, D., Pagnoni, G., & Porro, C. A. (2014) · PLoS ONE · doi:10.1371/journal.pone.0093187 · Cited by 66
“gov/afni/doc/manual/AlphaSim and in [30]).”
Functional connectivity and cannabis use in high-risk adolescents
Houck, J. M., Bryan, A. D., & Feldstein Ewing, S. W. (2013) · The American Journal of Drug and Alcohol Abuse · doi:10.3109/00952990.2013.837914 · Cited by 50
“005 and a cluster size threshold of 1200 mm(3) (78).”
Zhang, H., Copara, M., & Ekstrom, A. D. (2012) · PLoS ONE · doi:10.1371/journal.pone.0044886 · Cited by 50
“05 using Monte Carlo simulations [33] with 3dClustSim software based on an uncorrected, voxelwise p,0.”
MethodPhonetic processing areas revealed by sinewave speech and acoustically similar non-speech
Benson, R. R., Richardson, M., Whalen, D. H., & Lai, S. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2005.11.029 · Cited by 50
“05 after estimating spatial smoothing using the method of Forman et al. (1995). The critical voxel-wise Z threshold was determined to be 4.”
MethodInfluentialHaas, B. W., Omura, K., Amin, Z., Constable, R. T., & Canli, T. (2006) · Social Neuroscience · doi:10.1080/17470910600650753 · Cited by 49
“0002 (Forman, Cohen, Fitzgerald, Eddy, Mintun, & Noll, 1995 ).”
Brain activation patterns underlying fast habituation to painful laser stimuli
Mobascher, A., Brinkmeyer, J., Warbrick, T., Musso, F., Schlemper, V., Wittsack, H. J., Saleh, A., Schnitzler, A., & Winterer, G. (2010) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2009.10.008 · Cited by 48
“3 (Forman et al., 1995; Friston et al., 1994; Worsley et al., 1992).”
MethodLoeffler, L. A. K., Radke, S., Habel, U., Ciric, R., Satterthwaite, T. D., Schneider, F., & Derntl, B. (2018) · NeuroImage: Clinical · doi:10.1016/j.nicl.2018.10.025 · Cited by 47
Ash, S., Nevler, N., Phillips, J., Irwin, D. J., McMillan, C. T., Rascovsky, K., & Grossman, M. (2019) · Brain and Language · doi:10.1016/j.bandl.2019.04.006 · Cited by 47
“To perform multiple comparisons adjustment, we thresholded statistical maps at an uncorrected voxelwise threshold of p<001, then used the AFNI 3dFWHMx and 3dClustSim functions to determine a minimum cluster volume that corresponded to a cluster-wise corrected significance of p<05, independent of spatial autocorrelatio…”
MethodSalzwedel, A. P., Grewen, K. M., Goldman, B. D., & Gao, W. (2016) · Neurotoxicology and Teratology · doi:10.1016/j.ntt.2016.05.009 · Cited by 46
Abrams, D. A., Padmanabhan, A., Chen, T., Odriozola, P., Baker, A. E., Kochalka, J., Phillips, J. M., & Menon, V. (2019) · eLife · doi:10.7554/elife.39906 · Cited by 46
“05; 67 voxels) determined using Monte Carlo simulations (Forman et al., 1995; Ward, 2000) using a custom Matlab script (see Source Code).”
MethodRizvi, S. J., Salomons, T. V., Konarski, J. Z., Downar, J., Giacobbe, P., McIntyre, R. S., & Kennedy, S. H. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.06.050 · Cited by 45
“05) using Gaussian Random Field Theory (Forman et al., 1995; Worsley et al., 1992) except where noted below.”
MethodVentromedial Prefrontal Cortex Lesions Alter Neural and Physiological Correlates of Anticipation
Motzkin, J. C., Philippi, C. L., Wolf, R. C., Baskaya, M. K., & Koenigs, M. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.1446-14.2014 · Cited by 44
Lippard, E. T. C., Johnston, J. A. Y., Spencer, L., Quatrano, S., Fan, S., Sankar, A., Weathers, J., Pittman, B., Oquendo, M. A., & Blumberg, H. P. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.11.097 · Cited by 44
“This threshold was chosen to balance type I and type II errors in preliminary studies as previously described (Forman et al., 1995; Lieberman and Cunningham, 2009; Lippard et al., 2017).”
MethodBrain mechanisms supporting violated expectations of pain
Zeidan, F., Lobanov, O. V., Kraft, R. A., & Coghill, R. C. (2015) · Pain · doi:10.1097/j.pain.0000000000000231 · Cited by 41
“on the basis of Gaussian random field theory.(19,21,66) The predictivemodel functions for the general linearmodeling analysis were derived as follows: we created 20 regressors for analysis of cue presentation, postcue, stimulus, poststimulus rest, and rating periods, and they were described with 2 regressors based on…”
From cue to meaning: Brain mechanisms supporting the construction of expectations of pain
Lobanov, O. V., Zeidan, F., McHaffie, J. G., Kraft, R. A., & Coghill, R. C. (2014) · Pain · doi:10.1016/j.pain.2013.09.014 · Cited by 38
“These t-values were then converted to Z-scores to allow P values to be calculated on the basis of Gaussian random field theory [10,12,43].”
MethodCorticostriatothalamic reward prediction error signals and executive control in late-life depression
Dombrovski, A. Y., Szanto, K., Clark, L., Aizenstein, H. J., Chase, H. W., Reynolds, C. F., & Siegle, G. J. (2015) · Psychological Medicine · doi:10.1017/s0033291714002517 · Cited by 41
“We applied a voxelwise threshold of p < 0.001 and a whole-brain cluster-size threshold (Forman et al. 1995; Cox, 1996).”
InfluentialWillette, A. A., Coe, C. L., Colman, R. J., Bendlin, B. B., Kastman, E. K., Field, A. S., Alexander, A. L., Allison, D. B., Weindruch, R. H., & Johnson, S. C. (2012) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2011.10.006 · Cited by 41
Kastman, E. K., Willette, A. A., Coe, C. L., Bendlin, B. B., Kosmatka, K. J., McLaren, D. G., Xu, G., Canu, E., Field, A. S., Alexander, A. L., et al. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.2553-12.2012 · Cited by 40
“Multiple-comparison correction was performed using estimates from a Monte Carlo simulation with AlphaSim (http://afni.nimh.nih.gov/pub/dist/doc/manual/AlphaSim. pdf) to achieve a corrected cluster-level 0.05 (Forman et al., 1995).”
InfluentialKoyama, T., McHaffie, J. G., Laurienti, P. J., & Coghill, R. C. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00119-8 · Cited by 37
“These t values were then converted to Z scores to allow P values to be calculated on the basis of Gaussian random field theory (Worsley et al., 1992; Friston et al., 1994; Forman et al., 1995).”
Multisensory perception of action in posterior temporal and parietal cortices
James, T. W., VanDerKlok, R. M., Stevenson, R. A., & James, K. H. (2011) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2010.10.030 · Cited by 38
“The cluster-threshold technique controls false positives, with a relative sparing of statistical power (Forman et al., 1995; Thirion et al., 2007).”
BackgroundStrenziok, M., Krueger, F., Heinecke, A., Lenroot, R. K., Knutson, K. M., van der Meer, E., & Grafman, J. (2011) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsp036 · Cited by 38
“The cluster-level statistical threshold approach (Forman et al., 1995) as implemented in BrainVoyager QX was used to correct for multiple comparisons by calculating the minimum cluster size to achieve a false activation probability 1⁄4 0.”
MethodPsychological Structure and Neural Correlates of Event Knowledge
Wood, J. N., Knutson, K. M., & Grafman, J. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhh215 · Cited by 38
“Correction for multiple comparisons in PFC and limbic regions (for which we had a priori hypotheses) was carried out using an uncorrected P-value of 0.01 and an extent threshold of 20 — this corresponds to a per voxel false positive probability (Forman et al., 1995) of 0.000004.”
BackgroundMethodInfluentialStan, A. D., Schirda, C. V., Bertocci, M. A., Bebko, G. M., Kronhaus, D. M., Aslam, H. A., LaBarbara, E. J., Tanase, C., Lockovich, J. C., Pollock, M. H., et al. (2014) · Psychiatry Research: Neuroimaging · doi:10.1016/j.pscychresns.2014.05.016 · Cited by 35
“To control for multiple, voxelwise comparisons, we maintained a cluster-level false positive detection rate at p<0.05 by using a voxel threshold of p<0.05 with a cluster extent empirically determined by Monte Carlo simulations implemented in AlphaSim (Forman et al., 1995; Xiong et al., 1995).”
MethodInfluentialZiv, M., Goldin, P. R., Jazaieri, H., Hahn, K. S., & Gross, J. J. (2013) · Biology of Mood & Anxiety Disorders · doi:10.1186/2045-5380-3-5 · Cited by 33
“To correct for multiple comparisons, AlphaSim, a Monte Carlo simulation bootstrapping program in the AFNI library, was used to protect against false positives [42].”
MethodDifferential brain responses to social exclusion by one's own versus opposite-gender peers
Bolling, D. Z., Pelphrey, K. A., & Vander Wyk, B. C. (2012) · Social Neuroscience · doi:10.1080/17470919.2011.623181 · Cited by 32
“A cluster-size threshold was computed by an iterative Monte Carlo simulation to estimate an acceptable cluster-level false-positive rate (Forman et al, 1995 ; Goebel, Esposito, & Formisano, 2006 ).”
MethodHilger, K., & Fiebach, C. J. (2019) · Network Neuroscience · doi:10.1162/netn_a_00083 · Cited by 31
“The resultant p values were FWE-corrected for multiple comparisons with Monte Carlo-based cluster-level thresholding as implemented in AFNI (Forman et al., 1995), whereby an overall threshold of p < 0.05 was achieved by combining a voxel threshold of p < 0.005 with a cluster-based extent threshold…”
MethodInfluentialInterpretation-mediated changes in neural activity during language comprehension
Cooper, E. A., Hasson, U., & Small, S. L. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.01.003 · Cited by 31
“These simulations used an estimate of the spatial smoothing of the experimental dataset (from the residuals of the regression) to determine the sampling distribution of the maximum cluster size likely to be found by chance (Forman et al., 1995).”
Kalnin, A. J., Edwards, C. R., Wang, Y., Kronenberger, W. G., Hummer, T. A., Mosier, K. M., Dunn, D. W., & Mathews, V. P. (2011) · Psychiatry Research Neuroimaging · doi:10.1016/j.pscychresns.2010.11.005 · Cited by 30
“05 (Forman et al., 1995).”
Qiu, Y., Lv, X., Su, H., Jiang, G., Tian, J., Zhuo, F., Han, L., & Zhang, X. (2013) · PLoS ONE · doi:10.1371/journal.pone.0078738 · Cited by 28
“Threshold correction was done by using the AlphaSim program in AFNI, which applies Monte Carlo simulation to calculate the probability of false positive detection by taking into consideration both the individual voxel probability thresholding and cluster size [35].”
MethodOpel, N., Redlich, R., Grotegerd, D., Dohm, K., Zaremba, D., Meinert, S., Bürger, C., Plümpe, L., Alferink, J., Heindel, W., et al. (2017) · Journal of Psychiatry and Neuroscience · doi:10.1503/jpn.160198 · Cited by 28
Parahippocampal cortex is involved in material processing via echoes in blind echolocation experts
Milne, J. L., Arnott, S. R., Kish, D., Goodale, M. A., & Thaler, L. (2015) · Vision Research · doi:10.1016/j.visres.2014.07.004 · Cited by 27
“To control for Type-I error probability, each participant’s data was subjected to a cluster threshold correction (Forman et al., 1995).”
Moser, D. A., Aue, T., Wang, Z., Rusconi Serpa, S., Favez, N., Peterson, B. S., & Schechter, D. S. (2013) · Stress · doi:10.3109/10253890.2013.816280 · Cited by 26
“The combined application of a statistical threshold and a cluster filter substantially reduces the false-positive identification of activated pixels at any given threshold (Forman et al., 1995).”
BackgroundIdentifying with fictive characters: structural brain correlates of the personality trait ‘fantasy’
Cheetham, M., Hänggi, J., & Jancke, L. (2014) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nst179 · Cited by 25
Touching moments: desire modulates the neural anticipation of active romantic caress
Ebisch, S. J., Ferri, F., & Gallese, V. (2014) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2014.00060 · Cited by 25
Brown, L. A., Young, K. S., Goldin, P. R., Torre, J. B., Burklund, L. J., Davies, C. D., Niles, A. N., Lieberman, M. D., Saxbe, D. E., & Craske, M. G. (2019) · Psychiatry Research - Neuroimaging · doi:10.1016/j.pscychresns.2018.12.017 · Cited by 24
“For all analyses, we determined cluster-size thresholds using Monte Carlo simulations in AFNI's 3DClustSim (http://afni.nimh.nih.gov/afni/ ) which allowed for improved assessment of functional activation and correction for multiple comparisons (Forman et al., 1995) based on a grey matter mask.”
Boehme, S., Mohr, A., Becker, M. P., Miltner, W. H., & Straube, T. (2014) · Biology of Mood & Anxiety Disorders · doi:10.1186/2045-5380-4-6 · Cited by 23
“The cluster threshold criterion was based on an estimate of each map’s spatial smoothness [59] and on an iterative procedure (Monte Carlo simulation).”
MethodLeicht, G., Mulert, C., Eser, D., Sämann, P. G., Ertl, M., Laenger, A., Karch, S., Pogarell, O., Meindl, T., Czisch, M., et al. (2013) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.09.004 · Cited by 21
“005) was applied to all voxels and, then a minimum cluster size was calculated that protected against false positive clusters at 5% after 1000 Monte Carlo simulations (26,27).”
MethodDisrupted reinforcement learning during post-error slowing in ADHD
Chevrier, A., Bhaijiwala, M., Lipszyc, J., Cheyne, D., Graham, S., & Schachar, R. (2019) · PLOS ONE · doi:10.1371/journal.pone.0206780 · Cited by 21
“2.5.2 Correction of multiple comparisons Output from ANOVA analyses (TD, ADHD, TD-ADHD) were corrected for multiple comparisons using AFNI’s 3dClustSim program (Forman et al., 1995) (spatial correlation estimated from AFNIs corrected 3dFWHMx ‐acf option).”
MethodInfluentialHuman parietofrontal networks related to action observation detected at rest
Molinari, E., Baraldi, P., Campanella, M., Duzzi, D., Nocetti, L., Pagnoni, G., & Porro, C. A. (2013) · Cerebral Cortex · doi:10.1093/cercor/bhr393 · Cited by 19
“005, corrected for multiple comparison (Forman et al. 1995), as determined by the AFNI routine AlphaSim.”
MethodInfluentialSong, I.-U., Choi, E. K., Oh, J. K., Chung, Y.-A., & Chung, S.-W. (2016) · Acta Radiologica · doi:10.1177/0284185114566088 · Cited by 17
“This combined application of a statistical threshold and cluster filter has previously been shown to substantially reduce the false positive identification of activated pixels at any given threshold (15).”
BackgroundBernstein, J. A., Hastings, L., Boespflug, E. L., Allendorfer, J. B., Lamy, M., & Eliassen, J. C. (2011) · Annals of Allergy, Asthma & Immunology · doi:10.1016/j.anai.2011.02.014 · Cited by 15
Rogerson, R. G., Barnstaple, R. E., & DeSouza, J. F. (2021) · Brain Sciences · doi:10.3390/brainsci11040497 · Cited by 14
“For comparison, all other brain regions from the GLM analysis that passed our Bonferroni threshold and spatial voxel clustering [14] are also plotted in Figure 3.”
BackgroundMethodInfluentialLee, W., & Reeve, J. (2020) · Motivation and Emotion · doi:10.1007/s11031-019-09799-1 · Cited by 11
Naumer, M. J., van den Bosch, J. J. F., Wibral, M., Kohler, A., Singer, W., Kaiser, J., van de Ven, V., & Muckli, L. (2011) · Experimental Brain Research · doi:10.1007/s00221-011-2669-0 · Cited by 11
“Second, we applied cluster-size correction as an alternative method for multiple comparison correction (Forman et al. 1995).”
MethodEnhanced bodily states of fear facilitates bias perception of fearful faces
Jung, W.-M., Lee, Y.-S., Lee, I.-S., Wallraven, C., Ryu, Y., & Chae, Y. (2020) · Molecular Brain · doi:10.1186/s13041-020-00674-6 · Cited by 9
Self-Regulatory Control and Habit Learning in the Development of Eating Disorders
Marsh, R., Steinglass, J., Graziano, K., Peterson, B., & Walsh, B. T. (2007) · Current Psychiatry Reviews · doi:10.2174/157340007779815691 · Cited by 8
“B) Group composite t-maps for the percent fMRI signal change associated with the naming of colors in incongruent compared to congruent stimuli for children and adults.”
BackgroundNock, N. L., Jiang, H., Borato, L., Alberts, J., & Dimitropoulos, A. (2020) · Nutrition & Diabetes · doi:10.1038/s41387-020-0124-7 · Cited by 4
Nguyen, J. Q., Riddle, T., Nguyen, N., Chao, S., Dutta, D., Hill, A., Yu, R., Rowland, K., & Shi, Z. (2025) · Scientific Reports · doi:10.1038/s41598-025-15547-y · Cited by 3
Jung, W.-M., Lee, I.-S., Lee, Y.-S., Ryu, Y., Park, H.-J., & Chae, Y. (2021) · Brain Sciences · doi:10.3390/brainsci11070946 · Cited by 2
Worsley (1996) · doi:10.1002/(sici)1097-0193(1996)4:1
Metadata
- Authors
- Forman, S. D., Cohen, J. D., Fitzgerald, M., Eddy, W. F., Mintun, M. A., & Noll, D. C.
- Affiliations
- University of Pittsburgh (US)
- Corresponding author
- Forman, Steven D.
- Venue
- Magnetic Resonance in Medicine
- Publisher
- Wiley
- Published
- 1995-05
- Volume
- 33
- Issue
- 5
- Pages
- 636-647
- ISSN
- 0740-3194 (ISSN-L)
- 1522-2594
- OpenAlex
- W2044634376
- Cited by
- 3,202
- References
- 11
- Citations by year
- 2026: 27 · 2025: 26 · 2024: 30 · 2023: 36 · 2022: 45 · 2021: 55 · 2020: 64 · 2019: 75 · 2018: 96 · 2017: 137 · 2016: 140 · 2015: 188 · 2014: 203 · 2013: 213 · 2012: 242
- FWCI
- 14.83
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Magnetic Resonance in Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Functional Brain Connectivity Studies
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Advanced MRI Techniques and Applications
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Advanced Neuroimaging Techniques and Applications
- Keywords
- multiple comparisons, false positives, statistical power, fMRI activation detection, Monte Carlo simulation, cluster size distribution
- MeSH terms
- Brain, Data Interpretation, Statistical, False Positive Reactions, Humans, Magnetic Resonance Imaging, Monte Carlo Method, Probability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.