Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): use of a cluster-size threshold
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
The typical functional magnetic resonance (fMRI) study presents a formidable problem of multiple statistical comparisons (i.e., > 10,000 in a 128 x 128 image). To protect against false positives, investigators have typically relied on decreasing the per pixel false positive probability. This approach incurs an inevitable loss of power to detect statistically significant activity. An alternative approach, which relies on the assumption that areas of true neural activity will tend to stimulate signal changes over contiguous pixels, is presented. If one knows the probability distribution of such cluster sizes as a function of per pixel false positive probability, one can use cluster-size thresholds independently to reject false positives. Both Monte Carlo simulations and fMRI studies of human subjects have been used to verify that this approach can improve statistical power by as much as fivefold over techniques that rely solely on adjusting per pixel false positive probabilities.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For all analyses, we determined cluster-size thresholds using Monte Carlo simulations in AFNI’s 3DClustSim (http://afni.nimh.nih.gov/afni/) which allowed for improved assessment of functional activation and correction for multiple comparisons (Forman et al., 1995) based on a grey matter mask.”
From Self-referential processing during observation of a speech performance task in social anxiety disorder from pre- to post-treatment: Evidence of disrupted neural activation (2019) · cites this paper as Forman et al., 1995
In the citing paper
“Two criteria were employed in evaluating activations: (i) only regions with peak voxels of P < 0.001 were considered; (ii) only clusters of activation including k !6 voxels in which all voxels met an uncorrected threshold of P < 0.005 were considered, yielding a functional threshold equivalent of P < 0.001 according to cluster size significance level corrections (Forman et al., 1995).”
From Attending to the present: mindfulness meditation reveals distinct neural modes of self-reference (2007) · cites this paper as Forman et al., 1995
In the citing paper
“Cluster thresholding was applied to increase power in identifying heavily recruited neural areas while maintaining a reasonably low Type-I error rate (Forman et al., 1995).”
From Attending to the present: mindfulness meditation reveals distinct neural modes of self-reference (2007) · cites this paper as Forman et al., 1995
In the citing paper
“For all FC analyses, a double statistical threshold (voxel-wise p < 0.01 and cluster size ≥ 78 voxels, as determined by AlphaSim with 10,000 Monte Carlo simulations) was used to obtain an alpha < 0.05 (corrected for multiple comparisons) (see details on the procedure at http://afni.nimh.nih.gov/afni/doc/manual/AlphaSim and in [30]).”
From Structural and Functional Cerebral Correlates of Hypnotic Suggestibility (2014) · cites this paper as [30]
In the citing paper
“The resulting maps from all participants in the HFA group and all participants in the control group were averaged and these group-averaged t-maps were displayed on group composite anatomical images with a statistical threshold of p < .001, adjusted for multiple comparisons with a cluster-filter of 10 contiguous pixels (42).”
From The Neural Circuitry Mediating Shifts in Behavioral Response and Cognitive Set in Autism (2008) · cites this paper as [42]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Self-citationNumerical recipes in C: the art of scientific computing
(1993) · Choice Reviews Online · doi:10.5860/choice.30-5638 · Cited by 17,933
A three-dimensional statistical analysis for CBF activation studies in human brain
Worsley, K. J., Evans, A. C., Marrett, S., & Neelin, P. (1992) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1992.127 · Cited by 2,036
Assessing the significance of focal activations using their spatial extent
Friston, K. J., Worsley, K. J., Frackowiak, R. S. J., Mazziotta, J. C., & Evans, A. C. (1994) · Human Brain Mapping · doi:10.1002/hbm.460010306 · Cited by 1,907
Comparing Functional (PET) Images: The Assessment of Significant Change
Friston, K. J., Frith, C. D., Liddle, P. F., & Frackowiak, R. S. J. (1991) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1991.122 · Cited by 1,625
MRI-PET Registration with Automated Algorithm
Woods, R. P., Mazziotta, J. C., & R. Cherry, A. S. (1993) · Journal of Computer Assisted Tomography · doi:10.1097/00004728-199307000-00004 · Cited by 1,617
The Relationship between Global and Local Changes in PET Scans
Friston, K. J., Frith, C. D., Liddle, P. F., Dolan, R. J., Lammertsma, A. A., & Frackowiak, R. S. J. (1990) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1990.88 · Cited by 858
Activation of the prefrontal cortex in a nonspatial working memory task with functional MRI
Cohen, J. D., Forman, S. D., Braver, T. S., Casey, B. J., Servan‐Schreiber, D., & Noll, D. C. (1994) · Human Brain Mapping · doi:10.1002/hbm.460010407 · Cited by 576
Self-citationSpiral K‐space MR imaging of cortical activation
Noll, D. C., Cohen, J. D., Meyer, C. H., & Schneider, W. (1995) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.1880050112 · Cited by 254
Self-citationPoline, J.-B., & Mazoyer, B. M. (1993) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1993.57 · Cited by 155
Cited by
Items 301–400 of 1,095
Resting-state brain connectivity in patients with Parkinson's disease and freezing of gait
Tessitore, A., Amboni, M., Esposito, F., Russo, A., Picillo, M., Marcuccio, L., Pellecchia, M. T., Vitale, C., Cirillo, M., Tedeschi, G., et al. (2012) · Parkinsonism & Related Disorders · doi:10.1016/j.parkreldis.2012.03.018 · Cited by 257
Liston, C., Matalon, S., Hare, T. A., Davidson, M. C., & Casey, B. J. (2006) · Neuron · doi:10.1016/j.neuron.2006.04.015 · Cited by 256
“These criteria ensure that the probability of a type I error is less than 0.05 ( Forman et al., 1995 ).”
InfluentialCentral representation of visceral and cutaneous hypersensitivity in the irritable bowel syndrome
Verne, N. G., Himes, N. C., Robinson, M. E., Gopinath, K. S., Briggs, R. W., Crosson, B., & Price, D. D. (2003) · Pain · doi:10.1016/s0304-3959(02)00416-5 · Cited by 255
“This cluster-size threshold method has been shown (Forman et al., 1995) to yield improved statistical power compared to techniques such as the Bonferroni correction which adjust alpha probabilities based on number of pixels.”
MethodInfluentialMatsuo, K., Glahn, D. C., Peluso, M. A. M., Hatch, J. P., Monkul, E. S., Najt, P., Sanches, M., Zamarripa, F., Li, J., Lancaster, J. L., et al. (2007) · Molecular Psychiatry · doi:10.1038/sj.mp.4001894 · Cited by 251
Increased cerebral response during a divided attention task following sleep deprivation
Drummond, S. P. A., Gillin, J. C., & Brown, G. G. (2001) · Journal of Sleep Research · doi:10.1046/j.1365-2869.2001.00245.x · Cited by 255
“A cluster thresholding method (Forman et al. 1995) was used to protect against type I errors and resulted in a ®nal per-voxel P-value 0.0005 (one-sided for analysis 1 and 3) or 0.001 (two-sided for analysis 2).”
MethodInfluentialSahyoun, C., Floyer-Lea, A., Johansen-Berg, H., & Matthews, P. M. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.09.065 · Cited by 255
Neural correlates of verbal feedback processing: an fMRI study employing overt speech
Christoffels, I. K., Formisano, E., & Schiller, N. O. (2007) · Human Brain Mapping · doi:10.1002/hbm.20315 · Cited by 254
Ebisch, S. J. H., Perrucci, M. G., Ferretti, A., Del Gratta, C., Romani, G. L., & Gallese, V. (2008) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2008.20111 · Cited by 254
“This p value and an estimate of the spatial correlation of voxels were used as input in a Monte Carlo simulation to access the overall significance level (Cox, 1996; Forman et al., 1995).”
MethodNeural substrates for functionally discriminating self-face from personally familiar faces
Platek, S. M., Loughead, J. W., Gur, R. C., Busch, S., Ruparel, K., Phend, N., Panyavin, I. S., & Langleben, D. D. (2006) · Human Brain Mapping · doi:10.1002/hbm.20168 · Cited by 253
“Group-level random effects analyses were accomplished by entering whole brain contrasts into onesample t-tests and resulting SPM{T} maps were transformed to unit normal distribution SPM{Z} maps [Friston et al., [1994], [1995]].”
MethodInfluentialA new correlation‐based fuzzy logic clustering algorithm for FMRI
Golay, X., Kollias, S., Stoll, G., Meier, D., Valavanis, A., & Boesiger, P. (1998) · Magnetic Resonance in Medicine · doi:10.1002/mrm.1910400211 · Cited by 253
Training-induced plasticity in older adults: Effects of training on hemispheric asymmetry
Erickson, K. I., Colcombe, S. J., Wadhwa, R., Bherer, L., Peterson, M. S., Scalf, P. E., Kim, J. S., Alvarado, M., & Kramer, A. F. (2007) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2005.12.012 · Cited by 253
Perceived Controllability Modulates the Neural Response to Pain
Salomons, T. V., Johnstone, T., Backonja, M.-M., & Davidson, R. J. (2004) · The Journal of Neuroscience · doi:10.1523/jneurosci.1315-04.2004 · Cited by 253
“Z statistic images were thresholded at p Ͻ 0.01, with a cluster-based correction for multiple comparisons using Gaussian random field theory (Worsley et al., 1992; Friston et al., 1994; Forman et al., 1995).”
MethodInfluentialSpeech-associated gestures, Broca’s area, and the human mirror system
Skipper, J. I., Goldin-Meadow, S., Nusbaum, H. C., & Small, S. L. (2007) · Brain and Language · doi:10.1016/j.bandl.2007.02.008 · Cited by 252
“05 using a Monte Carlo simulation to optimize the relationship between the single voxel statistical threshold and the minimally acceptable cluster size (Forman et al., 1995).”
MethodYASSA, M., & STARK, C. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.09.016 · Cited by 253
“The program starts by assuming that voxels were spatially independent to begin with and then proceeds to estimate the kernel width that would be needed to produce the observed smoothness of an image using the method described by Forman et al. (1995).”
A developmental fMRI study of self‐regulatory control
Marsh, R., Zhu, H., Schultz, R. T., Quackenbush, G., Royal, J., Skudlarski, P., & Peterson, B. S. (2006) · Human Brain Mapping · doi:10.1002/hbm.20225 · Cited by 249
“The combined application of a statistical threshold and cluster filter has previously been shown to reduce substantially the false-positive identification of activated pixels at any given threshold [Forman et al., 1995].”
BackgroundMethodInfluentialDannlowski, U., Kugel, H., Huber, F., Stuhrmann, A., Redlich, R., Grotegerd, D., Dohm, K., Sehlmeyer, C., Konrad, C., Baune, B. T., et al. (2013) · Human Brain Mapping · doi:10.1002/hbm.22112 · Cited by 249
“05 with a cluster (k) extent empirically determined by Monte Carlo simulations (n 1⁄4 1000 iterations), by means of the AlphaSim procedure (Forman et al., 1995), implemented in the REST toolbox (http://restfmri.”
MethodInfluentialfMRI Measurement of Brain Dysfunction in Alcohol-Dependent Young Women
Tapert, S. F., Brown, G. G., Kindermann, S. S., Cheung, E. H., Frank, L. R., & Brown, S. A. (2001) · Alcoholism: Clinical and Experimental Research · doi:10.1097/00000374-200102000-00012 · Cited by 249
Snijders, T. M., Vosse, T., Kempen, G., Van Berkum, J. J. A., Petersson, K. M., & Hagoort, P. (2009) · Cerebral Cortex · doi:10.1093/cercor/bhn187 · Cited by 249
“To correct for multiple comparisons, statistical inference was based on the cluster-size statistics from the relevant second-level SPM[T] volumes (Forman et al. 1995; Friston et al. 1996).”
MethodSnitz, B. E., MacDonald, A., Cohen, J. D., Cho, R. Y., Becker, T., & Carter, C. S. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.12.2322 · Cited by 249
“005 (uncorrected) using an 8voxel contiguity criterion (30).”
MethodSelf-citationAndersen, A. H., Gash, D. M., & Avison, M. J. (1999) · Magnetic Resonance Imaging · doi:10.1016/s0730-725x(99)00028-4 · Cited by 248
Kim, S., & Tsekos, N. V. (1997) · Magnetic Resonance in Medicine · doi:10.1002/mrm.1910370321 · Cited by 247
Motivation-dependent responses in the human caudate nucleus.
Delgado, M. R. (2004) · Cerebral Cortex · doi:10.1093/cercor/bhh062 · Cited by 246
“Regions of interest (ROIs) consisting of five or more contiguous voxels were selected, as a precaution against type 1 errors (Forman et al., 1995).”
MethodNeural mechanisms of planning: A computational analysis using event-related fMRI
Fincham, J. M., Carter, C. S., van Veen, V., Stenger, V. A., & Anderson, J. R. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.052703399 · Cited by 246
Neural activation during inhibition predicts initiation of substance use in adolescence
Norman, A. L., Pulido, C., Squeglia, L. M., Spadoni, A. D., Paulus, M. P., & Tapert, S. F. (2011) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2011.06.019 · Cited by 244
Haas, B. W., Omura, K., Constable, R. T., & Canli, T. (2007) · Behavioral Neuroscience · doi:10.1037/0735-7044.121.2.249 · Cited by 244
Opiate addicts lack error-dependent activation of rostral anterior cingulate
Forman, S. D., Dougherty, G. G., Casey, B. J., Siegle, G. J., Braver, T. S., Barch, D. M., Stenger, V. A., Wick-Hull, C., Pisarov, L. A., & Lorensen, E. (2004) · Biological Psychiatry · doi:10.1016/j.biopsych.2003.09.011 · Cited by 243
Self-citationMathematics Anxiety: Separating the Math from the Anxiety
Lyons, I. M., & Beilock, S. L. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhr289 · Cited by 233
“…voxelwise bs. Second-Level Analyses For all whole-brain analyses below, statistical maps were thresholded at P < 0.005 and, subsequently, cluster level corrected for multiple comparisons using a Monte-Carlo simulation procedure (Forman et al. 1995) with a family-wise false positive rate a = 0.05.”
InfluentialSzeszko, P. R., Robinson, D. G., Ashtari, M., Vogel, J., Betensky, J., Sevy, S., Ardekani, B. A., Lencz, T., Malhotra, A. K., McCormack, J., et al. (2008) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301480 · Cited by 242
“…error rate given the potential for increased Type-I error due to multiple comparisons, but recognizing that tests at adjacent voxels are strongly interdependent (Forman et al, 1995) and for consistency with our six-direction DTI pilot study in first-episode schizophrenia (Szeszko et al, 2005a).”
ResultProbing the neural correlates of anticipated peer evaluation in adolescence
Guyer, A. E., McClure-Tone, E. B., Shiffrin, N. D., Pine, D. S., & Nelson, E. E. (2009) · Child Development · doi:10.1111/j.1467-8624.2009.01313.x · Cited by 239
“05 to protect against multiple comparisons for the five a priori regions of interest (ROIs) within the affective node (Forman et al., 1995; Poldrack, 2007).”
Role of anterior temporal cortex in auditory sentence comprehension: an fMRI study
Humphries, C., Willard, K., Buchsbaum, B., & Hickok, G. (2001) · Neuroreport · doi:10.1097/00001756-200106130-00046 · Cited by 239
Structural plasticity in the language system related to increased second language proficiency
Stein, M., Federspiel, A., Koenig, T., Wirth, M., Strik, W., Wiest, R., Brandeis, D., & Dierks, T. (2012) · Cortex · doi:10.1016/j.cortex.2010.10.007 · Cited by 240
“The correction for multiple comparisons (in order to control for Type I errors) was then performed using the method of cluster-size thresholding (Forman et al., 1995), which was computed by a self-written Matlab program.”
The Neural Circuitry of a Broken Promise
Baumgartner, T., Fischbacher, U., Feierabend, A., Lutz, K., & Fehr, E. (2009) · Neuron · doi:10.1016/j.neuron.2009.11.017 · Cited by 238
Topographic representation of the human body in the occipitotemporal cortex
Orlov, T., Makin, T. R., & Zohary, E. (2010) · Neuron · doi:10.1016/j.neuron.2010.09.032 · Cited by 236
“…maps were calculated taking into account the probability of a false detection for any given activation cluster, based on the approach of Forman and colleagues (Forman et al., 1995) and accomplished by Monte Carlo simulation (''cluster size correction analysis,'' incorporated in BrainVoyager QX).”
Burgmer, M., Gaubitz, M., Konrad, C., Wrenger, M., Hilgart, S., Heuft, G., & Pfleiderer, B. (2009) · Psychosomatic Medicine · doi:10.1097/psy.0b013e3181a32da0 · Cited by 236
“We minimized the risk of false-positive results by only analyzing brain areas of a priori expected importance and by implementing a contiguity threshold for cluster volumes (76), making it unlikely that our results are caused only by chance.”
BackgroundFunctional connectivity of hippocampal networks in temporal lobe epilepsy
Haneef, Z., Lenartowicz, A., Yeh, H. J., Levin, H. S., Engel, J., & Stern, J. M. (2014) · Epilepsia · doi:10.1111/epi.12476 · Cited by 235
Spatial maps in frontal and prefrontal cortex
Hagler, D. J., & Sereno, M. I. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2005.08.058 · Cited by 235
“Cluster size exclusion was used for multiple comparison correction (Forman et al., 1995), with t statistics thresholded at P < 0.”
MethodInfluentialAdaptive Changes in Early and Late Blind: A fMRI Study of Verb Generation to Heard Nouns
Burton, H., Snyder, A. Z., Diamond, J. B., & Raichle, M. E. (2002) · Journal of Neurophysiology · doi:10.1152/jn.00129.2002 · Cited by 235
“These z-score maps for each subject were corrected for multiple comparisons using prior Monte Carlo simulations on random noise patterns (based on methods described in Forman et al. 1995) and a whole brain P value of 0.05.”
MethodInfluentialNeural correlates of high and craving during cocaine self-administration using BOLD fMRI
Risinger, R. C., Salmeron, B. J., Ross, T. J., Amen, S. L., Sanfilipo, M., Hoffmann, R. G., Bloom, A. S., Garavan, H., & Stein, E. A. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.03.030 · Cited by 234
“After individual voxel thresholding, a cluster-based analysis was incorporated (Forman et al., 1995) to account for multiple comparisons, assuming that true regions of activation will occur over contiguous voxels.”
MethodKanske, P., & Kotz, S. A. (2011) · Human Brain Mapping · doi:10.1002/hbm.21012 · Cited by 233
“The advantages of combining a voxel-based threshold with a minimum cluster size have been described elsewhere [Forman et al., 1995].”
MethodWhite Matter Abnormalities in Obsessive-compulsive Disorder: A Diffusion Tensor Imaging Study
Szeszko, P. R., Ardekani, B. A., Ashtari, M., Malhotra, A. K., Robinson, D. G., Bilder, R. M., & Lim, K. O. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.7.782 · Cited by 235
“We chose this combination of level and cluster size to maintain a balance between type I and type II error rates given possible inflation of type I error due to multiple comparisons but also acknowledging that tests at nearby voxels have strong interdependencies.(59,60) Additional analyses examined group differences i…”
MethodClark, V. P., Keil, K., Maisog, J. M., Courtney, S., Ungerleider, L. G., & Haxby, J. V. (1996) · NeuroImage · doi:10.1006/nimg.1996.0025 · Cited by 234
Brain Activation during Anticipation of Sound Sequences
Leaver, A. M., Van Lare, J., Zielinski, B., Halpern, A. R., & Rauschecker, J. P. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.4921-08.2009 · Cited by 233
“During scans, sounds were delivered via a custom airconduction sound system fitted with silicone-cushioned headphones specifically designed to isolate the subject from scanner noise (Magnetic Resonance Technologies).”
MethodInfluentialFalse positive rates in surface-based anatomical analysis
Greve, D. N., & Fischl, B. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2017.12.072 · Cited by 232
“Historically, random field theory (RFT, Worsley et al., 1992; Friston et al., 1994; Forman et al., 1995) has been a very popular solution for fMRI (Carp, 2012).”
BackgroundSilva, A. C., Lee, S.-P., Yang, G., Iadecola, C., & Kim, S.-G. (1999) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1097/00004647-199908000-00006 · Cited by 233
Paulus, M. P., Hozack, N., Zauscher, B., McDowell, J. E., Frank, L., Brown, G. G., & Braff, D. L. (2001) · NeuroImage · doi:10.1006/nimg.2000.0667 · Cited by 232
“This work was supported by grants from NIMH (MH R37-42228; D.L.B.), (MH5358; M.P.P.), and support from the Veterans Administration via a VISN 22 MIRECC (D.L.B., G.B.).”
BackgroundInfluentialBurgess, G. C., Gray, J. R., Conway, A. R. A., & Braver, T. S. (2011) · Journal of Experimental Psychology: General · doi:10.1037/a0024695 · Cited by 231
“Group whole-brain analyses were conducted to identify regions that showed activation significant at a multiple-comparison corrected threshold of p Ͻ .05 (z Ͼ 3.25, clusters of 25 or more contiguous voxels, corrected using Monte Carlo simulation (Forman et al., 1995).”
InfluentialNeural and behavioral bases of age differences in perceptions of trust
Castle, E., Eisenberger, N. I., Seeman, T. E., Moons, W. G., Boggero, I. A., Grinblatt, M. S., & Taylor, S. E. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1218518109 · Cited by 230
Lewis, P. A., Wing, A. M., Pope, P. A., Praamstra, P., & Miall, R. C. (2004) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2004.03.001 · Cited by 230
Basal Ganglia Hypermetabolism and Symptoms of Fatigue during Interferon-α Therapy
Capuron, L., Pagnoni, G., Demetrashvili, M. F., Lawson, D. H., Fornwalt, F. B., Woolwine, B., Berns, G. S., Nemeroff, C. B., & Miller, A. H. (2007) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301362 · Cited by 229
“05 was reached by the combination of the single-voxel threshold of p¼ 0.0001 and a cluster size threshold of 78 voxels, as determined by a Monte Carlo simulation performed with the AFNI routine AlphaSim (Forman et al, 1995).”
MethodInfluentialUnderstanding Genetic Risk for Aggression: Clues From the Brain’s Response to Social Exclusion
Eisenberger, N. I., Way, B. M., Taylor, S. E., Welch, W. T., & Lieberman, M. D. (2007) · Biological Psychiatry · doi:10.1016/j.biopsych.2006.08.007 · Cited by 229
“First, measures of self-reported social distress were entered as regressors into a random-effects, whole-brain group analysis, comparing activations during exclusion relative to inclusion (p .005, 20-voxel extent threshold; Forman et al. 1995).”
BackgroundMethodInfluentialSomatotopic Activation in the Human Trigeminal Pain Pathway
DaSilva, A. F. M., Becerra, L., Makris, N., Strassman, A. M., Gonzalez, R. G., Geatrakis, N., & Borsook, D. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-18-08183.2002 · Cited by 230
“Statistical thresholds were based on a cluster size approach (Forman et al., 1995).”
MethodCerebrospinal fluid profile in frontotemporal dementia and Alzheimer’s disease
Grossman, M., Farmer, J., Leight, S., Work, M., Moore, P., Van Deerlin, V., Pratico, D., Clark, C. M., Coslett, H. B., Chatterjee, A., et al. (2005) · Annals of Neurology · doi:10.1002/ana.20477 · Cited by 228
“001 (uncorrected), and the reliability of the statistical analysis was confirmed using an extent threshold of 100 adjacent voxels.(27)”
MethodVariable Global Dysconnectivity and Individual Differences in Schizophrenia
Cole, M. W., Anticevic, A., Repovs, G., & Barch, D. (2011) · Biological Psychiatry · doi:10.1016/j.biopsych.2011.02.010 · Cited by 227
Neural correlates of individual differences in pain-related fear and anxiety
Ochsner, K. N., Ludlow, D. H., Knierim, K., Hanelin, J., Ramachandran, T., Glover, G. C., & Mackey, S. C. (2006) · Pain · doi:10.1016/j.pain.2005.10.014 · Cited by 228
“05 corrected for multiple comparisons as calculated by the Monte Carlo simulation and method of Forman et al. (1995) implemented in AFNI, which has been employed in numerous prior studies (e.”
MethodInfluentialPosner, J., Russell, J. A., Gerber, A., Gorman, D., Colibazzi, T., Yu, S., Wang, Z., Kangarlu, A., Zhu, H., & Peterson, B. S. (2009) · Human Brain Mapping · doi:10.1002/hbm.20553 · Cited by 228
“The effective P-value for the conjoint requirement of a statistical threshold and cluster filter across all voxels was 0.05 [Forman et al., 1995].”
BackgroundMethodInfluentialSelective visuo‐haptic processing of shape and texture
Stilla, R., & Sathian, K. (2008) · Human Brain Mapping · doi:10.1002/hbm.20456 · Cited by 228
“…volume (corrected P < 0.05) was achieved by imposing a threshold for the volume of clusters of contiguous voxels that each passed a significance threshold of P < 0.05, using a 3D extension (implemented in BrainVoyager QX) of the 2D Monte Carlo simulation procedure described by Forman et al. (1995).”
MethodInfluentialDissociation between Ventral and Dorsal fMRI Activation during Object and Action Recognition
Shmuelof, L., & Zohary, E. (2005) · Neuron · doi:10.1016/j.neuron.2005.06.034 · Cited by 227
“(Forman et al., 1995), based on Monte Carlo simulation (AlphaSim by B.”
Art for reward's sake: Visual art recruits the ventral striatum
Lacey, S., Hagtvedt, H., Patrick, V. M., Anderson, A., Stilla, R., Deshpande, G., Hu, X., Sato, J. R., Reddy, S., & Sathian, K. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.11.027 · Cited by 227
“…achieved by imposing a threshold for the volume of clusters comprising contiguous voxels (anatomic dimensions, 1×1×1mm) that passed a voxel-wise threshold of p<.05, using a 3D extension (implemented in BrainVoyager QX) of the 2D Monte Carlo simulation procedure described by Forman et al. (1995).”
MethodComputational approaches to fMRI analysis
Cohen, J. D., Daw, N., Engelhardt, B., Hasson, U., Li, K., Niv, Y., Norman, K. A., Pillow, J., Ramadge, P. J., Turk-Browne, N. B., et al. (2017) · Nature Neuroscience · doi:10.1038/nn.4499 · Cited by 226
“Third, the scale of brain imaging data and the number of statistical comparisons created a high risk of false discoveries (Type I errors); in response, methods were developed that exploit priors about the data (for example, spatial contiguity) when correcting for multiple comparisons 8,9 .”
MethodSelf-citationA common neural basis for receptive and expressive communication of pleasant facial affect
HENNENLOTTER, A., SCHROEDER, U., ERHARD, P., CASTROP, F., HASLINGER, B., STOECKER, D., LANGE, K., & CEBALLOSBAUMANN, A. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.01.057 · Cited by 226
“…Wicker et al., 2003) using similar methods as those applied in the present study to assess overlaps of neural activation across several experimental conditions, we chose a joint intensity and spatial threshold (P < 0.005 uncorrected, k = 20 voxels) to avoid false-positives (Forman et al., 1995).”
MethodInfluentialLange, N., & Zeger, S. L. (1997) · Journal of the Royal Statistical Society Series C: Applied Statistics · doi:10.1111/1467-9876.00046 · Cited by 226
Auditory Resting-State Network Connectivity in Tinnitus: A Functional MRI Study
Maudoux, A., Lefebvre, P., Cabay, J.-E., Demertzi, A., Vanhaudenhuyse, A., Laureys, S., & Soddu, A. (2012) · PLoS ONE · doi:10.1371/journal.pone.0036222 · Cited by 221
“Statistical parametric maps resulting from the voxel wise analysis were considered significant for statistical values that survived a cluster-based correction for multiple comparisons as implemented in Brain Voyager [29] using the ‘‘cluster-level statistical threshold estimator’’ plug-in, which is based on a 3D extens…”
MethodSpunt, R. P., Satpute, A. B., & Lieberman, M. D. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2010.21446 · Cited by 221
Kim Cmrr, S., & Uĝurbil, K. (1997) · Magnetic Resonance in Medicine · doi:10.1002/mrm.1910380110 · Cited by 220
Variability of fMRI activation during a phonological and semantic language task in healthy subjects
Seghier, M. L., Lazeyras, F., Pegna, A. J., Annoni, J., Zimine, I., Mayer, E., Michel, C. M., & Khateb, A. (2004) · Human Brain Mapping · doi:10.1002/hbm.20053 · Cited by 220
Neural bases of moderation of cortisol stress responses by psychosocial resources.
Taylor, S. E., Burklund, L. J., Eisenberger, N. I., Lehman, B. J., Hilmert, C. J., & Lieberman, M. D. (2008) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.95.1.197 · Cited by 219
“005 with a 10 voxel extent threshold (Forman et al., 1995).”
The neural basis of flashback formation: the impact of viewing trauma
Bourne, C., Mackay, C. E., & Holmes, E. A. (2013) · Psychological Medicine · doi:10.1017/s0033291712002358 · Cited by 218
Multivariate neural biomarkers of emotional states are categorically distinct
Kragel, P. A., & LaBar, K. S. (2015) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsv032 · Cited by 218
“0.05 in Monte Carlo simulations (Forman et al. , 1995).”
BackgroundInfluentialBrain activity in hunger and satiety: an exploratory visually stimulated fMRI study
Führer, D., Zysset, S., & Stumvoll, M. (2008) · Obesity · doi:10.1038/oby.2008.33 · Cited by 218
Refreshing: A Minimal Executive Function
Raye, C. L., Johnson, M. K., Mitchell, K. J., Greene, E. J., & Johnson, M. R. (2007) · Cortex · doi:10.1016/s0010-9452(08)70451-9 · Cited by 217
“Thus, we first identified regions that showed a condition × time interaction with a minimum of 6 contiguous voxels, each voxel significant at p .00001 (Experiment 1) or p .000001 (Experiment 2) (Forman et al., 1995).”
Increasing Task Difficulty Facilitates the Cerebral Compensatory Response to Total Sleep Deprivation
(2004) · Sleep · doi:10.1093/sleep/27.3.445 · Cited by 214
Dissociation of Verbal Working Memory System Components Using a Delayed Serial Recall Task
Chein, J. M. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.11.1003 · Cited by 217
Functional MRI-BOLD of brainstem structures during visually triggered migraine
Cao, Y., Aurora, S. K., Nagesh, V., Patel, S. C., & Welch, K. M. A. (2002) · Neurology · doi:10.1212/wnl.59.1.72 · Cited by 216
Consolidation of human memory over decades revealed by functional magnetic resonance imaging
Haist, F., Gore, J. B., & Mao, H. (2001) · Nature Neuroscience · doi:10.1038/nn739 · Cited by 215
Mindfulness-induced selflessness: a MEG neurophenomenological study
Dor-Ziderman, Y., Berkovich-Ohana, A., Glicksohn, J., & Goldstein, A. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00582 · Cited by 205
“…band, were conducted using a non-parametric permutation analysis procedure (2000 permutations, Nichols and Holmes, 2001; Singh et al., 2003), and corrected for multiple comparisons based on a Monte Carlo simulation of random noise distribution (using AFNI’s 3dClustSim module, Forman et al., 1995).”
MethodAbbott, A. E., Nair, A., Keown, C. L., Datko, M., Jahedi, A., Fishman, I., & Müller, R.-A. (2016) · Cerebral Cortex · doi:10.1093/cercor/bhv191 · Cited by 214
“Correlation coefficients were standardized using Fisher's r-z transform and entered into one-and two-sample t-tests, with cluster correction at P < 0.05 (Forman et al. 1995).”
MethodInfluentialWay, B. M., Creswell, J. D., Eisenberger, N. I., & Lieberman, M. D. (2010) · Emotion · doi:10.1037/a0018312 · Cited by 211
“The correction for multiple comparisons in whole-brain analyses was carried out using an uncorrected p value of .005 combined with a cluster-size threshold of 20 voxels (Forman et al., 1995).”
Functional Magnetic Resonance Imaging Methods
Chen, J. E., & Glover, G. H. (2015) · Neuropsychology Review · doi:10.1007/s11065-015-9294-9 · Cited by 212
“1992, 2004), Monte Carlo simulation (Forman et al. 1995) and nonparametric permutation (Holmes et al.”
MethodNoradrenaline mediates amygdala activation in men and women during encoding of emotional material
van Stegeren, A. H., Goekoop, R., Everaerd, W., Scheltens, P., Barkhof, F., Kuijer, J. P. A., & Rombouts, S. A. R. B. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.09.011 · Cited by 212
Morawetz, C., Bode, S., Baudewig, J., & Heekeren, H. R. (2017) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsw169 · Cited by 210
“We utilized height and cluster size thresholding after establishing family wise error (FWE) thresholds using the alphasim procedure (Forman et al., 1995) at an initial significance level of P 0.001 and an FWE cluster level correction of P 0.05 (implemented in NeuroElf, http://neuroelf.net).”
MethodInfluentialfMRI BOLD response to alcohol stimuli in alcohol dependent young women
Tapert, S. F., Brown, G. G., Baratta, M. V., & Brown, S. A. (2004) · Addictive Behaviors · doi:10.1016/j.addbeh.2003.07.003 · Cited by 210
The neural correlates of visual imagery vividness – An fMRI study and literature review
Fulford, J., Milton, F., Salas, D., Smith, A., Simler, A., Winlove, C., & Zeman, A. (2018) · Cortex · doi:10.1016/j.cortex.2017.09.014 · Cited by 211
Cortical activation during delay discounting in abstinent methamphetamine dependent individuals
Hoffman, W. F., Schwartz, D. L., Huckans, M. S., McFarland, B. H., Meiri, G., Stevens, A. A., & Mitchell, S. H. (2008) · Psychopharmacology · doi:10.1007/s00213-008-1261-1 · Cited by 210
“Minimum cluster sizeswere generated using the Monte Carlo simulation method (Forman et al. 1995), which arrived at minimum cluster sizes of 6.”
MethodInfluentialCader, S., Cifelli, A., Abu-Omar, Y., Palace, J., & Matthews, P. M. (2006) · Brain · doi:10.1093/brain/awh670 · Cited by 210
“…using FMRIB’s Local Analysis of Mixed Effects (FLAME) model (Behrens et al., 2003) with Z (Gaussianized T) statistic images thresholded using clusters determined by Z > 3.5 and a (corrected) cluster significance of P = 0.01 (Worsley et al., 1992; Friston et al., 1994; Forman et al., 1995).”
MethodInfluentialBlumenfeld, R. S., Parks, C. M., Yonelinas, A. P., & Ranganath, C. (2011) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2010.21459 · Cited by 209
“Significant regions of activation within PFC were identified using an uncorrected statistical threshold of p .005, with a cluster size threshold chosen to control for multiple comparisons in the PFC (Forman et al., 1995 ).”
BackgroundMethodDecoding Actions at Different Levels of Abstraction
Wurm, M. F., & Lingnau, A. (2015) · The Journal of Neuroscience · doi:10.1523/jneurosci.0188-15.2015 · Cited by 207
“Finally, maps were corrected for multiple comparisons at p 0.05 at the cluster level, using a cluster size algorithm (Forman et al., 1995) based on Monte Carlo simulations (1000 iterations) as implemented in BrainVoyager 2.4.”
MethodInfluentialFunctional imaging of working memory in obstructive sleep-disordered breathing
Thomas, R. J., Rosen, B. R., Stern, C. E., Weiss, J. W., & Kwong, K. K. (2005) · Journal of Applied Physiology · doi:10.1152/japplphysiol.01225.2004 · Cited by 209
A neural mechanism of first impressions
Schiller, D., Freeman, J. B., Mitchell, J. P., Uleman, J. S., & Phelps, E. A. (2009) · Nature Neuroscience · doi:10.1038/nn.2278 · Cited by 208
“The probability of a false positive was determined from the frequency count of cluster sizes in the entire brain using a Monte Carlo simulatio”
MethodMacDonald, A. W., & Carter, C. S. (2003) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.112.4.689 · Cited by 208
Lateralization of motor circuits and handedness during finger movements
Solodkin, A., Hlustik, P., Noll, D. C., & Small, S. L. (2001) · European Journal of Neurology · doi:10.1046/j.1468-1331.2001.00242.x · Cited by 209
Self-citationPaulus, M. P., Hozack, N., Frank, L., Brown, G. G., & Schuckit, M. A. (2003) · Biological Psychiatry · doi:10.1016/s0006-3223(02)01442-7 · Cited by 208
“A threshold adjustment method based on Monte Carlo simulations was used to guard against identifying false positive areas of activation (Forman et al 1995).”
MethodCombining Brains: A Survey of Methods for Statistical Pooling of Information
Lazar, N. A., Luna, B., Sweeney, J. A., & Eddy, W. F. (2002) · NeuroImage · doi:10.1006/nimg.2002.1107 · Cited by 208
“In imaging studies, v will typically be very large, which in turn means that the thresholds used for deciding significance of a voxel, using this method, will be very large, larger than they need to be in many situations (Benjamini and Hochberg, 1995; Forman et al., 1995).”
BackgroundMethodSelf-citationTsukiura, T., & Cabeza, R. (2011) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsq025 · Cited by 206
“Additionally, because a minimum spatial extent of 15 contiguous voxels was required, Monte Carlo simulations of spatially correlated data yield a probability estimate of P 0.0001 (Forman et al., 1995).”
InfluentialAttention-related activity during episodic memory retrieval: a cross-function fMRI study
Cabeza, R., Dolcos, F., Prince, S. E., Rice, H. J., Weissman, D. H., & Nyberg, L. (2003) · Neuropsychologia · doi:10.1016/s0028-3932(02)00170-7 · Cited by 208
Somatotopy in Human Primary Motor and Somatosensory Hand Representations Revisited
Hlustik, P. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.4.312 · Cited by 208
“D contiguity threshold (Forman et al., 1995) of 3 voxels (volume ∼ 22 mm 3 ) was used to determine which voxels were active.”
MethodThe role of ventral frontostriatal circuitry in reward-based learning in humans.
Galvan, A., Hare, T. A., Davidson, M., Spicer, J., Glover, G., & Casey, B. J. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.2431-05.2005 · Cited by 207
“Contrasts were conducted with a random effects analysis, and a contiguity threshold of 50 transformed voxels (interpolated resolution of 1 mm 3 ) was used to correct for multiple comparisons (Forman et al., 1995).”
MethodAtypically diffuse functional connectivity between caudate nuclei and cerebral cortex in autism
Turner, K. C., Frost, L., Linsenbardt, D., McIlroy, J. R., & Müller, R.-A. (2006) · Behavioral and Brain Functions · doi:10.1186/1744-9081-2-34 · Cited by 207
“Monte-Carlo alpha simulations were used to determine cluster significance at a corrected threshold of p 60 ].”
MethodEvent-Related fMRI of Frontotemporal Activity During Word Encoding and Recognition in Schizophrenia
Ragland, J. D., Gur, R. C., Valdez, J., Turetsky, B. I., Elliott, M., Kohler, C., Siegel, S., Kanes, S., & Gur, R. E. (2004) · American Journal of Psychiatry · doi:10.1176/appi.ajp.161.6.1004 · Cited by 206
“05, based on the theory of Gaussian fields (42, 43).”
Khan, A. J., Nair, A., Keown, C. L., Datko, M. C., Lincoln, A. J., & Müller, R.-A. (2015) · Biological Psychiatry · doi:10.1016/j.biopsych.2015.03.024 · Cited by 208
Czisch, M., Wetter, T. C., Kaufmann, C., Pollmächer, T., Holsboer, F., & Auer, D. P. (2002) · NeuroImage · doi:10.1006/nimg.2002.1071 · Cited by 207
“A threshold of ͉CC͉ Ն 0.37 and to reduce false-positive activation (Forman et al., 1995) a cluster criterion of at least three activated pixels in the neighboring eight pixels were chosen for qualitative trial analysis and for selecting activated pixels for quantitative analysis.”
MethodInfluential
Metadata
- Authors
- Forman, S. D., Cohen, J. D., Fitzgerald, M., Eddy, W. F., Mintun, M. A., & Noll, D. C.
- Affiliations
- University of Pittsburgh (US)
- Corresponding author
- Forman, Steven D.
- Venue
- Magnetic Resonance in Medicine
- Publisher
- Wiley
- Published
- 1995-05
- Volume
- 33
- Issue
- 5
- Pages
- 636-647
- ISSN
- 0740-3194 (ISSN-L)
- 1522-2594
- OpenAlex
- W2044634376
- Cited by
- 3,202
- References
- 11
- Citations by year
- 2026: 27 · 2025: 26 · 2024: 30 · 2023: 36 · 2022: 45 · 2021: 55 · 2020: 64 · 2019: 75 · 2018: 96 · 2017: 137 · 2016: 140 · 2015: 188 · 2014: 203 · 2013: 213 · 2012: 242
- FWCI
- 14.83
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Magnetic Resonance in Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Functional Brain Connectivity Studies
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Advanced MRI Techniques and Applications
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Advanced Neuroimaging Techniques and Applications
- Keywords
- multiple comparisons, false positives, statistical power, fMRI activation detection, Monte Carlo simulation, cluster size distribution
- MeSH terms
- Brain, Data Interpretation, Statistical, False Positive Reactions, Humans, Magnetic Resonance Imaging, Monte Carlo Method, Probability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.