Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): use of a cluster-size threshold
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
The typical functional magnetic resonance (fMRI) study presents a formidable problem of multiple statistical comparisons (i.e., > 10,000 in a 128 x 128 image). To protect against false positives, investigators have typically relied on decreasing the per pixel false positive probability. This approach incurs an inevitable loss of power to detect statistically significant activity. An alternative approach, which relies on the assumption that areas of true neural activity will tend to stimulate signal changes over contiguous pixels, is presented. If one knows the probability distribution of such cluster sizes as a function of per pixel false positive probability, one can use cluster-size thresholds independently to reject false positives. Both Monte Carlo simulations and fMRI studies of human subjects have been used to verify that this approach can improve statistical power by as much as fivefold over techniques that rely solely on adjusting per pixel false positive probabilities.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For all analyses, we determined cluster-size thresholds using Monte Carlo simulations in AFNI’s 3DClustSim (http://afni.nimh.nih.gov/afni/) which allowed for improved assessment of functional activation and correction for multiple comparisons (Forman et al., 1995) based on a grey matter mask.”
From Self-referential processing during observation of a speech performance task in social anxiety disorder from pre- to post-treatment: Evidence of disrupted neural activation (2019) · cites this paper as Forman et al., 1995
In the citing paper
“Two criteria were employed in evaluating activations: (i) only regions with peak voxels of P < 0.001 were considered; (ii) only clusters of activation including k !6 voxels in which all voxels met an uncorrected threshold of P < 0.005 were considered, yielding a functional threshold equivalent of P < 0.001 according to cluster size significance level corrections (Forman et al., 1995).”
From Attending to the present: mindfulness meditation reveals distinct neural modes of self-reference (2007) · cites this paper as Forman et al., 1995
In the citing paper
“Cluster thresholding was applied to increase power in identifying heavily recruited neural areas while maintaining a reasonably low Type-I error rate (Forman et al., 1995).”
From Attending to the present: mindfulness meditation reveals distinct neural modes of self-reference (2007) · cites this paper as Forman et al., 1995
In the citing paper
“For all FC analyses, a double statistical threshold (voxel-wise p < 0.01 and cluster size ≥ 78 voxels, as determined by AlphaSim with 10,000 Monte Carlo simulations) was used to obtain an alpha < 0.05 (corrected for multiple comparisons) (see details on the procedure at http://afni.nimh.nih.gov/afni/doc/manual/AlphaSim and in [30]).”
From Structural and Functional Cerebral Correlates of Hypnotic Suggestibility (2014) · cites this paper as [30]
In the citing paper
“The resulting maps from all participants in the HFA group and all participants in the control group were averaged and these group-averaged t-maps were displayed on group composite anatomical images with a statistical threshold of p < .001, adjusted for multiple comparisons with a cluster-filter of 10 contiguous pixels (42).”
From The Neural Circuitry Mediating Shifts in Behavioral Response and Cognitive Set in Autism (2008) · cites this paper as [42]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Self-citationNumerical recipes in C: the art of scientific computing
(1993) · Choice Reviews Online · doi:10.5860/choice.30-5638 · Cited by 17,933
A three-dimensional statistical analysis for CBF activation studies in human brain
Worsley, K. J., Evans, A. C., Marrett, S., & Neelin, P. (1992) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1992.127 · Cited by 2,036
Assessing the significance of focal activations using their spatial extent
Friston, K. J., Worsley, K. J., Frackowiak, R. S. J., Mazziotta, J. C., & Evans, A. C. (1994) · Human Brain Mapping · doi:10.1002/hbm.460010306 · Cited by 1,907
Comparing Functional (PET) Images: The Assessment of Significant Change
Friston, K. J., Frith, C. D., Liddle, P. F., & Frackowiak, R. S. J. (1991) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1991.122 · Cited by 1,625
MRI-PET Registration with Automated Algorithm
Woods, R. P., Mazziotta, J. C., & R. Cherry, A. S. (1993) · Journal of Computer Assisted Tomography · doi:10.1097/00004728-199307000-00004 · Cited by 1,617
The Relationship between Global and Local Changes in PET Scans
Friston, K. J., Frith, C. D., Liddle, P. F., Dolan, R. J., Lammertsma, A. A., & Frackowiak, R. S. J. (1990) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1990.88 · Cited by 858
Activation of the prefrontal cortex in a nonspatial working memory task with functional MRI
Cohen, J. D., Forman, S. D., Braver, T. S., Casey, B. J., Servan‐Schreiber, D., & Noll, D. C. (1994) · Human Brain Mapping · doi:10.1002/hbm.460010407 · Cited by 576
Self-citationSpiral K‐space MR imaging of cortical activation
Noll, D. C., Cohen, J. D., Meyer, C. H., & Schneider, W. (1995) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.1880050112 · Cited by 254
Self-citationPoline, J.-B., & Mazoyer, B. M. (1993) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.1993.57 · Cited by 155
Cited by
Items 101–200 of 1,095
Eigenvector Centrality Mapping for Analyzing Connectivity Patterns in fMRI Data of the Human Brain
Lohmann, G., Margulies, D. S., Horstmann, A., Pleger, B., Lepsien, J., Goldhahn, D., Schloegl, H., Stumvoll, M., Villringer, A., & Turner, R. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010232 · Cited by 505
“The results were corrected for multiple comparisons using cluster-size and cluster-value thresholds obtained by Monte-Carlo simulations [29,30] using a significance level of pv0:05.”
MethodThe Neural Basis of the Psychomotor Vigilance Task
(2005) · Sleep · doi:10.1093/sleep/28.9.1059 · Cited by 493
Functional Networks in Emotional Moral and Nonmoral Social Judgments
Moll, J., de Oliveira-Souza, R., Bramati, I. E., & Grafman, J. (2002) · NeuroImage · doi:10.1006/nimg.2002.1118 · Cited by 497
“Significance was assessed using a threshold corresponding to P Ͻ 0.001 (uncorrected) at the voxel level and a three-dimensional cluster extent threshold of 100 mm 3 to protect against Type I errors associated with multiple statistical comparisons (Forman et al., 1995).”
BackgroundMethodInfluentialIn the Zone or Zoning Out? Tracking Behavioral and Neural Fluctuations During Sustained Attention
Esterman, M., Noonan, S. K., Rosenberg, M., & DeGutis, J. (2013) · Cerebral Cortex · doi:10.1093/cercor/bhs261 · Cited by 490
“All resulting statistical maps were corrected for multiple comparisons using voxel-cluster Monte-Carlo-type α simulations (Forman et al. 1995) , resulting in a corrected significance level of α = 0.05 (individual-voxel intensity threshold of P < 0.01, cluster size of 54 contiguous voxels).”
MethodInfluentialValidating cluster size inference: random field and permutation methods
Hayasaka, S. (2003) · NeuroImage · doi:10.1016/j.neuroimage.2003.08.003 · Cited by 491
Vicarious responses to pain in anterior cingulate cortex: Is empathy a multisensory issue?
Morrison, I., Lloyd, D., Di Pellegrino, G., & Roberts, N. (2004) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.4.2.270 · Cited by 490
“Z (Gaussianized T/F) statistic images were thresholded using clusters determined by Z 1.8 and a (corrected) cluster significance threshold of p .05 (Forman et al., 1995; Friston, Worsley, Frackowiak, Mazziotta, & Evans, 1994; Worsley, Evans, Marrett, & Neelin, 1992).”
MethodInfluentialGoldin, P. R., Manber, T., Hakimi, S., Canli, T., & Gross, J. J. (2009) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2008.525 · Cited by 486
The principled control of false positives in neuroimaging
Bennett, C. M., Wolford, G. L., & Miller, M. B. (2009) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsp053 · Cited by 486
“Many authors justify this approach by referring to the results of Forman et al. (1995), who examined clustering behavior of voxels in fMRI.”
MethodResultFunctional connectivity in mild traumatic brain injury
Mayer, A. R., Mannell, M. V., Ling, J., Gasparovic, C., & Yeo, R. A. (2011) · Human Brain Mapping · doi:10.1002/hbm.21151 · Cited by 481
“05 using both parametric and spatial thresholds determined by 10,000 Monte Carlo simulations [Forman et al., 1995].”
MethodInfluentialSelf‐navigated spiral fMRI: Interleaved versus single‐shot
Glover, G. H., & Lai, S. (1998) · Magnetic Resonance in Medicine · doi:10.1002/mrm.1910390305 · Cited by 476
Blumberg, H. P., Leung, H.-C., Skudlarski, P., Lacadie, C. M., Fredericks, C. A., Harris, B. C., Charney, D. S., Gore, J. C., Krystal, J. H., & Peterson, B. S. (2003) · Archives of General Psychiatry · doi:10.1001/archpsyc.60.6.601 · Cited by 476
“This combined application of a statistical threshold and cluster filter has previously been shown to reduce substantially the false-positive identification of activated pixels at any given threshold.(59) Its use was intended to balance adjustment for the multiple comparisons while maintaining sufficient sensitivity to…”
BackgroundEmpirical Analyses of BOLD fMRI Statistics
Aguirre, G. K., Zarahn, E., & D'Esposito, M. (1997) · NeuroImage · doi:10.1006/nimg.1997.0264 · Cited by 472
“Because only a single suprathreshold voxel was required for a false-positive map, one might argue that requiring a cluster of suprathreshold voxels (Friston et al., 1994b; Forman et al., 1995; Xiong et al., 1995) would have reduced our false-positive rate.”
Amygdala response to facial expressions in children and adults.
Thomas, K. M., Drevets, W. C., Whalen, P. J., Eccard, C. H., Dahl, R. E., Ryan, N. D., & Casey, B. J. (2001) · Biological Psychiatry · doi:10.1016/s0006-3223(00)01066-0 · Cited by 470
Uddin, L. Q., Kaplan, J. T., Molnar-Szakacs, I., Zaidel, E., & Iacoboni, M. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.12.018 · Cited by 469
“Z (Gaussianised T/F) statistic images were thresholded using clusters determined by Z N 2.3 and a (corrected) cluster significance threshold of P = 0.05 (Forman et al., 1995; Friston et al., 1994; Worsley et al., 1992).”
InfluentialHow the brain integrates costs and benefits during decision making
Basten, U., Biele, G., Heekeren, H. R., & Fiebach, C. J. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0908104107 · Cited by 466
Dysregulation of Limbic and Auditory Networks in Tinnitus
Leaver, A. M., Renier, L., Chevillet, M. A., Morgan, S., Kim, H. J., & Rauschecker, J. P. (2011) · Neuron · doi:10.1016/j.neuron.2010.12.002 · Cited by 460
“05 using Montecarlo simulations (a means of estimating the rate of false positive voxels; Forman et al., 1995).”
Scott‐Van Zeeland, A. A., Dapretto, M., Ghahremani, D. G., Poldrack, R. A., & Bookheimer, S. Y. (2010) · Autism Research · doi:10.1002/aur.122 · Cited by 458
“00001 [Forman et al., 1995].”
MethodInfluentialCao, Y., D’Olhaberriague, L., Vikingstad, E. M., Levine, S. R., & Welch, K. M. A. (1998) · Stroke · doi:10.1161/01.str.29.1.112 · Cited by 458
Ventromedial Prefrontal Cortex Is Critical for the Regulation of Amygdala Activity in Humans
Motzkin, J. C., Philippi, C. L., Wolf, R. C., Baskaya, M. K., & Koenigs, M. (2015) · Biological Psychiatry · doi:10.1016/j.biopsych.2014.02.014 · Cited by 454
Cultural Influences on Neural Substrates of Attentional Control
Hedden, T., Ketay, S., Aron, A., Markus, H. R., & Gabrieli, J. D. E. (2008) · Psychological Science · doi:10.1111/j.1467-9280.2008.02038.x · Cited by 451
“…(absolute vs. relative), and congruency (incongruent vs. congruent), in order to locate regions demonstrating activation differences across task and culture (whole-brain threshold of p .05 corrected, achieved with p .005 and cluster size 49 for normalized, resliced voxels; Forman et al., 1995).”
BackgroundMotivational influences on cognitive control: Behavior, brain activation, and individual differences
LOCKE, H. S., & BRAVER, T. S. (2008) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.8.1.99 · Cited by 446
“In addition, an 8-voxel cluster size requirement was used to increase protection against false positives (Forman et al., 1995; McAvoy, Ollinger, & Buckner, 2001).”
MethodNeural basis of eye gaze processing deficits in autism
Pelphrey, K. A., Morris, J. P., & McCarthy, G. (2005) · Brain · doi:10.1093/brain/awh404 · Cited by 446
“The threshold for significance was set at a voxelwise uncorrected P < 0.05 (two-tailed) and a spatial extent of six functional voxels (Forman et al., 1995; Xiong et al., 1995).”
BackgroundInfluentialHeller, A. S., Johnstone, T., Shackman, A. J., Light, S. N., Peterson, M. J., Kolden, G. G., Kalin, N. H., & Davidson, R. J. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0910651106 · Cited by 444
fMRI evidence of age-related hippocampal dysfunction in feature binding in working memory
Mitchell, K. J., Johnson, M. K., Raye, C. L., & D’Esposito, M. (2000) · Cognitive Brain Research · doi:10.1016/s0926-6410(00)00029-x · Cited by 443
“In all cases, between conditions for young and older adults as indicated the condition name (instructing participants to remember by a significant Age3Condition interaction (where a object or location or both) appeared for 1 s, followed by region included at least 4 contiguous voxels [25], each of the three study arra…”
BackgroundInteractions between decision making and performance monitoring within prefrontal cortex
Walton, M. E., Devlin, J. T., & Rushworth, M. F. S. (2004) · Nature Neuroscience · doi:10.1038/nn1339 · Cited by 438
Voelcker-Rehage, C., Godde, B., & Staudinger, U. M. (2011) · Fronties in Human Neuroscience · doi:10.3389/fnhum.2011.00026 · Cited by 438
“Those voxels were identified that revealed for the incongruent condition a significant GROUP × test SESSION interaction effect (p < 0.01; corrected for multiple comparisons by cluster threshold estimation based on Monte Carlo simulations (Forman et al., 1995)).”
MethodInfluentialReal-Time Self-Regulation of Emotion Networks in Patients with Depression
Linden, D. E. J., Habes, I., Johnston, S. J., Linden, S., Tatineni, R., Subramanian, L., Sorger, B., Healy, D., & Goebel, R. (2012) · PLoS ONE · doi:10.1371/journal.pone.0038115 · Cited by 437
“05, using the cluster-level correction algorithm implemented in Brainvoyager to correct for multiple comparisons [24].”
MethodMeta-analysis of functional neuroimaging data: current and future directions
Wager, T. D., Lindquist, M., & Kaplan, L. (2007) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsm015 · Cited by 434
“005 with an eight-voxel extent that was reported to achieve ‘corrected’ false-positive control in simulations based on a single dataset (Forman et al., 1995).”
BackgroundInfluentialThe brain response to personally familiar faces in autism: Findings of fusiform activity and beyond
Pierce, K. (2004) · Brain · doi:10.1093/brain/awh289 · Cited by 432
“Correction for multiple comparisons was established using a voxel-cluster threshold technique (Forman et al., 1995) for an overall corrected level of significance (alpha) of 0.05 (individual voxel P < 0.001, two-tailed; minimum cluster threshold required = 702 mm3).”
MethodInfluentialDorsal striatum responses to reward and punishment: effects of valence and magnitude manipulations
DELGADO, M. R., LOCKE, H. M., STENGER, V. A., & FIEZ, J. A. (2003) · Cognitive, Affective, & Behavioral Neuroscience · doi:10.3758/cabn.3.1.27 · Cited by 431
“Regions of interest (ROIs) consisting of five or more contiguous voxels were selected, as a precaution against Type 1 errors (Forman et al., 1995).”
MethodHauser, T. U., Iannaccone, R., Stämpfli, P., Drechsler, R., Brandeis, D., Walitza, S., & Brem, S. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.08.028 · Cited by 428
“05, cluster-extent corrected for multiple comparisons (Forman et al., 1995; Slotnick et al., 2003) was used.”
MethodInfluentialBeyond threat: amygdala reactivity across multiple expressions of facial affect
Fitzgerald, D. A., Angstadt, M., Jelsone, L. M., Nathan, P. J., & Phan, K. L. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2005.11.003 · Cited by 427
Distinguishable brain activation networks for short- and long-term motor skill learning
Floyer-Lea, A., & Matthews, P. M. (2005) · Journal of Neurophysiology · doi:10.1152/jn.00717.2004 · Cited by 422
“Z (Gaussianized T/F) statistic images were corrected for multiple comparisons using cluster detection, with clusters determined by Z Ͼ 2.3 and a corrected cluster significance threshold of P ϭ 0.05 (Forman et al. 1995; Friston et al. 1994; Worsley et al. 1992).”
MethodInfluentialNeural Correlates of Different Types of Deception: An fMRI Investigation
Ganis, G. (2003) · Cerebral Cortex · doi:10.1093/cercor/13.8.830 · Cited by 419
“This method (i) estimates the smoothing present in the data based on a variant of the algorithm described by Forman et al. (Forman et al., 1995), and (ii) determines the number of clusters of a given size that would be significant at a particular threshold due to chance.”
BackgroundMethodTranscranial focused ultrasound stimulation of human primary visual cortex
Lee, W., Kim, H.-C., Jung, Y., Chung, Y. A., Song, I.-U., Lee, J.-H., & Yoo, S.-S. (2016) · Scientific Reports · doi:10.1038/srep34026 · Cited by 415
Cognitive Control, Goal Maintenance, and Prefrontal Function in Healthy Aging
Paxton, J. L., Barch, D. M., Racine, C. A., & Braver, T. S. (2008) · Cerebral Cortex · doi:10.1093/cercor/bhm135 · Cited by 417
“Participants were paid $25 per hour remuneration for their participation.”
InfluentialMeasuring shared responses across subjects using intersubject correlation
Nastase, S. A., Gazzola, V., Hasson, U., & Keysers, C. (2019) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsz037 · Cited by 407
“…the significance of clusters of voxels that survive this threshold by modeling the distribution of clusters occurring by chance using either random field theory (Worsley et al., 1992), Monte Carlo simulation (Forman et al., 1995) or per-mutations (Nichols and Holmes, 2002; Eklund et al., 2016).”
Who did what to whom? The neural basis of argument hierarchies during language comprehension
Bornkessel, I., Zysset, S., Friederici, A. D., von Cramon, D. Y., & Schlesewsky, M. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.01.032 · Cited by 414
“001 uncorrected) and with a volume greater than 216 mm (6 measured voxels) were considered (Braver and Bongiolatti, 2002; Forman et al., 1995).”
BackgroundDeficient approaches to human neuroimaging
Stelzer, J., Lohmann, G., Mueller, K., Buschmann, T., & Turner, R. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00462 · Cited by 412
“…should not be confused with large effect sizes or an adequate fit between Frontiers in Human Neuroscience www.frontiersin.org July 2014 | Volume 8 | Article 462 | 9 FIGURE 8 | Data simulation investigating the effects of a heterogeneous subject group (in terms of responders and non-responders).”
BackgroundCarter, C. S., MacDonald, A. W., Ross, L. L., & Stenger, V. A. (2001) · American Journal of Psychiatry · doi:10.1176/appi.ajp.158.9.1423 · Cited by 413
Cerebral Cortical Representation of Automatic and Volitional Swallowing in Humans
Martin, R. E., Goodyear, B. G., Gati, J. S., & Menon, R. S. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.85.2.938 · Cited by 408
The Role of Frontopolar Cortex in Subgoal Processing during Working Memory
Braver, T. S., & Bongiolatti, S. R. (2002) · NeuroImage · doi:10.1006/nimg.2001.1019 · Cited by 409
“The additional cluster-size requirement ensured an overall image-wise false-positive rate of P , 0.05 ( Forman et al., 1995; McAvoy et al., 2001).”
BackgroundInfluentialImpact of contour on aesthetic judgments and approach-avoidance decisions in architecture
Vartanian, O., Navarrete, G., Chatterjee, A., Fich, L. B., Leder, H., Modroño, C., Nadal, M., Rostrup, N., & Skov, M. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1301227110 · Cited by 404
FMRI evidence for a 'parietal reach region' in the human brain
Connolly, J. D., Andersen, R. A., & Goodale, M. A. (2003) · Experimental Brain Research · doi:10.1007/s00221-003-1587-1 · Cited by 404
“Active clusters of 10 or more voxels that exceeded a statistical threshold corrected for multiple comparisons were considered significant foci of activation (ROI) (Forman et al. 1995).”
BackgroundProcessing of Temporal Unpredictability in Human and Animal Amygdala
Herry, C., Bach, D. R., Esposito, F., Di Salle, F., Perrig, W. J., Scheffler, K., Lüthi, A., & Seifritz, E. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.5218-06.2007 · Cited by 401
“For differential effects (unpredictable vs predictable), we used a combined voxel- and cluster-level correction approach based on the three-dimensional extension of the randomization procedure described by Forman et al. (1995) (see also Etkin et al., 2004).”
MethodRogers, R. D., Ramnani, N., Mackay, C., Wilson, J. L., Jezzard, P., Carter, C. S., & Smith, S. M. (2004) · Biological Psychiatry · doi:10.1016/j.biopsych.2003.11.012 · Cited by 398
McDermott, K. B., Petersen, S. E., Watson, J. M., & Ojemann, J. G. (2003) · Neuropsychologia · doi:10.1016/s0028-3932(02)00162-8 · Cited by 393
“Previous Monte Carlo simulations on random noise patterns (using a method similar to that described in [14]) suggested that to achieve a whole-brain P-value of 0.”
MethodHigh-resolution mapping of iso-orientation columns by fMRI
Kim, D.-S., Duong, T. Q., & Kim, S.-G. (2000) · Nature Neuroscience · doi:10.1038/72109 · Cited by 393
“To determine the existence of BOLD activity per se , the MR signals were first cross-correlated with the stimulation protoco”
MethodDevelopmental Changes in Human Cerebral Functional Organization for Word Generation
Brown, T. T., Lugar, H. M., Coalson, R. S., Miezin, F. M., Petersen, S. E., & Schlaggar, B. L. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhh129 · Cited by 393
“For all voxel-wise analyses, a correction based on Monte Carlo simulation was implemented to guard against false positives that may result from conducting a large number of statistical comparisons over many images (Forman et al., 1995; McAvoy et al., 2001).”
MethodNeural mechanisms of top-down control during spatial and feature attention
Giesbrecht, B., Woldorff, M. G., Song, A. W., & Mangun, G. R. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00162-9 · Cited by 391
“To reduce the rate of false positives, a spatial 499B. Giesbrecht et al. / NeuroImage 19 (2003) 496–512 extent threshold of 10 contiguous voxels was also applied (Forman et al., 1995; Friston et al., 1994; Poline et al., 1997; Xiong et al., 1995).”
BackgroundMethodFraser, C., Power, M., Hamdy, S., Rothwell, J., Hobday, D., Hollander, I., Tyrell, P., Hobson, A., Williams, S., & Thompson, D. (2002) · Neuron · doi:10.1016/s0896-6273(02)00705-5 · Cited by 391
Breastfeeding, brain activation to own infant cry, and maternal sensitivity
Kim, P., Feldman, R., Mayes, L. C., Eicher, V., Thompson, N., Leckman, J. F., & Swain, J. E. (2011) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2011.02406.x · Cited by 386
“The significance threshold for between-group differences was set at p < .01, and was corrected for multiple comparisons at the cluster-level false-positive rate (a) of .05 (Forman et al., 1995; Goebel, Esposito, & Formisano, 2006).”
Musso, F., Brinkmeyer, J., Mobascher, A., Warbrick, T., & Winterer, G. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.01.093 · Cited by 387
“…analyses were then conducted using FLAME (FMRIB's local analysis of mixed effects) (Behrens et al., 2003) with spatial normalization to MNI (Montreal Neurological Institute) space and applying a cluster significance threshold of ZN2 (Forman et al., 1995; Friston et al., 1996;Worsley et al., 1992).”
MethodDifferences in the functional neuroanatomy of inhibitory control across the adult life span.
Nielson, K. A., Langenecker, S. A., & Garavan, H. (2002) · Psychology and Aging · doi:10.1037//0882-7974.17.1.56 · Cited by 386
“The advantages of combining a voxel-based threshold with a minimum cluster size have been described elsewhere (e.g., Forman et al., 1995; Ward et al., 1998).”
Capuron, L., Pagnoni, G., Drake, D. F., Woolwine, B. J., Spivey, J. R., Crowe, R. J., Votaw, J. R., Goodman, M. M., & Miller, A. H. (2012) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2011.2094 · Cited by 382
“05.(32) Using this procedure, 20 clusters were identified.”
MethodMakin, T. R., Holmes, N. P., & Zohary, E. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.3653-06.2007 · Cited by 381
“05 for each experiment (Forman et al., 1995) (implemented by Monte Carlo simulations in BV QX).”
MethodInfluentialEnhanced Intersubject Correlations during Movie Viewing Correlate with Successful Episodic Encoding
Hasson, U., Furman, O., Clark, D., Dudai, Y., & Davachi, L. (2008) · Neuron · doi:10.1016/j.neuron.2007.12.009 · Cited by 378
“The correction took into account the resolution of the sampling (3 mm 3 3 mm) and the spatial smoothness applied to the data set (FWHM 6mm), and closely followed the procedure introduced by Forman et al. (Forman et al., 1995; Goebel et al., 2006).”
MethodInfluentialNeural Response to Alcohol Stimuli in Adolescents With Alcohol Use Disorder
Tapert, S. F., Cheung, E. H., Brown, G. G., Frank, L. R., Paulus, M. P., Schweinsburg, A. D., Meloy, M. J., & Brown, S. A. (2003) · Archives of General Psychiatry · doi:10.1001/archpsyc.60.7.727 · Cited by 378
Heekeren, H. R., Marrett, S., Ruff, D. A., Bandettini, P. A., & Ungerleider, L. G. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0603949103 · Cited by 374
Leaver, A. M., & Rauschecker, J. P. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.0296-10.2010 · Cited by 376
“05 using Monte Carlo simulations (a means of estimating the rate of false-positive voxels) (Forman et al., 1995).”
MethodInfluentialCue-Induced Brain Activity in Pathological Gamblers
Crockford, D. N., Goodyear, B., Edwards, J., Quickfall, J., & el-Guebaly, N. (2005) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.04.037 · Cited by 375
Adaptive Changes in Early and Late Blind: A fMRI Study of Braille Reading
Burton, H., Snyder, A. Z., Conturo, T. E., Akbudak, E., Ollinger, J. M., & Raichle, M. E. (2002) · Journal of Neurophysiology · doi:10.1152/jn.00285.2001 · Cited by 373
“These Z-score statistical maps were corrected for multiple comparisons using a Monte Carlo simulated distribution, and inspected using a Z-score threshold of 4.5 over a minimum of 3 contiguous voxels (P 0.05) (Forman et al. 1995).”
MethodInfluentialStelzer, J., Chen, Y., & Turner, R. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2012.09.063 · Cited by 372
Nystrom, L. E., Braver, T. S., Sabb, F. W., Delgado, M. R., Noll, D. C., & Cohen, J. D. (2000) · NeuroImage · doi:10.1006/nimg.2000.0572 · Cited by 372
“Again, the additional constraint that regions contain eight or more contiguous voxels ensured an effective image-wide a of P , 0.01 (Forman et al., 1995).”
BackgroundInfluentialSelf-citationOrbitofrontal cortex tracks positive mood in mothers viewing pictures of their newborn infants
Nitschke, J. B., Nelson, E. E., Rusch, B. D., Fox, A. S., Oakes, T. R., & Davidson, R. J. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.10.005 · Cited by 371
Origin of Negative Blood Oxygenation Level—Dependent fMRI Signals
Harel, N., Lee, S.-P., Nagaoka, T., Kim, D.-S., & Kim, S.-G. (2002) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1097/00004647-200208000-00002 · Cited by 369
“04 (Forman et al., 1995).”
MethodInfluentialPelphrey, K. A., Morris, J. P., Michelich, C. R., Allison, T., & McCarthy, G. (2005) · Cerebral Cortex · doi:10.1093/cercor/bhi064 · Cited by 369
“The threshold for significance was set at a voxelwise uncorrected P < 0.05 (two-tailed) and a spatial extent of three functional voxels (Forman et al., 1995; Xiong et al., 1995).”
BackgroundInfluentialPaulus, M. P., Tapert, S. F., & Schuckit, M. A. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.7.761 · Cited by 369
Grossman, M. (2003) · Brain · doi:10.1093/brain/awh075 · Cited by 366
“Instead, for all analyses, we accepted only clusters comprised of >100 adjacent voxels because this would also demonstrate a consistent effect in a particular neuroanatomical distribution (Forman et al., 1995).”
MethodTelling truth from lie in individual subjects with fast event‐related fMRI
Langleben, D. D., Loughead, J. W., Bilker, W. B., Ruparel, K., Childress, A. R., Busch, S. I., & Gur, R. C. (2005) · Human Brain Mapping · doi:10.1002/hbm.20191 · Cited by 366
“Significance thresholds were based on spatial extent using a height of z 2.57 and cluster probability P 0.05 [Forman et al., 1995].”
MethodInfluentialEffects of memory training on cortical thickness in the elderly
Engvig, A., Fjell, A. M., Westlye, L. T., Moberget, T., Sundseth, Ø., Larsen, V. A., & Walhovd, K. B. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.05.041 · Cited by 364
“For the group×time interaction analysis, we controlled the familywise error (FWE) rate by the means of Z Monte Carlo simulations (Forman et al., 1995) as implemented in FreeSurfer (Hagler et al.”
MethodFunctional magnetic resonance imaging of synesthesia: activation of V4/V8 by spoken words
Nunn, J. A., Gregory, L. J., Brammer, M., Williams, S. C. R., Parslow, D. M., Morgan, M. J., Morris, R. G., Bullmore, E. T., Baron-Cohen, S., & Gray, J. A. (2002) · Nature Neuroscience · doi:10.1038/nn818 · Cited by 364
Implicit Perceptual Anticipation Triggered by Statistical Learning
Turk-Browne, N. B., Scholl, B. J., Johnson, M. K., & Chun, M. M. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.0858-10.2010 · Cited by 363
“This cluster size threshold was calculated based on Forman et al. (1995), but improved to take into account smoothness of 3D statistical maps (Goebel et al., 2006).”
MethodShulman, G. L., Astafiev, S. V., Franke, D., Pope, D. L. W., Snyder, A. Z., McAvoy, M. P., & Corbetta, M. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.5609-08.2009 · Cited by 362
“All voxelwise ANOVAs were corrected for nonindependence of time points by adjusting the degrees of freedom and corrected over the brain for multiple comparisons using joint z-score/cluster size thresholds (Forman et al., 1995) corresponding to z 3.0 and a cluster size of 13 face-contiguous voxels.”
MethodInfluentialAtypical default network connectivity in youth with attention-deficit/hyperactivity disorder
Fair, D. A., Posner, J., Nagel, B. J., Bathula, D., Dias, T. G. C., Mills, K. L., Blythe, M. S., Giwa, A., Schmitt, C. F., & Nigg, J. T. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.07.003 · Cited by 354
Anterior cingulate cortex and response conflict: Effects of response modality and processing domain
Barch, D. M. (2001) · Cerebral Cortex · doi:10.1093/cercor/11.9.837 · Cited by 359
Canli, T., Omura, K., Haas, B. W., Fallgatter, A., Constable, R. T., & Lesch, K. P. (2005) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0503880102 · Cited by 359
Fornito, A., Yücel, M., Patti, J., Wood, S. J., & Pantelis, C. (2009) · Schizophrenia Research · doi:10.1016/j.schres.2008.12.011 · Cited by 359
“, 2008), but studies that combined uncorrected thresholds with spatial extent thresholds (effectively equating a corrected threshold; Forman et al., 1995) were included.”
BackgroundThe Effect of Preceding Context on Inhibition: An Event-Related fMRI Study
Durston, S., Thomas, K. M., Worden, M. S., Yang, Y., & Casey, B. J. (2002) · NeuroImage · doi:10.1006/nimg.2002.1074 · Cited by 358
An event-related functional MRI study comparing interference effects in the Simon and Stroop tasks
Peterson, B. S., Kane, M. J., Alexander, G. M., Lacadie, C., Skudlarski, P., Leung, H.-C., May, J., & Gore, J. C. (2002) · Cognitive Brain Research · doi:10.1016/s0926-6410(02)00054-x · Cited by 357
The Moral Affiliations of Disgust: A Functional MRI Study
Moll, J., de Oliveira-Souza, R., Moll, F. T., Ignácio, F. A., Bramati, I. E., Caparelli-Dáquer, E. M., & Eslinger, P. J. (2005) · Cognitive and Behavioral Neurology · doi:10.1097/01.wnn.0000152236.46475.a7 · Cited by 355
“A 50- to 100-mm(3) cluster threshold was used to protect against type I errors.(28) Statistical parametric maps(29) were created with BrainVoyager version 4.”
MethodChanging Brain Networks for Visuomotor Control With Increased Movement Automaticity
Floyer-Lea, A., & Matthews, P. M. (2004) · Journal of Neurophysiology · doi:10.1152/jn.01092.2003 · Cited by 355
Brain mechanisms for processing affective touch
Gordon, I., Voos, A. C., Bennett, R. H., Bolling, D. Z., Pelphrey, K. A., & Kaiser, M. D. (2013) · Human Brain Mapping · doi:10.1002/hbm.21480 · Cited by 353
“Analyses of each touch condition separately were assessed at a threshold of q < 0.05, and were corrected for multiple comparisons using cluster thresholds determined by the Brain Voyager QX cluster-level statistical threshold estimator plug-in (Forman et al., 1995; Goebel et al., 2006).”
MethodInfluentialKaiser, M. D., Hudac, C. M., Shultz, S., Lee, S. M., Cheung, C., Berken, A. M., Deen, B., Pitskel, N. B., Sugrue, D. R., Voos, A. C., et al. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1010412107 · Cited by 352
Contributions of amygdala and striatal activity in emotion regulation.
Hare, T. A., Tottenham, N., Davidson, M. C., Glover, G. H., & Casey, B. J. (2005) · Biological Psychiatry · doi:10.1016/j.biopsych.2004.12.038 · Cited by 351
“Post hoc t tests were performed on significant main effects.”
MethodSeparating semantic conflict and response conflict in the Stroop task: A functional MRI study
van Veen, V., & Carter, C. S. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.04.042 · Cited by 348
An fMRI study of reward-related probability learning
Delgado, M. R., Miller, M. M., Inati, S., & Phelps, E. A. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.10.002 · Cited by 346
“Regions of interest comprised of five or more contiguous voxels were selected, as a precaution against type-1 errors (Forman et al., 1995).”
MethodCabeza, R., Rao, S. M., Wagner, A. D., Mayer, A. R., & Schacter, D. L. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.081082698 · Cited by 345
Rilling, J. K., DeMarco, A. C., Hackett, P. D., Chen, X., Gautam, P., Stair, S., Haroon, E., Thompson, R., Ditzen, B., Patel, R., et al. (2014) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2013.09.022 · Cited by 343
“05 corrected for multiple comparisons based on the volume of clusters of contiguous voxels, using a 3D extension (implemented in BrainVoyager) of a 2D Monte Carlo simulation procedure (Forman et al., 1995).”
MethodWhen Language Meets Action: The Neural Integration of Gesture and Speech
Willems, R. M., Özyürek, A., & Hagoort, P. (2007) · Cerebral Cortex · doi:10.1093/cercor/bhl141 · Cited by 342
“…multiple comparisons problem introduced by the massive univariate approach taken, a voxel-wise intensity threshold (P < 0.003) was combined with a cluster extend threshold of R > 41 contiguous 3 3 3 3 3 mm voxels, to control for false positives at an alpha level of P < 0.05 (Forman et al. 1995).”
MethodInfluentialUrsu, S., Stenger, V. A., Shear, M. K., Jones, M. R., & Carter, C. S. (2003) · Psychological Science · doi:10.1111/1467-9280.24411 · Cited by 341
“For a total number of voxels of 500 in the ACC and approximately 9,800 in the whole volume, the image-wise Type I error rate was equivalent to a Bonferroni-corrected value of .03 for the ACC analyses and .05 for the whole-brain analyses (Forman et al., 1995).”
MethodAdcock, J. E., Wise, R. G., Oxbury, J. M., Oxbury, S. M., & Matthews, P. M. (2003) · NeuroImage · doi:10.1016/s1053-8119(02)00013-7 · Cited by 341
Karalunas, S. L., Fair, D., Musser, E. D., Aykes, K., Iyer, S. P., & Nigg, J. T. (2014) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.763 · Cited by 340
RetractedFunctional MRI-BOLD of Visually Triggered Headache in Patients With Migraine
Cao, Y., Welch, K. M. A., Aurora, S., & Vikingstad, E. M. (1999) · Archives of Neurology · doi:10.1001/archneur.56.5.548 · Cited by 340
How the Opinion of Others Affects Our Valuation of Objects
Campbell-Meiklejohn, D. K., Bach, D. R., Roepstorff, A., Dolan, R. J., & Frith, C. D. (2010) · Current Biology · doi:10.1016/j.cub.2010.04.055 · Cited by 339
“05 [31-33].”
The mind of expert motor performance is cool and focused
Milton, J., Solodkin, A., Hluštík, P., & Small, S. L. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.01.003 · Cited by 340
“In particular, we performed a Monte Carlo simulation (Forman et al., 1995) with 10,000 iterations to establish a single voxel statistical threshold (1.0 × 10 − 5 ), given the minimally acceptable cluster size of none voxels (189 mm 3 ) and the desired whole-brain alpha level (p ≤ 0.05).”
MethodInfluentialKerns, J. G., Cohen, J. D., MacDonald, A. W., Johnson, M. K., Stenger, V. A., Aizenstein, H., & Carter, C. S. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.10.1833 · Cited by 336
Self-citationGetting a grip on other minds: Mirror neurons, intention understanding, and cognitive empathy
Kaplan, J. T., & Iacoboni, M. (2006) · Social Neuroscience · doi:10.1080/17470910600985605 · Cited by 333
“05 (Forman, Cohen, Fitzgerald, Eddy, Mintun, & Noll, 1995 ; Friston, Worsley, Frakowiak, Mazziotta, & Evans, 1994 ; Worsley, Evans, Marrett, & Neelin, 1992 ).”
Oxytocin enhances brain function in children with autism
Gordon, I., Vander Wyk, B. C., Bennett, R. H., Cordeaux, C., Lucas, M. V., Eilbott, J. A., Zagoory-Sharon, O., Leckman, J. F., Feldman, R., & Pelphrey, K. A. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1312857110 · Cited by 336
Large-scale mirror-symmetry organization of human occipito-temporal object areas
Hasson, U., Harel, M., Levy, I., & Malach, R. (2003) · Neuron · doi:10.1016/s0896-6273(03)00144-2 · Cited by 336
Metadata
- Authors
- Forman, S. D., Cohen, J. D., Fitzgerald, M., Eddy, W. F., Mintun, M. A., & Noll, D. C.
- Affiliations
- University of Pittsburgh (US)
- Corresponding author
- Forman, Steven D.
- Venue
- Magnetic Resonance in Medicine
- Publisher
- Wiley
- Published
- 1995-05
- Volume
- 33
- Issue
- 5
- Pages
- 636-647
- ISSN
- 0740-3194 (ISSN-L)
- 1522-2594
- OpenAlex
- W2044634376
- Cited by
- 3,202
- References
- 11
- Citations by year
- 2026: 27 · 2025: 26 · 2024: 30 · 2023: 36 · 2022: 45 · 2021: 55 · 2020: 64 · 2019: 75 · 2018: 96 · 2017: 137 · 2016: 140 · 2015: 188 · 2014: 203 · 2013: 213 · 2012: 242
- FWCI
- 14.83
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Magnetic Resonance in Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Functional Brain Connectivity Studies
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Advanced MRI Techniques and Applications
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Advanced Neuroimaging Techniques and Applications
- Keywords
- multiple comparisons, false positives, statistical power, fMRI activation detection, Monte Carlo simulation, cluster size distribution
- MeSH terms
- Brain, Data Interpretation, Statistical, False Positive Reactions, Humans, Magnetic Resonance Imaging, Monte Carlo Method, Probability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.