Reliability of an fMRI paradigm for emotional processing in a multisite longitudinal study
Open accessThe DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
Multisite neuroimaging studies can facilitate the investigation of brain‐related changes in many contexts, including patient groups that are relatively rare in the general population. Though multisite studies have characterized the reliability of brain activation during working memory and motor functional magnetic resonance imaging tasks, emotion processing tasks, pertinent to many clinical populations, remain less explored. A traveling participants study was conducted with eight healthy volunteers scanned twice on consecutive days at each of the eight North American Longitudinal Prodrome Study sites. Tests derived from generalizability theory showed excellent reliability in the amygdala ( = 0.82), inferior frontal gyrus (IFG; = 0.83), anterior cingulate cortex (ACC; = 0.76), insula ( = 0.85), and fusiform gyrus ( = 0.91) for maximum activation and fair to excellent reliability in the amygdala ( = 0.44), IFG ( = 0.48), ACC ( = 0.55), insula ( = 0.42), and fusiform gyrus ( = 0.83) for mean activation across sites and test days. For the amygdala, habituation ( = 0.71) was more stable than mean activation. In a second investigation, data from 111 healthy individuals across sites were aggregated in a voxelwise, quantitative meta‐analysis. When compared with a mixed effects model controlling for site, both approaches identified robust activation in regions consistent with expected results based on prior single‐site research. Overall, regions central to emotion processing showed strong reliability in the traveling participants study and robust activation in the aggregation study. These results support the reliability of blood oxygen level‐dependent signal in emotion processing areas across different sites and scanners and may inform future efforts to increase efficiency and enhance knowledge of rare conditions in the population through multisite neuroimaging paradigms. Hum Brain Mapp 36:2558–2579, 2015. © 2015 Wiley Periodicals, Inc.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Effectiveness of Antipsychotic Drugs in Patients with Chronic Schizophrenia
Lieberman, J. A., Stroup, T. S., McEvoy, J. P., Swartz, M. S., Rosenheck, R. A., Perkins, D. O., Keefe, R. S. E., Davis, S. M., Davis, C. E., Lebowitz, B. D., et al. (2005) · New England Journal of Medicine · doi:10.1056/nejmoa051688 · Cited by 5,892
Self-citationFunctional and effective connectivity in neuroimaging: a synthesis
Friston, K. J. (1994) · Human Brain Mapping · doi:10.1002/hbm.460020107 · Cited by 2,452
Non-invasive mapping of connections between human thalamus and cortex using diffusion imaging
Behrens, T. E. J., Johansen-Berg, H., Woolrich, M. W., Smith, S. M., Wheeler-Kingshott, C. A. M., Boulby, P. A., Barker, G. J., Sillery, E. L., Sheehan, K., Ciccarelli, O., et al. (2003) · Nature Neuroscience · doi:10.1038/nn1075 · Cited by 2,330 · cited 2×
“Group analysis was performed using FLAME (FMRIB’s Local Analysis of Mixed Effects) [Behrens et al., 2003; Smith et al., 2004] with each participant’s data, including parameter and variance estimates for each contrast from the lower-level analysis.”
Modulating emotional responses: effects of a neocortical network on the limbic system
Hariri, A. R., Bookheimer, S. Y., & Mazziotta, J. C. (2000) · NeuroReport · doi:10.1097/00001756-200001170-00009 · Cited by 1,277 · cited 8×
“The experimental paradigm consisted of an emotional faces task [Hariri et al., 2000; Lieberman et al., 2007].”
InfluentialCannon, T. D., Cadenhead, K., Cornblatt, B., Woods, S. W., Addington, J., Walker, E., Seidman, L. J., Perkins, D., Tsuang, M., McGlashan, T., et al. (2008) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2007.3 · Cited by 1,269 · cited 2×
“Multisite investigations provide an efficient way to recruit a large sample of participants, enhancing statistical power and the generalizability of results, and have thus contributed critical insight into conditions that are relatively rare in the general population [Addington et al., 2007; Beckett et al., 2010; Cann…”
Self-citationLieberman, M. D., Eisenberger, N. I., Crockett, M. J., Tom, S. M., Pfeifer, J. H., & Way, B. M. (2007) · Psychological Science · doi:10.1111/j.1467-9280.2007.01916.x · Cited by 1,150
Kober, H., Barrett, L. F., Joseph, J., Bliss-Moreau, E., Lindquist, K., & Wager, T. D. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.03.059 · Cited by 1,144 · cited 1×
“In addition, we examined several regions that are commonly activated during emotion paradigms [Fusar-Poli et al., 2009; Kober et al., 2008; Phan et al., 2002] to enhance generalizability to other studies of emotion processing.”
Brennan, R. L. (2001) · doi:10.1007/978-1-4757-3456-0 · Cited by 1,121
Neural correlates of dispositional mindfulness during affect labeling
Creswell, J. D., Way, B. M., Eisenberger, N. I., & Lieberman, M. D. (2007) · Psychosomatic Medicine · doi:10.1097/psy.0b013e3180f6171f · Cited by 835
Emotional Response Deficits in Schizophrenia: Insights From Affective Science
Kring, A. M., & Moran, E. K. (2008) · Schizophrenia Bulletin · doi:10.1093/schbul/sbn071 · Cited by 458 · cited 2×
“Emotion processing represents a core domain of impairment in schizophrenia [Kring and Moran, 2008; Mueser et al., 1996]; however, the extent to which deficits in emotion processing are present prior to the onset of psychosis and the role that they might play in its development remain unclear.”
Subjective responses to emotional stimuli during labeling, reappraisal, and distraction
Lieberman, M. D., Inagaki, T. K., Tabibnia, G., & Crockett, M. J. (2011) · Emotion · doi:10.1037/a0023503 · Cited by 288 · cited 3×
“, 2007] and has been associated with increased activation in the IFG and dampening of amygdala activation, as well as decreases in negative emotion and reduced physiological responsivity [Lieberman et al., 2011; Tabibnia et al., 2008].”
Test-retest reliability of evoked BOLD signals from a cognitive-emotive fMRI test battery.
Plichta, M. M., Schwarz, A. J., Grimm, O., Morgen, K., Mier, D., Haddad, L., Gerdes, A. B. M., Sauer, C., Tost, H., Esslinger, C., et al. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.01.129 · Cited by 287
Measuring fMRI reliability with the intra-class correlation coefficient
Caceres, A., Hall, D. L., Zelaya, F. O., Williams, S. C. R., & Mehta, M. A. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.12.035 · Cited by 255
Feelings Into Words: Contributions of Language to Exposure Therapy
Kircanski, K., Lieberman, M. D., & Craske, M. G. (2012) · Psychological Science · doi:10.1177/0956797612443830 · Cited by 249
Stability of amygdala BOLD response to fearful faces over multiple scan sessions
Johnstone, T., Somerville, L. H., Alexander, A. L., Oakes, T. R., Davidson, R. J., Kalin, N. H., & Whalen, P. J. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.12.016 · Cited by 155
Temporal stability of individual differences in amygdala reactivity
MANUCK, S. B., BROWN, S. M., FORBES, E. E., & HARIRI, A. R. (2007) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2007.07040609 · Cited by 111
Payer, D. E., Baicy, K., Lieberman, M. D., & London, E. D. (2012) · Emotion · doi:10.1037/a0027421 · Cited by 65 · cited 2×
“In conjunction with the current task’s widespread use with both healthy controls [Creswell et al., 2007; Lieberman et al., 2007; Payer et al., 2012] and clinical populations to date [Fakra et al.”
Cited by
Colich, N. L., Rosen, M. L., Williams, E. S., & McLaughlin, K. A. (2020) · Psychological Bulletin · doi:10.1037/bul0000270 · Cited by 433
Noble, S., Spann, M. N., Tokoglu, F., Shen, X., Constable, R. T., & Scheinost, D. (2017) · Cerebral Cortex · doi:10.1093/cercor/bhx230 · Cited by 377
Adolescent neurobiological susceptibility to social context
Schriber, R. A., & Guyer, A. E. (2016) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2015.12.009 · Cited by 246
Stevens, J. S., Kim, Y. J., Galatzer-Levy, I. R., Reddy, R., Ely, T. D., Nemeroff, C. B., Hudak, L. A., Jovanovic, T., Rothbaum, B. O., & Ressler, K. J. (2017) · Biological Psychiatry · doi:10.1016/j.biopsych.2016.11.015 · Cited by 177
“In addition, recent studies indicate that amygdala habituation, or the change over time in the response to a repeated stimulus, shows greater test-retest stability within individuals than reactivity (17,18).”
BackgroundLow emotional awareness as a transdiagnostic mechanism underlying psychopathology in adolescence
Weissman, D. G., Nook, E. C., Dews, A. A., Miller, A. B., Lambert, H. K., Sasse, S. F., Somerville, L. H., & McLaughlin, K. A. (2020) · Clinical Psychological Science · doi:10.1177/2167702620923649 · Cited by 91
“…self-reported distress, psychophysiological responses, and amygdala reactivity in children, adolescents, and adults (Burklund, David Creswell, Irwin, & Lieberman, 2014; Gee et al., 2015; Lieberman et al., 2007; Lieberman, Inagaki, Tabibnia, & Crockett, 2011; Tabibnia, Lieberman, & Craske, 2008).”
Metadata
- Authors
- Gee, D. G., McEwen, S. C., Forsyth, J. K., Haut, K. M., Bearden, C. E., Addington, J., Goodyear, B., Cadenhead, K. S., Mirzakhanian, H., Cornblatt, B. A., Olvet, D., Mathalon, D. H., McGlashan, T. H., Perkins, D. O., Belger, A., Seidman, L. J., Thermenos, H., Tsuang, M. T., van Erp, T. G. M., Walker, E. F., Hamann, S., Woods, S. W., Constable, T., & Cannon, T. D.
- Venue
- Human Brain Mapping
- Publisher
- Wiley
- Published
- 2015-03-28
- Volume
- 36
- Issue
- 7
- Pages
- 2558-2579
- ISSN
- 1065-9471 (ISSN-L)
- 1097-0193
- OpenAlex
- W1545909954
- Cited by
- 67
- References
- 18
- FWCI
- 5.35
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.