Task-Dependent Recruitment of Modality-Specific and Multimodal Regions during Conceptual Processing
Open accessThe DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
Conceptual knowledge is central to cognitive abilities such as word comprehension. Previous neuroimaging evidence indicates that concepts are at least partly composed of perceptual and motor features that are represented in the same modality-specific brain regions involved in actual perception and action. However, it is unclear to what extent the retrieval of perceptual–motor features and the resulting engagement of modality-specific regions depend on the concurrent task. To address this issue, we measured brain activity in 40 young and healthy participants using functional magnetic resonance imaging, while they performed three different tasks—lexical decision, sound judgment, and action judgment—on words that independently varied in their association with sounds and actions. We found neural activation for sound and action features of concepts selectively when they were task-relevant in brain regions also activated during auditory and motor tasks, respectively, as well as in higher-level, multimodal regions which were recruited during both sound and action feature retrieval. For the first time, we show that not only modality-specific perceptual–motor areas but also multimodal regions are engaged in conceptual processing in a flexible, task-dependent fashion, responding selectively to task-relevant conceptual features.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
The organization of the human cerebellum estimated by intrinsic functional connectivity
Buckner, R. L., Krienen, F. M., Castellanos, A., Diaz, J. C., & Yeo, B. T. T. (2011) · Journal of Neurophysiology · doi:10.1152/jn.00339.2011 · Cited by 7,304 · cited 1×
“…of the cerebellum activated during action and sound feature retrieval in the present study shows selective resting-state functional connectivity with all other multimodal conceptual regions identified here, that is, posterior IPL,pMTG,aIFG,and mPFC (Krienen and Buckner 2009; Buckner et al. 2011).”
Barsalou, L. W. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.103006.093639 · Cited by 5,936 · cited 2×
“…or motor processing supports grounded theories of conceptualprocessing,whichassumetheretrievalofconceptual knowledge to involve a partial reinstatement of activity in perceptual–motor areas during actual perception and action (Pulvermüller 1999; Barsalou 2008; Kiefer and Pulvermüller 2012).”
Thresholding of statistical maps in functional neuroimaging using the false discovery rate
Genovese, C. R., Lazar, N. A., & Nichols, T. (2002) · NeuroImage · doi:10.1006/nimg.2001.1037 · Cited by 4,923
Mesulam, M. (1998) · Brain · doi:10.1093/brain/121.6.1013 · Cited by 3,072 · cited 1×
“…modality-specific perceptual– motor regions to multiple levels of cross-modal CZs, including multimodal (bimodal, trimodal, etc.) up to heteromodal CZs, which receive input from all modalities (cf. Damasio 1989; Mesulam 1998; Simmons and Barsalou 2003; Binder and Desai 2011; Margulies et al. 2016).”
Where do you know what you know? The representation of semantic knowledge in the human brain
Patterson, K., Nestor, P. J., & Rogers, T. T. (2007) · Nature Reviews Neuroscience · doi:10.1038/nrn2277 · Cited by 2,706
Circular analysis in systems neuroscience: the dangers of double dipping
Kriegeskorte, N., Simmons, W. K., Bellgowan, P. S. F., & Baker, C. I. (2009) · Nature Neuroscience · doi:10.1038/nn.2303 · Cited by 2,696
Situating the default-mode network along a principal gradient of macroscale cortical organization
Margulies, D. S., Ghosh, S. S., Goulas, A., Falkiewicz, M., Huntenburg, J. M., Langs, G., Bezgin, G., Eickhoff, S. B., Castellanos, F. X., Petrides, M., et al. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1608282113 · Cited by 2,321 · cited 1×
“…modality-specific perceptual– motor regions to multiple levels of cross-modal CZs, including multimodal (bimodal, trimodal, etc.) up to heteromodal CZs, which receive input from all modalities (cf. Damasio 1989; Mesulam 1998; Simmons and Barsalou 2003; Binder and Desai 2011; Margulies et al. 2016).”
The neurobiology of semantic memory
Binder, J. R., & Desai, R. H. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.10.001 · Cited by 2,114
The neural and computational bases of semantic cognition
Ralph, M. A. L., Jefferies, E., Patterson, K., & Rogers, T. T. (2017) · Nature Reviews Neuroscience · doi:10.1038/nrn.2016.150 · Cited by 1,864
Brain mechanisms linking language and action
Pulvermüller, F. (2005) · Nature Reviews Neuroscience · doi:10.1038/nrn1706 · Cited by 1,828 · cited 2×
“This view is supported by studies demonstrating activation of modality-specific areas during implicit conceptual tasks (e.g., lexical decision; Pulvermüller et al.2005; Kiefer et al.2008,2012a) or even passive tasks (e.g., Hauk et al. 2004; Hauk and Pulver-müller 2004).”
Cerebellum and nonmotor function
Strick, P. L., Dum, R. P., & Fiez, J. A. (2009) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.31.060407.125606 · Cited by 1,777 · cited 1×
“…not included in contemporary models of conceptual processing (e.g., Binder and Desai 2011; Lambon Ralph et al. 2016), increasing evidence suggests that it contributes to higher cognitive processes and not just to movement planning and execution (for reviews, see Strick et al. 2009; Buckner 2013).”
Damasio, A. R. (1989) · Cognition · doi:10.1016/0010-0277(89)90005-x · Cited by 1,538 · cited 2×
“In addition to modality-specific areas, previous evidence suggests that conceptual processing involves “convergence zones” (Damasio 1989) at multiple hierarchical levels, which integrate modality-specific representations into increasingly abstract representations (Simmons and Barsalou 2003; Binder…”
BackgroundPuzzlingly High Correlations in fMRI Studies of Emotion, Personality, and Social Cognition
Vul, E., Harris, C., Winkielman, P., & Pashler, H. (2009) · Perspectives on Psychological Science · doi:10.1111/j.1745-6924.2009.01125.x · Cited by 1,475 · cited 1×
“To avoid circularity (Kriegeskorte et al. 2009; Vul et al. 2009), we employed a split-half approach, using half of the data of each subject (blocks 1–3) for fROI definition and the other half (blocks 4–6) for response estimation (cf. Fedorenko et al. 2011, 2013). fROI definition followed the GSS…”
Multiplexed echo planar imaging for sub-second whole brain FMRI and fast diffusion imaging
Feinberg, D. A., Moeller, S., Smith, S. M., Auerbach, E., Ramanna, S., Glasser, M. F., Miller, K. L., Ugurbil, K., & Yacoub, E. (2010) · PLoS ONE · doi:10.1371/journal.pone.0015710 · Cited by 1,296 · cited 1×
“Functional, blood oxygenation level-dependent (BOLD) images were acquired using a multiband (Feinberg et al. 2010) dual gradient-echo EPI sequence (repetition time [TR]: 2 s; echo time [TE]: 12 & 33 ms; flip angle: 90 ◦ ; field of view [FoV]: 204 mm; voxel size: 2.5 × 2.5 × 2.5 mm; slice gap: 0.25…”
InfluentialPulvermüller, F. (1999) · Behavioral and Brain Sciences · doi:10.1017/s0140525x9900182x · Cited by 1,284
Broad domain generality in focal regions of frontal and parietal cortex
Fedorenko, E., Duncan, J., & Kanwisher, N. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1315235110 · Cited by 952
Memory's echo: vivid remembering reactivates sensory-specific cortex
Wheeler, M. E., Petersen, S. E., & Buckner, R. L. (2000) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.97.20.11125 · Cited by 865
Transcranial magnetic stimulation and cognitive neuroscience
Walsh, V., & Cowey, A. (2000) · Nature Reviews Neuroscience · doi:10.1038/35036239 · Cited by 814 · cited 1×
“This issue cannot be addressed with correlative neuroimaging methods but requires methods that allow for causal inferences such as lesion or noninvasive brain stimulation studies (Walsh and Cowey 2000; Hartwigsen et al. 2015).”
New method for fMRI investigations of language: defining ROIs functionally in individual subjects
Fedorenko, E., Hsieh, P.-J., Nieto-Castañón, A., Whitfield-Gabrieli, S., & Kanwisher, N. (2010) · Journal of Neurophysiology · doi:10.1152/jn.00032.2010 · Cited by 686 · cited 2×
“We retained only those parcels within which at least 60% of subjects had any suprathreshold voxels or for which we had a priori hypotheses (cf. Fedorenko et al. 2010; Julian et al. 2012).”
Functional specificity for high-level linguistic processing in the human brain
Fedorenko, E., Behr, M. K., & Kanwisher, N. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1112937108 · Cited by 595 · cited 1×
“…approach, using half of the data of each subject (blocks 1–3) for fROI definition and the other half (blocks 4–6) for response estimation (cf. Fedorenko et al. 2011, 2013). fROI definition followed the GSS procedure (Julian et al. 2012): For each fROI type, subject-specific activation maps…”
Jefferies, E. (2013) · Cortex · doi:10.1016/j.cortex.2012.10.008 · Cited by 555
Siegel, J. S., Power, J. D., Dubis, J. W., Vogel, A. C., Church, J. A., Schlaggar, B. L., & Petersen, S. E. (2014) · Human Brain Mapping · doi:10.1002/hbm.22307 · Cited by 546
Noonan, K. A., Jefferies, E., Visser, M., & Lambon Ralph, M. A. (2013) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00442 · Cited by 543 · cited 4×
“Together with previous evidence, our data suggest that high-level multimodal CZs include left pIPL, pMTG, and mPFC (Binder et al. 2009; Binder 2016), and the ATL functions as an amodal hub (Jefferies 2013; Lambon Ralph et al. 2016).”
InfluentialOn staying grounded and avoiding quixotic dead ends
Barsalou, L. W. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-016-1028-3 · Cited by 331 · cited 3×
“…their representations are not amodal (i.e., completely abstracted away from modality-specific perceptual-motor information),but multimodal,that is,they retain modality-specific information about the individual features they integrate (cf. Barsalou 2016; Binder 2016; Fernandino et al.2016a,2016b).”
Concept representation reflects multimodal abstraction: A framework for embodied semantics
Fernandino, L., Binder, J. R., Desai, R. H., Pendl, S. L., Humphries, C. J., Gross, W. L., Conant, L. L., & Seidenberg, M. S. (2016) · Cerebral Cortex · doi:10.1093/cercor/bhv020 · Cited by 305
Debaere, F., Wenderoth, N., Sunaert, S., Van Hecke, P., & Swinnen, S. P. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00148-4 · Cited by 305 · cited 1×
“PMC is associated with actions in the environment (Rizzolatti et al. 1988; Davare et al. 2009), whereas SMA is linked to actions that require little monitoring of the environment, such as self-generated actions (Deecke and Kornhuber 1978; Halsband et al. 1994; Debaere et al. 2003).”
Nieto-Castañón, A., & Fedorenko, E. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.06.065 · Cited by 247 · cited 3×
“, the ability to separate adjacent but functionally distinct areas) than standard group analyses (Fedorenko et al. 2010; Nieto-Castañón and Fedorenko 2012).”
InfluentialModality-Independent Decoding of Semantic Information from the Human Brain
Simanova, I., Hagoort, P., Oostenveld, R., & van Gerven, M. A. J. (2014) · Cerebral Cortex · doi:10.1093/cercor/bhs324 · Cited by 138
Neuroimaging of Language: Why Hasn't a Clearer Picture Emerged?
Fedorenko, E., & Kanwisher, N. (2009) · Language and Linguistics Compass · doi:10.1111/j.1749-818x.2009.00143.x · Cited by 117
Cited by
Challenges and opportunities for grounding cognition.
Barsalou, L. W. (2020) · Journal of Cognition · doi:10.5334/joc.116 · Cited by 319
Cognitive neuroscience perspective on memory: overview and summary
Sridhar, S., Khamaj, A., & Asthana, M. K. (2023) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2023.1217093 · Cited by 80
“Modality-specific sensory, motor, and emotional system within these brain regions serve specialized tasks like language comprehension, while larger areas of the brain, such as the inferior parietal lobe and most of the temporal lobe, participate in more generalized interpretation tasks (Binder and Desai, 2011; Kuhnke…”
BackgroundAbstract Concepts and the Embodied Mind: Rethinking Grounded Cognition
Dove, G. (2022) · doi:10.1093/oso/9780190061975.001.0001 · Cited by 40
Metadata
- Authors
- Kuhnke, P., Kiefer, M., & Hartwigsen, G.
- Venue
- Cerebral Cortex
- Publisher
- Oxford University Press (OUP)
- Published
- 2020-03-06
- Volume
- 30
- Issue
- 7
- Pages
- 3938-3959
- ISSN
- 1047-3211 (ISSN-L)
- 1460-2199
- OpenAlex
- W2976943543
- Cited by
- 109
- References
- 30
- FWCI
- 7.89
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.