An asymmetrical relationship between verbal and visual thinking: Converging evidence from behavior and fMRI
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Humans rely on at least two modes of thought: verbal (inner speech) and visual (imagery). Are these modes independent, or does engaging in one entail engaging in the other? To address this question, we performed a behavioral and an fMRI study. In the behavioral experiment, participants received a prompt and were asked to either silently generate a sentence or create a visual image in their mind. They were then asked to judge the vividness of the resulting representation, and of the potentially accompanying representation in the other format. In the fMRI experiment, participants had to recall sentences or images (that they were familiarized with prior to the scanning session) given prompts, or read sentences and view images, in the control, perceptual, condition. An asymmetry was observed between inner speech and visual imagery. In particular, inner speech was engaged to a greater extent during verbal than visual thought, but visual imagery was engaged to a similar extent during both modes of thought. Thus, it appears that people generate more robust verbal representations during deliberate inner speech compared to when their intent is to visualize. However, they generate visual images regardless of whether their intent is to visualize or to think verbally. One possible interpretation of these results is that visual thinking is somehow primary, given the relatively late emergence of verbal abilities during human development and in the evolution of our species. HighlightsVerbal and visual thinking were examined in a behavioral and fMRI study.Inner speech can be evoked relatively independently of visual imagery.Individuals engage in visual imagery even when thinking verbally.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Baddeley, A. D., & Hitch, G. (1974) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60452-1 · Cited by 9,860
Construal-level theory of psychological distance.
Trope, Y., & Liberman, N. (2010) · Psychological Review · doi:10.1037/a0018963 · Cited by 6,618 · cited 1×
“For example, Amit et al. (2009) have shown that people use visual representations to prospect about proximal events, and verbal representations to prospect about distal events (see also Trope and Liberman, 2010).”
BackgroundMental Rotation of Three-Dimensional Objects
Shepard, R. N., & Metzler, J. (1971) · Science · doi:10.1126/science.171.3972.701 · Cited by 6,246
Running experiments on Amazon Mechanical Turk
Paolacci, G., Chandler, J., & Ipeirotis, P. G. (2010) · Judgment and Decision Making · doi:10.1017/s1930297500002205 · Cited by 3,767
Instructional manipulation checks: Detecting satisficing to increase statistical power
Oppenheimer, D. M., Meyvis, T., & Davidenko, N. (2009) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2009.03.009 · Cited by 3,493
Circular analysis in systems neuroscience: the dangers of double dipping
Kriegeskorte, N., Simmons, W. K., Bellgowan, P. S. F., & Baker, C. I. (2009) · Nature Neuroscience · doi:10.1038/nn.2303 · Cited by 2,696 · cited 2×
“…fROIs behave as expected showing robust localizer responses), we used an across-runs cross-validation procedure, as described in Nieto-Castañon and Fedorenko (2012), so that the data used for fROI definition were independent from the data used for response estimation (Kriegeskorte et al., 2009).”
Buckner, R. L., & Carroll, D. C. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.11.004 · Cited by 2,691
Price, C. J. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.04.062 · Cited by 2,159
The spatial and temporal signatures of word production components
Indefrey, P., & Levelt, W. J. M. (2004) · Cognition · doi:10.1016/j.cognition.2002.06.001 · Cited by 2,144
A cortical area selective for visual processing of the human body
Downing, P. E., Jiang, Y., Shuman, M., & Kanwisher, N. (2001) · Science · doi:10.1126/science.1063414 · Cited by 2,043
Poldrack, R. A., Wagner, A. D., Prull, M. W., Desmond, J. E., Glover, G. H., & Gabrieli, J. D. E. (1999) · NeuroImage · doi:10.1006/nimg.1999.0441 · Cited by 1,448 · cited 2×
“Such studies have shown that the brain regions of the language network – a set of frontal and temporal brain regions predominantly in the left hemisphere that are engaged during language comprehension – are active during covert production, both at the lexical/sub-lexical level (e.g., Smith et al., 1998; Poldrack et al…”
BackgroundSpontaneous giving and calculated greed
Rand, D. G., Greene, J. D., & Nowak, M. A. (2012) · Nature · doi:10.1038/nature11467 · Cited by 1,334
Grounded Cognition: Past, Present, and Future: Topics in Cognitive Science
Barsalou, L. W. (2010) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2010.01115.x · Cited by 993 · cited 1×
“It may be impossible to verbalize without invoking a corresponding visual representation (e.g., Barsalou, 2010; Boroditsky and Prinz, 2008; Hume, 1739/1951).”
BackgroundSpreng, R. N., & Grady, C. L. (2010) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21282 · Cited by 985 · cited 2×
“, 2008) to thought processes, especially those linked to our past experiences and future simulations (e.g., Buckner et al., 2008; Spreng and Grady, 2010; Andrews‐Hanna et al., 2014).”
BackgroundInferring mental states from neuroimaging data: from reverse inference to large-scale decoding
Poldrack, R. A. (2011) · Neuron · doi:10.1016/j.neuron.2011.11.001 · Cited by 821 · cited 1×
“…localizers benefit from higher sensitivity and functional resolution because they circumvent the well-documented inter-individual anatomical and functional variability (e.g., Nieto‐ Castañon and Fedorenko, 2012) while also minimizing the problem of “reverse inference” (e.g., Poldrack, 2011).”
BackgroundBrain areas underlying visual mental imagery and visual perception: an fMRI study
Ganis, G., Thompson, W. L., & Kosslyn, S. M. (2004) · Cognitive Brain Research · doi:10.1016/j.cogbrainres.2004.02.012 · Cited by 765
The cognitive functions of language
Carruthers, P. (2002) · Behavioral and Brain Sciences · doi:10.1017/s0140525x02000122 · Cited by 728 · cited 1×
“Inner speech has been shown to play an important role in propositional thought (e.g., Carruthers, 2002; Pléh, 2002), working memory (e.g., Baddeley and Hitch, 1974), long-term memory (e.g., Schrauf, 2002), numerical cognition (e.g., Frank et al., 2012), self-awareness (e.g., Siegrist, 1995), and…”
Navigating Into the Future or Driven by the Past
Seligman, M. E. P., Railton, P., Baumeister, R. F., & Sripada, C. (2013) · Perspectives on Psychological Science · doi:10.1177/1745691612474317 · Cited by 720 · cited 1×
“Furthermore, given that the way we think affects downstream beliefs, emotions, and decisions (e.g., Amit and Greene, 2012), our findings may be relevant to the growing body of research on prospection, i.e., the way people think about the future (e.g., Seligman et al., 2013, 2016).”
ResultNew method for fMRI investigations of language: defining ROIs functionally in individual subjects
Fedorenko, E., Hsieh, P.-J., Nieto-Castañón, A., Whitfield-Gabrieli, S., & Kanwisher, N. (2010) · Journal of Neurophysiology · doi:10.1152/jn.00032.2010 · Cited by 686 · cited 6×
“…generated from a group-level representation of language localizer data from 220 participants, are similar to the parcels reported originally in Fedorenko et al. (2010) based on a set of 25 participants, except that the two anterior temporal parcels (LAntTemp, and LMidAntTemp) ended up being…”
BackgroundMethodSelf-citationLives without imagery – Congenital aphantasia
Zeman, A., Dewar, M., & Della Sala, S. (2015) · Cortex · doi:10.1016/j.cortex.2015.05.019 · Cited by 621 · cited 3×
“…Chatterjee and Southwood, 1995; Bartolomeo, 2002, 2008), and some individuals with intact perceptual abilities appear unable to engage in volitional imagery (e.g., Charcot and Bernard, 1883; Nielsen, 1946; Zeman et al., 2015), although most still experience involuntary imagery (Zeman et al., 2015).”
BackgroundThe role of segmentation in phonological processing: an fMRI investigation
Burton, M. W., Small, S. L., & Blumstein, S. E. (2000) · Journal of Cognitive Neuroscience · doi:10.1162/089892900562309 · Cited by 378 · cited 2×
“…language comprehension – are active during covert production, both at the lexical/sub-lexical level (e.g., Smith et al., 1998; Poldrack et al., 1999; Burton et al., 2000; Indefrey and Levelt, 2004; Geva et al., 2011) and at the level of phrase and sentence production (e.g., Brown et al., 2006;…”
BackgroundBrown, S., Martinez, M. J., & Parsons, L. M. (2006) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2006.04785.x · Cited by 371
Functional anatomy of inner speech and auditory verbal imagery
McGuire, P. K., Silbersweig, D. A., Murray, R. M., David, A. S., Frackowiak, R. S. J., & Frith, C. D. (1996) · Psychological Medicine · doi:10.1017/s0033291700033699 · Cited by 277 · cited 1×
“…et al., 1998; Poldrack et al., 1999; Burton et al., 2000; Indefrey and Levelt, 2004; Geva et al., 2011) and at the level of phrase and sentence production (e.g., Brown et al., 2006; Golestani et al., 2006; Menenti et al., 2012; McGuire et al., 1996b; McGuire et al., 1996a; Shergill et al., 2001).”
BackgroundNieto-Castañón, A., & Fedorenko, E. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.06.065 · Cited by 247 · cited 1×
“…(to ensure that fROIs behave as expected showing robust localizer responses), we used an across-runs cross-validation procedure, as described in Nieto-Castañon and Fedorenko (2012), so that the data used for fROI definition were independent from the data used for response estimation…”
MethodSelf-citationA functional study of auditory verbal imagery
SHERGILL, S. S., BULLMORE, E. T., BRAMMER, M. J., WILLIAMS, S. C. R., MURRAY, R. M., & McGUIRE, P. K. (2001) · Psychological Medicine · doi:10.1017/s003329170100335x · Cited by 237 · cited 3×
“, 2011) and at the level of phrase and sentence production (e.g., Brown et al., 2006; Golestani et al., 2006; Menenti et al., 2012; McGuire et al., 1996b; McGuire et al., 1996a; Shergill et al., 2001).”
BackgroundGerlach, K. D., Spreng, R. N., Gilmore, A. W., & Schacter, D. L. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.01.030 · Cited by 224
Delamillieure, P., Doucet, G., Mazoyer, B., Turbelin, M.-R., Delcroix, N., Mellet, E., Zago, L., Crivello, F., Petit, L., Tzourio-Mazoyer, N., et al. (2010) · Brain Research Bulletin · doi:10.1016/j.brainresbull.2009.11.014 · Cited by 190 · cited 3×
“, 2014) and thinking during unconstrained cognition (Delamillieure et al., 2010).”
BackgroundMcNorgan, C. (2012) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2012.00285 · Cited by 178 · cited 2×
“, Bartolomeo, 2008) and perhaps other kinds of imagery (McNorgan, 2012) and thought (e.”
BackgroundThe neural correlates of inner speech defined by voxel-based lesion-symptom mapping
Geva, S., Jones, P. S., Crinion, J. T., Price, C. J., Baron, J.-C., & Warburton, E. A. (2011) · Brain · doi:10.1093/brain/awr232 · Cited by 173
Self-awareness and the left inferior frontal gyrus: Inner speech use during self-related processing
Morin, A., & Michaud, J. (2007) · Brain Research Bulletin · doi:10.1016/j.brainresbull.2007.06.013 · Cited by 141 · cited 1×
“…role in propositional thought (e.g., Carruthers, 2002; Pléh, 2002), working memory (e.g., Baddeley and Hitch, 1974), long-term memory (e.g., Schrauf, 2002), numerical cognition (e.g., Frank et al., 2012), self-awareness (e.g., Siegrist, 1995), and self-reflection (e.g., Morin and Michaud, 2007).”
The neural correlates of visual mental imagery: An ongoing debate
Bartolomeo, P. (2008) · Cortex · doi:10.1016/j.cortex.2006.07.001 · Cited by 123 · cited 2×
“…some individuals with severe visual perception deficits can apparently nevertheless engage in visual imagery (e.g., Chatterjee and Southwood, 1995; Bartolomeo, 2002, 2008), and some individuals with intact perceptual abilities appear unable to engage in volitional imagery (e.g., Charcot and…”
Background
Cited by
The language network as a natural kind within the broader landscape of the human brain
Fedorenko, E., Ivanova, A. A., & Regev, T. I. (2024) · Nature Reviews Neuroscience · doi:10.1038/s41583-024-00802-4 · Cited by 293
Self-citationThe roles of sensory perceptions and mental imagery in consumer decision-making
Kim, M., Kim, J.-H., Park, M., & Yoo, J. (2021) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2021.102517 · Cited by 97
The Language Network Is Recruited but Not Required for Nonverbal Event Semantics
Ivanova, A. A., Mineroff, Z., Zimmerer, V., Kanwisher, N., Varley, R., & Fedorenko, E. (2021) · Neurobiology of Language · doi:10.1162/nol_a_00030 · Cited by 65
Self-citationImagine, and you will find – Lack of attentional guidance through visual imagery in aphantasics
Monzel, M., Keidel, K., & Reuter, M. (2021) · Attention, Perception, & Psychophysics · doi:10.3758/s13414-021-02307-z · Cited by 61
Concepts in the Brain: The View From Cross-linguistic Diversity
Kemmerer, D. (2019) · doi:10.1093/oso/9780190682620.001.0001 · Cited by 42
Metadata
- Authors
- Amit, E., Hoeflin, C., Hamzah, N., & Fedorenko, E.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2017-05
- Volume
- 152
- Pages
- 619-627
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2597357884
- Cited by
- 78
- References
- 31
- FWCI
- 4.29
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.