Words Jump-Start Vision: A Label Advantage in Object Recognition
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
People use language to shape each other's behavior in highly flexible ways. Effects of language are often assumed to be "high-level" in that, whereas language clearly influences reasoning, decision making, and memory, it does not influence low-level visual processes. Here, we test the prediction that words are able to provide top-down guidance at the very earliest stages of visual processing by acting as powerful categorical cues. We investigated whether visual processing of images of familiar animals and artifacts was enhanced after hearing their name (e.g., "dog") compared with hearing an equally familiar and unambiguous nonverbal sound (e.g., a dog bark) in 14 English monolingual speakers. Because the relationship between words and their referents is categorical, we expected words to deploy more effective categorical templates, allowing for more rapid visual recognition. By recording EEGs, we were able to determine whether this label advantage stemmed from changes to early visual processing or later semantic decision processes. The results showed that hearing a word affected early visual processes and that this modulation was specific to the named category. An analysis of ERPs showed that the P1 was larger when people were cued by labels compared with equally informative nonverbal cues-an enhancement occurring within 100 ms of image onset, which also predicted behavioral responses occurring almost 500 ms later. Hearing labels modulated the P1 such that it distinguished between target and nontarget images, showing that words rapidly guide early visual processing.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Whatever next? Predictive brains, situated agents, and the future of cognitive science
Clark, A. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000477 · Cited by 5,924
Kutas, M., & Federmeier, K. D. (2011) · Annual Review of Psychology · doi:10.1146/annurev.psych.093008.131123 · Cited by 4,377 · cited 5×
“Furthermore, whereas incongruent cues led to greater N4s compared with congruent ones (a classic N4 semantic incongruity effect; Kutas and Hillyard, 1984; Kutas and Federmeier, 2011), these effects were equivalent for verbal and nonverbal cues, supporting our contention that the two cue types were equivalently informa…”
BackgroundInfluentialElectrophysiological correlates of feature analysis during visual search
LUCK, S. J., & HILLYARD, S. A. (1994) · Psychophysiology · doi:10.1111/j.1469-8986.1994.tb02218.x · Cited by 1,485 · cited 1×
“Both the cue type and congruence effects were also reflected on the P2, an ERP component known to index matching processes between sensory inputs and memory (Luck and Hillyard, 1994; Freunberger et al., 2007).”
BackgroundKosslyn, S. M., Thompson, W. L., & Ganis, G. (2006) · doi:10.1093/acprof:oso/9780195179088.001.0001 · Cited by 909
Allison, T. (1999) · Cerebral Cortex · doi:10.1093/cercor/9.5.415 · Cited by 882 · cited 3×
“Classically, the P1 and N1 components are known to reflect processing of low-level visual features (e.g., contrast, color, luminance; Spehlmann, 1965; Mangun and Hillyard, 1991; Allison et al., 1999).”
BackgroundLess Is More: Expectation Sharpens Representations in the Primary Visual Cortex
Kok, P., Jehee, J. F. M., & de Lange, F. P. (2012) · Neuron · doi:10.1016/j.neuron.2012.04.034 · Cited by 798
How neurons make meaning: brain mechanisms for embodied and abstract-symbolic semantics
Pulvermüller, F. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.06.004 · Cited by 631 · cited 2×
“In this view, comprehending a word such as “dog” activates visual properties diagnostic of dogs (Simmons et al., 2007; Evans, 2009; Kuipers et al., 2013; Pulvermüller, 2013).”
BackgroundAttention reverses the effect of prediction in silencing sensory signals
Kok, P., Rahnev, D., Jehee, J. F. M., Lau, H. C., & de Lange, F. P. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhr310 · Cited by 430
The functional impact of mental imagery on conscious perception
Pearson, J., Clifford, C. W. G., & Tong, F. (2008) · Current Biology · doi:10.1016/j.cub.2008.05.048 · Cited by 409 · cited 1×
“The neural machinery underlying such activations is likely to be substantially shared with perception, visual working memory, and, indeed, explicit mental imagery (Pearson et al., 2008; Pratte and Tong, 2014).”
BackgroundAttention during natural vision warps semantic representation across the human brain
Çukur, T., Nishimoto, S., Huth, A. G., & Gallant, J. L. (2013) · Nature Neuroscience · doi:10.1038/nn.3381 · Cited by 351
Cited by
Cognition does not affect perception: Evaluating the evidence for “top-down” effects
Firestone, C., & Scholl, B. J. (2016) · Behavioral and Brain Sciences · doi:10.1017/s0140525x15000965 · Cited by 1,200
Arbitrariness, iconicity, and systematicity in language
Dingemanse, M., Blasi, D. E., Lupyan, G., Christiansen, M. H., & Monaghan, P. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.07.013 · Cited by 494
Self-citationWords and the World: Predictive Coding and the Language-Perception-Cognition Interface
Lupyan, G., & Clark, A. (2015) · Current Directions in Psychological Science · doi:10.1177/0963721415570732 · Cited by 380
Self-citationModulating early visual processing by language
de Vries, H., Strub, F., Mary, J., Larochelle, H., Pietquin, O., & Courville, A. C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.00683 · Cited by 369
The centrality of language in human cognition
Lupyan, G. (2016) · Language Learning · doi:10.1111/lang.12155 · Cited by 137
Self-citation
Metadata
- Authors
- Boutonnet, B., & Lupyan, G.
- Venue
- Journal of Neuroscience
- Publisher
- Society for Neuroscience
- Published
- 2015-06-24
- Volume
- 35
- Issue
- 25
- Pages
- 9329-9335
- ISSN
- 0270-6474 (ISSN-L)
- 1529-2401
- OpenAlex
- W1792711683
- Cited by
- 155
- References
- 14
- FWCI
- 23.56
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Words Jump-Start Vision: A Label Advantage in Object Recognition. https://app.cochat.ai/papers/10.1523/jneurosci.5111-14.2015
- The paper
- Boutonnet, B., & Lupyan, G. (2015). Words Jump-Start Vision: A Label Advantage in Object Recognition. Journal of Neuroscience. https://doi.org/10.1523/jneurosci.5111-14.2015
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.