Pictures in sentences: Understanding without words.

Mary C. Potter, Judith F. Kroll, Betsy Yachzel, Elisabeth Carpenter, Janet Sherman·1986·Journal of Experimental Psychology General

Abstract

To understand a sentence, the meanings of the words in the sentence must be retrieved and combined. Are these meanings represented within the language system (the lexical hypothesis) or are they represented in a general conceptual system that is not restricted to language (the conceptual hypothesis)? To evaluate these hypotheses, sentences were presented in which a pictured object replaced a word (rebus sentences). Previous research has shown that isolated pictures and words are processed equally rapidly in conceptual tasks, but that pictures are markedly slower than words in tasks requiring lexical access. The lexical hypothesis would therefore lead one to expect that rebus sentences will be relatively difficult, whereas the conceptual hypothesis would predict that rebus sentences would be rather easy. Sentences were shown using rapid serial visual presentation (RSVP) at a rate of 10 or 12 words per second. With one set of materials (Experiments 1 and 2), readers took longer to judge the plausibility of rebus sentences than all-word sentences, although the accuracy of judgment and of recall were similar for the two formats. With two new sets of materials (Experiments 3 and 5), rebus and all-word sentences were virtually equivalent except in one circumstance: when a picture replaced the noun in a familiar phrase such as seedless grapes. In contrast, when the task required overt naming of the rebus picture in a sentence context, latency to name the picture was markedly longer than to name the corresponding word, and the appropriateness of the sentence context affected picture naming but not word naming (Experiment 4). The results fail to support theories that place word meanings in a specialized lexical entry. Instead, the results suggest that the lexical representation of a noun or familiar noun phrase provides a pointer to a nonlinguistic conceptual system, and it is in that system that the meaning of a sentence is constructed.

Cited by (19)

  1. Perceptual symbol systems
    Barsalou, Lawrence W. · 1999 · Behavioral and Brain Sciences
  2. Grounded cognition.
    Barsalou, Lawrence W. · 2008 · Annual Review of Psychology
  3. Dual coding theory and education
    Clark, James M., Paivio, Allan · 1991 · Educational Psychology Review
  4. A two-stage model for multiple target detection in rapid serial visual presentation.
    Chun, Marvin M., Potter, Mary C. · 1995 · Journal of Experimental Psychology: Human Perception and Performance
  5. Situated simulation in the human conceptual system
    Barsalou, Lawrence · 2003 · Language and Cognitive Processes

See all 140

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Pictures in sentences: Understanding without words. https://app.cochat.ai/papers/10.1037//0096-3445.115.3.281
The paper
Potter, M. C., Kroll, J. F., Yachzel, B., Carpenter, E., & Sherman, J. (1986). Pictures in sentences: Understanding without words. Journal of Experimental Psychology General. https://doi.org/10.1037//0096-3445.115.3.281

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.