Situating Language in the Real-World: The Role of Multimodal Iconicity and Indexicality
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
In the last decade, a growing body of work has convincingly demonstrated that languages embed a certain degree of non-arbitrariness (mostly in the form of iconicity, namely the presence of imagistic links between linguistic form and meaning). Most of this previous work has been limited to assessing the degree (and role) of non-arbitrariness in the speech (for spoken languages) or manual components of signs (for sign languages). When approached in this way, non-arbitrariness is acknowledged but still considered to have little presence and purpose, showing a diachronic movement towards more arbitrary forms. However, this perspective is limited as it does not take into account the situated nature of language use in face-to-face interactions, where language comprises categorical components of speech and signs, but also multimodal cues such as prosody, gestures, eye gaze etc. We review work concerning the role of context-dependent iconic and indexical cues in language acquisition and processing to demonstrate the pervasiveness of non-arbitrary multimodal cues in language use and we discuss their function. We then move to argue that the online omnipresence of multimodal non-arbitrary cues supports children and adults in dynamically developing situational models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183
Barsalou, L. W. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.103006.093639 · Cited by 5,936
Integration of Visual and Linguistic Information in Spoken Language Comprehension
Tanenhaus, M. K., Spivey-Knowlton, M. J., Eberhard, K. M., & Sedivy, J. C. (1995) · Science · doi:10.1126/science.7777863 · Cited by 2,929
Gaze Following in Human Infants Depends on Communicative Signals
Senju, A., & Csibra, G. (2008) · Current Biology · doi:10.1016/j.cub.2008.03.059 · Cited by 749
Differences in Early Gesture Explain SES Disparities in Child Vocabulary Size at School Entry
Rowe, M. L., & Goldin-Meadow, S. (2009) · Science · doi:10.1126/science.1167025 · Cited by 556
Steinberg, L., Icenogle, G., Shulman, E. P., Breiner, K., Chein, J., Bacchini, D., Chang, L., Chaudhary, N., Giunta, L. D., Dodge, K. A., et al. (2018) · Developmental Science · doi:10.1111/desc.12532 · Cited by 514
Multimodal Language Processing in Human Communication
Holler, J., & Levinson, S. C. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.05.006 · Cited by 441
How do gestures influence thinking and speaking? The gesture-for-conceptualization hypothesis.
Kita, S., Alibali, M. W., & Chu, M. (2017) · Psychological Review · doi:10.1037/rev0000059 · Cited by 342
Hasson, U., Egidi, G., Marelli, M., & Willems, R. M. (2018) · Cognition · doi:10.1016/j.cognition.2018.06.018 · Cited by 157
Iconicity and Sign Lexical Acquisition: A Review
Ortega, G. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01280 · Cited by 123
de Ruiter, L. E., Theakston, A. L., Brandt, S., & Lieven, E. V. M. (2018) · Cognition · doi:10.1016/j.cognition.2017.10.015 · Cited by 57
Cited by
Abstract Concepts and the Embodied Mind: Rethinking Grounded Cognition
Dove, G. (2022) · doi:10.1093/oso/9780190061975.001.0001 · Cited by 40
van der Klis, A., Adriaans, F., & Kager, R. (2023) · Infant Behavior and Development · doi:10.1016/j.infbeh.2023.101828 · Cited by 20
Language is a Source of Grounding and a Mode of Action
Dove, G. (2023) · Topics in Cognitive Science · doi:10.1111/tops.12665 · Cited by 4
Metadata
- Authors
- Murgiano, M., Motamedi, Y., & Vigliocco, G.
- Venue
- Journal of Cognition
- Publisher
- Ubiquity Press, Ltd.
- Published
- 2021
- Volume
- 4
- Issue
- 1
- Pages
- 38-38
- ISSN
- 2514-4820 (ISSN-L)
- OpenAlex
- W3194424775
- Cited by
- 62
- References
- 11
- FWCI
- 46.13
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.