Human Sensorimotor Communication: A Theory of Signaling in Online Social Interactions
Open accessThe DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
Although the importance of communication is recognized in several disciplines, it is rarely studied in the context of online social interactions and joint actions. During online joint actions, language and gesture are often insufficient and humans typically use non-verbal, sensorimotor forms of communication to send coordination signals. For example, when playing volleyball, an athlete can exaggerate her movements to signal her intentions to her teammates (say, a pass to the right) or to feint an adversary. Similarly, a person who is transporting a table together with a co-actor can push the table in a certain direction to signal where and when he intends to place it. Other examples of "signaling" are over-articulating in noisy environments and over-emphasizing vowels in child-directed speech. In all these examples, humans intentionally modify their action kinematics to make their goals easier to disambiguate. At the moment no formal theory exists of these forms of sensorimotor communication and signaling. We present one such theory that describes signaling as a combination of a pragmatic and a communicative action, and explains how it simplifies coordination in online social interactions. We cast signaling within a "joint action optimization" framework in which co-actors optimize the success of their interaction and joint goals rather than only their part of the joint action. The decision of whether and how much to signal requires solving a trade-off between the costs of modifying one's behavior and the benefits in terms of interaction success. Signaling is thus an intentional strategy that supports social interactions; it acts in concert with automatic mechanisms of resonance, prediction, and imitation, especially when the context makes actions and intentions ambiguous and difficult to read. Our theory suggests that communication dynamics should be studied within theories of coordination and interaction rather than only in terms of the maximization of information transmission.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Grice, H. P. (1975) · Speech Acts · doi:10.1163/9789004368811_003 · Cited by 23,221
Austin, J. L. (1975) · doi:10.1093/acprof:oso/9780198245537.001.0001 · Cited by 21,496
ASPECTS OF THE THEORY OF SYNTAX
Chomsky, N. (1964) · doi:10.21236/ad0616323 · Cited by 13,587
Rizzolatti, G., & Craighero, L. (2004) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.27.070203.144230 · Cited by 7,433
Clark, H. H. (1996) · doi:10.1017/cbo9780511620539 · Cited by 5,123
Clark, H. H., & Brennan, S. E. (1991) · Perspectives on socially shared cognition. · doi:10.1037/10096-006 · Cited by 4,555
Cattaneo, L., & Rizzolatti, G. (2009) · Archives of Neurology · doi:10.1001/archneurol.2009.41 · Cited by 3,137
Referring as a collaborative process
Clark, H. H., & Wilkes-Gibbs, D. (1986) · Cognition · doi:10.1016/0010-0277(86)90010-7 · Cited by 2,401
Computational principles of movement neuroscience
Wolpert, D. M., & Ghahramani, Z. (2000) · Nature Neuroscience · doi:10.1038/81497 · Cited by 2,122 · cited 1×
“An authoritative view in computational motor control is that each particular instantiation of an action can be associated to an internal model m [31,32].”
BackgroundJoint action: bodies and minds moving together
SEBANZ, N., BEKKERING, H., & KNOBLICH, G. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.12.009 · Cited by 1,950
Error Correction, Sensory Prediction, and Adaptation in Motor Control
Shadmehr, R., Smith, M. A., & Krakauer, J. W. (2010) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-060909-153135 · Cited by 1,869 · cited 1×
“An authoritative view in computational motor control is that each particular instantiation of an action can be associated to an internal model m [31,32].”
BackgroundOptimality principles in sensorimotor control
Todorov, E. (2004) · Nature Neuroscience · doi:10.1038/nn1309 · Cited by 1,746 · cited 1×
“These limitations can be overcome by introducing in our formulation more detailed action models based on optimal control theory [57,58].”
MethodCsibra, G., & Gergely, G. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.01.005 · Cited by 1,648
An integrated theory of language production and comprehension
Pickering, M. J., & Garrod, S. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12001495 · Cited by 1,569
Predictive coding: an account of the mirror neuron system
Kilner, J. M., Friston, K. J., & Frith, C. D. (2007) · Cognitive Processing · doi:10.1007/s10339-007-0170-2 · Cited by 1,134 · cited 1×
“However, action understanding and prediction are hard and often under-constrained computational problems, and it is still unclear how humans (and other animals) solve them in real time while at the same time planning their complementary or competitive actions [42–46].”
BackgroundThe perception-behavior expressway: automatic effects of social perception on social behavior.
Dijksterhuis, A., & Bargh, J. A. (2001) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(01)80003-4 · Cited by 1,052
Cross-language analysis of phonetic units in language addressed to infants
Kuhl, P. K., Andruski, J. E., Chistovich, I. A., Chistovich, L. A., Kozhevnikova, E. V., Ryskina, V. L., Stolyarova, E. I., Sundberg, U., & Lacerda, F. (1997) · Science · doi:10.1126/science.277.5326.684 · Cited by 1,041
Garrod, S., & Pickering, M. J. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2003.10.016 · Cited by 733
Action understanding and active inference
Friston, K., Mattout, J., & Kilner, J. (2011) · Biological Cybernetics · doi:10.1007/s00422-011-0424-z · Cited by 665
Efficient computation of optimal actions
Todorov, E. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0710743106 · Cited by 417
Probabilistic models of language processing and acquisition
Chater, N., & Manning, C. D. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.006 · Cited by 411 · cited 1×
“anthropology, biology, and philosophy [1–5].”
A minimal architecture for joint action
Vesper, C., Butterfill, S., Knoblich, G., & Sebanz, N. (2010) · Neural Networks · doi:10.1016/j.neunet.2010.06.002 · Cited by 398
Decision making, movement planning and statistical decision theory
Trommershäuser, J., Maloney, L. T., & Landy, M. S. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.04.010 · Cited by 314
Probabilistic movement modeling for intention inference in human–robot interaction
Wang, Z., Mülling, K., Deisenroth, M. P., Ben Amor, H., Vogt, D., Schölkopf, B., & Peters, J. (2013) · The International Journal of Robotics Research · doi:10.1177/0278364913478447 · Cited by 171
Cited by
Interactional leader–follower sensorimotor communication strategies during repetitive joint actions
Candidi, M., Curioni, A., Donnarumma, F., Sacheli, L. M., & Pezzulo, G. (2015) · Journal of The Royal Society Interface · doi:10.1098/rsif.2015.0644 · Cited by 92
“Previous studies have shown that interactions impact on a number of higher-level perceptuocognitive representations as they change the way we co-represent the physical space [22], display our attention [54], perceive our partner [37,72–75] and build a common representation of the task at hand [51].”
BackgroundResultInfluentialSelf-citationReciprocity and alignment: quantifying coupling in dynamic interactions
Dumas, G., & Fairhurst, M. T. (2021) · Royal Society Open Science · doi:10.1098/rsos.210138 · Cited by 88
Spontaneous dyadic behavior predicts the emergence of interpersonal neural synchrony
Koul, A., Ahmar, D., Iannetti, G. D., & Novembre, G. (2023) · NeuroImage · doi:10.1016/j.neuroimage.2023.120233 · Cited by 75
Metadata
- Authors
- Pezzulo, G., Donnarumma, F., & Dindo, H.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-11-20
- Volume
- 8
- Issue
- 11
- Pages
- e79876
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2037628672
- Cited by
- 175
- References
- 24
- FWCI
- 12.90
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.