The body talks: Sensorimotor communication and its brain and kinematic signatures
Open accessThe DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
Human communication is a traditional topic of research in many disciplines such as psychology, linguistics and philosophy, all of which mainly focused on language, gestures and deictics. However, these do not constitute the sole channels of communication, especially during online social interaction, where instead an additional critical role may be played by sensorimotor communication (SMC). SMC refers here to (often subtle) communicative signals embedded within pragmatic actions - for example, a soccer player carving his body movements in ways that inform a partner about his intention, or to feint an adversary; or the many ways we offer a glass of wine, rudely or politely. SMC is a natural form of communication that does not require any prior convention or any specific code. It amounts to the continuous and flexible exchange of bodily signals, with or without awareness, to enhance coordination success; and it is versatile, as sensorimotor signals can be embedded within every action. SMC is at the center of recent interest in neuroscience, cognitive psychology, human-robot interaction and experimental semiotics; yet, we still lack a coherent and comprehensive synthesis to account for its multifaceted nature. Some fundamental questions remain open, such as which interactive scenarios promote or do not promote SMC, what aspects of social interaction can be properly called communicative and which ones entail a mere transfer of information, and how many forms of SMC exist and what we know (or still don't know) about them from an empirical viewpoint. The present work brings together all these separate strands of research within a unified overarching, multidisciplinary framework for SMC, which combines evidence from kinematic studies of human-human interaction and computational modeling of social exchanges.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Austin, J. L. (1975) · doi:10.1093/acprof:oso/9780198245537.001.0001 · Cited by 21,496 · cited 2×
“However, in communication theory and semiotics there is a distinction between these simple forms of information transfer (IT) and true communication [5,21,86].”
BackgroundThe free-energy principle: a unified brain theory?
Friston, K. (2010) · Nature Reviews Neuroscience · doi:10.1038/nrn2787 · Cited by 8,120 · cited 1×
“A class of models that we argue to be particularly appropriate to this purpose are those based on the idea that internal generative (or forward) models underlie action production, perception and simulation [19,18,38,58].”
BackgroundEvent-related EEG/MEG synchronization and desynchronization: basic principles
Pfurtscheller, G., & Lopes da Silva, F. H. (1999) · Clinical Neurophysiology · doi:10.1016/s1388-2457(99)00141-8 · Cited by 7,328 · cited 2×
“These oscillations correspond to the rolandic mu-rhythm [43], which has also been found to suppress during execution or observation of movement in contrast to rest [10,22,95].”
BackgroundWhatever next? Predictive brains, situated agents, and the future of cognitive science
Clark, A. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000477 · Cited by 5,924 · cited 1×
“A class of models that we argue to be particularly appropriate to this purpose are those based on the idea that internal generative (or forward) models underlie action production, perception and simulation [19,18,38,58].”
BackgroundClark, H. H. (1996) · doi:10.1017/cbo9780511620539 · Cited by 5,123
Toward a mechanistic psychology of dialogue.
Pickering, M. J., & Garrod, S. (2004) · Behavioral and Brain Sciences · doi:10.1017/s0140525x04000056 · Cited by 2,678
Neural simulation of action: a unifying mechanism for motor cognition.
Jeannerod, M. (2001) · NeuroImage · doi:10.1006/nimg.2001.0832 · Cited by 2,563 · cited 2×
“A class of models that we argue to be particularly appropriate to this purpose are those based on the idea that internal generative (or forward) models underlie action production, perception and simulation [19,18,38,58].”
BackgroundJoint action: bodies and minds moving together
SEBANZ, N., BEKKERING, H., & KNOBLICH, G. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.12.009 · Cited by 1,950
Csibra, G., & Gergely, G. (2009) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2009.01.005 · Cited by 1,648
An integrated theory of language production and comprehension
Pickering, M. J., & Garrod, S. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12001495 · Cited by 1,569
A unifying computational framework for motor control and social interaction
Wolpert, D. M., Doya, K., & Kawato, M. (2003) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.2002.1238 · Cited by 1,228
Relevance: Communication and Cognition
Meara, P., Sperber, D., & Wilson, D. (1989) · The Modern Language Review · doi:10.2307/3731158 · Cited by 1,189
Brain-to-brain coupling: a mechanism for creating and sharing a social world
Hasson, U., Ghazanfar, A. A., Galantucci, B., Garrod, S., & Keysers, C. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.12.007 · Cited by 1,140
Cross-language analysis of phonetic units in language addressed to infants
Kuhl, P. K., Andruski, J. E., Chistovich, I. A., Chistovich, L. A., Kozhevnikova, E. V., Ryskina, V. L., Stolyarova, E. I., Sundberg, U., & Lacerda, F. (1997) · Science · doi:10.1126/science.277.5326.684 · Cited by 1,041
Dolan, R. J., & Dayan, P. (2013) · Neuron · doi:10.1016/j.neuron.2013.09.007 · Cited by 977
Inter-Brain Synchronization during Social Interaction
Dumas, G., Nadel, J., Soussignan, R., Martinerie, J., & Garnero, L. (2010) · PLoS ONE · doi:10.1371/journal.pone.0012166 · Cited by 966 · cited 1×
“[35] employed a two-person hand imitation task, asking participants to spontaneously imitate their partner’s hand gestures, while recording dual EEG.”
MethodRocking together: Dynamics of intentional and unintentional interpersonal coordination
Richardson, M. J., Marsh, K. L., Isenhower, R. W., Goodman, J. R. L., & Schmidt, R. C. (2007) · Human Movement Science · doi:10.1016/j.humov.2007.07.002 · Cited by 796 · cited 1×
“movements [83], lifting from each others’ trays [94] and rocking next to each other [101].”
BackgroundTheraulaz, G., & Bonabeau, E. (1999) · Artificial Life · doi:10.1162/106454699568700 · Cited by 665
Brain basis of human social interaction: from concepts to brain imaging
Hari, R., & Kujala, M. V. (2009) · Physiological Reviews · doi:10.1152/physrev.00041.2007 · Cited by 638
(2013) · doi:10.1109/hri.2013.6483603 · Cited by 595 · cited 1×
“These studies show that “exaggeration” of the robot movements and signaling dynamics improve legibility of behavior [32], which might in turn entail improved coordination success, acceptability and trust [30].”
BackgroundSocial neuroscience and hyperscanning techniques: past, present and future.
Babiloni, F., & Astolfi, L. (2014) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.07.006 · Cited by 573 · cited 1×
“Only recently have researchers begun to design interactive experiments, and in particular, explore neural mechanisms of two people simultaneously as they engage in sensorimotor communication (see [6,34,66,55] for reviews).”
BackgroundFollow you, follow me: continuous mutual prediction and adaptation in joint tapping
Konvalinka, I., Vuust, P., Roepstorff, A., & Frith, C. D. (2010) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2010.497843 · Cited by 421
Self-citationSocial coordination dynamics: measuring human bonding.
Oullier, O., de Guzman, G. C., Jantzen, K. J., Lagarde, J., & Scott Kelso, J. A. (2008) · Social Neuroscience · doi:10.1080/17470910701563392 · Cited by 404 · cited 1×
“movements [83], lifting from each others’ trays [94] and rocking next to each other [101].”
BackgroundA minimal architecture for joint action
Vesper, C., Butterfill, S., Knoblich, G., & Sebanz, N. (2010) · Neural Networks · doi:10.1016/j.neunet.2010.06.002 · Cited by 398
Mirroring and beyond: coupled dynamics as a generalized framework for modelling social interactions
Hasson, U., & Frith, C. D. (2016) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2015.0366 · Cited by 371 · cited 1×
“For example, brain areas that have been shown to be involved in recipient design or intention recognition [40,51,54,115] may be engaged (or aligned between co-actors) only in the most sophisticated forms of SMC.”
BackgroundFriston, K., & Frith, C. (2015) · Consciousness and Cognition · doi:10.1016/j.concog.2014.12.003 · Cited by 359
Mapping the information flow from one brain to another during gestural communication
Schippers, M. B., Roebroeck, A., Renken, R., Nanetti, L., & Keysers, C. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1001791107 · Cited by 323
van Ulzen, N. R., Lamoth, C. J. C., Daffertshofer, A., Semin, G. R., & Beek, P. J. (2008) · Neuroscience Letters · doi:10.1016/j.neulet.2007.11.070 · Cited by 272 · cited 1×
“A large body of literature has investigated how dyads achieve interpersonal sensorimotor (non-verbal) coordination in partially independent tasks, such as walking side-by-side [121], swinging pendulums [108], coordinating finger”
BackgroundKonvalinka, I., Bauer, M., Stahlhut, C., Hansen, L. K., Roepstorff, A., & Frith, C. D. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.03.003 · Cited by 228 · cited 2×
“By employing brain-decoding techniques to distinguish interactive from non-interactive conditions, one study has shown complementary neural mechanisms between two partners, one a leader and the other a follower [65].”
BackgroundSelf-citationFlow of affective information between communicating brains
Anders, S., Heinzle, J., Weiskopf, N., Ethofer, T., & Haynes, J.-D. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.07.004 · Cited by 206 · cited 1×
“[1] investigated correlated activity between brains using fMRI to scan two people in a pseudo-interactive scenario – one was asked to indulge in emotional situations and facially communicate their emotion to their partner while scanned, while the other was scanned separately and played back the sender’s facial express…”
BackgroundKoban, L., Ramamoorthy, A., & Konvalinka, I. (2019) · Social Neuroscience · doi:10.1080/17470919.2017.1400463 · Cited by 180
Self-citationInteractional leader–follower sensorimotor communication strategies during repetitive joint actions
Candidi, M., Curioni, A., Donnarumma, F., Sacheli, L. M., & Pezzulo, G. (2015) · Journal of The Royal Society Interface · doi:10.1098/rsif.2015.0644 · Cited by 92 · cited 3×
“[11] designed a follow-up of the Sacheli et al.”
BackgroundMethodInfluentialSelf-citation
Cited by
Spontaneous dyadic behavior predicts the emergence of interpersonal neural synchrony
Koul, A., Ahmar, D., Iannetti, G. D., & Novembre, G. (2023) · NeuroImage · doi:10.1016/j.neuroimage.2023.120233 · Cited by 75
Artificial cognition vs. artificial intelligence for next-generation autonomous robotic agents
Sandini, G., Sciutti, A., & Morasso, P. (2024) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2024.1349408 · Cited by 40
Interpersonal synchronization of spontaneously generated body movements
Koul, A., Ahmar, D., Iannetti, G. D., & Novembre, G. (2023) · iScience · doi:10.1016/j.isci.2023.106104 · Cited by 28
Boukarras, S., Era, V., Aglioti, S. M., & Candidi, M. (2021) · Scientific Reports · doi:10.1038/s41598-021-84280-z · Cited by 25
Metadata
- Authors
- Pezzulo, G., Donnarumma, F., Dindo, H., D'Ausilio, A., Konvalinka, I., & Castelfranchi, C.
- Venue
- Physics of Life Reviews
- Publisher
- Elsevier BV
- Published
- 2019-03
- Volume
- 28
- Pages
- 1-21
- ISSN
- 1571-0645 (ISSN-L)
- OpenAlex
- W2811209743
- Cited by
- 130
- References
- 32
- FWCI
- 16.76
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.