Challenges of multimodality: Language and the body in social interaction
The DOI matches its Crossref record; 72 of the 74 references it cites were found in a registry or an index.
Abstract
This article reflects on recent challenges emerging from the study of language and the body in social interaction. There is a general interest in language and the body across disciplines that has invited a reconceptualization of the broader issues relative to action, cognition, culture, knowledge, social relations and identities, spatiality and temporality. The study of social interaction focuses on how multimodal resources – including language and bodily movements – are holistically and situatedly used in building human action. This article discusses some consequences and challenges of putting the body at the center of attention: it repositions language as one among other modalities, and invites us to consider the involvement of entire bodies in social interaction, overcoming a logo‐centric vision of communication, as well as a visuo‐centric vision of embodiment. These issues are developed through a series of conversation analytic studies, firstly of classic topics in linguistics like deixis, then of more recent topics, such as mobility and sensoriality.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
A simplest systematics for the organization of turn-taking for conversation
Sacks, H., Schegloff, E. A., & Jefferson, G. (1974) · Language · doi:10.2307/412243 · Cited by 11,350
Hand and mind: what gestures reveal about thought
(1993) · Choice Reviews Online · doi:10.5860/choice.30-2492 · Cited by 5,094
Sequence Organization in Interaction: A Primer in Conversation Analysis
Schegloff, E. A. (2007) · Cambridge University Press eBooks · doi:10.1017/cbo9780511791208 · Cited by 4,684
(1981) · Medical Entomology and Zoology · Cited by 4,644
(1985) · Cambridge University Press eBooks · doi:10.1017/cbo9780511665868 · Cited by 4,133
Busfield, J., & Garfinkel, H. (1968) · The British Journal of Sociology · doi:10.2307/588840 · Cited by 3,813
Being There: Putting Brain, Body and World Together Again.
van Gelder, T., & Clark, A. (1998) · The Philosophical Review · doi:10.2307/2998391 · Cited by 3,128
Goodwin, C. (1994) · American Anthropologist · doi:10.1525/aa.1994.96.3.02a00100 · Cited by 3,117
Action and embodiment within situated human interaction
Goodwin, C. (2000) · Journal of Pragmatics · doi:10.1016/s0378-2166(99)00096-x · Cited by 3,073 · cited 2×
“…resources but also embodied ones, within a more global and holistic approach of multimodality, comprising language, gesture, gaze, head movements, facial expressions, body posture, body movements, and embodied manipulations of material objects (Goodwin 2000; Streeck, Goodwin and LeBaron 2011).”
BackgroundBeing there: putting brain, body, and world together again
(1997) · Choice Reviews Online · doi:10.5860/choice.34-6204 · Cited by 2,631
Shilling, C. (2003) · SAGE Publications Ltd eBooks · doi:10.4135/9781446215470 · Cited by 2,391
Everyday Language: Studies in Ethnomethodology
Psathas, G. (1979) · Human Studies · Cited by 2,349
Woolgar, S., Sacks, H., Jefferson, G., Drew, P., & Heritage, J. (1995) · The British Journal of Sociology · doi:10.2307/591645 · Cited by 2,312
Conversational Organization: Interaction Between Speakers and Hearers
Goodwin, C. (1981) · Cited by 2,305
Non-representational theory : space, politics, affect
Thrift, N. J. (2007) · doi:10.82444/warw.33626224 · Cited by 2,118
Relations in Public. Microstudies of the Public Order
Dellwing, M. (2022) · Goffman-Handbuch · doi:10.1007/978-3-476-05871-3_44 · Cited by 2,118
Relations in Public: Microstudies of the Public Order.
Turner, R. H., & Goffman, E. (1973) · Social Forces · doi:10.2307/2576707 · Cited by 2,036
Sequence Organization in Interaction: A Primer in Conversation Analysis
Schegloff, E. A. (2007) · Cited by 1,942
Conducting Interaction: Patterns of Behavior in Focused Encounters.
Burgoon, J. K., & Kendon, A. (1992) · Contemporary Sociology · doi:10.2307/2075490 · Cited by 1,634
(1996) · Cambridge University Press eBooks · doi:10.1017/cbo9780511620874 · Cited by 1,443
The Interactive Construction of a Sentence in Natural Conversation
Goodwin, C. (1979) · Cited by 1,146
Embodied Interaction: Language And Body In The Material World
Streeck, J., Goodwin, C., & Lebaron, C. D. (2014) · Cited by 1,127
Body Movement and Speech in Medical Interaction
Heath, C., & Nicholls, K. (1986) · Cambridge University Press eBooks · doi:10.1017/cbo9780511628221 · Cited by 1,044
Pointing : where language, culture, and cognition meet
喜多, 壮. (2003) · Thammasat University Digital Collections · Cited by 1,022
(2010) · Encyclopedia of Geography · doi:10.4135/9781412939591.n824 · Cited by 692
Birdwhistell, R. L. (1970) · Cited by 662
Multimodal resources for turn-taking: pointing and the emergence of possible next speakers
Mondada, L. (2007) · Discourse Studies · doi:10.1177/1461445607075346 · Cited by 635
Self-citationHeath, C., & Luff, P. (2000) · Cambridge University Press eBooks · doi:10.1017/cbo9780511489839 · Cited by 628
The Social Body: Habit, Identity and Desire
Crossley, N. (2001) · SAGE Publications Ltd eBooks · doi:10.4135/9781446219867 · Cited by 590
Mondada, L. (2009) · Journal of Pragmatics · doi:10.1016/j.pragma.2008.09.019 · Cited by 553
Self-citationThe Handbook of Conversation Analysis
(2012) · doi:10.1002/9781118325001 · Cited by 551
The local constitution of multimodal resources for social interaction
Mondada, L. (2014) · Journal of Pragmatics · doi:10.1016/j.pragma.2014.04.004 · Cited by 536
Self-citationThe Language of Turn and Sequence
(2002) · doi:10.1093/oso/9780195124897.001.0001 · Cited by 528
Prosody in Conversation: Interactional Studies
(1996) · Cambridge University Press eBooks · doi:10.1017/cbo9780511597862 · Cited by 487
A Companion to Linguistic Anthropology
(2005) · A Companion to Linguistic Anthropology · doi:10.1111/b.9781405144308.2005.00015.x · Cited by 408
Body – Language – Communication: An International Handbook on Multimodality in Human Interaction
Müller, C., Cienki, A. J., Fricke, E., Ladewig, S. H., McNeill, D., & Teßendorf, S. (2013) · Cited by 398
Video Analysis: Methodology and Methods
(2006) · Peter Lang D eBooks · doi:10.3726/978-3-653-02667-2 · Cited by 377
Interacting with Objects: Language, materiality, and social activity
Nevile, M., Haddington, P., Heinemann, T., & Rauniomaa, M. (2014) · John Benjamins Publishing Company eBooks · doi:10.1075/z.186 · Cited by 368
Geographies of mobilities: practices, spaces, subjects
(2011) · Choice Reviews Online · doi:10.5860/choice.49-0430 · Cited by 342
(2003) · Pointing · doi:10.4324/9781410607744-13 · Cited by 320
Embodied reference: A study of deixis in workplace interaction
Hindmarsh, J., & Heath, C. (2000) · Journal of Pragmatics · doi:10.1016/s0378-2166(99)00122-8 · Cited by 279
The Embodied Turn in Research on Language and Social Interaction
Nevile, M. (2015) · Research on Language and Social Interaction · doi:10.1080/08351813.2015.1025499 · Cited by 272
Multimodal interaction from a conversation analytic perspective
Deppermann, A. (2013) · Journal of Pragmatics · doi:10.1016/j.pragma.2012.11.014 · Cited by 262 · cited 1×
“Since the start of the 21st century, there has been an increase in video studies (Deppermann 2013; Heath and Luff 2000; Streeck, Goodwin and LeBaron 2011).”
BackgroundWalking away: The embodied achievement of activity closings in mobile interaction
Broth, M., & Mondada, L. (2013) · Journal of Pragmatics · doi:10.1016/j.pragma.2012.11.016 · Cited by 199
Self-citationSacks, H., & Schegloff, E. A. (2002) · Gesture · doi:10.1075/gest.2.2.02sac · Cited by 192
Syntax and Lexis in Conversation: Studies on the use of linguistic resources in talk-in-interaction
(2005) · Studies in Discourse and Grammar · doi:10.1075/sidag.17 · Cited by 188
Intercorporeality : Emerging Socialities in Interaction
Meyer, C. G., Streeck, J., & Jordan, J. S. (2017) · Cited by 184
A Companion to Linguistic Anthropology
(2005) · A Companion to Linguistic Anthropology · doi:10.1111/b.9781405144308.2005.00001.x · Cited by 182
Multiactivity in Social Interaction: Beyond multitasking
(2014) · John Benjamins Publishing Company eBooks · doi:10.1075/z.187 · Cited by 176
From Talk to Text: The Interactional Construction of a Police Record
Komter, M. L. (2006) · Research on Language and Social Interaction · doi:10.1207/s15327973rlsi3903_2 · Cited by 170
Video Recording as the Reflexive Preservation and Configuration of Phenomenal Features for Analysis
Mondada, L. (2006) · HAL · Cited by 167
Self-citationHaddington, P., Mondada, L., & Nevile, M. (2013) · De Gruyter eBooks · doi:10.1515/9783110291278 · Cited by 158
Bodies in action: Multimodal analysis of walking and talking
Mondada, L. (2014) · Language and Dialogue · doi:10.1075/ld.4.3.02mon · Cited by 153
Self-citationThe temporal orders of multiactivity: Operating and demonstrating in the surgical theatre
Mondada, L. (2014) · John Benjamins Publishing Company eBooks · doi:10.1075/z.187.02mon · Cited by 146
Self-citationRollins, P. R. (2014) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199697960.013.6 · Cited by 135
The Coordination of Talk and Touch in Adults’ Directives to Children: Touch and Social Control
Čekaitė, A. (2015) · Research on Language and Social Interaction · doi:10.1080/08351813.2015.1025501 · Cited by 128 · cited 1×
“…interactional studies, it has been tackled mainly in the form of persons touching other persons, as in everyday hugs (Goodwin in press) and parental tactile control of children (Cekaite 2015), or in institutional settings, as in health-related activities (Nishizaka 2007; Nishizaka and Sunaga 2015).”
BackgroundWriting-in-interaction: Studying writing as a multimodal phenomenon in social interaction
Mondada, L., & Svinhufvud, K. (2016) · Language and Dialogue · doi:10.1075/ld.6.1.01mon · Cited by 114
Self-citationRyave, A. L., & Schenkein, J. N. (1974) · Cited by 111
Pointing, talk, and the bodies: Reference and joint attention as embodied interactional achievements
Mondada, L. (2014) · John Benjamins Publishing Company eBooks · doi:10.1075/z.188.06mon · Cited by 95
Self-citationCommunicating place, space and mobility
McIlvenny, P., Broth, M., & Haddington, P. (2008) · Journal of Pragmatics · doi:10.1016/j.pragma.2008.09.014 · Cited by 83
(2014) · Routledge eBooks · doi:10.4324/9781315851709 · Cited by 79
Hand Touching Hand: Referential Practice at a Japanese Midwife House
Nishizaka, A. (2007) · Human Studies · doi:10.1007/s10746-007-9059-4 · Cited by 64
Leeds‐Hurwitz, W. (1987) · Research on Language and Social Interaction · doi:10.1080/08351818709389274 · Cited by 46
Grammar and Interaction: Pivots in German Conversation
Betz, E. M. (2008) · Cited by 39
Conversing While Massaging: Multidimensional Asymmetries of Multiple Activities in Interaction
Nishizaka, A., & Sunaga, M. (2015) · Research on Language and Social Interaction · doi:10.1080/08351813.2015.1025506 · Cited by 37
The Organization of Turn-Taking in Pool Skate Sessions
Ivarsson, J., & Greiffenhagen, C. (2015) · Research on Language and Social Interaction · doi:10.1080/08351813.2015.1090114 · Cited by 33
Pointing, talk, and the bodies: Reference and joint attention as embodied interactional achievements
Mondada, L. (2014) · John Benjamins eBooks · Cited by 27
Self-citationConversation Analytic Studies of Multimodal Interaction
Deppermann, A. (2013) · Journal of Pragmatics · Cited by 22
(2013) · De Gruyter eBooks · doi:10.1515/9783110261318 · Cited by 21
Kreplak, Y., & Mondémé, C. (2014) · John Benjamins Publishing Company eBooks · doi:10.1075/z.186.13kre · Cited by 20
Air embolism during hemodialysis.
Mcgeown, M., Lyness, J., & Harvey, G. R. (1971) · BMJ · doi:10.1136/bmj.3.5777.771-b · Cited by 11
Artworks as touchable objects: Guiding perception in a museum tour for blind people
Mondémé, C., & Kreplak, Y. (2014) · HAL (Le Centre pour la Communication Scientifique Directe) · Cited by 5
Research works printed but not linked: 10
- Heath Christian, 2010, Video in Qualitative Research
- Heidegger Martin, 1996, Being and Time
- Kress Gunther, 2001, Multimodal Discourse
- Mondada Lorenza, Temporalities and Modalities
- Ryave A. Lincoln, 1974, Ethnomethodology, 265
- Sacks Harvey, 1963, Sociological description, Berkeley Journal of Sociology, 8, 1
- 10.1353/lan.1974.0010 · DOI · Paper page
- Scheflen Albert E, 1972, Body Language and Social Order: Communications as Behavioral Control
- Schegloff Emanuel A, 1998, Body torque, Social Research, 65, 535
- Urry John, 2007, Mobilities
Cited by
Mondada, L. (2018) · Research on Language and Social Interaction · doi:10.1080/08351813.2018.1413878 · Cited by 1,056
“This has made it possible to speak of a “visual,” “embodied,” or “multimodal” turn in the discipline (Mondada, 2016a; Nevile, 2015).”
BackgroundInfluentialSelf-citationMondada, L. (2019) · Journal of Pragmatics · doi:10.1016/j.pragma.2019.01.016 · Cited by 490
Self-citationSLA and the Study of Equitable Multilingualism
ORTEGA, L. (2019) · The Modern Language Journal · doi:10.1111/modl.12525 · Cited by 425
“Moreover, there can be no perfect correspondence between language and meaning: Meaningmaking greatly supersedes the strictly linguistic (Canagarajah, 2018; Hawkins, 2018; Mondada, 2016), and sheer linguistic meaning is inherently polysemous (Gries, 2015) and ambiguous (Piantadosi, Tily, & Gibson, 2012).”
BackgroundBeyond languages, beyond modalities: transforming the study of semiotic repertoires
Kusters, A., Spotti, M., Swanwick, R., & Tapio, E. (2017) · International Journal of Multilingualism · doi:10.1080/14790718.2017.1321651 · Cited by 379
“…all engage in body orientations and eye gaze, even when only one person is speaking, for example; and interactants might already start to respond while the previous action is still being produced, such as by interrupting or by reorienting the body, ready for producing a response (Mondada, 2016).”
BackgroundInfluentialThe Cambridge Handbook of Discourse Studies
(2020) · Cambridge University Press eBooks · doi:10.1017/9781108348195 · Cited by 197
Metadata
- Authors
- Mondada, L.
- Affiliations
- University of Helsinki (FI)
- Corresponding author
- Mondada, Lorenza
- ORCID
- Mondada, Lorenza
- Venue
- Journal of Sociolinguistics
- Publisher
- Wiley
- Published
- 2016-06
- Volume
- 20
- Issue
- 3
- Pages
- 336-366
- ISSN
- 1360-6441 (ISSN-L)
- 1467-9841
- OpenAlex
- W2464690791
- Cited by
- 768
- References
- 74
- Citations by year
- 2026: 53 · 2025: 64 · 2024: 94 · 2023: 77 · 2022: 85 · 2021: 113 · 2020: 107 · 2019: 79 · 2018: 67 · 2017: 24 · 2016: 3
- FWCI
- 367.10
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Sociolinguistics (publishedVersion)
- Funders
- Suomen Akatemia (282931)
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (100014_144376, 100012_162689/1)
- Topics
- Social Sciences › Arts and Humanities › Language and Linguistics › Language, Discourse, Communication Strategies
- Social Sciences › Linguistics and Language › Discourse Analysis in Language Studies
- Social Sciences › Psychology › Social Psychology › Health, Education, and Physical Culture
- Keywords
- body and language, multimodality, embodiment, social interaction, deixis, mobility, sensoriality, bodily movement, situated action, conversation analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.