The DOI matches its Crossref record; 57 of the 57 references it cites were found in a registry or an index.
Multiple Temporalities of Language and Body in Interaction: Challenges for Transcribing Multimodality
Abstract
The article focuses on the principles of multimodal CA, the way they can be operationalized in a transcription system, and the analytical and conceptual consequences of transcription choices. Elaborating on the foundations of multimodal CA and on the basis of video recordings of French and Swiss German encounters, as well as animal interactions, the article discusses classic and contemporary challenges for transcription and analysis, such as beyond gesture and gaze, body arrangements in interactional spaces, larger groups, material environments, mobile settings, silent activities, and animal encounters. It also highlights the diversity of multimodal practices involved: mobilizing occasioned material resources, movements not only of the upper (head, gesture) but also the lower (feet, legs, posterior) parts of the body, haptic contacts touching objects and coparticipants, and camera movements. The precise transcription of relevant details reveals complex arrangements of multimodal resources and gestalts. Their fine-grained, distinct, multiple temporalities constitute the basis of their sequential order—for sequentiality as a fundamental organizational principle of action. Data are in French and Swiss German.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hand and mind: what gestures reveal about thought
(1993) · Choice Reviews Online · doi:10.5860/choice.30-2492 · Cited by 5,094
(1985) · Cambridge University Press eBooks · doi:10.1017/cbo9780511665868 · Cited by 4,133
Gesture Visible Action as Utterance
Kendon, A. (2004) · Cambridge University Press eBooks · doi:10.1017/cbo9780511807572 · Cited by 3,891
Action and embodiment within situated human interaction
Goodwin, C. (2000) · Journal of Pragmatics · doi:10.1016/s0378-2166(99)00096-x · Cited by 3,073
Everyday Language: Studies in Ethnomethodology
Psathas, G. (1979) · Human Studies · Cited by 2,349
Conversational Organization: Interaction Between Speakers and Hearers
Goodwin, C. (1981) · Cited by 2,305
Hand and Mind: What Gestures Reveal about Thought
Feyereisen, P., & McNeill, D. (1994) · The American Journal of Psychology · doi:10.2307/1423299 · Cited by 1,688
Conducting Interaction: Patterns of Behavior in Focused Encounters.
Burgoon, J. K., & Kendon, A. (1992) · Contemporary Sociology · doi:10.2307/2075490 · Cited by 1,634
Stance, Alignment, and Affiliation During Storytelling: When Nodding Is a Token of Affiliation
Stivers, T. (2008) · Research on Language and Social Interaction · doi:10.1080/08351810701691123 · Cited by 1,408
Gesticulation and Speech: Two Aspects of the Process of Utterance
KENDON, A. (1980) · The Relationship of Verbal and Nonverbal Communication · doi:10.1515/9783110813098.207 · Cited by 1,205
Research works printed but not linked: 17
- 10.1177/1461445615590717 · doi:10.1177/1461445615590717
- Bergmann, J. (1985). Flüchtigkeit und methodische fixierung sozialer wirklichkeit: Aufzeichnungen als daten der interpretativen soziologie [Fleetingness and methodological fixation of social reality]. In W. Bonss & H. Hartmann (Eds.), Entzauberte Wissenschaft (pp. 299–320). Göttingen, Germany: Schwarz.
- Birdwhistell, R. L. (1970). Kinesics in context: Essays on body motion communication. Philadelphia, PA: University of Pennsylvania Press.
- Bulwer, J. (1644). Chirologia. London, England: Harper.
- Condon, W. S. (1971). Speech and body motion synchrony of the speaker-hearer. In D. L. Horton & J. J. Jenkins (Eds.), Perception of language (pp. 150–173). Columbus, OH: Merrill.
- De Stefani, E. (2010). Reference as an interactively and multimodally accomplished practice. In M. Pettorino, A. Giannini, I. Chiari, & F. Dovetto (Eds.), Spoken communication (pp. 137–170). Newcastle, England: Cambridge Scholars Publishing.
- 10.1525/aa.1994.96.issue-3 · doi:10.1525/aa.1994.96.issue-3
- Haddington, P., Keisanen, T., Mondada, L., & Nevile, M. (Eds.). (2015). Multiactivity in social interaction. Amsterdam, The Netherlands: John Benjamins.
- Jefferson, G. (1985). An exercise in the transcription and analysis of laughter. In T. A. Van Dijk (Ed.), Handbook of discourse analysis volume 3 (pp. 25–34). New York, NY: Academic Press.
- Lerner, G. H., & Zimmerman, D. H. (2002). Action and the appearance of action in the conduct of very young children. In P. Glenn, C. LeBaron, & J. Mandelbaum (Eds.), Studies in language and social interaction (pp. 441–457). Mahwah, NJ: Lawrence Erlbaum.
- 10.1002/9781118584194.ch17 · doi:10.1002/9781118584194.ch17
- McQuown, N. (1971). The natural history of an interview. Chicago, IL: Microfilm Collection, University of Chicago. (Original work published 1955)
- 10.1075/ld · doi:10.1075/ld
- Mondada, L. (2014d). Shooting as a research activity: The embodied production of video data. In M. Broth, E. Laurier, & L. Mondada (Eds.), Video at work (pp. 33–62). London, England: Routledge.
- Mondada, L. (2016b). Zwischen text und bild: Multimodale transkription [Between text and image: Multimodal transcriptions]. In H. Hausendorf, R. Schmitt, & W. Kesselheim (Eds.), Interaktionsarchitektur, sozialtopograhie und interaktionsraum (pp. 111–160). Tübingen, Germany: Narr.
- 10.1075/gest · doi:10.1075/gest
- Schegloff, E. A. (1998). Body torque. Social Research, 65(3), 535–586.
Cited by
Mondada, L. (2019) · Journal of Pragmatics · doi:10.1016/j.pragma.2019.01.016 · Cited by 490
Self-citationMultimodal Language Processing in Human Communication
Holler, J., & Levinson, S. C. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.05.006 · Cited by 441
“Pepper, what do you mean?” Miscommunication and repair in robot-led survey interaction
Stommel, W., de Rijk, L., & Boumans, R. (2022) · 2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN) · doi:10.1109/ro-man53752.2022.9900528 · Cited by 19
Tai, K. W. H., & Choi, K. C. K. (2026) · Journal of Multilingual and Multicultural Development · doi:10.1080/01434632.2025.2580563 · Cited by 11
Embodied-Visual Practices during Conversational Repair: Scoping Review
Saalasti, S., Pajo, K., Fox, B., Pekkala, S., & Laakso, M. (2023) · Research on Language and Social Interaction · doi:10.1080/08351813.2023.2272528 · Cited by 9
Metadata
- Authors
- Mondada, L.
- Venue
- Research on Language and Social Interaction
- Publisher
- Informa UK Limited
- Published
- 2018-01-02
- Volume
- 51
- Issue
- 1
- Pages
- 85-106
- ISSN
- 0835-1813 (ISSN-L)
- 1532-7973
- OpenAlex
- W2793998950
- Cited by
- 1,056
- References
- 57
- FWCI
- 377.35
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Multiple Temporalities of Language and Body in Interaction: Challenges for Transcribing Multimodality. https://app.cochat.ai/papers/10.1080/08351813.2018.1413878
- The paper
- Mondada, L. (2018). Multiple Temporalities of Language and Body in Interaction: Challenges for Transcribing Multimodality. Research on Language and Social Interaction. https://doi.org/10.1080/08351813.2018.1413878
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.