Conversation Electrified: ERP Correlates of Speech Act Recognition in Underspecified Utterances
Open accessAbstract
The ability to recognize speech acts (verbal actions) in conversation is critical for everyday interaction. However, utterances are often underspecified for the speech act they perform, requiring listeners to rely on the context to recognize the action. The goal of this study was to investigate the time-course of auditory speech act recognition in action-underspecified utterances and explore how sequential context (the prior action) impacts this process. We hypothesized that speech acts are recognized early in the utterance to allow for quick transitions between turns in conversation. Event-related potentials (ERPs) were recorded while participants listened to spoken dialogues and performed an action categorization task. The dialogues contained target utterances that each of which could deliver three distinct speech acts depending on the prior turn. The targets were identical across conditions, but differed in the type of speech act performed and how it fit into the larger action sequence. The ERP results show an early effect of action type, reflected by frontal positivities as early as 200 ms after target utterance onset. This indicates that speech act recognition begins early in the turn when the utterance has only been partially processed. Providing further support for early speech act recognition, actions in highly constraining contexts did not elicit an ERP effect to the utterance-final word. We take this to show that listeners can recognize the action before the final word through predictions at the speech act level. However, additional processing based on the complete utterance is required in more complex actions, as reflected by a posterior negativity at the final word when the speech act is in a less constraining context and a new action sequence is initiated. These findings demonstrate that sentence comprehension in conversational contexts crucially involves recognition of verbal action which begins as soon as it can.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Listeners can rapidly infer the speech act of utterances.
“there are studies showing specifically that listeners can rapidly infer the speech act of utterances”
From Timing in Conversation (2023) · cites this paper as Gisladottir, Chwilla, & Levinson, 2015
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Austin, J. L. (1975) · doi:10.1093/acprof:oso/9780198245537.001.0001 · Cited by 21,496 · see citing works
Searle, J. R. (1969) · doi:10.1017/cbo9781139173438 · Cited by 11,718 · see citing works
Categorical data analysis: Away from ANOVAs (transformation or not) and towards logit mixed models
Jaeger, T. F. (2008) · Journal of Memory and Language · doi:10.1016/j.jml.2007.11.007 · Cited by 3,317 · cited 1× · see citing works
“Mixed-effects logistic regression is better suited for the analysis of categorical outcome variables (such as question-answer accuracy) than ANOVA and allows the inclusion of participants and items as random factors in a single analysis [44].”
MethodRemembering the past to imagine the future: the prospective brain
Schacter, D. L., Addis, D. R., & Buckner, R. L. (2007) · Nature Reviews Neuroscience · doi:10.1038/nrn2213 · Cited by 2,394 · cited 1× · see citing works
“The ERP pattern for Declinations is consistent with the idea that the brain is proactive, constantly generating expectations about upcoming input [50–53].”
MethodThe Neural Basis of Mentalizing
Frith, C. D., & Frith, U. (2006) · Neuron · doi:10.1016/j.neuron.2006.05.001 · Cited by 1,855 · see citing works
(1979) · Expression and Meaning · doi:10.1017/cbo9780511609213.004 · Cited by 1,393 · see citing works
Flagged first, then by citations
Research works printed but not linked: 75
- [1]Wittgenstein L. Philosophical investigations. Oxford: Basil Blackwell; 1953.
- [3]Levinson SC. Action formation and ascription In: Stivers T, Sidnell J, editors. The handbook of conversation analysis. Malden, MA: Wiley-Blackwell; 2013 pp. 103– 130.
- [4]Searle JR. Speech acts: An essay in the philosophy of language. Cambridge: Cambridge University Press; 1969.
- [5]Schegloff EA. Sequence organization in interaction: A primer in conversation analysis. Cambridge: Cambridge University Press; 2007.
- [6]Sadock JM, Zwicky AM. Speech act distinctions in syntax In: Shopen T, editor. Language typology and syntactic description. Vol. 1 Cambridge: Cambridge University Press; 1985 pp. 155– 196.
- [7]Heritage J. Epistemics in action: Action formation and territories of knowledge. Res Lang Soc Interact. 2012; 45: 1– 29.
- [8]De Ruiter JP, Mitterer H, Enfield NJ. Projecting the end of a speaker’s turn: A cognitive cornerstone of conversation. Language (Baltim). 2006; 82: 515– 535.
- [9]Heldner M, Edlund J. Pauses, gaps and overlaps in conversations. J Phon. 2010; 38: 555– 568.
- [10]Stivers T, Enfield NJ, Brown P, Englert C, Hayashi M, Heinemann T, et al Universals and cultural variation in turn-taking in conversation. Proc Natl Acad Sci U S A. 2009; 106: 10587– 10592. 10.1073/pnas.0903616106 19553212 PMC2705608 · DOI · Paper page
- [11]Indefrey P, Levelt WJ. The spatial and temporal signatures of word production components. Cognition. 2004; 92: 101– 144. 15037128
- [12]Schnur TT, Costa A, Caramazza A. Planning at the phonological level during sentence production. J Psycholinguist Res. 2006; 35: 189– 213. 16502144
- [13]Schegloff EA, Sacks H. Opening up closings. Semiotica. 1973; 8: 289– 327.
- [14]Hanna JE, Tanenhaus MK, Trueswell JC. The effects of common ground and perspective on domains of referential interpretation. J Mem Lang. 2003; 49: 43– 61.
- [15]Hanna JE, Tanenhaus MK. Pragmatic effects on reference resolution in a collaborative task: Evidence from eye movements. Cogn Sci. 2004; 28: 105– 115.
- [16]Heller D, Grodner D, Tanenhaus MK. The role of perspective in identifying domains of reference. Cognition. 2008; 108: 831– 836. 10.1016/j.cognition.2008.04.008 18586232 · DOI
- [17]Brown-Schmidt S, Gunlogson C, Tanenhaus MK. Addressees distinguish shared from private information when interpreting questions during interactive conversation. Cognition. 2008; 107: 1122– 1134. 10.1016/j.cognition.2007.11.005 18164700 PMC2491908 · DOI
- [18]Nurmsoo E, Bloom P. Preschoolers’ perspective taking in word learning: Do they blindly follow eye gaze? Psychol Sci. 2008; 19: 211– 215. 10.1111/j.1467-9280.2008.02069.x 18315790 · DOI
- [20]Basnakova J, Weber K, Petersson KM, Van Berkum JJA, Hagoort P. Beyond the language given: The neural correlates of inferring speaker meaning. Cereb Cortex. 2014; 24: 2572– 2578. 10.1093/cercor/bht112 23645715 · DOI
- [21]Van Ackeren MJ, Casasanto D, Bekkering H, Hagoort P, Rüschemeyer SA. Pragmatics in action: Indirect requests engage theory of mind areas and the cortical motor network. J Cogn Neurosci. 2012; 24: 2237– 2247. 22849399
- [22]Van Berkum JJA, Zwitserlood P, Hagoort P, Brown CM. When and how do listeners relate a sentence to the wider discourse? Evidence from the N400 effect. Brain Res Cogn Brain Res. 2003; 17: 701– 718. 14561457
- [23]Van Berkum JJA, Hagoort P, Brown CM. Semantic integration in sentences and discourse: Evidence from the N400. J Cogn Neurosci. 1999; 11: 657– 671. 10601747
- [24]Regel S, Gunter TC, Friederici AD. Isn’t it ironic? An electrophysiological exploration of figurative language processing. J Cogn Neurosci. 2011; 23: 277– 293. 10.1162/jocn.2010.21411 20044894 · DOI
- [25]Spotorno N, Cheylus A, Van Der Henst J-B, Noveck IA. What’s behind a P600? Integration operations during irony processing. PLoS One. 2013; 8: e66839 10.1371/journal.pone.0066839 23826155 PMC3691266 · DOI
- [26]Nieuwland MS, Ditman T, Kuperberg GR. On the incrementality of pragmatic processing: An ERP investigation of informativeness and pragmatic abilities. J Mem Lang. 2010; 63: 324– 346. 20936088 PMC2950651
- [27]Noveck IA, Posada A. Characterizing the time course of an implicature: An evoked potentials study. Brain Lang. 2003; 85: 203– 210. 12735938
- [28]Egorova N, Shtyrov Y, Pulvermüller F. Early and parallel processing of pragmatic and semantic information in speech acts: Neurophysiological evidence. Front Hum Neurosci. 2013; 7: 1– 13. 10.3389/fnhum.2013.00001 23543248 PMC3610085 · DOI
- [29]Egorova N, Pulvermüller F, Shtyrov Y. Neural dynamics of speech act comprehension: An MEG study of naming and requesting. Brain Topogr. 2013; 27: 375– 392. 10.1007/s10548-013-0329-3 24253730 PMC3976511 · DOI
- [30]Coulson S, Lovett C. Comprehension of nonconventional indirect requests: An event-related brain potential study. Riv Linguist. 2010; 22: 107– 124.
- [31]Dimitrova DV, Stowe LA, Redeker G, Hoeks JC. Less is not more: Neural responses to missing and superfluous accents in context. J Cogn Neurosci. 2012; 24: 2400– 2418. 10.1162/jocn_a_00302 23016764 · DOI
- [32]Magne C, Astésano C, Lacheret-Dujour A, Morel M, Alter K, Besson M. On-line processing of “pop-out” words in spoken French dialogues. J Cogn Neurosci. 2005; 17: 740– 756. 15904541
- [33]Wang L, Bastiaansen M, Yang Y, Hagoort P. The influence of information structure on the depth of semantic processing: How focus and pitch accent determine the size of the N400 effect. Neuropsychologia. 2011; 49: 813– 820. 10.1016/j.neuropsychologia.2010.12.035 21195102 · DOI
- [34]Schober MF, Clark HH. Understanding by addressees and overhearers. Cogn Psychol. 1989; 21: 211– 232.
- [35]Gisladottir RS, Chwilla DJ, Schriefers H, Levinson SC. Speech act recognition in conversation: Experimental evidence In: Miyake N, Cooper RP, editors. Proceedings of the 34th annual meeting of the Cognitive Science Society. Austin, Texas: Cognitive Science Society; 2012 pp. 1596– 1601.
- [36]Schegloff EA. Presequences and indirection: Applying speech act theory to ordinary conversation. J Pragmat. 1988; 12: 55– 62.
- [37]Magliano JP, Baggett WB, Johnson BK, Graesser AC. The time course of generating causal antecedent and causal consequence inferences. Discourse Process. 1993; 16: 35– 53.
- [38]Kutas M. In the company of other words: Electrophysiological evidence for single word and sentence context effects. Lang Cogn Process. 1993; 8: 533– 572.
- [39]Blakemore D. Understanding utterances: An introduction to pragmatics. Oxford: Blackwell; 1992.
- [40]Ten Bosch L, Oostdijk N, Boves L. On temporal aspects of turn taking in conversational dialogues. Speech Commun. 2005; 47: 80– 86.
- [41]Baron-Cohen S, Wheelwright S. The empathy quotient: An investigation of adults with Asperger syndrome or high functioning autism, and normal sex differences. J Autism Dev Disord. 2004; 34: 163– 175. 15162935
- [45]Barr DJ, Levy R, Scheepers C, Tily HJ. Random effects structure for confirmatory hypothesis testing: Keep it maximal. J Mem Lang. 2013; 68: 255– 278. PMC3881361 24403724
- [46]Brown CM, Hagoort P. On the electrophysiology of language comprehension: Implications for the human language system In: Crocker MW, Pickering M, Clifton C, editors. Architectures and mechanisms for language processing. Cambridge: Cambridge University Press; 2000 pp. 213– 237.
- [47]Coulson S. Electrophysiology and pragmatic language comprehension In: Noveck IA, Sperber D, editors. Experimental pragmatics. Basingstoke, Hampshire: Palgrave Macmillan; 2004 pp. 187– 206.
- [48]Grainger J, Lopez D, Eddy M, Dufau S, Holcomb PJ. How word frequency modulates masked repetition priming: An ERP investigation. Psychophysiology. 2012; 49: 604– 616. 10.1111/j.1469-8986.2011.01337.x 22221077 PMC3323680 · DOI
- [49]Kwon N, Kluender R, Kutas M, Polinsky M. Subject/object processing asymmetries in Korean relative clauses: Evidence from ERP data. Language (Baltim). 2013; 89: 537– 585. 25400303 PMC4231604
- [50]Bar M. The proactive brain: memory for predictions. Philos Trans R Soc Lond B Biol Sci. 2009; 364: 1235– 1243. 10.1098/rstb.2008.0310 19528004 PMC2666710 · DOI
- [51]Kutas M, DeLong KA, Smith NJ. A look around at what lies ahead: Prediction and predictability in language processing In: Bar M, editor. Predictions in the brain: Using our past to generate a future. Oxford: Oxford University Press; 2011 pp. 190– 207.
- [53]Pickering MJ, Garrod S. An integrated theory of language production and comprehension. Behav Brain Sci. 2013; 36: 329– 347. 10.1017/S0140525X12001495 23789620 · DOI · Paper page
- [54]Schank R, Abelson R. Scripts, plans, goals, and understanding: An inquiry into human knowledge structures. Oxford, England: Lawrence Erlbaum; 1977.
- [55]Altmann G, Kamide Y. Incremental interpretation at verbs: Restricting the domain of subsequent reference. Cognition. 1999; 73: 247– 264. 10585516
- [56]Federmeier KD. Thinking ahead: The role and roots of prediction in language comprehension. Psychophysiology. 2007; 44: 491– 505. 17521377 PMC2712632
- [57]Thornhill DE, Van Petten C. Lexical versus conceptual anticipation during sentence processing: Frontal positivity and N400 ERP components. Int J Psychophysiol. 2012; 83: 382– 392. 10.1016/j.ijpsycho.2011.12.007 22226800 · DOI
- [58]Hagoort P. The fractionation of spoken language understanding by measuring electrical and magnetic brain signals. Philos Trans R Soc Lond B Biol Sci. 2008; 363: 1055– 1069. 17890190 PMC2606796
- [59]Grice HP. Logic and conversation In: Cole P, Morgan J, editors. Syntax and semantics, 3: Speech Acts. New York: Academic Press; 1975 pp. 41– 58.
- [60]Hagoort P, Brown CM, Osterhout L. The neurocognition of syntactic processing In: Hagoort P, Brown CM, editors. The neurocognition of language. Oxford: Oxford University Press; 1999 pp. 273– 316.
- [61]Kolk H, Chwilla D. Late positivities in unusual situations. Brain Lang. 2007; 100: 257– 261. 16919324
- [62]Van Petten C, Luka BJ. Prediction during language comprehension: Benefits, costs, and ERP components. Int J Psychophysiol, 2012; 83: 176– 190. 10.1016/j.ijpsycho.2011.09.015 22019481 · DOI
- [63]Holtgraves T. The role of the right hemisphere in speech act comprehension. Brain Lang. 2012; 121: 58– 64. 10.1016/j.bandl.2012.01.003 22330796 · DOI
- [64]Foldi NS. Appreciation of pragmatic interpretations of indirect commands: Comparison of right and left hemisphere brain-damaged patients. Brain Lang. 1987; 31: 88– 108. 2437997
- [65]Coulson S, Wu YC. Right hemisphere activation of joke-related information: An event-related brain potential study. J Cogn Neurosci. 2005; 17: 494– 506. 15814008
- [66]Menenti L, Petersson KM, Scheeringa R, Hagoort P. When elephants fly: Differential sensitivity of right and left inferior frontal gyri to discourse and world knowledge. J Cogn Neurosci. 2009; 21: 2358– 2368. 10.1162/jocn.2008.21163 19016600 · DOI · Paper page
- [67]Beeman MJ, Bowden EM, Gernsbacher MA. Right and left hemisphere cooperation for drawing predictive and coherence inferences during normal story comprehension. Brain Lang. 2000; 71: 310– 336. 10716864 PMC4364278
- [68]Federmeier KD, Wlotko EW, Meyer AM. What’s “right” in language comprehension: Event-related potentials reveal right hemisphere language capabilities. Lang Linguist Compass. 2008; 2: 1– 17. 19777128 PMC2748422
- [69]Dwivedi VD, Drury JE, Molnar M, Phillips NA, Baum S, Steinhauer K. ERPs reveal sensitivity to hypothetical contexts in spoken discourse. Neuroreport. 2010; 21: 791– 795. 10.1097/WNR.0b013e32833cae0d 20574414 · DOI
- [70]Dwivedi VD, Phillips NA, Laguë-Beauvais M, Baum SR. An electrophysiological study of mood, modal context, and anaphora. Brain Res. 2006; 1117: 135– 153. 16997288
- [71]MacGregor LJ, Corley M, Donaldson DI. Listening to the sound of silence: Disfluent silent pauses in speech have consequences for listeners. Neuropsychologia. 2010; 48: 3982– 3992. 10.1016/j.neuropsychologia.2010.09.024 20950633 · DOI
- [72]Meinhardt J, Kühn-Popp N, Sommer M, Sodian B. Distinct neural correlates underlying pretense and false belief reasoning: Evidence from ERPs. Neuroimage. 2012; 63: 623– 631. 10.1016/j.neuroimage.2012.07.019 22813953 · DOI
- [73]Sabbagh MA, Taylor M. Neural correlates of theory-of-mind reasoning: An event-related potential study. Psychol Sci. 2000; 11: 46– 50. 11228842
- [75]Kärkkäinen E, Keisanen T. Linguistic and embodied formats for making (concrete) offers. Discourse Stud. 2012; 14: 587– 611.
- [76]Osterhout L, Holcomb PJ. Event-related brain potentials elicited by syntactic anomaly. J Mem Lang. 1992; 31: 785– 806.
- [77]Kutas M. Views on how the electrical activity that the brain generates reflects the functions of different language structures. Psychophysiology. 1997; 34: 383– 398. 9260491
- [78]King J, Kutas M. Who did what and when? Using word-and clause-level ERPs to monitor working memory usage in reading. J Cogn Neurosci. 1995; 7: 376– 395. 10.1162/jocn.1995.7.3.376 23961867 · DOI
- [79]Münte TF, Schiltz K, Kutas M. When temporal terms belie conceptual order. Nature. 1998; 395: 71– 73. 9738499
- [80]Kluender R, Kutas M. Bridging the gap: Evidence from ERPs on the processing of unbounded dependencies. J Cogn Neurosci. 1993; 5: 196– 214. 10.1162/jocn.1993.5.2.196 23972154 · DOI
- [81]Van Berkum JJA, Brown CM, Hagoort P, Zwitserlood P. Event-related brain potentials reflect discourse-referential ambiguity in spoken language comprehension. Psychophysiology. 2003; 40: 235– 248. 12820864
- [82]Ward G, Hirschberg J. Implicating uncertainty: The pragmatics of fall-rise intonation. Language (Baltim). 1985; 61: 747– 776.
Cited by
Sorted by citations
Multimodal Language Processing in Human Communication
Holler, J., & Levinson, S. C. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.05.006 · Cited by 441 · see citing works
Self-citationBarthel, M., Sauppe, S., Levinson, S. C., & Meyer, A. S. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01858 · Cited by 83 · see citing works
Self-citationNever Say No … How the Brain Interprets the Pregnant Pause in Conversation
Bögels, S., Kendrick, K. H., & Levinson, S. C. (2015) · PLOS ONE · doi:10.1371/journal.pone.0145474 · Cited by 62 · see citing works
Self-citationMeyer, A. S. (2023) · Journal of Cognition · doi:10.5334/joc.268 · Cited by 34 · see citing works
- Authors
- Gisladottir, R. S., Chwilla, D. J., & Levinson, S. C.
- Affiliations
- Radboud University Nijmegen (NL)
- Max Planck Society (DE)
- ORCID
- Levinson, Stephen C.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2015-03-20
- Volume
- 10
- Issue
- 3
- Pages
- e0120068
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4368040
- OpenAlex
- W1986320816
- Cited by
- 108
- References
- 6
- Citations by year
- 2026: 26 · 2025: 5 · 2024: 7 · 2023: 14 · 2022: 11 · 2021: 12 · 2020: 8 · 2019: 7 · 2018: 2 · 2017: 5 · 2016: 7 · 2015: 3 · 2012: 1
- FWCI
- 3.41
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- MPG.PuRe (Max Planck Society) (submittedVersion, other-oa)
- Radboud Repository (Radboud University) (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- Funders
- International Max Planck Research School for Environmental, Cellular and Molecular Microbiology
- Radboud Universiteit
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neurobiology of Language and Bilingualism
- Social Sciences › Arts and Humanities › Language and Linguistics › Language, Discourse, Communication Strategies
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Phonetics and Phonology Research
- Keywords
- speech act recognition, conversation, event-related potentials, turn-taking, sentence comprehension, verbal acts, frontal positivity, posterior negativity, spoken dialogue
- MeSH terms
- Adolescent, Adult, Evoked Potentials, Female, Humans, Male, Speech
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review