Cited by 108Neurobiology of Language and BilingualismLanguage, Discourse, Communication StrategiesPhonetics and Phonology Research

Conversation Electrified: ERP Correlates of Speech Act Recognition in Underspecified Utterances

Open access
Gisladottir, Rosa S., Chwilla, Dorothee J., Levinson, Stephen C.·2015·PLOS ONE

Abstract

The ability to recognize speech acts (verbal actions) in conversation is critical for everyday interaction. However, utterances are often underspecified for the speech act they perform, requiring listeners to rely on the context to recognize the action. The goal of this study was to investigate the time-course of auditory speech act recognition in action-underspecified utterances and explore how sequential context (the prior action) impacts this process. We hypothesized that speech acts are recognized early in the utterance to allow for quick transitions between turns in conversation. Event-related potentials (ERPs) were recorded while participants listened to spoken dialogues and performed an action categorization task. The dialogues contained target utterances that each of which could deliver three distinct speech acts depending on the prior turn. The targets were identical across conditions, but differed in the type of speech act performed and how it fit into the larger action sequence. The ERP results show an early effect of action type, reflected by frontal positivities as early as 200 ms after target utterance onset. This indicates that speech act recognition begins early in the turn when the utterance has only been partially processed. Providing further support for early speech act recognition, actions in highly constraining contexts did not elicit an ERP effect to the utterance-final word. We take this to show that listeners can recognize the action before the final word through predictions at the speech act level. However, additional processing based on the complete utterance is required in more complex actions, as reflected by a posterior negativity at the final word when the speech act is in a less constraining context and a new action sequence is initiated. These findings demonstrate that sentence comprehension in conversational contexts crucially involves recognition of verbal action which begins as soon as it can.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pone.0120068

Cites

6 of 6 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Listeners can rapidly infer the speech act of utterances.

    “there are studies showing specifically that listeners can rapidly infer the speech act of utterances”

    From Timing in Conversation (2023) · cites this paper as Gisladottir, Chwilla, & Levinson, 2015

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 75

  1. [1]Wittgenstein L. Philosophical investigations. Oxford: Basil Blackwell; 1953.
  2. [3]Levinson SC. Action formation and ascription In: Stivers T, Sidnell J, editors. The handbook of conversation analysis. Malden, MA: Wiley-Blackwell; 2013 pp. 103– 130.
  3. [4]Searle JR. Speech acts: An essay in the philosophy of language. Cambridge: Cambridge University Press; 1969.
  4. [5]Schegloff EA. Sequence organization in interaction: A primer in conversation analysis. Cambridge: Cambridge University Press; 2007.
  5. [6]Sadock JM, Zwicky AM. Speech act distinctions in syntax In: Shopen T, editor. Language typology and syntactic description. Vol. 1 Cambridge: Cambridge University Press; 1985 pp. 155– 196.
  6. [7]Heritage J. Epistemics in action: Action formation and territories of knowledge. Res Lang Soc Interact. 2012; 45: 1– 29.
  7. [8]De Ruiter JP, Mitterer H, Enfield NJ. Projecting the end of a speaker’s turn: A cognitive cornerstone of conversation. Language (Baltim). 2006; 82: 515– 535.
  8. [9]Heldner M, Edlund J. Pauses, gaps and overlaps in conversations. J Phon. 2010; 38: 555– 568.
  9. [10]Stivers T, Enfield NJ, Brown P, Englert C, Hayashi M, Heinemann T, et al Universals and cultural variation in turn-taking in conversation. Proc Natl Acad Sci U S A. 2009; 106: 10587– 10592. 10.1073/pnas.0903616106 19553212 PMC2705608 · DOI · Paper page
  10. [11]Indefrey P, Levelt WJ. The spatial and temporal signatures of word production components. Cognition. 2004; 92: 101– 144. 15037128
  11. [12]Schnur TT, Costa A, Caramazza A. Planning at the phonological level during sentence production. J Psycholinguist Res. 2006; 35: 189– 213. 16502144
  12. [13]Schegloff EA, Sacks H. Opening up closings. Semiotica. 1973; 8: 289– 327.
  13. [14]Hanna JE, Tanenhaus MK, Trueswell JC. The effects of common ground and perspective on domains of referential interpretation. J Mem Lang. 2003; 49: 43– 61.
  14. [15]Hanna JE, Tanenhaus MK. Pragmatic effects on reference resolution in a collaborative task: Evidence from eye movements. Cogn Sci. 2004; 28: 105– 115.
  15. [16]Heller D, Grodner D, Tanenhaus MK. The role of perspective in identifying domains of reference. Cognition. 2008; 108: 831– 836. 10.1016/j.cognition.2008.04.008 18586232 · DOI
  16. [17]Brown-Schmidt S, Gunlogson C, Tanenhaus MK. Addressees distinguish shared from private information when interpreting questions during interactive conversation. Cognition. 2008; 107: 1122– 1134. 10.1016/j.cognition.2007.11.005 18164700 PMC2491908 · DOI
  17. [18]Nurmsoo E, Bloom P. Preschoolers’ perspective taking in word learning: Do they blindly follow eye gaze? Psychol Sci. 2008; 19: 211– 215. 10.1111/j.1467-9280.2008.02069.x 18315790 · DOI
  18. [20]Basnakova J, Weber K, Petersson KM, Van Berkum JJA, Hagoort P. Beyond the language given: The neural correlates of inferring speaker meaning. Cereb Cortex. 2014; 24: 2572– 2578. 10.1093/cercor/bht112 23645715 · DOI
  19. [21]Van Ackeren MJ, Casasanto D, Bekkering H, Hagoort P, Rüschemeyer SA. Pragmatics in action: Indirect requests engage theory of mind areas and the cortical motor network. J Cogn Neurosci. 2012; 24: 2237– 2247. 22849399
  20. [22]Van Berkum JJA, Zwitserlood P, Hagoort P, Brown CM. When and how do listeners relate a sentence to the wider discourse? Evidence from the N400 effect. Brain Res Cogn Brain Res. 2003; 17: 701– 718. 14561457
  21. [23]Van Berkum JJA, Hagoort P, Brown CM. Semantic integration in sentences and discourse: Evidence from the N400. J Cogn Neurosci. 1999; 11: 657– 671. 10601747
  22. [24]Regel S, Gunter TC, Friederici AD. Isn’t it ironic? An electrophysiological exploration of figurative language processing. J Cogn Neurosci. 2011; 23: 277– 293. 10.1162/jocn.2010.21411 20044894 · DOI
  23. [25]Spotorno N, Cheylus A, Van Der Henst J-B, Noveck IA. What’s behind a P600? Integration operations during irony processing. PLoS One. 2013; 8: e66839 10.1371/journal.pone.0066839 23826155 PMC3691266 · DOI
  24. [26]Nieuwland MS, Ditman T, Kuperberg GR. On the incrementality of pragmatic processing: An ERP investigation of informativeness and pragmatic abilities. J Mem Lang. 2010; 63: 324– 346. 20936088 PMC2950651
  25. [27]Noveck IA, Posada A. Characterizing the time course of an implicature: An evoked potentials study. Brain Lang. 2003; 85: 203– 210. 12735938
  26. [28]Egorova N, Shtyrov Y, Pulvermüller F. Early and parallel processing of pragmatic and semantic information in speech acts: Neurophysiological evidence. Front Hum Neurosci. 2013; 7: 1– 13. 10.3389/fnhum.2013.00001 23543248 PMC3610085 · DOI
  27. [29]Egorova N, Pulvermüller F, Shtyrov Y. Neural dynamics of speech act comprehension: An MEG study of naming and requesting. Brain Topogr. 2013; 27: 375– 392. 10.1007/s10548-013-0329-3 24253730 PMC3976511 · DOI
  28. [30]Coulson S, Lovett C. Comprehension of nonconventional indirect requests: An event-related brain potential study. Riv Linguist. 2010; 22: 107– 124.
  29. [31]Dimitrova DV, Stowe LA, Redeker G, Hoeks JC. Less is not more: Neural responses to missing and superfluous accents in context. J Cogn Neurosci. 2012; 24: 2400– 2418. 10.1162/jocn_a_00302 23016764 · DOI
  30. [32]Magne C, Astésano C, Lacheret-Dujour A, Morel M, Alter K, Besson M. On-line processing of “pop-out” words in spoken French dialogues. J Cogn Neurosci. 2005; 17: 740– 756. 15904541
  31. [33]Wang L, Bastiaansen M, Yang Y, Hagoort P. The influence of information structure on the depth of semantic processing: How focus and pitch accent determine the size of the N400 effect. Neuropsychologia. 2011; 49: 813– 820. 10.1016/j.neuropsychologia.2010.12.035 21195102 · DOI
  32. [34]Schober MF, Clark HH. Understanding by addressees and overhearers. Cogn Psychol. 1989; 21: 211– 232.
  33. [35]Gisladottir RS, Chwilla DJ, Schriefers H, Levinson SC. Speech act recognition in conversation: Experimental evidence In: Miyake N, Cooper RP, editors. Proceedings of the 34th annual meeting of the Cognitive Science Society. Austin, Texas: Cognitive Science Society; 2012 pp. 1596– 1601.
  34. [36]Schegloff EA. Presequences and indirection: Applying speech act theory to ordinary conversation. J Pragmat. 1988; 12: 55– 62.
  35. [37]Magliano JP, Baggett WB, Johnson BK, Graesser AC. The time course of generating causal antecedent and causal consequence inferences. Discourse Process. 1993; 16: 35– 53.
  36. [38]Kutas M. In the company of other words: Electrophysiological evidence for single word and sentence context effects. Lang Cogn Process. 1993; 8: 533– 572.
  37. [39]Blakemore D. Understanding utterances: An introduction to pragmatics. Oxford: Blackwell; 1992.
  38. [40]Ten Bosch L, Oostdijk N, Boves L. On temporal aspects of turn taking in conversational dialogues. Speech Commun. 2005; 47: 80– 86.
  39. [41]Baron-Cohen S, Wheelwright S. The empathy quotient: An investigation of adults with Asperger syndrome or high functioning autism, and normal sex differences. J Autism Dev Disord. 2004; 34: 163– 175. 15162935
  40. [45]Barr DJ, Levy R, Scheepers C, Tily HJ. Random effects structure for confirmatory hypothesis testing: Keep it maximal. J Mem Lang. 2013; 68: 255– 278. PMC3881361 24403724
  41. [46]Brown CM, Hagoort P. On the electrophysiology of language comprehension: Implications for the human language system In: Crocker MW, Pickering M, Clifton C, editors. Architectures and mechanisms for language processing. Cambridge: Cambridge University Press; 2000 pp. 213– 237.
  42. [47]Coulson S. Electrophysiology and pragmatic language comprehension In: Noveck IA, Sperber D, editors. Experimental pragmatics. Basingstoke, Hampshire: Palgrave Macmillan; 2004 pp. 187– 206.
  43. [48]Grainger J, Lopez D, Eddy M, Dufau S, Holcomb PJ. How word frequency modulates masked repetition priming: An ERP investigation. Psychophysiology. 2012; 49: 604– 616. 10.1111/j.1469-8986.2011.01337.x 22221077 PMC3323680 · DOI
  44. [49]Kwon N, Kluender R, Kutas M, Polinsky M. Subject/object processing asymmetries in Korean relative clauses: Evidence from ERP data. Language (Baltim). 2013; 89: 537– 585. 25400303 PMC4231604
  45. [50]Bar M. The proactive brain: memory for predictions. Philos Trans R Soc Lond B Biol Sci. 2009; 364: 1235– 1243. 10.1098/rstb.2008.0310 19528004 PMC2666710 · DOI
  46. [51]Kutas M, DeLong KA, Smith NJ. A look around at what lies ahead: Prediction and predictability in language processing In: Bar M, editor. Predictions in the brain: Using our past to generate a future. Oxford: Oxford University Press; 2011 pp. 190– 207.
  47. [53]Pickering MJ, Garrod S. An integrated theory of language production and comprehension. Behav Brain Sci. 2013; 36: 329– 347. 10.1017/S0140525X12001495 23789620 · DOI · Paper page
  48. [54]Schank R, Abelson R. Scripts, plans, goals, and understanding: An inquiry into human knowledge structures. Oxford, England: Lawrence Erlbaum; 1977.
  49. [55]Altmann G, Kamide Y. Incremental interpretation at verbs: Restricting the domain of subsequent reference. Cognition. 1999; 73: 247– 264. 10585516
  50. [56]Federmeier KD. Thinking ahead: The role and roots of prediction in language comprehension. Psychophysiology. 2007; 44: 491– 505. 17521377 PMC2712632
  51. [57]Thornhill DE, Van Petten C. Lexical versus conceptual anticipation during sentence processing: Frontal positivity and N400 ERP components. Int J Psychophysiol. 2012; 83: 382– 392. 10.1016/j.ijpsycho.2011.12.007 22226800 · DOI
  52. [58]Hagoort P. The fractionation of spoken language understanding by measuring electrical and magnetic brain signals. Philos Trans R Soc Lond B Biol Sci. 2008; 363: 1055– 1069. 17890190 PMC2606796
  53. [59]Grice HP. Logic and conversation In: Cole P, Morgan J, editors. Syntax and semantics, 3: Speech Acts. New York: Academic Press; 1975 pp. 41– 58.
  54. [60]Hagoort P, Brown CM, Osterhout L. The neurocognition of syntactic processing In: Hagoort P, Brown CM, editors. The neurocognition of language. Oxford: Oxford University Press; 1999 pp. 273– 316.
  55. [61]Kolk H, Chwilla D. Late positivities in unusual situations. Brain Lang. 2007; 100: 257– 261. 16919324
  56. [62]Van Petten C, Luka BJ. Prediction during language comprehension: Benefits, costs, and ERP components. Int J Psychophysiol, 2012; 83: 176– 190. 10.1016/j.ijpsycho.2011.09.015 22019481 · DOI
  57. [63]Holtgraves T. The role of the right hemisphere in speech act comprehension. Brain Lang. 2012; 121: 58– 64. 10.1016/j.bandl.2012.01.003 22330796 · DOI
  58. [64]Foldi NS. Appreciation of pragmatic interpretations of indirect commands: Comparison of right and left hemisphere brain-damaged patients. Brain Lang. 1987; 31: 88– 108. 2437997
  59. [65]Coulson S, Wu YC. Right hemisphere activation of joke-related information: An event-related brain potential study. J Cogn Neurosci. 2005; 17: 494– 506. 15814008
  60. [66]Menenti L, Petersson KM, Scheeringa R, Hagoort P. When elephants fly: Differential sensitivity of right and left inferior frontal gyri to discourse and world knowledge. J Cogn Neurosci. 2009; 21: 2358– 2368. 10.1162/jocn.2008.21163 19016600 · DOI · Paper page
  61. [67]Beeman MJ, Bowden EM, Gernsbacher MA. Right and left hemisphere cooperation for drawing predictive and coherence inferences during normal story comprehension. Brain Lang. 2000; 71: 310– 336. 10716864 PMC4364278
  62. [68]Federmeier KD, Wlotko EW, Meyer AM. What’s “right” in language comprehension: Event-related potentials reveal right hemisphere language capabilities. Lang Linguist Compass. 2008; 2: 1– 17. 19777128 PMC2748422
  63. [69]Dwivedi VD, Drury JE, Molnar M, Phillips NA, Baum S, Steinhauer K. ERPs reveal sensitivity to hypothetical contexts in spoken discourse. Neuroreport. 2010; 21: 791– 795. 10.1097/WNR.0b013e32833cae0d 20574414 · DOI
  64. [70]Dwivedi VD, Phillips NA, Laguë-Beauvais M, Baum SR. An electrophysiological study of mood, modal context, and anaphora. Brain Res. 2006; 1117: 135– 153. 16997288
  65. [71]MacGregor LJ, Corley M, Donaldson DI. Listening to the sound of silence: Disfluent silent pauses in speech have consequences for listeners. Neuropsychologia. 2010; 48: 3982– 3992. 10.1016/j.neuropsychologia.2010.09.024 20950633 · DOI
  66. [72]Meinhardt J, Kühn-Popp N, Sommer M, Sodian B. Distinct neural correlates underlying pretense and false belief reasoning: Evidence from ERPs. Neuroimage. 2012; 63: 623– 631. 10.1016/j.neuroimage.2012.07.019 22813953 · DOI
  67. [73]Sabbagh MA, Taylor M. Neural correlates of theory-of-mind reasoning: An event-related potential study. Psychol Sci. 2000; 11: 46– 50. 11228842
  68. [75]Kärkkäinen E, Keisanen T. Linguistic and embodied formats for making (concrete) offers. Discourse Stud. 2012; 14: 587– 611.
  69. [76]Osterhout L, Holcomb PJ. Event-related brain potentials elicited by syntactic anomaly. J Mem Lang. 1992; 31: 785– 806.
  70. [77]Kutas M. Views on how the electrical activity that the brain generates reflects the functions of different language structures. Psychophysiology. 1997; 34: 383– 398. 9260491
  71. [78]King J, Kutas M. Who did what and when? Using word-and clause-level ERPs to monitor working memory usage in reading. J Cogn Neurosci. 1995; 7: 376– 395. 10.1162/jocn.1995.7.3.376 23961867 · DOI
  72. [79]Münte TF, Schiltz K, Kutas M. When temporal terms belie conceptual order. Nature. 1998; 395: 71– 73. 9738499
  73. [80]Kluender R, Kutas M. Bridging the gap: Evidence from ERPs on the processing of unbounded dependencies. J Cogn Neurosci. 1993; 5: 196– 214. 10.1162/jocn.1993.5.2.196 23972154 · DOI
  74. [81]Van Berkum JJA, Brown CM, Hagoort P, Zwitserlood P. Event-related brain potentials reflect discourse-referential ambiguity in spoken language comprehension. Psychophysiology. 2003; 40: 235– 248. 12820864
  75. [82]Ward G, Hirschberg J. Implicating uncertainty: The pragmatics of fall-rise intonation. Language (Baltim). 1985; 61: 747– 776.

Cited by

Sorted by citations

Authors
Gisladottir, R. S., Chwilla, D. J., & Levinson, S. C.
Affiliations
  • Radboud University Nijmegen (NL)
  • Max Planck Society (DE)
Venue
PLOS ONE
Published
2015-03-20
Volume
10
Issue
3
Pages
e0120068
ISSN
1932-6203 (ISSN-L)
OpenAlex
W1986320816
Cited by
108
References
6
Citations by year
2026: 26 · 2025: 5 · 2024: 7 · 2023: 14 · 2022: 11 · 2021: 12 · 2020: 8 · 2019: 7 · 2018: 2 · 2017: 5 · 2016: 7 · 2015: 3 · 2012: 1
FWCI
3.41
Type
journal article
Language
en
Open access
Locations
  • PLoS ONE (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Figshare (submittedVersion, cc-by)
  • MPG.PuRe (Max Planck Society) (submittedVersion, other-oa)
  • Radboud Repository (Radboud University) (submittedVersion)
  • Radboud Repository (Radboud University) (submittedVersion, other-oa)
Funders
  • International Max Planck Research School for Environmental, Cellular and Molecular Microbiology
  • Radboud Universiteit
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Neurobiology of Language and Bilingualism
  • Social Sciences › Arts and Humanities › Language and Linguistics › Language, Discourse, Communication Strategies
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Phonetics and Phonology Research
Keywords
speech act recognition, conversation, event-related potentials, turn-taking, sentence comprehension, verbal acts, frontal positivity, posterior negativity, spoken dialogue
MeSH terms
Adolescent, Adult, Evoked Potentials, Female, Humans, Male, Speech

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review