Cited by 994Memory and Neural MechanismsMemory Processes and InfluencesNeural dynamics and brain function

Discovering Event Structure in Continuous Narrative Perception and Memory

Open access
Baldassano, Christopher, Chen, Janice, Zadbood, Asieh, Pillow, Jonathan W., Hasson, Uri, Norman, Kenneth A.·2017·Neuron

Published version of a preprint

Abstract

During realistic, continuous perception, humans automatically segment experiences into discrete events. Using a novel model of cortical event dynamics, we investigate how cortical structures generate event representations during narrative perception and how these events are stored to and retrieved from memory. Our data-driven approach allows us to detect event boundaries as shifts between stable patterns of brain activity without relying on stimulus annotations and reveals a nested hierarchy from short events in sensory regions to long events in high-order areas (including angular gyrus and posterior medial cortex), which represent abstract, multimodal situation models. High-order event boundaries are coupled to increases in hippocampal activity, which predict pattern reinstatement during later free recall. These areas also show evidence of anticipatory reinstatement as subjects listen to a familiar narrative. Based on these results, we propose that brain activity is naturally structured into nested events, which form the basis of long-term memory representations.

Integrity signals

Registry

Crossref · 10.1016/j.neuron.2017.06.041

Cites

82 of 82 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

37 of 57 cited sources checked · 28 supported · 0 flagged · accuracy not yet measured

  • Premisecitation

    Humans automatically segment continuous perceptual experience into discrete events.

    “During realistic, continuous perception, humans automatically segment experiences into discrete events.”
    Quote in the paperSubstantial claim1 of 3 sources checked
    • cites Beal & Weiss, 2013

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Newtson, Engquist, & Bois, 1977 source
    • cites Zacks, Speer, Swallow, Braver, & Reynolds, 2007 source
  • Interpretationcitation

    The topography of event timescales is broadly consistent with previous work measuring sensitivity to temporal scrambling.

    “This topography of event timescales is broadly consistent with that found in previous work (Hasson et al., 2015) measuring sensitivity to temporal scrambling of a movie stimulus”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Hasson et al., 2015 source
  • Premisecitation

    Behavioral studies show that subjects can segment events into a nested hierarchy from coarse to fine timescales.

    “Behavioral studies have shown that subjects can segment events into a nested hierarchy from coarse to fine timescales (Kurby & Zacks, 2008; Zacks, Tversky, & Iyer, 2001)”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites Kurby & Zacks, 2008 source
    • cites Zacks, Tversky, & Iyer, 2001 source
  • Premisecitation

    The hippocampus is connected to long timescale regions including angular gyrus and posterior medial cortex.

    “The hippocampus is connected to long timescale regions including the angular gyrus and posterior medial cortex (Kravitz, Saleem, Baker, & Mishkin, 2011; Ranganath & Ritchey, 2012; Rugg & Vilberg, 2013)”
    Quote in the paperSubstantial claim2 of 3 sources checked
    • cites Kravitz et al., 2011 source

      The Anatomy of the three pathways section (page not provided) describes pathways linking the inferior parietal lobule, posterior cingulate and retrosplenial cortex with hippocampal regions, and identifies the angular gyrus as part of the human inferior parietal lobule. It does not characterize these regions as operating on long timescales, so that part of the claim is unsupported by this source. (LLM, conf=0.86)

      Experimental — accuracy not yet measured
    • cites Ranganath & Ritchey, 2012 source
    • cites Rugg & Vilberg, 2013 source

      The Cortical recollection effects section describes connectivity between the hippocampus and angular gyrus, and identifies hippocampal connections with retrosplenial/posterior cingulate cortex, which fits the posterior-medial part of the claim. It does not characterize those regions as operating on long timescales; a search for “timescale” did not establish that qualifier. No page number is available in our copy. (LLM, conf=0.86)

      Experimental — accuracy not yet measured
  • Findingcitation

    Event patterns could be partially predicted by key characters and locations from the narrative.

    “We also found that event patterns could be partially predicted by key characters and locations from the narrative (see Fig. S4d, and supplementary Fig. 6 in J. Chen et al., 2017)”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites J. Chen et al., 2017 source
    • The authors state this as an assumption: While processing a narrative stimulus, observers progress through a sequence of discrete event representations (hidden states).
    • The authors state this as an assumption: Each event has a distinct observable signature (a multi-voxel fMRI pattern) that is present throughout the event.
  • Classified as probably not a substantial claim. 20
  • May combine two claims. 20
  • The quote only partly states this claim. 1
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The hippocampus binds cortical representations into a memory trace.

    “The hippocampus is thought to bind cortical representations into a memory trace (McClelland, McNaughton, & O’Reilly, 1995; Moscovitch et al., 2005; Norman & O’Reilly, 2003)”
    Quote in the paperNot a substantial claim1 of 3 sources checked
    • cites McClelland et al., 1995 source
    • cites Moscovitch et al., 2005 source
    • cites Norman & O’Reilly, 2003

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim.

    Premisecitation

    Hippocampal activity peaks at the offset of video clips.

    “Recent work has shown that hippocampal activity peaks at the offset of video clips (Ben-Yakov & Dudai, 2011; Ben-Yakov, Eshel, & Dudai, 2013)”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites Ben-Yakov & Dudai, 2011 source

      The Experiment 2 results (page not specified in our copy) conclude that delayed activity in the bilateral hippocampus is time-locked to clip offset. The paper describes the response as beginning around or shortly after the clip ends, however, not as peaking at that moment. (LLM, conf=0.86)

      Experimental — accuracy not yet measured
    • cites Ben-Yakov et al., 2013 source
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    Prior work has shown that the end of a video clip is associated with increased hippocampal activity, and the magnitude predicts later memory.

    “Prior work has shown that the end of a video clip is associated with increased hippocampal activity, and the magnitude of the activity predicts later memory (Ben-Yakov & Dudai, 2011; Ben-Yakov et al., 2013).”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites Ben-Yakov & Dudai, 2011 source
    • cites Ben-Yakov et al., 2013 source
  • Classified as probably not a substantial claim.

    Premisecitation

    Cortical processing timescales increase along a hierarchy from early sensory regions (tens of milliseconds) to high-order regions (hundreds of seconds).

    “Processing timescales increase from tens of milliseconds in early sensory regions (e.g. for detecting phonemes in early auditory areas), to a few seconds in mid-level sensory areas (e.g. for integrating words into sentences), up to hundreds of seconds in regions including the temporoparietal junction, angular gyrus, and posterior and frontal medial cortex”
    Quote in the paperSubstantial claim2 of 2 sources checked
    • cites J. Chen et al., 2016 source

      The Introduction (page unavailable) describes a hierarchy from sensory regions with processing timescales shorter than a second to higher-order regions influenced by information from minutes earlier. The Discussion specifies hundreds of milliseconds for low-level sensory areas, not the claimed tens of milliseconds. Thus the hierarchy and long-timescale end are supported, but the precise short-timescale value is not. (LLM, conf=0.85)

      Experimental — accuracy not yet measured
    • cites Hasson, Chen, & Honey, 2015 source
  • Classified as probably not a substantial claim.

    Premisecitation

    Prior study found that activity patterns evoked by corresponding events in movie and narration were correlated in a network including angular gyrus, precuneus, retrosplenial cortex, posterior cingulate cortex and mPFC.

    “The prior study used a hand-labeled event correspondence between these two stimuli to show that activity patterns evoked by corresponding events in the movie and narration were correlated in a network of regions including angular gyrus, precuneus, retrosplenial cortex, posterior cingulate cortex and mPFC (Zadbood et al., 2016).”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Zadbood et al., 2016 source
  • Classified as probably not a substantial claim.

    Premisecitation

    Long-term memory reflects event structure during encoding.

    “Behavioral experiments and mathematical models have argued that long-term memory reflects event structure during encoding (Ezzyat & Davachi, 2011; Gershman, Radulescu, Norman, & Niv, 2014; Sargent et al., 2013; Zacks, Tversky, et al., 2001)”
    Quote in the paperSubstantial claim3 of 3 sources checked
    • cites Ezzyat & Davachi, 2011 source
    • cites Gershman et al., 2014 source
    • cites Sargent et al., 2013 source
  • May combine two claims.

    Premisecitation

    Event-related representations generalize across modalities and between encoding and recall.

    “we demonstrated that event-related representations generalize across modalities and between encoding and recall (thereby supporting hypotheses 3 and 5, J. Chen et al., 2017; Zadbood, Chen, Leong, Norman, & Hasson, 2016)”
    Quote in the paperSubstantial claim2 of 2 sources checked
    • cites J. Chen et al., 2017 source
    • cites Zadbood et al., 2016 source
  • May combine two claims.

    Premisereasoning

    Dynamic time warping and conditional random fields do not explicitly model event boundaries.

    “However, these methods do not explicitly model event boundaries.”
    Quote in the paperSubstantial claim2 of 3 sources checked
    • cites Kang & Wheatley, 2015 source
    • cites Silbert, Honey, Simony, Poeppel, & Hasson, 2014 source

      The Time-Warp Analysis section says the paper’s time-warping procedure aligns recordings using similarities between sound waveforms, rather than describing an explicit model of event boundaries. It does not address conditional random fields, so it cannot support that part of the claim. (LLM, conf=0.75)

      Experimental — accuracy not yet measured
    • cites Zhu et al., 2015 source

      Section 4.4 (p. 6) defines the paper’s CRF in terms of shot-to-sentence alignments and consistency between nearby alignments, with no explicit event-boundary variable. It describes dynamic time warping only as enforcing forward-in-time matching; that description does not establish whether the dynamic-time-warping method models event boundaries. (LLM, conf=0.76)

      Experimental — accuracy not yet measured
  • May combine two claims.

    Premisecitation

    These areas (angular gyrus, posterior cingulate) are involved in high-level multimodal scene processing, part of the general recollection network, and core components of the posterior medial memory system, which represents and updates a high-level situation model.

    “These areas are involved in high-level, multimodal scene processing tasks including memory and navigation (Baldassano, Esteva, Beck, & Fei-Fei, 2016; Kumar, Federmeier, Fei-Fei, & Beck, 2017), are part of the “general recollection network” with strong anatomical and functional connectivity to the hippocampus (Rugg & Vilberg, 2013), and are the core components of the posterior medial memory system”
    Quote in the paperSubstantial claim2 of 3 sources checked
    • cites Baldassano et al., 2016 source

      Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.

      Experimental — accuracy not yet measured
    • cites Kumar et al., 2017 source
    • cites Rugg & Vilberg, 2013 source
      Experimental — accuracy not yet measured
  • Classified as probably not a substantial claim.

    Premisecitation

    Previous work found hand-labeled event boundaries associated with univariate activity increases in a network overlapping high-level areas.

    “Previous work has shown that hand-labeled event boundaries are associated with univariate activity increases in a network of regions overlapping our high-level areas (Ezzyat & Davachi, 2011; Speer, Zacks, & Reynolds, 2007; Swallow et al., 2011; Whitney et al., 2009; Zacks, Braver, et al., 2001; Zacks, Speer, Swallow, & Maley, 2010)”
    Quote in the paperSubstantial claim2 of 3 sources checked
    • cites Ezzyat & Davachi, 2011 source

      Experiment 2 Results (page unavailable) report greater activity for boundary than control sentences in the right posterior cingulate/precuneus, plus sentence-type-dependent responses in other regions. But Experiment 1 Method (page unavailable) says the boundaries were cued by experimentally inserted “A while later” phrases and checked by an independent group, not hand-labeled event boundaries. The paper therefore supports a boundary-related activity finding, but not that methodological description. (LLM, conf=0.86)

      Experimental — accuracy not yet measured
    • cites Speer, Zacks, & Reynolds, 2007 source
    • cites Swallow et al., 2011 source

      The Materials and Methods (Materials; page unavailable) describe event boundaries identified from observers’ button presses. The Results (Imaging Data; page unavailable) report greater activity in medial temporal and parietal regions when objects were retrieved across an event boundary, but this is a retrieval-related effect, not a demonstrated network-wide increase at the hand-labeled boundaries themselves. (LLM, conf=0.84)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Other analyses of these datasets found reactivation during recall and shared event structure across modalities.

    “Other analyses of these datasets also found reactivation during recall (J. Chen et al., 2017) and shared event structure across modalities (Zadbood et al., 2016)”
    Quote in the paperNot a substantial claim2 of 2 sources checked
    • cites J. Chen et al., 2017 source
    • cites Zadbood et al., 2016 source
  • Classified as probably not a substantial claim.

    Premisecitation

    The process memory framework argues that perceptual stimuli are integrated across longer and longer timescales along a hierarchy from early sensory regions to default mode network regions.

    “The “process memory framework” argues that perceptual stimuli are integrated across longer and longer timescales along a hierarchy from early sensory regions to regions in the default mode network.”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Hasson et al., 2015 source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    This topography has previously been mapped by temporally scrambling stimuli or examining power spectra of intrinsic dynamics.

    “this topography has previously been mapped either by temporally scrambling the stimulus at different timescales to see which regions’ responses are disrupted (Hasson, Yang, Vallines, Heeger, & Rubin, 2008; Honey et al., 2012; Lerner, Honey, Silbert, & Hasson, 2011) or by examining the power spectrum of intrinsic dynamics within each region (Honey et al., 2012; Murray et al., 2014; Stephens et al.,”
    Quote in the paperNot a substantial claim3 of 3 sources checked
    • cites Hasson et al., 2008 source
    • cites Honey et al., 2012 source
    • cites Lerner et al., 2011 source
  • May combine two claims.

    Findingown data

    Sensory regions showed faster transitions between stable activity patterns, while higher-level regions had activity patterns that often remained constant for over a minute.

    “Sensory regions like visual and auditory cortex showed faster transitions between stable activity patterns, while higher-level regions like the posterior medial cortex, angular gyrus, and intraparietal sulcus had activity patterns that often remained constant for over a minute before transitioning to a new stable pattern”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: While processing a narrative stimulus, observers progress through a sequence of discrete event representations (hidden states).
    • The authors state this as an assumption: Each event has a distinct observable signature (a multi-voxel fMRI pattern) that is present throughout the event.
  • May combine two claims.

    Findingown data

    The model found significant fits for shared event order between movie and recall in posterior cingulate and angular gyrus, but not in low-level auditory cortex.

    “we found significant model fits in both the posterior cingulate (p=0.015) and the angular gyrus (p=0.002), but not in low-level auditory cortex (p=0.277) (Fig. 7b).”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: The same event-specific activity patterns seen during movie-viewing will be reinstated during spoken recall.
  • May combine two claims.

    Findingown data

    Human raters identified between 36 and 64 event boundaries, with significant overlap (average pairwise Dice's coefficient 0.63, 20 boundaries labeled by all four).

    “The number of event boundaries identified by the observers varied between 36 and 64, but the boundaries had a significant amount of overlap, with an average pairwise Dice’s coefficient of 0.63 and 20 event boundaries that were labeled by all four raters.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    All regions showed an above-chance match between fMRI-defined boundaries and consensus human annotations, with the match increasing across the hierarchy and largest in angular gyrus and posterior medial cortex.

    “all regions showed an above-chance match to human annotations (early visual, p=0.0135; late visual, p=0.0065; angular gyrus, p=0.0011; posterior medial, p<0.001), but this match increased across the layers of the hierarchy and was largest in angular gyrus and posterior medial cortex”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: While processing a narrative stimulus, observers progress through a sequence of discrete event representations (hidden states).
    • The authors state this as an assumption: Each event has a distinct observable signature (a multi-voxel fMRI pattern) that is present throughout the event.
  • May combine two claims.

    Findingown data

    Narrative stimuli evoke event-structured activity throughout the cortex, with stable periods punctuated by rapid transitions.

    “We found that narrative stimuli evoke event-structured activity throughout the cortex, with pattern dynamics consisting of relatively stable periods punctuated by rapid event transitions.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: While processing a narrative stimulus, observers progress through a sequence of discrete event representations (hidden states).
    • The authors state this as an assumption: Each event has a distinct observable signature (a multi-voxel fMRI pattern) that is present throughout the event.
  • May combine two claims.

    Findingown data

    Encoding activity and event reactivation were positively correlated in angular gyrus and posterior cingulate, but not in early auditory cortex.

    “we found that encoding activity and event reactivation were positively correlated in both angular gyrus (r=0.362, p=0.002) and the posterior cingulate (r=0.312, p=0.042), but not early auditory cortex (r=0.080, p=0.333).”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: The same event-specific activity patterns seen during movie-viewing will be reinstated during spoken recall.
  • The quote only partly states this claim.

    Findingown data

    In high-level association cortex, the detected events matched human observers' subjective annotations.

    “In a network of high-level association regions, we found that these events were related to subjective event annotations by human observers”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: Narrative processing involves observers experiencing a series of separate events.
    • The authors state this as an assumption: Every event is associated with its own neural signature.
  • May combine two claims.

    Findingown data

    There was no relationship between hippocampal activity at the starting boundary and later reinstatement in angular gyrus, and only a weak nonsignificant relationship in posterior cingulate.

    “there was no relationship between the hippocampal activity at the starting boundary of an event and that event’s later reinstatement in the angular gyrus (r=−0.119, p=0.867; difference from ending boundary correlation p=0.004) and only a weak, nonsignificant relationship in posterior cingulate (r=0.189, p=0.113; difference from ending boundary correlation p=0.274).”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: The same event-specific activity patterns seen during movie-viewing will be reinstated during spoken recall.
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductreasoning

    Both event boundaries and hippocampal response are hemodynamic signals, so there is no hemodynamic offset between them.

    “Note that both the event boundaries and the hippocampal response are hemodynamic signals, so there is no hemodynamic offset between these two measures.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Subjects flexibly adjust their units of segmentation depending on uncertainty about ongoing events.

    “flexibly adjust their units of segmentation depending on their uncertainty about ongoing events (Newtson, 1973)”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Newtson, 1973 source
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationreasoning

    The lack of similarity in low-level auditory cortex is presumably because low-level auditory features of the two stimuli were markedly different.

    “presumably because the low level auditory features of the two stimuli were markedly different.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    The hippocampal response starts slightly before the event boundary, possibly due to uncertainty in boundary estimation and/or anticipation.

    “The hippocampal response does start slightly before the event boundary, which could be due to uncertainty in the model estimation of the exact boundary timepoint and/or anticipation that the event is about to end.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Study design and conductown data

    The method was highly effective at identifying events in real fMRI data, with most identified boundaries close to a story switch.

    “As shown in Fig. S2, our method was highly effective at identifying events, with the majority of the identified boundaries falling close to a story switch.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: Narrative processing involves observers experiencing a series of separate events.
    • The authors state this as an assumption: Every event is associated with its own neural signature.
    • The authors state this as an assumption: An event boundary is expected every time the stimulus switches stories, providing ground truth for model comparison.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    A different segmentation approach that avoids exact MNI alignment yielded comparable results.

    “We also conducted an alternate version of the segmentation analysis that does not rely on precise MNI alignment (P.-H. (Cameron) Chen et al., 2015) and obtained similar results (see Fig. S4c).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites P.-H. (Cameron) Chen et al., 2015

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim.

    Study design and conductcitation

    Searchlight analyses were restricted to voxels reliably driven by stimuli, measured by intersubject correlation.

    “We restricted our searchlight analyses to voxels that were reliably driven by the stimuli, measured using intersubject correlation (Hasson, Nir, Levy, Fuhrmann, & Malach, 2004).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Hasson, Nir, Levy, Fuhrmann, & Malach, 2004 source
    • The authors state this as an assumption: Narrative processing involves observers experiencing a series of separate events.
    • The authors state this as an assumption: Every event is associated with its own neural signature.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    Statistical evaluation of every result relied on permutation or resampling tests.

    “Permutation or resampling analyses were used to statistically evaluate all of the results.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    The power spectrum is an incomplete description of voxel dynamics because correlation timescale changes dynamically, with faster changes at event boundaries and slower changes within boundaries.

    “The power spectrum is therefore an incomplete description of voxel dynamics, since the correlation timescale changes dynamically, with faster changes at event boundaries and slower changes within boundaries (see also Fig. S4b).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given

    The model is not fMRI-specific.

    “The model also is not fMRI-specific”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data

    Angular gyrus and posterior medial cortex exhibit overlapping properties associated with high-level situation model representations: long event timescales, boundaries related to human annotations, generalization across modalities, hippocampal response at boundaries, reactivation during recall, and anticipatory coding.

    “Furthermore, the angular gyrus and posterior medial cortex exhibit a set of overlapping properties associated with high-level situation model representations: long event timescales, event boundaries closely related to human annotations, generalization across modalities, hippocampal response at event boundaries, reactivation during free recall, and anticipatory coding for familiar narratives.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Study design and conductown data

    The robustness of identified boundaries was assessed by testing whether they explained held-out subject data.

    “We measured the robustness of the identified boundaries by testing whether these boundaries explained the data in the held-out subject.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: Narrative processing involves observers experiencing a series of separate events.
    • The authors state this as an assumption: Every event is associated with its own neural signature.
  • May combine two claims.

    Interpretationreasoning

    The model proposes that these events are combined across the cortical hierarchy into extended, meaningful episodic structures and then stored through hippocampal interaction.

    “these events are integrated along the processing hierarchy into meaningful, temporally extended, episodic structures, to be later encoded into memory via interaction with the hippocampus.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    A similar result can be obtained by directly aligning the two listening conditions without reference to movie-watching.

    “A similar result can be obtained by directly aligning the two listening conditions without reference to the movie-watching condition (see Fig. S7).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data

    All processing regions can exhibit rapid activity shifts, but these fast changes are much less frequent in long timescale regions.

    “suggesting that all processing regions can exhibit rapid activity shifts, but that these fast changes are much less frequent in long timescale regions.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    Three subjects were excluded for sleeping during scanning, and one for audio delivery problems.

    “Data from 3 subjects were discarded due to falling asleep during the scan, and 1 due to problems with audio delivery.”
    Quote in the paperNot a substantial claim
37 of 37
  • The authors state this as an assumption.

    While processing a narrative stimulus, observers progress through a sequence of discrete event representations (hidden states).

    “that while processing a narrative stimulus, observers progress through a sequence of discrete event representations (hidden states)”
  • The authors state this as an assumption.

    Each event has a distinct observable signature (a multi-voxel fMRI pattern) that is present throughout the event.

    “and that each event has a distinct (observable) signature (a multi-voxel fMRI pattern) that is present throughout the event.”
  • The authors state this as an assumption.

    The same event-specific activity patterns seen during movie-viewing will be reinstated during spoken recall.

    “we assumed that the same event-specific activity patterns seen during the movie-viewing will be reinstated during the spoken recall.”
  • The paper relies on this without support.

    The relationship between process-memory topography and event segmentation has not been investigated.

    “The relationship between the process-memory topography and event segmentation has not yet been investigated.”
  • The paper relies on this without support.

    Chunking of continuous experience at multiple timescales along the cortical processing hierarchy has not been previously demonstrated in whole-brain neural activity.

    “This chunking of continuous experience at multiple timescales along the cortical processing hierarchy has not been previously demonstrated in the dynamics of whole-brain neural activity.”
  • The paper relies on this without support.

    Detecting anticipation has not been possible with previous approaches relying on stimulus annotations.

    “Detecting this kind of anticipation has not been possible with previous approaches that rely on stimulus annotations”
  • The paper relies on this without support.

    Ongoing interpretation of events can be influenced by prior knowledge.

    “Our ongoing interpretation of events can be influenced by prior knowledge”
  • The paper relies on this without support.

    Real-life experience consists of a continuous stream of perceptual stimuli.

    “Real-life experience, however, consists of a continuous stream of perceptual stimuli.”
  • The paper relies on this without support.

    The brain needs to structure experience into units that can be understood and remembered.

    “The brain therefore needs to structure experience into units that can be understood and remembered”
  • The authors state this as an assumption.

    Narrative processing involves observers experiencing a series of separate events.

    “Our model is built on two hypotheses: 1) while processing narrative stimuli, observers experience a sequence of discrete events”
  • The authors state this as an assumption.

    Every event is associated with its own neural signature.

    “2) each event has a distinct neural signature.”
  • The authors state this as an assumption.

    The observed brain activity at any timepoint is highly correlated with the event signature mean activity pattern.

    “the observed brain activity bt at any timepoint t is assumed to be highly correlated with mk”
  • The authors state this as an assumption.

    A subject starts in event 1 and ends in event K.

    “the model assumes that a given subject (or averaged group of subjects) starts in event s1=1 and ends in event sT=K”
  • The authors state this as an assumption.

    At each timepoint, the subject either stays in the same state or moves to the next state.

    “In each timepoint the subject either remains in the same state or advances to the next state, i.e. st+1 ∈ {st, st+1} for all timepoints t.”
  • The authors state this as an assumption.

    The observation model is an isotropic Gaussian.

    “the observation model is an isotropic Gaussian”
  • The authors state this as an assumption.

    All valid event segmentations have the same prior probability.

    “we must modify the transition matrix to ensure that all valid event segmentations (which start at event 1 and end at event K, and proceed monotonically through all events) have the same prior probability.”
  • The authors state this as an assumption.

    An event boundary is expected every time the stimulus switches stories, providing ground truth for model comparison.

    “we expect that an event boundary should be generated every time the stimulus switches stories, giving a ground truth against which to compare the model’s segmentations.”
17 of 17

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Human memory is organized hierarchically and connected through rich logical associations rather than as a collection of isolated facts.

    “In contrast, human memory is organized hierarchically and connected through rich logical associations rather than as a collection of isolated facts.”

    From Memory Matters More: Event-Centric Memory as a Logic Map for Agent Searching and Reasoning (2026) · cites this paper as Baldassano et al., 2017

    The Introduction and Discussion (Events in episodic memory; pages unavailable) describe experiences as hierarchically chunked into events that can be encoded and recalled, supporting the hierarchical-memory part of the claim. The paper contrasts this account with studies of discrete items, but does not show that memories are connected through rich logical associations. (LLM, conf=0.86)

    Experimental — accuracy not yet measured
  • These events form the backbone of long-term memory and are encoded with rich temporal and semantic information.

    “These events form the backbone of long-term memory and are encoded with rich temporal and semantic information (Baldassano et al., 2017; Ezzyat and Davachi, 2011).”

    From Memory Matters More: Event-Centric Memory as a Logic Map for Agent Searching and Reasoning (2026) · cites this paper as Baldassano et al., 2017

    The Discussion (‘Events in episodic memory’; page unavailable) describes events as natural units of episodic memory and says event boundaries trigger storage of a situation representation into long-term memory. The Discussion (‘Processing timescales and event segmentation’; page unavailable) supports temporal structure and high-level situation descriptions, but says the specific features represented—and how semantic content evokes event patterns—remain open questions. It therefore does not establish that the stored events contain rich semantic information. (LLM, conf=0.83)

    Experimental — accuracy not yet measured
  • People can flexibly recover information generalizing across other stories, subjects, and modalities.

    “One benefit of this is that people can flexibly recover information generalizing across other stories, subjects, and modalities (Baldassano et al., 2017).”

    From Stories in Action. (2022) · cites this paper as Baldassano et al., 2017

    The Results sections on free recall and shared event structure across modalities report reinstatement of event patterns during recall and similar patterns across different subjects viewing or hearing the same narrative (page not available). The paper does not show people recovering information that generalizes across other stories; its cross-modal comparison concerns different versions of the same story. (LLM, conf=0.88)

    Experimental — accuracy not yet measured
  • Brains acquire especially powerful predictive modeling abilities when they are organized according to multiple layers of hierarchical depth.

    “Brains acquire especially powerful predictive modeling abilities when they are organized according to multiple layers of hierarchical depth.”

    From An Integrated World Modeling Theory (IWMT) of Consciousness (2020) · cites this paper as Baldassano et al., 2017

    The Introduction reports that experiences are hierarchically chunked across multiple timescales. The Results section on anticipatory reinstatement finds that people familiar with a narrative represented upcoming events in some higher-order regions. The paper does not establish that hierarchical organization causes brains to acquire especially powerful predictive modeling abilities, or compare those abilities with a less hierarchical organization. (LLM, conf=0.85)

    Experimental — accuracy not yet measured
  • According to Event Segmentation Theory, humans naturally perceive continuous experience as a series of discrete and meaningful events.

    “According to this theory, humans naturally perceive continuous experience as a series of discrete and meaningful events.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Human-annotation match uses conflicting denominators

    Minor

    The methods define this match as the fraction of consensus boundaries near a regional boundary, because the consensus is the upper level. The results instead describe the fraction of regional boundaries near a consensus boundary. Those fractions need not be equal when several boundaries fall within the matching window.

1 of 1

Cites

Flagged first, then by citations

3 of the 85 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Baldassano, C., Chen, J., Zadbood, A., Pillow, J. W., Hasson, U., & Norman, K. A.
Affiliations
  • Princeton University (US)
  • Johns Hopkins University (US)
Corresponding author
Baldassano, Christopher
Venue
Neuron
Publisher
Elsevier BV
Published
2017-08
Volume
95
Issue
3
Pages
709-721.e5
ISSN
0896-6273 (ISSN-L)
OpenAlex
W2537240939
Cited by
952
References
85
Citations by year
2026: 124 · 2025: 155 · 2024: 139 · 2023: 105 · 2022: 98 · 2021: 108 · 2020: 86 · 2019: 69 · 2018: 44 · 2017: 21 · 2016: 1
FWCI
34.54
Type
journal article
Language
en
Open access
Locations
  • Neuron (publishedVersion)
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
  • PubMed (publishedVersion)
  • Europe PMC (PubMed Central) (acceptedVersion)
  • PubMed Central (acceptedVersion)
Funders
  • Intel Labs
  • The National Institutes of Health (R01 MH112357-01, R01-MH094480, 2T32MH065214-11)
  • McKnight Foundation
  • NSF CAREER Award (IIS-1150186)
  • Simons Collaboration on the Global Brain (SCGB AWD1004351)
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
Keywords
event segmentation, narrative perception, event memory, event boundaries, situation model, hippocampal activity, free recall, angular gyrus, posterior medial cortex, long-term memory
MeSH terms
Adolescent, Adult, Brain Mapping, Female, Hippocampus, Humans, Image Processing, Computer-Assisted, Magnetic Resonance Imaging, Male, Memory, Mental Recall, Visual Perception, Young Adult

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read under definition version 3 (extract-v3) on 2026-09-28.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-09-28.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review