A partially nested cortical hierarchy of neural states underlies event segmentation in the human brain
Open accessPublished version of a preprint
Abstract
A fundamental aspect of human experience is that it is segmented into discrete events. This may be underpinned by transitions between distinct neural states. Using an innovative data-driven state segmentation method, we investigate how neural states are organized across the cortical hierarchy and where in the cortex neural state boundaries and perceived event boundaries overlap. Our results show that neural state boundaries are organized in a temporal cortical hierarchy, with short states in primary sensory regions, and long states in lateral and medial prefrontal cortex. State boundaries are shared within and between groups of brain regions that resemble well-known functional networks. Perceived event boundaries overlap with neural state boundaries across large parts of the cortical hierarchy, particularly when those state boundaries demarcate a strong transition or are shared between brain regions. Taken together, these findings suggest that a partially nested cortical hierarchy of neural states forms the basis of event segmentation.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Cognitive neuroscience indicates that the brain does not encode information uniformly; instead, it privileges event boundaries.
“Cognitive neuroscience indicates that the brain does not encode information uniformly. Instead, it privileges event boundaries [3, 16].”
From HingeMem: Boundary Guided Long-Term Memory with Query Adaptive Retrieval for Scalable Dialogues (2026) · cites this paper as [16]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
The citation lists haven’t been fetched yet
References 94 · Cited by 78
Research works printed but not linked: 75
- Aicher C Jacobs AZ Clauset A 2015 Learning latent block structure in weighted networks Journal of Complex Networks 3 221 248 10.1093/comnet/cnu026 · DOI
- Andermane N Joensen BH Horner AJ 2021 Forgetting across a hierarchy of episodic representations Current Opinion in Neurobiology 67 50 57 10.1016/j.conb.2020.08.004 32882596 · DOI
- Baldassano C Hasson U Norman KA 2018 Representation of real-world event schemas during narrative perception The Journal of Neuroscience 38 9689 9699 10.1523/JNEUROSCI.0251-18.2018 30249790 PMC6222059 · DOI
- Baron-Cohen S 2000 Theory of mind and autism: a review International Review of Research in Mental Retardation 23 169 184 10.1016/S0074-7750(00)80010-5 · DOI
- Bassett DS Porter MA Wymbs NF Grafton ST Carlson JM Mucha PJ 2013 Robust detection of dynamic community structure in networks Chaos 23 013142 10.1063/1.4790830 23556979 PMC3618100 · DOI · Paper page
- Ben-Yakov A Henson RN 2018 The hippocampal film editor: sensitivity and specificity to event boundaries in continuous experience The Journal of Neuroscience 38 10057 10068 10.1523/JNEUROSCI.0524-18.2018 30301758 PMC6246887 · DOI
- Benjamini Y Hochberg Y 2000 Controlling the false discovery rate: a practical and powerful approach to multiple testing Journal of the Royal Statistical Society 57 289 300 10.1111/j.2517-6161.1995.tb02031.x · DOI · Paper page
- Benoit RG Szpunar KK Schacter DL 2014 Ventromedial prefrontal cortex supports affective future simulation by integrating distributed knowledge PNAS 111 16550 16555 10.1073/pnas.1419274111 25368170 PMC4246308 · DOI · Paper page
- Blondel VD Guillaume JL Lambiotte R Lefebvre E 2008 Fast unfolding of communities in large networks Journal of Statistical Mechanics 2008 10008 10.1088/1742-5468/2008/10/P10008 · DOI · Paper page
- Bromis K Raykov PP Wickens L Roseboom W Bird CM 2022 The neural representation of events is dominated by elements that are most reliably present Journal of Cognitive Neuroscience 34 517 531 10.1162/jocn_a_01802 34942648 · DOI
- Buschman TJ Miller EK 2007 Top-Down versus bottom-up control of attention in the prefrontal and posterior parietal cortices Science 315 1860 1862 10.1126/science.1138071 17395832 · DOI · Paper page
- Campbell KL Grigg O Saverino C Churchill N Grady CL 2013 Age differences in the intrinsic functional connectivity of default network subsystems Frontiers in Aging Neuroscience 5 1 12 10.3389/fnagi.2013.00073 24294203 PMC3827623 · DOI
- Campbell KL Shafto MA Wright P Tsvetanov KA Geerligs L Cusack R Tyler LK Cam-CAN 2015 Idiosyncratic responding during movie-watching predicted by age differences in attentional control Neurobiology of Aging 36 3045 3055 10.1016/j.neurobiolaging.2015.07.028 26359527 PMC4706158 · DOI
- Chien HYS Honey CJ 2020 Constructing and forgetting temporal context in the human cerebral cortex Neuron 106 675 686 10.1016/j.neuron.2020.02.013 32164874 PMC7244383 · DOI
- Clarke A Tyler LK 2015 Understanding what we see: how we derive meaning from vision Trends in Cognitive Sciences 19 677 687 10.1016/j.tics.2015.08.008 26440124 PMC4636429 · DOI
- Clewett D DuBrow S Davachi L 2019 Transcending time in the brain: how event memories are constructed from experience Hippocampus 29 162 183 10.1002/hipo.23074 30734391 PMC6629464 · DOI
- Cox RW 1996 AFNI: software for analysis and visualization of functional magnetic resonance NeuroImages Computers and Biomedical Research, an International Journal 29 162 173 10.1006/cbmr.1996.0014 8812068 · DOI · Paper page
- Davis EE Chemnitz E Collins TK Geerligs L Campbell KL 2021 Looking the same, but remembering differently: preserved eye-movement synchrony with age during movie watching Psychology and Aging 36 604 615 10.1037/pag0000615 34291964 · DOI
- Desikan RS Ségonne F Fischl B Quinn BT Dickerson BC Blacker D Buckner RL Dale AM Maguire RP Hyman BT Albert MS Killiany RJ 2006 An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest NeuroImage 31 968 980 10.1016/j.neuroimage.2006.01.021 16530430 · DOI · Paper page
- DiCarlo JJ Cox DD 2007 Untangling invariant object recognition Trends in Cognitive Sciences 11 333 341 10.1016/j.tics.2007.06.010 17631409 · DOI
- Duncan J 2010 The multiple-demand (MD) system of the primate brain: mental programs for intelligent behaviour Trends in Cognitive Sciences 14 172 179 10.1016/j.tics.2010.01.004 20171926 · DOI · Paper page
- Flores S Bailey HR Eisenberg ML Zacks JM 2017 Event segmentation improves event memory up to one month later Journal of Experimental Psychology. Learning, Memory, and Cognition 43 1183 1202 10.1037/xlm0000367 28383955 PMC5542882 · DOI
- Fuster JM 2001 The prefrontal cortex -- an update: time is of the essence Neuron 30 319 333 10.1016/s0896-6273(01)00285-9 11394996 · DOI
- Geerligs L Campbell KL 2018 Age-Related differences in information processing during movie watching Neurobiology of Aging 72 106 120 10.1016/j.neurobiolaging.2018.07.025 30243125 · DOI
- Geerligs L van Gerven M Güçlü U 2021 Detecting neural state transitions underlying event segmentation NeuroImage 236 118085 10.1016/j.neuroimage.2021.118085 33882350 · DOI
- Gilboa A Marlatte H 2017 Neurobiology of schemas and schema-mediated memory Trends in Cognitive Sciences 21 618 631 10.1016/j.tics.2017.04.013 28551107 · DOI · Paper page
- Gordon EM Laumann TO Marek S Raut RV Gratton C Newbold DJ Greene DJ Coalson RS Snyder AZ Schlaggar BL Petersen SE Dosenbach NUF Nelson SM 2020 Default-Mode network streams for coupling to language and control systems PNAS 117 17308 17319 10.1073/pnas.2005238117 32632019 PMC7382234 · DOI
- Gregoriou GG Gotts SJ Zhou H Desimone R 2009 High-Frequency, long-range coupling between prefrontal and visual cortex during attention Science 324 1207 1210 10.1126/science.1171402 19478185 PMC2849291 · DOI · Paper page
- Guntupalli JS Hanke M Halchenko YO Connolly AC Ramadge PJ Haxby JV 2016 A model of representational spaces in human cortex Cerebral Cortex 26 2919 2934 10.1093/cercor/bhw068 26980615 PMC4869822 · DOI
- Hamilton LS Huth AG 2020 The revolution will not be controlled: natural stimuli in speech neuroscience Language, Cognition and Neuroscience 35 573 582 10.1080/23273798.2018.1499946 32656294 PMC7324135 · DOI
- Hanke M Halchenko YO Sederberg PB Hanson SJ Haxby JV Pollmann S 2009 PyMVPA: a python toolbox for multivariate pattern analysis of fMRI data Neuroinformatics 7 37 53 10.1007/s12021-008-9041-y 19184561 PMC2664559 · DOI
- Hasson Uri Yang E Vallines I Heeger DJ Rubin N 2008 A hierarchy of temporal receptive windows in human cortex The Journal of Neuroscience 28 2539 2550 10.1523/JNEUROSCI.5487-07.2008 18322098 PMC2556707 · DOI · Paper page
- Hasson U Avidan G Gelbard H Vallines I Harel M Minshew N Behrmann M 2009 Shared and idiosyncratic cortical activation patterns in autism revealed under continuous real-life viewing conditions Autism Research 2 220 231 10.1002/aur.89 19708061 PMC2775929 · DOI
- Hasson U Chen J Honey CJ 2015 Hierarchical process memory: memory as an integral component of information processing Trends in Cognitive Sciences 19 304 313 10.1016/j.tics.2015.04.006 25980649 PMC4457571 · DOI · Paper page
- Holroyd CB Coles MGH 2002 The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity Psychological Review 109 679 709 10.1037/0033-295X.109.4.679 12374324 · DOI · Paper page
- Krueger F Barbey AK Grafman J 2009 The medial prefrontal cortex mediates social event knowledge Trends in Cognitive Sciences 13 103 109 10.1016/j.tics.2008.12.005 19223228 · DOI
- Kundu P Inati SJ Evans JW Luh WM Bandettini PA 2012 Differentiating BOLD and non-BOLD signals in fMRI time series using multi-echo EPI NeuroImage 60 1759 1770 10.1016/j.neuroimage.2011.12.028 22209809 PMC3350785 · DOI
- Kundu P Brenowitz ND Voon V Worbe Y Vértes PE Inati SJ Saad ZS Bandettini PA Bullmore ET 2013 Integrated strategy for improving functional connectivity mapping using multiecho fMRI PNAS 110 16187 16192 10.1073/pnas.1301725110 24038744 PMC3791700 · DOI · Paper page
- Kurby CA Zacks JM 2008 Segmentation in the perception and memory of events Trends in Cognitive Sciences 12 72 79 10.1016/j.tics.2007.11.004 18178125 PMC2263140 · DOI · Paper page
- Kurby CA Zacks JM 2018 Preserved neural event segmentation in healthy older adults Psychology and Aging 33 232 245 10.1037/pag0000226 29446971 PMC8577268 · DOI
- Lambon Ralph MA Sage K Jones RW Mayberry EJ 2010 Coherent concepts are computed in the anterior temporal lobes PNAS 107 2717 2722 10.1073/pnas.0907307107 20133780 PMC2823909 · DOI
- Lancichinetti A Fortunato S 2012 Consensus clustering in complex networks Scientific Reports 2 336 10.1038/srep00336 22468223 PMC3313482 · DOI
- Lee H Bellana B Chen J 2020 What can narratives tell us about the neural bases of human memory? Current Opinion in Behavioral Sciences 32 111 119 10.1016/j.cobeha.2020.02.007 · DOI
- Lei X Wang Y Yuan H Mantini D 2014 Neuronal oscillations and functional interactions between resting state networks Human Brain Mapping 35 3517 3528 10.1002/hbm.22418 25050432 PMC6869195 · DOI
- Liu W Shi Y Cousins JN Kohn N Fernández G 2022 Hippocampal-medial prefrontal event segmentation and integration contribute to episodic memory formation Cerebral Cortex 32 949 969 10.1093/cercor/bhab258 34398213 · DOI
- Lu KH Hung SC Wen H Marussich L Liu Z 2016 Influences of high-level features, gaze, and scene transitions on the reliability of BOLD responses to natural movie stimuli PLOS ONE 11 e0161797 10.1371/journal.pone.0161797 27564573 PMC5001718 · DOI
- Newtson D Rindner RJ 1979 Variation in behavior perception and ability Attribution Journal of Personality and Social Psychology 37 1847 1858 10.1037/0022-3514.37.10.1847 · DOI
- Pettijohn KA Radvansky GA 2016 Narrative event boundaries, reading times, and expectation Memory & Cognition 44 1064 1075 10.3758/s13421-016-0619-6 27170375 · DOI
- Ranganath C Ritchey M 2012 Two cortical systems for memory-guided behaviour Nature Reviews. Neuroscience 13 713 726 10.1038/nrn3338 22992647 · DOI · Paper page
- Reichardt J Bornholdt S 2006 Statistical mechanics of community detection Physical Review. E, Statistical, Nonlinear, and Soft Matter Physics 74 016110 10.1103/PhysRevE.74.016110 16907154 · DOI · Paper page
- Rogers TT Lambon Ralph MA Garrard P Bozeat S McClelland JL Hodges JR Patterson K 2004 Structure and deterioration of semantic memory: a neuropsychological and computational investigation Psychological Review 111 205 235 10.1037/0033-295X.111.1.205 14756594 · DOI · Paper page
- Rubinov M Sporns O 2010 Complex network measures of brain connectivity: uses and interpretations NeuroImage 52 1059 1069 10.1016/j.neuroimage.2009.10.003 19819337 · DOI · Paper page
- Rubinov M Sporns O 2011 Weight-conserving characterization of complex functional brain networks NeuroImage 56 2068 2079 10.1016/j.neuroimage.2011.03.069 21459148 · DOI
- Sargent JQ Zacks JM Hambrick DZ Zacks RT Kurby CA Bailey HR Eisenberg ML Beck TM 2013 Event segmentation ability uniquely predicts event memory Cognition 129 241 255 10.1016/j.cognition.2013.07.002 23942350 PMC3821069 · DOI · Paper page
- Shafto MA Tyler LK Dixon M Taylor JR Rowe JB Cusack R Calder AJ Marslen-Wilson WD Duncan J Dalgleish T Henson RN Brayne C Matthews FE Cam-CAN 2014 The Cambridge centre for ageing and neuroscience (cam-CAN) study protocol: a cross-sectional, lifespan, multidisciplinary examination of healthy cognitive ageing BMC Neurology 14 204 10.1186/s12883-014-0204-1 25412575 PMC4219118 · DOI
- Shin YS DuBrow S 2021 Structuring memory through inference-based event segmentation Topics in Cognitive Science 13 106 127 10.1111/tops.12505 32459391 · DOI
- Son J Ai L Lim R Xu T Colcombe S Franco AR Cloud J LaConte S Lisinski J Klein A Craddock RC Milham M 2020 Evaluating fmri-based estimation of eye gaze during naturalistic viewing Cerebral Cortex 30 1171 1184 10.1093/cercor/bhz157 31595961 PMC7132907 · DOI
- Sun Y Danila B Josić K Bassler KE 2009 Improved community structure detection using a modified fine-tuning strategy Europhysics Letters 86 28004 10.1209/0295-5075/86/28004 · DOI
- Taylor JR Williams N Cusack R Auer T Shafto MA Dixon M Tyler LK Henson RN Cam-Can 2017 The Cambridge centre for ageing and neuroscience (cam-CAN) data Repository: structural and functional MRI, MEG, and cognitive data from a cross-sectional adult lifespan sample NeuroImage 144 262 269 10.1016/j.neuroimage.2015.09.018 26375206 PMC5182075 · DOI
- Taylor AJ Kim JH Ress D 2018 Characterization of the hemodynamic response function across the majority of human cerebral cortex NeuroImage 173 322 331 10.1016/j.neuroimage.2018.02.061 29501554 PMC5911213 · DOI
- Van Essen DC Drury HA Dickson J Harwell J Hanlon D Anderson CH 2001 An integrated software suite for surface-based analyses of cerebral cortex Journal of the American Medical Informatics Association 8 443 459 10.1136/jamia.2001.0080443 11522765 PMC131042 · DOI
- van Kesteren MTR Ruiter DJ Fernández G Henson RN 2012 How schema and novelty augment memory formation Trends in Neurosciences 35 211 219 10.1016/j.tins.2012.02.001 22398180 · DOI · Paper page
- Vernet M Quentin R Chanes L Mitsumasu A Valero-Cabré A 2014 Frontal eye field, where art thou? anatomy, function, and non-invasive manipulation of frontal regions involved in eye movements and associated cognitive operations Frontiers in Integrative Neuroscience 8 8 10.3389/fnint.2014.00066 25202241 PMC4141567 · DOI
- Wen T Duncan J Mitchell DJ 2020 Hierarchical representation of multistep tasks in multiple-demand and default mode networks The Journal of Neuroscience 40 7724 7738 10.1523/JNEUROSCI.0594-20.2020 32868460 PMC7531550 · DOI
- Wilcoxon F 1945 Individual comparisons by ranking methods Biometrics Bulletin 1 80 83 10.2307/3001968 · DOI · Paper page
- Willems RM Nastase SA Milivojevic B 2020 Narratives for neuroscience Trends in Neurosciences 43 271 273 10.1016/j.tins.2020.03.003 32353331 · DOI
- Wu GR Colenbier N Van Den Bossche S Clauw K Johri A Tandon M Marinazzo D 2021 RsHRF: a toolbox for resting-state HRF estimation and deconvolution NeuroImage 244 118591 10.1016/j.neuroimage.2021.118591 34560269 · DOI
- Xuan Vinh N Epps J Bailey J 2010 Information theoretic measures for clusterings comparison: variants, properties, normalization and correction for chance Journal of Machine Learning Research: JMLR 11 2837 2854 10.5555/1756006.1953024 · DOI
- Yeo BTT Krienen FM Sepulcre J Sabuncu MR Lashkari D Hollinshead M Roffman JL Smoller JW Zöllei L Polimeni JR Fischl B Liu H Buckner RL 2011 The organization of the human cerebral cortex estimated by intrinsic functional connectivity Journal of Neurophysiology 106 1125 1165 10.1152/jn.00338.2011 21653723 PMC3174820 · DOI · Paper page
- Zacks JM Braver TS Sheridan MA Donaldson DI Snyder AZ Ollinger JM Buckner RL Raichle ME 2001a Human brain activity time-locked to perceptual event boundaries Nature Neuroscience 4 651 655 10.1038/88486 11369948 · DOI · Paper page
- Zacks JM Tversky B Iyer G 2001b Perceiving, remembering, and communicating structure in events Journal of Experimental Psychology. General 130 29 58 10.1037/0096-3445.130.1.29 11293458 · DOI · Paper page
- Zacks JM Speer NK Vettel JM Jacoby LL 2006 Event understanding and memory in healthy aging and dementia of the Alzheimer type Psychology and Aging 21 466 482 10.1037/0882-7974.21.3.466 16953710 · DOI
- Zacks JM Speer NK Swallow KM Braver TS Reynolds JR 2007 Event perception: a mind-brain perspective Psychological Bulletin 133 273 293 10.1037/0033-2909.133.2.273 17338600 PMC2852534 · DOI · Paper page
- Zacks JM Speer NK Reynolds JR 2009 Segmentation in reading and film comprehension Journal of Experimental Psychology. General 138 307 327 10.1037/a0015305 19397386 PMC8710938 · DOI
- Zacks JM Speer NK Swallow KM Maley CJ 2010 The brain ’ S cutting-room floor: segmentation of narrative cinema Frontiers in Human Neuroscience 4 1 15 10.3389/fnhum.2010.00168 20953234 PMC2955413 · DOI
- Authors
- Geerligs, L., Gözükara, D., Oetringer, D., Campbell, K. L., van Gerven, M., & Güçlü, U.
- Affiliations
- Radboud University Nijmegen (NL)
- Brock University (CA)
- Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen
- Corresponding author
- Geerligs, Linda
- Venue
- eLife
- Publisher
- eLife Sciences Publications, Ltd
- Published
- 2022-09-16
- Volume
- 11
- ISSN
- 2050-084X (ISSN-L)
- PMC
- PMC9531941
- OpenAlex
- W4296027313
- Cited by
- 78
- References
- 94
- Citations by year
- 2026: 15 · 2025: 24 · 2024: 19 · 2023: 11 · 2022: 9
- FWCI
- 8.12
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- eLife (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Radboud Repository (Radboud University) (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- Funders
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (VI.Vidi.201.150)
- Natural Sciences and Engineering Research Council of Canada (RGPIN-2017-03804)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
- Life Sciences › Neuroscience › Cognitive Neuroscience › Functional Brain Connectivity Studies
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- Keywords
- event segmentation, neural states, cortical hierarchy, state boundaries, prefrontal cortex, functional networks, sensory cortex, neural state transitions
- MeSH terms
- Brain, Brain Mapping, Humans, Magnetic Resonance Imaging
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review