CoChat

The “Narratives” fMRI dataset for evaluating models of naturalistic language comprehension

Open access
Nastase, Samuel A., Liu, Yun-Fei, Hillman, Hanna, Zadbood, Asieh, Hasenfratz, Liat, Keshavarzian, Neggin, Chen, Janice, Honey, Christopher J., Yeshurun, Yaara, Regev, Mor, Nguyen, Mai, Chang, Claire H. C., Baldassano, Christopher, Lositsky, Olga, Simony, Erez, Chow, Michael A., Leong, Yuan Chang, Brooks, Paula P., Micciche, Emily, Choe, Gina, Goldstein, Ariel, Vanderwal, Tamara, Halchenko, Yaroslav O., Norman, Kenneth A., Hasson, Uri · 2021 · Scientific Data
Cited by 148

The DOI matches its Crossref record; 75 of the 75 references it cites were found in a registry or an index.

Abstract

The “Narratives” collection aggregates a variety of functional MRI datasets collected while human subjects listened to naturalistic spoken stories. The current release includes 345 subjects, 891 functional scans, and 27 diverse stories of varying duration totaling ~4.6 hours of unique stimuli (~43,000 words). This data collection is well-suited for naturalistic neuroimaging analysis, and is intended to serve as a benchmark for models of language and narrative comprehension. We provide standardized MRI data accompanied by rich metadata, preprocessed versions of the data ready for immediate use, and the spoken story stimuli with time-stamped phoneme- and word-level transcripts. All code and data are publicly available with full provenance in keeping with current best practices in transparent and reproducible neuroimaging.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41597-021-01033-3

Cites

75 of 75 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 75 references

Research works printed but not linked: 152

  1. Bolhuis, J. J., Beckers, G. J. L., Huybregts, M. A. C., Berwick, R. C. & Everaert, M. B. H. Meaningful syntactic structure in songbird vocalizations? PLoS Biol. 16, e2005157 (2018). · DOI
  2. Townsend, S. W., Engesser, S., Stoll, S., Zuberbühler, K. & Bickel, B. Compositionality in animals and humans. PLoS Biol. 16, e2006425 (2018). · DOI
  3. Hamilton, L. S. & Huth, A. G. The revolution will not be controlled: natural stimuli in speech neuroscience. Lang. Cogn. Neurosci. 35, 573–582 (2020). · DOI · Paper page
  4. Willems, R. M., Nastase, S. A. & Milivojevic, B. Narratives for neuroscience. Trends Neurosci. 43, 271–273 (2020). · DOI · Paper page
  5. Bookheimer, S. Functional MRI of language: new approaches to understanding the cortical organization of semantic processing. Annu. Rev. Neurosci. 25, 151–188 (2002). · DOI · Paper page
  6. Price, C. J. A review and synthesis of the first 20 years of PET and fMRI studies of heard speech, spoken language and reading. Neuroimage 62, 816–847 (2012). · DOI · Paper page
  7. Friederici, A. D. The brain basis of language processing: from structure to function. Physiol. Rev. 91, 1357–1392 (2011). · DOI · Paper page
  8. Démonet, J. F. et al. The anatomy of phonological and semantic processing in normal subjects. Brain 115, 1753–1768 (1992). · DOI · Paper page
  9. Belin, P., Zatorre, R. J., Lafaille, P., Ahad, P. & Pike, B. Voice-selective areas in human auditory cortex. Nature 403, 309–312 (2000). · DOI · Paper page
  10. Vouloumanos, A., Kiehl, K. A., Werker, J. F. & Liddle, P. F. Detection of sounds in the auditory stream: event-related fMRI evidence for differential activation to speech and nonspeech. J. Cogn. Neurosci. 13, 994–1005 (2001). · DOI · Paper page
  11. Ben-Shachar, M., Hendler, T., Kahn, I., Ben-Bashat, D. & Grodzinsky, Y. The neural reality of syntactic transformations: evidence from functional magnetic resonance imaging. Psychol. Sci. 14, 433–440 (2003). · DOI · Paper page
  12. Noppeney, U. & Price, C. J. An FMRI study of syntactic adaptation. J. Cogn. Neurosci. 16, 702–713 (2004). · DOI · Paper page
  13. Binder, J. R., Desai, R. H., Graves, W. W. & Conant, L. L. Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. Cereb. Cortex 19, 2767–2796 (2009). · DOI · Paper page
  14. Mahowald, K. & Fedorenko, E. Reliable individual-level neural markers of high-level language processing: a necessary precursor for relating neural variability to behavioral and genetic variability. Neuroimage 139, 74–93 (2016). · DOI · Paper page
  15. Braga, R. M., DiNicola, L. M., Becker, H. C. & Buckner, R. L. Situating the left-lateralized language network in the broader organization of multiple specialized large-scale distributed networks. J. Neurophysiol. 124, 1415–1448 (2020). · DOI · Paper page
  16. Jäncke, L., Wüstenberg, T., Scheich, H. & Heinze, H.-J. Phonetic perception and the temporal cortex. Neuroimage 15, 733–746 (2002). · DOI · Paper page
  17. Obleser, J., Zimmermann, J., Van Meter, J. & Rauschecker, J. P. Multiple stages of auditory speech perception reflected in event-related FMRI. Cereb. Cortex 17, 2251–2257 (2007). · DOI · Paper page
  18. Wise, R. et al. Distribution of cortical neural networks involved in word comprehension and word retrieval. Brain 114, 1803–1817 (1991). · DOI · Paper page
  19. Just, M. A., Carpenter, P. A., Keller, T. A., Eddy, W. F. & Thulborn, K. R. Brain activation modulated by sentence comprehension. Science 274, 114–116 (1996). · DOI · Paper page
  20. Kuperberg, G. R. et al. Common and distinct neural substrates for pragmatic, semantic, and syntactic processing of spoken sentences: an fMRI study. J. Cogn. Neurosci. 12, 321–341 (2000). · DOI · Paper page
  21. Ni, W. et al. An event-related neuroimaging study distinguishing form and content in sentence processing. J. Cogn. Neurosci. 12, 120–133 (2000). · DOI · Paper page
  22. Scott, S. K., Blank, C. C., Rosen, S. & Wise, R. J. Identification of a pathway for intelligible speech in the left temporal lobe. Brain 123, 2400–2406 (2000). · DOI · Paper page
  23. Vandenberghe, R., Nobre, A. C. & Price, C. J. The response of left temporal cortex to sentences. J. Cogn. Neurosci. 14, 550–560 (2002). · DOI · Paper page
  24. Humphries, C., Binder, J. R., Medler, D. A. & Liebenthal, E. Syntactic and semantic modulation of neural activity during auditory sentence comprehension. J. Cogn. Neurosci. 18, 665–679 (2006). · DOI · Paper page
  25. Yarkoni, T., Speer, N. K. & Zacks, J. M. Neural substrates of narrative comprehension and memory. NeuroImage 41, 1408–1425 (2008). · DOI · Paper page
  26. Brennan, J. R., Stabler, E. P., Van Wagenen, S. E., Luh, W.-M. & Hale, J. T. Abstract linguistic structure correlates with temporal activity during naturalistic comprehension. Brain Lang. 157–158, 81–94 (2016). · DOI · Paper page
  27. Nastase, S. A., Goldstein, A. & Hasson, U. Keep it real: rethinking the primacy of experimental control in cognitive neuroscience. Neuroimage 222, 117254 (2020). · DOI · Paper page
  28. Wehbe, L. et al. Simultaneously uncovering the patterns of brain regions involved in different story reading subprocesses. PLoS One 9, e112575 (2014). · DOI · Paper page
  29. Baroni, M. Linguistic generalization and compositionality in modern artificial neural networks. Philos. Trans. R. Soc. Lond. B Biol. Sci. 375, 20190307 (2020). · DOI · Paper page
  30. Turney, P. D. & Pantel, P. From frequency to meaning: vector space models of semantics. J. Artif. Intell. Res. 37, 141–188 (2010). · DOI · Paper page
  31. Mikolov, T., Sutskever, I., Chen, K., Corrado, G. S. & Dean, J. Distributed representations of words and phrases and their compositionality. in Advances in Neural Information Processing Systems 26 (eds. Burges, C. J. C., Bottou, L., Welling, M., Ghahramani, Z. & Weinberger, K. Q.) 3111–3119 (Curran Associates, Inc., 2013).
  32. Manning, C. D., Clark, K., Hewitt, J., Khandelwal, U. & Levy, O. Emergent linguistic structure in artificial neural networks trained by self-supervision. Proc. Natl. Acad. Sci. USA 117, 30046–30054 (2020). · DOI · Paper page
  33. Yarkoni, T. & Westfall, J. Choosing prediction over explanation in psychology: lessons from machine learning. Perspect. Psychol. Sci. 12, 1100–1122 (2017). · DOI · Paper page
  34. Varoquaux, G. & Poldrack, R. A. Predictive models avoid excessive reductionism in cognitive neuroimaging. Curr. Opin. Neurobiol. 55, 1–6 (2019). · DOI
  35. Milham, M. P. et al. Assessment of the impact of shared brain imaging data on the scientific literature. Nat. Commun. 9, 2818 (2018). · DOI · Paper page
  36. Shafto, M. A. et al. The Cambridge Centre for Ageing and Neuroscience (Cam-CAN) study protocol: a cross-sectional, lifespan, multidisciplinary examination of healthy cognitive ageing. BMC Neurol. 14, 204 (2014). · DOI · Paper page
  37. Taylor, J. R. et al. The Cambridge Centre for Ageing and Neuroscience (Cam-CAN) data repository: structural and functional MRI, MEG, and cognitive data from a cross-sectional adult lifespan sample. Neuroimage 144, 262–269 (2017). · DOI · Paper page
  38. Alexander, L. M. et al. An open resource for transdiagnostic research in pediatric mental health and learning disorders. Sci Data 4, 170181 (2017). · DOI · Paper page
  39. Poldrack, R. A. & Gorgolewski, K. J. Making big data open: data sharing in neuroimaging. Nat. Neurosci. 17, 1510–1517 (2014). · DOI · Paper page
  40. Poldrack, R. A., Gorgolewski, K. J. & Varoquaux, G. Computational and informatic advances for reproducible data analysis in neuroimaging. Annu. Rev. Biomed. Data Sci. 2, 119–138 (2019). · DOI
  41. Ferguson, A. R., Nielson, J. L., Cragin, M. H., Bandrowski, A. E. & Martone, M. E. Big data from small data: data-sharing in the ‘long tail’ of neuroscience. Nat. Neurosci. 17, 1442–1447 (2014). · DOI · Paper page
  42. Hanke, M. et al. A high-resolution 7-Tesla fMRI dataset from complex natural stimulation with an audio movie. Sci Data 1, 140003 (2014). · DOI · Paper page
  43. Hanke, M. et al. A studyforrest extension, simultaneous fMRI and eye gaze recordings during prolonged natural stimulation. Sci Data 3, 160092 (2016). · DOI
  44. Aly, M., Chen, J., Turk-Browne, N. B. & Hasson, U. Learning naturalistic temporal structure in the posterior medial network. J. Cogn. Neurosci. 30, 1345–1365 (2018). · DOI
  45. DuPre, E., Hanke, M. & Poline, J.-B. Nature abhors a paywall: how open science can realize the potential of naturalistic stimuli. Neuroimage 216, 116330 (2020). · DOI
  46. Aliko, S., Huang, J., Gheorghiu, F. & Meliss, S. & Skipper, J. I. A naturalistic neuroimaging database for understanding the brain using ecological stimuli. Sci Data 7, 347 (2020). · DOI
  47. Richardson, H., Lisandrelli, G., Riobueno-Naylor, A. & Saxe, R. Development of the social brain from age three to twelve years. Nat. Commun. 9, 1027 (2018). · DOI · Paper page
  48. Finn, E. S., Corlett, P. R., Chen, G., Bandettini, P. A. & Constable, R. T. Trait paranoia shapes inter-subject synchrony in brain activity during an ambiguous social narrative. Nat. Commun. 9, 2043 (2018). · DOI · Paper page
  49. O’Connor, D. et al. The Healthy Brain Network Serial Scanning Initiative: a resource for evaluating inter-individual differences and their reliabilities across scan conditions and sessions. GigaScience 6, 1–14 (2017). · DOI · Paper page
  50. Haxby, J. V. et al. A common, high-dimensional model of the representational space in human ventral temporal cortex. Neuron 72, 404–416 (2011). · DOI · Paper page
  51. Nastase, S. A. et al. Attention Selectively Reshapes the Geometry of Distributed Semantic Representation. Cereb. Cortex 27, 4277–4291 (2017). · DOI
  52. Nastase, S. A., Halchenko, Y. O., Connolly, A. C., Gobbini, M. I. & Haxby, J. V. Neural responses to naturalistic clips of behaving animals in two different task contexts. Front. Neurosci. 12, 316 (2018). · DOI
  53. Castello, M. V. di O., di Oleggio Castello, M. V., Chauhan, V., Jiahui, G. & Ida Gobbini, M. An fMRI dataset in response to ‘The Grand Budapest Hotel’, a socially-rich, naturalistic movie. Scientific Data vol. 7 (2020). · DOI
  54. Nastase, S. A. et al. Narratives. OpenNeuro https://doi.org/10.18112/openneuro.ds002345.v1.1.4 (2019). · DOI
  55. Poldrack, R. A. & Gorgolewski, K. J. OpenfMRI: Open sharing of task fMRI data. Neuroimage 144, 259–261 (2017). · DOI · Paper page
  56. Hanke, M. et al. In defense of decentralized research data management. Neuroforum 27, 17–25 (2021).
  57. Spiers, H. J. & Maguire, E. A. Decoding human brain activity during real-world experiences. Trends Cogn. Sci. 11, 356–365 (2007). · DOI
  58. Hasson, U. & Honey, C. J. Future trends in neuroimaging: neural processes as expressed within real-life contexts. Neuroimage 62, 1272–1278 (2012). · DOI · Paper page
  59. Matusz, P. J., Dikker, S., Huth, A. G. & Perrodin, C. Are we ready for real-world neuroscience? J. Cogn. Neurosci. 31, 327–338 (2019). · DOI · Paper page
  60. Sonkusare, S., Breakspear, M. & Guo, C. Naturalistic stimuli in neuroscience: critically acclaimed. Trends Cogn. Sci. 23, 699–714 (2019). · DOI · Paper page
  61. Redcay, E. & Moraczewski, D. Social cognition in context: a naturalistic imaging approach. Neuroimage 216, 116392 (2020). · DOI
  62. Vanderwal, T., Eilbott, J. & Castellanos, F. X. Movies in the magnet: naturalistic paradigms in developmental functional neuroimaging. Dev. Cogn. Neurosci. 36, 100600 (2018). · DOI · Paper page
  63. Naselaris, T., Kay, K. N., Nishimoto, S. & Gallant, J. L. Encoding and decoding in fMRI. Neuroimage 56, 400–410 (2011). · DOI · Paper page
  64. Santoro, R. et al. Encoding of natural sounds at multiple spectral and temporal resolutions in the human auditory cortex. PLoS Comput. Biol. 10, e1003412 (2014). · DOI · Paper page
  65. de Heer, W. A., Huth, A. G., Griffiths, T. L., Gallant, J. L. & Theunissen, F. E. The hierarchical cortical organization of human speech processing. J. Neurosci. 37, 6539–6557 (2017). · DOI · Paper page
  66. Schrimpf, M. et al. The neural architecture of language: integrative reverse-engineering converges on a model for predictive processing. Preprint at https://doi.org/10.1101/2020.06.26.174482 (2020). · doi:10.1101/2020.06.26.174482
  67. Nastase, S. A., Gazzola, V., Hasson, U. & Keysers, C. Measuring shared responses across subjects using intersubject correlation. Soc. Cogn. Affect. Neurosci. 14, 667–685 (2019).
  68. Vanderwal, T. et al. Individual differences in functional connectivity during naturalistic viewing conditions. Neuroimage 157, 521–530 (2017). · DOI · Paper page
  69. Feilong, M., Nastase, S. A., Guntupalli, J. S. & Haxby, J. V. Reliable individual differences in fine-grained cortical functional architecture. Neuroimage 183, 375–386 (2018). · DOI · Paper page
  70. Finn, E. S. et al. Idiosynchrony: from shared responses to individual differences during naturalistic neuroimaging. Neuroimage 215, 116828 (2020). · DOI · Paper page
  71. Chen, P.-H. et al. A reduced-dimension fMRI shared response model. in Advances in Neural Information Processing Systems 28 (eds. Cortes, C., Lawrence, N. D., Lee, D. D., Sugiyama, M. & Garnett, R.) 460–468 (Curran Associates, Inc., 2015).
  72. Guntupalli, J. S. et al. A model of representational spaces in human cortex. Cereb. Cortex 26, 2919–2934 (2016). · DOI · Paper page
  73. Guntupalli, J. S., Feilong, M. & Haxby, J. V. A computational model of shared fine-scale structure in the human connectome. PLoS Comput. Biol. 14, e1006120 (2018). · DOI · Paper page
  74. Van Uden, C. E. et al. Modeling semantic encoding in a common neural representational space. Front. Neurosci. 12, 437 (2018). · DOI
  75. Haxby, J. V., Guntupalli, J. S., Nastase, S. A. & Feilong, M. Hyperalignment: modeling shared information encoded in idiosyncratic cortical topographies. eLife 9 (2020). · DOI · Paper page
  76. Milivojevic, B., Varadinov, M., Vicente Grabovetsky, A., Collin, S. H. P. & Doeller, C. F. Coding of event nodes and narrative context in the hippocampus. J. Neurosci. 36, 12412–12424 (2016). · DOI · Paper page
  77. Baldassano, C., Hasson, U. & Norman, K. A. Representation of real-world event schemas during narrative perception. J. Neurosci. 38, 9689–9699 (2018). · DOI · Paper page
  78. Chang, L. J. et al. Endogenous variation in ventromedial prefrontal cortex state dynamics during naturalistic viewing reflects affective experience. Sci. Adv. 7, eabf7129 (2021). · DOI · Paper page
  79. Heusser, A. C., Fitzpatrick, P. C. & Manning, J. R. Geometric models reveal behavioural and neural signatures of transforming experiences into memories. Nat. Hum. Behav. 5, 905–919 (2021). · DOI
  80. Kim, D., Kay, K., Shulman, G. L. & Corbetta, M. A new modular brain organization of the BOLD signal during natural vision. Cereb. Cortex 28, 3065–3081 (2018). · DOI
  81. Betzel, R. F., Byrge, L., Esfahlani, F. Z. & Kennedy, D. P. Temporal fluctuations in the brain’s modular architecture during movie-watching. Neuroimage 213, 116687 (2020). · DOI
  82. Meer, J. N., van der, Breakspear, M., Chang, L. J., Sonkusare, S. & Cocchi, L. Movie viewing elicits rich and reliable brain state dynamics. Nat. Commun. 11, 5004 (2020). · DOI · Paper page
  83. Brainard, D. H. The Psychophysics Toolbox. Spat. Vis. 10, 433–436 (1997). · DOI · Paper page
  84. Peirce, J. W. PsychoPy—psychophysics software in Python. J. Neurosci. Methods 162, 8–13 (2007). · DOI · Paper page
  85. Peirce, J. W. Generating stimuli for neuroscience using PsychoPy. Front. Neuroinform. 2, 10 (2009).
  86. Peirce, J. et al. PsychoPy2: experiments in behavior made easy. Behav. Res. Methods 51, 195–203 (2019). · DOI · Paper page
  87. DuPre, E., Hanke, M. & Poline, J.-B. Nature abhors a paywall: how open science can realize the potential of naturalistic stimuli. Neuroimage 216, 116330 (2019). · DOI
  88. McNamara, Q., De La Vega, A. & Yarkoni, T. Developing a comprehensive framework for multimodal feature extraction. in Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 1567–1574 (ACM, 2017). · DOI
  89. Povey, D. et al. The Kaldi speech recognition toolkit. in IEEE 2011 workshop on automatic speech recognition and understanding (IEEE Signal Processing Society, 2011).
  90. Cieri, C., Miller, D. & Walker, K. The Fisher Corpus: a resource for the next generations of speech-to-text. Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC) 4, 69–71 (2004).
  91. Gorgolewski, K. et al. Nipype: a flexible, lightweight and extensible neuroimaging data processing framework in python. Front. Neuroinform. 5, 13 (2011). · DOI · Paper page
  92. Abraham, A. et al. Machine learning for neuroimaging with scikit-learn. Front. Neuroinform. 8, 14 (2014). · DOI · Paper page
  93. Cox, R. W. AFNI: what a long strange trip it’s been. Neuroimage 62, 743–747 (2012). · DOI · Paper page
  94. Tustison, N. J. et al. N4ITK: improved N3 bias correction. IEEE Trans. Med. Imaging 29, 1310–1320 (2010). · DOI · Paper page
  95. Avants, B. B., Epstein, C. L., Grossman, M. & Gee, J. C. Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly and neurodegenerative brain. Med. Image Anal. 12, 26–41 (2008). · DOI · Paper page
  96. Zhang, Y., Brady, M. & Smith, S. Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm. IEEE Trans. Med. Imaging 20, 45–57 (2001). · DOI · Paper page
  97. Klein, A. et al. Mindboggling morphometry of human brains. PLoS Comput. Biol. 13, e1005350 (2017). · DOI · Paper page
  98. Fonov, V. S., Evans, A. C., McKinstry, R. C., Almli, C. R. & Collins, D. L. Unbiased nonlinear average age-appropriate brain templates from birth to adulthood. Neuroimage 47, S102 (2009). · DOI · Paper page
  99. Evans, A. C., Janke, A. L., Collins, D. L. & Baillet, S. Brain templates and atlases. Neuroimage 62, 911–922 (2012). · DOI · Paper page
  100. Fischl, B., Sereno, M. I., Tootell, R. B. & Dale, A. M. High-resolution intersubject averaging and a coordinate system for the cortical surface. Hum. Brain Mapp. 8, 272–284 (1999). · DOI · Paper page
  101. Wang, S. et al. Evaluation of Field Map and Nonlinear Registration Methods for Correction of Susceptibility Artifacts in Diffusion MRI. Front. Neuroinform. 11, 17 (2017). · DOI · Paper page
  102. Treiber, J. M. et al. Characterization and Correction of Geometric Distortions in 814 Diffusion Weighted Images. PLoS One 11, e0152472 (2016). · DOI · Paper page
  103. Greve, D. N. & Fischl, B. Accurate and robust brain image alignment using boundary-based registration. Neuroimage 48, 63–72 (2009). · DOI · Paper page
  104. Jenkinson, M., Beckmann, C. F., Behrens, T. E. J., Woolrich, M. W. & Smith, S. M. FSL. Neuroimage 62, 782–790 (2012). · DOI · Paper page
  105. Cox, R. W. & Hyde, J. S. Software tools for analysis and visualization of fMRI data. NMR Biomed. 10, 171–178 (1997). · DOI · Paper page
  106. Lanczos, C. Evaluation of Noisy Data. J. Soc. Ind. Appl. Math. B Numer. Anal. 1, 76–85 (1964).
  107. Satterthwaite, T. D. et al. An improved framework for confound regression and filtering for control of motion artifact in the preprocessing of resting-state functional connectivity data. Neuroimage 64, 240–256 (2013). · DOI · Paper page
  108. Pajula, J. & Tohka, J. Effects of spatial smoothing on inter-subject correlation based analysis of FMRI. Magn. Reson. Imaging 32, 1114–1124 (2014). · DOI
  109. Chung, M. K. et al. Cortical thickness analysis in autism with heat kernel smoothing. Neuroimage 25, 1256–1265 (2005). · DOI · Paper page
  110. Triantafyllou, C., Hoge, R. D. & Wald, L. L. Effect of spatial smoothing on physiological noise in high-resolution fMRI. Neuroimage 32, 551–557 (2006). · DOI
  111. Friedman, L., Glover, G. H., Krenz, D. & Magnotta, V., FIRST BIRN. Reducing inter-scanner variability of activation in a multicenter fMRI study: role of smoothness equalization. Neuroimage 32, 1656–1668 (2006). · DOI · Paper page
  112. Simony, E. & Chang, C. Analysis of stimulus-induced brain dynamics during naturalistic paradigms. Neuroimage 216, 116461 (2019). · DOI
  113. Parkes, L., Fulcher, B., Yücel, M. & Fornito, A. An evaluation of the efficacy, reliability, and sensitivity of motion correction strategies for resting-state functional MRI. Neuroimage 171, 415–436 (2018). · DOI · Paper page
  114. Muschelli, J. et al. Reduction of motion-related artifacts in resting state fMRI using aCompCor. Neuroimage 96, 22–35 (2014). · DOI · Paper page
  115. Lindquist, M. A., Geuter, S., Wager, T. D. & Caffo, B. S. Modular preprocessing pipelines can reintroduce artifacts into fMRI data. Hum. Brain Mapp. 40, 2358–2376 (2019). · DOI · Paper page
  116. Halchenko, Y. O. & Hanke, M. Open is not enough. Let’s take the next step: an integrated, community-driven computing platform for neuroscience. Front. Neuroinform. 6, 22 (2012). · DOI · Paper page
  117. Hanke, M. & Halchenko, Y. O. Neuroscience runs on GNU/Linux. Front. Neuroinform. 5, 8 (2011). · DOI
  118. Walt, S., van der, Colbert, S. C. & Varoquaux, G. The NumPy Array: a structure for efficient numerical computation. Comput. Sci. Eng. 13, 22–30 (2011). · DOI · Paper page
  119. McKinney, W. Data structures for statistical computing in Python. in Proceedings of the 9th Python in Science Conference 51–56 (2010). · DOI · Paper page
  120. Perez, F. & Granger, B. E. IPython: a system for interactive scientific computing. Computing in Science Engineering 9, 21–29 (2007). · DOI · Paper page
  121. Kluyver, T. et al. Jupyter Notebooks—a publishing format for reproducible computational workflows. in Positioning and Power in Academic Publishing: Players, Agents and Agendas (eds. Loizides, F. & Schmidt, B.) 87–90 (IOS Press, 2016).
  122. Jette, M. A., Yoo, A. B. & Grondona, M. SLURM: Simple Linux Utility for Resource Management. in Job Scheduling Strategies for Parallel Processing (eds. Feitelson, D., Rudolph, L. & Schwiegelshohn, U.) 44–60 (Springer, Berlin, Heidelberg, 2003). · DOI · Paper page
  123. Saad, Z. S., Reynolds, R. C., Argall, B., Japee, S. & Cox, R. W. SUMA: an interface for surface-based intra- and inter-subject analysis with AFNI. 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro 2, 1510–1513 (2004).
  124. Saad, Z. S. & Reynolds, R. C. SUMA. Neuroimage 62, 768–773 (2012). · DOI · Paper page
  125. Ben-Yakov, A., Honey, C. J., Lerner, Y. & Hasson, U. Loss of reliable temporal structure in event-related averaging of naturalistic stimuli. Neuroimage 63, 501–506 (2012). · DOI · Paper page
  126. Liu, Y. et al. Measuring speaker-listener neural coupling with functional near infrared spectroscopy. Sci. Rep. 7, 43293 (2017). · DOI · Paper page
  127. Vodrahalli, K. et al. Mapping between fMRI responses to movies and their natural language annotations. Neuroimage 180, 223–231 (2018). · DOI · Paper page
  128. Blank, I. A. & Fedorenko, E. Domain-general brain regions do not track linguistic input as closely as language-selective regions. J. Neurosci. 37, 9999–10011 (2017). · DOI · Paper page
  129. Iotzov, I. et al. Divergent neural responses to narrative speech in disorders of consciousness. Ann Clin Transl Neurol 4, 784–792 (2017). · DOI
  130. Loiotile, R. E., Cusack, R. & Bedny, M. Naturalistic audio-movies and narrative synchronize ‘visual’ cortices across congenitally blind but not sighted individuals. J. Neurosci. 39, 8940–8948 (2019). · DOI
  131. Lositsky, O. et al. Neural pattern change during encoding of a narrative predicts retrospective duration estimates. Elife 5 (2016). · DOI · Paper page
  132. Regev, M. et al. Propagation of Information Along the Cortical Hierarchy as a Function of Attention While Reading and Listening to Stories. Cereb. Cortex 29, 4017–4034 (2019). · DOI · Paper page
  133. Chien, H.-Y. S. & Honey, C. J. Constructing and forgetting temporal context in the human cerebral cortex. Neuron 106, 675–686.e11 (2020). · DOI
  134. Chang, C. H. C., Lazaridi, C., Yeshurun, Y., Norman, K. A. & Hasson, U. Relating the past with the present: Information integration and segregation during ongoing narrative processing. J. Cogn. Neurosci. 33, 1106–1128 (2021). · DOI · Paper page
  135. Lin, X. et al. Data-efficient mutual information neural estimator. Preprint at https://arxiv.org/abs/1905.03319 (2019). · arXiv
  136. Mennes, M., Biswal, B. B., Castellanos, F. X. & Milham, M. P. Making data sharing work: the FCP/INDI experience. Neuroimage 82, 683–691 (2013). · DOI · Paper page
  137. Kennedy, D. N., Haselgrove, C., Riehl, J., Preuss, N. & Buccigrossi, R. The NITRC image repository. Neuroimage 124, 1069–1073 (2016). · DOI · Paper page
  138. Nastase, S. A. et al. Narratives Dataset. FCP/INDI https://doi.org/10.15387/fcp_indi.retro.Narratives (2021). · doi:10.15387/fcp_indi.retro.narratives
  139. Krüger, G. & Glover, G. H. Physiological noise in oxygenation-sensitive magnetic resonance imaging. Magn. Reson. Med. 46, 631–637 (2001). · DOI · Paper page
  140. Ojemann, J. G. et al. Anatomic localization and quantitative analysis of gradient refocused echo-planar fMRI susceptibility artifacts. Neuroimage 6, 156–167 (1997). · DOI · Paper page
  141. Hasson, U., Malach, R. & Heeger, D. J. Reliability of cortical activity during natural stimulation. Trends Cogn. Sci. 14, 40–48 (2010). · DOI · Paper page
  142. Nili, H. et al. A toolbox for representational similarity analysis. PLoS Comput. Biol. 10, e1003553 (2014). · DOI · Paper page
  143. Cohen, J. D. et al. Computational approaches to fMRI analysis. Nat. Neurosci. 20, 304–313 (2017). · DOI · Paper page
  144. Kumar, M. et al. BrainIAK tutorials: user-friendly learning materials for advanced fMRI analysis. PLoS Comp. Biol. 16, e1007549 (2020). · DOI
  145. Kumar, M. et al. BrainIAK: the brain imaging analysis kit. Preprint at https://doi.org/10.31219/osf.io/db2ev (2020). · doi:10.31219/osf.io/db2ev
  146. Aguirre, G. K., Zarahn, E. & D’esposito, M. The variability of human, BOLD hemodynamic responses. Neuroimage 8, 360–369 (1998). · DOI · Paper page
  147. Handwerker, D. A., Ollinger, J. M. & D’Esposito, M. Variation of BOLD hemodynamic responses across subjects and brain regions and their effects on statistical analyses. Neuroimage 21, 1639–1651 (2004). · DOI · Paper page
  148. Zatorre, R. J., Belin, P. & Penhune, V. B. Structure and function of auditory cortex: music and speech. Trends Cogn. Sci. 6, 37–46 (2002). · DOI · Paper page
  149. Chen, G. et al. Untangling the relatedness among correlations, part I: nonparametric approaches to inter-subject correlation analysis at the group level. Neuroimage 142, 248–259 (2016). · DOI · Paper page
  150. Chen, G., Taylor, P. A., Shin, Y.-W., Reynolds, R. C. & Cox, R. W. Untangling the relatedness among correlations, Part II: inter-subject correlation group analysis through linear mixed-effects modeling. Neuroimage 147, 825–840 (2017). · DOI · Paper page
  151. Chen, G. et al. Untangling the relatedness among correlations, part III: inter-subject correlation analysis through Bayesian multilevel modeling for naturalistic scanning. Neuroimage 216, 116474 (2020). · DOI
  152. Yarkoni, T. et al. PyBIDS: Python tools for BIDS datasets. J. Open Source Softw. 4 (2019). · DOI

Cited by

See all 148

Metadata

Authors
Nastase, S. A., Liu, Y.-F., Hillman, H., Zadbood, A., Hasenfratz, L., Keshavarzian, N., Chen, J., Honey, C. J., Yeshurun, Y., Regev, M., Nguyen, M., Chang, C. H. C., Baldassano, C., Lositsky, O., Simony, E., Chow, M. A., Leong, Y. C., Brooks, P. P., Micciche, E., Choe, G., Goldstein, A., Vanderwal, T., Halchenko, Y. O., Norman, K. A., & Hasson, U.
Venue
Scientific Data
Published
2021-09-28
Volume
8
Issue
1
Pages
250-250
ISSN
2052-4463 (ISSN-L)
OpenAlex
W3203937348
Cited by
148
References
75
Type
data paper
Language
en
Open access
gold
Licence
Funders
  • U.S. Department of Health & Human Services | NIH | National Institute of Mental Health (R01-MH094480, DP1-HD091948, R01-MH112566, R01-MH112357, T32-MH065214)
  • United States Department of Defense | Defense Advanced Research Projects Agency (FA8750-18-C-0213)
  • Intel Corporation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The “Narratives” fMRI dataset for evaluating models of naturalistic language comprehension. https://app.cochat.ai/papers/10.1038/s41597-021-01033-3
The paper
Nastase, S. A., Liu, Y.-F., Hillman, H., Zadbood, A., Hasenfratz, L., Keshavarzian, N., Chen, J., Honey, C. J., Yeshurun, Y., Regev, M., Nguyen, M., Chang, C. H. C., Baldassano, C., Lositsky, O., Simony, E., Chow, M. A., Leong, Y. C., Brooks, P. P., Micciche, E., . . . Hasson, U. (2021). The “Narratives” fMRI dataset for evaluating models of naturalistic language comprehension. Scientific Data. https://doi.org/10.1038/s41597-021-01033-3

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.