Decoding fMRI Signatures of Real-world Autobiographical Memory Retrieval
The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
Extant neuroimaging data implicate frontoparietal and medial-temporal lobe regions in episodic retrieval, and the specific pattern of activity within and across these regions is diagnostic of an individual's subjective mnemonic experience. For example, in laboratory-based paradigms, memories for recently encoded faces can be accurately decoded from single-trial fMRI patterns [Uncapher, M. R., Boyd-Meredith, J. T., Chow, T. E., Rissman, J., & Wagner, A. D. Goal-directed modulation of neural memory patterns: Implications for fMRI-based memory detection. Journal of Neuroscience, 35, 8531–8545, 2015; Rissman, J., Greely, H. T., & Wagner, A. D. Detecting individual memories through the neural decoding of memory states and past experience. Proceedings of the National Academy of Sciences, U.S.A., 107, 9849–9854, 2010]. Here, we investigated the neural patterns underlying memory for real-world autobiographical events, probed at 1- to 3-week retention intervals as well as whether distinct patterns are associated with different subjective memory states. For 3 weeks, participants (n = 16) wore digital cameras that captured photographs of their daily activities. One week later, they were scanned while making memory judgments about sequences of photos depicting events from their own lives or events captured by the cameras of others. Whole-brain multivoxel pattern analysis achieved near-perfect accuracy at distinguishing correctly recognized events from correctly rejected novel events, and decoding performance did not significantly vary with retention interval. Multivoxel pattern classifiers also differentiated recollection from familiarity and reliably decoded the subjective strength of recollection, of familiarity, or of novelty. Classification-based brain maps revealed dissociable neural signatures of these mnemonic states, with activity patterns in hippocampus, medial PFC, and ventral parietal cortex being particularly diagnostic of recollection. Finally, a classifier trained on previously acquired laboratory-based memory data achieved reliable decoding of autobiographical memory states. We discuss the implications for neuroscientific accounts of episodic retrieval and comment on the potential forensic use of fMRI for probing experiential knowledge.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Alzheimer’s disease neuroimaging initiative (ADNI): MRI methods
Jack, C. R., Bernstein, M. A., Fox, N. C., Thompson, P., Alexander, G., Harvey, D., Borowski, B., Britson, P. J., L. Whitwell, J., Ward, C., et al. (2008) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.21049 · Cited by 4,347
The Medial Temporal Lobe and Recognition Memory
Eichenbaum, H., Yonelinas, A. P., & Ranganath, C. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.30.051606.094328 · Cited by 2,580
Beyond mind-reading: multi-voxel pattern analysis of fMRI data
Norman, K. A., Polyn, S. M., Detre, G. J., & Haxby, J. V. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.07.005 · Cited by 2,271 · cited 1×
“Over the past decade, aided by the development and application of sophisticated multivoxel pattern analysis (MVPA) techniques (Tong & Pratte, 2012; Norman, Polyn, Detre, & Haxby, 2006), researchers have demonstrated that the distributed fMRI patterns associated with the act of memory retrieval are…”
BackgroundMachine learning classifiers and fMRI: A tutorial overview
Pereira, F., Mitchell, T., & Botvinick, M. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.11.007 · Cited by 1,624 · cited 1×
“For any given classification, participants with fewer than 15 trials per class were excluded, because having an insufficient number of training examples can result in unstable classifier performance (Pereira, Mitchell, & Botvinick, 2009).”
BackgroundParietal lobe contributions to episodic memory retrieval
Wagner, A. D., Shannon, B. J., Kahn, I., & Buckner, R. L. (2005) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.07.001 · Cited by 1,571 · cited 1×
“…is closely linked to the subjective feeling of familiarity for a given retrieval cue and/or the recollection of associated contextual details (Rugg & Vilberg, 2013; Shimamura, 2011; Eichenbaum, Yonelinas, & Ranganath, 2007; Wagner, Shannon, Kahn, & Buckner, 2005; Squire, Stark, & Clark, 2004).”
BackgroundSelf-citationDeconstructing episodic memory with construction
Hassabis, D., & Maguire, E. A. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.05.001 · Cited by 1,229
Spreng, R. N., & Grady, C. L. (2010) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2009.21282 · Cited by 985 · cited 1×
“…the default mode network, presumably owing to the fact that both undirected mentation and episodic retrieval entail self-referential processing and representation of information retrieved from (or constructed based on) memory (Andrews-Hanna, Saxe, & Yarkoni, 2014; Kim, 2012; Spreng & Grady, 2010).”
BackgroundDenny, B. T., Kober, H., Wager, T. D., & Ochsner, K. N. (2012) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00233 · Cited by 830 · cited 1×
“The vmPFC is thought to play a critical role in self-referential processing (Denny, Kober, Wager, & Ochsner, 2012; Sajonz et al., 2010), which likely explains its prominent involvement when participants attempt to project themselves back into and mentally “ relive ” events depicted in their…”
Spaniol, J., Davidson, P. S. R., Kim, A. S. N., Han, H., Moscovitch, M., & Grady, C. L. (2009) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2009.02.028 · Cited by 791
Brain networks underlying episodic memory retrieval
Rugg, M. D., & Vilberg, K. L. (2013) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2012.11.005 · Cited by 751
Research works printed but not linked: 46
- Binder, 2009, Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies, Cerebral Cortex, 19, 2767, 10.1093/cercor/bhp055 · DOI · Paper page
- Bles, 2008, Detecting concealed information using brain-imaging technology, Neurocase, 14, 82, 10.1080/13554790801992784 · DOI
- Bonnici, 2012, Detecting representations of recent and remote autobiographical memories in vmPFC and hippocampus, Journal of Neuroscience, 32, 16982, 10.1523/JNEUROSCI.2475-12.2012 · DOI · Paper page
- Bonnici, 2013, Representations of recent and remote autobiographical memories in hippocampal subfields, Hippocampus, 23, 849, 10.1002/hipo.22155 · DOI · Paper page
- Bosshardt, 2005, One month of human memory consolidation enhances retrieval-related hippocampal activity, Hippocampus, 15, 1026, 10.1002/hipo.20105 · DOI · Paper page
- Brainard, 1997, The psychophysics toolbox, Spatial Vision, 10, 433, 10.1163/156856897X00357 · DOI · Paper page
- Cabeza, 2004, Brain activity during episodic retrieval of autobiographical and laboratory events: An fMRI study using a novel photo paradigm, Journal of Cognitive Neuroscience, 16, 1583, 10.1162/0898929042568578 · DOI · Paper page
- Chadwick, 2011, Decoding overlapping memories in the medial temporal lobes using high-resolution fMRI, Learning and Memory, 18, 742, 10.1101/lm.023671.111 · DOI · Paper page
- Chadwick, 2010, Decoding individual episodic memory traces in the human hippocampus, Current Biology, 20, 544, 10.1016/j.cub.2010.01.053 · DOI · Paper page
- Chang, 2009, Effects of model-based physiological noise correction on default mode network anti-correlations and correlations, Neuroimage, 47, 1448, 10.1016/j.neuroimage.2009.05.012 · DOI · Paper page
- Cohen, 2008, Memory in the real world
- Dobbins, 2002, Executive control during episodic retrieval: Multiple prefrontal processes subserve source memory, Neuron, 35, 989, 10.1016/S0896-6273(02)00858-9 · DOI · Paper page
- Glover, 2000, Image-based method for retrospective correction of physiological motion effects in fMRI: RETROICOR, Magnetic Resonance in Medicine, 44, 162, 10.1002/1522-2594(200007)44:1<162::AID-MRM23>3.0.CO;2-E · doi:10.1002/1522-2594(200007)44:1<162::aid-mrm23>3.0.co;2-e
- Horn, 2015, The multiple neural networks of familiarity: A meta-analysis of functional imaging studies, Cognitive, Affective & Behavioral Neuroscience
- Hutchinson, 2014, Functional heterogeneity in posterior parietal cortex across attention and episodic memory retrieval, Cerebral Cortex, 24, 49, 10.1093/cercor/bhs278 · DOI · Paper page
- Kim, 2010, Dissociating the roles of the default-mode, dorsal, and ventral networks in episodic memory retrieval, Neuroimage, 50, 1648, 10.1016/j.neuroimage.2010.01.051 · DOI · Paper page
- Kim, 2012, A dual-subsystem model of the brain's default network: Self-referential processing, memory retrieval processes, and autobiographical memory retrieval, Neuroimage, 61, 966, 10.1016/j.neuroimage.2012.03.025 · DOI · Paper page
- Kim, 2013, Differential neural activity in the recognition of old versus new events: An activation likelihood estimation meta-analysis, Human Brain Mapping, 34, 814, 10.1002/hbm.21474 · DOI · Paper page
- Kuhl, 2014, Successful remembering elicits event-specific activity patterns in lateral parietal cortex, Journal of Neuroscience, 34, 8051, 10.1523/JNEUROSCI.4328-13.2014 · DOI · Paper page
- Kuhl, 2011, Fidelity of neural reactivation reveals competition between memories, Proceedings of the National Academy of Sciences, U.S.A., 108, 5903, 10.1073/pnas.1016939108 · DOI · Paper page
- Leiker, 2014, Neural reinstatement and the amount of information recollected, Brain Research, 1582, 125, 10.1016/j.brainres.2014.07.026 · DOI
- Leiker, 2015, Pattern reactivation co-varies with activity in the core recollection network during source memory, Neuropsychologia, 75, 88, 10.1016/j.neuropsychologia.2015.05.021 · DOI
- LePort, 2012, Behavioral and neuroanatomical investigation of highly superior autobiographical memory (HSAM), Neurobiology of Learning and Memory, 98, 78, 10.1016/j.nlm.2012.05.002 · DOI · Paper page
- Maguire, 2012, Studying the freely-behaving brain with fMRI, Neuroimage, 62, 1170, 10.1016/j.neuroimage.2012.01.009 · DOI
- McDuff, 2009, Multivoxel pattern analysis reveals increased memory targeting and reduced use of retrieved details during single-agenda source monitoring, Journal of Neuroscience, 29, 508, 10.1523/JNEUROSCI.3587-08.2009 · DOI · Paper page
- Meegan, 2008, Neuroimaging techniques for memory detection: Scientific, ethical, and legal issues, American Journal of Bioethics, 8, 9, 10.1080/15265160701842007 · DOI
- Milton, 2011, The neural correlates of everyday recognition memory, Brain and Cognition, 76, 369, 10.1016/j.bandc.2011.04.003 · DOI
- Montaldi, 2006, The neural system that mediates familiarity memory, Hippocampus, 16, 504, 10.1002/hipo.20178 · DOI · Paper page
- Nielson, 2015, Human hippocampus represents space and time during retrieval of real-world memories, Proceedings of the National Academy of Sciences, U.S.A., 112, 11078, 10.1073/pnas.1507104112 · DOI · Paper page
- Patihis, 2013, False memories in highly superior autobiographical memory individuals, Proceedings of the National Academy of Sciences, U.S.A., 110, 20947, 10.1073/pnas.1314373110 · DOI · Paper page
- Qin, 2012, Dissociation between anterior and posterior cortical regions during self-specificity and familiarity: A combined fMRI-meta-analytic study, Human Brain Mapping, 33, 154, 10.1002/hbm.21201 · DOI · Paper page
- Quamme, 2010, Listening for recollection: A multi-voxel pattern analysis of recognition memory retrieval strategies, Frontiers in Human Neuroscience, 4, 61
- Rissman, 2010, Detecting individual memories through the neural decoding of memory states and past experience, Proceedings of the National Academy of Sciences, U.S.A., 107, 9849, 10.1073/pnas.1001028107 · DOI · Paper page
- Ritchey, 2013, Neural similarity between encoding and retrieval is related to memory via hippocampal interactions, Cerebral Cortex, 23, 2818, 10.1093/cercor/bhs258 · DOI · Paper page
- Roediger, 2013, Two types of event memory, Proceedings of the National Academy of Sciences, U.S.A., 110, 20856, 10.1073/pnas.1321373110 · DOI
- Sajonz, 2010, Delineating self-referential processing from episodic memory retrieval: Common and dissociable networks, Neuroimage, 50, 1606, 10.1016/j.neuroimage.2010.01.087 · DOI
- Shen, 2011, Brain scans as evidence: Truths, proofs, lies, and lessons, Mercer Law Review, 62, 861
- Smith, 2010, Imaging systems level consolidation of novel associate memories: A longitudinal neuroimaging study, Neuroimage, 50, 826, 10.1016/j.neuroimage.2009.11.053 · DOI
- Squire, 2004, The medial temporal lobe, Annual Review of Neuroscience, 27, 279, 10.1146/annurev.neuro.27.070203.144130 · DOI · Paper page
- St-Laurent, 2015, Distributed patterns of reactivation predict vividness of recollection, Journal of Cognitive Neuroscience, 27, 2000, 10.1162/jocn_a_00839 · DOI · Paper page
- Thakral, 2015, Cortical reinstatement and the confidence and accuracy of source memory, Neuroimage, 109, 118, 10.1016/j.neuroimage.2015.01.003 · DOI
- Tulving, 1989, Remembering and knowing the past, American Scientist, 77, 361
- Uncapher, 2015, Goal-directed modulation of neural memory patterns: Implications for fMRI-based memory detection, Journal of Neuroscience, 35, 8531, 10.1523/JNEUROSCI.5145-14.2015 · DOI
- Vilberg, 2007, Dissociation of the neural correlates of recognition memory according to familiarity, recollection, and amount of recollected information, Neuropsychologia, 45, 2216, 10.1016/j.neuropsychologia.2007.02.027 · DOI · Paper page
- Vilberg, 2008, Memory retrieval and the parietal cortex: A review of evidence from a dual-process perspective, Neuropsychologia, 46, 1787, 10.1016/j.neuropsychologia.2008.01.004 · DOI · Paper page
- Vilberg, 2009, Left parietal cortex is modulated by amount of recollected verbal information, NeuroReport, 20, 1295, 10.1097/WNR.0b013e3283306798 · DOI · Paper page
Cited by
Discovering Event Structure in Continuous Narrative Perception and Memory
Baldassano, C., Chen, J., Zadbood, A., Pillow, J. W., Hasson, U., & Norman, K. A. (2017) · Neuron · doi:10.1016/j.neuron.2017.06.041 · Cited by 952
A contextual binding theory of episodic memory: systems consolidation reconsidered
Yonelinas, A. P., Ranganath, C., Ekstrom, A. D., & Wiltgen, B. J. (2019) · Nature Reviews Neuroscience · doi:10.1038/s41583-019-0150-4 · Cited by 450
Keep it real: rethinking the primacy of experimental control in cognitive neuroscience
Nastase, S. A., Goldstein, A., & Hasson, U. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.117254 · Cited by 344
Lieberman, M. D., Straccia, M. A., Meyer, M. L., Du, M., & Tan, K. M. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2018.12.021 · Cited by 268
Wing, E. A., Ritchey, M., & Cabeza, R. (2015) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00740 · Cited by 174
Sreekumar, V., Nielson, D. M., Smith, T. A., Dennis, S. J., & Sederberg, P. B. (2018) · Scientific Reports · doi:10.1038/s41598-018-32879-0 · Cited by 64
The role of personal goals in autonoetic experience when imagining future events
Lehner, E., & D’Argembeau, A. (2016) · Consciousness and Cognition · doi:10.1016/j.concog.2016.04.002 · Cited by 49
Neurorights, mental privacy, and mind reading
Brown, C. M. L. (2024) · Neuroethics · doi:10.1007/s12152-024-09568-z · Cited by 33
“Further powers include the reconstruction of visual stimuli [95], decoding of covert intentions [96], detection of autobiographical memories [97], identification of pain states [98], prediction of psychiatric and neurological disorders [99], tracking of processes involved in moral judgement and…”
Metadata
- Authors
- Rissman, J., Chow, T. E., Reggente, N., & Wagner, A. D.
- Venue
- Journal of Cognitive Neuroscience
- Publisher
- MIT Press - Journals
- Published
- 2016-04-01
- Volume
- 28
- Issue
- 4
- Pages
- 604-620
- ISSN
- 0898-929X (ISSN-L)
- 1530-8898
- OpenAlex
- W2222947713
- Cited by
- 105
- References
- 35
- FWCI
- 6.46
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.