CoChat

Evidence that neural information flow is reversed between object perception and object reconstruction from memory

Open access
Linde-Domingo, Juan, Treder, Matthias S., Kerrén, Casper, Wimber, Maria · 2019 · Nature Communications

Published version of a preprint

The DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.

Abstract

Remembering is a reconstructive process, yet little is known about how the reconstruction of a memory unfolds in time in the human brain. Here, we used reaction times and EEG time-series decoding to test the hypothesis that the information flow is reversed when an event is reconstructed from memory, compared to when the same event is initially being perceived. Across three experiments, we found highly consistent evidence supporting such a reversed stream. When seeing an object, low-level perceptual features were discriminated faster behaviourally, and could be decoded from brain activity earlier, than high-level conceptual features. This pattern reversed during associative memory recall, with reaction times and brain activity patterns now indicating that conceptual information was reconstructed more rapidly than perceptual details. Our findings support a neurobiologically plausible model of human memory, suggesting that memory retrieval is a hierarchical, multi-layered process that prioritises semantically meaningful information over perceptual details.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41467-018-08080-2

Cites

70 of 70 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 1 Stimuli and design of the behavioural experiments. a Illustration of the orthogonal design of the stimulus set. In all experiments, objects (a total of 128) varied along two dimensions: a perceptual dimension where objects could be presented as a photograph or as a line drawing; and a semantic dimension where objects could belong to the animate or inanimate category. b In the visual reaction time task, participants were prompted on each trial to categorise the upcoming object as fast as possible, either according to its perceptual category (photograph vs. line drawing) or its semantic category (animate vs. inanimate). c During the encoding phase of a memory reaction time task, participants were asked to create word-object associations (a total of eight per block). Reaction times were then measured during the retrieval phase, where subjects were presented with a reminder word, and asked to recall and categorise the associated object according to its perceptual (photograph vs. line drawing) or semantic (animate vs. inanimate) features. Button press symbols indicate at which moment in a trial RTs were collected
Fig. 1 Stimuli and design of the behavioural experiments. a Illustration of the orthogonal design of the stimulus set. In all experiments, objects (a total of 128) varied along two dimensions: a perceptual dimension where objects could be presented as a photograph or as a line drawing; and a semantic dimension where objects could belong to the animate or inanimate category. b In the visual reaction time task, participants were prompted on each trial to categorise the upcoming object as fast as possible, either according to its perceptual category (photograph vs. line drawing) or its semantic category (animate vs. inanimate). c During the encoding phase of a memory reaction time task, participants were asked to create word-object associations (a total of eight per block). Reaction times were then measured during the retrieval phase, where subjects were presented with a reminder word, and asked to recall and categorise the associated object according to its perceptual (photograph vs. line drawing) or semantic (animate vs. inanimate) features. Button press symbols indicate at which moment in a trial RTs were collectedCC BY · PubMed Central
Fig. 2 Behavioural RT and accuracy results. a Box plots representing reaction times in Experiments 1 and 2 (b) for perceptual (blue) and semantic (pink) questions when an object was physically presented on the screen (visual task, left) or cued by a reminder (memory task, right). We found that RTs were significantly predicted by an interaction between question type and kind of task (P < .001). For illustrative purposes the Y-axis in (a) and (b) is logarithmically scaled. c In Experiment 1, both types of questions were asked for each object representation. This allowed us to measure the difference in RTs between perceptual and semantic questions (X-axis) on a trial-by-trial level (Y-axis) during the visual task (left panel) and the memory task (right panel). Curved lines represent an expected normal distribution. The solid horizontal lines indicate the 50% point of the distribution (i.e., half of the trials), and dashed horizontal lines indicate the trial with a value closest to zero, where the perceptual–semantic difference is flipping from positive (pink) to negative (blue). If differences were normally distributed, the solid and dashed lines would be on top of each other. d Accuracy results in Experiment 1 for perceptual (blue) and semantic questions (pink) when the object was presented on the screen (visual task) or had to be recalled (memory task). Behavioural analyses showed that an interaction between type of task (i.e. visual or memory) and question type (i.e. perceptual or semantic) significantly predicted accuracy. e Box plots representing accuracy in Experiment 2 during the visual and memory task, where the significant interaction effect between type of task and question type was replicated. In all box plots, the line in the middle of each box represents the median, and the tops and bottoms of the boxes the 25th and 75th percentiles of the samples, respectively. Whiskers are drawn from the interquartile ranges to the furthest minimum (bottom) and maximum (top) values. Crosses represent outliers
Fig. 2 Behavioural RT and accuracy results. a Box plots representing reaction times in Experiments 1 and 2 (b) for perceptual (blue) and semantic (pink) questions when an object was physically presented on the screen (visual task, left) or cued by a reminder (memory task, right). We found that RTs were significantly predicted by an interaction between question type and kind of task (P < .001). For illustrative purposes the Y-axis in (a) and (b) is logarithmically scaled. c In Experiment 1, both types of questions were asked for each object representation. This allowed us to measure the difference in RTs between perceptual and semantic questions (X-axis) on a trial-by-trial level (Y-axis) during the visual task (left panel) and the memory task (right panel). Curved lines represent an expected normal distribution. The solid horizontal lines indicate the 50% point of the distribution (i.e., half of the trials), and dashed horizontal lines indicate the trial with a value closest to zero, where the perceptual–semantic difference is flipping from positive (pink) to negative (blue). If differences were normally distributed, the solid and dashed lines would be on top of each other. d Accuracy results in Experiment 1 for perceptual (blue) and semantic questions (pink) when the object was presented on the screen (visual task) or had to be recalled (memory task). Behavioural analyses showed that an interaction between type of task (i.e. visual or memory) and question type (i.e. perceptual or semantic) significantly predicted accuracy. e Box plots representing accuracy in Experiment 2 during the visual and memory task, where the significant interaction effect between type of task and question type was replicated. In all box plots, the line in the middle of each box represents the median, and the tops and bottoms of the boxes the 25th and 75th percentiles of the samples, respectively. Whiskers are drawn from the interquartile ranges to the furthest minimum (bottom) and maximum (top) values. Crosses represent outliersCC BY · PubMed Central
Fig. 3 Design for EEG experiment and time-resolved multivariate decoding. In the EEG experiment participants were asked to create word-object associations (panel a), and to later reconstruct the object as vividly as possible when cued with the word, and to indicate with a button press when they had a vivid image back in mind. EEG was recorded during learning and recall, with the aim to perform time-series decoding analyses that can detect at which moment, within a single trial, a classifier is most likely to categorise perceptual and semantic features correctly. Coloured time lines under object and cue time windows represent our reversal hypothesis regarding the temporal order of maximum semantic (pink) and perceptual (blue) classification during the perception (encoding) and retrieval of an object. All EEG analyses were aligned to the object onset during encoding, and to the button press during retrieval. b Decoding analyses were performed independently per participant at each time point. For each given time point during a trial, two linear discriminant analysis (LDA)-based classifiers were trained on the EEG signal: one perceptual classifier discriminating photographs from line drawings, and one semantic classifier discriminating animate from inanimate objects. Classifiers were tested using a leave-one-out procedure, which allowed us to obtain a time series of confidence values (d values, reflecting the distance from the separation hyperplane) for each single trial. c Our main interest was to compare the time points of maximal fidelity of the perceptual (blue) and semantic classifiers (pink) on each trial, to test the hypothesis that the perceptual maximum (blue) precedes the semantic one (pink) during perception, and importantly that this order is reversed during memory recall
Fig. 3 Design for EEG experiment and time-resolved multivariate decoding. In the EEG experiment participants were asked to create word-object associations (panel a), and to later reconstruct the object as vividly as possible when cued with the word, and to indicate with a button press when they had a vivid image back in mind. EEG was recorded during learning and recall, with the aim to perform time-series decoding analyses that can detect at which moment, within a single trial, a classifier is most likely to categorise perceptual and semantic features correctly. Coloured time lines under object and cue time windows represent our reversal hypothesis regarding the temporal order of maximum semantic (pink) and perceptual (blue) classification during the perception (encoding) and retrieval of an object. All EEG analyses were aligned to the object onset during encoding, and to the button press during retrieval. b Decoding analyses were performed independently per participant at each time point. For each given time point during a trial, two linear discriminant analysis (LDA)-based classifiers were trained on the EEG signal: one perceptual classifier discriminating photographs from line drawings, and one semantic classifier discriminating animate from inanimate objects. Classifiers were tested using a leave-one-out procedure, which allowed us to obtain a time series of confidence values (d values, reflecting the distance from the separation hyperplane) for each single trial. c Our main interest was to compare the time points of maximal fidelity of the perceptual (blue) and semantic classifiers (pink) on each trial, to test the hypothesis that the perceptual maximum (blue) precedes the semantic one (pink) during perception, and importantly that this order is reversed during memory recallCC BY · PubMed Central
Fig. 4 EEG multivariate analysis results. For illustrative purposes, box plots show group peak distributions of d values for perceptual and semantic categories during encoding (a; Perceptual peaks: M = 259 ms, SD = 24 ms; Semantic peaks: M = 267 ms, SD = 43 ms) and retrieval (b; Perceptual peaks: M = −1646 ms, SD = 247 ms; Semantic peaks: M = −1772 ms, SD = 177 ms) after averaging peaks within participants. All box plot elements represent the same metrics as in Fig. 2. c Measuring classifier fidelity in terms of d value peaks on a single-trial level allowed us to measure the pairwise time distance between perceptual and semantic peaks during encoding (left panel) and retrieval (right panel). Y-axis represents each individual trial, with trials accumulated across participants. The time distance between classifier peaks (time of perceptual peak minus time of semantic peak on a given trial) is represented on the X-axis. The curved line represents an expected normal distribution. The solid horizontal line indicates the 50% point (half of the trials), and the dashed horizontal line indicates the point where the temporal distance values change sign from perceptual < semantic (blue) to semantic < perceptual (pink)
Fig. 4 EEG multivariate analysis results. For illustrative purposes, box plots show group peak distributions of d values for perceptual and semantic categories during encoding (a; Perceptual peaks: M = 259 ms, SD = 24 ms; Semantic peaks: M = 267 ms, SD = 43 ms) and retrieval (b; Perceptual peaks: M = −1646 ms, SD = 247 ms; Semantic peaks: M = −1772 ms, SD = 177 ms) after averaging peaks within participants. All box plot elements represent the same metrics as in Fig. 2. c Measuring classifier fidelity in terms of d value peaks on a single-trial level allowed us to measure the pairwise time distance between perceptual and semantic peaks during encoding (left panel) and retrieval (right panel). Y-axis represents each individual trial, with trials accumulated across participants. The time distance between classifier peaks (time of perceptual peak minus time of semantic peak on a given trial) is represented on the X-axis. The curved line represents an expected normal distribution. The solid horizontal line indicates the 50% point (half of the trials), and the dashed horizontal line indicates the point where the temporal distance values change sign from perceptual < semantic (blue) to semantic < perceptual (pink)CC BY · PubMed Central
Fig. 5 Univariate analysis results. a Left panels represent ERP group differences (T values) across time in those electrodes that formed a significant cluster during object presentation, locked to the onset of the stimulus. Top left panel shows the contrast of photographs vs. line drawings, and the bottom left panel differences between animate vs. inanimate objects. Scalp figures next to each contrast illustrate the maximum cluster’s topography, averaged across the significant time-window, with all significant electrodes in a cluster being marked with an asterisk. b Right panels show ERP group differences (T values) over time in those electrodes that are contained in the maximum significant clusters during memory retrieval, time locked to participants’ responses. The top right panel shows the perceptual contrast, and the bottom right panel the semantic contrast. Cluster topographies for each comparison are located next to each panel, and the temporal extent of significant clusters is shaded in colour
Fig. 5 Univariate analysis results. a Left panels represent ERP group differences (T values) across time in those electrodes that formed a significant cluster during object presentation, locked to the onset of the stimulus. Top left panel shows the contrast of photographs vs. line drawings, and the bottom left panel differences between animate vs. inanimate objects. Scalp figures next to each contrast illustrate the maximum cluster’s topography, averaged across the significant time-window, with all significant electrodes in a cluster being marked with an asterisk. b Right panels show ERP group differences (T values) over time in those electrodes that are contained in the maximum significant clusters during memory retrieval, time locked to participants’ responses. The top right panel shows the perceptual contrast, and the bottom right panel the semantic contrast. Cluster topographies for each comparison are located next to each panel, and the temporal extent of significant clusters is shaded in colourCC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 70 references

Research works printed but not linked: 1

  1. Fabiani, M., Gratton, G., & Federmeier, K. in Handbook of Psychophysiology (eds. Cacioppo, J., Tassinary, L. & Berntson, G.) (Cambridge University Press, Cambridge, 2007).

Cited by

See all 152

Metadata

Authors
Linde-Domingo, J., Treder, M. S., Kerrén, C., & Wimber, M.
Affiliations
  • Cardiff University (GB)
  • University of Birmingham (GB)
Corresponding author
Wimber, Maria
Venue
Nature Communications
Published
2019-01-14
Volume
10
Issue
1
Pages
179-179
ISSN
2041-1723 (ISSN-L)
OpenAlex
W2908952471
Cited by
152
References
70
Citations by year
2026: 14 · 2025: 29 · 2024: 24 · 2023: 15 · 2022: 20 · 2021: 17 · 2020: 21 · 2019: 12
FWCI
10.17
Type
journal article
Language
en
Open access
Licence
Locations
  • Nature Communications (publishedVersion, cc-by)
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
  • Europe PMC (PubMed Central) (publishedVersion, other-oa)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) (acceptedVersion, cc-by-sa)
  • ORCA Online Research @Cardiff (Cardiff University) (acceptedVersion)
  • RePEc: Research Papers in Economics (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • University of Birmingham Research Portal (University of Birmingham) (submittedVersion, cc-by)
Funders
  • Directorate for Biological Sciences
  • Biotechnology and Biological Sciences Research Council
  • H2020 European Research Council (715714)
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Functions and Memory
Keywords
memory reconstruction, object perception, neural information flow, perceptual features, conceptual features, perceptual detail, semantic processing, EEG decoding, reaction time
MeSH terms
Adult, Brain, Electroencephalography, Female, Humans, Male, Models, Neurological, Reaction Time, Mental Recall, Recognition, Psychology, Young Adult

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Evidence that neural information flow is reversed between object perception and object reconstruction from memory. https://app.cochat.ai/papers/10.1038/s41467-018-08080-2
The paper
Linde-Domingo, J., Treder, M. S., Kerrén, C., & Wimber, M. (2019). Evidence that neural information flow is reversed between object perception and object reconstruction from memory. Nature Communications. https://doi.org/10.1038/s41467-018-08080-2

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.