Single-Trial Analysis of Neuroimaging Data: Inferring Neural Networks Underlying Perceptual Decision-Making in the Human Brain
Open accessThe DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
Advances in neural signal and image acquisition as well as in multivariate signal processing and machine learning are enabling a richer and more rigorous understanding of the neural basis of human decision-making. Decision-making is essentially characterized behaviorally by the variability of the decision across individual trials--e.g., error and response time distributions. To infer the neural processes that govern decision-making requires identifying neural correlates of such trial-to-trial behavioral variability. In this paper, we review efforts that utilize signal processing and machine learning to enable single-trial analysis of neural signals acquired while subjects perform simple decision-making tasks. Our focus is on neuroimaging data collected noninvasively via electroencephalograpy (EEG) and functional magnetic resonance imaging (fMRI). We review the specific framework for extracting decision-relevant neural components from the neuroimaging data, the goal being to analyze the trial-to-trial variability of the neural signal along these component directions and to relate them to elements of the decision-making process. We review results for perceptual decision-making and discrimination tasks, including paradigms in which EEG variability is used to inform an fMRI analysis. We discuss how single-trial analysis reveals aspects of the underlying decision-making networks that are unobservable using traditional trial-averaging methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Neurophysiological investigation of the basis of the fMRI signal
Logothetis, N. K., Pauls, J., Augath, M., Trinath, T., & Oeltermann, A. (2001) · Nature · doi:10.1038/35084005 · Cited by 6,551 · cited 1×
“Major technical challenges for simultaneous acquisition include 1) removal of large magnetic field gradients and radio-frequency (RF) pulses used to produce the MR images from the EEG [85], 2) special EEG amplifier design to remove the dc components without allowing the gradients to saturate the input stage [86], 3) n…”
Maass, W., Natschläger, T., & Markram, H. (2002) · Neural Computation · doi:10.1162/089976602760407955 · Cited by 4,025 · cited 1×
“The basic notion of what is known as reservoir computing [43], [44] is to represent a stimulus in a high dimensional space capturing many of its nonlinear features but then use a simple weighted sum of these features to classify the pattern into a few categories.”
The Neural Basis of Decision Making
Gold, J. I., & Shadlen, M. N. (2007) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.29.051605.113038 · Cited by 3,764 · cited 1×
“A number of ground-breaking electrophysiology studies have already laid the foundation upon which future research on perceptual decision-making will be conducted [2], [3].”
Beyond mind-reading: multi-voxel pattern analysis of fMRI data
Norman, K. A., Polyn, S. M., Detre, G. J., & Haxby, J. V. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.07.005 · Cited by 2,271 · cited 1×
“Direct decoding using linear classification as outlined above has been used with great success in fMRI, and several reviews are already available [46], [57].”
Motor imagery and direct brain-computer communication
Pfurtscheller, G., & Neuper, C. (2001) · Proceedings of the IEEE · doi:10.1109/5.939829 · Cited by 1,990
The analysis of visual motion: a comparison of neuronal and psychophysical performance
Britten, K., Shadlen, M., Newsome, W., & Movshon, J. (1992) · The Journal of Neuroscience · doi:10.1523/jneurosci.12-12-04745.1992 · Cited by 1,958
Perception's shadow: long-distance synchronization of human brain activity
Rodriguez, E., George, N., Lachaux, J.-P., Martinerie, J., Renault, B., & Varela, F. J. (1999) · Nature · doi:10.1038/17120 · Cited by 1,915
Intersubject synchronization of cortical activity during natural vision
Hasson, U., Nir, Y., Levy, I., Fuhrmann, G., & Malach, R. (2004) · Science · doi:10.1126/science.1089506 · Cited by 1,839 · cited 1×
“to correlate distinct neuroimaging modalities to each other [54] and even to identify common signals in the activity detected for different subjects [55].”
Neural Basis of a Perceptual Decision in the Parietal Cortex (Area LIP) of the Rhesus Monkey
Shadlen, M. N., & Newsome, W. T. (2001) · Journal of Neurophysiology · doi:10.1152/jn.2001.86.4.1916 · Cited by 1,755
Unconscious determinants of free decisions in the human brain
Soon, C. S., Brass, M., Heinze, H.-J., & Haynes, J.-D. (2008) · Nature Neuroscience · doi:10.1038/nn.2112 · Cited by 1,741 · cited 1×
“Free choice decisions could be detected several seconds ahead of an overt behavioral response [62], and even ahead of the conscious realization by the subject that he/she had reached a decision [63].”
Roitman, J. D., & Shadlen, M. N. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-21-09475.2002 · Cited by 1,589
Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans
Wolpaw, J. R., & McFarland, D. J. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0403504101 · Cited by 1,512
Predicting Human Brain Activity Associated with the Meanings of Nouns
Mitchell, T. M., Shinkareva, S. V., Carlson, A., Chang, K.-M., Malave, V. L., Mason, R. A., & Just, M. A. (2008) · Science · doi:10.1126/science.1152876 · Cited by 1,180 · cited 1×
“associated with the meaning of nouns [71].”
Face-specific processing in the human fusiform gyrus
McCarthy, G., Puce, A., Gore, J. C., & Allison, T. (1997) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1997.9.5.605 · Cited by 1,127
A relationship between behavioral choice and the visual responses of neurons in macaque MT
Britten, K. H., Newsome, W. T., Shadlen, M. N., Celebrini, S., & Movshon, J. A. (1996) · Visual Neuroscience · doi:10.1017/s095252380000715x · Cited by 1,049 · cited 3×
“adequate account of behavioral performance [4]–[6] and that trial-to-trial variability in these neuronal signals could predict the monkeys’ actual choices [7].”
Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque
Kim, J.-N., & Shadlen, M. N. (1999) · Nature Neuroscience · doi:10.1038/5739 · Cited by 950
Allison, T. (1999) · Cerebral Cortex · doi:10.1093/cercor/9.5.415 · Cited by 882 · cited 1×
“Both the FFA and STS have previously been implicated in early IEEE REVIEWS IN BIOMEDICAL ENGINEERING, VOL. 2, 2009 visual processing of faces using neuroimaging [34], [96]–[98] and field potentials recorded directly from the cortical surface [99]–[101].”
Cortical microstimulation influences perceptual judgements of motion direction
Salzman, C. D., Britten, K. H., & Newsome, W. T. (1990) · Nature · doi:10.1038/346174a0 · Cited by 881 · cited 1×
“the neurons’ preferred direction [8]–[10].”
Ratcliff, R., & Tuerlinckx, F. (2002) · Psychonomic Bulletin & Review · doi:10.3758/bf03196302 · Cited by 838
Neuronal correlates of parametric working memory in the prefrontal cortex
Romo, R., Brody, C. D., Hernández, A., & Lemus, L. (1999) · Nature · doi:10.1038/20939 · Cited by 822 · cited 2×
“Likewise, during vibrotactile frequency discrimination, regions in the secondary somatosensory (S2), medial premotor cortex (MPC), ventral premotor cortex (VPC), and DLPFC were reported as being involved in decision formation [27]–[30].”
A general mechanism for perceptual decision-making in the human brain
Heekeren, H. R., Marrett, S., Bandettini, P. A., & Ungerleider, L. G. (2004) · Nature · doi:10.1038/nature02966 · Cited by 741
Motion perception: seeing and deciding.
Shadlen, M. N., & Newsome, W. T. (1996) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.93.2.628 · Cited by 723
Decision-making with multiple alternatives
Churchland, A. K., Kiani, R., & Shadlen, M. N. (2008) · Nature Neuroscience · doi:10.1038/nn.2123 · Cited by 671
Microstimulation in visual area MT: effects on direction discrimination performance
Salzman, C., Murasugi, C., Britten, K., & Newsome, W. (1992) · The Journal of Neuroscience · doi:10.1523/jneurosci.12-06-02331.1992 · Cited by 657
A role for neural integrators in perceptual decision making
Mazurek, M. E., Roitman, J. D., Ditterich, J., & Shadlen, M. N. (2003) · Cerebral Cortex · doi:10.1093/cercor/bhg097 · Cited by 620
Responses of neurons in macaque MT to stochastic motion signals
Britten, K. H., Shadlen, M. N., Newsome, W. T., & Movshon, J. A. (1993) · Visual Neuroscience · doi:10.1017/s0952523800010269 · Cited by 594
Miyawaki, Y., Uchida, H., Yamashita, O., Sato, M.-A., Morito, Y., Tanabe, H. C., Sadato, N., & Kamitani, Y. (2008) · Neuron · doi:10.1016/j.neuron.2008.11.004 · Cited by 543 · cited 2×
“The geometry of a visual stimulus can be determined from visual cortex activity by predicting areas of high and low contrast on the image [59].”
Huk, A. C., & Shadlen, M. N. (2005) · The Journal of Neuroscience · doi:10.1523/jneurosci.4684-04.2005 · Cited by 538
Puce, A. (1999) · Cerebral Cortex · doi:10.1093/cercor/9.5.445 · Cited by 422
Neuronal correlates of decision-making in secondary somatosensory cortex
Romo, R., Hernández, A., Zainos, A., Lemus, L., & Brody, C. D. (2002) · Nature Neuroscience · doi:10.1038/nn950 · Cited by 387 · cited 1×
“sensory information to form a decision [28] and that short-term memory representation in DLPFC might also play a role in decision-making [27], [31].”
Microstimulation of inferotemporal cortex influences face categorization
Afraz, S.-R., Kiani, R., & Esteky, H. (2006) · Nature · doi:10.1038/nature04982 · Cited by 363 · cited 1×
“Interestingly, this pattern of neural responses appears to extend even to highly complex visual stimuli such as faces [11], [12].”
Microstimulation of macaque area LIP affects decision-making in a motion discrimination task
Hanks, T. D., Ditterich, J., & Shadlen, M. N. (2006) · Nature Neuroscience · doi:10.1038/nn1683 · Cited by 360 · cited 1×
“Specifically, electrophysiological recordings in LIP during the motion discrimination task [21]-[24] have shown that, for choices made towards the response field of the neuron under consideration, neural activity increased in a ramp-like fashion, consistent with a temporal integration process.”
Timing and Neural Encoding of Somatosensory Parametric Working Memory in Macaque Prefrontal Cortex
Brody, C. D. (2003) · Cerebral Cortex · doi:10.1093/cercor/bhg100 · Cited by 350
Neuronal Correlates of a Perceptual Decision in Ventral Premotor Cortex
Romo, R., Hernández, A., & Zainos, A. (2004) · Neuron · doi:10.1016/s0896-6273(03)00817-1 · Cited by 340
Ploran, E. J., Nelson, S. M., Velanova, K., Donaldson, D. I., Petersen, S. E., & Wheeler, M. E. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.3522-07.2007 · Cited by 282 · cited 1×
“Another recent fMRI study also showed how the fMRI signal can be used to examine the process of accumulation of sensory evidence [40].”
Microstimulation of visual cortex affects the speed of perceptual decisions
Ditterich, J., Mazurek, M. E., & Shadlen, M. N. (2003) · Nature Neuroscience · doi:10.1038/nn1094 · Cited by 234 · cited 1×
“the neurons’ preferred direction [8]–[10].”
Decoding Neuronal Ensembles in the Human Hippocampus
Hassabis, D., Chu, C., Rees, G., Weiskopf, N., Molyneux, P. D., & Maguire, E. A. (2009) · Current Biology · doi:10.1016/j.cub.2009.02.033 · Cited by 231 · cited 1×
“Decoders have also been used to distinguish spatial memories by distinguishing between two locations to which a subject navigated within a virtual environment despite identical visual appearance of the locations [60].”
The effects of visual object priming on brain activation before and after recognition
James, T. W., Humphrey, G. K., Gati, J. S., Menon, R. S., & Goodale, M. A. (2000) · Current Biology · doi:10.1016/s0960-9822(00)00655-2 · Cited by 164 · cited 1×
“ment in object categorization [103]–[107], the LOC has been”
Visual Selective Behavior Can Be Triggered by a Feed-Forward Process
VanRullen, R., & Koch, C. (2003) · Journal of Cognitive Neuroscience · doi:10.1162/089892903321208141 · Cited by 140 · cited 1×
“Aside from its involvement in object categorization [103]–[107], the LOC has been implicated in “perceptual persistence” [108], [109], a process in which a percept assembled by lower visual areas is allowed to remain in the visual system, via feedback pathways, as a form of iconic memory [110]–[ 112 ].”
Cortical origins of response time variability during rapid discrimination of visual objects
Gerson, A. D., Parra, L. C., & Sajda, P. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.06.026 · Cited by 103
Self-citation
Cited by
Human VMPFC encodes early signatures of confidence in perceptual decisions
Gherman, S., & Philiastides, M. G. (2018) · eLife · doi:10.7554/elife.38293 · Cited by 107
“We used a single-trial multivariate discriminant analysis, combined with a sliding window approach (Parra et al., 2005; Sajda et al., 2009) to discriminate between High and Low confidence trials in the stimulus-locked EEG data.”
MethodSelf-citationAuditory information enhances post-sensory visual evidence during rapid multisensory decision-making
Franzen, L., Delis, I., De Sousa, G., Kayser, C., & Philiastides, M. G. (2020) · Nature Communications · doi:10.1038/s41467-020-19306-7 · Cited by 57
Self-citationCortically Coupled Computing: A New Paradigm for Synergistic Human-Machine Interaction
Saproo, S., Faller, J., Shih, V., Sajda, P., Waytowich, N. R., Bohannon, A., Lawhern, V. J., Lance, B. J., & Jangraw, D. (2016) · Computer · doi:10.1109/mc.2016.294 · Cited by 18
Self-citation
Metadata
- Authors
- Sajda, P., Philiastides, M. G., & Parra, L. C.
- Venue
- IEEE Reviews in Biomedical Engineering
- Published
- 2009
- Volume
- 2
- Pages
- 97-109
- ISSN
- 1937-3333 (ISSN-L)
- 1941-1189
- OpenAlex
- W2132873208
- Cited by
- 49
- References
- 40
- FWCI
- 0.30
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.