The DOI matches its Crossref record; 72 of the 72 references it cites were found in a registry or an index.
Representational models: A common framework for understanding encoding, pattern-component, and representational-similarity analysis
Open accessAbstract
Abstract Representational models specify how activity patterns in populations of neurons (or, more generally, in multivariate brain-activity measurements) relate to sensory stimuli, motor responses, or cognitive processes. In an experimental context, representational models can be defined as hypotheses about the distribution of activity profiles across experimental conditions. Currently, three different methods are being used to test such hypotheses: encoding analysis, pattern component modeling (PCM), and representational similarity analysis (RSA). Here we develop a common mathematical framework for understanding the relationship of these three methods, which share one core commonality: all three evaluate the second moment of the distribution of activity profiles, which determines the representational geometry, and thus how well any feature can be decoded from population activity with any readout mechanism capable of a linear transform. Using simulated data for three different experimental designs, we compare the power of the methods to adjudicate between competing representational models. PCM implements a likelihood-ratio test and therefore provides the most powerful test if its assumptions hold. However, the other two approaches – when conducted appropriately – can perform similarly. In encoding analysis, the linear model needs to be appropriately regularized, which effectively imposes a prior on the activity profiles. With such a prior, an encoding model specifies a well-defined distribution of activity profiles. In RSA, the unequal variances and statistical dependencies of the dissimilarity estimates need to be taken into account to reach near-optimal power in inference. The three methods render different aspects of the information explicit (e.g. single-response tuning in encoding analysis and population-response representational dissimilarity in RSA) and have specific advantages in terms of computational demands, ease of use, and extensibility. The three methods are properly construed as complementary components of a single data-analytical toolkit for understanding neural representations on the basis of multivariate brain-activity data. Author Summary Modern neuroscience can measure activity of many neurons or the local blood oxygenation of many brain locations simultaneously. As the number of simultaneous measurements grows, we can better investigate how the brain represents and transforms information, to enable perception, cognition, and behavior. Recent studies go beyond showing that a brain region is involved in some function. They use representational models that specify how different perceptions, cognitions, and actions are encoded in brain-activity patterns. In this paper, we provide a general mathematical framework for such representational models, which clarifies the relationships between three different methods that are currently used in the neuroscience community. All three methods evaluate the same core feature of the data, but each has distinct advantages and disadvantages. Pattern component modelling (PCM) implements the most powerful test between models, and is analytically tractable and expandable. Representational similarity analysis (RSA) provides a highly useful summary statistic (the dissimilarity) and enables model comparison with weaker distributional assumptions. Finally, encoding models characterize individual responses and enable the study of their layout across cortex. We argue that these methods should be considered components of a larger toolkit for testing hypotheses about the way the brain represents information.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Biometry: The Principles and Practice of Statistics in Biological Research
Sokal, R. R., & Rohlf, F. J. (1969) · Cited by 20,963
THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS
FISHER, R. A. (1936) · Annals of Eugenics · doi:10.1111/j.1469-1809.1936.tb02137.x · Cited by 15,227
Biometry. The Principles and Practice of Statistics in Biological Research
Fienberg, S. E., Sokal, R. R., Rohlf, F. J., Rohlf, F. J., & Sokal, R. R. (1970) · Biometrics · doi:10.2307/2529087 · Cited by 9,364
(2012) · Cited by 9,062
Random-Effects Models for Longitudinal Data
Laird, N. M., & Ware, J. H. (1982) · Biometrics · doi:10.2307/2529876 · Cited by 8,923
(1987) · Medical Entomology and Zoology · Cited by 4,269
Distributed and overlapping representations of faces and objects in ventral temporal cortex
Haxby, J. V., Gobbini, M. I., Furey, M. L., Ishai, A., Schouten, J. L., & Pietrini, P. (2001) · Science · doi:10.1126/science.1063736 · Cited by 3,940
Generalized Cross-Validation as a Method for Choosing a Good Ridge Parameter
Golub, G. H., Heath, M., & Wahba, G. (1979) · Technometrics · doi:10.1080/00401706.1979.10489751 · Cited by 3,934
Biometry: The Principles and Practice of Statistics in Biological Research (2nd ed.).
Bailey, K., Sokal, R. R., & Rohlf, F. J. (1982) · Journal of the American Statistical Association · doi:10.2307/2287349 · Cited by 3,728
Representational similarity analysis-connecting the branches of systems neuroscience
Kriegeskorte, N. (2008) · Frontiers in Systems Neuroscience · doi:10.3389/neuro.06.004.2008 · Cited by 3,355
Self-citationNeuronal Population Coding of Movement Direction
Georgopoulos, A. P., Schwartz, A. B., & Kettner, R. E. (1986) · Science · doi:10.1126/science.3749885 · Cited by 3,161
Maximum Likelihood Approaches to Variance Component Estimation and to Related Problems
Harville, D. A. (1977) · Journal of the American Statistical Association · doi:10.1080/01621459.1977.10480998 · Cited by 2,667
Analysis of fMRI Time-Series Revisited
Friston, K. J., Holmes, A. P., Poline, J.-B., Grasby, P. J., Williams, S. C. R., Frackowiak, R. S. J., & Turner, R. (1995) · NeuroImage · doi:10.1006/nimg.1995.1007 · Cited by 2,502
IX. On the problem of the most efficient tests of statistical hypotheses
Neyman, J., & Pearson, E. S. (1933) · Philosophical Transactions of the Royal Society of London. Series A, Containing Papers of a Mathematical or Physical Character · doi:10.1098/rsta.1933.0009 · Cited by 2,341
Beyond mind-reading: multi-voxel pattern analysis of fMRI data
Norman, K. A., Polyn, S. M., Detre, G. J., & Haxby, J. V. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.07.005 · Cited by 2,271
Analysis of fMRI Time-Series Revisited—Again
Worsley, K. J., & Friston, K. J. (1995) · NeuroImage · doi:10.1006/nimg.1995.1023 · Cited by 2,185
Information-based functional brain mapping
Kriegeskorte, N., Goebel, R., & Bandettini, P. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0600244103 · Cited by 2,113
Self-citationInvariant visual representation by single neurons in the human brain
Quiroga, R. Q., Reddy, L., Kreiman, G., Koch, C., & Fried, I. (2005) · Nature · doi:10.1038/nature03687 · Cited by 1,988
Decoding the visual and subjective contents of the human brain
Kamitani, Y., & Tong, F. (2005) · Nature Neuroscience · doi:10.1038/nn1444 · Cited by 1,829
How does the brain solve visual object recognition?
DiCarlo, J. J., Zoccolan, D., & Rust, N. C. (2012) · Neuron · doi:10.1016/j.neuron.2012.01.010 · Cited by 1,790
That BLUP is a Good Thing: The Estimation of Random Effects
Robinson, G. K. (1991) · Statistical Science · doi:10.1214/ss/1177011926 · Cited by 1,686
Ledoit, O., & Wolf, M. (2003) · Journal of Empirical Finance · doi:10.1016/s0927-5398(03)00007-0 · Cited by 1,627
Machine learning classifiers and fMRI: A tutorial overview
Pereira, F., Mitchell, T., & Botvinick, M. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.11.007 · Cited by 1,624
Natural speech reveals the semantic maps that tile human cerebral cortex
Huth, A. G., de Heer, W. A., Griffiths, T. L., Theunissen, F. E., & Gallant, J. L. (2016) · Nature · doi:10.1038/nature17637 · Cited by 1,504
ON THE PROBLEM OF THE MOST EFFICIENT TESTS OF STATISTICAL HYPOTHESES
(1967) · Joint Statistical Papers · doi:10.1525/9780520339897-008 · Cited by 1,504
Matching Categorical Object Representations in Inferior Temporal Cortex of Man and Monkey
Kriegeskorte, N., Mur, M., Ruff, D. A., Kiani, R., Bodurka, J., Esteky, H., Tanaka, K., & Bandettini, P. A. (2008) · Neuron · doi:10.1016/j.neuron.2008.10.043 · Cited by 1,344
Self-citationIdentifying natural images from human brain activity
Kay, K. N., Naselaris, T., Prenger, R. J., & Gallant, J. L. (2008) · Nature · doi:10.1038/nature06713 · Cited by 1,286
Deep supervised, but not unsupervised, models may explain IT cortical representation
Khaligh-Razavi, S.-M., & Kriegeskorte, N. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003915 · Cited by 1,204
Self-citationPopulation receptive field estimates in human visual cortex
Dumoulin, S. O., & Wandell, B. A. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.09.034 · Cited by 1,182
Predicting Human Brain Activity Associated with the Meanings of Nouns
Mitchell, T. M., Shinkareva, S. V., Carlson, A., Chang, K.-M., Malave, V. L., Mason, R. A., & Just, M. A. (2008) · Science · doi:10.1126/science.1152876 · Cited by 1,180
Untangling invariant object recognition
DiCarlo, J. J., & Cox, D. D. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.06.010 · Cited by 959
A Toolbox for Representational Similarity Analysis
Nili, H., Wingfield, C., Walther, A., Su, L., Marslen-Wilson, W., & Kriegeskorte, N. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003553 · Cited by 937
Self-citationRepresentational geometry: integrating cognition, computation, and the brain
Kriegeskorte, N., & Kievit, R. A. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.06.007 · Cited by 911
Self-citationNaselaris, T., Kay, K. N., Nishimoto, S., & Gallant, J. L. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.07.073 · Cited by 905
Fast Readout of Object Identity from Macaque Inferior Temporal Cortex
Hung, C. P., Kreiman, G., Poggio, T., & DiCarlo, J. J. (2005) · Science · doi:10.1126/science.1117593 · Cited by 854
Resolving human object recognition in space and time
Cichy, R. M., Pantazis, D., & Oliva, A. (2014) · Nature Neuroscience · doi:10.1038/nn.3635 · Cited by 823
How does nature program neuron types?
Borst, A. (2008) · Frontiers in Neuroscience · doi:10.3389/neuro.01.016.2008 · Cited by 705
Yu, B. M., Cunningham, J. P., Santhanam, G., Ryu, S. I., Shenoy, K. V., & Sahani, M. (2009) · Journal of Neurophysiology · doi:10.1152/jn.90941.2008 · Cited by 656
Demixed principal component analysis of neural population data
Kobak, D., Brendel, W., Constantinidis, C., Feierstein, C. E., Kepecs, A., Mainen, Z. F., Qi, X.-L., Romo, R., Uchida, N., & Machens, C. K. (2016) · eLife · doi:10.7554/elife.10989 · Cited by 599
How advances in neural recording affect data analysis
Stevenson, I. H., & Kording, K. P. (2011) · Nature Neuroscience · doi:10.1038/nn.2731 · Cited by 582
Reliability of dissimilarity measures for multi-voxel pattern analysis
Walther, A., Nili, H., Ejaz, N., Alink, A., Kriegeskorte, N., & Diedrichsen, J. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2015.12.012 · Cited by 560
Self-citationDistinct Cortical Pathways for Music and Speech Revealed by Hypothesis-Free Voxel Decomposition
Norman-Haignere, S., Kanwisher, N. G., & McDermott, J. H. (2015) · Neuron · doi:10.1016/j.neuron.2015.11.035 · Cited by 465
Comparison of multivariate classifiers and response normalizations for pattern-information fMRI
Misaki, M., Kim, Y., Bandettini, P. A., & Kriegeskorte, N. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.05.051 · Cited by 458
Self-citationRepresentational dynamics of object vision: The first 1000 ms
Carlson, T., Tovar, D. A., Alink, A., & Kriegeskorte, N. (2013) · Journal of Vision · doi:10.1167/13.10.1 · Cited by 414
Self-citationNeural Representation and the Cortical Code
deCharms, R. C., & Zador, A. (2000) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.23.1.613 · Cited by 394
Eisenhauer, J. G. (2003) · Teaching Statistics · doi:10.1111/1467-9639.00136 · Cited by 381
Explicit information for category-orthogonal object properties increases along the ventral stream
Hong, H., Yamins, D. L. K., Majaj, N. J., & DiCarlo, J. J. (2016) · Nature Neuroscience · doi:10.1038/nn.4247 · Cited by 337
The statistics of natural hand movements
Ingram, J. N., Körding, K. P., Howard, I. S., & Wolpert, D. M. (2008) · Experimental Brain Research · doi:10.1007/s00221-008-1355-3 · Cited by 330
Could a neuroscientist understand a microprocessor?
Jonas, E., & Paul Kording, K. (2016) · doi:10.1101/055624 · Cited by 329
Partially Distributed Representations of Objects and Faces in Ventral Temporal Cortex
O'Toole, A. J., Jiang, F., Abdi, H., & Haxby, J. V. (2005) · Journal of Cognitive Neuroscience · doi:10.1162/0898929053467550 · Cited by 322
Analyzing for information, not activation, to exploit high-resolution fMRI
Kriegeskorte, N., & Bandettini, P. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.02.022 · Cited by 270
Self-citationHand use predicts the structure of representations in sensorimotor cortex
Ejaz, N., Hamada, M., & Diedrichsen, J. (2015) · Nature Neuroscience · doi:10.1038/nn.4038 · Cited by 239
Self-citationSergio, L. E., Hamel-Pâquet, C., & Kalaska, J. F. (2005) · Journal of Neurophysiology · doi:10.1152/jn.00989.2004 · Cited by 238
Bayesian decoding of brain images
Friston, K., Chu, C., Mourão-Miranda, J., Hulme, O., Rees, G., Penny, W., & Ashburner, J. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.08.013 · Cited by 202
Pattern-information analysis: From stimulus decoding to computational-model testing
Kriegeskorte, N. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.01.061 · Cited by 194
Self-citationKriegeskorte, N., Cusack, R., & Bandettini, P. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.09.059 · Cited by 176
Self-citationA comparison of volume-based and surface-based multi-voxel pattern analysis
Oosterhof, N. N., Wiestler, T., Downing, P. E., & Diedrichsen, J. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.04.270 · Cited by 163
Self-citationA synergy-based hand control is encoded in human motor cortical areas
Leo, A., Handjaras, G., Bianchi, M., Marino, H., Gabiccini, M., Guidi, A., Scilingo, E. P., Pietrini, P., Bicchi, A., Santello, M., et al. (2016) · eLife · doi:10.7554/elife.13420 · Cited by 145
Wardle, S. G., Kriegeskorte, N., Grootswagers, T., Khaligh‐Razavi, S., & Carlson, T. A. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.02.019 · Cited by 104
Self-citationSergio, L. E., & Kalaska, J. F. (1997) · Journal of Neurophysiology · doi:10.1152/jn.1997.78.2.1170 · Cited by 104
Jozwik, K. M., Kriegeskorte, N., & Mur, M. (2015) · Neuropsychologia · doi:10.1016/j.neuropsychologia.2015.10.023 · Cited by 98
Self-citationComparing the similarity and spatial structure of neural representations: A pattern-component model
Diedrichsen, J., Ridgway, G. R., Friston, K. J., & Wiestler, T. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.01.044 · Cited by 97
Self-citationKhaligh‐Razavi, S., Henriksson, L., Kay, K., & Kriegeskorte, N. (2016) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2016.10.007 · Cited by 84
Self-citationDiedrichsen, J., Yokoi, A., & Arbuckle, S. A. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.08.051 · Cited by 77
Self-citationCai, M. B., Schuck, N. W., Anderson, M. C., Pillow, J. W., & Niv, Y. (2017) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1006299 · Cited by 64
On the distribution of cross-validated Mahalanobis distancesPreprint
Diedrichsen, J., Provost, S. B., & Zareamoghaddam, H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1607.01371 · Cited by 63
Self-citationChaimow, D., Yacoub, E. S., Uǧurbil, K., & Shmuel, A. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.09.037 · Cited by 61
Inferring brain-computational mechanisms with models of activity measurements
Kriegeskorte, N., & Diedrichsen, J. (2016) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2016.0278 · Cited by 60
Self-citationThe Neural Code for Face Orientation in the Human Fusiform Face Area
Ramírez, F., Cichy, R. M., Allefeld, C., & Haynes, J. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.3156-13.2014 · Cited by 59
[That BLUP is a Good Thing: The Estimation of Random Effects]: Rejoinder
Robinson, G. K. (1991) · Statistical Science · doi:10.1214/ss/1177011933 · Cited by 45
A Bayesian method for reducing bias in neural representational similarity analysisPreprint
Cai, M. B., Schuck, N. W., Pillow, J. W., & Niv, Y. (2016) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/073932 · Cited by 26
Maximum Likelihood Approaches to Variance Component Estimation and to Related Problems: Rejoinder
Harville, D. A. (1977) · Journal of the American Statistical Association · doi:10.2307/2286798 · Cited by 10
Cited by
Functional boundaries in the human cerebellum revealed by a multi-domain task battery
King, M., Hernandez-Castillo, C. R., Poldrack, R. A., Ivry, R. B., & Diedrichsen, J. (2019) · Nature Neuroscience · doi:10.1038/s41593-019-0436-x · Cited by 673
Self-citationCognitive computational neuroscience
Kriegeskorte, N., & Douglas, P. K. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0210-5 · Cited by 535
Self-citationNeural network models and deep learning
Kriegeskorte, N., & Golan, T. (2019) · Current Biology · doi:10.1016/j.cub.2019.02.034 · Cited by 543
Self-citationDeconstructing multivariate decoding for the study of brain function
Hebart, M. N., & Baker, C. I. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2017.08.005 · Cited by 320
Hand Knob Area of Premotor Cortex Represents the Whole Body in a Compositional Way
Willett, F. R., Deo, D. R., Avansino, D. T., Rezaii, P., Hochberg, L. R., Henderson, J. M., & Shenoy, K. V. (2020) · Cell · doi:10.1016/j.cell.2020.02.043 · Cited by 171
Metadata
- Authors
- Diedrichsen, J., & Kriegeskorte, N.
- Venue
- PLOS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2017-04-24
- Volume
- 13
- Issue
- 4
- Pages
- e1005508
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- OpenAlex
- W2951877485
- Cited by
- 333
- References
- 72
- FWCI
- 15.75
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.