The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Comparison of multivariate classifiers and response normalizations for pattern-information fMRI
Open accessAbstract
A popular method for investigating whether stimulus information is present in fMRI response patterns is to attempt to “decode” the stimuli from the response patterns with a multivariate classifier. The sensitivity for detecting the information depends on the particular classifier used. However, little is known about the relative performance of different classifiers on fMRI data. Here we compared six multivariate classifiers and investigated how the response-amplitude estimate used (beta or t-value) and different pattern normalizations affect classification performance. The compared classifiers were a pattern-correlation classifier, a k-nearest-neighbors classifier, Fisher’s linear discriminant, Gaussian naïve Bayes, and linear and nonlinear (radial-basis-function-kernel) support vector machines. We compared these classifiers’ accuracy at decoding the category of visual objects from response patterns in human early visual and inferior temporal cortex acquired in an event-related design with BOLD fMRI at 3T using SENSE and isotropic voxels of about 2-mm width. Overall, Fisher’s linear discriminant (with an optimal-shrinkage covariance estimator) and the linear support vector machine performed best. The pattern-correlation classifier often performed similarly as those two classifiers. The nonlinear classifiers never performed better and sometimes significantly worse than the linear classifiers, suggesting overfitting. Defining response patterns by t-values (or in error-standard-deviation units) rather than by beta estimates (in % signal change) to define the patterns appeared advantageous. Cross-validation by a leave-one-stimulus-pair-out method gave higher accuracies than a leave-one-run-out method, suggesting that generalization to independent runs (which more safely ensures independence of the test set) is more challenging than generalization to novel stimuli within the same category. Independent selection of fewer more visually responsive voxels tended to yield better decoding performance for all classifiers. Normalizing mean and standard deviation of the response patterns either across stimuli or across voxels had no significant effect on decoding performance. Overall our results suggest that linear decoders based on t-value patterns may perform best in the present scenario of visual object representations measured for about 60-minutes per subject with 3T fMRI.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
The Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
Book Review: Pattern Recognition and Machine Learning
Nasrabadi, N. M. (2007) · Journal of Electronic Imaging · doi:10.1117/1.2819119 · Cited by 22,066
(2012) · Encyclopedia of the Sciences of Learning · doi:10.1007/978-1-4419-1428-6_5195 · Cited by 19,370
An Introduction to Support Vector Machines and Other Kernel-based Learning Methods
Cristianini, N., & Shawe-Taylor, J. (2000) · doi:10.1017/cbo9780511801389 · Cited by 13,855
Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond
Schölkopf, B., & Smola, A. J. (2001) · The MIT Press eBooks · doi:10.7551/mitpress/4175.001.0001 · Cited by 11,703
Russell, E. L., Chiang, L. H., & Braatz, R. D. (2000) · Advances in Industrial Control · doi:10.1007/978-1-4471-0409-4_3 · Cited by 7,862
An introduction to variable and feature selection
GuyonIsabelle, & ElisseeffAndré (2003) · Journal of Machine Learning Research · doi:10.5555/944919.944968 · Cited by 7,715
An Introduction to Variable and Feature Selection.
Guyon, I., & Elisseeff, A. (2003) · Cited by 6,576
The Nature of Statistical Learning Theory
Sain, S. R. (1996) · Technometrics · doi:10.1080/00401706.1996.10484565 · Cited by 5,434
Distributed and overlapping representations of faces and objects in ventral temporal cortex
Haxby, J. V., Gobbini, M. I., Furey, M. L., Ishai, A., Schouten, J. L., & Pietrini, P. (2001) · Science · doi:10.1126/science.1063736 · Cited by 3,940
Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms
Dietterich, T. G. (1998) · Neural Computation · doi:10.1162/089976698300017197 · Cited by 3,840
Representational similarity analysis-connecting the branches of systems neuroscience
Kriegeskorte, N. (2008) · Frontiers in Systems Neuroscience · doi:10.3389/neuro.06.004.2008 · Cited by 3,355
Self-citationAn Introduction to Support Vector Machines and Other Kernel‐based Learning Methods
(2001) · Kybernetes · doi:10.1108/k.2001.30.1.103.6 · Cited by 3,308
Circular analysis in systems neuroscience: the dangers of double dipping
Kriegeskorte, N., Simmons, W. K., Bellgowan, P. S. F., & Baker, C. I. (2009) · Nature Neuroscience · doi:10.1038/nn.2303 · Cited by 2,696
Self-citationPattern Classification (2nd ed.)
Duda, R. O., Hart, P. E., & Stork, D. G. (1999) · Cited by 2,520
Linear Systems Analysis of Functional Magnetic Resonance Imaging in Human V1
Boynton, G. M., Engel, S. A., Glover, G. H., & Heeger, D. J. (1996) · The Journal of Neuroscience · doi:10.1523/jneurosci.16-13-04207.1996 · Cited by 2,314
Beyond mind-reading: multi-voxel pattern analysis of fMRI data
Norman, K. A., Polyn, S. M., Detre, G. J., & Haxby, J. V. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.07.005 · Cited by 2,271
Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2005.848998 · Cited by 2,225
Information-based functional brain mapping
Kriegeskorte, N., Goebel, R., & Bandettini, P. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0600244103 · Cited by 2,113
Self-citationDecoding the visual and subjective contents of the human brain
Kamitani, Y., & Tong, F. (2005) · Nature Neuroscience · doi:10.1038/nn1444 · Cited by 1,829 · cited 3×
“A number of studies used raw fMRI responses as input (typically in percent signal change), defining the patterns by single time points or temporal block averages (Cox and Savoy, 2003; Mitchell et al., 2004; Haynes and Rees, 2005; Kamitani and Tong, 2005; LaConte et al., 2005).”
Decoding mental states from brain activity in humans
Haynes, J.-D., & Rees, G. (2006) · Nature Reviews Neuroscience · doi:10.1038/nrn1931 · Cited by 1,817
Ledoit, O., & Wolf, M. (2003) · Journal of Empirical Finance · doi:10.1016/s0927-5398(03)00007-0 · Cited by 1,627
Machine learning classifiers and fMRI: A tutorial overview
Pereira, F., Mitchell, T., & Botvinick, M. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.11.007 · Cited by 1,624
Schäfer, J., & Strimmer, K. (2005) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1175 · Cited by 1,561
Adaptive Computation and Machine Learning
(2012) · Boosting · doi:10.7551/mitpress/8291.003.0026 · Cited by 1,402
Matching Categorical Object Representations in Inferior Temporal Cortex of Man and Monkey
Kriegeskorte, N., Mur, M., Ruff, D. A., Kiani, R., Bodurka, J., Esteky, H., Tanaka, K., & Bandettini, P. A. (2008) · Neuron · doi:10.1016/j.neuron.2008.10.043 · Cited by 1,344
Self-citationIdentifying natural images from human brain activity
Kay, K. N., Naselaris, T., Prenger, R. J., & Gallant, J. L. (2008) · Nature · doi:10.1038/nature06713 · Cited by 1,286
Predicting Human Brain Activity Associated with the Meanings of Nouns
Mitchell, T. M., Shinkareva, S. V., Carlson, A., Chang, K.-M., Malave, V. L., Mason, R. A., & Just, M. A. (2008) · Science · doi:10.1126/science.1152876 · Cited by 1,180
Pattern Recognition and Machine Learning
Burr, T. (2008) · Journal of the American Statistical Association · doi:10.1198/jasa.2008.s236 · Cited by 1,102
Principles of Multivariate Analysis, A User's Perspective.
Kocherlakota, K., Kocherlakota, S., & Krzanowski, W. J. (1989) · Biometrics · doi:10.2307/2531791 · Cited by 1,080
Statistical Comparisons of Classifiers over Multiple Data Sets
DemšarJanez (2006) · Journal of Machine Learning Research · doi:10.5555/1248547.1248548 · Cited by 1,074
Cox, D. D., & Savoy, R. L. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00049-1 · Cited by 1,053
Inference for the Generalization Error
Nadeau, C., & Bengio, Y. (2003) · Machine Learning · doi:10.1023/a:1024068626366 · Cited by 1,026
Sparse multinomial logistic regression: fast algorithms and generalization bounds
Krishnapuram, B., Carin, L., Figueiredo, M. A. T., & Hartemink, A. J. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.127 · Cited by 877
Predicting the orientation of invisible stimuli from activity in human primary visual cortex
Haynes, J.-D., & Rees, G. (2005) · Nature Neuroscience · doi:10.1038/nn1445 · Cited by 867
Extracting information from neuronal populations: information theory and decoding approaches
Quian Quiroga, R., & Panzeri, S. (2009) · Nature Reviews Neuroscience · doi:10.1038/nrn2578 · Cited by 811
Mourão-Miranda, J., Bokde, A. L. W., Born, C., Hampel, H., & Stetter, M. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.06.070 · Cited by 704
Learning to Decode Cognitive States from Brain Images
Mitchell, T. M., Hutchinson, R., Niculescu, R. S., Pereira, F., Wang, X., Just, M., & Newman, S. (2004) · Machine Learning · doi:10.1023/b:mach.0000035475.85309.1b · Cited by 644
Nordhausen, K. (2009) · International Statistical Review · doi:10.1111/j.1751-5823.2009.00095_18.x · Cited by 637
De Martino, F., Valente, G., Staeren, N., Ashburner, J., Goebel, R., & Formisano, E. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.06.037 · Cited by 508
Individual faces elicit distinct response patterns in human anterior temporal cortex
Kriegeskorte, N., Formisano, E., Sorger, B., & Goebel, R. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0705654104 · Cited by 485
Self-citationPrinciples of multivariate analysis: a user's perspective
(1989) · Choice Reviews Online · doi:10.5860/choice.26-5111 · Cited by 417
Revealing representational content with pattern-information fMRI—an introductory guide
Mur, M., Bandettini, P. A., & Kriegeskorte, N. (2009) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsn044 · Cited by 414
Self-citationSupport vector machines for temporal classification of block design fMRI data
LACONTE, S., STROTHER, S., CHERKASSKY, V, ANDERSON, J., & HU, X. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.01.048 · Cited by 379
Analyzing for information, not activation, to exploit high-resolution fMRI
Kriegeskorte, N., & Bandettini, P. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.02.022 · Cited by 270
Self-citationHanson, S. J., Matsuka, T., & Haxby, J. V. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2004.05.020 · Cited by 258
Recollection- and familiarity-based decisions reflect memory strength
Wiesmann, M. (2008) · Frontiers in Systems Neuroscience · doi:10.3389/neuro.06.001.2008 · Cited by 175
Ku, S.-P., Gretton, A., Macke, J. H., & Logothetis, N. K. (2008) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2008.02.016 · Cited by 71
fMRI pattern classification using neuroanatomically constrained boosting
Martínez‐Ramón, M., Koltchinskii, V. I., Heileman, G. L., & Posse, S. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.01.022 · Cited by 65
Kriegeskorte, N., Bodurka, J., & Bandettini, P. A. (2008) · International Journal of Imaging Systems and Technology · doi:10.1002/ima.20166 · Cited by 17
Self-citation
Cited by
On the interpretation of weight vectors of linear models in multivariate neuroimaging
Haufe, S., Meinecke, F., Görgen, K., Dähne, S., Haynes, J.-D., Blankertz, B., & Bießmann, F. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.10.067 · Cited by 1,389
A Toolbox for Representational Similarity Analysis
Nili, H., Wingfield, C., Walther, A., Su, L., Marslen-Wilson, W., & Kriegeskorte, N. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003553 · Cited by 937
Self-citationNaselaris, T., Kay, K. N., Nishimoto, S., & Gallant, J. L. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.07.073 · Cited by 905
Less Is More: Expectation Sharpens Representations in the Primary Visual Cortex
Kok, P., Jehee, J. F. M., & de Lange, F. P. (2012) · Neuron · doi:10.1016/j.neuron.2012.04.034 · Cited by 798
Grootswagers, T., Wardle, S. G., & Carlson, T. A. (2017) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01068 · Cited by 727
Metadata
- Authors
- Misaki, M., Kim, Y., Bandettini, P. A., & Kriegeskorte, N.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2010-10
- Volume
- 53
- Issue
- 1
- Pages
- 103-118
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W1994900366
- Cited by
- 458
- References
- 52
- FWCI
- 15.57
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.