Decoding the visual and subjective contents of the human brain

Kamitani, Yukiyasu; Tong, Frank

doi:10.1038/nn1444

Cited by 1,829Visual perception and processing mechanismsFace Recognition and PerceptionNeural dynamics and brain function

Decoding the visual and subjective contents of the human brain

Open access

Kamitani, Yukiyasu, Tong, Frank·2005·Nature Neuroscience

DOI 10.1038/nn1444PMC PMC1808230

Open this paper in CoChat — free account

Abstract

The potential for human neuroimaging to read out the detailed contents of a person's mental state has yet to be fully explored. We investigated whether the perception of edge orientation, a fundamental visual feature, can be decoded from human brain activity measured with functional magnetic resonance imaging (fMRI). Using statistical algorithms to classify brain states, we found that ensemble fMRI signals in early visual areas could reliably predict on individual trials which of eight stimulus orientations the subject was seeing. Moreover, when subjects had to attend to one of two overlapping orthogonal gratings, feature-based attention strongly biased ensemble activity toward the attended orientation. These results demonstrate that fMRI activity patterns in early visual areas, including primary visual cortex (V1), contain detailed orientation information that can reliably predict subjective perception. Our approach provides a framework for the readout of fine-tuned representations in the human brain and their subjective contents.

Integrity signals

Registry

Crossref · 10.1038/nn1444

Cites

42 of 42 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

MVPA is more likely to reflect population codes across neurons and has greater sensitivity and specificity to particular types of mental events.
“MVPA is more likely to reflect population codes across neurons43,45,48, as they have demonstrably greater sensitivity and specificity to particular types of mental events17,31,32.”
From Separate neural representations for physical pain and social rejection (2014) · cites this paper as [31]

Statistical Learning Theory
Wu, Y., & Vapnik, V. N. (1999) · Technometrics · doi:10.2307/1271368 · Cited by 27,236 · see citing works
Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex
Hubel, D. H., & Wiesel, T. N. (1962) · The Journal of Physiology · doi:10.1113/jphysiol.1962.sp006837 · Cited by 13,680 · see citing works
Receptive fields and functional architecture of monkey striate cortex
Hubel, D. H., & Wiesel, T. N. (1968) · The Journal of Physiology · doi:10.1113/jphysiol.1968.sp008455 · Cited by 6,520 · see citing works
Distributed and overlapping representations of faces and objects in ventral temporal cortex
Haxby, J. V., Gobbini, M. I., Furey, M. L., Ishai, A., Schouten, J. L., & Pietrini, P. (2001) · Science · doi:10.1126/science.1063736 · Cited by 3,940 · see citing works
Perceptrons: An Introduction to Computational Geometry
Minsky, M., & Papert, S. A. (1969) · Cited by 3,273 · see citing works
Borders of Multiple Visual Areas in Humans Revealed by Functional Magnetic Resonance Imaging
Sereno, M. I., Dale, A. M., Reppas, J. B., Kwong, K. K., Belliveau, J. W., Brady, T. J., Rosen, B. R., & Tootell, R. B. H. (1995) · Science · doi:10.1126/science.7754376 · Cited by 2,658 · see citing works
A direct demonstration of functional specialization in human visual cortex
Zeki, S., Watson, J. D. G., Lueck, C. J., Friston, K. J., Christopher Kennard, C., & Frackowiak, R. S. J. (1991) · Journal of Neuroscience · doi:10.1523/jneurosci.11-03-00641.1991 · Cited by 1,717 · see citing works
Automated Image Registration: I. General Methods and Intrasubject, Intramodality Validation
Woods, R. P., Grafton, S. T., Holmes, C. J., Cherry, S. R., & Mazziotta, J. C. (1998) · Journal of Computer Assisted Tomography · doi:10.1097/00004728-199801000-00027 · Cited by 1,707 · see citing works
Retinotopic organization in human visual cortex and the spatial precision of functional MRI
Engel, S. A. (1997) · Cerebral Cortex · doi:10.1093/cercor/7.2.181 · Cited by 1,606 · see citing works
Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans
Wolpaw, J. R., & McFarland, D. J. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0403504101 · Cited by 1,512 · see citing works
Feature-based attention influences motion processing gain in macaque visual cortex
Treue, S., & Trujillo, J. C. M. (1999) · Nature · doi:10.1038/21176 · Cited by 1,465 · see citing works
Functional analysis of human MT and related visual cortical areas using magnetic resonance imaging
Tootell, R. B. H., Reppas, J. B., Kwong, K. K., Malach, R., Born, R. T., Brady, T., Rosen, B. R., & Belliveau, J. (1995) · Journal of Neuroscience · doi:10.1523/jneurosci.15-04-03215.1995 · Cited by 1,412 · see citing works
Area V5 of the Human Brain: Evidence from a Combined Study Using Positron Emission Tomography and Magnetic Resonance Imaging
Watson, J. D. G., Myers, R., Frackowiak, R. S. J., Hajnal, J. V., Woods, R. P., Mazziotta, J. C., Shipp, S. D., & Zeki, S. (1993) · Cerebral Cortex · doi:10.1093/cercor/3.2.79 · Cited by 1,235 · see citing works
Interactions Between Electrical Activity and Cortical Microcirculation Revealed by Imaging Spectroscopy: Implications for Functional Brain Mapping
Malonek, D., & Grinvald, A. (1996) · Science · doi:10.1126/science.272.5261.551 · Cited by 1,095 · see citing works
Functional magnetic resonance imaging (fMRI) “brain reading”: detecting and classifying distributed patterns of fMRI activity in human visual cortex
Cox, D., & Savoy, R. L. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00049-1 · Cited by 1,057 · see citing works
Attentional modulation of visual motion processing in cortical areas MT and MST
Treue, S., & Maunsell, J. H. R. (1996) · Nature · doi:10.1038/382539a0 · Cited by 1,025 · see citing works
The quest for consciousness: a neurobiological approach
(2004) · Choice Reviews Online · doi:10.5860/choice.42-1543 · Cited by 815 · see citing works
Object-based attention in the primary visual cortex of the macaque monkey
Roelfsema, P. R., Lamme, V. A. F., & Spekreijse, H. (1998) · Nature · doi:10.1038/26475 · Cited by 814 · see citing works
Information processing with population codes
Pouget, A., Dayan, P., & Zemel, R. S. (2000) · Nature reviews. Neuroscience · doi:10.1038/35039062 · Cited by 744 · see citing works
Neural correlates of consciousness in humans
Rees, G., Kreiman, G., & Koch, C. (2002) · Nature Reviews Neuroscience · doi:10.1038/nrn783 · Cited by 742 · see citing works
Connecting cortex to machines: recent advances in brain interfaces
Donoghue, J. P. (2002) · Nature Neuroscience · doi:10.1038/nn947 · Cited by 720 · see citing works
Global effects of feature-based attention in human visual cortex
Sàenz, M., Buračas, G. T., & Boynton, G. M. (2002) · Nature Neuroscience · doi:10.1038/nn876 · Cited by 609 · see citing works
Visual Perception: The Neurophysiological Foundations
Spillmann, L., & Werner, J. S. (1989) · Cited by 565 · see citing works
Cognitive neuroscience: Primary visual cortex and visual awareness
Tong, F. (2003) · Nature Reviews Neuroscience · doi:10.1038/nrn1055 · Cited by 507 · see citing works
Self-citation
Orientation selectivity, preference, and continuity in monkey striate cortex
Blasdel, G. G. (1992) · Journal of Neuroscience · doi:10.1523/jneurosci.12-08-03139.1992 · Cited by 506 · see citing works
Functional analysis of primary visual cortex (V1) in humans
Tootell, R. B. H., Hadjikhani, N. K., Vanduffel, W., Liu, A. K., Mendola, J. D., Sereno, M. I., & Dale, A. M. (1998) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.95.3.811 · Cited by 487 · see citing works
Visual attention: the where, what, how and why of saliency
Treue, S. (2003) · Current Opinion in Neurobiology · doi:10.1016/s0959-4388(03)00105-3 · Cited by 422 · see citing works
High-resolution mapping of iso-orientation columns by fMRI
Kim, D., Duong, T. Q., & Kim, S. (2000) · Nature Neuroscience · doi:10.1038/72109 · Cited by 393 · see citing works
An oblique effect in human primary visual cortex
Furmanski, C. S., & Engel, S. A. (2000) · Nature Neuroscience · doi:10.1038/75702 · Cited by 370 · see citing works
Patterns of Activity in the Categorical Representations of Objects
Carlson, T. A., Schrater, P., & He, S. (2003) · Journal of Cognitive Neuroscience · doi:10.1162/089892903322307429 · Cited by 273 · see citing works
Relationships between orientation-preference pinwheels, cytochrome oxidase blobs, and ocular-dominance columns in primate striate cortex.
Bartfeld, E., & Grinvald, A. (1992) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.89.24.11905 · Cited by 270 · see citing works
A theory for the use of visual orientation information which exploits the columnar structure of striate cortex
Paradiso, M. A. (1988) · Biological Cybernetics · doi:10.1007/bf00363954 · Cited by 244 · see citing works
Patterns of Activity in the Categorical Representations of Objects
Carlson, T. A., Schrater, P., & He, S. (2003) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2003.15.5.704 · Cited by 215 · see citing works
Long-Term Optical Imaging and Spectroscopy Reveal Mechanisms Underlying the Intrinsic Signal and Stability of Cortical Maps in V1 of Behaving Monkeys
Shtoyerman, E., Arieli, A., Slovin, H., Vanzetta, I., & Grinvald, A. (2000) · Journal of Neuroscience · doi:10.1523/jneurosci.20-21-08111.2000 · Cited by 213 · see citing works
THE PERCEPTION OF FORM
Wilson, H. R., Levi, D. M., Maffei, L., Rovamo, J. M., & DeValois, R. L. (1990) · Elsevier eBooks · doi:10.1016/b978-0-12-657675-7.50016-8 · Cited by 198 · see citing works
Orientation-Specific Adaptation in Human Visual Cortex
Boynton, G. M., & Finney, E. M. (2003) · Journal of Neuroscience · doi:10.1523/jneurosci.23-25-08781.2003 · Cited by 164 · see citing works
Task-dependent influences of attention on the activation of human primary visual cortex
Watanabe, T., Harner, A. M., Miyauchi, S., Sasaki, Y., Nielsen, M., Palomo, D., & Mukai, I. (1998) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.95.19.11489 · Cited by 157 · see citing works
The Organization of Orientation Selectivity Throughout Macaque Visual Cortex
Vanduffel, W. (2002) · Cerebral Cortex · doi:10.1093/cercor/12.6.647 · Cited by 124 · see citing works
Manifestation of scotomas created by transcranial magnetic stimulation of human visual cortex
Kamitani, Y., & Shinsuke Shimojo, A. (1999) · Nature Neuroscience · doi:10.1038/11245 · Cited by 104 · see citing works
Self-citation
Retinal ganglion cell dendritic fields in old-world monkeys are oriented radially
Schall, J. D., Perry, V. H., & Leventhal, A. G. (1986) · Brain Research · doi:10.1016/0006-8993(86)91037-1 · Cited by 93 · see citing works
Stroboscope motion: Effects of duration and interval1
Kahneman, D. J., & Wolman, R. E. (1970) · Perception & Psychophysics · doi:10.3758/bf03210195 · Cited by 55 · see citing works
Complementary global maps for orientation coding in upper and lower layers of the monkey's foveal striate cortex
Bauer, R., & Dow, B. M. (1989) · Experimental Brain Research · doi:10.1007/bf00248906 · Cited by 40 · see citing works

Flagged first, then by citations

Sorted by citations

Representational similarity analysis-connecting the branches of systems neuroscience
Kriegeskorte, N. (2008) · Frontiers in Systems Neuroscience · doi:10.3389/neuro.06.004.2008 · Cited by 3,355 · see citing works
Visual attention: The past 25 years
Carrasco, M. (2011) · Vision Research · doi:10.1016/j.visres.2011.04.012 · Cited by 2,462 · see citing works
Beyond mind-reading: multi-voxel pattern analysis of fMRI data
Norman, K. A., Polyn, S. M., Detre, G. J., & Haxby, J. V. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.07.005 · Cited by 2,271 · see citing works
Information-based functional brain mapping
Kriegeskorte, N., Goebel, R., & Bandettini, P. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0600244103 · Cited by 2,113 · see citing works
Decoding subject-driven cognitive states with whole-brain connectivity patterns
Shirer, W. R., Ryali, S., Rykhlevskaia, E., Menon, V., & Greicius, M. D. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhr099 · Cited by 1,843 · see citing works
Decoding mental states from brain activity in humans
Haynes, J., & Rees, G. E. (2006) · Nature reviews. Neuroscience · doi:10.1038/nrn1931 · Cited by 1,804 · see citing works
Unconscious determinants of free decisions in the human brain
Soon, C. S., Brass, M., Heinze, H.-J., & Haynes, J.-D. (2008) · Nature Neuroscience · doi:10.1038/nn.2112 · Cited by 1,741 · see citing works
Machine learning classifiers and fMRI: A tutorial overview
Pereira, F., Mitchell, T., & Botvinick, M. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.11.007 · Cited by 1,624 · see citing works
An fMRI-Based Neurologic Signature of Physical Pain
Wager, T. D., Atlas, L. Y., Lindquist, M. A., Roy, M., Woo, C.-W., & Kross, E. (2013) · New England Journal of Medicine · doi:10.1056/nejmoa1204471 · Cited by 1,597 · see citing works
A taxonomy of external and internal attention.
Chun, M. M., Golomb, J. D., & Turk-Browne, N. B. (2011) · Annual Review of Psychology · doi:10.1146/annurev.psych.093008.100427 · Cited by 1,472 · see citing works
Decoding reveals the contents of visual working memory in early visual areas
Harrison, S. A., & Tong, F. (2009) · Nature · doi:10.1038/nature07832 · Cited by 1,347 · see citing works
Self-citation
Matching Categorical Object Representations in Inferior Temporal Cortex of Man and Monkey
Kriegeskorte, N., Mur, M., Ruff, D. A., Kiani, R., Bodurka, J., Esteky, H., Tanaka, K., & Bandettini, P. A. (2008) · Neuron · doi:10.1016/j.neuron.2008.10.043 · Cited by 1,334 · see citing works
Closed-loop brain training: the science of neurofeedback
Sitaram, R., Ros, T., Stoeckel, L., Haller, S., Scharnowski, F., Lewis-Peacock, J., Weiskopf, N., Blefari, M. L., Rana, M., Oblak, E., et al. (2017) · Nature Reviews Neuroscience · doi:10.1038/nrn.2016.164 · Cited by 1,306 · see citing works
Identifying natural images from human brain activity
Kay, K., Naselaris, T., Prenger, R., & Gallant, J. L. (2008) · Nature · doi:10.1038/nature06713 · Cited by 1,272 · see citing works
Neural Predictors of Purchases
Knutson, B., Rick, S., Wimmer, G. E., Prelec, D., & Loewenstein, G. (2007) · Neuron · doi:10.1016/j.neuron.2006.11.010 · Cited by 1,171 · see citing works
Consciousness, accessibility, and the mesh between psychology and neuroscience
Block, N. (2007) · Behavioral and Brain Sciences · doi:10.1017/s0140525x07002786 · Cited by 1,146 · see citing works
Neuromarketing: the hope and hype of neuroimaging in business
Dan Ariely, C., & Berns, G. S. (2010) · Nature reviews. Neuroscience · doi:10.1038/nrn2795 · Cited by 1,112 · see citing works
Building better biomarkers: brain models in translational neuroimaging
Woo, C.-W., Chang, L. J., Lindquist, M. A., & Wager, T. D. (2017) · Nature Neuroscience · doi:10.1038/nn.4478 · Cited by 1,056 · see citing works
Reconstructing Visual Experiences from Brain Activity Evoked by Natural Movies
Nishimoto, S., Vu, A. T., Naselaris, T., Benjamini, Y., Yu, B., & Gallant, J. L. (2011) · Current Biology · doi:10.1016/j.cub.2011.08.031 · Cited by 933 · see citing works
A Toolbox for Representational Similarity Analysis
Nili, H., Wingfield, C., Walther, A., Su, L., Marslen‐Wilson, W. D., & Kriegeskorte, N. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003553 · Cited by 914 · see citing works
Representational geometry: integrating cognition, computation, and the brain
Kriegeskorte, N., & Kievit, R. (2013) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2013.06.007 · Cited by 898 · see citing works
Characterizing the dynamics of mental representations: the temporal generalization method
King, J.-R., & Dehaene, S. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.01.002 · Cited by 896 · see citing works
Encoding and decoding in fMRI
Naselaris, T., Kay, K., Nishimoto, S., & Gallant, J. L. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.07.073 · Cited by 894 · see citing works
The Distributed Nature of Working Memory
Christophel, T. B., Klink, P. C., Spitzer, B., Roelfsema, P. R., & Haynes, J.-D. (2017) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.12.007 · Cited by 882 · see citing works
Stimulus-Specific Delay Activity in Human Primary Visual Cortex
Serences, J. T., Ester, E. F., Vogel, E. K., & Awh, E. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02276.x · Cited by 833 · see citing works
Inferring mental states from neuroimaging data: from reverse inference to large-scale decoding
Poldrack, R. A. (2011) · Neuron · doi:10.1016/j.neuron.2011.11.001 · Cited by 821 · see citing works
Assessing and tuning brain decoders: Cross-validation, caveats, and guidelines
Varoquaux, G. P., Raamana, P. R., Engemann, D. A., Hoyos-Idrobo, A., Schwartz, Y., & Thirion, B. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.10.038 · Cited by 801 · see citing works
Less Is More: Expectation Sharpens Representations in the Primary Visual Cortex
Kok, P., Jehee, J. F. M., & de Lange, F. P. (2012) · Neuron · doi:10.1016/j.neuron.2012.04.034 · Cited by 798 · see citing works
Decoding Neural Representational Spaces Using Multivariate Pattern Analysis
Haxby, J. V., Connolly, A. C., & Guntupalli, J. S. (2014) · Annual Review of Neuroscience · doi:10.1146/annurev-neuro-062012-170325 · Cited by 717 · see citing works
Decoding Dynamic Brain Patterns from Evoked Responses: A Tutorial on Multivariate Pattern Analysis Applied to Time Series Neuroimaging Data
Grootswagers, T., Wardle, S. G., & Carlson, T. A. (2016) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_01068 · Cited by 712 · see citing works
Reading Hidden Intentions in the Human Brain
Haynes, J., Sakai, K., Rees, G. E., Gilbert, S. J., Frith, C., & Passingham, R. E. (2007) · Current Biology · doi:10.1016/j.cub.2006.11.072 · Cited by 695 · see citing works
Category-Specific Cortical Activity Precedes Retrieval During Memory Search
Polyn, S. M., Natu, V. S., Cohen, J. D., & Norman, K. A. (2005) · Science · doi:10.1126/science.1117645 · Cited by 690 · see citing works
Neural bases of binocular rivalry
Tong, F., Meng, M., & Blake, R. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.09.003 · Cited by 689 · see citing works
Self-citation
The neural basis of visual body perception
Peelen, M. V., & Downing, P. E. (2007) · Nature reviews. Neuroscience · doi:10.1038/nrn2195 · Cited by 686 · see citing works
See what you want to see: Motivational influences on visual perception
Balcetis, E., & Dunning, D. (2006) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.91.4.612 · Cited by 649 · see citing works
Shared memories reveal shared structure in neural activity across individuals
Chen, J., Leong, Y. C., Honey, C. J., Yong, C. H., Norman, K. A., & Hasson, U. (2017) · Nature Neuroscience · doi:10.1038/nn.4450 · Cited by 645 · see citing works
A Common, High-Dimensional Model of the Representational Space in Human Ventral Temporal Cortex
Haxby, J. V., Guntupalli, J. S., Connolly, A. C., Halchenko, Y. O., Conroy, B., Gobbini, M. I., Hanke, M., & Ramadge, P. J. (2011) · Neuron · doi:10.1016/j.neuron.2011.08.026 · Cited by 645 · see citing works
Introduction to machine learning for brain imaging
Lemm, S., Blankertz, B., Dickhaus, T., & Müller, K. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.11.004 · Cited by 626 · see citing works
Who “Is Saying What”? Brain-based decoding of human voice and speech
Formisano, E., De Martino, F., Bonte, M., & Goebel, R. (2008) · Science · doi:10.1126/science.1164318 · Cited by 599 · see citing works
Decoding and Reconstructing Color from Responses in Human Visual Cortex
Brouwer, G. J., & Heeger, D. J. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.3577-09.2009 · Cited by 586 · see citing works
High-field fMRI unveils orientation columns in humans
Yacoub, E. S., Harel, N., & Uǧurbil, K. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0804110105 · Cited by 564 · see citing works
Divide and conquer: A defense of functional localizers
Saxe, R., Brett, M., & Kanwisher, N. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2005.12.062 · Cited by 544 · see citing works
Visual image reconstruction from human brain activity using a combination of multiscale local image decoders.
Miyawaki, Y., Uchida, H., Yamashita, O., Sato, M.-A., Morito, Y., Tanabe, H. C., Sadato, N., & Kamitani, Y. (2008) · Neuron · doi:10.1016/j.neuron.2008.11.004 · Cited by 543 · see citing works
Self-citation
Cognitive computational neuroscience
Kriegeskorte, N., & Douglas, P. K. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0210-5 · Cited by 535 · see citing works
Shared representations for working memory and mental imagery in early visual cortex
Albers, A. M., Kok, P., Toni, I., Dijkerman, H. C., & de Lange, F. P. (2013) · Current Biology · doi:10.1016/j.cub.2013.05.065 · Cited by 528 · see citing works
Generic decoding of seen and imagined objects using hierarchical visual features
Horikawa, T., & Kamitani, Y. (2017) · Nature Communications · doi:10.1038/ncomms15037 · Cited by 514 · see citing works
Self-citation
Combining multivariate voxel selection and support vector machines for mapping and classification of fMRI spatial patterns
Martino, F. D., Valente, G., Staeren, N., Ashburner, J., Goebel, R., & Formisano, E. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.06.037 · Cited by 501 · see citing works
Bayesian Reconstruction of Natural Images from Human Brain Activity
Naselaris, T., Prenger, R., Kay, K., Oliver, M., & Gallant, J. L. (2009) · Neuron · doi:10.1016/j.neuron.2009.09.006 · Cited by 499 · see citing works
Neural decoding of visual imagery during sleep
Horikawa, T., Tamaki, M., Miyawaki, Y., & Kamitani, Y. (2013) · Science · doi:10.1126/science.1234330 · Cited by 498 · see citing works
Self-citation
Individual faces elicit distinct response patterns in human anterior temporal cortex
Kriegeskorte, N., Formisano, E., Sorger, B., & Goebel, R. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0705654104 · Cited by 477 · see citing works
PyMVPA: a Python Toolbox for Multivariate Pattern Analysis of fMRI Data
Hanke, M., Halchenko, Y. O., Sederberg, P. B., Hanson, S. J., Haxby, J. V., & Pollmann, S. (2009) · Neuroinformatics · doi:10.1007/s12021-008-9041-y · Cited by 468 · see citing works
Psychophysical magic: rendering the visible ‘invisible’
Kim, C.-Y., & Blake, R. (2005) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2005.06.012 · Cited by 458 · see citing works
Perceptual Learning Incepted by Decoded fMRI Neurofeedback Without Stimulus Presentation
Shibata, K., Watanabe, T., Sasaki, Y., & Kawato, M. (2011) · Science · doi:10.1126/science.1212003 · Cited by 456 · see citing works
Comparison of multivariate classifiers and response normalizations for pattern-information fMRI
Misaki, M., Kim, Y., Bandettini, P. A., & Kriegeskorte, N. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.05.051 · Cited by 454 · see citing works
Neuroethics
Levy, N. L. (2007) · Cambridge University Press eBooks · doi:10.1017/cbo9780511811890 · Cited by 425 · see citing works
PRoNTo: Pattern Recognition for Neuroimaging Toolbox
Schrouff, J., Rosa, M. J., Rondina, J. M., Marquand, A. F., Chu, C., Ashburner, J., Phillips, C. L. M., Richiardi, J., & Mourão-Miranda, J. (2013) · Neuroinformatics · doi:10.1007/s12021-013-9178-1 · Cited by 424 · see citing works
Supramodal Representations of Perceived Emotions in the Human Brain
Peelen, M. V., Atkinson, A. P., & Vuilleumier, P. O. (2010) · Journal of Neuroscience · doi:10.1523/jneurosci.2161-10.2010 · Cited by 417 · see citing works
Deficient approaches to human neuroimaging
Stelzer, J., Lohmann, G., Mueller, K., Buschmann, T., & Turner, R. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00462 · Cited by 413 · see citing works
Representational dynamics of object vision: The first 1000 ms
Carlson, T. A., Tovar, D. A., Alink, A., & Kriegeskorte, N. (2013) · Journal of Vision · doi:10.1167/13.10.1 · Cited by 413 · see citing works
The functional impact of mental imagery on conscious perception
Pearson, J., Clifford, C. W. G., & Tong, F. (2008) · Current Biology · doi:10.1016/j.cub.2008.05.048 · Cited by 409 · see citing works
Self-citation
Recruitment of an Area Involved in Eye Movements During Mental Arithmetic
Knops, A., Thirion, B., Hubbard, E. M., Michel, V., & Dehaene, S. (2009) · Science · doi:10.1126/science.1171599 · Cited by 404 · see citing works
Revealing representational content with pattern-information fMRI—an introductory guide
Mur, M., Bandettini, P. A., & Kriegeskorte, N. (2009) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsn044 · Cited by 404 · see citing works
Patterns of fMRI activity dissociate overlapping functional brain areas that respond to biological motion.
Peelen, M. V., Wiggett, A. J., & Downing, P. E. (2006) · Neuron · doi:10.1016/j.neuron.2006.02.004 · Cited by 402 · see citing works
A Primer on Pattern-Based Approaches to fMRI: Principles, Pitfalls, and Perspectives
Haynes, J.-D. (2015) · Neuron · doi:10.1016/j.neuron.2015.05.025 · Cited by 402 · see citing works
Convergence of spoken and written language processing in the superior temporal sulcus
Wilson, S. M., Bautista, A., & McCarron, A. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.12.068 · Cited by 399 · see citing works
Selective Activation of the Deep Layers of the Human Primary Visual Cortex by Top-Down Feedback
Kok, P., Bains, L. J., van Mourik, T., Norris, D. G., & de Lange, F. P. (2016) · Current Biology · doi:10.1016/j.cub.2015.12.038 · Cited by 397 · see citing works
How long to scan? The relationship between fMRI temporal signal to noise ratio and necessary scan duration
Murphy, K., Bodurka, J., & Bandettini, P. A. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.09.032 · Cited by 396 · see citing works
Feature-Based Attentional Modulations in the Absence of Direct Visual Stimulation
Serences, J. T., & Boynton, G. M. (2007) · Neuron · doi:10.1016/j.neuron.2007.06.015 · Cited by 395 · see citing works
Decoding the Nature of Emotion in the Brain
Kragel, P. A., & LaBar, K. S. (2016) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2016.03.011 · Cited by 388 · see citing works
Imaging retinotopic maps in the human brain
Wandell, B. A., & Winawer, J. A. (2010) · Vision Research · doi:10.1016/j.visres.2010.08.004 · Cited by 376 · see citing works
Decoding Patterns of Human Brain Activity
Tong, F., & Pratte, M. S. (2012) · Annual Review of Psychology · doi:10.1146/annurev-psych-120710-100412 · Cited by 375 · see citing works
Self-citation
Multivariate pattern analysis of fMRI: The early beginnings
Haxby, J. V. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.03.016 · Cited by 369 · see citing works
Applications of real-time fMRI
deCharms, R. C. (2008) · Nature reviews. Neuroscience · doi:10.1038/nrn2414 · Cited by 369 · see citing works
Enhanced Intersubject Correlations during Movie Viewing Correlate with Successful Episodic Encoding
Hasson, U., Furman, O., Clark, D., Dudai, Y., & Davachi, L. (2008) · Neuron · doi:10.1016/j.neuron.2007.12.009 · Cited by 368 · see citing works
A voxel-wise encoding model for early visual areas decodes mental images of remembered scenes
Naselaris, T., Olman, C. A., Stansbury, D. E., Uǧurbil, K., & Gallant, J. L. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.10.018 · Cited by 360 · see citing works
Inverse retinotopy: Inferring the visual content of images from brain activation patterns
Thirion, B., Duchesnay, É., Hubbard, E. M., Dubois, J., Poline, J., Bihan, D. L., & Dehaene, S. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.06.062 · Cited by 356 · see citing works
Decoding Seen and Attended Motion Directions from Activity in the Human Visual Cortex
Kamitani, Y., & Tong, F. (2006) · Current Biology · doi:10.1016/j.cub.2006.04.003 · Cited by 353 · see citing works
Self-citation
Eye-specific effects of binocular rivalry in the human lateral geniculate nucleus
Haynes, J., Deichmann, R., & Rees, G. E. (2005) · Nature · doi:10.1038/nature04169 · Cited by 349 · see citing works
Perceptual Learning: Toward a Comprehensive Theory
Watanabe, T., & Sasaki, Y. (2014) · Annual Review of Psychology · doi:10.1146/annurev-psych-010814-015214 · Cited by 348 · see citing works
The Future of Psychology: Connecting Mind to Brain
Barrett, L. F. (2009) · Perspectives on Psychological Science · doi:10.1111/j.1745-6924.2009.01134.x · Cited by 347 · see citing works
Decoding the content of visual short-term memory under distraction in occipital and parietal areas
Bettencourt, K. C., & Xu, Y. (2015) · Nature Neuroscience · doi:10.1038/nn.4174 · Cited by 343 · see citing works
Pattern Classification of Sad Facial Processing: Toward the Development of Neurobiological Markers in Depression
Fu, C. H. Y., Mourão-Miranda, J., Costafreda, S. G., Khanna, A., Marquand, A. F., Williams, S., & Brammer, M. J. (2007) · Biological Psychiatry · doi:10.1016/j.biopsych.2007.08.020 · Cited by 337 · see citing works
Natural Scene Categories Revealed in Distributed Patterns of Activity in the Human Brain
Walther, D. B., Caddigan, E., Fei-Fei, L., & Beck, D. M. (2009) · Journal of Neuroscience · doi:10.1523/jneurosci.0559-09.2009 · Cited by 336 · see citing works
Representational models: A common framework for understanding encoding, pattern-component, and representational-similarity analysis
Diedrichsen, J., & Kriegeskorte, N. (2017) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005508 · Cited by 336 · see citing works
A Sensitive and Specific Neural Signature for Picture-Induced Negative Affect
Chang, L. J., Gianaros, P. J., Manuck, S. B., Krishnan, A., & Wager, T. D. (2015) · PLoS Biology · doi:10.1371/journal.pbio.1002180 · Cited by 336 · see citing works
Beyond faces and modularity: the power of an expertise framework
Bukach, C. M., Gauthier, L., & Tarr, M. J. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.02.004 · Cited by 330 · see citing works
Predicting the Stream of Consciousness from Activity in Human Visual Cortex
Haynes, J., & Rees, G. E. (2005) · Current Biology · doi:10.1016/j.cub.2005.06.026 · Cited by 327 · see citing works
Top-down activation of shape-specific population codes in visual cortex during mental imagery
Stokes, M., Thompson, R., Cusack, R., & Duncan, J. (2009) · The Journal of Neuroscience · doi:10.1523/jneurosci.4657-08.2009 · Cited by 323 · see citing works
Numerical representation in the parietal lobes: Abstract or not abstract?
Kadosh, R. C., & Walsh, V. (2009) · Behavioral and Brain Sciences · doi:10.1017/s0140525x09990938 · Cited by 320 · see citing works
Sparse estimation automatically selects voxels relevant for the decoding of fMRI activity patterns
Yamashita, O., Sato, M.-A., Yoshioka, T., Tong, F., & Kamitani, Y. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.05.050 · Cited by 319 · see citing works
Self-citation
Deconstructing multivariate decoding for the study of brain function
Hebart, M. N., & Baker, C. I. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.08.005 · Cited by 315 · see citing works
Separate neural representations for physical pain and social rejection
Woo, C.-W., Koban, L., Kross, E., Lindquist, M. A., Banich, M. T., Ruzic, L., Andrews-Hanna, J. R., & Wager, T. D. (2014) · Nature Communications · doi:10.1038/ncomms6380 · Cited by 310 · see citing works
Decoding the charitable brain: empathy, perspective taking, and attention shifts differentially predict altruistic giving
Tusche, A., Böckler, A., Kanske, P., Trautwein, F.-M., & Singer, T. (2016) · The Journal of Neuroscience · doi:10.1523/jneurosci.3392-15.2016 · Cited by 309 · see citing works
Training Improves Multitasking Performance by Increasing the Speed of Information Processing in Human Prefrontal Cortex
Dux, P. E., Tombu, M. N., Harrison, S. A., Rogers, B. P., Tong, F., & Marois, R. (2009) · Neuron · doi:10.1016/j.neuron.2009.06.005 · Cited by 306 · see citing works
Self-citation
Decoding brain states from fMRI connectivity graphs
Richiardi, J., Eryilmaz, H., Schwartz, S., Vuilleumier, P. O., & Ville, D. V. D. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2010.05.081 · Cited by 303 · see citing works
Population coding of affect across stimuli, modalities and individuals
Chikazoe, J., Lee, D. H., Kriegeskorte, N., & Anderson, A. K. (2014) · Nature Neuroscience · doi:10.1038/nn.3749 · Cited by 303 · see citing works
From part- to whole-body ownership in the multisensory brain
Petkova, V. I., Björnsdotter, M., Gentile, G., Jonsson, T., Li, T.-Q., & Ehrsson, H. H. (2011) · Current Biology · doi:10.1016/j.cub.2011.05.022 · Cited by 301 · see citing works
Odor quality coding and categorization in human posterior piriform cortex
Howard, J. D., Plailly, J., Grueschow, M., Haynes, J., & Gottfried, J. A. (2009) · Nature Neuroscience · doi:10.1038/nn.2324 · Cited by 301 · see citing works
Distributed Representations in Memory: Insights from Functional Brain Imaging
Rissman, J., & Wagner, A. D. (2012) · Annual Review of Psychology · doi:10.1146/annurev-psych-120710-100344 · Cited by 299 · see citing works
Neural Encoding and Decoding with Deep Learning for Dynamic Natural Vision
Wen, H., Shi, J., Zhang, Y., Lu, K., Cao, J., & Liu, Z. (2017) · Cerebral Cortex · doi:10.1093/cercor/bhx268 · Cited by 297 · see citing works

Decoding visual perception from human brain activity
Kamitani, Y. (2010) · Frontiers in Neuroscience · doi:10.3389/conf.fnins.2010.13.00007
Self-citation
Decoding visual experience from the human brain
Kamitani, Y. (2012) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2393347.2393353
Self-citation
Pattern recognition of orientation-selective fMRI signals in the human visual cortex
Kamitani, Y., & Tong, F. (2004) · Journal of Vision · doi:10.1167/4.8.186 · Cited by 2 · see citing works
Self-citation
Identifying natural images from human brain activity
Kay, K., Naselaris, T., Prenger, R., & Gallant, J. L. (2008) · Nature · doi:10.1038/nature06713 · Cited by 1,272 · see citing works
Predicting the orientation of invisible stimuli from activity in human primary visual cortex
Haynes, J., & Rees, G. E. (2005) · Nature Neuroscience · doi:10.1038/nn1445 · Cited by 866 · see citing works

Authors: Kamitani, Y., & Tong, F.
Affiliations: Advanced Telecommunications Research Institute International (JP)
Vanderbilt University (US)
Corresponding author: Kamitani, Yukiyasu
ORCID: Kamitani, Yukiyasu
Tong, Frank
Venue: Nature Neuroscience
Publisher: Springer Science and Business Media LLC
Published: 2005-04-24
Volume: 8
Issue: 5
Pages: 679-685
ISSN: 1097-6256 (ISSN-L)
1546-1726
DOI: 10.1038/nn1444
PMC: PMC1808230
OpenAlex: W2036084760
Cited by: 1,829
References: 42
Citations by year: 2026: 46 · 2025: 76 · 2024: 64 · 2023: 63 · 2022: 65 · 2021: 86 · 2020: 65 · 2019: 91 · 2018: 83 · 2017: 113 · 2016: 100 · 2015: 99 · 2014: 111 · 2013: 119 · 2012: 107
FWCI: 30.12
Type: journal article
Language: en
Open access: green
www.ncbi.nlm.nih.gov
Licence: www.springer.com/tdm (tdm)
Locations: Nature Neuroscience (publishedVersion)
PubMed (publishedVersion)
PubMed Central (acceptedVersion)
Funders: National Institutes of Health
Japan Society for the Promotion of Science
National Institute of Information and Communications Technology
National Institute of Mental Health (P50 MH62196, P50MH062196)
National Eye Institute (R01-EY14202, R01EY014202)
Topics: Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
Life Sciences › Neuroscience › Cognitive Neuroscience › Face Recognition and Perception
Life Sciences › Neuroscience › Cognitive Neuroscience › Neural dynamics and brain function
Keywords: fMRI decoding, primary visual cortex, early visual areas, feature-based attention, orientation discrimination, visual perception
MeSH terms: Adult, Algorithms, Attention, Brain Mapping, Cognition, Evoked Potentials, Visual, Humans, Magnetic Resonance Imaging, Models, Neurological, Orientation, Pattern Recognition, Visual, Photic Stimulation, Visual Cortex, Visual Pathways, Visual Perception

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Decoding the visual and subjective contents of the human brain

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks