Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 112

The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.

Coding of Visual, Auditory, Rule, and Response Information in the Brain: 10 Years of Multivoxel Pattern Analysis

Woolgar, Alexandra, Jackson, Jade, Duncan, John · 2016 · Journal of Cognitive Neuroscience

Abstract

How is the processing of task information organized in the brain? Many views of brain function emphasize modularity, with different regions specialized for processing different types of information. However, recent accounts also highlight flexibility, pointing especially to the highly consistent pattern of frontoparietal activation across many tasks. Although early insights from functional imaging were based on overall activation levels during different cognitive operations, in the last decade many researchers have used multivoxel pattern analyses to interrogate the representational content of activations, mapping out the brain regions that make particular stimulus, rule, or response distinctions. Here, we drew on 100 searchlight decoding analyses from 57 published papers to characterize the information coded in different brain networks. The outcome was highly structured. Visual, auditory, and motor networks predominantly (but not exclusively) coded visual, auditory, and motor information, respectively. By contrast, the frontoparietal multiple-demand network was characterized by domain generality, coding visual, auditory, motor, and rule information. The contribution of the default mode network and voxels elsewhere was minor. The data suggest a balanced picture of brain organization in which sensory and motor networks are relatively specialized for information in their own domain, whereas a specific frontoparietal network acts as a domain-general “core” with the capacity to code many different aspects of a task.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1162/jocn_a_00981

Cites

24 of 24 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 94

  1. Alink, 2012, Auditory motion direction encoding in auditory cortex and high-level visual cortex, Human Brain Mapping, 33, 969, 10.1002/hbm.21263 · DOI
  2. Asaad, 1998, Neural activity in the primate prefrontal cortex during associative learning, Neuron, 21, 1399, 10.1016/S0896-6273(00)80658-3 · DOI · Paper page
  3. Azumo, 1984, Properties and distribution of auditory neurons in the dorsolateral prefrontal cortex of the alert monkey, Brain Research, 298, 343, 10.1016/0006-8993(84)91434-3 · DOI
  4. Badre, 2007, Functional magnetic resonance imaging evidence for a hierarchical organization of the prefrontal cortex, Journal of Cognitive Neuroscience, 19, 2082, 10.1162/jocn.2007.19.12.2082 · DOI · Paper page
  5. Billington, 2013, Cortical responses to congruent and incongruent stereo cues for objects on a collision path with the observer, Displays, 34, 114, 10.1016/j.displa.2012.10.008 · DOI
  6. Bode, 2013, Similar neural mechanisms for perceptual guesses and free decisions, Neuroimage, 65, 456, 10.1016/j.neuroimage.2012.09.064 · DOI
  7. Bode, 2012, The neural encoding of guesses in the human brain, Neuroimage, 59, 1924, 10.1016/j.neuroimage.2011.08.106 · DOI
  8. Bode, 2009, Decoding sequential stages of task preparation in the human brain, Neuroimage, 45, 606, 10.1016/j.neuroimage.2008.11.031 · DOI · Paper page
  9. Boets, 2013, Intact but less accessible phonetic representations in adults with dyslexia, Science, 342, 1251, 10.1126/science.1244333 · DOI · Paper page
  10. Bogler, 2011, Decoding successive computational stages of saliency processing, Current Biology, 21, 1667, 10.1016/j.cub.2011.08.039 · DOI
  11. Buckner, 2008, The brain's default network: Anatomy, function, and relevance to disease, Annals of the New York Academy of Sciences, 1124, 1, 10.1196/annals.1440.011 · DOI · Paper page
  12. Carlin, 2011, A head view-invariant representation of gaze direction in anterior superior temporal sulcus, Current Biology, 21, 1817, 10.1016/j.cub.2011.09.025 · DOI
  13. Carlin, 2012, Direction-sensitive codes for observed head turns in human superior temporal sulcus, Cerebral Cortex, 22, 735, 10.1093/cercor/bhr061 · DOI
  14. Carp, 2011, Age-related neural differentiation in the motor system, PLoS One, 6, 1, 10.1371/journal.pone.0029411 · DOI
  15. Christophel, 2012, Decoding the contents of visual short-term memory from human visual and parietal cortex, Journal of Neuroscience, 32, 12983, 10.1523/JNEUROSCI.0184-12.2012 · DOI · Paper page
  16. Clarke, 2014, Object-specific semantic coding in human perirhinal cortex, Journal of Neuroscience, 34, 4766, 10.1523/JNEUROSCI.2828-13.2014 · DOI · Paper page
  17. Clithero, 2011, Within- and cross-participant classifiers reveal different neural coding of information, Neuroimage, 56, 699, 10.1016/j.neuroimage.2010.03.057 · DOI
  18. Colas, 2014, Pre-existing brain states predict aesthetic judgments, Human Brain Mapping, 35, 2924, 10.1002/hbm.22374 · DOI
  19. Corbetta, 2002, Control of goal-directed and stimulus-driven attention in the brain, Nature Reviews Neuroscience, 3, 201, 10.1038/nrn755 · DOI · Paper page
  20. Crittenden, 2014, Task difficulty manipulation reveals multiple demand activity but no frontal lobe hierarchy, Cerebral Cortex, 24, 532, 10.1093/cercor/bhs333 · DOI
  21. Dosenbach, 2007, Distinct brain networks for adaptive and stable task control in humans, Proceedings of the National Academy of Sciences, U.S.A., 104, 11073, 10.1073/pnas.0704320104 · DOI · Paper page
  22. Duncan, 2006, EPS Mid-Career Award 2004: Brain mechanisms of attention, Quarterly Journal of Experimental Psychology (Hove), 59, 2, 10.1080/17470210500260674 · DOI · Paper page
  23. Ekman, 2012, Predicting errors from reconfiguration patterns in human brain networks, Proceedings of the National Academy of Sciences, U.S.A., 109, 16714, 10.1073/pnas.1207523109 · DOI
  24. Erez, 2015, Discrimination of visual categories based on behavioral relevance in widespread regions of frontoparietal cortex, Journal of Neuroscience, 35, 12383, 10.1523/JNEUROSCI.1134-15.2015 · DOI
  25. FitzGerald, 2014, Reward-related activity in ventral striatum is action contingent and modulated by behavioral relevance, Journal of Neuroscience, 34, 1271, 10.1523/JNEUROSCI.4389-13.2014 · DOI
  26. Fox, 2005, The human brain is intrinsically organized into dynamic, anticorrelated functional networks, Proceedings of the National Academy of Sciences, U.S.A., 102, 9673, 10.1073/pnas.0504136102 · DOI · Paper page
  27. Gilbert, 2012, Evaluative vs. trait representation in intergroup social judgments: Distinct roles of anterior temporal lobe and prefrontal cortex, Neuropsychologia, 50, 3600, 10.1016/j.neuropsychologia.2012.09.002 · DOI
  28. Giordano, 2013, Abstract encoding of auditory objects in cortical activity patterns, Cerebral Cortex, 23, 2025, 10.1093/cercor/bhs162 · DOI
  29. Greenberg, 2010, Control of spatial and feature-based attention in frontoparietal cortex, Journal of Neuroscience, 30, 14330, 10.1523/JNEUROSCI.4248-09.2010 · DOI · Paper page
  30. Grinband, 2011, The dorsal medial frontal cortex is sensitive to time on task, not response conflict or error likelihood, Neuroimage, 57, 303, 10.1016/j.neuroimage.2010.12.027 · DOI · Paper page
  31. Guo, 2012, Feature-independent neural coding of target detection during search of natural scenes, Journal of Neuroscience, 32, 9499, 10.1523/JNEUROSCI.5876-11.2012 · DOI
  32. Hampshire, 2012, Fractionating human intelligence, Neuron, 76, 1225, 10.1016/j.neuron.2012.06.022 · DOI · Paper page
  33. Harel, 2014, Task context impacts visual object processing differentially across the cortex, Proceedings of the National Academy of Sciences, U.S.A., 111, E962, 10.1073/pnas.1312567111 · DOI · Paper page
  34. Haynes, 2006, Decoding mental states from brain activity in humans, Nature Reviews Neuroscience, 7, 523, 10.1038/nrn1931 · DOI · Paper page
  35. Haynes, 2007, Reading hidden intentions in the human brain, Current Biology, 17, 323, 10.1016/j.cub.2006.11.072 · DOI · Paper page
  36. Hebart, 2012, Human visual and parietal cortex encode visual choices independent of motor plans, Neuroimage, 63, 1393, 10.1016/j.neuroimage.2012.08.027 · DOI
  37. Helfinstein, 2014, Predicting risky choices from brain activity patterns, Proceedings of the National Academy of Sciences, U.S.A., 111, 2470, 10.1073/pnas.1321728111 · DOI · Paper page
  38. Herrmann, 2012, Dissociable neural imprints of perception and grammar in auditory functional imaging, Human Brain Mapping, 33, 584, 10.1002/hbm.21235 · DOI
  39. Hoshi, 1998, Task-dependent selectivity of movement-related neuronal activity in the primate prefrontal cortex, Journal of Neurophysiology, 80, 3392, 10.1152/jn.1998.80.6.3392 · DOI
  40. Huang, 2014, Pre-existing brain states predict risky choices, Neuroimage, 101, 466, 10.1016/j.neuroimage.2014.07.036 · DOI
  41. Jiang, 2014, Auditory motion processing after early blindness, Journal of Vision, 14, 4, 10.1167/14.13.4 · DOI
  42. Jiang, 2014, Using neural pattern classifiers to quantify the modularity of conflict-control mechanisms in the human brain, Cerebral Cortex, 24, 1793, 10.1093/cercor/bht029 · DOI
  43. Kadohisa, 2013, Dynamic construction of a coherent attentional state in a prefrontal cell population, Neuron, 80, 235, 10.1016/j.neuron.2013.07.041 · DOI
  44. Kahnt, 2011, Perceptual learning and decision-making in human medial frontal cortex, Neuron, 70, 549, 10.1016/j.neuron.2011.02.054 · DOI · Paper page
  45. Kalberlah, 2011, Beyond topographic representation: Decoding visuospatial attention from local activity patterns in the human frontal cortex, Wiley Periodicals, 21, 201
  46. Kaplan, 2012, Multivariate pattern analysis reveals common neural patterns across individuals during touch observation, Neuroimage, 60, 204, 10.1016/j.neuroimage.2011.12.059 · DOI
  47. Klein, 2015, Representations of invariant musical categories are decodable by pattern analysis of locally distributed BOLD responses in superior temporal and intraparietal sulci, Cerebral Cortex, 25, 1947, 10.1093/cercor/bhu003 · DOI
  48. Kriegeskorte, 2006, Information-based functional brain mapping, Proceedings of the National Academy of Sciences, U.S.A., 103, 3863, 10.1073/pnas.0600244103 · DOI · Paper page
  49. Lee, 2011, Investigation of melodic contour processing in the brain using multivariate pattern-based fMRI, Neuroimage, 57, 292, 10.1016/j.neuroimage.2011.02.006 · DOI
  50. Lee, 2012, Categorical speech processing in Broca's area: An fMRI study using multivariate pattern-based analysis, Journal of Neuroscience, 32, 3942, 10.1523/JNEUROSCI.3814-11.2012 · DOI
  51. Li, 2012, Task-dependent uncertainty modulation of perceptual decisions in the human brain, European Journal of Neuroscience, 36, 3732, 10.1111/ejn.12006 · DOI
  52. Linden, 2012, Mapping brain activation and information during category-specific visual working memory, Journal of Neurophysiology, 107, 628, 10.1152/jn.00105.2011 · DOI
  53. Linke, 2011, Stimulus-specific suppression preserves information in auditory short-term memory, Proceedings of the National Academy of Sciences, U.S.A., 108, 12961, 10.1073/pnas.1102118108 · DOI
  54. Mayhew, 2013, Dissociable circuits for visual shape learning in the young and aging human brain, Frontiers in Human Neuroscience, 7, 75, 10.3389/fnhum.2013.00075 · DOI
  55. Mayhew, 2010, Learning shapes the representation of visual categories in the aging human brain, Journal of Cognitive Neuroscience, 22, 2899, 10.1162/jocn.2010.21415 · DOI
  56. McNamee, 2013, Category-dependent and category-independent goal-value codes in human ventromedial prefrontal cortex, Nature Neuroscience, 16, 479, 10.1038/nn.3337 · DOI · Paper page
  57. Merrill, 2012, Perception of words and pitch patterns in song and speech, Frontiers in Psychology, 3, 76, 10.3389/fpsyg.2012.00076 · DOI
  58. Mirabella, 2007, Neurons in area V4 of the macaque translate attended visual features into behaviorally relevant categories, Neuron, 54, 303, 10.1016/j.neuron.2007.04.007 · DOI
  59. Momennejad, 2012, Human anterior prefrontal cortex encodes the “what” and “when” of future intentions, Neuroimage, 61, 139, 10.1016/j.neuroimage.2012.02.079 · DOI
  60. Murawski, 2012, Led into temptation? Rewarding brand logos bias the neural encoding of incidental economic decisions, PLoS One, 7, e34155, 10.1371/journal.pone.0034155 · DOI
  61. Naghavi, 2005, Common fronto-parietal activity in attention, memory, and consciousness: Shared demands on integration?, Consciousness and Cognition, 14, 390, 10.1016/j.concog.2004.10.003 · DOI · Paper page
  62. Nee, 2012, Rostral-caudal gradients of abstraction revealed by multi-variate pattern analysis of working memory, Neuroimage, 63, 1285, 10.1016/j.neuroimage.2012.08.034 · DOI
  63. Niki, 1976, Prefrontal unit activity and delayed response: Relation to cue location versus direction of response, Brain Research, 105, 79, 10.1016/0006-8993(76)90924-0 · DOI · Paper page
  64. O'Reilly, 2010, The what and how of prefrontal cortical organization, Trends in Neurosciences, 33, 355, 10.1016/j.tins.2010.05.002 · DOI · Paper page
  65. Peelen, 2010, Supramodal representations of perceived emotions in the human brain, Journal of Neuroscience, 30, 10127, 10.1523/JNEUROSCI.2161-10.2010 · DOI · Paper page
  66. Peelen, 2012, Conceptual object representations in human anterior temporal cortex, Journal of Neuroscience, 32, 15728, 10.1523/JNEUROSCI.1953-12.2012 · DOI · Paper page
  67. Pollmann, 2014, The right temporo-parietal junction contributes to visual feature binding, Neuroimage, 101, 289, 10.1016/j.neuroimage.2014.07.021 · DOI
  68. Power, 2013, Control-related systems in the human brain, Current Opinion in Neurobiology, 23, 223, 10.1016/j.conb.2012.12.009 · DOI · Paper page
  69. Raichle, 2001, A default mode of brain function, Proceedings of the National Academy of Sciences, U.S.A., 98, 676, 10.1073/pnas.98.2.676 · DOI · Paper page
  70. Rao, 1997, Integration of what and where in the primate prefrontal cortex, Science, 276, 821, 10.1126/science.276.5313.821 · DOI · Paper page
  71. Reverberi, 2012, Compositionality of rule representations in human prefrontal cortex, Cerebral Cortex, 22, 1237, 10.1093/cercor/bhr200 · DOI
  72. Reverberi, 2012, Distributed representations of rule identity and rule order in human frontal cortex and striatum, Journal of Neuroscience, 32, 17420, 10.1523/JNEUROSCI.2344-12.2012 · DOI
  73. Riehle, 1994, Neuronal coding of stimulus–response association rules in the motor cortex, NeuroReport, 5, 2462, 10.1097/00001756-199412000-00014 · DOI
  74. Riehle, 1997, Neuronal correlates of sensorimotor association in stimulus–response compatibility, Journal of Experimental Psychology: Human Perception and Performance, 23, 1708
  75. Romanski, 2007, Representation and integration of auditory and visual stimuli in the primate ventral lateral prefrontal cortex, Cerebral Cortex, 17(Suppl. 1), i61, 10.1093/cercor/bhm099 · DOI · Paper page
  76. Seeley, 2007, Dissociable intrinsic connectivity networks for salience processing and executive control, Journal of Neuroscience, 27, 2349, 10.1523/JNEUROSCI.5587-06.2007 · DOI · Paper page
  77. Soon, 2013, Preparatory patterns of neural activity predict visual category search speed, Neuroimage, 66, 215, 10.1016/j.neuroimage.2012.10.036 · DOI
  78. Team, 2015, R: A language and environment for statistical computing
  79. Todd, 2013, Confounds in multivariate pattern analysis: Theory and rule representation case study, Neuroimage, 77, 157, 10.1016/j.neuroimage.2013.03.039 · DOI · Paper page
  80. Tzourio-Mazoyer, 2002, Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain, Neuroimage, 15, 273, 10.1006/nimg.2001.0978 · DOI · Paper page
  81. Vickery, 2011, Ubiquity and specificity of reinforcement signals throughout the human brain, Neuron, 72, 166, 10.1016/j.neuron.2011.08.011 · DOI · Paper page
  82. Wallis, 2001, Single neurons in prefrontal cortex encode abstract rules, Nature, 411, 953, 10.1038/35082081 · DOI · Paper page
  83. Weygandt, 2012, Diagnosing different binge-eating disorders based on reward-related brain activation patterns, Human Brain Mapping, 33, 2135, 10.1002/hbm.21345 · DOI
  84. White, 1999, Rule-dependent neuronal activity in the prefrontal cortex, Experimental Brain Research, 126, 315, 10.1007/s002210050740 · DOI · Paper page
  85. Wisniewski, 2015, The neural representation of voluntary task-set selection in dynamic environments, Cerebral Cortex, 25, 4715, 10.1093/cercor/bhu155 · DOI
  86. Woolgar, 2015, Flexible coding of task rules in frontoparietal cortex: An adaptive system for flexible cognitive control, Journal of Cognitive Neuroscience, 27, 1895, 10.1162/jocn_a_00827 · DOI
  87. Woolgar, 2014, Coping with confounds in multivoxel pattern analysis: What should we do about reaction time differences? A comment on Todd, Nystrom & Cohen 2013, Neuroimage, 98, 506, 10.1016/j.neuroimage.2014.04.059 · DOI
  88. Woolgar, 2011, Adaptive coding of task-relevant information in human frontoparietal cortex, Journal of Neuroscience, 31, 14592, 10.1523/JNEUROSCI.2616-11.2011 · DOI · Paper page
  89. Woolgar, 2011, Multivoxel coding of stimuli, rules, and responses in human frontoparietal cortex, Neuroimage, 56, 744, 10.1016/j.neuroimage.2010.04.035 · DOI
  90. Woolgar, 2015, Attention enhances multivoxel representation of novel objects in frontal, parietal and visual cortices, Neuroimage, 109, 429, 10.1016/j.neuroimage.2014.12.083 · DOI
  91. Yeo, 2015, Functional specialization and flexibility in human association cortex, Cerebral Cortex, 25, 3654, 10.1093/cercor/bhu217 · DOI · Paper page
  92. Zhang, 2013, Choosing the rules: Distinct and overlapping frontoparietal representations of task rules for perceptual decisions, Journal of Neuroscience, 33, 11852, 10.1523/JNEUROSCI.5193-12.2013 · DOI
  93. Zhang, 1997, Dynamics of single neuron activity in monkey primary motor cortex related to sensorimotor transformation, Journal of Neuroscience, 17, 2227, 10.1523/JNEUROSCI.17-06-02227.1997 · DOI
  94. Zheng, 2013, Multivoxel patterns reveal functionally differentiated networks underlying auditory feedback processing of speech, Journal of Neuroscience, 33, 4339, 10.1523/JNEUROSCI.6319-11.2013 · DOI

Cited by

See all 112

Metadata

Authors
Woolgar, A., Jackson, J., & Duncan, J.
Affiliations
  • 1Macquarie University, Sydney, Australia
  • 3MRC Cognition and Brain Sciences Unit, Cambridge, UK
Venue
Journal of Cognitive Neuroscience
Published
2016-10-01
Volume
28
Issue
10
Pages
1433-1454
ISSN
  • 0898-929X
  • 1530-8898
Cited by
112
References
24
Language
en

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.