Extensive sampling for complete models of individual brains
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
In designing cognitive neuroscience experiments, resource limitations induce a fundamental trade-off between sampling variation across individual brains and sampling variation across experimental conditions. Here, we argue that extensive sampling of experimental conditions is essential for understanding how human brains process complex stimuli, that a model of how any one brain does this is likely to generalize to most other brains, and that introducing large numbers of subjects into an analysis pool is likely to introduce unnecessary and undesirable variance. Thus, contrary to conventional wisdom, we believe that sampling many individuals provides relatively few benefits and that extensive sampling of a limited number of subjects is more productive for revealing general principles. Furthermore, an emphasis on depth in individual brains is well-suited for capitalizing on the improvements in resolution and signal-to-noise ratio that are being achieved in modern neuroscientific measurement techniques.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
The WU-Minn Human Connectome Project: An overview
Van Essen, D. C., Smith, S. M., Barch, D. M., Behrens, T. E. J., Yacoub, E., & Ugurbil, K. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.05.041 · Cited by 5,651
A multi-modal parcellation of human cerebral cortex
Glasser, M. F., Coalson, T. S., Robinson, E. C., Hacker, C. D., Harwell, J., Yacoub, E., Ugurbil, K., Andersson, J., Beckmann, C. F., Jenkinson, M., et al. (2016) · Nature · doi:10.1038/nature18933 · Cited by 5,111 · cited 1×
“While surface-based approaches for registering cerebral cortex across individuals are more accurate than volume-based approaches [48,49], substantial variability still remains [50].”
BackgroundRepresentational similarity analysis-connecting the branches of systems neuroscience
Kriegeskorte, N. (2008) · Frontiers in Systems Neuroscience · doi:10.3389/neuro.06.004.2008 · Cited by 3,355
Natural Image Statistics and Neural Representation
Simoncelli, E. P., & Olshausen, B. A. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.1193 · Cited by 2,460 · cited 1×
“Furthermore, visual (and auditory) features are often highly correlated in stimuli, both natural [35] and synthetic [36], and it is difficult to isolate individual features [37].”
BackgroundNatural speech reveals the semantic maps that tile human cerebral cortex
Huth, A. G., de Heer, W. A., Griffiths, T. L., Theunissen, F. E., & Gallant, J. L. (2016) · Nature · doi:10.1038/nature17637 · Cited by 1,504 · cited 1×
“Beyond sensory processing, there is even some evidence that cortical organization of high-level task representations [21 ] and semantic processing [44] exhibits consistent structure across individuals.”
BackgroundPuzzlingly High Correlations in fMRI Studies of Emotion, Personality, and Social Cognition
Vul, E., Harris, C., Winkielman, P., & Pashler, H. (2009) · Perspectives on Psychological Science · doi:10.1111/j.1745-6924.2009.01125.x · Cited by 1,475
Scanning the horizon: towards transparent and reproducible neuroimaging research
Poldrack, R. A., Baker, C. I., Durnez, J., Gorgolewski, K. J., Matthews, P. M., Munafò, M. R., Nichols, T. E., Poline, J.-B., Vul, E., & Yarkoni, T. (2017) · Nature Reviews Neuroscience · doi:10.1038/nrn.2016.167 · Cited by 1,410
Precision Functional Mapping of Individual Human Brains
Gordon, E. M., Laumann, T. O., Gilmore, A. W., Newbold, D. J., Greene, D. J., Berg, J. J., Ortega, M., Hoyt-Drazen, C., Gratton, C., Sun, H., et al. (2017) · Neuron · doi:10.1016/j.neuron.2017.07.011 · Cited by 1,335
Visual field maps in human cortex.
Wandell, B. A., Dumoulin, S. O., & Brewer, A. A. (2007) · Neuron · doi:10.1016/j.neuron.2007.10.012 · Cited by 1,231 · cited 1×
“com such as retinotopic organization [40] and face-selectivity [41]—not only generalize across individuals, but for the most part generalize across species [42,43].”
BackgroundReconstructing Visual Experiences from Brain Activity Evoked by Natural Movies
Nishimoto, S., Vu, A. T., Naselaris, T., Benjamini, Y., Yu, B., & Gallant, J. L. (2011) · Current Biology · doi:10.1016/j.cub.2011.08.031 · Cited by 933 · cited 1×
“Selected publications include Biobank [4 ], BOLD5000 [5 ], CNeuroMod [6 ], Doctor Who [7 ], Dynamic Natural Vision [8], Generic Object Decoding [9], HCP [10], HCP 7T Retinotopy [11 ], IBC [12], Midnight Scan Club [13 ], MOUS [14 ], MyConnectome [15], Narratives [16 ], Naturalistic Neuroimaging Database [17], NSD [18 ]…”
BackgroundSelf-citationSmith, S. M., Nichols, T. E., Vidaurre, D., Winkler, A. M., Behrens, T. E. J., Glasser, M. F., Ugurbil, K., Barch, D. M., Van Essen, D. C., & Miller, K. L. (2015) · Nature Neuroscience · doi:10.1038/nn.4125 · Cited by 859 · cited 1×
“For these purposes, studies involving large numbers of subjects are appropriate and may be highly useful for developing predictive biomarkers for various behavioral phenotypes [61].”
BackgroundVision as Bayesian inference: analysis by synthesis?
Yuille, A., & Kersten, D. (2006) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2006.05.002 · Cited by 849
Estimating sample size in functional MRI (fMRI) neuroimaging studies: Statistical power analyses
Desmond, J. E., & Glover, G. H. (2002) · Journal of Neuroscience Methods · doi:10.1016/s0165-0270(02)00121-8 · Cited by 716
Parcellations and Hemispheric Asymmetries of Human Cerebral Cortex Analyzed on Surface-Based Atlases
Van Essen, D. C., Glasser, M. F., Dierker, D. L., Harwell, J., & Coalson, T. (2012) · Cerebral Cortex · doi:10.1093/cercor/bhr291 · Cited by 616 · cited 1×
“While surface-based approaches for registering cerebral cortex across individuals are more accurate than volume-based approaches [48,49], substantial variability still remains [50].”
BackgroundDivide and conquer: A defense of functional localizers
Saxe, R., Brett, M., & Kanwisher, N. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2005.12.062 · Cited by 544 · cited 1×
“subjects [51] or characterizing activity at a more abstract level before averaging [16 ,52,53], but these strategies come with their own limitations.”
BackgroundNeural decoding of visual imagery during sleep
Horikawa, T., Tamaki, M., Miyawaki, Y., & Kamitani, Y. (2013) · Science · doi:10.1126/science.1234330 · Cited by 498
Integrative benchmarking to advance neurally mechanistic models of human intelligence
Schrimpf, M., Kubilius, J., Lee, M. J., Ratan Murty, N. A., Ajemian, R., & DiCarlo, J. J. (2020) · Neuron · doi:10.1016/j.neuron.2020.07.040 · Cited by 233 · cited 1×
“In particular, we are excited by the prospect of different research groups comparing different models and analyses on common benchmark datasets [70 ,71].”
MethodUsing neuroscience to develop artificial intelligence
Ullman, S. (2019) · Science · doi:10.1126/science.aau6595 · Cited by 231
Leveraging shared connectivity to aggregate heterogeneous datasets into a common response space
Nastase, S. A., Liu, Y.-F., Hillman, H., Norman, K. A., & Hasson, U. (2020) · NeuroImage · doi:10.1016/j.neuroimage.2020.116865 · Cited by 42 · cited 1×
“subjects [51] or characterizing activity at a more abstract level before averaging [16 ,52,53], but these strategies come with their own limitations.”
Background
Cited by
A massive 7T fMRI dataset to bridge cognitive neuroscience and artificial intelligence
Allen, E. J., St-Yves, G., Wu, Y., Breedlove, J. L., Prince, J. S., Dowdle, L. T., Nau, M., Caron, B., Pestilli, F., Charest, I., et al. (2022) · Nature Neuroscience · doi:10.1038/s41593-021-00962-x · Cited by 577
Self-citationThe Human Connectome Project: A retrospective
Elam, J. S., Glasser, M. F., Harms, M. P., Sotiropoulos, S. N., Andersson, J. L. R., Burgess, G. C., Curtiss, S. W., Oostenveld, R., Larson-Prior, L. J., Schoffelen, J.-M., et al. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118543 · Cited by 307
Frontostriatal salience network expansion in individuals in depression
Lynch, C. J., Elbau, I. G., Ng, T., Ayaz, A., Zhu, S., Wolk, D., Manfredi, N., Johnson, M., Chang, M., Chou, J., et al. (2024) · Nature · doi:10.1038/s41586-024-07805-2 · Cited by 271
Self-citationThe neuroconnectionist research programme
Doerig, A., Sommers, R. P., Seeliger, K., Richards, B., Ismael, J., Lindsay, G. W., Kording, K. P., Konkle, T., van Gerven, M. A. J., Kriegeskorte, N., et al. (2023) · Nature Reviews Neuroscience · doi:10.1038/s41583-023-00705-w · Cited by 233
Improving the accuracy of single-trial fMRI response estimates using GLMsingle
Prince, J. S., Charest, I., Kurzawski, J. W., Pyles, J. A., Tarr, M. J., & Kay, K. N. (2022) · eLife · doi:10.7554/elife.77599 · Cited by 174
Self-citation
Metadata
- Authors
- Naselaris, T., Allen, E., & Kay, K.
- Venue
- Current Opinion in Behavioral Sciences
- Publisher
- Elsevier BV
- Published
- 2021-08
- Volume
- 40
- Pages
- 45-51
- ISSN
- 2352-1546 (ISSN-L)
- OpenAlex
- W3127523145
- Cited by
- 145
- References
- 21
- FWCI
- 4.74
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.