THINGS-data, a multimodal collection of large-scale datasets for investigating object representations in human brain and behavior
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
Understanding object representations requires a broad, comprehensive sampling of the objects in our visual world with dense measurements of brain activity and behavior. Here, we present THINGS-data, a multimodal collection of large-scale neuroimaging and behavioral datasets in humans, comprising densely sampled functional MRI and magnetoencephalographic recordings, as well as 4.70 million similarity judgments in response to thousands of photographic images for up to 1,854 object concepts. THINGS-data is unique in its breadth of richly annotated objects, allowing for testing countless hypotheses at scale while assessing the reproducibility of previous findings. Beyond the unique insights promised by each individual dataset, the multimodality of THINGS-data allows combining datasets for a much broader view into object processing than previously possible. Our analyses demonstrate the high quality of the datasets and provide five examples of hypothesis-driven and data-driven applications. THINGS-data constitutes the core public release of the THINGS initiative ( https://things-initiative.org ) for bridging the gap between disciplines and the advancement of cognitive neuroscience.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473
AFNI: Software for analysis and visualization of functional magnetic resonance neuroimages
Cox, R. W. (1996) · Computers and Biomedical Research · doi:10.1006/cbmr.1996.0014 · Cited by 10,913
Cortical Surface-Based Analysis
Dale, A. M., Fischl, B., & Sereno, M. I. (1999) · NeuroImage · doi:10.1006/nimg.1998.0395 · Cited by 10,910
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515 · cited 1×
“…replicable results and highlighting that, despite known issues in the replicability of neuroscience and behavioral research ( Marek et al., 2022 ; Button et al., 2013 ; Open Science Collaboration, 2015 ), many previously reported findings are reliable and generalize across objects and images.”
ResultThe fusiform face area: a module in human extrastriate cortex specialized for face perception
Kanwisher, N., McDermott, J., & Chun, M. M. (1997) · The Journal of Neuroscience · doi:10.1523/jneurosci.17-11-04302.1997 · Cited by 7,738 · cited 2×
“This finding is in line with many studies showing face-specific effects measured with fMRI in FFA ( Kanwisher et al., 1997 ; Grill-Spector et al., 2004 ; Tong et al., 2000 ) and a later dominance of high-level face responses ( Bentin et al., 1996 ; Deffke et al., 2007 ; Eimer, 2011 ; Wardle et al.,…”
BackgroundResultPower failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · cited 1×
“…replicable results and highlighting that, despite known issues in the replicability of neuroscience and behavioral research ( Marek et al., 2022 ; Button et al., 2013 ; Open Science Collaboration, 2015 ), many previously reported findings are reliable and generalize across objects and images.”
ResultDistributed and overlapping representations of faces and objects in ventral temporal cortex
Haxby, J. V., Gobbini, M. I., Furey, M. L., Ishai, A., Schouten, J. L., & Pietrini, P. (2001) · Science · doi:10.1126/science.1063736 · Cited by 3,940 · cited 1×
“The time series format is also not ideal for some data-driven techniques such as multivariate pattern analysis ( Haxby et al., 2001 ), representational similarity analysis ( Kriegeskorte et al., 2008a ), or dimensionality reduction techniques that require discrete data samples as inputs.”
MethodfMRIPrep: A robust preprocessing pipeline for functional MRI
Esteban, O., Markiewicz, C. J., Blair, R. W., Moodie, C. A., Isik, A. I., Erramuzpe, A., Kent, J. D., Goncalves, M., DuPre, E., Snyder, M., et al. (2019) · Nature Methods · doi:10.1038/s41592-018-0235-4 · Cited by 3,905
Large Scale GAN Training for High Fidelity Natural Image Synthesis
Brock, A., Donahue, J., & Simonyan, K. (2018) · arXiv · doi:10.48550/arxiv.1809.11096 · Cited by 3,717
Andersson, J. L. R., Skare, S., & Ashburner, J. (2003) · NeuroImage · doi:10.1016/s1053-8119(03)00336-7 · Cited by 3,469
Representational similarity analysis-connecting the branches of systems neuroscience
Kriegeskorte, N. (2008) · Frontiers in Systems Neuroscience · doi:10.3389/neuro.06.004.2008 · Cited by 3,355
SUN database: Large-scale scene recognition from abbey to zoo
Xiao, J., Hays, J., Ehinger, K. A., Oliva, A., & Torralba, A. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539970 · Cited by 3,283
A cortical area selective for visual processing of the human body
Downing, P. E., Jiang, Y., Shuman, M., & Kanwisher, N. (2001) · Science · doi:10.1126/science.1063414 · Cited by 2,043
Gorgolewski, K. J., Auer, T., Calhoun, V. D., Craddock, R. C., Das, S., Duff, E. P., Flandin, G., Ghosh, S. S., Glatard, T., Halchenko, Y. O., et al. (2016) · Scientific Data · doi:10.1038/sdata.2016.44 · Cited by 1,775 · cited 3×
“Functional magnetic resonance imaging data was deidentified ( Gulban et al., 2019 ), converted to the Brain Imaging Data Structure ( Gorgolewski et al., 2016 ) and preprocessed with fMRIPrep ( Esteban et al., 2019 ) (version 20.2.0).”
BackgroundMethodInfluentialSalimi-Khorshidi, G., Douaud, G., Beckmann, C. F., Glasser, M. F., Griffanti, L., & Smith, S. M. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.11.046 · Cited by 1,770
ICA-AROMA: A robust ICA-based strategy for removing motion artifacts from fMRI data
Pruim, R. H. R., Mennes, M., van Rooij, D., Llera, A., Buitelaar, J. K., & Beckmann, C. F. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.02.064 · Cited by 1,684
Signal timing across the macaque visual system
Schmolesky, M. T., Wang, Y., Hanes, D. P., Thompson, K. G., Leutgeb, S., Schall, J. D., & Leventhal, A. G. (1998) · Journal of Neurophysiology · doi:10.1152/jn.1998.79.6.3272 · Cited by 1,032 · cited 1×
“The results from all four MEG participants showed that V1 responses could be predicted by MEG activity starting within the first 100ms, corresponding to earlier MEG work ( Cichy et al., 2014 ; Cichy et al., 2015 ) and work in non-human primates ( Bullier, 2001 ; Schmolesky et al., 1998 ).”
BackgroundMagnetoencephalography for Brain Electrophysiology and Imaging
Baillet, S. (2017) · Nature Neuroscience · doi:10.1038/nn.4504 · Cited by 992
Resting-state fMRI confounds and cleanup
Murphy, K., Birn, R. M., & Bandettini, P. A. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.04.001 · Cited by 666 · cited 1×
“fMRI data contains noise due to head motion, pulse and heartbeat, respiration, as well as other physiological and scanner-related factors that can negatively impact downstream data analysis ( Murphy et al., 2013 ).”
BackgroundCognitive computational neuroscience
Kriegeskorte, N., & Douglas, P. K. (2018) · Nature Neuroscience · doi:10.1038/s41593-018-0210-5 · Cited by 535
Recurrence is required to capture the representational dynamics of the human visual system
Kietzmann, T. C., Spoerer, C. J., Sörensen, L. K. A., Cichy, R. M., Hauk, O., & Kriegeskorte, N. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1905544116 · Cited by 406 · cited 1×
“…between visual and more abstract semantic properties ( Bankson et al., 2018 ; Cichy et al., 2014 ; Clarke et al., 2013 ; Clarke et al., 2015 ), and that reveal the dynamics of feedforward and feedback processing ( Boring et al., 2022 ; Kietzmann et al., 2019 ; Mohsenzadeh et al., 2018 ).”
BackgroundA Primer on Pattern-Based Approaches to fMRI: Principles, Pitfalls, and Perspectives
Haynes, J.-D. (2015) · Neuron · doi:10.1016/j.neuron.2015.05.025 · Cited by 402
Cited by
DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Data
Fu, S., Tamir, N., Sundaram, S., Chai, L., Zhang, R., Dekel, T., & Isola, P. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-2208 · Cited by 108
Better artificial intelligence does not mean better models of biology
Linsley, D., Feng, P., & Serre, T. (2026) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2025.11.016 · Cited by 7
A 7T fMRI dataset of synthetic images for out-of-distribution modeling of vision
Gifford, A. T., Cichy, R. M., Naselaris, T., & Kay, K. (2026) · Nature Communications · doi:10.1038/s41467-026-69345-9 · Cited by 6
High-dimensional structure underlying individual differences in naturalistic visual experience
Han, C., & Bonner, M. F. (2026) · Current Biology · doi:10.1016/j.cub.2025.12.039 · Cited by 5
Correcting Biased Centered Kernel Alignment Measures in Biological and Artificial Neural Networks
Murphy, A., Zylberberg, J., & Fyshe, A. (2024) · arXiv · doi:10.48550/arxiv.2405.01012 · Cited by 1
“In order to test the effect of bias correction on CKA used as an alignment metric to quantify similarity of neural network responses with human neural data, we used images, fMRI and MEG responses from the THINGS dataset (Hebart et al., 2023).”
BackgroundMethod
Metadata
- Authors
- Hebart, M. N., Contier, O., Teichmann, L., Rockter, A. H., Zheng, C. Y., Kidder, A., Corriveau, A., Vaziri-Pashkam, M., & Baker, C. I.
- Venue
- eLife
- Publisher
- eLife Sciences Publications, Ltd
- Published
- 2023-02-27
- Volume
- 12
- ISSN
- 2050-084X (ISSN-L)
- OpenAlex
- W4322494696
- Cited by
- 161
- References
- 22
- FWCI
- 22.63
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.