The DOI matches its Crossref record; 86 of the 86 references it cites were found in a registry or an index.
THINGS: A database of 1,854 object concepts and more than 26,000 naturalistic object images
Open accessAbstract
In recent years, the use of a large number of object concepts and naturalistic object images has been growing strongly in cognitive neuroscience research. Classical databases of object concepts are based mostly on a manually curated set of concepts. Further, databases of naturalistic object images typically consist of single images of objects cropped from their background, or a large number of naturalistic images of varying quality, requiring elaborate manual image curation. Here we provide a set of 1,854 diverse object concepts sampled systematically from concrete picturable and nameable nouns in the American English language. Using these object concepts, we conducted a large-scale web image search to compile a database of 26,107 high-quality naturalistic images of those objects, with 12 or more object images per concept and all images cropped to square size. Using crowdsourcing, we provide higher-level category membership for the 27 most common categories and validate them by relating them to representations in a semantic embedding derived from large text corpora. Finally, by feeding images through a deep convolutional neural network, we demonstrate that they exhibit high selectivity for different object concepts, while at the same time preserving variability of different object images within each concept. Together, the THINGS database provides a rich resource of object concepts and object images and offers a tool for both systematic and large-scale naturalistic research in the fields of psychology, neuroscience, and computer science.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Microsoft COCO: Common Objects in Context
Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., & Zitnick, C. L. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10602-1_48 · Cited by 45,460
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
(2008) · Journal of Machine Learning Research · Cited by 33,051
Learning Multiple Layers of Features from Tiny Images
Krizhevsky, A. (2024) · doi:10.57702/zp44cu3g · Cited by 23,395
The pascal visual object classes (VOC) challenge
Everingham, M., Van Gool, L., Williams, C. K. I., Winn, J., & Zisserman, A. (2010) · International Journal of Computer Vision · doi:10.1007/s11263-009-0275-4 · Cited by 19,599
WordNet: An Electronic Lexical Database
Kilgarriff, A., & Fellbaum, C. (2000) · Language · doi:10.2307/417141 · Cited by 11,464
Snodgrass, J. G., & Vanderwart, M. (1980) · Journal of Experimental Psychology Human Learning & Memory · doi:10.1037//0278-7393.6.2.174 · Cited by 5,615
WordNet: An Electronic Lexical Database
(1998) · The MIT Press eBooks · doi:10.7551/mitpress/7287.001.0001 · Cited by 4,857
LabelMe: A Database and Web-Based Tool for Image Annotation
Russell, B. C., Torralba, A., Murphy, K. P., & Freeman, W. T. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0090-8 · Cited by 4,210
Places: A 10 Million Image Database for Scene Recognition
Zhou, B., Lapedriza, A., Khosla, A., Oliva, A., & Torralba, A. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2017.2723009 · Cited by 4,042
Distributed and overlapping representations of faces and objects in ventral temporal cortex
Haxby, J. V., Gobbini, M. I., Furey, M. L., Ishai, A., Schouten, J. L., & Pietrini, P. (2001) · Science · doi:10.1126/science.1063736 · Cited by 3,940
Speed of processing in the human visual system
Thorpe, S., Fize, D., & Marlot, C. (1996) · Nature · doi:10.1038/381520a0 · Cited by 3,538
Linguistic Regularities in Continuous Space Word Representations
Mikolov, T., Yih, W.-T., & Zweig, G. (2013) · North American Chapter of the Association for Computational Linguistics · Cited by 2,912
ImageNet: A large-scale hierarchical image database
Deng, J. H., Dong, W. F., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206848 · Cited by 2,714
Battig, W. F., & Montague, W. E. (1969) · Journal of Experimental Psychology · doi:10.1037/h0027577 · Cited by 2,570
Murphy, G. L. (2002) · The MIT Press eBooks · doi:10.7551/mitpress/1602.001.0001 · Cited by 2,505
(2007) · CaltechAUTHORS (California Institute of Technology) · Cited by 2,274
CATEGORY SPECIFIC SEMANTIC IMPAIRMENTS
WARRINGTON, E. K., & SHALLICE, T. (1984) · Brain · doi:10.1093/brain/107.3.829 · Cited by 2,217
Cohen, L., Dehaene, S., Naccache, L., Lehéricy, S., Dehaene-Lambertz, G., Hénaff, M.-A., & Michel, F. (2000) · Brain · doi:10.1093/brain/123.2.291 · Cited by 1,954
Performance-optimized hierarchical models predict neural responses in higher visual cortex
Yamins, D. L. K., Hong, H., Cadieu, C. F., Solomon, E. A., Seibert, D., & DiCarlo, J. J. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1403112111 · Cited by 1,924
Concreteness ratings for 40 thousand generally known English word lemmas
Brysbaert, M., Warriner, A. B., & Kuperman, V. (2014) · Behavior Research Methods · doi:10.3758/s13428-013-0403-5 · Cited by 1,821
Kuznetsova, A., Rom, H., Alldrin, N., Uijlings, J., Krasin, I., Pont-Tuset, J., Kamali, S., Popov, S., Malloci, M., Kolesnikov, A., et al. (2020) · International Journal of Computer Vision · doi:10.1007/s11263-020-01316-z · Cited by 1,738
Torralba, A., Oliva, A., Castelhano, M. S., & Henderson, J. M. (2006) · Psychological Review · doi:10.1037/0033-295x.113.4.766 · Cited by 1,639
The Representation of Object Concepts in the Brain
Martin, A. (2007) · Annual Review of Psychology · doi:10.1146/annurev.psych.57.102904.190143 · Cited by 1,591
Domain-Specific Knowledge Systems in the Brain: The Animate-Inanimate Distinction
Caramazza, A., & Shelton, J. R. (1998) · Journal of Cognitive Neuroscience · doi:10.1162/089892998563752 · Cited by 1,348
Matching Categorical Object Representations in Inferior Temporal Cortex of Man and Monkey
Kriegeskorte, N., Mur, M., Ruff, D. A., Kiani, R., Bodurka, J., Esteky, H., Tanaka, K., & Bandettini, P. A. (2008) · Neuron · doi:10.1016/j.neuron.2008.10.043 · Cited by 1,344
Identifying natural images from human brain activity
Kay, K. N., Naselaris, T., Prenger, R. J., & Gallant, J. L. (2008) · Nature · doi:10.1038/nature06713 · Cited by 1,286
Deep supervised, but not unsupervised, models may explain IT cortical representation
Khaligh-Razavi, S.-M., & Kriegeskorte, N. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003915 · Cited by 1,204
Visual long-term memory has a massive storage capacity for object details
Brady, T. F., Konkle, T., Alvarez, G. A., & Oliva, A. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0803390105 · Cited by 1,106
Semantic feature production norms for a large set of living and nonliving things
McRae, K., Cree, G. S., Seidenberg, M. S., & Mcnorgan, C. (2005) · Behavior Research Methods · doi:10.3758/bf03192726 · Cited by 1,068
The role of context in object recognition
Oliva, A., & Torralba, A. (2007) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2007.09.009 · Cited by 1,063
Huth, A. G., Nishimoto, S., Vu, A. T., & Gallant, J. L. (2012) · Neuron · doi:10.1016/j.neuron.2012.10.014 · Cited by 896
Fast Readout of Object Identity from Macaque Inferior Temporal Cortex
Hung, C. P., Kreiman, G., Poggio, T., & DiCarlo, J. J. (2005) · Science · doi:10.1126/science.1117593 · Cited by 854
The functional architecture of the ventral temporal cortex and its role in categorization
Grill-Spector, K., & Weiner, K. S. (2014) · Nature Reviews Neuroscience · doi:10.1038/nrn3747 · Cited by 837
Cichy, R. M., Khosla, A., Pantazis, D., Torralba, A., & Oliva, A. (2016) · Scientific Reports · doi:10.1038/srep27755 · Cited by 716
Brodeur, M. B., Dionne-Dostie, E., Montreuil, T., & Lepage, M. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010773 · Cited by 658
Ultra-rapid object detection with saccadic eye movements: Visual processing speed revisited
Kirchner, H., & Thorpe, S. J. (2006) · Vision Research · doi:10.1016/j.visres.2005.10.002 · Cited by 628
Category norms: An updated and expanded version of the Battig and Montague (1969) norms
Van Overschelde, J. P., Rawson, K. A., & Dunlosky, J. (2004) · Journal of Memory and Language · doi:10.1016/j.jml.2003.10.003 · Cited by 617
Corpus of Contemporary American English (COCA)
Davies, M. (2015) · Harvard Dataverse · doi:10.7910/dvn/amuduw · Cited by 579
Kuznetsova, A., Rom, H., Alldrin, N., Uijlings, J., Krasin, I., Pont-Tuset, J., Kamali, S., Popov, S., Malloci, M., Kolesnikov, A., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.00982 · Cited by 575
Concepts and Categories: A Cognitive Neuropsychological Perspective
Mahon, B. Z., & Caramazza, A. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.60.110707.163532 · Cited by 514
Kiani, R., Esteky, H., Mirpour, K., & Tanaka, K. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00024.2007 · Cited by 511
Bayesian Reconstruction of Natural Images from Human Brain Activity
Naselaris, T., Prenger, R. J., Kay, K. N., Oliver, M., & Gallant, J. L. (2009) · Neuron · doi:10.1016/j.neuron.2009.09.006 · Cited by 511
Conceptual distinctiveness supports detailed visual long-term memory for real-world objects.
Konkle, T., Brady, T. F., Alvarez, G. A., & Oliva, A. (2010) · Journal of Experimental Psychology: General · doi:10.1037/a0019165 · Cited by 473
Bank of Standardized Stimuli (BOSS) Phase II: 930 New Normative Photos
Brodeur, M. B., Guérard, K., & Bouras, M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0106953 · Cited by 463
Deep Neural Networks as Scientific Models
Cichy, R. M., & Kaiser, D. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.01.009 · Cited by 454
The Representation of Biological Classes in the Human Brain
Connolly, A. C., Guntupalli, J. S., Gors, J., Hanke, M., Halchenko, Y. O., Wu, Y.-C., Abdi, H., & Haxby, J. V. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.5547-11.2012 · Cited by 410
Keuleers, E., Lacey, P., Rastle, K., & Brysbaert, M. (2012) · Behavior Research Methods · doi:10.3758/s13428-011-0118-4 · Cited by 390
Rust, N. C., & DiCarlo, J. J. (2010) · The Journal of Neuroscience · doi:10.1523/jneurosci.0179-10.2010 · Cited by 387
Liu, H., Agam, Y., Madsen, J. R., & Kreiman, G. (2009) · Neuron · doi:10.1016/j.neuron.2009.02.025 · Cited by 385
The Corpus of Contemporary American English
Kaltenböck, G., & Mustafa, O. (2024) · Reference Module in Social Sciences · doi:10.1016/b978-0-323-95504-1.00109-5 · Cited by 337
Toward a universal decoder of linguistic meaning from brain activation
Pereira, F., Lou, B., Pritchett, B., Ritter, S., Gershman, S. J., Kanwisher, N., Botvinick, M., & Fedorenko, E. (2018) · Nature Communications · doi:10.1038/s41467-018-03068-4 · Cited by 324
A natural approach to studying vision
Felsen, G., & Dan, Y. (2005) · Nature Neuroscience · doi:10.1038/nn1608 · Cited by 285
Neural mechanisms of rapid natural scene categorization in human visual cortex
Peelen, M. V., Fei-Fei, L., & Kastner, S. (2009) · Nature · doi:10.1038/nature08103 · Cited by 281
Dissociations and Associations between Shape and Category Representations in the Two Visual Pathways
Bracci, S., & Op de Beeck, H. (2016) · The Journal of Neuroscience · doi:10.1523/jneurosci.2314-15.2016 · Cited by 261
Adding part-of-speech information to the SUBTLEX-US word frequencies
Brysbaert, M., New, B., & Keuleers, E. (2012) · Behavior Research Methods · doi:10.3758/s13428-012-0190-4 · Cited by 255
Recall-to-Reject in Recognition: Evidence from ROC Curves
Rotello, C. M., Macmillan, N. A., & Van Tassel, G. (2000) · Journal of Memory and Language · doi:10.1006/jmla.1999.2701 · Cited by 229
A large-scale hierarchical image database
Deng, J. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · Cited by 229
Deep neural networks in computational neuroscience
Kietzmann, T. C., McClure, P., & Kriegeskorte, N. (2019) · Oxford Research Encyclopedia of Neuroscience · doi:10.1093/acrefore/9780190264086.013.46 · Cited by 186
fMRI Activity Patterns in Human LOC Carry Information about Object Exemplars within Category
Eger, E., Ashburner, J., Haynes, J.-D., Dolan, R. J., & Rees, G. (2008) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2008.20.2.356 · Cited by 184
The Centre for Speech, Language and the Brain (CSLB) concept property norms
Devereux, B. J., Tyler, L. K., Geertzen, J., & Randall, B. (2014) · Behavior Research Methods · doi:10.3758/s13428-013-0420-4 · Cited by 177
Tranel, D., Logan, C. G., Frank, R. J., & Damasio, A. R. (1997) · Neuropsychologia · doi:10.1016/s0028-3932(97)00086-9 · Cited by 177
Proklova, D., Kaiser, D., & Peelen, M. V. (2016) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00924 · Cited by 177
CORnet: Modeling the Neural Mechanisms of Core Object Recognition
Kubilius, J., Schrimpf, M., Nayebi, A., Bear, D., Yamins, D. L. K., & DiCarlo, J. J. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/408385 · Cited by 177
Toward direct visualization of the internal shape representation space by fMRI
Edelman, S., Grill-Spector, K., Kushnir, T., & Malach, R. (1998) · Psychobiology · doi:10.3758/bf03330618 · Cited by 168
Rice, G. E., Watson, D. M., Hartley, T., & Andrews, T. J. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.5265-13.2014 · Cited by 161
Jozwik, K. M., Kriegeskorte, N., Storrs, K. R., & Mur, M. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01726 · Cited by 161
Canonical visual size for real-world objects.
Konkle, T., & Oliva, A. (2010) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/a0020413 · Cited by 159
BOLD5000, a public fMRI dataset while viewing 5000 visual images
Chang, N., Pyles, J. A., Marcus, A., Gupta, A., Tarr, M. J., & Aminoff, E. M. (2019) · Scientific Data · doi:10.1038/s41597-019-0052-3 · Cited by 159
Bracci, S., Daniëls, N., & de Beeck, H. O. (2017) · Cerebral Cortex · doi:10.1093/cercor/bhw419 · Cited by 155
BOLD5000, a public fMRI dataset while viewing 5000 visual images
Chang, N., Pyles, J. A., Marcus, A., Gupta, A., Tarr, M., & Aminoff, E. (2019) · Figshare · doi:10.1184/r1/8097584 · Cited by 132
Comparison of Object Recognition Behavior in Human and Monkey
Rajalingham, R., Schmidt, K., & DiCarlo, J. J. (2015) · Journal of Neuroscience · doi:10.1523/jneurosci.0573-15.2015 · Cited by 122
Mid-level perceptual features distinguish objects of different real-world sizes.
Long, B., Konkle, T., Cohen, M. A., & Alvarez, G. A. (2015) · Journal of Experimental Psychology General · doi:10.1037/xge0000130 · Cited by 116
Baldassi, C., Alemi, A., Pagan, M., DiCarlo, J. J., Zecchina, R., & Zoccolan, D. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003167 · Cited by 110
A comparative analysis of serial and free recall
Klein, K. A., Addis, K. M., & Kahana, M. J. (2005) · Memory & Cognition · doi:10.3758/bf03193078 · Cited by 102
A Direct Demonstration of Functional Differences between Subdivisions of Human V5/MT+
Strong, S., Silson, E. H., Gouws, A. D., Morland, A. B., & McKeefry, D. J. (2016) · Cerebral Cortex · doi:10.1093/cercor/bhw362 · Cited by 92
De-Conflated Semantic Representations
Pilehvar, M. T., & Collier, N. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1174 · Cited by 89
A Review of Functional Imaging Studies on Category Specificity
Gerlach, C. (2007) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2007.19.2.296 · Cited by 77
Effect of typicality on online category verification of animate category exemplars in aphasia
Kiran, S., & Thompson, C. K. (2003) · Brain and Language · doi:10.1016/s0093-934x(03)00064-6 · Cited by 77
Proklova, D., KAISER, D. H., & Peelen, M. V. (2019) · NeuroImage · doi:10.1016/j.neuroimage.2019.03.028 · Cited by 72
Coggan, D. D., Liu, W., Baker, D. H., & Andrews, T. J. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.04.060 · Cited by 69
Getting real — sensory processing of natural stimuli
Einhäuser, W., & Peter König, B. (2010) · Current Opinion in Neurobiology · doi:10.1016/j.conb.2010.03.010 · Cited by 37
Cited by
Hebart, M. N., Zheng, C. Y., Pereira, F., & Baker, C. I. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-00951-3 · Cited by 297
Self-citationThe neuroconnectionist research programme
Doerig, A., Sommers, R. P., Seeliger, K., Richards, B., Ismael, J., Lindsay, G. W., Kording, K. P., Konkle, T., van Gerven, M. A. J., Kriegeskorte, N., et al. (2023) · Nature Reviews Neuroscience · doi:10.1038/s41583-023-00705-w · Cited by 233
Improving the accuracy of single-trial fMRI response estimates using GLMsingle
Prince, J. S., Charest, I., Kurzawski, J. W., Pyles, J. A., Tarr, M. J., & Kay, K. N. (2022) · eLife · doi:10.7554/elife.77599 · Cited by 174
An ecologically motivated image dataset for deep learning yields better models of human vision
Mehrer, J., Spoerer, C. J., Jones, E. C., Kriegeskorte, N., & Kietzmann, T. C. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2011417118 · Cited by 140
Brain-like functional specialization emerges spontaneously in deep neural networks
Dobs, K., Martinez, J., Kell, A. J. E., & Kanwisher, N. (2022) · Science Advances · doi:10.1126/sciadv.abl8913 · Cited by 129
“For object decoding, we selected 100 categories from the THINGS database (10 images each; 1000 images in total) (56) that were prototypical object categories and did not overlap with the 423 categories that the object CNN was trained on.”
Method
Metadata
- Authors
- Hebart, M. N., Dickter, A. H., Kidder, A., Kwok, W. Y., Corriveau, A., Van Wicklin, C., & Baker, C. I.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2019-10-15
- Volume
- 14
- Issue
- 10
- Pages
- e0223792
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2980938713
- Cited by
- 281
- References
- 86
- FWCI
- 15.95
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.