The DOI matches its Crossref record; 72 of the 72 references it cites were found in a registry or an index.
Attribute-Based Classification for Zero-Shot Visual Object Categorization
Abstract
We study the problem of object recognition for categories for which we have no training examples, a task also called zero--data or zero-shot learning. This situation has hardly been studied in computer vision research, even though it occurs frequently; the world contains tens of thousands of different object classes, and image collections have been formed and suitably annotated for only a few of them. To tackle the problem, we introduce attribute-based classification: Objects are identified based on a high-level description that is phrased in terms of semantic attributes, such as the object's color or shape. Because the identification of each such property transcends the specific learning task at hand, the attribute classifiers can be prelearned independently, for example, from existing image data sets unrelated to the current task. Afterward, new classes can be detected based on their attribute representation, without the need for a new training phase. In this paper, we also introduce a new data set, Animals with Attributes, of over 30,000 images of 50 animal classes, annotated with 85 semantic attributes. Extensive experiments on this and two more data sets show that attribute-based classification indeed is able to categorize images without access to any training images of the target classes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 20,825
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
Learning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,172
Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Foundations
Rumelhart, D. E., McClelland, J. L., & AU (1986) · doi:10.7551/mitpress/5236.001.0001 · Cited by 15,686
Speeded-Up Robust Features (SURF)
Bay, H., Ess, A., Tuytelaars, T., & Van Gool, L. (2008) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2007.09.014 · Cited by 13,557
Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond
Schölkopf, B., & Smola, A. J. (2001) · The MIT Press eBooks · doi:10.7551/mitpress/4175.001.0001 · Cited by 11,703
Recognition-by-components: A theory of human image understanding.
Biederman, I. (1987) · Psychological Review · doi:10.1037/0033-295x.94.2.115 · Cited by 5,621
SUN database: Large-scale scene recognition from abbey to zoo
Xiao, J., Hays, J., Ehinger, K. A., Oliva, A., & Torralba, A. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539970 · Cited by 3,283
One-shot learning of object categories
Fei-Fei, L., Fergus, R., & Perona, P. (2006) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2006.79 · Cited by 3,029
A discriminatively trained, multiscale, deformable part model
Felzenszwalb, P., McAllester, D., & Ramanan, D. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587597 · Cited by 2,867
Solving Multiclass Learning Problems via Error-Correcting Output Codes
Dietterich, T. G., & Bakiri, G. (1995) · Journal of Artificial Intelligence Research · doi:10.1613/jair.105 · Cited by 2,739
Hierarchical Mixtures of Experts and the EM Algorithm
Jordan, M. I., & Jacobs, R. A. (1994) · Neural Computation · doi:10.1162/neco.1994.6.2.181 · Cited by 2,673
Murphy, G. L. (2002) · The MIT Press eBooks · doi:10.7551/mitpress/1602.001.0001 · Cited by 2,505
Object class recognition by unsupervised scale-invariant learning
Fergus, R., Perona, P., & Zisserman, A. (2003) · 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings. · doi:10.1109/cvpr.2003.1211479 · Cited by 2,023
Describing objects by their attributes
Farhadi, A., Endres, I., Hoiem, D., & Forsyth, D. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206772 · Cited by 1,917
Advances in Large-Margin Classifiers
(2000) · The MIT Press eBooks · doi:10.7551/mitpress/1113.001.0001 · Cited by 1,869
Learning to detect unseen object classes by between-class attribute transfer
Lampert, C. H., Nickisch, H., & Harmeling, S. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206594 · Cited by 1,849
Self-citationLarge Margin DAG's for Multiclass Classification
Platt, J. C., Cristianini, N., & Shawe-Taylor, J. S. (1999) · Cited by 1,674
In Defense of One-Vs-All Classification
Rifkin, R. M., & Junior, A. B. D. R. K. (2004) · Cited by 1,598
Scheirer, W. J., de Rezende Rocha, A., Sapkota, A., & Boult, T. E. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.256 · Cited by 1,573
Representing shape with a spatial pyramid kernel
Bosch, A., Zisserman, A., & Munoz, X. (2007) · Proceedings of the 6th ACM international conference on Image and video retrieval · doi:10.1145/1282280.1282340 · Cited by 1,399
The Representation and Matching of Pictorial Structures
Fischler, M. A., & Elschlager, R. A. (1973) · IEEE Transactions on Computers · doi:10.1109/t-c.1973.223602 · Cited by 1,322
Evaluation campaigns and TRECVid
Smeaton, A. F., Over, P., & Kraaij, W. (2006) · Proceedings of the 8th ACM international workshop on Multimedia information retrieval · doi:10.1145/1178677.1178722 · Cited by 1,224
Platt, J. C. (2000) · Advances in Large-Margin Classifiers · doi:10.7551/mitpress/1113.003.0008 · Cited by 1,156
Unsupervised Learning of Invariant Feature Hierarchies with Applications to Object Recognition
Ranzato, M., Huang, F. J., Boureau, Y.-L., & LeCun, Y. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383157 · Cited by 1,086
Matching Local Self-Similarities across Images and Videos
Shechtman, E., & Irani, M. (2007) · 2007 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2007.383198 · Cited by 1,076
In Defense of One-Vs-All Classification
RifkinRyan, & KlautauAldebaro (2004) · Journal of Machine Learning Research · doi:10.5555/1005332.1005336 · Cited by 891
Parikh, D., & Grauman, K. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126281 · Cited by 851
SUN attribute database: Discovering, annotating, and recognizing scene attributes
Patterson, G., & Hays, J. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247998 · Cited by 836
Learning Color Names for Real-World Applications
van de Weijer, J., Schmid, C., Verbeek, J., & Larlus, D. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2009.2019809 · Cited by 709
Sharing Visual Features for Multiclass and Multiview Object Detection
Torralba, A., Murphy, K. P., & Freeman, W. T. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1055 · Cited by 700
Recognizing human actions by attributes
Liu, J., Kuipers, B., & Savarese, S. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995353 · Cited by 563
Learning systems of concepts with an infinite relational model
Kemp, C., Tenenbaum, J. B., Griffiths, T. L., Yamada, T., & Ueda, N. (2006) · Cited by 550
Baby talk: Understanding and generating simple image descriptions
Kulkarni, G., Premraj, V., Dhar, S., Li, S., Choi, Y., Berg, A. C., & Berg, T. L. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995466 · Cited by 521
LOCUS: learning object classes with unsupervised segmentation
Winn, J., & Jojic, N. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.148 · Cited by 520
Memory modulates color appearance
Hansen, T., Olkkonen, M., Walter, S., & Gegenfurtner, K. R. (2006) · Nature Neuroscience · doi:10.1038/nn1794 · Cited by 507
Boosting: foundations and algorithms
(2012) · Choice Reviews Online · doi:10.5860/choice.50-2112 · Cited by 505
Sloman, S. A. (1993) · Cognitive Psychology · doi:10.1006/cogp.1993.1006 · Cited by 494
Describable Visual Attributes for Face Verification and Image Search
Kumar, N., Berg, A., Belhumeur, P. N., & Nayar, S. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.48 · Cited by 434
Boosting: Foundations and Algorithms
Schapire, R. E., & Freund, Y. (2012) · The MIT Press eBooks · doi:10.7551/mitpress/8291.001.0001 · Cited by 417
Learning from one example through shared densities on transforms
Miller, M. G., Matsakis, N. E., & Viola, P. A. (2002) · Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662) · doi:10.1109/cvpr.2000.855856 · Cited by 413
Automatic Attribute Discovery and Characterization from Noisy Web Data
Berg, T. L., Berg, A. C., & Shih, J. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15549-9_48 · Cited by 411
Efficient Object Category Recognition Using Classemes
Torresani, L., Szummer, M., & Fitzgibbon, A. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15549-9_56 · Cited by 409
Zero-data learning of new tasks
Larochelle, H., Erhan, D., & Bengio, Y. (2008) · Cited by 406
Ferrari, V., & Zisserman, A. (2007) · Cited by 387
FaceTracer: A Search Engine for Large Collections of Images with Faces
Kumar, N., Belhumeur, P., & Nayar, S. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88693-8_25 · Cited by 368
Knuth, D. E. (1992) · American Mathematical Monthly · doi:10.2307/2325085 · Cited by 367
WhittleSearch: Image search with relative attribute feedback
Kovashka, A., Parikh, D., & Grauman, K. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248026 · Cited by 296
Combining randomization and discrimination for fine-grained image categorization
Yao, B., Khosla, A., & Fei-Fei, L. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995368 · Cited by 288
What helps where – and why? Semantic relatedness for knowledge transfer
Rohrbach, M., Stark, M., Szarvas, G., Gurevych, I., & Schiele, B. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540121 · Cited by 273
Evaluation of color descriptors for object and scene recognition
van de Sande, K. E. A., Gevers, T., & Snoek, C. G. M. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587658 · Cited by 235
A Discriminative Latent Model of Object Classes and Attributes
Wang, Y., & Mori, G. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15555-0_12 · Cited by 218
Interactively building a discriminative vocabulary of nameable attributes
Parikh, D., & Grauman, K. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995451 · Cited by 203
Learning Models for Object Recognition from Natural Language Descriptions
Wang, J., Markert, K., & Everingham, M. (2009) · Procedings of the British Machine Vision Conference 2009 · doi:10.5244/c.23.2 · Cited by 201
Cross-Generalization: Learning Novel Classes from a Single Example by Feature Replacement
Bart, E., & Ullman, S. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.117 · Cited by 196
Multi-attribute spaces: Calibration for attribute fusion and similarity search
Scheirer, W. J., Kumar, N., Belhumeur, P. N., & Boult, T. E. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248021 · Cited by 169
Attribute-Based Transfer Learning for Object Categorization with Zero/One Training Example
Yu, X., & Aloimonos, Y. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15555-0_10 · Cited by 148
Objects as Attributes for Scene Classification
Li, L.-J., Su, H., Lim, Y., & Fei-Fei, L. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-35749-7_5 · Cited by 142
Kernel Methods in Computer Vision
Lampert, C. H. (2009) · Foundations and Trends® in Computer Graphics and Vision · doi:10.1561/0600000027 · Cited by 118
Self-citationAttributes for Classifier Feedback
Parkash, A., & Parikh, D. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33712-3_26 · Cited by 104
Osherson, D. N., Stern, J., Wilkie, O., Stob, M., & Smith, E. E. (1991) · Cognitive Science · doi:10.1207/s15516709cog1502_3 · Cited by 101
Augmented Attribute Representations
Sharmanska, V., Quadrianto, N., & Lampert, C. H. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33715-4_18 · Cited by 77
Self-citationYanai, ., & Barnard, K. (2005) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1101149.1101241 · Cited by 75
Learning models for object recognition
Felzenszwalb, P. F. (2005) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2001.990647 · Cited by 69
Attribute-based vehicle search in crowded surveillance videos
Feris, R., Siddiquie, B., Zhai, Y., Petterson, J., Brown, L., & Pankanti, S. (2011) · International Conference on Multimedia Retrieval · doi:10.1145/1991996.1992014 · Cited by 39
Beyond Dataset Bias: Multi-task Unaligned Shared Knowledge Transfer
Tommasi, T., Quadrianto, N., Barbara Caputo, B., & Lampert, C. H. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-37331-2_1 · Cited by 36
Self-citationOptimizing one-shot recognition with micro-set learning
Tang, K. D., Tappen, M. F., Sukthankar, R., & Lampert, C. H. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5540053 · Cited by 34
Self-citationExtrapolating human probability judgment
Osherson, D. N., Smith, E. E., Myers, T. S., Shafir, E. B., & Stob, M. (1994) · Theory and Decision · doi:10.1007/bf01079209 · Cited by 21
An Efficient Shared Multi-Class Detection Cascade
Zehnder, P., Koller-Meier, E., & Gool, L. V. (2008) · British Machine Vision Conference (BMVC) · doi:10.5244/c.22.80 · Cited by 15
Cited by
CNN Features Off-the-Shelf: An Astounding Baseline for Recognition
Razavian, A. S., Azizpour, H., Sullivan, J., & Carlsson, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.131 · Cited by 4,451
iCaRL: Incremental Classifier and Representation Learning
Rebuffi, S.-A., Kolesnikov, A., Sperl, G., & Lampert, C. H. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.587 · Cited by 3,988
Self-citationGenerative Adversarial Text to Image Synthesis
Reed, S., Akata, Z., Yan, X., Logeswaran, L., Schiele, B., & Lee, H. (2016) · arXiv · doi:10.48550/arxiv.1605.05396 · Cited by 2,494
Zero-Shot Learning—A Comprehensive Evaluation of the Good, the Bad and the Ugly
Xian, Y., Lampert, C. H., Schiele, B., & Akata, Z. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2857768 · Cited by 1,678
Self-citationDeep Metric Learning via Lifted Structured Feature Embedding
Song, H. O., Xiang, Y., Jegelka, S., & Savarese, S. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.434 · Cited by 1,630
Metadata
- Authors
- Lampert, C. H., Nickisch, H., & Harmeling, S.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2014-03
- Volume
- 36
- Issue
- 3
- Pages
- 453-465
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2128532956
- Cited by
- 1,627
- References
- 72
- FWCI
- 56.32
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.