The DOI matches its Crossref record; 77 of the 77 references it cites were found in a registry or an index.
Label-Embedding for Image Classification
Open accessAbstract
Attributes act as intermediate representations that enable parameter sharing between classes, a must when training data is scarce. We propose to view attribute-based image classification as a label-embedding problem: each class is embedded in the space of attribute vectors. We introduce a function that measures the compatibility between an image and a label embedding. The parameters of this function are learned on a training set of labeled samples to ensure that, given an image, the correct classes rank higher than the incorrect ones. Results on the Animals With Attributes and Caltech-UCSD-Birds datasets show that the proposed framework outperforms the standard Direct Attribute Prediction baseline in a zero-shot learning scenario. Label embedding enjoys a built-in ability to leverage alternative sources of information instead of or in addition to attributes, such as, e.g., class hierarchies or textual descriptions. Moreover, label embedding encompasses the whole range of learning settings from zero-shot learning to regular learning with a large number of labeled examples.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Blei, D. M., Ng, A. Y., & Jordan, M. I. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0082 · Cited by 12,223
Kernel Methods for Pattern Analysis
Shawe-Taylor, J., & Cristianini, N. (2004) · Cambridge University Press eBooks · doi:10.1017/cbo9780511809682 · Cited by 6,587
Error Detecting and Error Correcting Codes
Hamming, R. W. (1950) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1950.tb00463.x · Cited by 5,377
Probabilistic Latent Semantic Indexing
Hofmann, T. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130370 · Cited by 3,988
Probabilistic latent semantic indexing
Hofmann, T. (1999) · Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/312624.312649 · Cited by 3,976
ERROR DETECTING AND ERROR CORRECTING CODES
Chauhan, N., Yadav, P., & Kumari, P. (2014) · Cited by 3,270
Understanding Machine Learning: From Theory to Algorithms
Shalev-Shwartz, S., & Ben-David, S. (2014) · doi:10.1017/cbo9781107298019 · Cited by 3,115
Product Quantization for Nearest Neighbor Search
Jégou, H., Douze, M., & Schmid, C. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2010.57 · Cited by 2,956 · cited 1×
“This includes work on patch encoding (see [40] for a recent comparison), on kernel-based methods [41] with a recent focus on explicit embeddings [42], [43], on dimensionality reduction [41] and on compression [44], [45], [46].”
MethodSelf-citation(2015) · Cited by 2,857
Solving Multiclass Learning Problems via Error-Correcting Output Codes
Dietterich, T. G., & Bakiri, G. (1995) · Journal of Artificial Intelligence Research · doi:10.1613/jair.105 · Cited by 2,739
Improving the Fisher Kernel for Large-Scale Image Classification
Perronnin, F., Sánchez, J., & Mensink, T. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_11 · Cited by 2,588
Self-citationDeViSE: A Deep Visual-Semantic Embedding Model
Frome, A., Corrado, G. S., Shlens, J., Samy Bengio, A., Dean, J., Ranzato, M., & Mikolov, T. (2013) · Cited by 2,308
Describing objects by their attributes
Farhadi, A., Endres, I., Hoiem, D., & Forsyth, D. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206772 · Cited by 1,917
Large Margin Methods for Structured and Interdependent Output Variables
Tsochantaridis, I., Joachims, T., Hofmann, T., & Altün, Y. (2005) · MPG.PuRe (Max Planck Society) · Cited by 1,879
Learning to detect unseen object classes by between-class attribute transfer
Lampert, C. H., Nickisch, H., & Harmeling, S. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206594 · Cited by 1,849
Learning to detect unseen object classes by between-class attribute transfer
Lampert, C. H., Nickisch, H., & Harmeling, S. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206594 · Cited by 1,528
Image Classification with the Fisher Vector: Theory and Practice
Sánchez, J., Perronnin, F., Mensink, T., & Verbeek, J. (2013) · International Journal of Computer Vision · doi:10.1007/s11263-013-0636-x · Cited by 1,498
Self-citationPegasos: primal estimated sub-gradient solver for SVM
Shalev-Shwartz, S., Singer, Y., Srebro, N., & Cotter, A. (2011) · Mathematical Programming · doi:10.1007/s10107-010-0420-4 · Cited by 1,477
Attribute and simile classifiers for face verification
Kumar, N., Berg, A. C., Belhumeur, P. N., & Nayar, S. K. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459250 · Cited by 1,361
Im2Text: Describing Images Using 1 Million Captioned Photographs
Ordóñez, V., Kulkarni, G. A., & Berg, T. L. (2011) · neural information processing systems · Cited by 1,356
Zero-Shot Learning Through Cross-Modal Transfer
Socher, R., Ganjoo, M., Sridhar, H., Bastani, O., Manning, C. D., & Ng, A. Y. (2013) · arXiv · doi:10.48550/arxiv.1301.3666 · Cited by 997
The devil is in the details: an evaluation of recent feature encoding methods
Chatfield, K., Lempitsky, V., Vedaldi, A., & Zisserman, A. (2011) · Procedings of the British Machine Vision Conference 2011 · doi:10.5244/c.25.76 · Cited by 834
Evaluation of output embeddings for fine-grained image classification
Akata, Z., Reed, S., Walter, D., Lee, H., & Schiele, B. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298911 · Cited by 752
Self-citationZero-Shot Learning with Semantic Output Codes
Palatucci, M., Pomerleau, D., Hinton, G. E., & Mitchell, T. M. (2018) · Figshare · doi:10.1184/r1/6476456 · Cited by 752
Label-Embedding for Attribute-Based Classification
Akata, Z., Perronnin, F., Harchaoui, Z., & Schmid, C. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.111 · Cited by 618
Self-citationHuman action recognition by learning bases of action attributes and parts
Yao, B., Jiang, X., Khosla, A., Lin, A. L., Guibas, L., & Fei-Fei, L. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126386 · Cited by 609
Deterministic constructions of compressed sensing matrices
DeVore, R. (2007) · Journal of Complexity · doi:10.1016/j.jco.2007.04.002 · Cited by 591
Evaluation of Output Embeddings for Fine-grained Image Classification
Akata, Z., Reed, S., Walter, D., Lee, H., & Schiele, B. (2015) · Max Planck Digital Library · Cited by 567
Self-citationRecognizing human actions by attributes
Liu, J., Kuipers, B., & Savarese, S. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995353 · Cited by 563
Baby talk: Understanding and generating simple image descriptions
Kulkarni, G., Premraj, V., Dhar, S., Li, S., Choi, Y., Berg, A. C., & Berg, T. L. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995466 · Cited by 521
Error Detecting and Error Correcting Codes (1950)
Hamming, R. W. (2021) · Ideas That Created the Future · doi:10.7551/mitpress/12274.003.0015 · Cited by 429
Kernel Methods for Pattern Analysis
Breneman, J. (2005) · Technometrics · doi:10.1198/tech.2005.s264 · Cited by 426
Describing Clothing by Semantic Attributes
Chen, H., Gallagher, A., & Girod, B. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33712-3_44 · Cited by 411
Automatic Attribute Discovery and Characterization from Noisy Web Data
Berg, T. L., Berg, A. C., & Shih, J. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15549-9_48 · Cited by 411
Zero-data learning of new tasks
Larochelle, H., Erhan, D., & Bengio, Y. (2008) · Cited by 406
Visual Recognition with Humans in the Loop
Branson, S., Wah, C., Schroff, F., Babenko, B., Welinder, P., Perona, P., & Belongie, S. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_32 · Cited by 402
Large scale image annotation: learning to rank with joint word-image embeddings
Weston, J., Bengio, S., & Usunier, N. (2010) · Machine Learning · doi:10.1007/s10994-010-5198-3 · Cited by 399
Ferrari, V., & Zisserman, A. (2007) · Cited by 387
FaceTracer: A Search Engine for Large Collections of Images with Faces
Kumar, N., Belhumeur, P., & Nayar, S. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88693-8_25 · Cited by 368
Image ranking and retrieval based on multi-attribute queries
Siddiquie, B., Feris, R. S., & Davis, L. S. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995329 · Cited by 313
Evaluating knowledge transfer and zero-shot learning in a large-scale setting
Rohrbach, M., Stark, M., & Schiele, B. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995627 · Cited by 303
Label Embedding Trees for Large Multi-Class Tasks
Samy Bengio, A., Weston, J., & Grangier, D. (2010) · Cited by 298
Metric Learning for Large Scale Image Classification: Generalizing to New Classes at Near-Zero Cost
Mensink, T., Verbeek, J., Perronnin, F., & Csurka, G. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33709-3_35 · Cited by 281
Self-citationUncovering shared structures in multiclass classification
Amit, Y., Fink, M., Srebro, N., & Ullman, S. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273499 · Cited by 278
What helps where – and why? Semantic relatedness for knowledge transfer
Rohrbach, M., Stark, M., Szarvas, G., Gurevych, I., & Schiele, B. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5540121 · Cited by 273
High-dimensional signature compression for large-scale image classification
Sanchez, J., & Perronnin, F. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995504 · Cited by 272
Self-citationEfficient additive kernels via explicit feature maps
Vedaldi, A., & Zisserman, A. (2010) · 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2010.5539949 · Cited by 257
Multi-Label Prediction via Compressed Sensing
Hsu, D., Kakade, S. M., Langford, J. C., & Zhang, T. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0902.1284 · Cited by 245
Discovering localized attributes for fine-grained recognition
Duan, K., Parikh, D., Crandall, D., & Grauman, K. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248089 · Cited by 227
The Principal Components Analysis of a Graph, and Its Relationships to Spectral Clustering
Saerens, M., Fouss, F., Yen, L., & Dupont, P. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-30115-8_35 · Cited by 219
A Discriminative Latent Model of Object Classes and Attributes
Wang, Y., & Mori, G. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15555-0_12 · Cited by 218
Describing objects by their attributes
Farhadi, A., Endres, I., Hoiem, D., & Forsyth, D. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvprw.2009.5206772 · Cited by 208
Designing Category-Level Attributes for Discriminative Visual Recognition
Yu, F. X., Cao, L., Feris, R. S., Smith, J. R., & Chang, S.-F. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.105 · Cited by 195
COSTA: Co-Occurrence Statistics for Zero-Shot Classification
Mensink, T., Gavves, E., & Snoek, C. G. M. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.313 · Cited by 193
Multiclass recognition and part localization with humans in the loop
Wah, C., Branson, S., Perona, P., & Belongie, S. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126539 · Cited by 177
Combining attributes and Fisher vectors for efficient image retrieval
Douze, M., Ramisa, A., & Schmid, C. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995595 · Cited by 173
Self-citationAttribute-Based Transfer Learning for Object Categorization with Zero/One Training Example
Yu, X., & Aloimonos, Y. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15555-0_10 · Cited by 170
Multi-attribute spaces: Calibration for attribute fusion and similarity search
Scheirer, W. J., Kumar, N., Belhumeur, P. N., & Boult, T. E. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6248021 · Cited by 169
Max-margin additive classifiers for detection
Maji, S., & Berg, A. C. (2009) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2009.5459203 · Cited by 160
Ranking with ordered weighted pairwise classification
Usunier, N., Buffoni, D., & Gallinari, P. (2009) · International Conference on Machine Learning · doi:10.1145/1553374.1553509 · Cited by 153
Joint learning of visual attributes, object classes and visual saliency
Wang, G., & Forsyth, D. A. (2009) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2009.5459194 · Cited by 149
Weston, J., Chapelle, O., Elisseeff, A., Schölkopf, B., & Vapnik, V. N. (2002) · Cited by 148
Towards good practice in large-scale learning for image classification
Perronnin, F., Akata, Z., Harchaoui, Z., & Schmid, C. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6248090 · Cited by 114
Self-citationOsherson, D. N., Stern, J., Wilkie, O., Stob, M., & Smith, E. E. (1991) · Cognitive Science · doi:10.1207/s15516709cog1502_3 · Cited by 101
A joint learning framework for attribute models and object descriptions
Mahajan, D. K., Sellamanickam, S., & Nair, V. B. (2011) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2011.6126373 · Cited by 88
Sparse kernel approximations for efficient classification and detection
Vedaldi, A., & Zisserman, A. (2012) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2012.6247943 · Cited by 85
Augmented Attribute Representations
Sharmanska, V., Quadrianto, N., & Lampert, C. H. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33715-4_18 · Cited by 77
Large Margin Taxonomy Embedding for Document Categorization
Weinberger, K. Q., & Chapelle, O. (2008) · neural information processing systems · Cited by 77
Ranking Model Adaptation for Domain-Specific Search
Geng, B., Yang, L., Xu, C., & Hua, X. (2011) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2010.252 · Cited by 54
Semantic Kernel Forests from Multiple Taxonomies
Hwang, S. J., Grauman, K. L., & Sha, F. (2012) · Cited by 35
Attribute-Based Detection of Unfamiliar Classes with Humans in the Loop
Wah, C., & Belongie, S. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.106 · Cited by 31
Tree-Structured CRF Models for Interactive Image Labeling
Mensink, T., Verbeek, J. J., & Csurka, G. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.100 · Cited by 26
What's in a Name? First Names as Facial Attributes
Chen, H., Gallagher, A., & Girod, B. (2013) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2013.432 · Cited by 26
Cited by
Zero-Shot Learning—A Comprehensive Evaluation of the Good, the Bad and the Ugly
Xian, Y., Lampert, C. H., Schiele, B., & Akata, Z. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2857768 · Cited by 1,678
Self-citationZero-Shot Learning — The Good, the Bad and the Ugly
Xian, Y., Schiele, B., & Akata, Z. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.328 · Cited by 891
Self-citationLearning Deep Representations of Fine-Grained Visual Descriptions
Reed, S., Akata, Z., Lee, H., & Schiele, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.13 · Cited by 760
Self-citationGeneralized Zero- and Few-Shot Learning via Aligned Variational Autoencoders
Schönfeld, E., Ebrahimi, S., Sinha, S., Darrell, T., & Akata, Z. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00844 · Cited by 747
Self-citationLatent Embeddings for Zero-Shot Classification
Xian, Y., Akata, Z., Sharma, G., Nguyen, Q., Hein, M., & Schiele, B. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.15 · Cited by 703
Self-citation
Metadata
- Authors
- Akata, Z., Perronnin, F., Harchaoui, Z., & Schmid, C.
- Venue
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Published
- 2016-07-01
- Volume
- 38
- Issue
- 7
- Pages
- 1425-1438
- ISSN
- 0162-8828 (ISSN-L)
- 2160-9292
- OpenAlex
- W2171061940
- Cited by
- 770
- References
- 77
- FWCI
- 25.34
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.