The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
WhittleSearch: Image search with relative attribute feedback
Abstract
We propose a novel mode of feedback for image search, where a user describes which properties of exemplar images should be adjusted in order to more closely match his/her mental model of the image(s) sought. For example, perusing image results for a query “black shoes”, the user might state, “Show me shoe images like these, but sportier.” Offline, our approach first learns a set of ranking functions, each of which predicts the relative strength of a nameable attribute in an image (`sportiness', `furriness', etc.). At query time, the system presents an initial set of reference images, and the user selects among them to provide relative attribute feedback. Using the resulting constraints in the multi-dimensional attribute space, our method updates its relevance function and re-ranks the pool of images. This procedure iterates using the accumulated constraints until the top ranked images are acceptably close to the user's envisioned target. In this way, our approach allows a user to efficiently “whittle away” irrelevant portions of the visual feature space, using semantic language to precisely communicate her preferences to the system. We demonstrate the technique for refining image search for people, products, and scenes, and show it outperforms traditional binary relevance feedback in terms of search speed and accuracy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope
Oliva, A., & Torralba, A. (2001) · International Journal of Computer Vision · doi:10.1023/a:1011139631724 · Cited by 6,319
Cumulated gain-based evaluation of IR techniques
Järvelin, K., & Kekäläinen, J. (2002) · ACM Transactions on Information Systems · doi:10.1145/582415.582418 · Cited by 4,841
Optimizing search engines using clickthrough data
Joachims, T. (2002) · Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/775047.775067 · Cited by 3,873
Query by image and video content: the QBIC system
Flickner, M., Sawhney, H., Niblack, W., Ashley, J., Huang, Q., Dom, B., Gorkani, M., Hafner, J., Lee, D., Petkovic, D., et al. (1995) · Computer · doi:10.1109/2.410146 · Cited by 3,060
Training linear SVMs in linear time
Joachims, T. (2006) · Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1150402.1150429 · Cited by 1,920
Describing objects by their attributes
Farhadi, A., Endres, I., Hoiem, D., & Forsyth, D. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206772 · Cited by 1,917
Learning to detect unseen object classes by between-class attribute transfer
Lampert, C. H., Nickisch, H., & Harmeling, S. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206594 · Cited by 1,849
Relevance feedback: a power tool for interactive content-based image retrieval
Rui, Y., Huang, T. S., Ortega, M., & Mehrotra, S. (1998) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/76.718510 · Cited by 1,764
Query by Image and Video Content: The QBIC System
Flickner, M., Sawhney, H., Niblack, W., Ashley, J., Huang, Q., Dom, B., Gorkani, M., Hafner, J., Lee, D., Petkovic, D., et al. (2002) · Readings in Multimedia Computing and Networking · doi:10.1016/b978-155860651-7/50108-x · Cited by 1,559
Learning to detect unseen object classes by between-class attribute transfer
Lampert, C. H., Nickisch, H., & Harmeling, S. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvprw.2009.5206594 · Cited by 1,528
Attribute and simile classifiers for face verification
Kumar, N., Berg, A. C., Belhumeur, P. N., & Nayar, S. K. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459250 · Cited by 1,361
Parikh, D., & Grauman, K. (2011) · 2011 International Conference on Computer Vision · doi:10.1109/iccv.2011.6126281 · Cited by 851
Self-citationRelevance feedback in image retrieval: A comprehensive review
Zhou, X. S., & Huang, T. S. (2003) · Multimedia Systems · doi:10.1007/s00530-002-0070-3 · Cited by 826
Cox, I. J., Miller, M. L., Minka, T. P., Papathomas, T. V., & Yianilos, P. N. (2000) · IEEE Transactions on Image Processing · doi:10.1109/83.817596 · Cited by 712
Large-Scale Concept Ontology for Multimedia
Naphade, M., Smith, J. R., Tesic, J., Chang, S.-F., Hsu, W., Kennedy, L., Hauptmann, A., & Curtis, J. (2006) · IEEE Multimedia · doi:10.1109/mmul.2006.63 · Cited by 648
NeTra: a toolbox for navigating large image databases
Ma, W., & Manjunath, B. S. (2002) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.1997.647976 · Cited by 611
Automatic Attribute Discovery and Characterization from Noisy Web Data
Berg, T. L., Berg, A. C., & Shih, J. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15549-9_48 · Cited by 411
Visual Recognition with Humans in the Loop
Branson, S., Wah, C., Schroff, F., Babenko, B., Welinder, P., Perona, P., & Belongie, S. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_32 · Cited by 402
Tieu, K., & Viola, P. (2002) · Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662) · doi:10.1109/cvpr.2000.855824 · Cited by 386
FaceTracer: A Search Engine for Large Collections of Images with Faces
Kumar, N., Belhumeur, P., & Nayar, S. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-88693-8_25 · Cited by 368
Image ranking and retrieval based on multi-attribute queries
Siddiquie, B., Feris, R. S., & Davis, L. S. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995329 · Cited by 313
Bridging the Gap: Query by Semantic Example
Rasiwasia, N., Moreno, P. J., & Vasconcelos, N. (2007) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2007.900138 · Cited by 247
A Discriminative Latent Model of Object Classes and Attributes
Wang, Y., & Mori, G. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15555-0_12 · Cited by 218
Interactively building a discriminative vocabulary of nameable attributes
Parikh, D., & Grauman, K. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995451 · Cited by 203
Self-citationCombining attributes and Fisher vectors for efficient image retrieval
Douze, M., Ramisa, A., & Schmid, C. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995595 · Cited by 173
2011 International Conference on Computer Vision, ICCV 2011
Donahue, J., & Grauman, K. (2011) · CiteSeer X (The Pennsylvania State University) · Cited by 120
Self-citationAnnotator rationales for visual recognition
Donahue, J., & Grauman, K. L. (2011) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2011.6126394 · Cited by 66
Self-citationQuery-specific visual semantic spaces for web image re-ranking
Wang, X., Liu, K., & Tang, X. (2011) · doi:10.1109/cvpr.2011.5995399 · Cited by 56
Comparative object similarity for improved recognition with few or no examples
Wang, G., Forsyth, D. A., & Hoiem, D. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5539955 · Cited by 51
Cited by
Attribute-Based Classification for Zero-Shot Visual Object Categorization
Lampert, C. H., Nickisch, H., & Harmeling, S. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.140 · Cited by 1,627
VITON: An Image-Based Virtual Try-on Network
Han, X., Wu, Z., Wu, Z., Yu, R., & Davis, L. S. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00787 · Cited by 652
Deep Learning the City: Quantifying Urban Perception at a Global Scale
Dubey, A., Naik, N., Parikh, D., Raskar, R., & Hidalgo, C. A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46448-0_12 · Cited by 513
Self-citationFine-Grained Visual Comparisons with Local Learning
Yu, A., & Grauman, K. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.32 · Cited by 454
Self-citationCross-Domain Image Retrieval with a Dual Attribute-Aware Ranking Network
Huang, J., Feris, R., Chen, Q., & Yan, S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.127 · Cited by 410
Metadata
- Authors
- Kovashka, A., Parikh, D., & Grauman, K.
- Venue
- 2012 IEEE Conference on Computer Vision and Pattern Recognition
- Publisher
- IEEE
- Published
- 2012-06
- Pages
- 2973-2980
- ISSN
- 1063-6919 (ISSN-L)
- OpenAlex
- W2033365921
- Cited by
- 296
- References
- 29
- FWCI
- 24.51
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.