Harvesting visual concepts for image search with complex queries
The DOI matches its Crossref record.
Abstract
The use of image reranking to boost retrieval performance has been found to be successful for simple queries. It is, however, less effective for complex queries due to the widened semantic gap. This paper presents a scheme to enhance web image reranking for complex queries by fully exploring the information from simple visual concepts. Given a complex query, our scheme first detects the noun-phrase based visual concepts and crawls their top ranked images from popular image search engines. Next, it constructs a heterogeneous probabilistic network to model the relatedness between the complex query and each of its crawled images. The network seamlessly integrates three layers of relationships, i.e., the semantic-level, cross-modality level as well as visual-level. These mutually reinforced layers are established among the complex query and its involved visual concepts, by harnessing the contents of images and their associated textual cues. Based on the derived relevance scores, a new ranking list is generated. Extensive evaluations on a real-world dataset demonstrate that our model is able to characterize the complex queries well and achieve promising performance as compared to the state-of-the-art methods. Based on the proposed scheme, we introduce two applications: photo-based question answering and textual news visualization. Comprehensive experiments well validate the proposed scheme.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Fast image encryption algorithm based on parallel computing system
Wang, X., Feng, L., & Zhao, H. (2019) · Information Sciences · doi:10.1016/j.ins.2019.02.049 · Cited by 414
Easy Samples First: Self-paced Reranking for Zero-Example Multimedia Search
Jiang, L., Meng, D., Mitamura, T., & Hauptmann, A. G. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654918 · Cited by 271
Disease inference from health-related questions via sparse deep learning
Nie, L., Wang, M., Zhang, L., Yan, S., Zhang, B., & Chua, T.-S. (2015) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2015.2399298 · Cited by 195
Self-citationHu, H., Liu, Y., Liu, M., & Nie, L. (2016) · Neurocomputing · doi:10.1016/j.neucom.2015.05.134 · Cited by 93
Self-citation
Metadata
- Authors
- Nie, L., Yan, S., Wang, M., Hong, R., & Chua, T.-S.
- Venue
- Proceedings of the 20th ACM international conference on Multimedia
- Publisher
- ACM
- Published
- 2012-10-29
- Pages
- 59-68
- OpenAlex
- W1986455621
- Cited by
- 148
- References
- 0
- FWCI
- 7.83
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Harvesting visual concepts for image search with complex queries. https://app.cochat.ai/papers/10.1145/2393347.2393363
- The paper
- Nie, L., Yan, S., Wang, M., Hong, R., & Chua, T.-S. (2012). Harvesting visual concepts for image search with complex queries. Proceedings of the 20th ACM international conference on Multimedia. https://doi.org/10.1145/2393347.2393363
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.