The DOI matches its Crossref record.
Semantic concept-based query expansion and re-ranking for multimedia retrieval
Abstract
We study the problem of semantic concept-based query expansion and re-ranking for multimedia retrieval. In particular, we explore the utility of a fixed lexicon of visual semantic concepts for automatic multimedia retrieval and re-ranking purposes. In this paper, we propose several new approaches for query expansion, in which textual keywords, visual examples, or initial retrieval results are analyzed to identify the most relevant visual concepts for the given query. These concepts are then used to generate additional query results and/or to re-rank an existing set of results. We develop both lexical and statistical approaches for text query expansion, as well as content-based approaches for visual query expansion. In addition, we study several other recently proposed methods for concept-based query expansion. In total, we compare 7 different approaches for expanding queries with visual semantic concepts. They are evaluated using a large video corpus and 39 concept detectors from the TRECVID-2006 video retrieval benchmark. We observe consistent improvement over the baselines for all 7 approaches, leading to an overall performance gain of 77% relative to a text retrieval baseline, and a 31% improvement relative to a state-of-the-art multimodal retrieval baseline.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
A Survey of Automatic Query Expansion in Information Retrieval
Carpineto, C., & Romano, G. (2012) · ACM Computing Surveys · doi:10.1145/2071389.2071390 · Cited by 1,109
Learning Social Tag Relevance by Neighbor Voting
Li, X., Snoek, C. G. M., & Worring, M. (2009) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2009.2030598 · Cited by 378
Snoek, C. G. M., & Worring, M. (2007) · now publishers, Inc. eBooks · doi:10.1561/9781601982353 · Cited by 317
Query expansion techniques for information retrieval: a survey
Azad, H. K., & Deepak, A. (2019) · Information Processing & Management · doi:10.1016/j.ipm.2019.05.009 · Cited by 313
Event Driven Web Video Summarization by Tag Localization and Key-Shot Identification
Wang, M., Hong, R., Li, G., Zha, Z.-J., Yan, S., & Chua, T.-S. (2012) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2012.2185041 · Cited by 263
Metadata
- Authors
- Natsev, A. (., Haubold, A., Tešić, J., Xie, L., & Yan, R.
- Venue
- Proceedings of the 15th ACM international conference on Multimedia
- Publisher
- ACM
- Published
- 2007-09-29
- Pages
- 991-1000
- OpenAlex
- W2090912237
- Cited by
- 183
- References
- 0
- FWCI
- 14.51
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Semantic concept-based query expansion and re-ranking for multimedia retrieval. https://app.cochat.ai/papers/10.1145/1291233.1291448
- The paper
- Natsev, A. (., Haubold, A., Tešić, J., Xie, L., & Yan, R. (2007). Semantic concept-based query expansion and re-ranking for multimedia retrieval. Proceedings of the 15th ACM international conference on Multimedia. https://doi.org/10.1145/1291233.1291448
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.