The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Multimodal Graph-Based Reranking for Web Image Search
Abstract
This paper introduces a web image search reranking approach that explores multiple modalities in a graph-based learning scheme. Different from the conventional methods that usually adopt a single modality or integrate multiple modalities into a long feature vector, our approach can effectively integrate the learning of relevance scores, weights of modalities, and the distance metric and its scaling for each modality into a unified scheme. In this way, the effects of different modalities can be adaptively modulated and better reranking performance can be achieved. We conduct experiments on a large dataset that contains more than 1000 queries and 1 million images to evaluate our approach. Experimental results demonstrate that the proposed reranking approach is more robust than using each individual modality, and it also performs better than many existing methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Nonlinear Dimensionality Reduction by Locally Linear Embedding
Roweis, S. T., & Saul, L. K. (2000) · Science · doi:10.1126/science.290.5500.2323 · Cited by 14,965
Cumulated gain-based evaluation of IR techniques
Järvelin, K., & Kekäläinen, J. (2002) · ACM Transactions on Information Systems · doi:10.1145/582415.582418 · Cited by 4,841
Learning with Local and Global Consistency
Zhou, D., Bousquet, O., Lal, T. N., Weston, J., & Schölkopf, B. (2003) · MPG.PuRe (Max Planck Society) · Cited by 3,864
Semi-supervised learning using Gaussian fields and harmonic functions
Zhu, X., Zoubin Ghahramani, A., & Lafferty, J. (2003) · Cited by 3,509
Early versus late fusion in semantic video analysis
Snoek, C. G. M., Worring, M., & Smeulders, A. W. M. (2005) · Proceedings of the 13th annual ACM international conference on Multimedia · doi:10.1145/1101149.1101236 · Cited by 879
Label Propagation through Linear Neighborhoods
Wang, F., & Zhang, C. (2008) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2007.190672 · Cited by 690
Bregman Divergence-Based Regularization for Transfer Subspace Learning
Si, S., Tao, D., & Geng, B. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.126 · Cited by 477
Self-citationUnified Video Annotation via Multigraph Learning
Wang, M., Hua, X.-S., Hong, R., Tang, J., Qi, G.-J., & Song, Y. (2009) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2009.2017400 · Cited by 441
Self-citationVisualRank: Applying PageRank to Large-Scale Image Search
Jing, Y., & Baluja, S. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.121 · Cited by 441
Adaptive Hypergraph Learning and its Application in Image Classification
Yu, J., Tao, D., & Wang, M. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2190083 · Cited by 405
Self-citationBeyond Distance Measurement: Constructing Neighborhood Similarity for Video Annotation
Wang, M., Hua, X.-S., Tang, J., & Hong, R. (2009) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2009.2012919 · Cited by 288
Self-citationOptimal multimodal fusion for multimedia data analysis
Wu, Y., Chang, E. Y., Chang, K. C.-C., & Smith, J. R. (2004) · Proceedings of the 12th annual ACM international conference on Multimedia · doi:10.1145/1027527.1027665 · Cited by 229
Towards a Relevant and Diverse Search of Social Images
Wang, M., Yang, K., Hua, X., & Zhang, H.-J. (2010) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2010.2055045 · Cited by 228
Self-citationEnsemble Manifold Regularization
Geng, B., Tao, D., Xu, C., Yang, L., & Hua, X.-S. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.57 · Cited by 227
Self-citationVideo search reranking through random walk over document-level context graph
Hsu, W. H., Kennedy, L. S., & Chang, S.-F. (2007) · Proceedings of the 15th ACM international conference on Multimedia · doi:10.1145/1291233.1291446 · Cited by 226
DAML: Domain Adaptation Metric Learning
Geng, B., Tao, D., & Xu, C. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2134107 · Cited by 198
Self-citationLearning an image manifold for retrieval
He, X., Ma, W.-Y., & Zhang, H.-J. (2004) · Proceedings of the 12th annual ACM international conference on Multimedia · doi:10.1145/1027527.1027532 · Cited by 179
Learning the semantics of multimedia queries and concepts from a small number of examples
Natsev, A., Naphade, M. R., & Tešić, J. (2005) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1101149.1101288 · Cited by 147
Bayesian video search reranking
Tian, X., Yang, L., Wang, J., Yang, Y., Wu, X., & Hua, X. (2008) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1459359.1459378 · Cited by 134
Self-citationImproving web image search results using query-relative classifiers
Krapac, J., Allan, M., Verbeek, J. J., & Jurie, F. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5540092 · Cited by 125
Generalized Manifold-Ranking-Based Image Retrieval
He, J., Li, M., Zhang, H.-J., Tong, H., & Zhang, C. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.877491 · Cited by 117
Jain, V., & Varma, M. (2011) · International World Wide Web Conference (WWW) · doi:10.1145/1963405.1963447 · Cited by 115
Active Reranking for Web Image Search
Tian, X., Tao, D., Hua, X., & Wu, X. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2009.2035866 · Cited by 110
Self-citationToward improved ranking metrics
Sebe, N., Lew, M. S., & Huijsmans, D. P. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.879793 · Cited by 107
MSRA-MM 2.0: A Large-Scale Web Multimedia Dataset
Li, H., Wang, M., & Hua, X. (2009) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw.2009.46 · Cited by 101
Self-citationSupervised reranking for web image search
Yang, L., & Hanjalić, A. (2010) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1873951.1873977 · Cited by 85
Liu, Y., Mei, T., & Hua, X. (2009) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1571941.1572027 · Cited by 76
Semi-supervised kernel density estimation for video annotation
Wang, M., Hua, X., Mei, T., Hong, R., Qi, G.-J., Song, Y., & Dai, L.-R. (2008) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2008.08.003 · Cited by 75
Self-citationDiscriminative model fusion for semantic concept detection and annotation in video
Iyengar, G., & Nock, H. J. (2003) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/957013.957065 · Cited by 69
The combination limit in multimedia retrieval
Yan, R., & Hauptmann, A. G. (2003) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/957013.957086 · Cited by 56
Hyperparameter Learning for Graph Based Semi-supervised Learning Algorithms
Zhang, X., & Lee, W. S. (2007) · The MIT Press eBooks · doi:10.7551/mitpress/7503.003.0203 · Cited by 54
Co-reranking by mutual reinforcement for image search
Yao, T., Mei, T., & Ngo, C. (2010) · ACM International Conference on Image and Video Retrieval (CIVR) · doi:10.1145/1816041.1816048 · Cited by 52
Manifold-ranking based video concept detection on large database and feature pool
Yuan, X., Hua, X., Wang, M., & Wu, X. (2006) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1180639.1180768 · Cited by 44
Self-citationEnsemble manifold regularization
Geng, B., Xu, C., Tao, D., Yang, L., & Hua, X. (2009) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2009.5206695 · Cited by 39
Self-citationRe-ranking of web image search results using a graph algorithm
Zitouni, H., Sevil, S., Özkan, D., et al. (2008) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2008.4761472 · Cited by 38
Optimizing Visual Search Reranking via Pairwise Learning
Liu, Y., & Mei, T. (2011) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2010.2103931 · Cited by 34
Robust visual reranking via sparsity and ranking constraints
Morioka, N., & Wang, J. (2011) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2072298.2072367 · Cited by 27
Learning to judge image search results
Tian, X., Lu, Y., Yang, L., et al. (2011) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2072298.2072346 · Cited by 18
Cited by
Neural Collaborative Filtering
He, X., Liao, L., Zhang, H., Nie, L., Hu, X., & Chua, T.-S. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052569 · Cited by 6,652
Chen, J., Zhang, H., He, X., Nie, L., Liu, W., & Chua, T.-S. (2017) · Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3077136.3080797 · Cited by 851
A Brief Survey on Semantic Segmentation with Deep Learning
Hao, S., Zhou, Y., & Guo, Y. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.11.118 · Cited by 596
Learning to Rank Using User Clicks and Visual Features for Image Retrieval
Yu, J., Tao, D., Wang, M., & Rui, Y. (2015) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2336697 · Cited by 445
Self-citationCross-Modal Retrieval With CNN Visual Features: A New Baseline
Wei, Y., Zhao, Y., Lu, C., Wei, S., Liu, L., Zhu, Z., & Yan, S. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2519449 · Cited by 370
Metadata
- Authors
- Wang, M., Li, H., Tao, D., Lu, K., & Wu, X.
- Venue
- IEEE Transactions on Image Processing
- Published
- 2012-11
- Volume
- 21
- Issue
- 11
- Pages
- 4649-4661
- ISSN
- 1057-7149 (ISSN-L)
- 1941-0042
- OpenAlex
- W2024082504
- Cited by
- 344
- References
- 38
- FWCI
- 41.97
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.