Content-based multimedia information retrieval: State of the art and challenges
The DOI matches its Crossref record; 150 of the 152 references it cites were found in a registry or an index.
Abstract
Extending beyond the boundaries of science, art, and culture, content-based multimedia information retrieval provides new paradigms and methods for searching through the myriad variety of media all over the world. This survey reviews 100+ recent articles on content-based multimedia information retrieval and discusses their role in current research directions which include browsing and search paradigms, user studies, affective computing, learning, semantic queries, new features and media types, high performance indexing, and evaluation techniques. Based on the current state of the art, we discuss the major challenges for the future.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Similarly, given a diagnostically challenging WSI, retrieving a similar WSI via slide search5,46–53 or pathology reports through cross-modal report search10,54–56 typically requires specialized algorithms to bridge the gap between fine-grained patch embeddings and slide-level information, introducing hurdles to clinical adoption.”
From A multimodal whole-slide foundation model for pathology (2025) · cites this paper as [46]
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
A Combined Corner and Edge Detector
Harris, C., & Stephens, M. (1988) · Procedings of the Alvey Vision Conference 1988 · doi:10.5244/c.2.23 · Cited by 12,901
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
A comparative study of texture measures with classification based on featured distributions
Ojala, T., Pietikäinen, M., & Harwood, D. (1996) · Pattern Recognition · doi:10.1016/0031-3203(95)00067-4 · Cited by 6,882
Content-based image retrieval at the end of the early years
Smeulders, A. W. M., Worring, M., Santini, S., Gupta, A., & Jain, R. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.895972 · Cited by 6,056
Self-citation2009 IEEE Conference on Computer Vision and Pattern Recognition
(2009) · doi:10.1109/cvpr14067.2009 · Cited by 5,550
Ballard, D. H., & Brown, C. M. (1982) · Cited by 5,303
Haralock, R. M., & Shapiro, L. G. (1991) · Addison-Wesley Longman Publishing Co., Inc. eBooks · Cited by 3,933
Scale & Affine Invariant Interest Point Detectors
Mikolajczyk, K., & Schmid, C. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000027790.02288.f2 · Cited by 3,436
Detecting faces in images: a survey
Yang, M.-H., Kriegman, D. J., & Ahuja, N. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.982883 · Cited by 3,427
Research works printed but not linked: 5
- Bach , J. R. , Fuller , C. , Gupta , A. , Hampapur , A. , Horowitz , B. , Humphrey , R. , Jain , R. , and Shu , C. F . 1996. Virage image search engine: An open framework for image management . In Proceedings of the SPIE Storage and Retrieval for Still Image and Video Databases. 76--87 .]] Bach, J. R., Fuller, C., Gupta, A., Hampapur, A., Horowitz, B., Humphrey, R., Jain, R., and Shu, C. F. 1996. Virage image search engine: An open framework for image management. In Proceedings of the SPIE Storage and Retrieval for Still Image and Video Databases. 76--87.]]
- Eiter T. and Libkin L. 2005. Database Theory. Springer London. UK.]] Eiter T. and Libkin L. 2005. Database Theory. Springer London. UK.]]
- Enser , P. G. B. and Sandom , C. J . 2003. Towards a comprehensive survey of the semantic gap in visual information retrieval . In Proceedings of the 2nd International Conference on Image and Video Retrieval. (July) , Urbana, IL, E. M. Bakker, T. S. Huang, M. S. Lew, N. Sebe and X. Zhou, Eds. Springer-Verlag, London, UK. 291--299.]] Enser, P. G. B. and Sandom, C. J. 2003. Towards a comprehensive survey of the semantic gap in visual information retrieval. In Proceedings of the 2nd International Conference on Image and Video Retrieval. (July), Urbana, IL, E. M. Bakker, T. S. Huang, M. S. Lew, N. Sebe and X. Zhou, Eds. Springer-Verlag, London, UK. 291--299.]]
- Lew , M. S. 2001. Principles of Visual Information Retrieval . Springer , London, UK .]] Lew, M. S. 2001. Principles of Visual Information Retrieval. Springer, London, UK.]]
- Tian , Q. , Moghaddam , B. , and Huang , T. S . 2002. Visualization, estimation and user-modeling . In Proceedings of the 1st International Conference on Image and Video Retrieval. (July) , London, UK, M. S. Lew, N. Sebe, and J. P. Eakins, Eds. Springer-Verlag, London, UK, 7--16.]] Tian, Q., Moghaddam, B., and Huang, T. S. 2002. Visualization, estimation and user-modeling. In Proceedings of the 1st International Conference on Image and Video Retrieval. (July), London, UK, M. S. Lew, N. Sebe, and J. P. Eakins, Eds. Springer-Verlag, London, UK, 7--16.]]
Cited by
Image retrieval: Ideas, influences, and trends of the new age
Datta, R., Joshi, D., Li, J., & Wang, J. Z. (2008) · ACM Computing Surveys · doi:10.1145/1348246.1348248 · Cited by 3,040
Chen, M., Mao, S., & Liu, Y. (2014) · Mobile Networks and Applications · doi:10.1007/s11036-013-0489-0 · Cited by 2,913
Image-Based Recommendations on Styles and Substitutes
McAuley, J., Targett, C., Shi, Q., & van den Hengel, A. (2015) · Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/2766462.2767755 · Cited by 2,280
The MIR flickr retrieval evaluation
Huiskes, M. J., & Lew, M. S. (2008) · Proceedings of the 1st ACM international conference on Multimedia information retrieval · doi:10.1145/1460096.1460104 · Cited by 1,836
Self-citationHow to Evaluate Foreground Maps
Margolin, R., Zelnik-Manor, L., & Tal, A. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.39 · Cited by 1,106
Affective image classification using features inspired by psychology and art theory
Machajdik, J., & Hanbury, A. (2010) · Proceedings of the 18th ACM international conference on Multimedia · doi:10.1145/1873951.1873965 · Cited by 852
Deep Learning for Content-Based Image Retrieval: A Comprehensive Study
Wan, J., Wang, D., Hoi, S. C. H., Wu, P., Zhu, J., Zhang, Y., & Li, J. (2014) · Proceedings of the 22nd ACM international conference on Multimedia · doi:10.1145/2647868.2654948 · Cited by 811
HashNet: Deep Learning to Hash by Continuation
Cao, Z., Long, M., Wang, J., & Yu, P. S. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.598 · Cited by 777
“Parallel to the traditional indexing methods [21], another advantageous solution is hashing methods [35], which transform high-dimensional media data into compact binary codes and generate similar binary codes for similar data items.”
MethodScale Invariant Feature Transform
Lindeberg, T. (2012) · Scholarpedia · doi:10.4249/scholarpedia.10491 · Cited by 621
Features for image retrieval: an experimental comparison
Deselaers, T., Keysers, D., & Ney, H. (2008) · Information Retrieval · doi:10.1007/s10791-007-9039-3 · Cited by 585
A Survey on Visual Content-Based Video Indexing and Retrieval
Hu, W., Xie, N., Li, L., Zeng, X., & Maybank, S. (2011) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2011.2109710 · Cited by 585
PatternNet: A benchmark dataset for performance evaluation of remote sensing image retrieval
Zhou, W., Newsam, S., Li, C., & Shao, Z. (2018) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2018.01.004 · Cited by 571
Video summarisation: A conceptual framework and survey of the state of the art
Money, A., & Agius, H. (2007) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2007.04.002 · Cited by 492
A review on automatic image annotation techniques
Zhang, D., Islam, M. M., & Lu, G. (2012) · Pattern Recognition · doi:10.1016/j.patcog.2011.05.013 · Cited by 479
Liu, D., Hua, X.-S., Yang, L., Wang, M., & Zhang, H.-J. (2009) · Proceedings of the 18th international conference on World wide web · doi:10.1145/1526709.1526757 · Cited by 475
Fast k nearest neighbor search using GPU
Garcia, V., Debreuve, E., & Barlaud, M. (2008) · 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2008.4563100 · Cited by 447
Describable Visual Attributes for Face Verification and Image Search
Kumar, N., Berg, A., Belhumeur, P. N., & Nayar, S. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.48 · Cited by 434
A Multimedia Retrieval Framework Based on Semi-Supervised Ranking and Relevance Feedback
Yang, Y., Nie, F., Xu, D., Luo, J., Zhuang, Y., & Pan, Y. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.170 · Cited by 417
Machine Recognition of Music Emotion: A Review
Yang, Y.-H., & Chen, H. H. (2012) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2168752.2168754 · Cited by 378
Deep Cauchy Hashing for Hamming Space Retrieval
Cao, Y., Long, M., Liu, B., & Wang, J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00134 · Cited by 376
Deep Multimodal Distance Metric Learning Using Click Constraints for Image Ranking
Yu, J., Yang, X., Gao, F., & Tao, D. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2591583 · Cited by 364
A Decade Survey of Content Based Image Retrieval Using Deep Learning
Dubey, S. R. (2022) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2021.3080920 · Cited by 356
50 Years of object recognition: Directions forward
Andreopoulos, A., & Tsotsos, J. K. (2013) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2013.04.005 · Cited by 347
“See [168, 257, 258, 259] for good surveys on the topic.”
BackgroundSelf-taught hashing for fast similarity search
Zhang, D., Wang, J., Cai, D., & Lu, J. (2010) · Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1835449.1835455 · Cited by 347
An Overview of Cross-Media Retrieval: Concepts, Methodologies, Benchmarks, and Challenges
Peng, Y., Huang, X., & Zhao, Y. (2018) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2017.2705068 · Cited by 341
Snoek, C. G. M., & Worring, M. (2007) · now publishers, Inc. eBooks · doi:10.1561/9781601982353 · Cited by 317
Query expansion techniques for information retrieval: a survey
Azad, H. K., & Deepak, A. (2019) · Information Processing & Management · doi:10.1016/j.ipm.2019.05.009 · Cited by 313
I2T: Image Parsing to Text Description
Yao, B. Z., Yang, X., Lin, L., Lee, M. W., & Zhu, S.-C. (2010) · Proceedings of the IEEE · doi:10.1109/jproc.2010.2050411 · Cited by 310
Learning Cross-Media Joint Representation With Sparse and Semisupervised Regularization
Zhai, X., Peng, Y., & Xiao, J. (2014) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2013.2276704 · Cited by 294
Combining Cloud and sensors in a smart city environment
Mitton, N., Papavassiliou, S., Puliafito, A., & Trivedi, K. S. (2012) · EURASIP Journal on Wireless Communications and Networking · doi:10.1186/1687-1499-2012-247 · Cited by 285
Recent Advance in Content-based Image Retrieval: A Literature SurveyPreprint
Zhou, W., Li, H., & Tian, Q. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.06064 · Cited by 277
Music Information Retrieval: Recent Developments and Applications
Schedl, M., Gómez, E., & Urbano, J. (2014) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000042 · Cited by 267
Snoek, C. G. M., & Worring, M. (2009) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000014 · Cited by 263
Focus: Querying Large Video Datasets with Low Latency and Low CostPreprint
Hsieh, K., Ananthanarayanan, G., Bodík, P., Bahl, P., Philipose, M., Gibbons, P. B., & Mutlu, O. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.03493 · Cited by 263
World-scale mining of objects and events from community photo collections
Quack, T., Leibe, B., & Van Gool, L. (2008) · Proceedings of the 2008 international conference on Content-based image and video retrieval · doi:10.1145/1386352.1386363 · Cited by 262
Content-based image retrieval using color moment and Gabor texture feature
Huang, Z.-C., Chan, P. P. K., Ng, W. W. Y., & Yeung, D. (2010) · International Conference on Machine Learning and Cybernetics · doi:10.1109/icmlc.2010.5580566 · Cited by 243
Tag Completion for Image Retrieval
Wu, L., Jin, R., & Jain, A. K. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.124 · Cited by 238
Content-Based Video Recommendation System Based on Stylistic Visual Features
Deldjoo, Y., Elahi, M., Cremonesi, P., Garzotto, F., Piazzolla, P., & Quadrana, M. (2016) · Journal on Data Semantics · doi:10.1007/s13740-016-0060-9 · Cited by 233
Image retrieval from remote sensing big data: A survey
Li, Y., Ma, J., & Zhang, Y. (2021) · Information Fusion · doi:10.1016/j.inffus.2020.10.008 · Cited by 233
Cross-media shared representation by hierarchical learning with multiple deep networks
Peng, Y., Huang, X., & Qi, J. (2016) · International Joint Conference on Artificial Intelligence · Cited by 233
Kumar, A., Kim, J., Cai, W., Fulham, M., & Feng, D. (2013) · Journal of Digital Imaging · doi:10.1007/s10278-013-9619-2 · Cited by 229
Pooling in image representation: The visual codeword point of view
Avila, S., Thome, N., Cord, M., Valle, E., & de A. Araújo, A. (2013) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2012.09.007 · Cited by 224
Semantic content-based image retrieval: A comprehensive study
Alzu’bi, A., Amira, A., & Ramzan, N. (2015) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2015.07.012 · Cited by 220
Assistive tagging: A survey of multimedia tagging with human-computer joint exploration
Wang, M., Ni, B., Hua, X.-S., & Chua, T.-S. (2012) · ACM Computing Surveys · doi:10.1145/2333112.2333120 · Cited by 219
Imran, M., Ofli, F., Caragea, D., & Torralba, A. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2020.102261 · Cited by 217
Yang, Y., Zhuang, Y.-T., Wu, F., & Pan, Y.-H. (2008) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2008.917359 · Cited by 213
Image Matching Using Generalized Scale-Space Interest Points
Lindeberg, T. (2015) · Journal of Mathematical Imaging and Vision · doi:10.1007/s10851-014-0541-0 · Cited by 208
Li, G. (2015) · Information Technology & Tourism · doi:10.1007/s40558-015-0027-y · Cited by 208
Deep Learning for Instance Retrieval: A Survey
Chen, W., Liu, Y., Wang, W., Bakker, E. M., Georgiou, T., Fieguth, P., Liu, L., & Lew, M. S. (2023) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3218591 · Cited by 201
Self-citationContextual music information retrieval and recommendation: State of the art and challenges
Kaminskas, M., & Ricci, F. (2012) · Computer Science Review · doi:10.1016/j.cosrev.2012.04.002 · Cited by 198
Multimedia search reranking: A literature survey
Mei, T., Rui, Y., Li, S., & Tian, Q. (2014) · ACM Computing Surveys · doi:10.1145/2536798 · Cited by 192
Machine learning in cybersecurity: A review
Handa, A., Sharma, A., & Shukla, S. K. (2019) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1306 · Cited by 187
Content based image retrieval using deep learning process
Saritha, R. R., Paul, V., & Kumar, P. G. (2019) · Cluster Computing · doi:10.1007/s10586-018-1731-0 · Cited by 184
Remote Sensing Image Retrieval With Global Morphological Texture Descriptors
Aptoula, E. (2014) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2013.2268736 · Cited by 182
Ranking with local regression and global alignment for cross media retrieval
Yang, Y., Xu, D., Nie, F., Luo, J., & Zhuang, Y. (2009) · Proceedings of the 17th ACM international conference on Multimedia · doi:10.1145/1631272.1631298 · Cited by 179
Zha, Z.-J., Yang, L., Mei, T., Wang, M., & Wang, Z. (2009) · Proceedings of the 17th ACM international conference on Multimedia · doi:10.1145/1631272.1631278 · Cited by 179
Publishing and Using Cultural Heritage Linked Data on the Semantic Web
Hyvönen, E. (2012) · Synthesis lectures on the semantic web · doi:10.2200/s00452ed1v01y201210wbe003 · Cited by 179
Content-based filtering for recommendation systems using multiattribute networks
Son, J., & Kim, S. B. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.08.008 · Cited by 178
Similar image search for histopathology: SMILY
Hegde, N., Hipp, J. D., Liu, Y., Emmert-Buck, M., Reif, E., Smilkov, D., Terry, M., Cai, C. J., Amin, M. B., Mermel, C. H., et al. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0131-z · Cited by 176
Semi-supervised distance metric learning for collaborative image retrieval and clustering
Hoi, S. C. H., Liu, W., & Chang, S.-F. (2010) · ACM Transactions on Multimedia Computing, Communications, and Applications · doi:10.1145/1823746.1823752 · Cited by 174
Deep learning for video classification and captioning
Wu, Z., Yao, T., Fu, Y., & Jiang, Y.-G. (2017) · doi:10.1145/3122865.3122867 · Cited by 174
Structure-Measure: A New Way to Evaluate Foreground Maps
Cheng, M.-M., & Fan, D.-P. (2021) · International Journal of Computer Vision · doi:10.1007/s11263-021-01490-8 · Cited by 172
Online multimodal deep similarity learning with application to image retrieval
Wu, P., Hoi, S. C. H., Xia, H., Zhao, P., Wang, D., & Miao, C. (2013) · Proceedings of the 21st ACM international conference on Multimedia · doi:10.1145/2502081.2502112 · Cited by 172
A multimodal whole-slide foundation model for pathology
Ding, T., Wagner, S. J., Song, A. H., Chen, R. J., Lu, M. Y., Zhang, A., Vaidya, A. J., Jaume, G., Shaban, M., Kim, A., et al. (2025) · Nature Medicine · doi:10.1038/s41591-025-03982-3 · Cited by 171
Multi-Feature Fusion via Hierarchical Regression for Multimedia Analysis
Yang, Y., Song, J., Huang, Z., Ma, Z., Sebe, N., & Hauptmann, A. G. (2013) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2012.2234731 · Cited by 171
Self-citationIntegrating Color Features in Polarimetric SAR Image Classification
Uhlmann, S., & Kiranyaz, S. (2014) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2013.2258675 · Cited by 170
Semisupervised SVM batch mode active learning with applications to image retrieval
Hoi, S. C. H., Jin, R., Zhu, J., & Lyu, M. R.-T. (2009) · ACM Transactions on Information Systems · doi:10.1145/1508850.1508854 · Cited by 170
Vlogging: A survey of videoblogging technology on the web
Gao, W., Tian, Y., Huang, T., & Yang, Q. (2010) · ACM Computing Surveys · doi:10.1145/1749603.1749606 · Cited by 163
The semantics of similarity in geographic information retrieval
Janowicz, K., Raubal, M., & Kühn, W. (2011) · Journal of Spatial Information Science · doi:10.5311/josis.2011.2.3 · Cited by 161
Deep Visual-Semantic Quantization for Efficient Image Retrieval
Cao, Y., Long, M., Wang, J., & Liu, S. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.104 · Cited by 158
Mining Semantic Correlation of Heterogeneous Multimedia Data for Cross-Media Retrieval
Zhuang, Y., Yang, Y., & Wu, F. Q. (2008) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2007.911822 · Cited by 157
Online video recommendation based on multimodal fusion and relevance feedback
Yang, B. X., Mei, T., Hua, X., Yang, L., Yang, S., & Li, M. (2007) · ACM International Conference on Image and Video Retrieval (CIVR) · doi:10.1145/1282280.1282290 · Cited by 157
Image-based Recommendations on Styles and SubstitutesPreprint
McAuley, J., Targett, C., Shi, Q., & van den Hengel, A. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.04757 · Cited by 157
Zhang, H., Zha, Z.-J., Yang, Y., Yan, S., Gao, Y., & Chua, T. (2013) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2502081.2502093 · Cited by 149
Information fusion in content based image retrieval: A comprehensive overview
Piras, L., & Giacinto, G. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.01.003 · Cited by 149
View-Based Discriminative Probabilistic Modeling for 3D Object Retrieval and Recognition
Wang, M., Gao, Y., Lü, K., & Rui, Y. (2012) · IEEE Transactions on Image Processing · doi:10.1109/tip.2012.2231088 · Cited by 146
Learning to reduce the semantic gap in web image retrieval and annotation
Wang, C., Zhang, L., & Zhang, H.-J. (2008) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1390334.1390396 · Cited by 145
Oracle in Image Search: A Content-Based Approach to Performance Prediction
Nie, L., Wang, M., Zha, Z.-J., & Chua, T. (2012) · ACM Transactions on Information Systems · doi:10.1145/2180868.2180875 · Cited by 141
Visual Semantic Search: Retrieving Videos via Complex Textual Queries
Lin, D., Fidler, S., Kong, C., & Urtasun, R. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.340 · Cited by 140
Spectral Hashing With Semantically Consistent Graph for Image Indexing
Li, P., Wang, M., Cheng, J., Xu, C., & Lu, H. (2012) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2012.2199970 · Cited by 138
Bridging the Semantic Gap Between Image Contents and Tags
Ma, H., Zhu, J., Lyu, M. R.-T., & King, I. (2010) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2010.2051360 · Cited by 137
Privacy-Assured Outsourcing of Image Reconstruction Service in Cloud
Wang, C., Zhang, B., Ren, K., & Roveda, J. M. (2013) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2013.2273797 · Cited by 136
Landmark Image Super-Resolution by Retrieving Web Images
Yue, H., Sun, X., Yang, J., & Wu, F. (2013) · IEEE Transactions on Image Processing · doi:10.1109/tip.2013.2279315 · Cited by 134
HashGAN: Deep Learning to Hash with Pair Conditional Wasserstein GAN
Cao, Y., Liu, B., Long, M., & Wang, J. (2018) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2018.00140 · Cited by 134
Visual query suggestion: Towards capturing user intent in internet image search
Zha, Z.-J., Yang, L., Mei, T., Wang, M., Wang, Z., Chua, T., & Hua, X. (2010) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/1823746.1823747 · Cited by 132
Dual cross-media relevance model for image annotation
Liu, J., Wang, B., Li, M., Li, Z., Ma, W., Lu, H., & Ma, S. (2007) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1291233.1291380 · Cited by 128
Hawkes processes for events in social media
Rizoiu, M.-A., Lee, Y., Mishra, S., & Xie, L. (2017) · doi:10.1145/3122865.3122874 · Cited by 128
MoVi: mobile phone based video highlights via collaborative sensing
Bao, X., & Choudhury, R. R. (2010) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/1814433.1814468 · Cited by 127
Contextual Video Recommendation by Multimodal Relevance and User Feedback
Mei, T., Yang, B. X., Hua, X., & Li, S. (2011) · ACM Transactions on Information Systems · doi:10.1145/1961209.1961213 · Cited by 126
Sparse transfer learning for interactive video search reranking
Tian, X., Tao, D., & Rui, Y. (2012) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/2240136.2240139 · Cited by 123
Naaman, M. (2010) · Multimedia Tools and Applications · doi:10.1007/s11042-010-0538-7 · Cited by 123
Event Mining in Multimedia Streams
Xie, L., Sundaram, H., & Campbell, M. S. (2008) · Proceedings of the IEEE · doi:10.1109/jproc.2008.916362 · Cited by 121
Cloud-Based Image Coding for Mobile Devices—Toward Thousands to One Compression
Yue, H., Sun, X., Yang, J., & Wu, F. (2013) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2013.2239629 · Cited by 118
Directional Binary Wavelet Patterns for Biomedical Image Indexing and Retrieval
Murala, S., Maheshwari, R. P., & Raman, B. (2011) · Journal of Medical Systems · doi:10.1007/s10916-011-9764-4 · Cited by 117
Clickage: towards bridging semantic and intent gaps via mining click logs of search engines
Hua, X., Yang, L., Wang, J., Wang, J., Ye, M., Wang, K., Rui, Y., & Li, J. (2013) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2502081.2502283 · Cited by 116
Liu, D., Hua, X., Wang, M., & Zhang, H.-J. (2010) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1873951.1874031 · Cited by 116
On Combining Multiple Features for Cartoon Character Retrieval and Clip Synthesis
Yu, J., Liu, D., Tao, D., & Seah, H. S. (2012) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2012.2192108 · Cited by 115
Web and Personal Image Annotation by Mining Label Correlation With Relaxed Visual Graph Embedding
Yang, Y., Wu, F., Nie, F., Shen, H. T., Zhuang, Y., & Hauptmann, A. G. (2011) · IEEE Transactions on Image Processing · doi:10.1109/tip.2011.2169269 · Cited by 115
Private Content Based Image Retrieval
Shashank, J., Kowshik, P., Srinathan, K., & Jawahar, C. V. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587388 · Cited by 114
Metadata
- Authors
- Lew, M. S., Sebe, N., Djeraba, C., & Jain, R.
- Affiliations
- Leiden University (NL)
- University of Amsterdam (NL)
- Laboratoire d'Informatique Fondamentale de Lille (FR)
- University of California, Irvine (US)
- Venue
- ACM Transactions on Multimedia Computing, Communications, and Applications
- Published
- 2006-02
- Volume
- 2
- Issue
- 1
- Pages
- 1-19
- ISSN
- 1551-6857 (ISSN-L)
- 1551-6865
- OpenAlex
- W2147069236
- Semantic Scholar
- cabe73e89b6389a163393ecbf1b82d20ba4ea10f
- Cited by
- 1,528
- References
- 152
- Citations by year
- 2026: 17 · 2025: 13 · 2024: 20 · 2023: 25 · 2022: 18 · 2021: 31 · 2020: 34 · 2019: 58 · 2018: 64 · 2017: 88 · 2016: 77 · 2015: 102 · 2014: 113 · 2013: 132 · 2012: 160
- FWCI
- 113.04
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Multimedia Computing Communications and Applications (publishedVersion)
- UvA-DARE (University of Amsterdam) (publishedVersion)
- HAL (submittedVersion)
- Iris (University of Trento) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Analysis and Summarization
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Keywords
- multimedia browsing, multimedia retrieval, user study, affective computing, multimedia learning, semantic queries, indexing, evaluation techniques, media types
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.