Content-based multimedia information retrieval: State of the art and challenges
The DOI matches its Crossref record; 150 of the 152 references it cites were found in a registry or an index.
Abstract
Extending beyond the boundaries of science, art, and culture, content-based multimedia information retrieval provides new paradigms and methods for searching through the myriad variety of media all over the world. This survey reviews 100+ recent articles on content-based multimedia information retrieval and discusses their role in current research directions which include browsing and search paradigms, user studies, affective computing, learning, semantic queries, new features and media types, high performance indexing, and evaluation techniques. Based on the current state of the art, we discuss the major challenges for the future.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Similarly, given a diagnostically challenging WSI, retrieving a similar WSI via slide search5,46–53 or pathology reports through cross-modal report search10,54–56 typically requires specialized algorithms to bridge the gap between fine-grained patch embeddings and slide-level information, introducing hurdles to clinical adoption.”
From A multimodal whole-slide foundation model for pathology (2025) · cites this paper as [46]
Citations
Cites
Distinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
A Combined Corner and Edge Detector
Harris, C., & Stephens, M. (1988) · Procedings of the Alvey Vision Conference 1988 · doi:10.5244/c.2.23 · Cited by 12,901
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
A comparative study of texture measures with classification based on featured distributions
Ojala, T., Pietikäinen, M., & Harwood, D. (1996) · Pattern Recognition · doi:10.1016/0031-3203(95)00067-4 · Cited by 6,882
Content-based image retrieval at the end of the early years
Smeulders, A. W. M., Worring, M., Santini, S., Gupta, A., & Jain, R. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.895972 · Cited by 6,056
Self-citation2009 IEEE Conference on Computer Vision and Pattern Recognition
(2009) · doi:10.1109/cvpr14067.2009 · Cited by 5,550
Ballard, D. H., & Brown, C. M. (1982) · Cited by 5,303
Haralock, R. M., & Shapiro, L. G. (1991) · Addison-Wesley Longman Publishing Co., Inc. eBooks · Cited by 3,933
Scale & Affine Invariant Interest Point Detectors
Mikolajczyk, K., & Schmid, C. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000027790.02288.f2 · Cited by 3,436
Detecting faces in images: a survey
Yang, M.-H., Kriegman, D. J., & Ahuja, N. (2002) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.982883 · Cited by 3,427
Research works printed but not linked: 5
- Bach , J. R. , Fuller , C. , Gupta , A. , Hampapur , A. , Horowitz , B. , Humphrey , R. , Jain , R. , and Shu , C. F . 1996. Virage image search engine: An open framework for image management . In Proceedings of the SPIE Storage and Retrieval for Still Image and Video Databases. 76--87 .]] Bach, J. R., Fuller, C., Gupta, A., Hampapur, A., Horowitz, B., Humphrey, R., Jain, R., and Shu, C. F. 1996. Virage image search engine: An open framework for image management. In Proceedings of the SPIE Storage and Retrieval for Still Image and Video Databases. 76--87.]]
- Eiter T. and Libkin L. 2005. Database Theory. Springer London. UK.]] Eiter T. and Libkin L. 2005. Database Theory. Springer London. UK.]]
- Enser , P. G. B. and Sandom , C. J . 2003. Towards a comprehensive survey of the semantic gap in visual information retrieval . In Proceedings of the 2nd International Conference on Image and Video Retrieval. (July) , Urbana, IL, E. M. Bakker, T. S. Huang, M. S. Lew, N. Sebe and X. Zhou, Eds. Springer-Verlag, London, UK. 291--299.]] Enser, P. G. B. and Sandom, C. J. 2003. Towards a comprehensive survey of the semantic gap in visual information retrieval. In Proceedings of the 2nd International Conference on Image and Video Retrieval. (July), Urbana, IL, E. M. Bakker, T. S. Huang, M. S. Lew, N. Sebe and X. Zhou, Eds. Springer-Verlag, London, UK. 291--299.]]
- Lew , M. S. 2001. Principles of Visual Information Retrieval . Springer , London, UK .]] Lew, M. S. 2001. Principles of Visual Information Retrieval. Springer, London, UK.]]
- Tian , Q. , Moghaddam , B. , and Huang , T. S . 2002. Visualization, estimation and user-modeling . In Proceedings of the 1st International Conference on Image and Video Retrieval. (July) , London, UK, M. S. Lew, N. Sebe, and J. P. Eakins, Eds. Springer-Verlag, London, UK, 7--16.]] Tian, Q., Moghaddam, B., and Huang, T. S. 2002. Visualization, estimation and user-modeling. In Proceedings of the 1st International Conference on Image and Video Retrieval. (July), London, UK, M. S. Lew, N. Sebe, and J. P. Eakins, Eds. Springer-Verlag, London, UK, 7--16.]]
Cited by
Items 101–200 of 1,000
Unveiling the multimedia unconscious: implicit cognitive processes and multimedia content analysis
Cristani, M., Vinciarelli, A., Segalin, C., & Perina, A. (2013) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2502081.2502280 · Cited by 113
Content Based Video Retrieval Systems
Patel, B. V. (2012) · International Journal of UbiComp · doi:10.5121/iju.2012.3202 · Cited by 113
Unsupervised Hashing with Contrastive Information Bottleneck
Qiu, Z., Su, Q., Ou, Z., Yu, J., & Chen, C. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/133 · Cited by 112
Interactive search in image retrieval: a survey
Thomée, B., & Lew, M. S. (2012) · International Journal of Multimedia Information Retrieval · doi:10.1007/s13735-012-0014-4 · Cited by 112
Self-citationRobust image retrieval based on color histogram of local feature regions
Wang, X., Wu, J., & Yang, H. (2009) · Multimedia Tools and Applications · doi:10.1007/s11042-009-0362-0 · Cited by 111
Plant Image Retrieval Using Color, Shape and Texture Features
Kebapci, H., Yanikoglu, B. A., & Ünal, G. (2010) · The Computer Journal · doi:10.1093/comjnl/bxq037 · Cited by 111
Signature Quadratic Form Distance
Beecks, C., Uysal, M. S., & Seidl, T. (2010) · ACM International Conference on Image and Video Retrieval (CIVR) · doi:10.1145/1816041.1816105 · Cited by 110
Using affective parameters in a content-based recommender system for images
Tkalčič, M., Burnik, U., & Košir, A. (2010) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-010-9079-z · Cited by 108
Cross-media analysis and reasoning: advances and directions
Peng, Y., Zhu, W., Zhao, Y., Xu, C., Huang, Q., Lu, H., Zheng, Q., Huang, T., & Gao, W. (2017) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.1601787 · Cited by 108
Deep Multiscale Fusion Hashing for Cross-Modal Retrieval
Nie, X., Wang, B., Li, J., Hao, F., Jian, M., & Yin, Y. (2020) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2020.2974877 · Cited by 108
Finding meaning on YouTube: Tag recommendation and category discovery
Toderici, G. D., Aradhye, H. B., PAŞCA, M. A., Sbaiz, L., & Yagnik, J. (2010) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2010.5539985 · Cited by 107
Document Image Retrieval through Word Shape Coding
Lu, S., Li, L., & Tan, C. L. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.89 · Cited by 107
A Privacy-Preserving Framework for Large-Scale Content-Based Information Retrieval
Weng, L., Amsaleg, L., Morton, A., & Marchand‐Maillet, S. (2014) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2014.2365998 · Cited by 106
Local Structure-Based Region-of-Interest Retrieval in Brain MR Images
Ünay, D., Ekin, A., & Jasinschi, R. (2010) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2009.2038152 · Cited by 105
Play and Rewind: Optimizing Binary Representations of Videos by Self-Supervised Temporal Hashing
Zhang, H., Wang, M., Hong, R., & Chua, T. (2016) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/2964284.2964308 · Cited by 104
Movie genome: alleviating new item cold start in movie recommendation
Deldjoo, Y., Dacrema, M. F., Constantin, M. G., Eghbal-zadeh, H., Cereda, S., Schedl, M., Ionescu, B. E., & Cremonesi, P. (2019) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-019-09221-y · Cited by 103
Scott, G. J., Klaric, M. N., Davis, C. H., & Shyu, C. (2010) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2010.2088404 · Cited by 103
Online Multiple Kernel Similarity Learning for Visual Search
Xia, H., Hoi, S. C. H., Jin, R., & Zhao, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.149 · Cited by 99
Personality Based User Similarity Measure for a Collaborative Recommender System
Tkalčič, M. (2009) · Repository of the University of Ljubljana (University of Ljubljana) · Cited by 99
Hirability in the Wild: Analysis of Online Conversational Video Resumes
Nguyen, L. S., & Gática-Pérez, D. (2016) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2016.2557058 · Cited by 97
Semantic combination of textual and visual information in multimedia retrieval
Clinchant, S., Ah-Pine, J., & Csurka, G. (2011) · International Conference on Multimedia Retrieval · doi:10.1145/1991996.1992040 · Cited by 96
Toward Multimodal Cyberbullying Detection
Singh, V. K., Ghosh, S., & Jose, C. (2017) · Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/3027063.3053169 · Cited by 95
Multimodal Fusion for Video Search Reranking
Wei, S., Zhao, Y., Zhu, Z., & Liu, N. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.145 · Cited by 94
Semi-Supervised Nonlinear Hashing Using Bootstrap Sequential Projection Learning
Wu, C., Zhu, J., Cai, D., Chen, C., & Bu, J. (2012) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2012.76 · Cited by 92
Osteoporosis Prediction for Trabecular Bone using Machine Learning: A Review
Anam, M., Ponnusamy, V., Hussain, M., Nadeem, M. W., Awan, M. J., Goh, H. G., & Qadeer, S. (2021) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2021.013159 · Cited by 91
MultiTube--Where Web 2.0 and Multimedia Could Meet
Boll, S. (2007) · IEEE Multimedia · doi:10.1109/mmul.2007.17 · Cited by 91
A review of text and image retrieval approaches for broadcast news video
Yan, R., & Hauptmann, A. G. (2007) · Information Retrieval · doi:10.1007/s10791-007-9031-y · Cited by 91
The evolution of visual information retrieval
Enser, P. G. B. (2008) · Journal of Information Science · doi:10.1177/0165551508091013 · Cited by 91
Shrivastava, N., & Tyagi, V. (2013) · Information Sciences · doi:10.1016/j.ins.2013.08.043 · Cited by 90
Agullo, E., Buttari, A., Guermouche, A., & Lopez, F. (2016) · ACM Transactions on Mathematical Software · doi:10.1145/2898348 · Cited by 90
Internet visual media processing: a survey with graphics and vision applications
Hu, S., Chen, T., Xu, K., Cheng, M., & Martin, R. R. (2013) · The Visual Computer · doi:10.1007/s00371-013-0792-6 · Cited by 89
Convolutional Attention Networks for Scene Text Recognition
Xie, H., Fang, S., Zha, Z.-J., Yang, Y., Li, Y., & Zhang, Y. (2019) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3231737 · Cited by 88
Interactive Image Search by Color Map
Wang, J., & Hua, X. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/2036264.2036276 · Cited by 86
Qi, H., Li, K., Shen, Y., & Qu, W. (2010) · Pattern Recognition · doi:10.1016/j.patcog.2010.01.007 · Cited by 86
Secret-Fragment-Visible Mosaic Image–A New Computer Art and Its Application to Information Hiding
Lai, I.-J., & Tsai, W. (2011) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2011.2135853 · Cited by 86
Irie, G., Satou, T., Kojima, A., Yamasaki, T., & Aizawa, K. (2010) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2010.2051871 · Cited by 86
Spatio-temporal pyramid matching for sports videos
Choi, J., Jeon, W. J., & Lee, S. (2008) · Multimedia Information Retrieval · doi:10.1145/1460096.1460144 · Cited by 85
Sentic Album: Content-, Concept-, and Context-Based Online Personal Photo Management System
Cambria, E., & Hussain, A. (2012) · Cognitive Computation · doi:10.1007/s12559-012-9145-4 · Cited by 85
Reichert, J., Backes, A. R., Schubert, P., & Wilke, T. (2017) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12829 · Cited by 86
The Use of Ontology in Retrieval: A Study on Textual, Multilingual, and Multimedia Retrieval
Asim, M. N., Wasim, M., Khan, M. U. G., Mahmood, N., & Mahmood, W. (2019) · IEEE Access · doi:10.1109/access.2019.2897849 · Cited by 84
Online Multi-Modal Distance Metric Learning with Application to Image Retrieval
Wu, P., Hoi, S. C. H., Zhao, P., Miao, C., & Liu, Z.-Y. (2015) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2015.2477296 · Cited by 83
A comparative study of similarity measures for content-based multimedia retrieval
Beecks, C., Uysal, M. S., & Seidl, T. (2010) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2010.5582949 · Cited by 83
CrowdReranking: exploring multiple search engines for visual search reranking
Liu, Y., Mei, T., & Hua, X. (2009) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1571941.1572027 · Cited by 82
A nearest-neighbor approach to relevance feedback in content based image retrieval
Giacinto, G. (2007) · ACM International Conference on Image and Video Retrieval (CIVR) · doi:10.1145/1282280.1282347 · Cited by 82
MCEN: Bridging Cross-Modal Gap between Cooking Recipes and Dish Images with Latent Variable Model
Fu, H., Wu, R., Liu, C., & Sun, J. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.01458 · Cited by 82
Human Behavior Analysis for Highlight Ranking in Broadcast Racket Sports Video
Zhu, G., Huang, Q., Xu, C., Xing, L., Gao, W., & Yao, H. (2007) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2007.902847 · Cited by 81
3D shape retrieval using Kernels on Extended Reeb Graphs
Barra, V., & Biasotti, S. (2013) · Pattern Recognition · doi:10.1016/j.patcog.2013.03.019 · Cited by 81
Association and Temporal Rule Mining for Post-Filtering of Semantic Concept Detection in Video
Liu, K.-H., Weng, M.-F., Tseng, C.-Y., Chuang, Y., & Chen⋆, M.-S. (2008) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2007.911826 · Cited by 81
A survey of recent work on video summarization: approaches and techniques
Tiwari, V., & Bhatnagar, C. (2021) · Multimedia Tools and Applications · doi:10.1007/s11042-021-10977-y · Cited by 80
GPS Estimation for Places of Interest From Social Users' Uploaded Photos
Li, J., Qian, X., Tang, Y. Y., Yang, L., & Mei, T. (2013) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2013.2280127 · Cited by 79
Utilizing semantic word similarity measures for video retrieval
Aytar, Y., Shah, M. A., & Luo, J. (2008) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2008.4587822 · Cited by 79
Celik, C., & Bılge, H. Ş. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.03.006 · Cited by 80
A fast compression-based similarity measure with applications to content-based image retrieval
Cerra, D., & Datcu, M. P. (2011) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2011.10.009 · Cited by 76
A comparative study of Flickr tags and index terms in a general image collection
Rorissa, A. (2010) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21401 · Cited by 76
Learning Computational Models of Video Memorability from fMRI Brain Imaging
Han, J., Chen, C., Shao, L., Hu, X., Han, J., & Liu, T. (2014) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2014.2358647 · Cited by 75
Neighborhood rough sets based multi-label classification for automatic image annotation
Yu, Y., Pedrycz, W., & Miao, D. (2013) · International Journal of Approximate Reasoning · doi:10.1016/j.ijar.2013.06.003 · Cited by 75
Spectral Multimodal Hashing and Its Application to Multimedia Retrieval
Zhen, Y., Gao, Y., Yeung, D.-Y., Zha, H., & Li, X. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2015.2392052 · Cited by 73
Event recognition: viewing the world with a third eye
Luo, J., Yu, J., Joshi, D., & Hao, W. (2008) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/1459359.1459574 · Cited by 74
Technology in the 21st century: New challenges and opportunities
Sheng, J., Amankwah-Amoah, J., & Wang, X. (2019) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2018.06.009 · Cited by 73
NASH: Toward End-to-End Neural Architecture for Generative Semantic Hashing
Shen, D., Su, Q., Chapfuwa, P., Wang, W., Wang, G., Henao, R., & Carin, L. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1190 · Cited by 73
Multimedia Event Detection Using A Classifier-Specific Intermediate Representation
Ma, Z., Yang, Y., Sebe, N., Zheng, K., & Hauptmann, A. G. (2013) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2013.2264928 · Cited by 73
Self-citationGiveki, D., Soltanshahi, M. A., & Montazer, G. A. (2016) · Optik · doi:10.1016/j.ijleo.2016.11.046 · Cited by 74
Text‐based video content classification for online video‐sharing sites
Huang, C.-N., Fu, T., & Chen, H. (2010) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21291 · Cited by 73
Huang, X., Li, Z., Wang, C., & Ning, H. (2020) · International Journal of Digital Earth · doi:10.1080/17538947.2019.1633425 · Cited by 71
Corpus Development for Affective Video Indexing
Soleymani, M., Larson, M., Pun, T., & Hanjalić, A. (2014) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2014.2305573 · Cited by 70
Analysing user physiological responses for affective video summarisation
Money, A., & Agius, H. (2008) · Displays · doi:10.1016/j.displa.2008.12.003 · Cited by 71
Semantic Portals for Cultural Heritage
Hyvönen, E. (2009) · Springer eBooks · doi:10.1007/978-3-540-92673-3_34 · Cited by 71
Interactive Search or Sequential Browsing? A Detailed Analysis of the Video Browser Showdown 2018
Lokoč, J., Kovalčík, G., Münzer, B., Schoeffmann, K., Bailer, W., Gasser, R., Vrochidis, S., Nguyen, P. A., Rujikietgumjorn, S., & Barthel, K. U. (2019) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3295663 · Cited by 70
MSRA-MM: Bridging Research and Industrial Societies for Multimedia Information Retrieval
Wang, M., Yang, L., & Hua, X. (2009) · Cited by 70
Inferring generic activities and events from image content and bags of geo-tags
Joshi, D., & Luo, J. (2008) · ACM International Conference on Image and Video Retrieval (CIVR) · doi:10.1145/1386352.1386361 · Cited by 70
Image search—from thousands to billions in 20 years
Zhang, L., & Rui, Y. (2013) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/2490823 · Cited by 70
Rorissa, A. (2008) · Information Processing & Management · doi:10.1016/j.ipm.2008.03.004 · Cited by 69
Detecting objects in large image collections and videos by efficient subimage retrieval
Lampert, C. H. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459359 · Cited by 63
Landscape similarity, retrieval, and machine mapping of physiographic units
Jasiewicz, J., Netzel, P., & Stepinski, T. F. (2014) · Geomorphology · doi:10.1016/j.geomorph.2014.06.011 · Cited by 67
Content Based Image Indexing and RetrievalPreprint
Bhute, A. N., & Meshram, B. B. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1401.1742 · Cited by 67
Indexing of Remote Sensing Images With Different Resolutions by Multiple Features
Luo, B., Jiang, S., & Zhang, L. (2013) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2012.2228254 · Cited by 67
JustClick: Personalized Image Recommendation via Exploratory Search From Large-Scale Flickr Images
Fan, J., Keim, D. A., Gao, Y., Luo, H., & Li, Z. (2008) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2008.2009258 · Cited by 66
Can relevance of images be inferred from eye movements?
Klami, A., Saunders, C. J., de Campos, T. E., & Kaski, S. (2008) · Multimedia Information Retrieval · doi:10.1145/1460096.1460120 · Cited by 66
Pedronette, D. C. G., Gonçalves, F. M. F., & Guilherme, I. R. (2017) · Pattern Recognition · doi:10.1016/j.patcog.2017.05.009 · Cited by 65
A review on human action analysis in videos for retrieval applications
Ramezani, M., & Yaghmaee, F. (2016) · Artificial Intelligence Review · doi:10.1007/s10462-016-9473-y · Cited by 64
Popularity prediction of movies: from statistical modeling to machine learning techniques
Abidi, S. M. R., Xu, Y., Ni, J., Wang, X., & Wu, Z. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-019-08546-5 · Cited by 64
Wason, R., Jain, V. K., Narula, G. S., & Balyan, A. (2019) · Iran Journal of Computer Science · doi:10.1007/s42044-019-00030-5 · Cited by 63
Towards brain-activity-controlled information retrieval: Decoding image relevance from MEG signals
Kauppi, J., Kandemir, M., Saarinen, V.-M., Hirvenkari, L., Parkkonen, L. T., Klami, A., Hari, R., & Kaski, S. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2014.12.079 · Cited by 62
Raza, S., Sapkota, R., Karkee, M., & Emmanouilidis, C. (2026) · AI Open · doi:10.1016/j.aiopen.2026.02.006 · Cited by 57
Partially Supervised Speaker Clustering
Tang, H., Chu, S. M., Hasegawa‐Johnson, M., & Huang, T. S. (2011) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2011.174 · Cited by 57
Multimodal Content Analysis for Effective Advertisements on YouTube
Vedula, N., Sun, W., Lee, H., Gupta, H., Ogihara, M., Johnson, J., Ren, G., & Parthasarathy, S. (2017) · Proceedings · doi:10.1109/icdm.2017.149 · Cited by 57
Advanced Information Retrieval
Ren, F., & Bracewell, D. B. (2009) · Electronic Notes in Theoretical Computer Science · doi:10.1016/j.entcs.2008.12.082 · Cited by 56
Secure and robust image hashing via compressive sensing
Sun, R., & Zeng, W. (2012) · Multimedia Tools and Applications · doi:10.1007/s11042-012-1188-8 · Cited by 55
Robust Web Image Annotation via Exploring Multi-Facet and Structural Knowledge
Hu, M., Yang, Y., Shen, F., Zhang, L., Shen, H. T., & Li, X. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2717185 · Cited by 54
Recognizing and Presenting the Storytelling Video Structure With Deep Multimodal Networks
Baraldi, L., Grana, C., & Cucchiara, R. (2016) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2016.2644872 · Cited by 54
Deep Collaborative Discrete Hashing With Semantic-Invariant Structure Construction
Wang, Z., Zhang, Z., Luo, Y., Huang, Z. H., & Shen, H. T. (2020) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2020.2995267 · Cited by 54
Combining similarity measures in content-based image retrieval
Arevalillo‐Herráez, M., Domingo, J., & Ferri, F. J. (2008) · Pattern Recognition Letters · doi:10.1016/j.patrec.2008.08.003 · Cited by 54
Schoeffmann, K., Taschwer, M., & Boeszoermenyi, L. (2010) · ACM Multimedia Systems Conference (MMSys) · doi:10.1145/1730836.1730867 · Cited by 54
Rotation Invariant Curvelet Features for Region Based Image Retrieval
Zhang, D., Islam, M. M., Lu, G., & Sumana, I. J. (2011) · International Journal of Computer Vision · doi:10.1007/s11263-011-0503-6 · Cited by 53
SocioNet: A Social-Based Multimedia Access System for Unstructured P2P Networks
Lin, K. C., Wang, C.-P., Chou, C., & Golubchik, L. (2009) · IEEE Transactions on Parallel and Distributed Systems · doi:10.1109/tpds.2009.134 · Cited by 53
Spatial-Semantic Image Search by Visual Feature Synthesis
Mai, L., Jin, H., Lin, Z., Chen, F., Brandt, J., & Liu, F. (2017) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2017.125 · Cited by 53
Content-based tag processing for Internet social images
Liu, D., Hua, X., & Zhang, H.-J. (2010) · Multimedia Tools and Applications · doi:10.1007/s11042-010-0647-3 · Cited by 52
A Statistical Framework for Image Category Search from a Mental Picture
Ferecatu, M., & Geman, D. (2008) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2008.259 · Cited by 52
Automatic summarization of soccer highlights using audio-visual descriptors
Raventós, A., Quijada, R., Torres, L., & Tarrés, F. (2015) · SpringerPlus · doi:10.1186/s40064-015-1065-9 · Cited by 51
Xu, H., Wang, J., Hua, X., & Li, S. (2010) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1835449.1835497 · Cited by 51
Metadata
- Authors
- Lew, M. S., Sebe, N., Djeraba, C., & Jain, R.
- Affiliations
- Leiden University (NL)
- University of Amsterdam (NL)
- Laboratoire d'Informatique Fondamentale de Lille (FR)
- University of California, Irvine (US)
- Venue
- ACM Transactions on Multimedia Computing, Communications, and Applications
- Published
- 2006-02
- Volume
- 2
- Issue
- 1
- Pages
- 1-19
- ISSN
- 1551-6857 (ISSN-L)
- 1551-6865
- OpenAlex
- W2147069236
- Semantic Scholar
- cabe73e89b6389a163393ecbf1b82d20ba4ea10f
- Cited by
- 1,528
- References
- 152
- Citations by year
- 2026: 17 · 2025: 13 · 2024: 20 · 2023: 25 · 2022: 18 · 2021: 31 · 2020: 34 · 2019: 58 · 2018: 64 · 2017: 88 · 2016: 77 · 2015: 102 · 2014: 113 · 2013: 132 · 2012: 160
- FWCI
- 113.04
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Multimedia Computing Communications and Applications (publishedVersion)
- UvA-DARE (University of Amsterdam) (publishedVersion)
- HAL (submittedVersion)
- Iris (University of Trento) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Video Analysis and Summarization
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Keywords
- multimedia browsing, multimedia retrieval, user study, affective computing, multimedia learning, semantic queries, indexing, evaluation techniques, media types
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.